Program for MT Summit 2025 Tutorial

Understanding Large Language Model-Generated Translations:  
How Can They Adapt to Different Translation Specifications and Pass the Translation Turing Test? 

Monday, 23 June (9 am – 12.30 pm) 

9:00 Session 1: The Translation Turing Test (45 mins) 

  • Language industry practice and rational of the TTT 

  • The original Turing test 

  • Importance of Project Management 

  • 3 parts of the TTT:  

  • ST negotiation client with PM (specification) 

  • TT evaluation (TT quality assessment) 

  • TT negotiation client with PM (complaint) 

  • Experimental setup  

9:45 Session 2: Requester-Provider Negotiations (45 mins) 

  • Project Managers (PMs) present themselves (15 mins) 

  • Round 1: ST negotiation (25 mins) 

  • Partial TTT (5 mins) 

10:30 Break 30 mins 

11:00 Session 3 Translation Quality Evaluation (45 mins) 

  • General introduction to quality evaluation and how it relates to the TTT (5 mins) 

  • Evaluation of French translations (20 mins) 

  • TPR-DB+Syntactic Complexity (15 mins)

  • Formulating translation complaints (5 mins) 

11:45 Session 4 TT negotiation  

  • Round 2: TT negotiation (25 mins)  

  • Expert evaluation (10 mins) 

  • Final discussion (10 mins)

12:30 End