Program for MT Summit 2025 Tutorial
Understanding Large Language Model-Generated Translations:
How Can They Adapt to Different Translation Specifications and Pass the Translation Turing Test?
Monday, 23 June (9 am – 12.30 pm)
9:00 Session 1: The Translation Turing Test (45 mins)
Language industry practice and rational of the TTT
The original Turing test
Importance of Project Management
3 parts of the TTT:
ST negotiation client with PM (specification)
TT evaluation (TT quality assessment)
TT negotiation client with PM (complaint)
Experimental setup
9:45 Session 2: Requester-Provider Negotiations (45 mins)
Project Managers (PMs) present themselves (15 mins)
Round 1: ST negotiation (25 mins)
Partial TTT (5 mins)
10:30 Break 30 mins
11:00 Session 3 Translation Quality Evaluation (45 mins)
General introduction to quality evaluation and how it relates to the TTT (5 mins)
Evaluation of French translations (20 mins)
TPR-DB+Syntactic Complexity (15 mins)
Formulating translation complaints (5 mins)
11:45 Session 4 TT negotiation
Round 2: TT negotiation (25 mins)
Expert evaluation (10 mins)
Final discussion (10 mins)
12:30 End