Program for MT Summit 2025 Tutorial
Understanding Large Language Model-Generated Translations:
How Can They Adapt to Different Translation Specifications and Pass the Translation Turing Test?
Monday, 23 June (9 am – 12.30 pm)
9:00 Session 1: The Translation Turing Test
- Language industry practice and rationale behind the TTT (including the original Turing Test)
- Importance of project management in translation
- Translation standards ASTM F2575, ISO 116900
- MQM & TQE Intro
- The Translation Turing Test
- 3 parts of the TTT:
- ST negotiation client with PM (specification)
- TT evaluation (TT quality assessment)
- TT negotiation client with PM (complaint)
- Experimental setup
- Roles play by participants
- Training the ChatGPT agent
9:45 Session 2: Requester-Provider Negotiations
- Project Managers (PMs) present themselves
- Round 1: ST negotiation
- Instructions
- Paper trail review:
- PM Evaluation Survey
- Partial TTT
10:30 Break 30 mins
11:00 Session 3 Translation Quality Evaluation
- General introduction to MQM, quality evaluation, and how it relates to the TTT
- Evaluation of French translations with MQM
- MQM Tools
- Perfectionist
- Formulating translation complaints
- TPR-DB+Syntactic Complexity
11:45 Session 4 TT negotiation
- Round 2: TT negotiation
- Paper trail review (PM index numbers don’t correspond to round 1 negotiations):
- PM Evaluation Survey
- Expert evaluation
- Final discussion