Catch our Google Translate Research team at #EMNLP #WMT24! The team will present 9 papers on step-by-step decoding, mitigating metric bias within MBR decoding (+ MBR dataset release), improved human data collection and automatic metrics (MetricX: winner of WMT Metrics Task). Eleftheria Briakou Mara Finkelstein Daniel Deutsch David Vilar Torres Jurik Juraska Zhongtao Liu and I will be at the conference! Come chat with us about what we're working on and any job opportunities on our team (we are hiring junior researchers in Mountain View https://lnkd.in/d9Rxk5vb). Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Texts https://lnkd.in/dHSz6ZwA Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Data https://lnkd.in/dV8QY9GT Mitigating Metric Bias in Minimum Bayes Risk Decoding https://lnkd.in/dDYbMeju Beyond Human-Only: Evaluating Human-Machine Collaboration for Collecting High-Quality Translation Data https://lnkd.in/dPAuBqmb MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task https://lnkd.in/d6k2MW4h Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy https://lnkd.in/d4ESBWr8 Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task https://lnkd.in/d9AuRSsR Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet https://lnkd.in/dGRp-SKt Findings of the Quality Estimation Shared Task at WMT 2024: Are LLMs Closing the Gap in QE? https://lnkd.in/dB-QHpTv
Impressive!!! I wish I was there. I will send students to talk to you and your team at EMNLP.
M.Sc.
1wGreat work, Markus