Projects
I have contributed to several large collaborative projects, such as ParaCrawl, HPLT, MaLA, and UTTER, on open-source web-scale multilingual resource provision, including data, tools, and models.
I have been very fortunate to work with many wonderful people on various smaller research projects: machine translation, summarization, multilingual and cross-lingual methods, and LLMs, e.g. agentic systems, long-context modelling, reward modelling, multi-modality, and trustworthy evaluation.
Recent Preprints
- Dayyán O'Brien, Bhavitvya Malik, Ona de Gibert, Pinzhen Chen, Barry Haddow, and Jörg Tiedemann. DocHPLT: A massively multilingual document-level translation dataset. arXiv 2025.
- Xiao Zhu, Chenmien Tan, Pinzhen Chen, Rico Sennrich, Yanlin Zhang, and Hanxu Hu. CHARM: Calibrating reward models with Chatbot Arena scores. arXiv 2025.
- Vivek Iyer, Ricardo Rei, Pinzhen Chen, and Alexandra Birch. XL-Instruct: Synthetic data for cross-lingual open-ended generation. arXiv 2025.
- Wenhao Zhu, Pinzhen Chen, Hanxu Hu, Shujian Huang, Fei Yuan, Jiajun Chen, and Alexandra Birch. Generalizing from short to long: Effective data synthesis for long-context instruction tuning. arXiv 2025.
- Shaoxiong Ji, Zihao Li, Indraneil Paul, Jaakko Paavola, Peiqin Lin, Pinzhen Chen, Dayyán O'Brien, Hengyu Luo, Hinrich Schütze, Jörg Tiedemann, and Barry Haddow. EMMA-500: Enhancing massively multilingual adaptation of large language models. arXiv 2024.
Selected Publications
- Laurie Burchell, Ona de Gibert, Nikolay Arefyev, Mikko Aulamo, Marta Bañón, Pinzhen Chen, Mariia Fedorova, Liane Guillou, Barry Haddow, Jan Hajič, Jindřich Helcl, Erik Henriksson, Mateusz Klimaszewski, Ville Komulainen, Andrey Kutuzov, Joona Kytöniemi, Veronika Laippala, Petter Mæhlum, Bhavitvya Malik, Farrokh Mehryary, Vladislav Mikhailov, Nikita Moghe, Amanda Myntti, Dayyán O'Brien, Stephan Oepen, Proyag Pal, Jousia Piha, Sampo Pyysalo, Gema Ramírez-Sánchez, David Samuel, Pavel Stepachev, Jörg Tiedemann, Dušan Variš, Tereza Vojtěchová, and Jaume Zaragoza-Bernabeu. An expanded massive multilingual dataset for high-performance language technologies. ACL 2025.
- Hanxu Hu, Simon Yu, Pinzhen Chen, and Edoardo M. Ponti. Fine-tuning large language models with sequential instructions. NAACL 2025.
- Mateusz Klimaszewski, Pinzhen Chen, Liane Guillou, Ioannis Papaioannou, Barry Haddow, and Alexandra Birch. AveniBench: Accessible and versatile evaluation of finance intelligence. FinNLP 2025.
- Shaoxiong Ji and Pinzhen Chen. How many languages make good multilingual instruction tuning? A case study on BLOOM. COLING 2025.
- Pinzhen Chen, Simon Yu, Zhicheng Guo, and Barry Haddow. Is it good data for multilingual instruction tuning or just bad multilingual evaluation for large language models?. EMNLP 2024.
- Dawei Zhu, Pinzhen Chen, Miaoran Zhang, Barry Haddow, Xiaoyu Shen, and Dietrich Klakow. Fine-tuning large language models to translate: Will a touch of noisy data in misaligned languages suffice?. EMNLP 2024.
- Vilém Zouhar, Pinzhen Chen, Tsz Kin Lam, Nikita Moghe, and Barry Haddow. Pitfalls and outlooks in using COMET. WMT 2024.
- Pinzhen Chen, Shaoxiong Ji, Nikolay Bogoychev, Andrey Kutuzov, Barry Haddow, and Kenneth Heafield. Monolingual or multilingual instruction tuning: Which makes a better Alpaca. EACL Findings 2024.
- Nikolay Bogoychev, Pinzhen Chen, Barry Haddow, and Alexandra Birch. The ups and downs of large language model inference with vocabulary trimming by language heuristics. Insights 2024. Best paper.
- Pinzhen Chen, Zhicheng Guo, Barry Haddow, and Kenneth Heafield. Iterative translation refinement with large language models. EAMT 2024.
- Zhanghao Hu, Yijun Yang, Junjie Xu, Yifu Qiu, and Pinzhen Chen. EEE-QA: Exploring effective and efficient question-answer representations. LREC-COLING 2024.
- Ashok Urlana, Pinzhen Chen, Zheng Zhao, Shay B. Cohen, Manish Shrivastava, and Barry Haddow. PMIndiaSum: Multilingual and cross-lingual headline summarization for languages in India. EMNLP Findings 2023.
- Pinzhen Chen and Gerasimos Lampouras. Exploring data augmentation for code generation tasks. EACL Findings 2023.
- Pinzhen Chen and Zheng Zhao. Edinburgh at SemEval-2022 Task 1: Jointly fishing for word embeddings and definitions. SemEval 2022. Best paper honourable mention and winning system.
- Pinzhen Chen and Zheng Zhao. A unified model for reverse dictionary and definition modelling. AACL-IJCNLP 2022.
- Pinzhen Chen and Kenneth Heafield. Approaching neural Chinese word segmentation as a low-resource machine translation task. PACLIC 2022. Best paper.
- Nikolay Bogoychev and Pinzhen Chen. The highs and lows of simple lexical domain adaptation approaches for neural machine translation. Insights 2021.
- Pinzhen Chen, Nikolay Bogoychev, Kenneth Heafield, and Faheem Kirefu. Parallel sentence mining by constrained decoding. ACL 2020.
- Marta Bañón, Pinzhen Chen, Barry Haddow, Kenneth Heafield, Hieu Hoang, Miquel Esplà-Gomis, Mikel L. Forcada, Amir Kamran, Faheem Kirefu, Philipp Koehn, Sergio Ortiz Rojas, Leopoldo Pla Sempere, Gema Ramírez-Sánchez, Elsa Sarrías, Marek Strelec, Brian Thompson, William Waites, Dion Wiggins, and Jaume Zaragoza. ParaCrawl: Web-scale acquisition of parallel corpora. ACL 2020.