avatar

Nuno M. Guerreiro

Ph.D. Student
Instituto Superior Técnico
miguelguerreironuno (at) gmail.com


About Me

I’m currently a research scientist at Unbabel, and a graduate student at Instituto Superior Técnico, University of Lisbon, supervised by André F.T. Martins. My research revolves around the study of hallucinations and failure modes in Neural Machine Translation (NMT), automatic evaluation for machine translation, and interpretability of models of language.

News

• February 2024: Release of Tower, an open multilingual LLM for translation-related tasks.
• February 2024: Release of CroissantLLM, a fully-open 1.3B language model pretrained on a set of 3T English and French tokens.
• October 2023: New paper on transparent machine translation evaluation, xCOMET, the winner of the WMT 2023 Metrics Shared Task
• September 2023: Co-led the winning submission to the WMT 2023 Metrics Shared Task to be held at EMNLP 2023
• September 2023: Co-led the winning submission to the WMT 2023 Shared Task on Quality Estimation to be held at EMNLP 2023
• August 2023: Paper accepted at TACL
• August 2023: Talk at MT Marathon Europe 2023, Tartu, Estonia
• July 2023: Talk at Apple Machine Translation Seminar
• July 2023: Talk at the UTTER User Day, 2023
• July 2023: Joined Unbabel as a Research Scientist
• June 2023: Talk at MT Marathon in the Americas 2023, Fairfax, VA
• June 2023: Talk at CNRS, Université Paris-Sud, Paris
• June 2023: Talk at CentraleSupélec, Université Paris-Saclay, Paris

Selected Publications

    * = equal contribution
  1. Tower: An Open Multilingual Large Language Model for Translation-Related Tasks
    Duarte M. Alves (*), José Pombal (*), Nuno M. Guerreiro (*), Pedro H. Martins, João Alves, Amin Farajian, Ben Peters, Ricardo Rei, Patrick Fernandes, Sweta Agrawal, Pierre Colombo, José G.C. de Souza, André F.T. Martins
    arXiv (preprint), 2024.
    PDF Code
  2. CroissantLLM: A Truly Bilingual French-English Language Model
    Manuel Faysse (*), Patrick Fernandes (*), Nuno M. Guerreiro (*), António Loison, Duarte M. Alves, Caio Corro, Nicolas Boizard, João Alves, Ricardo Rei, Pedro H. Martins, Antoni Bigata Casademunt, François Yvon, André F.T. Martins, Gautier Viaud, Céline Hudelot, Pierre Colombo (*)
    arXiv (preprint), 2024.
    PDF Code
  3. xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection
    Nuno M. Guerreiro (*), Ricardo Rei (*), Daan van Stigt, Luisa Coheur, Pierre Colombo, André F.T. Martins
    arXiv (preprint), 2023.
    PDF Code
  4. Scaling up CometKiwi: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task
    Ricardo Rei, Nuno M. Guerreiro (*), José Pombal, Daan van Stigt, Marcos Treviso, Luisa Coheur, José G.C. de Souza, André F.T. Martins
    Conference on Machine Translation (WMT), @EMNLP2023.
    PDF Code
  5. Hallucinations in Large Multilingual Translation Models
    Nuno M. Guerreiro, Duarte M. Alves, Jonas Waldendorf, Barry Haddow, Alexandra Birch, Pierre Colombo, André F. T. Martins
    Transactions of the Association for Computacional Linguistics (TACL), 2023.
    PDF Code
  6. Optimal Transport for Unsupervised Hallucination Detection in Neural Machine Translation
    Nuno M. Guerreiro, Pierre Colombo, Pablo Piantanida, André F.T. Martins
    Annual Meeting of the Association for Computational Linguistics (ACL), 2023.
    PDF Code
  7. The Inside Story: Towards Better Understanding of Machine Translation Neural Evaluation Metrics
    Ricardo Rei, Nuno M. Guerreiro (*), Marcos Treviso, André F.T. Martins
    Annual Meeting of the Association for Computational Linguistics (ACL), 2023.
    PDF Code
  8. CREST: A Joint Framework for Rationalization and Counterfactual Text Generation
    Marcos Treviso, Alexis Ross, Nuno M. Guerreiro, André F.T. Martins
    Annual Meeting of the Association for Computational Linguistics (ACL), 2023.
    PDF Code
  9. Looking for a Needle in a Haystack:
    A Comprehensive Study of Hallucinations in Neural Machine Translation
    Nuno M. Guerreiro, Elena Voita, André F.T. Martins
    Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023.
    PDF Code
  10. CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task
    Ricardo Rei (*), Marcos Treviso (*), Nuno M. Guerreiro (*), Chrysoula Zerva (*), Ana C. Farinha, Christine Maroti, José G. C. de Souza, Taisiya Glushkova, Duarte M. Alves, Alon Lavie, Luisa Coheur, André F. T. Martins
    Conference on Machine Translation (WMT), @EMNLP2022.
    PDF Code
  11. SPECTRA: Sparse Structured Text Rationalization
    Nuno M. Guerreiro, André F. T. Martins
    Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021.
    PDF Code
  12. IST-Unbabel 2021 Submission for the Explainable Quality Estimation Shared Task
    Marcos Treviso, Nuno M. Guerreiro, Ricardo Rei, André F. T. Martins
    Workshop on Evaluation and Comparison of NLP Systems (Eval4NLP), @EMNLP2021.
    PDF Code


Powered by Jekyll and Minimal Light theme.