Sheila Castilho
Dr.
Sheila Castilho is an Assistant Professor at the School of Applied Language and Intercultural Studies (SALIS) at Dublin City University, and served as the programme chair of the Master in translation Studies and the Master in Translation Technology from 2022-2025.
She holds a degree in Linguistics and Education from UNIOESTE (Brazil), a joint Erasmus Mundus Master’s degree in Natural Language Processing from the University of Wolverhampton (UK) and the University of Algarve (Portugal), and completed her PhD at Dublin City University in 2016.
She was previously an Irish Research Council Research Fellow at the ADAPT Centre, where she worked on the DELA project, focusing on document-level machine translation evaluation and the extension of sentence-level human and automatic metrics to more context-aware evaluation settings. She has also been involved in several EU-funded and international projects, including TraMOOC and iADAATPA, addressing translation technologies, accessibility, and educational and audiovisual translation. She is currently involved in the LT-LiDER project, contributing to the development of an open-access textbook aimed at supporting translation trainers in integrating language technologies and AI into teaching practice. She is also the coordinator of the CHIST-ERA project OSCAIL (Open Science Communication through AI in EU Languages), which explores the use of AI to support multilingual and accessible science communication.
She has served on the programme committees of major machine translation and NLP conferences, including ACL, EMNLP, WMT, RANLP, EAMT, and COLING, and has acted as reviewer for leading journals such as Machine Translation, Natural Language Engineering, Language Resources and Evaluation, and JoSTrans. She has served as Senior Area Chair for EMNLP and participated in the WMT Metrics shared task. She has authored over 70 peer-reviewed publications, including journal articles and book chapters, on machine translation, post-editing, translation quality assessment, usability, and human- and user-centred evaluation. She is co-editor of the volume Translation Quality Assessment: From Principles to Practice (Springer, 2018) and has co-edited several journal special issues, including ‘Human Factors in Neural Machine Translation’ (Machine Translation, 2019), ‘Translation Automation and Sustainability’ (JoSTrans, 2024), and ‘The Role of Context in Neural Machine Translation Systems and its Evaluation’ (Natural Language Engineering, 2025). She was co-chair of the conference New Trends in Translation Technology (NeTTT2022).
Her research interests include machine translation and post-editing, machine and human translation evaluation, document-level and context-aware MT, usability and translation technologies, as well as AI and large language models in translation, with a particular focus on style, creativity, hallucination, multimodality, and sustainability in translation evaluation.
Full publication list: https://scholar.google.com/citations?hl=en&user=mANFFWIAAAAJ&pagesize=80&view_op=list_works&sortby=pubdate
Book Chapter
| Year | Publication | |
|---|---|---|
| 2026 | Joss Moorkens and Sheila Castilho (2026) 'Translation Quality' In: International Encyclopedia of Language and Linguistics. online : Elsevier. [Link] | |
| 2023 | Sheila Castilho; Helena de Medeiros Caseli (2023) 'Tradução Automática' In: Processamento de Linguagem Natural: Conceitos, Técnicas e Aplicações em Português. São Carlos, Brasil : BPLN. [Link] | |
| 2018 | Sheila Castilho; Stephen Doherty; Federico Gaspari; Joss Moorkens (2018) 'Approaches to Human and Machine Translation Quality Assessment' In: Translation Quality Assessment From Principles to Practice. Cham : Springer. [Link] https://doi.org/10.1007/978-3-319-91241-7_2 | |
| 2018 | Joss Moorkens; Sheila Castilho; Federico Gaspari; Stephen Doherty (2018) 'Introduction: Translation Quality Assessment' In: TRANSLATION QUALITY ASSESSMENT: FROM PRINCIPLES TO PRACTICE. Cham : Springer. [Link] https://doi.org/10.1007/978-3-319-91241-7_1 | |
| 2018 | Stephen Doherty; Joss Moorkens; Federico Gaspari; Sheila Castilho (2018) 'On education and training in Translation Quality Assessment' In: Translation Quality Assessment From Principles to Practice. Cham : Springer. [Link] [DOI] |
Peer Reviewed Journal
| Year | Publication | |
|---|---|---|
| 2025 | Sheila Castilho (2025) 'Bringing context into mt evaluation: Translator training insights from the classroom'. INFORMATION, . [Link] [DOI] | |
| 2025 | Sheila Castilho; Rebecca Knowles (2025) 'A survey of context in neural machine translation and its evaluation'. NATURAL LANGUAGE PROCESSING, 31 (4):986-1016. [Link] https://doi.org/10.1017/nlp.2024.7 | |
| 2022 | Petra Bago; Sheila Castilho; Edoardo Celeste; Jane Dunne; Federico Gaspari; Níels Rúnar Gíslason; Andre Kåsen; Filip Klubička; Gauti Kristmannsson; Helen McHugh; Róisín Moran; Órla Ní Loinsigh; Jon Arild Olsen; Carla Parra Escartín; Akshai Ramesh; Natalia Resende; Páraic Sheridan; Andy Way (2022) 'Sharing high-quality language resources in the legal domain to develop neural machine translation for under-resourced European languages'. Revista de Llengua i Dret (Journal of Language and Law), 78 :9-34. [Link] [DOI] | |
| 2022 | Castilho, S.; Resende, N. (2022) 'Post-Editese in Literary Translations'. Information Switzerland, 13 . [Link] [DOI] | |
| 2020 | Samuel Läubli; Sheila Castilho; Graham Neubig; Rico Sennrich; Qinlan Shen; Antonio Toral (2020) 'A Set of Recommendations for Assessing Human–Machine Parity in Language Translation'. Journal of Artificial Intelligence Research, . [Link] [DOI] | |
| 2019 | (2019) 'Challenge test sets for MT evaluation'. Proceedings of Machine Translation Summit XVII Volume 3: Tutorial Abstracts, Dublin, Ireland. European Association for Machine Translation, . | |
| 2018 | Moorkens, J., Toral, A., Castilho, S., Way, A. (2018) 'Translator's Perceptions of Literary Post-editing using Statistical and Neural Machine Translation'. TRANSLATION SPACES, 7 (2):240-262. [Link] [DOI] | |
| 2018 | (2018) 'Acceptability of machine-translated content: A multi-language evaluation by translators and end-users'. Linguistica Antverpiensia, New Series--Themes in Translation Studies, . [DOI] | |
| 2018 | Castilho, Sheila; Doherty, Stephen; Gaspari, Federico; Moorkens, Joss (2018) 'Approaches to Human and Machine Translation Quality Assessment'. TRANSLATION QUALITY ASSESSMENT: FROM PRINCIPLES TO PRACTICE, 1 . [DOI] | |
| 2018 | Castilho, S.; Moorkens, J.; Gaspari, F.; Sennrich, R.; Way, A.; Georgakopoulou, P. (2018) 'Evaluating MT for massive open online courses: A multifaceted comparison between PBSMT and NMT systems'. Machine Translation, 32 . [Link] [DOI] | |
| 2017 | Castilho, Sheila; O'Brien, Sharon (2017) 'Acceptability of machine-translated content: A multi-language evaluation by translators and end-users'. LINGUISTICA ANTVERPIENSIA NEW SERIES-THEMES IN TRANSLATION STUDIES, 16 . | |
| 2017 | (2017) 'Acceptability of Machine Translated Content: A Multi-Language Evaluation by Translators and End Users'. Linguistica Antverpiensia, . [Link] | |
| 2016 | (2016) 'A comparative evaluation of phrase-based statistical and neural machine translation'. Presentation at Translating and the Computer, . | |
| 2016 | Cadwell, P., Castilho, S., O’Brien, S., and Mitchell, L. (2016) 'Human Factors in Machine Translation and Post-Editing among Institutional Translators'. TRANSLATION SPACES, 5 (2):222-243. [DOI] | |
| 2016 | (2016) 'Human factors in machine translation and post-editing among institutional translators'. TRANSLATION SPACES, . [Link] | |
| 2016 | (2016) 'Content profiling and translation scenarios'. The Journal of Internationalization and Localization, . | |
| 2014 | (2014) 'Does post-editing increase usability? A study with Brazilian Portuguese as Target Language'. . |
Other Journal
| Year | Publication | |
|---|---|---|
| 2017 | Sheila Castilho; Joss Moorkens; Federico Gaspari; Iacer Calixto; John Tinsley; Andy Way (2017) 'Is Neural Machine Translation the New State of the Art?' The Prague Bulletin of Mathematical Linguistics, :109-120. [Link] | |
| 2026 | Narongdej Phanthaphoommee; Wichaya Pidchamook; Sheila Castilho; Joss Moorkens (2026) 'Empowering Migrant Communities through Machine Translation Literacy: A Pathway to Socio-Economic Inclusion' Journal of Ethnic and Cultural Studies, . [Link] [DOI] | |
| 2024 | Joss Moorkens; Sheila Castilho; Federico Gaspari; Antonio Toral; Maja Popovic (2024) 'Proposal for a Triple Bottom Line for Translation Automation and Sustainability: An Editorial Position Paper' The Journal of Specialised Translation, 41 . [Link] [DOI] |
Other Publication
| Year | Publication | |
|---|---|---|
| 2020 | Läubli, S.; Castilho, S.; Neubig, G.; Sennrich, R.; Shen, Q.; Toral, A. (2020) A set of recommendations for assessing human-machine parity in language translation. [Link] [DOI] | |
| 2019 | (2019) Chan Sin-Wai (ed): The human factor in machine translation. | |
| 2019 | Sheila Castilho; Federico Gaspari; Joss Moorkens; Maja Popović; Antonio Toral (2019) Editors’ foreword to the special issue on human factors in neural machine translation. [Link] [DOI] |
Conference Publication
| Year | Publication | |
|---|---|---|
| 2024 | Sami Haq; Rudali Huidrom; Sheila Castilho (2024) Proceedings of the Ninth Conference on Machine Translation Dcu adapt at wmt24: English to low-resource multi-modal translation task [Link] [DOI] | |
| 2025 | Sheila Castilho; Zoe Fitzsimmons; Claire Holton; Aoife Mc Donagh (2025) Proceedings of Machine Translation Summit XX: Volume 1 Synthetic Fluency: Hallucinations, Confabulations, and the Creation of IrishWords in LLM-Generated Translations [Link] | |
| 2025 | Antonio Castaldo; Sheila Castilho; Joss Moorkens; Johanna Monti (2025) Proceedings of Machine Translation Summit XX: Volume 2 UniOr PET: An Online Platform for Translation Post-Editing [Link] | |
| 2025 | Sami Ul Haq; Chinonso Osuji; Sheila Castilho; Brian Davis; Thiago Castro Ferreira (2025) Proceedings of the Tenth Conference on Machine Translation Long-context Reference-based MT Quality Estimation [Link] [DOI] | |
| 2025 | Sami Ul Haq; Sheila Castilho; Yvette Graham (2025) Proceedings of the Tenth Conference on Machine Translation Audio-based Crowd-sourced Evaluation of Machine Translation Quality [Link] [DOI] | |
| 2025 | Antonio Castaldo; Sheila Castilho; Joss Moorkens; Johanna Monti (2025) Proceedings of Machine Translation Summit XX: Volume 1 Extending CREAMT: Leveraging Large Language Models for Literary Translation Post-Editing Geneva, Switzerland, [Link] | |
| 2024 | João Cavalheiro Camargo; Sheila Castilho; Joss Moorkens (2024) Proceedings of the European Association for Machine Translation Perceptions of Educators on MTQA Curriculum and Instruction Sheffield, UK, 24/06/2024- 27/06/2024 | |
| 2023 | Castilho, S.; Mallon, C.; Meisterr, R.; Yue, S. (2023) Proceedings of the 24th Annual Conference of the European Association for Machine Translation Eamt 2023 Do online Machine Translation Systems Care for Context? What About a GPT Model? [Link] | |
| 2022 | Castilho, S. (2022) Eamt 2022 Proceedings of the 23rd Annual Conference of the European Association for Machine Translation DELA Project: Document-level Machine Translation Evaluation [Link] | |
| 2021 | Castilho, S. (2021) 5th Conference on Machine Translation Wmt 2020 Proceedings On the Same Page? Comparing Inter-Annotator Agreement in Sentence and Document Level Human Machine Translation Evaluation [Link] | |
| 2021 | (2021) European Chapter of the Association for Computational Linguistics - EACL 2021 Towards document-level human MT evaluation: On the Issues of annotator agreement, effort and misevaluation | |
| 2021 | (2021) Sixth Conference on Machine Translation Dela corpus: A document-level corpus annotated with context-related issues | |
| 2021 | Castilho, S.; Menezes, M.; Cavalheiro Camargo, J.L.; Way, A. (2021) Wmt 2021 6th Conference on Machine Translation Proceedings DELA Corpus - A Document-Level Corpus Annotated with Context-Related Issues [Link] | |
| 2021 | Castilho, S. (2021) Human Evaluation of Nlp Systems Humeval 2021 Proceedings of the Workshop as Part of the 16th Conference of the European Chapter of the Association for Computational Linguistics Eacl 2021 Towards Document-Level Human MT Evaluation: On the Issues of Annotator Agreement, Effort and Misevaluation [Link] | |
| 2021 | (2021) Proceedings of Machine Translation Summit XVIII: Users and Providers Track Building MT systems in low resourced languages for Public Sector users in Croatia, Iceland, Ireland, and Norway | |
| 2020 | (2020) Proceedings of the 22nd Annual Conference of the European Association for Machine Translation A human evaluation of English-Irish statistical and neural machine translation | |
| 2020 | Castilho, S. (2020) Proceedings of the 22nd Annual Conference of the European Association for Machine Translation Eamt 2020 Document-Level Machine Translation Evaluation Project: Methodology, Effort and Inter-Annotator Agreement [Link] | |
| 2020 | Castilho, S.; Popovi, M.; Way, A. (2020) Lrec 2020 12th International Conference on Language Resources and Evaluation Conference Proceedings On context span needed for machine translation evaluation [Link] | |
| 2020 | (2020) 22nd Annual Conference of the European Association for Machine Translation Document-Level Machine Translation Evaluation Project: Methodology, Effort and Inter-Annotator Agreement | |
| 2020 | (2020) Proceedings of the Fifth Conference on Machine Translation On the same page? comparing inter-annotator agreement in sentence and document level human machine translation evaluation | |
| 2020 | (2020) Proceedings of the 12th Language Resources and Evaluation Conference On context span needed for machine translation evaluation | |
| 2020 | Castilho, Sheila; Popovic, Maja; Way, Andy (2020) PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020) On Context Span Needed for Machine Translation Evaluation | |
| 2019 | (2019) Proceedings of Machine Translation Summit XVII: Translator, Project and User Tracks Large-scale machine translation evaluation of the iADAATPA Project | |
| 2019 | Popović, M.; Castilho, S. (2019) International Conference Recent Advances in Natural Language Processing Ranlp Are ambiguous conjunctions problematic for machine translation? [Link] [DOI] | |
| 2019 | (2019) Proceedings of the Human-Informed Translation and Interpreting Technology Workshop (HiT-IT 2019) What influences the features of post-editese? a preliminary study | |
| 2018 | Antonio Toral; Sheila Castilho; Ke Hu; Andy Way (2018) Proceedings of the third conference on machine translation: Research papers Attaining the unattainable? reassessing claims of human parity in neural machine translation [Link] [DOI] | |
| 2018 | (2018) Proceedings of the 21st Annual Conference of the European Association for Machine Translation Reading Comprehension of Machine Translation Output: What Makes for a Better Read? | |
| 2018 | (2018) Proceedings of the 21st Annual Conference of the European Association for Machine Translation Project PiPeNovel: Pilot on Post-editing Novels | |
| 2018 | Sosoni, Vilelmini; Kermanidis, Katia Lida; Stasimioti, Maria; Naskos, Thanasis; Takoulidou, Eirini; van Zaanen, Menno; Castilho, Sheila; Georgakopoulou, Panayota; Kordoni, Valia; Egg, Markus (2018) PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018) Translation Crowdsourcing: Creating a Multilingual Corpus of Online Educational Content | |
| 2018 | Behnke, Maximiliana; Barone, Antonio Valerio Miceli; Sennrich, Rico; Sosoni, Vilelmini; Naskos, Thanasis; Takoulidou, Eirini; Stasimioti, Maria; van Zaanen, Menno; Castilho, Sheila; Gaspari, Federico; Georgakopoulou, Panayota; Kordoni, Valia; Egg, Markus; Kermanidis, Katia Lida (2018) PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018) Improving Machine Translation of Educational Content via Crowdsourcing | |
| 2018 | (2018) Improving Machine Translation of Educational Content via Crowdsourcing | |
| 2018 | (2018) The 21st Annual Conference of the European Association for Machine Translation Project PiPeNovel: Pilot on Post-editing Novels | |
| 2018 | (2018) Translation Crowdsourcing: Creating a Multilingual Corpus of Online Educational Content | |
| 2017 | Castilho, S., Gaspari, F., Moorkens, J., Way, A. (2017) EDULEARN 2017 - 9th annual International Conference on Education and New Learning Technologies INTEGRATING MACHINE TRANSLATION INTO MOOCS Barcelona, Spain, 03/07/2017- 05/07/2017 [DOI] | |
| 2017 | (2017) Proceedings of the Sixth Workshop on Vision and Language Human Evaluation of Multi-modal Neural Machine Translation: A Case-Study on E-Commerce Listing Titles [Link] | |
| 2017 | (2017) Proceedings of MT Summit XVI, the 16th Machine Translation Summit A Comparative Quality Evaluation of PBSMT and NMT using Professional Translators | |
| 2017 | Castilho, Sheila; Gaspari, Federico; Moorkens, Joss; Way, Andy (2017) 9TH INTERNATIONAL CONFERENCE ON EDUCATION AND NEW LEARNING TECHNOLOGIES (EDULEARN17) INTEGRATING MACHINE TRANSLATION INTO MOOCS | |
| 2017 | (2017) 20th Annual Conference of the European Association for Machine Translation, EAMT TraMOOC—translation for massive open online courses: recent developments in machine translation | |
| 2017 | (2017) Proceedings of MT Summit XVI, the 16th Machine Translation Summit Translation Dictation vs. Post-editing with Cloud-based Voice Recognition: A Pilot Experiment | |
| 2017 | (2017) Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers Using Images to Improve Machine-Translating E-Commerce Product Listings [Link] | |
| 2016 | (2016) The Tenth International Conference on Language Resources and Evaluation, LREC ’1 Evaluating the impact of light post-editing on usability | |
| 2015 | (2015) Proceedings of the sixth workshop on cognitive aspects of computational language learning Reading metrics for estimating task efficiency with MT output | |
| 2015 | (2015) CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING Reading metrics for estimating task efficiency with MT output | |
| 2014 | (2014) Proceedings of the 17th annual conference of the European association for machine translation Does post-editing increase usability? A study with Brazilian Portuguese as Target Language | |
| 2012 | (2012) Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12) PET: a tool for post-editing and assessing machine translation | |
| 2012 | (2012) LREC PET: a Tool for Post-editing and Assessing Machine Translation | |
| 2012 | (2012) LREC 2012 A review corpus annotated for negation, speculation and their scope | |
| 2012 | (2012) EAMT 2012 Cross-lingual Sentence Compression for Subtitles | |
| 2012 | Aziz, Wilker; de Sousa, Sheila C. M.; Specia, Lucia (2012) LREC 2012 - EIGHTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION PET: a Tool for Post-editing and Assessing Machine Translation | |
| 2011 | (2011) Recent Advances in Natural Language Processing Conference, RANLP ’11 Annotating negation and speculation: the case of the review domain | |
| 2011 | (2011) Proceedings of the International Conference Recent Advances in Natural Language Processing 2011 Assessing the post-editing effort for automatic and semi-automatic translations of DVD subtitles | |
| 2011 | (2011) RANLP Assessing the Post-Editing Effort for Automatic and Semi-Automatic Translations of DVD Subtitles |
Certain data included herein are derived from the © Web of Science (2026) of Clarivate. All rights reserved.