Output
Publications
2026
Panadero, E., Broadbent, J., Espasa, A., & Guasch, T. (2026). Spanish Validation of the Self-Regulation for Learning Online (SRL-O) Questionnaire for Higher Education Students. Journal for the Study of Education and Development.
Zamorano, D., Panadero, E., Alqassab, M., & Gómez-Varela, J. F. (2026). Provider versus recipient: Peer feedback roles effect on task performance, perceptions of learning, trust, and epistemic emotions. Studies in Educational Evaluation, 88, 101560. https://doi.org/https://doi.org/10.1016/j.stueduc.2026.101560
2025
Amezua-Urrutia, A., Sánchez-Iglesias, I., Panadero, E., & Auzmendi-Escribano, E. (2025). El Engagement Laboral del Profesorado de Música: Influencia de variables Personales y Laborales. Revista Electrónica Complutense de Investigación en Educación Musical - RECIEM, 22, 269-292. https://doi.org/10.5209/reciem.99844
Cao, Y., Yan, Z., Yang, L., Panadero, E., & Chen, C. (2025). Technology-mediated self-assessment in higher education: A critical review. Contemporary Educational Technology, 17(3), ep588. https://doi.org/10.30935/cedtech/16739
Fernández-Ortube, A., Panadero, E., Dignath, C., Karlen, Y (2026). Unveiling Pre-Service Teachers’ Cognitive Processes: Insights from Thinking-Aloud Protocols on Self-Regulated Learning Assessment. Journal for the Study of Education and Development: Infancia y Aprendizaje, 49(2).
Jonsson, A., Panadero, E., Pinedo, L., & Fernández-Castilla, B. (2025) Using rubrics for formative purposes: identifying factors that may affect the success of rubric implementations. Assessment in Education: Principles, Policy & Practice, 1-20. https://doi.org/10.1080/0969594X.2025.2486947
Kitsantas, A., Bembenutty, H., Cleary, T. J., Alexander, P. A., DiBenedetto, M. K., Kaplan, A., Kolovelonis, A., Mandell, B. E., Martin, A. J., McCrudden, M. T., Panadero, E., Salisbury-Glennon, J. D., & Schunk, D. H. (2025). Barry J. Zimmerman’s Enduring Legacy: The Inspiring Fusion of Self-Regulated Learning Theory, Practice, and Mentorship. Educational Psychology Review, 37(3), 78. https://doi.org/10.1007/s10648-025-10052-0
Lehane, P., O'Connor, G. & O'Leary, M. (2025). Back to the future? Reflections from 25 years of empirical research on Leaving Certificate assessment in Ireland. Irish Educational Studies, 1-31. https://doi.org/10.1080/03323315.2024.2441158
Máñez, I., & Panadero, E. (2025). How the order of performance levels influences rubric engagement and task performance in digital environments? Assessment & Evaluation In Higher Education, 1-20. https://doi.org/10.1080/02602938.2025.2585089
Ocampo, J. C. G., Panadero, E., Sánchez-Iglesias, I., & Ruiz, F. D. (2025). “Due to the composition of the feedback, I think it’s a girl”: The effects of gender and peer feedback content on essay revisions and perceptions of peer feedback. Studies in Educational Evaluation, 85, 101455. https://doi.org/https://doi.org/10.1016/j.stueduc.2025.101455
Ocampo, J. C. G., Panadero, E., Zamorano, D., & Sánchez-Iglesias, I. (2025). Which gender provides more specific peer feedback? Gender and assessment training’s effects on peer feedback specificity and intrapersonal factors. Assessing Writing, 66, 100987. https://doi.org/10.1016/j.asw.2025.100987
Panadero, E., & Broadbent, J. (2025). Decremental research in the GenAI era: Rethinking what learning means when machines do the work. Journal for the Study of Education and Development, Prospectives section.
Panadero, E., Delgado, P., Barrenetxea-Mínguez, L., Zamorano, D., Pinedo, L., & Fernández-Ortube, A. (2025). How dominant language influences rubric reading and task performance: Insights from eye-tracking research. European Journal of Psychology of Education, 40(2), 55. https://doi.org/10.1007/s10212-025-00951-9
Panadero, E., Delgado, P., Zamorano, D., Pinedo, L., Fernández-Ortube, A., & Barrenetxea-Mínguez, L. (2025). Putting excellence first: How rubric performance level order and feedback type influence students’ reading patterns and task performance. Learning and Instruction, 99, 102168. https://doi.org/10.1016/j.learninstruc.2025.102168
Panadero, E., Fernández-Ortube, A., Zamorano, D., Pinedo, L., Sánchez-Iglesias, I., & Barrenetxea-Mínguez, L. (2025). Tracking self-regulated learning in action: How individual differences shape positive and negative regulation across three types of tasks. Learning and Individual Differences, 124, 102808. https://doi.org/10.1016/j.lindif.2025.102808
Panadero, E., & Sánchez-Iglesias, I. (2025). Impact of Displaying Grades Vs. Not Displaying Grades on Academic Performance and Emotional Outcomes While Delivering Feedback Comments: A Longitudinal Study. Educational Assessment, 1(21-40). https://doi.org/10.1080/10627197.2025.2455128
Peltzer, K., Lira Lorca, A., Krause, U. M., Graham, S., Panadero, E., & Busse, V. (2025). How to support at-risk writers: Differential effects of formative feedback on argumentative writing and motivation. Reading and Writing. https://doi.org/10.1007/s11145-025-10652-w
Pinedo, L., Panadero, E., Fernández-Ruiz, J., & García-Pérez, D. (2025). Beyond the Accuracy Gap in Self-assessment: Exploring Reasons for (In)Accuracy and the Role of Individual Differences. Assessment in Education: Principles, Policy & Practice, 32(4), 462-484. https://doi.org/10.1080/0969594X.2025.2565384
Rickey, N., Panadero, E., & DeLuca, C. (2025). How do students self-assess? Examining the metacognitive processes of student self-assessment. Metacognition and Learning, 20(1), 25. https://doi.org/10.1007/s11409-025-09430-4
Scully, D., Carroll, M., Clarke, S. & Guirke, G. (2025). Burgeoning teacher assessment identity and learning to 'play the system': the realities of assessment-led reform at lower secondary level in Ireland. Assessment in Education: Principles, Policy & Practice. https://doi.org/10.1080/0969594X.2025.2467673
Slattery, E.J., Lehane, P., Butler, D., O'Leary, M. & Marshall, K. (2025). Assessing the benefits of digital game-based learning with Minecraft in children, adolescents and young adults: A broad systematic review. Review of Education, 13 (e70035). https://doi.org/10.1002/rev3.70035
Zamorano, D., Panadero, E., Alqassab, M., & Amillano, A. (2025). Effect of Peer Feedback Role: Task Performance, Feedback Implementation and Perceptions on Learning and Trust. The Journal of Experimental Education, 1-25. https://doi.org/10.1080/00220973.2025.2466146
2024
Bembenutty, H., Kitsantas, A., DiBenedetto, M. K., Wigfield, A., Greene, J. A., Usher, E. L., Bong, M., Cleary, T. J., Panadero, E., Mullen, C. A., & Chen, P. P. (2024). Harnessing Motivation, Self-Efficacy, and Self-Regulation: Dale H. Schunk’s Enduring Influence. Educational Psychology Review, 36(4), 139. https://doi.org/10.1007/s10648-024-09969-9
Fraile, J., Monguillot, M., González-Arévalo, C., Lehane, P., & Panadero, E. (2024). Investigating anonymity in formative and summative peer assessment: Effects on university students’ social-affective factors, perceptions and preference. Studies in Educational Evaluation, 83, 101410. https://doi.org/10.1016/j.stueduc.2024.101410
Lehane, P., Scully, D., & O’Leary, M. (2024). Why multimedia might matter: The impact of animations and images on item performance and test‐taker behaviour. British Journal of Educational Technology, 55(1), 398–416. https://doi.org/10.1111/bjet.13369
Noroozi, O., Alqassab, M., Taghizadeh Kerman, N., Banihashem, S. K., & Panadero, E. (2024). Does perception mean learning? Insights from an online peer feedback setting. Assessment & Evaluation In Higher Education, 1-15. https://doi.org/10.1080/02602938.2024.2345669
Ortube, A. F., Panadero, E., & Dignath, C. (2024). Self-Regulated Learning Interventions for Pre-service Teachers: A Systematic Review. Educational Psychology Review, 36(4), 113. https://doi.org/10.1007/s10648-024-09919-5
Panadero, E., Fernández, J., Pinedo, L., Sánchez, I., & García-Pérez, D. (2024). A self-feedback model (SEFEMO): secondary and higher education students’ self-assessment profiles. Assessment in Education: Principles, Policy & Practice, 1-33. https://doi.org/10.1080/0969594X.2024.2367027
Panadero, E., Fernández Ortube, A., Krebs, R., & Roelle, J. (2024) Analysis of online rubric platforms: Advancing toward erubrics. Assessment & Evaluation In Higher Education, 1-19. https://doi.org/10.1080/02602938.2024.2345657
Panadero, E., Jonsson, A., Pinedo, L., & Fernández-Castilla, B. (2023). Effects of rubrics on academic performance, self-regulated learning, and self-efficacy: a meta-analytic review. Educational Psychology Review. 35(4), 113. https://doi.org/10.1007/s10648-023-09823-4
Pardo, R., García-Pérez, D., & Panadero, E. (2024). Shaping the assessors of tomorrow: How practicum experiences develop assessment literacy in secondary education pre-service teachers. Teaching and Teacher Education, 152, 104798. https://doi.org/10.1016/j.tate.2024.104798
2023
Abello, D. M., Alonso Tapia, J., & Panadero, E. (2023). Situated goals questionnaire transcultural adjustment and validation: comparison between Colombian and Spanish students. Electronic Journal of Research in Educational Psychology, 21(3), 667-692. https://doi.org/10.25115/ejrep.v21i61.6811
Lehane, P., Lysaght, Z., & O’Leary, M. (2023). A validity perspective on interviews as a selection mechanism for entry to initial teacher education programmes. European Journal of Teacher Education, 46(2), 293–307. https://doi.org/10.1080/02619768.2021.1920920
Ocampo, J. C., Panadero, E., Zamorano, D., Sánchez-Iglesias, I., & Diez Ruiz, F. (2023). The effects of gender and training on peer feedback characteristics. Assessment & Evaluation In Higher Education, 1-17. https://doi.org/10.1080/02602938.2023.2286432
Panadero, E. (2023). Toward a paradigm shift in feedback research: Five further steps influenced by self-regulated learning theory. Educational Psychologist, 58(3), 193-204. https://doi.org/10.1080/00461520.2023.2223642
Panadero, E., García-Pérez, D., Fernández Ruiz, J., Fraile, J., Sánchez-Iglesias, I., & Brown, G. T. L. (2023). Feedback and year level effects on university students’ self-efficacy and emotions during self-assessment: positive impact of rubrics vs. instructor feedback. Educational Psychology, 43(7), 756-779. https://doi.org/10.1080/01443410.2023.2254015
Pinedo, L., Panadero, E., Fernández-Ruiz, J., & Rodríguez-Hernández, C. (2023). Students’ experiences in self-assessment: training, processes and feedback use in secondary and higher education. Assessment in Education: Principles, Policy & Practice, 30(5-6), 448-480. https://doi.org/10.1080/0969594X.2023.2284630
2022
2021
Scully, D., Lehane, P. and Scully, C. (2021). 'Its no longer scary': digital learning before and during the Covid-19 pandemic in Irish secondary schools. Technology, Pedagogy and Education, 30(1), 159-181. DOI: 10.1080/1475939X.2020.1854844
2020
Abrams, L. Reynolds, K., & O'Leary, M. (2020). Advancing Alignment Arguments in Supporting Scoring
Interpretation and Use Claims of Credentialing Exams. CLEAR Exam Review (30)2, 15-23.
2019
2018
2017
2016
2025
Lehane, P. & Gorman, A. (2025). Assessment and learning: summative approaches. In L. Cremin, L. Hendry, & C. Harrison (Eds.), Learning to Teach in the Primary School (5th Edition). London: Routledge. https://www.routledge.com/Learning-to-Teach-in-the-Primary-School/Cremin-Hendry-Harrison/p/book/9781032691756
2022
Looney, A., O'Leary, M., Scully, D., & Shiel, G. (2022). Cross-national achievement surveys and educational monitoring in Ireland. In, European Commission, Joint Research Centre, Cross-national achievement surveys for monitoring educational outcomes : policies, practices and political reforms within the European Union, Klinger, D., Volante, L., & Schnepf, S.(Eds.), (pp. 153-176). Luxembourg: Publications Office of the European Union. Download from https://data.europa.eu/doi/10.2760/406165
2025
Etxeberria, B., Fernández, A., Zamorano, D., Pinedo, L., Barrenetxea-Mínguez, L. & Panadero, E. (2025, August 23-24). How Rubric and Feedback Design Affect Self-regulation: Insights from Higher Education. [Single Paper presentation] JURE Conference, Graz, Austria.
Fernández Ruiz, J., Panadero, E., Fraile, J., Rodríguez Hernández, C. & Amezúa, A. (2025, June 25-27). A longitudinal analysis of spanish university assessment practices. Paper presentation at symposium "Exploring assessment practices in higher education". 25th Congreso Internacional en Psicología y Educación. Oviedo, Spain.
Krebs, R., Waldeyer, J., Rothstein, B., Roelle, J., & Panadero, E. (2025, August 28). How do Rubrics Affect Self-Assessment Accuracy and Regulation? An Experimental Think-Aloud Study [Paper presentation]. In J. Roelle (Chair), The Better the Self-Assessment Accuracy the Better the Regulation and Performance? Not that Simple! [Symposium]. EARLI 2025, Graz, Austria.
Lehane, P., O’Connor, G., & O’Leary, M. (2025, November 22). Reflections from 25 years of empirical research on Leaving Certificate assessment in Ireland. In Proceedings from 100 years of the Leaving Certificate: Past insights, future directions. Dublin City University, Ireland.
Ocampo, J. C., Zamorano, D., & Panadero, E. (2025, August 26). Does Gender Influence Peer Assessment? A Systematic Review [Paper presentation]. EARLI 2025, Graz, Austria.
Panadero, E. (2025, April). Using Process and Multimodal Data to Investigate Classroom Assessment, paper presentation at the symposium organized by Qiwei He at the National Council for Measurement in Educacion 2025, Denver Colorado USA.
Peltzer, K., Lira Lorca, A., Krause, U.-M., Graham, S., Busse, V., & Panadero, E. (2025, August 25). How to support different writers: Effects of feedback on argumentative writing and motivation [Paper presentation]. EARLI 2025, Graz, Austria.
Pijeira-Díaz, H. J., Panadero, E., Fernández Ortube, A., Pinedo, L., Barrenetxea, L. R., & Zamorano, D. (2025, August 28). Electrodermal activity during reading, oral tasks, written tasks, and listening to feedback [Paper presentation]. EARLI 2025, Graz, Austria.
Pinedo, L., Fernández, J., Panadero, E., & Brown, G. (2025, August 26). Beyond the score: how discovering self-assessment accuracy affects emotions and self-efficacy [Paper presentation]. In C. Schuster & R. Krebs (Chairs), The Impact of Interventions on Metacognitive Accuracy and Emotional Outcomes [Symposium]. EARLI 2025, Graz, Austria.
Rickey, N., Panadero, E., & DeLuca, C. (2025, August 28). Examining How Emotions Shape Student Self-Assessment via State-Transition Analysis [Paper presentation]. EARLI 2025, Graz, Austria.
Zamorano, D., Panadero, E., Alqassab, M., & Amillano Solano, A. (2025, August 26). Comparing Two Phases of Peer-Feedback, Provision and Reception: From Outcomes to Internal Processes [Paper presentation]. In I. Kollar (Chair), From Peer-Feedback to Learning: Understanding and Supporting the Phases of Provision and Reception [Invited Symposium]. EARLI 2025, Graz, Austria.
2022
Cherry, G. and Scully, C. (2022, November). A consideration of factors affecting the use of Automatic Item Generation (AIG) in developing items for use in high-stakes assessments. Paper accepted for presentation at the Association for Educational Assessment Europe (AEA-E) conference, Dublin, Ireland.
Doyle, A., Lysaght, Z. and O’Leary, M. (2022, September). Disturbing the teachers’ role as assessor: The Case of Calculated and Accredited Grades 2020-2021 in Ireland. Paper accepted for presentation at the European Conference on Educational Research (ECER).
Lysaght, Z., Doyle, A. and O’Leary, M. (2022, September). Irish Post-Primary Techers’ Experiences of Assessing their Students for High-Stakes Certification Purposes: Pandemic or Endemic Challenges and Opportunities? Paper accepted for presentation at the European Conference on Educational Research (ECER).
Denner, S., O'Leary, M. and Shiel, G. (2022, November). The impact on the performance of 15-year-olds in Ireland on the PISA reading, mathematics, and science tests when testing occurs at two different periods in the same year (spring vs autumn). Paper accepted for presentation at the Association for Educational Assessment Europe (AEA-E) conference, Dublin, Ireland.
Scully, C. and Cherry, G. (2022, October). Theoretical and practical considerations when adapting performance assessments for remote administration. Paper accepted for presentation at the European Association of Test Publishers (E-ATP) conference, London, United Kingdom.
Chen, M., Cherry, G. and Kuan, L. (2022, October). Examining the suitability of live remote proctoring for language proficiency assessments from a psychometric standpoint. Paper accepted for presentation at the European Association of Test Publishers (E-ATP) conference, London, United Kingdom.
Cherry, G. and O'Leary, M. (2022, August). Live Remote Proctoring and Test Centre Proctoring: The same but different? Paper accepted for presentation at the European Conference for Educational Research (ECER), Yerevan, Amernia.
Scully, C. and Cherry, G. (2022, April). Practical and Theoretical Concerns when Administering Remote Performance Assessments. Paper presented at the Irish Educational Studies Association of Ireland (ESAI) conference, Dublin, Ireland.
O'Leary, M., Lysaght, Z. and Doyle, A. (2022, April). Irish Post-Primary Teachers Feelings and Beliefs about Assessment following the 2021 Accredited Grades Process. Paper presented at the Irish Educational Studies Association of Ireland (ESAI) Conference, Dublin, Ireland.
Lehane, P., O'Leary, M. and Scully, D. (2022, April). Exploring Irish post-primary students’ interactions with computer-based exams. Paper presented at the Irish Educational Studies Association of Ireland (ESAI) Conference, Dublin, Ireland.
Kuan, L., Chen, M., Cherry, G., O'Leary, M. and Zumbo, B. (2022, March). Comparability of High-Stakes Exams in Test Centres Proctored and Live Remote Proctoring: A Multimethod Psychometric Investigation across Multiple Testing Programmes. Paper presented at the Association of Test Publishers (ATP) conference, Orlando, United States.
Cherry, G. (2022, April). Inequalities in Educational Attainment across Rural and Urban Locations of Northern Ireland. Paper accepted for a Roundtable Discussion at the American Educational Research Association (AERA) conference, San Diego, United States.
Cherry, G., O'Leary, M., Kuan, L. and Waters, L. (2022, April). Comparing Outcomes from Examinations Proctored in Test Centres and Online using Live Remote Proctoring Technology. Paper accepted for presentation at the American Educational Research Association (AERA) conference, San Diego, United States.
Lehane, P., O'Leary, M. and Scully, D. (2022, April). Understanding Simulation-Type Items using Eye Movement and Log-File Data. Paper accepted for presentation at the American Educational Research Association (AERA) conference, San Diego, United States.
Lehane, P. (2022, April). Items in Technology-Based Assessments: Examining the Use of Multimedia Stimuli with Post-Primary Test Takers. Paper accepted for a Roundtable Discussion at the American Educational Research Association (AERA) conference, San Diego, United States.
Costello, E., Brown, M., Butler, D., Girme, P., Kaya, S., Kirwan, C., McLoughlin, E. and O'Leary, M. (2022, April). Assessment of Transversal Skills in STEM: From theory to practice in a large scale research project. Paper accepted for presentation at the annual Society for Information Technology and Teacher Education (SITE) conference, San Diego, United States.
2021
O'Leary, M. Assessment and Student Wellbeing: Perspectives from a High-Stakes Assessment Context in Ireland. Keynote address at the 11th Lifelong Learning Week, Lifelong Learning Platform. (2021, November).
Cherry, G., O'Leary, M., Kuan, L., Waters, L. and Gilvarry, E. A Comparison of Outcomes across Tests Taken in Test Centres and Via Live Remote Proctoring (LRP). Paper presented at the European Association of Test Publishers (E-ATP) Virtual Conference. (2021, September).
Lehane, P., Scully, D. and O'Leary, M. Items in Technology Based-Assessments: Examining the use of multimedia stimuli with eye movement data. Paper presented at the European Association of Test Publishers (E-ATP) Virtual Conference. (2021, September).
Doyle, A., Lysaght, Z. and O'Leary, M. High-Stakes Exams in the Time of Covid-19. The Experiences of Irish Post-Primary Teachers. Paper presented at the European Conference for Educational Research (ECER Network 09: Assessment, Evaluation, Testing and Measurement), Geneva, Switzerland. (2021, September).
Lysaght, Z. and Cherry, G. Standardised Testing in English Reading and Mathematics in Irish Primary Schools: Trends over Time. Paper presented at the Association for Educational Assessment Europe (AEA-E) Virtual Conference. (2021, November).
Cherry, G., O'Leary, M., Kuan, L. and Waters, L. A Comparison of Outcomes from Tests Proctored Locally in Testing Centres and Online using Live Remote Proctoring (LRP). Poster presented at the Association for Educational Assessment Europe (AEA-E) Virtual Conference. (2021, November).
Scully, C. Examiner consistency in high-stakes performance assessments in the health sciences. Roundtable at the European Association of Test Publishers (E-ATP) Virtual Conference. (2021, September).
Scully, C. Assessor cognition as a means of improving the reliability of nursing Objective Structured Clinical Examinations (OSCEs). Paper presented at the Dublin City University (DCU) Unconference. (2021, June).
Lehane, P., Pitsia, V. and Karakolidis, A. Identifying factors predicting teachers' use of assessment data: Findings from a national large-scale survey of primary teachers in Ireland. Paper presented at the Virtual European Conference on Educational Research (ECER). (2021, September).
Lehane, P., Scully, D. and O'Leary, M. Exploring primary school teachers' use of assessment data in an Irish context - A secondary analysis of survey data. Paper presented at the Virtual European Conference on Educational Research (ECER). (2021, September).
Scully, D., Crosbie, N., O'Brien, N. and O'Leary, M. "What do you think Jessica should do?": An innovative tool to support the formative assessment of Junior Cycle students' knowledge and understanding of wellbeing. Paper presented at The SPHE Network's 5th Conference, Institute of Education, DCU. (2021, November).
Scully, D., Crosbie, N., O'Brien, N. and O'Leary, M. "What do you think Jessica should do?": An innovative tool to support the formative assessment of Junior Cycle students' knowledge and understanding of wellbeing. Paper presented at the Association for Educational Assessment - Europe (AEA-E) Virtual conference. (2021, November).
Lehane, P. Items in technology-based assessments: Examining the use of multimedia stimuli with post-primary test-takers. Paper presented at the Association for Educational Assessment - Europe (AEA-E) Virtual conference. (2021, November).
2020
Kuan, L., O'Leary, M. & Brunner, B. (2020). Is the Psychometric Quality of Situational Judgment Items Affected by the Type of Task Analysis Performed? Paper accepted for presentation at the Association of Test Publishers (ATP) Conference, San Diego, United States. (Conference cancelled).
Lehane, P., Lysaght, Z. & O'Leary, M. (2020) The Interview as a Selection Mechanism for Entry into Initial Teacher Education: A Review of the Literature and Recommendations for Practice. Paper accepted for presentation at the Educational Studies Association of Ireland, Dublin, Ireland. (Conference cancelled).
Lehane, P., Pitsia, V., & Karakolidis, A. (2020). Identifying factors predicting teachers’ use of assessment data: Findings from a national large-scale survey of primary teachers in Ireland. Paper accepted for presentation at the European Conference on Educational Research 2020, Glasgow, UK. (Conference cancelled).
Ling, G., O'Leary, M. et al. (2020). Assessment of Competencies as a Result of College Learning: Explorations in Europe and Beyond. Symposium accepted by Division 9 (Assessment, Evaluation, Testing and Measurement) of the European Conference on Educational Research 2020, Glasgow, UK. (Conference cancelled)
O'Leary, M., Lysaght, Z., NicCraith, D. & Scully D. (2020). Teacher Perspectives on Standardised Testing of Achievement in Ireland. Paper accepted for presentation at the Annual Meeting of the American Educational Research Association (AERA), San Francisco, United States. (Conference cancelled).
O'Leary, M. & Reynolds, K. (2020). Critical Thinking Test Validity in International Contexts: Evaluating the ETS HEIghten Test for Irish Use. Paper accepted for presentation at the Annual Meeting of the American Educational Research Association (AERA), San Francisco, United States. (Conference cancelled).
Pitsia, V., Lysaght, Z., O’Leary, M., & Shiel, G. (2020). A multilevel binary logistic regression analysis of mathematics and science achievement in TIMSS 2015 in an Irish post-primary context. Paper accepted for presentation at the European Conference on Educational Research 2020, Glasgow, UK. (Conference cancelled).
Pitsia, V. (2020). Characteristics of high achievers: A multilevel logistic regression analysis of PISA mathematics and science data. Paper accepted for presentation at the American Educational Research Association (AERA) 2020 Annual Meeting, San Francisco, United States. (Conference cancelled).
Pitsia, V., Lysaght, Z., Shiel, G., & O’Leary, M. (2020). Are we meeting the needs of high achievers? A closer look at PISA, TIMSS and PIRLS data for Ireland. Paper accepted for presentation at the Educational Studies Association of Ireland Conference 2020, Dublin, Ireland. (Conference cancelled).
Reynolds, K., Abrams, L. & O'Leary, M. (2020). Applying the Webb Alignment Model to Professional Testing. Paper accepted for presentation at the Association of Test Publishers (ATP) Conference, San Diego, United States. (Conference cancelled).
Scully, C. (2020). Inter-rater reliability and validity in the Objective Structured Clinical Examination. Paper accepted for presentation at the Educational Studies Association of Ireland, Dublin, Ireland. (Conference cancelled).
2019
Abrams, L., Lysaght, Z., & O'Leary, M. (2019). The context and use of standardized testing data for educational decision-making in Ireland. Paper presented at the Annual Meeting of the American Educational Research Association conference. Canada: Toronto.
Pitsia, V., O’Leary, M., Shiel, G., & Lysaght, Z. (2019, November). What do international large-scale assessments tell us about high achievement in mathematics and science, with specific reference to Ireland and some comparison countries? Paper presented at the 20th Annual Meeting of the Association for Educational Assessment- Europe (AEA-E). Portugal: Lisbon.
Clifford, I., & Karakolidis, A. (2019, September) The challenges and opportunities of including animated items in licensure examinations: Insights from two research studies. Paper presented at the European Association of Test Publishers (E-ATP) Conference, Madrid, Spain.
Karakolidis, A. (2019, April). The use of animations in assessment: Comparing an animated and a text-based situational judgment test. Paper presented at the American Education Research Association (AERA) Annual Meeting. Toronto, Canada.
Karakolidis, A., O'Leary, M., & Scully, D. (2019). Enhancing assessment validity through the use of animated videos: An experimental study comparing text-based and animated situational judgements tests. Paper presented at the 20th annual Association for Educational Assessment – Europe (AEA) conference. Lisbon, Portugal.
Lehane, P. (2019, November). Designing Digital Assessments: Factors to Consider when Developing Computer-Based Exams. Paper presented at the World Conference of Online Learning (WCOL) conference, Dublin, Ireland.
Lehane, P. (2019, September). Considering ‘Emotional Intelligence’ in Certification and Licensure Testing. Paper presented at the European Association of Test Publishers (E-ATP) Conference, Madrid, Spain.
Lehane, P. (2019, April). Assessment 2.0: Factors to consider when developing technology-based assessment. Paper presented at the Educational Studies Association of Ireland (ESAI) conference, Sligo, Ireland.
Lehane, P. & Kuan, L. (2019, March). Finding a suitable task analysis for developing competency-based statements. Paper presented at the Association of Test Publishers (ATP) Conference, Orlando, United States.
Lehane, P. & Waters, L. (2019, March). What makes a difference for candidates taking computer-based tests? The impact of devices and user interface tools. Paper presented at the Association of Test Publishers (ATP) Conference, Orlando, United States.
O'Leary, M. & Champagne, K. (2019, March). Alternative and high-fidelity item types. Where are we now with technology-based items? Paper presented at the Association of Test Publishers (ATP) Conference, Orlando, United States.
O’ Leary, M., Scully, D. & Lehane, P. (2019, September). Considering emotional intelligence in certification and licensure testing. Paper presented at the Association of Test Publishers (ATP) Public Sector Special Interest Group Conference, Vienna, Austria.
Pitsia, V., Karakolidis, A., & Shiel, G. (2019, June). High achievement in mathematics and science: A multilevel analysis of TIMSS 2015 data for Ireland. Paper presented at the 8th International Association for the Evaluation of Educational Achievement (IEA) International Research Conference (IRC-2019), Copenhagen, Denmark.
Scully, D. (2019, January). The Learning Portfolio in Higher Education: A Game of Snakes and Ladders? Paper presented at the Middle East and Africa Association of Test Publishers (MEA-ATP) Conference, Abu Dhabi, United Arab Emirates.
Scully, D. & Kuan, L. (2019, January). Providing useful and effective diagnostic feedback. Paper presented at the Middle East and Africa Association of Test Publishers (MEA-ATP) Conference, Abu Dhabi, United Arab Emirates.
Scully, D., O'Leary, M. & Lehane, P. (2019, September). Considering emotional intelligence in certification and licensure testing. Paper presented at the European Association of Test Publishers (E-ATP) Conference, Madrid, Spain.
2018
Karakolidis, A. & Corrigan, R. (2018, February). Is a picture worth a thousand words? Using animated items in certification testing. Paper presented at the Association of Test Publishers Conference, San Antonio, TX.
Karakolidis, A. & Pitsia, V. (2018, September). Transforming Situational Judgement Tests through the use of animated simulations. Paper presented at the European Association of Test Publishers (E-ATP) Conference, Athens, Greece.
Lehane, P. (2018, September). Device Comparability – Does it matter what device is used to administer assessments? Paper presented at the European Association of Test Publishers (E-ATP) Conference, Athens, Greece.
Lysaght, Z. & Scully, D. (2018, September). Providing Diagnostic Feedback to Non-Successful Test Candidates. Paper presented at the Association of Test Publishers (ATP) Public Sector Special Interest Group Conference, Brussels, Belgium.
Scully, D. & Kuan, L. (2018, September). Identifying the Task Analysis of Best Fit. Paper presented at the European Association of Test Publishers (E-ATP) Conference, Athens, Greece.
Scully, D. & Lysaght, Z. (2018, September). Diagnostic Feedback – Dos and Don’ts. Paper presented at the European Association of Test Publishers (E-ATP) Conference, Athens, Greece.
Scully, D., O’Leary, M. & Brown, M. (2018, August). Key Findings from a Literature Review on the Use of Learning Portfolios (ePortfolios) in Higher Education. Paper presented at the World Education Research Association (WERA) World Congress, Cape Town, South Africa.
Scully, D., O'Leary, M. & Brown, M. (2018, June). The Learning Portfolio in Higher Education: An Integrative Review. Paper presented at the EdMedia + Innovate Learning International Conference, Amsterdam, Netherlands.
Scully, D., O'Leary, M. & Brown, M (2018, May). A Game of Snakes and Ladders: An Integrative Review of Learning Portfolio in Higher Education. Paper presented at the Irish Learning Technology Association EdTech Conference, Carlow IT.
Scully, D., O'Leary, M. & Brown, M. (2018, May). The Learning Portfolio in Higher Education: A Game of Snakes and Ladders? Paper to be presented at the CRA/AAEEBL International Seminar, ePortfolios and more: the developing role of ePortfolios within the digital landscape, Dublin City University.
Scully, D. & Ridgley, K. (2018, February). Competencies - What are they and how best to we define them to measure them? Paper presented at the Association of Test Publishers Conference, San Antonio, TX.
Stemler, S., Elliott, J., O'Leary, M., Scully, D., Karakolidis, A. & Pitsia, V. (2018, April). A Cross-Cultural Study of High School Teachers' Tacit Knowledge of Interpersonal Skills. Paper presented at the Annual Meeting of the American Educational Research Association (AERA), New York, NY.
Kent, G., & Pitsia, V. (2018, December). Gender differences in cognitive development and school readiness: Findings from a randomised controlled trial of children from communities of socio-economic disadvantage in Ireland. Paper presented at the Annual conference of the Children's Research Network 2018, Dublin, Ireland.
Kent, G., Pitsia, V., & Colton, G. (2018, November). Preparing for the transition to primary school; predictors of school readiness behaviours of five-year-old children from areas of socio-economic disadvantage. Paper presented at the 48th Annual Conference of the Psychological Society of Ireland, Wexford, Ireland.
Pitsia, V., Karakolidis, A., Sofianopoulou, C. & Emvalotis, A. (2018, October). Risk factors for early school leaving in Greece. Paper presented at the ESA/RN27 Mid-term Conference 2018, Catania, Italy.
Pitsia, V., & Kent, G. (2018, November). Variations in perceptions of five-year-old children’s school readiness among parents and teachers. Paper presented at the 11th annual International Conference of Education, Research and Innovation (pp. 8426-
8435)
2017
O'Leary, M., Scully, D. & Karakolidis, A. (2017, September). Refining Situational Judgement Tests. Paper presented at the European Association of Test Publishers Conference, Noordwijk, The Netherlands.
O'Leary, M. Scully, D. & Karakolidis, A. (2017, September). Challenging a Tenet of Multiple Choice Testing: Are Four Response Options Really Necessary? Paper presented at the European Assoication of Test Publishers Conference, Noordwijk, The Netherlands.
Gurhy, AM (2017, April). Using assessment for learning to enhance mathematics education in the primary school: A lesson study approach. Paper presented at the Annual Conference of the Educational Studies Association of Ireland Conference, University College Cork.
Karakolidis, A., Scully, D. & O'Leary M. (2017, March). Simulations in Assessment and the Uncanny Valley: Too true to be good? Paper presented at the International TEchnology Education and Development (INTED) Conference, Valencia.
Scully, D. & Waters, L. (2017, March). Driving Program Decisions Through Research: Applying Best Practices. Paper presented at the Association of Test Publishers Conference, Scottsdale, AZ.
Gurhy, AM (2017, February). Using assessment for learning to enhance mathematics education in the primary school: Irish students' perspectives. Paper presented at the 10th Congress of European Research in Mathematics Education (CERME 10), Croke Park, Dublin.
2016
Lysaght, Z. & O'Leary, M. (2016, August). Developing Assessment Capacity in Norway and Ireland using the Assessment for Learning Audit Instrument (AfLAi). Paper presented at the Annual Meeting of the European Conference for Education Research (ECER), Dublin.
O'Leary, M. & Lysaght, Z. (2016, April). Using the Assessment for Learning Audit Instrument to inform Data-driven Professional Development. Paper presented at the Annual Meeting of the American Educational Research Association (AERA), Washington, D.C.
Darmody, M. (2016, September). Post-Primary Teachers’ Conceptions of Assessment. Paper presented at the NCCA Assessment Research Showcase, Dublin.
2025
Panadero, E. (2025, August 25). Cognitive Offloading and Self-Regulated Learning: The Paradox of Digital Support in the Age of AI [Paper presentation invited by the EARLI SIG16 to their invited symposium slot]. EARLI 2025, Graz, Austria.
Panadero, E. (2025). Positioning Feedback Within the Regulation Process:
Where Is the Student? Seminar The Future of Feedback funded by the Jacob Foundation, Marbach Castle (Germany), 5/6/2025.
Panadero, E. (2025). Transforming assessment into a learning engine: feedback and self-regulated learning, into the John Sabatini 2025 series. Hybrid presentation (face to face at Universitat de Valencia and remote worldwide), 7/4/2025.
2022
O'Leary, M., Cherry, G. and Scully, C. (2022). Theoretical and Practical Considerations for the Development and Validation of a Hazard Test for Use in Driver Licensing in Ireland. Dublin: Centre for Assessment Research, Policy and Practice in Education (CARPE), Dublin City University.
Cherry, G. and Scully, C. (2022). A consideration of the use and intended outcomes of incorporating gamification in assessment and learning environments. Dublin: Centre for Assessment Research, Policy and Practice in Education (CARPE), Dublin City University.
Scully, C. and Cherry, G. (2022). A White Paper on theoretical and practical considerations for the administration of remote Objective Structured Clinical Examinations (OSCEs). Dublin: Centre for Assessment Research, Policy and Practice in Education (CARPE), Dublin City University.
Cherry, G. and Scully, C. (2022). A Brief on Security Protocols for Live Remote Proctoring. Dublin: Centre for Assessment Research, Policy and Practice in Education (CARPE), Dublin City University.
Cherry, G. and Scully, C. (2022). A consideration of factors affecting the use of automatic item generation (AIG) in developing items for use in certification and licensure assessments. Dublin: Centre for Assessment Research, Policy and Practice in Education (CARPE), Dublin City University.
2021
2020
Scully, C. and Lehane, P. (2020). An examination of recent literature on the validity and reliability of outcomes from remote proctored assessments and on candidate experience of taking remote proctored tests. Dublin: Centre for Assessment, Research, Policy and Practice in Education (CARPE), Dublin City University.
Lehane, P. and Scully, C. (2020). Considerations for policies, procedures and regulations (including legal regulations) when using remote proctoring for online licensure and certification tests. Dublin: Centre for Assessment, Research, Policy and Practice in Education (CARPE), Dublin City University.
2019
Abrams, L., Morgan, M., & O’Leary, M. (2019). The Measurement of Non-Cognitive Factors Influencing Educational and Workplace Performance. Unpublished manuscript, Centre for Assessment Research Policy & Practice in Education (CARPE), Dublin City University.
Abrams, L., Reynolds, K., & O’Leary, M. (2019). The Application of Webb’s Model of Alignment to Enhance Credentialing Exam Design and Documentation of Score Interpretation and Use Claims. Unpublished manuscript, Centre for Assessment Research Policy & Practice in Education (CARPE), Dublin City University.
Szendey, O., & O’Leary, M. (2019). Automated Item Generation. Unpublished manuscript, Centre for Assessment Research Policy & Practice in Education (CARPE), Dublin City University.
Szendey, O., & O’Leary, M. (2019). Computer Adaptive Testing. Unpublished manuscript, Centre for Assessment Research Policy & Practice in Education (CARPE), Dublin City University.
2018
Abrams, L. (2018). Best Practice in Test Design: Test Content Specification Procedures for Achievement and Credentialing Exams. Unpublished manuscript, Centre for Assessment Research Policy & Practice in Education (CARPE), Dublin City University.
Lehane, P. (2018). Device Comparability: Administering the same test using different device types: A review of the literature and recommendations for practice. Unpublished manuscript, Centre for Assessment Research Policy & Practice in Education (CARPE), Dublin City University.
Lehane, P. & Karakolidis A. (2018). Items in Technology-Based Assessment: A review of the literature and recommendations for practice. Unpublished manuscript, Centre for Assessment Research, Policy & Practice in Education (CARPE), Dublin City University.
Lehane, P. (2018). User Interface Tools: A review of the literature and recommendations for practice. Unpublished manuscript, Centre for Assessment Research, Policy & Practice in Education (CARPE), Dublin City University.
Reynolds, K. (2018). Short Assessments and Their Applications: Maintenance of Certification and Micro-Credentials. Unpublished manuscript, Centre for Assessment Research, Policy & Practice in Education (CARPE), Dublin City University.
Scully, D. & Lehane P. (2018). Considering Emotional Intelligence in Certification and Licensure Testing. Unpublished manuscript, Centre for Assessment Research Policy & Practice in Education (CARPE), Dublin City University.
2017
O'Leary, M. & Scully D. (2017). Providing effective feedback in the context of certification and licensure testing with particular reference to non-successful test candidates. Unpublished manuscript, Centre for Assessment Research, Policy & Practice in Education, Dublin City University.
Scully, D. (2017). Reducing Gender Bias in Tests and Test Items. Unpublished manuscript, Centre for Assessment Research, Policy & Practice in Education, Dublin City University.
Karakolidis, A., O’Leary, M. & Scully, D. (2017). The development and provision of practice tests: A research brief outlining key findings and recommendations for best practice. Unpublished manuscript, Centre for Assessment Research, Policy & Practice in Education, Dublin City University.
Karakolidis, A., O’Leary, M. & Scully, D. (2017). Online Proctoring: A research brief outlining current knowledge of an emerging practice. Unpublished manuscript, Centre for Assessment Research, Policy & Practice in Education, Dublin City University.
Scully, D. & Lehane P. (2018). Considering Emotional Intelligence in Certification and Licensure Testing. Unpublished manuscript, Centre for Assessment Research Policy & Practice in Education (CARPE), Dublin City University.
2016
Scully, D. (2016). Awarding Partial Credit in Multiple-choice Testing. Unpublished manuscript, Centre for Assessment Research, Policy & Practice in Education, Dublin City University.
Scully, D. (2016). Some Recommendations for Item Development. Unpublished manuscript, Centre for Assessment Research, Policy & Practice in Education, Dublin City University.
Karakolidis, A. (2016). Simulations: Fidelity and the Uncanny Valley. Unpublished manuscript, Centre for Assessment Research, Policy & Practice in Education, Dublin City University
Scully, D. (2016). Constructing MC items at higher levels of cognitive complexity for certification and licensure tests. Unpublished manuscript, Centre for Assessment Research Policy & Practice in Education, Dublin City University.
Scully, D. (2016). Organizing certification or licensure tests by competency statements: a review of the literature and recommendations for practice. Unpublished manuscript, Centre for Assessment Research Policy & Practice in Education, Dublin City University.
Scully, D. (2016). A review of empirical research and theory on the use of situational judgement items and recommendations for best practice. Unpublished manuscript, Centre for Assessment Research Policy & Practice in Education, Dublin City University.
Scully, D. (2017). Reducing Gender Bias in Tests and Test Items. Unpublished manuscript, Centre for Assessment Research, Policy & Practice in Education, Dublin City University.
Lysaght, Z., O'Leary, M. and Ludlow, L. (2021). An instrument for measuring Assessment for Learning (AfL) in the classroom. Research Outreach. Available at: https://researchoutreach.org/articles/instrument-measuring-assessment-learning-afl-classroom/
2025
Hayward, L., & Lehane, P. (2025). What matters? Rethinking assessment in the redeveloped primary school curriculum [Audio podcast episode]. In NCCA (Hosts), Primary school curriculum podcasts. National Council for Curriculum and Assessment. https://ncca.ie/en/primary/podcasts-and-webinars/podcasts/
Resources
CARPE have compiled an annotated list of research and commentaries on assessment conducted in Ireland from 2000-present, which may be a helpful resource for those interested in or pursuing research on the topic of assessment. Peer-reviewed articles, reports and doctoral theses are included in this repository, with the most recent published work cited first. This list will be updated continually, and we invite suggestions for any additional research to be included.
This chapter begins with an overview of how compulsory schooling in Ireland is organised. Ireland's patterns of performance across various international surveys of achievement at primary and post-primary levels as well as adult literacy studies are then described and evaluated. Although the analysis makes it clear that, in general, between 1995 and 2018, Irish students performed well in comparison with their international counterparts, Programme for International Student Assessment (PISA) 2009 was an exception. At the time, the term 'PISA shock' was used to describe a set of poor results that challenged prior notions about high standards of achievement in Ireland and accelerated policy change. As we discuss, the most prominent example of political reform in response to International survey results in Ireland was the introduction of the 2011-2022 national literacy and numeracy strategy by the Department of Education and Skills in 2011. The strategy set out a number of planned actions, and the outcomes of these actions are evaluated towards the end of the chapter. The chapter concludes by considering issues pertinent to the usefulness of cross-national achievement surveys in supporting the process of educational monitoring in Ireland.
National policy initiatives in Ireland, such as Project Maths and the Science, Technology, Engineering, and Mathematics (STEM) Education Policy Statement have sought to increase the engagement and performance of students in mathematics and science. The current study investigated the performance of students in Ireland in these areas and in reading in international large-scale assessments (Programme for International Student Assessment [PISA], Trends in International Mathematics and Science Study [TIMSS], and Progress in International Reading Literacy Study [PIRLS]), with a view to better understand the performance of high-achieving students, relative to their counterparts in other countries in general, and in countries with similar average performance. Lower than expected proportions of high achievers were noted and a pattern of relative underachievement was observed among high achievers – those performing at the highest levels of proficiency, and those performing at key benchmarks, including the 75th and 90th percentiles – in mathematics and science to a greater extent than in reading. These issues were found to be consistent over time, and more prevalent at post-primary level, compared with primary level. The findings of this study are discussed with reference to individual and societal costs, and specific issues that need to be investigated further are identified.
In line with the widespread proliferation of digital technology in everyday life, many countries are now beginning to use computer-based exams (CBEs) in their post-primary education systems. To ensure that these CBEs are delivered in a manner that preserves their fairness, validity, utility and credibility, several factors pertaining to their design and development will need to be considered. This research study investigated the extent to which the design of different types of test items (e.g. inclusion of multimedia stimuli) in a CBE can affect test-takers’ engagement and behaviour. Qualitative data from a cued-Retrospective Think Aloud (c-RTA) protocol were gathered from 12 participants who had participated in a previous eye-tracking study. Participants watched a replay of their eye movements and were asked to state out loud what they were thinking at different points of the replay. Thematic analysis of the responses from these cognitive interviews captured the nature of students’ interactions with online testing environments under three main themes: Familiarisation, Sense-making and Making Decisions. Students also provided their opinions of and recommendations for the future of Irish online assessments. These findings can offer guidelines to all stakeholders considering the use of CBEs in post-primary contexts.
Save for the 2009 Programme for International Student Assessment (PISA) shock, Ireland has recorded strong average scores in mathematics, science, and reading on national and international large-scale assessments. Despite this, percentages of high achievers in mathematics and science in these assessments have remained stubbornly lower than those of some countries with average performance similar to that of Ireland. Reflecting the multifaceted benefits to individuals and society of knowledge and skills in science, technology, engineering, and mathematics (STEM), increasing prioritisation in educational policy in Ireland of high achievers in mathematics and science over the past decade in particular is not unexpected, albeit this was not always the case. This paper offers a chronology of Irish educational policy documents since 1995 illuminating why, when, and how high achievement in mathematics and science has emerged as a key component and driver of educational policy reform.
Evidence suggests that the quality of teachers’ instructional practices can be improved when these are informed by relevant assessment data. Drawing on a sample of 1,300 primary school teachers in Ireland, this study examined the extent to which teachers use standardized test results for instructional purposes as well as the role of several factors in predicting this use. Specifically, the study analyzed data from a cross-sectional survey that gathered information about teachers’ use of, experiences with, and attitudes toward assessment data from standardized tests. After taking other teacher and school characteristics into consideration, the analysis revealed that teachers with more positive attitudes toward standardized tests and those who were often engaged in some form of professional development on standardized testing tended to use assessment data to inform their teaching more frequently. Based on the findings, policy and practice implications are discussed.
This paper provides a perspective on the manner in which Irish post-primary teachers interpreted and implemented a set of guidelines created by the Department of Education and Skills (DES) in Ireland when faced with the cancellation of the traditional high stakes Leaving Certificate (LC) examination due to COVID-19. Subject teachers were asked to engage with a system of calculated grades whereby they would estimate a percentage mark and a class rank for each of their students before meeting with school colleagues to agree a final set of data to be submitted for national standardisation. This was a remarkable event in Irish education as teachers had never before been directly involved in assessing their own students for certification purposes. Data from a survey conducted with teachers (n = 713) show that a wide variety of evidence was used to support their judgements and that the DES guidelines were not always implemented as intended. Challenges highlighted in the paper include decision making around grade boundaries, the lack of evidence for newer subjects, negotiating with school colleagues, and anticipating the impact of national standardisation. The study findings will be of interest to future initiatives involving the professional judgement of teachers in high stakes contexts.
Primary schools in Ireland are required to administer standardised tests in English reading and Mathematics in second, fourth and sixth classes, and to report the aggregated results to their boards of management and the Department of Education and Skills (DES). Since September 2017, results are used at national level as part of the process of determining the allocation of special educational teaching resources to schools. Schools are also required to share results with parents in written format using end-of-year school reports at the three mandatory testing points. The international literature on standardised testing suggests that when test scores are shared widely and used for purposes beyond internal planning, the associated sense of accountability can lead to a culture of teaching to the test and narrowing of the curriculum. Although the stakes associated with standardised testing in Irish primary education remain relatively low, recent policy changes have increased the focus on these instruments. In the wake of these changes, a survey of Irish primary teachers was conducted. A collaborative effort by the Centre for Assessment Research, Policy and Practice in Education (CARPE) and the Irish National Teachers' Organisation (INTO), the research aimed to gather information about how standardised tests are used and how teachers feel about them. In this paper, data with respect to teachers' beliefs about, and attitudes to, standardised testing are foregrounded and reveal an interesting diversity of opinion with study participants being neither wholly supportive nor wholly opposed to the practice.
The study at the heart of this paper was conducted in 2017 to gather data on Irish post-primary teachers’ conceptions of assessment at the time immediately following the introduction of a revised policy for assessment by the Department of Education and Skills (DES). Central to the reform policy was an increased emphasis on formative assessment and a requirement that teachers engage in summative assessment for certification purposes – something that had never applied previously. The paper provides an overview of the literature on teachers’ beliefs, including Brown’s (2004, 2006) Teachers’ Conceptions of Assessment Inventory. Data from an implementation of the inventory with 489 Irish teachers are used to consider how they conceive of assessment, how these conceptions compare and contrast with those held by teachers in other jurisdictions where the instrument has been used and how the data might be used to inform policy change and implementation in Ireland.
This discussion paper provides an outline of how stakeholders across the Irish higher education sector were supported to develop a national understanding of assessment and feedback through local and national conversations. Within the context of a national enhancement initiative and utilising a conversational approach, a collective effort was made to provide clarity around concepts related to assessment and feedback in Irish higher education. The approach taken and the perspectives that emerged from these conversations, along with the resulting national understanding, are presented and discussed with reference to related literature.
In this paper, the authors use a critical policy historiography approach to explore the impact of globalisation forces on tw relatively recent curriculum reforms - the Australian Curriculum and Ireland’s Framework for Junior Cycle. Both reforms employ triadic models of curriculum design involving subjects/learning areas, key skills/general capabilities, statements of learning/cross-curriculum priorities. Globalization influences are clearly evident in the shared emphases in both jurisdictions on skills, learning and school/teacher agency. However, these reforms have inevitably been shaped by their respective local political and social contexts and the respective curriculum debates have been dominated by technical implementation issues such as curriculum overload in Australia and school-based versus external assessment in Ireland. The paper offers a good overview of both education systems.
This discussion paper provides an outline of how stakeholders across the Irish higher education sector were supported to develop a national understanding of assessment and feedback through local and national conversations. Within the context of a national enhancement initiative and utilising a conversational approach, a collective effort was made to provide clarity around concepts related to assessment and feedback in Irish higher education. The approach taken and the perspectives that emerged from these conversations, along with the resulting national understanding, are presented and discussed with reference to related literature.
This in-depth study on the use of standardised tests in Mathematics and English Reading in Irish primary schools was led by the Centre for Assessment Research, Policy and Practice in Education (CARPE) at DCU and the Irish National Teachers’ Organisation (INTO). It was the first large scale investigation of Irish primary teachers’ use of, beliefs about and attitudes to the tests, with the views of 1564 respondents recorded. The research suggests that while standardised tests bring value over and above other assessments and ultimately provide information which is essential in broadening the focus of decision-making about teaching and learning within classrooms and across schools, unintended negative consequences can also result from their use.
This case study investigates factors influencing efforts to introduce school-based assessments (SBAs) in lower secondary education in the Republic of Ireland and reactions from the main stakeholders. Policymakers’ perspectives were informed by national consultations, results of international assessments, trends towards skills-based curricula and practices in relation to SBA as part of high-stakes assessment internationally. Despite broad enthusiasm for the reforms from most stakeholders, teachers remained opposed. A series of compromise proposals shifted the reforms far from their intended nature, leaving in place a dual system of assessment that incorporates continued centralised examining by the state along with some non-certified SBA by teachers. The efficacy of this solution in relation to the original aims of the reform remains to be seen. The analysis explores relevant substantive and methodological issues. The complex interplay between international, national and very local influences on policy implementation is highlighted, suggesting the need for due diligence in anticipating and managing stakeholder responses to reform initiatives. Readers’ attention is also drawn to the intricacy of undertaking qualitative case study inquiry and the need for awareness in relation to possible alternative interpretations of data.
The terminal examination of post-primary education in Ireland, the Leaving Certificate, is often criticised for the reliance on memory recall over higher order thinking skills in the assessment process. In order to examine the evidence base for these critiques, this article presents an empirical investigation of the intellectual skills and knowledge domains implicit in the tasks in the written examination papers of 23 subjects in the Leaving Certificate in Ireland from 2005 to 2010. Data were collected from two sources: examination papers and student interviews. In an in-depth document analysis of the examination papers, 14,910 occurrences of command verbs were coded for the intellectual skill and knowledge domains required by the assessment task. As the same verb can require different intellectual skills in different subjects and in different tasks, each occurrence of every verb was assigned a specific value depending on its context. The article presents the frequencies and distributions of intellectual skills and knowledge domains within and across subjects. In light of key points in the literature search, the findings indicate concern regarding the level of challenge and stimulation for the development of students of the Leaving Certificate.
This paper explores the Leaving Certificate Physical Education curriculum development process. Ten interviews with members of the Physical Education Development Group were interviewed. The results revolved around curriculum content knowledge, assessment weightings, and debating the responsibility for assessing students’ work.
Self-assessment practices have been advocated in recent Irish educational documents due to their potential to enhance school children’s learning and self-regulatory skills. However, the literature has highlighted how some children struggle to make accurate self-assessments of their academic work, which diminishes such positive effects (Keane and Griffin 2015; Nicol 2009). Using Piaget’s Theory of Cognitive Development (1970) as a theoretical framework, the present study sought to investigate whether children’s academic self-assessments became more accurate in line with increased age and higher prior literacy attainment. Following training in the use of self-assessment writing rubrics, 85 school children from second class, fifth class and Transition Year wrote an English essay and later self-assessed their work using rubrics devised by Andrade, Du, and Wang (2008). Results indicated that overall, children’s self-assessment scores held a weak relationship with their actual performance scores (r = .24). However, findings illustrated that children’s self-assessments became significantly more accurate in line with increased developmental stages. Strong correlations also emerged between higher prior literacy attainment and children’s accuracy in self-assessments, amongst second class (r = −.45) and fifth class (r = −.73) children only. The findings suggest that Irish school children, in particular, primary school children with low literacy attainment, display difficulty making accurate self-assessments of their academic work in literacy. Stemming from the research, implications for practice and future research directions are outlined.
The more recent discussion in Ireland around post-primary teachers being responsible for assessing their own students’ work continues. The new junior cycle reform (covering the first three years of post-primary education) is concerned with making fundamental changes in approaches to learning, teaching, curriculum and assessment, with school-based assessment as an important element of the reform. This paper sets out to map assessment policy in a changing and contested assessment environment in the Republic of Ireland. The paper tells the story of assessment in junior cycle from the first progress report in 1999 on a review of the curriculum that had been introduced for students in the junior cycle of post-primary schools in 1989 to the 2015 Framework for Junior Cycle. We document the intention to move away from assessment as solely a means of making summative judgements towards assessment as a support of learning and teaching.
Darmody, M. (2017) Irish post-primary teachers’ conceptions of assessment. Doctor of Education thesis, Dublin City University.
The purpose of this research was to elicit baseline data about Irish post-primary teachers’ conceptions of assessment. Post-primary education in the Republic of Ireland is currently in the midst of significant curriculum and assessment reform at Junior Cycle, the first three years of the secondary school system. Central to this change is the positioning of the teacher at the heart of the assessment process. The successful implementation of the new assessment practices will not only require a high level of teacher assessment literacy, but will also depend upon the extent to which teachers’ conceptions of assessment align with the philosophical underpinnings of the reform. Research has indicated that teachers’ beliefs serve to filter information entering the cognitive domain, to frame particular educational situations or problems and to guide teachers’ intentions and actions (Fives & Buehl, 2012). In light of this evidence, the introduction of new assessment initiatives should take account of how teachers conceive of the nature and purpose of assessment. Adopting a non-experimental cross-sectional design, this study surveyed a large sample (n=489) of post-primary teachers using the abridged version of Brown’s (2006) Teachers’ Conceptions of Assessment Inventory (TCoA-IIIA). This 27-item self-report instrument is designed to elicit teachers’ level of agreement with four intercorrelated assessment factors (i.e., school accountability, student accountability, improvement and irrelevance). Quantitative data derived from the survey were analysed using a mixture of descriptive statistics, exploratory factor analysis, independent samples t-tests and one-way analysis of variance. Maximum likelihood exploratory factor analysis resulted in a 5-factor solution for the Irish data which differed somewhat from Brown’s (2006) original model. Implications of the results for the conceptualisation of assessment in the Irish post-primary context are considered.
Gurhy, A. (2017). Using assessment for learning to enhance the teaching and learning of mathematics in one Primary school: a lesson study approach. Doctor of Education thesis, Dublin City University
Over the course of one academic year, this practitioner research study investigated the impact of AfL practices on the teaching and learning of mathematics at fourth-class level in one primary school. Specifically, it explored how the use of AfL principles, strategies and techniques affected students’ attainment on standardised mathematics tests and their dispositions towards mathematics. Additionally, the research investigated the potential of lesson study (LS) as a vehicle of collaborative professional learning in AfL and considered the impact engaging in LS had on teachers’ skills, knowledge, and use of AfL, and their beliefs towards AfL as a form of assessment. This study also provided unique insights into learners’ perspectives of using AfL in mathematics, both teachers and students. Findings revealed significant effect size gains in children’s confidence, motivation and attitudes regarding mathematics, although there was no appreciable difference in students standardised mathematics scores when compared to the comparison group. Additionally, indications are that teachers found LS to be a very effective model of CPD in AfL.
This paper sets out to outline current discussions in Ireland around teachers being responsible for assessing their own students’ work, and the subsequent impact such a perspective is having (or not) on the delivery and assessment of physical education in Ireland. This discussion is particularly timely given the very recent endorsement for the introduction of the new Leaving Certificate Physical Education as a full optional subject. The authors begin by discussing more specifically assessment in Irish primary and post-primary schools, drawing attention to the limited Irish assessment-related research being conducted in both contexts. They then explore assessment developments related to Irish primary physical education and post-primary physical education and compare the extent to which such developments are limited in comparison to international assessment interests and practices in physical education. The paper concludes with suggestions related to studying (pre-service) teachers’ and students’ exposure to assessment in order to understand how to alter the balance of assessment purposes and uses in Irish schools.
Giving students a choice of assessment methods is one approach to developing an inclusive curriculum. However, both staff and students raise concerns about its fairness, often described as its equity. This study investigates their perceptions of the fairness of the procedures and outcomes of this approach to assessment, in nine modules in a University setting. Using a tool validated as part of the study, students’ views on procedural fairness were gathered (n = 370 students). In addition, seven module co-ordinators were interviewed. A seven-step approach to the design of the approach was used. The results demonstrated that students were satisfied that their assessment choices were fair in levels of support, feedback, information and, to a lesser extent, student workload and examples of assessment methods. In exploring fairness of the outcomes, the students’ grades were not significantly different between the two sets of choices. However, based on staff interviews, the overall grades were higher than previous cohorts and higher than average for current student cohorts in the institution. The discussion highlights some of the complex issues surrounding fairness (equity) using assessment choice and, in addition, the paper refers to some practical tools for its implementation.
Exploiting the potential that Assessment for Learning (AfL) offers to optimise student learning is contingent on both teachers’ knowledge and use of AfL and the fidelity with which this translates into their daily classroom practices. Quantitative data derived from the use of an Assessment for Learning Audit Instrument (AfLAI) with a large sample (n = 594) across 42 primary schools in the Republic of Ireland serve to deprivatise teachers’ knowledge and use of AfL and the extent to which AfL is embedded in their work. The data confirm that there is urgent need for high-quality teacher professional development to build teacher assessment literacy. However, fiscal constraints coupled with the fractured nature of current provision renders it impossible to offer sustained support on a national scale in the immediate term. In response, this paper proposes the adoption of a design-based implementation research approach to site-based collaborations between researchers, teachers and other constituent groups, such as that engaged in by the authors over recent years, as a mechanism for addressing teachers’ needs in a manner that also supports other participants’ professional interests.
Teachers’ capabilities to conduct classroom assessment and use assessment evidence are central to quality assessment practice, traditionally conceptualised as assessment literacy. In this paper we present, firstly, an expanded conceptualisation of teachers’ assessment work. Drawing on research on teacher identity, we posit that teachers’ identity as professionals, beliefs about assessment, disposition towards enacting assessment, and perceptions of their role as assessors are all significant for their assessment work. We term this reconceptualisation Teacher Assessment Identity (TAI). Secondly, in support of this conceptual work, we present findings from a systematic review of self-report scales on teacher assessment literacy and teacher identity related to assessment. The findings demonstrate that such scales and previous research exploring teacher assessment practices have paid limited attention to what we identify as essential and broader dimensions of TAI. We share our reconceptualisation and analyses to encourage others to consider teacher assessment work more broadly in their research.
This report profiles the documented assessment practices across a sample of 30 undergraduate degree programmes. The study also explores whether and how assessment practices differ between fields of study and also shares insights regarding students’ experiences of assessment across Irish higher education.
The assessment of educational progress and outcomes of pupils is important to all concerned with education. This includes testing which is undertaken for accountability and award bearing purposes. This article examines how students with special educational needs and disability (SEND) are included in assessment. An “inclusive assessment” framework is outlined based around three core features: (1) all students are included and benefit from assessment; (2) assessments are accessible and appropriate for the diverse range of children in the education system; and (3) the full breadth of the curriculum is assessed (including curriculum areas of particular relevance to students with SEND). Assessment policies and practice in three countries (England, Ireland and the US) are drawn upon to demonstrate how the framework usefully enables between-country comparisons and within-country analysis. This analysis shows that in comparison to Ireland, the US and England have highly developed system-based approaches to assessment which seek to “include all” (feature 1) and be “accessible and appropriate” (feature 2). However, the analysis highlights that a consequence of such assessment approaches is the narrowing of the curriculum around topics that are assessed (most notably literacy and mathematics). Such approaches therefore may be at the expense of wider curriculum areas that have value for all students, but often of particular value for those with SEND (feature 3). It is argued that within such systems there may be a danger of neglecting the third feature of the inclusive assessment framework, i.e. ensuring that the full breadth of the curriculum is assessed. A consequence of such an omission could be a failure to assess and celebrate progress in relation to educational outcomes that are relevant to a diverse range of students.
In this paper, Harrison, O’Hara & McNamara criticize the assessment system in Irish education, which they believe continues to rely solely on traditional ‘teacher-centred’ methods. Arguing that this fosters a sense of dependency in learners and undermines their potential to become self-reliant individuals, they advocate for the introduction of self- and peer-assessment (S&PA) strategies, beginning as early as possible in the education system. Following this, they document their investigation of S&PA applied to student group work, which included 11 teachers and 523 students across a range of contexts, from primary and post-primary classrooms to further education settings with early school leavers and senior learners. In each setting, students selected criteria they believed to be important in the process of group work, and marked both themselves and their peers according to these criteria. This was then combined with the teacher’s mark for the overall product. Following analysis of interviews with the teachers in question, observations, and a research journal, Harrison et al suggest that S&PA can be as valid and rigorous as traditional assessment, and that it helps students to become self-directed and independent learners. They acknowledge the need for longitudinal studies to determine its true value and benefits, but nonetheless encourage its use.
This article explores the “inclusive assessment” framework, outlining how the concept of inclusivity can refer not only to who is assessed, but also to how pupils are assessed and what is assessed. The assessment policies and practices of Ireland, England and the U.S. are then examined and compared in terms of the extent to which they exhibit these features of inclusivity. Findings reveal that Ireland falls behind both the US in England on the first two of these three criteria, in that national assessments of literacy and numeracy at primary level in Ireland do not include all children with SEN, and do not offer accommodated or alternative versions to ensure that pupils with SEN can be assessed appropriately. On the other hand, the more deeply ingrained culture of national testing in both the US and England may have the unintended consequence of narrowing the range of curriculum outcomes assessed, thus detracting from inclusivity, as some of the neglected areas may include those that are of particular concern to certain SEND groups. This may be less of an issue in Ireland, where mandatory testing at primary level had only recently been introduced, and is conducted less frequently. Continued analysis of assessment practices in these three countries is advised to track the development of these issues.
The PISA 2009 results for Ireland indicated a large decline in reading literacy scores since PISA 2000 (the largest of 38 countries). The decline in mathematics scores since PISA 2003 was the second largest of 39 countries. In contrast, there was no change in science achievement since PISA 2006. These results prompted detailed investigations into possible reasons for the declines, particularly in reading. This paper considers the changes in achievement observed for Ireland in PISA 2009 under two themes: implementation of PISA in Ireland and changes in the cohort of students participating in PISA, and response patterns on the PISA test (as measures of student engagement). It is argued that the case of Ireland represents the 'perfect storm’, since a range of factors appear to have been in operation to produce the results. The discussion attempts to show how the case of Ireland can be relevant to other countries which may have experienced changes in PISA test scores over time. Some of the findings have relevance to international practice in large-scale surveys of educational achievement more generally.
This paper reports on the experiences of five primary school teachers as they implemented formative assessment strategies in the context of physical education. Each teacher planned and delivered a series of 6-8 lessons based on the Primary Schools’ Sports Initiative lesson plans, and selected a variety of written and verbal assessment strategies to examine their pupils’ learning within these lessons. Their experiences of the process were recorded using a combination of focus groups and reflective journals. Qualitative analysis of these data suggested that the process enhanced teachers’ knowledge, pupils’ learning experiences, and the ‘status’ of physical education from the perspective of the learner. Lessons became more structured and learning more explicit. Some challenges were noted, such as guiding pupils in how to engage in peer assessment, and adapting the assessment strategies to suit the context of infant classes. Ni Chroinin & Cosgrave conclude that the use of formative assessment strategies has a positive effect on teaching and learning in the context of physical education, but that the current lack of guidance surrounding the design of these strategies during initial teacher education presents an obstacle to their future use.
This paper describes the design, development and trialling of the Assessment for Learning Audit Instrument (AfLAi), an instrument designed to support teachers in reviewing their knowledge, skills and practices in formative assessment. Lysaght and O’Leary revisit Lysaght’s (2013) concerns regarding the mismatch between teachers’ mental models and basic AfL strategies, and suggest that this may explain why AfL has failed to take hold to the extent that might have been expected, given the wealth of literature attesting its value. The AfLAi is then offered as a practical first step in addressing this issue. Findings arising from a trial of the instrument support its psychometric structure and provide a snapshot of current formative assessment practices in Irish primary schools.
Lysaght, Z. (2013). The professional gold standard: Adaptive expertise through assessment for learning. In F. Waldron, J. Smith, M. Fitzpatrick & T. Dooley (eds.), Re-imagining initial teacher education: Perspectives on transformation (pp.155-176). Dublin: The Liffey Press.
In this chapter, Lysaght calls for the foregrounding of Assessment for Learning in pre-service teacher education. She outlines how the value of the AfL pedagogy extends beyond its well-documented positive effects on learning, through its ability to promote the development of ‘adaptive expertise’, and considers evidence which suggests that these expertise are not yet pervasive in Irish schools. With this in mind, she urges consideration of how pre-service learning environments may be redesigned, such that they model practices compatible with the AfL philosophy, and, in doing so, challenge the outdated mental models of assessment, teaching and learning to which teachers were exposed during their own schooling.
Lysaght, Z. (2012). Towards inclusive assessment. In T. Day & J. Travers (Eds.) Special and inclusive education: A research perspective (pp.245-260). Oxford: Peter Lang.
This chapter presents findings from an evaluation of a site-based teacher learning community (TLC) designed to increase teachers’ understanding and use of AfL, employed in a disadvantaged junior school over a ten month period. Comparisons of pre- and post-intervention reading scores of the experimental and control groups suggest that the intervention did not have an effect on pupils’ reading achievement overall, but further analysis focusing on pupils with SEN show that it may have helped these children maintain their reading level. Of particular note; however, is that additional outcomes revealed substantial changes in children’s use of AfL approaches during reading as a result of the intervention. Lysaght notes that these findings highlight the bluntness of standardised assessments, and argues that a truly inclusive education system is contingent on the development of more sensitive assessment tools that can capture subtle changes in children’s learning.
Using an action research approach, this research explores the impact of an AfL programme on third class pupils’ writing and self-assessment skills. Following a series of lessons on writing, pupils selected pieces of their work for inclusion in a portfolio, accompanied by reflections on their choices. These portfolios were then used during pupil-involved parent-teacher meetings. Darcy notes that although the programme was associated with increases in preparation and lesson time, it yielded an increased sense of teacher-pupil collaboration, and positive reactions from pupils and parents alike.
This research investigates the implementation of an AfL programme consisting of eight science lessons in a junior infant classroom, using an action research approach. Data collected from interviews, observation notes and researcher’s reflective journal suggest that AfL strategies were successfully introduced, with pupils reportedly achieving gains in learning and associated language development. The challenge of developing AfL materials appropriate for this age group and the need for on-going professional development in this area are noted.
This research investigates the use of AfL strategies in physical education. Macken and O’Leary report how sharing learning intentions and success criteria at the start of a series of PE lessons yielded a range of positive outcomes for pupils, including heightened awareness of learning, more positive attitudes towards PE, and more effective use of time during lessons. There are many parallels between these findings and those of Collins & O’Leary (2010), with both studies demonstrating the potential benefits of AfL in areas of the primary school curriculum not traditionally associated with the concept of assessment.
This research investigates attitudes towards standardised assessment in Ireland, comprising a survey of 30 primary school teachers and an interview with a DES Inspector. McNamara considers themes such as accountability, and the phenomenon of 'teaching to the test', that have recurred in both Irish and international literature on standardised assessment, and seeks to explore the extent to which these themes are reflected in classroom practice, in light of the increasing emphasis placed on this assessment format in Irish primary schools. The findings reveal an appreciation of the benefits of standardised assessment amongst the teachers surveyed, coupled with a keen awareness of their limitations and appropriate uses, which McNamara deems 'commendable'. Also evident from this research; however, is that the majority of teachers experience the pressure of 'accountability' associated with standardised assessments from a range of sources, and that approximately one third of teachers in engage in activities to prepare their students for the tests during class time, some of which are deemed unethical and detrimental to more meaningful forms of learning. Based on these findings, McNamara offers a number of recommendations for future research and practice.
This paper posits that the increasingly ‘child-centred’ nature of the primary school curriculum, although commendable, may inadvertently facilitate an unacceptable breech of children’s privacy, with ‘patterns of disclosure’ of information pertaining to personal and family life now a fundamental element of pupils’ schooling experience. With regard to assessment, Hanafin et al. draw attention to classroom questioning, observation, peer assessment, and the provision of feedback in group situations. Their argument is not that these practices should be abolished, rather that they should be accompanied by an awareness of the potential negative consequences, and means of alleviating these identified.
In this theoretical paper, Dunphy argues that increasing understanding of assessment and curriculum as inter-related constructs necessitates greater consideration of how children’s learning from birth to six years may be formatively assessed. Theoretical constructs related to early learning are discussed, and, on the basis of these, a variety of methods and approaches that may be used for the formative assessment of early learning are presented. These include the observation of children’s behaviour and actions, the skilful use of questioning and of multiple modes of communication (e.g. gaze, facial expression, gestures) during conversation with young children, and the compilation of portfolios that serve as a record of learning, amongst others. Challenges and additional requirements associated with these methods are also noted, including their time-consuming nature, and the importance of a close personal relationship between the educator and the child.
In this paper, Collins & O’Leary note that, despite the recommendations outlined in the Revised Primary School Curriculum of 1999 that assessment should be an integral part of teaching and learning within all areas of the curriculum, there remains a tendency to perceive it as inappropriate in the context of the visual arts. In response to this issue, they compared two types of lessons on the Fabric and Fibre strand of the art curriculum with fifth class pupils: one with the use of ‘success criteria’ as a method of peer- and self-assessment and one without. Teachers’ and pupils’ experiences of each lesson type were recorded by means of a reflective journal and a questionnaire, respectively, and thematically analysed. The findings suggest that incorporating the use of success criteria yielded a range of positive outcomes, including greater focus on the task during lessons, reduced frustration and increased willingness to engage amongst certain pupils, more constructive feedback from the teacher, and greater variation in the artwork produced. Collins & O’Leary argue that these findings contradict concerns that success criteria may encourage routine compliance and thus reduce the learner’s independence. They conclude that the integration of assessment with teaching and learning in the visual arts is possible.
Lysaght, Z. (2009). From Balkanisation to Boundary Crossing: Using a Teacher-Learning Community to Explore the Impact of Assessment On Teaching and Learning in a Disadvantaged School. Doctor of Education Thesis, Dublin City University.
This study examined the potential of a teacher learning community, as a vehicle of professional development, to bring about changes in teachers’ understanding and use of Assessment for Learning (AfL), in order to improve the reading competency of a cohort of children attending a designated disadvantaged, junior school, in the Republic of Ireland. Employing a partially mixed, concurrent equal status design (Onwuegbuzie, 2007) and an interpretive framework, the study tested three research hypotheses. Although no statistically significant changes in effect sizes were found between the control and experimental groups from standard reading attainment data, significant findings were reported both in relation to teachers’ knowledge, skills and attitudes to AfL and the approaches to reading adopted by the children in the experimental group. These findings, in turn, highlight the potential of a TLC, reconceived as a boundary zone (Star, 1989), to challenge the traditional Balkanisation of teachers’ working lives (Hargreaves, 1994).
McCrudden, E. (2009). Questioning for appropriate assessment and learning. Master of Science, Dublin City University
This thesis investigates three forms of assessment in chemistry – the Leaving Certificate Examination (summative) and two distinct continuous assessment methods used during undergraduate chemistry modules in Dublin City University (formative). Referring to Bloom’s Taxonomy of Cognitive Domains, McCrudden reports that most questions in the Leaving Cert. exam are written at the lower levels, and that some topics are not frequently assessed, while others are over-assessed. Analyses of the third-level assessments reveal that these formative methods can encourage students to take a more active role in their learning, and increase their engagement with the material.
In this paper, MacRuairc argues that the possibility of an inherent bias in standardised assessments has not received sufficient consideration when attempting to explain the lower levels of attainment typically observed in disadvantaged schools. He reports on a series of focus groups in which children from both middle- and working-class backgrounds were asked to describe the strategies they employed when responding to items on standardised tests. Children from both backgrounds described similar strategies, such as seeking a context for target words from the test in their own experiences. This revealed a marked discontinuity between the linguistic register of the test instrument and the linguistic repertoire of the working class children. MacRuairc argues that the use of the dominant linguistic code in standardised tests ‘negates a whole way of being’ and erodes the self-efficacy of working-class pupils. He thus cautions that continued used of standardised assessments that fail to acknowledge the language variety used by specific groups may exacerbate stratified patterns of achievement.
This is a reflective and exploratory piece of action research investigating how Assessment for Learning (AfL) practices may be implemented in the Irish language classroom through
the use of e-portfolios. Clerkin documents how her second class pupils developed self- and peer-assessment skills and gradually became more autonomous in their learning, through the process of compiling a selection of their work over time using ICT. She simultaneously reflects on her own experiences, citing the challenge of maintaining a balance between supporting her students and allowing them freedom to explore. The need to move towards more formative approaches to the assessment of Irish is expressed, and it is suggested that e-portfolios may be an effective tool to this end.
In the wake of repeated calls for a programme of teacher professional development in assessment in Ireland, this paper provides a suggested menu of topics for inclusion in such a programme. Informed by both international literature and national documents relevant to the Irish context, the proposed programme encompasses numerous aspects of assessment, including assessment terminology, the use of performance assessment tasks to improve learning processes, interpreting standardized test results, facilitating pupil self-assessment, understanding how assessment can cater for a range of pupil abilities, issues associated with grading, and the challenge of communicating assessment information, among many others. O’Leary notes that any such programme should also take into account the research indicating that teacher professional development is more effective when it is school embedded, co-operative and sustained over time.
This research examines the use of Assessment for Learning techniques, including self- and peer-assessment, in the context of English writing with a group of third class students. O’Callaghan reports that these strategies developed students’ competence in identifying strengths and weaknesses in various genres of writing, and promoted skills of reflection, self-correction and independence in writing.
In this paper, Looney & Klenowski consider how the concept of the ‘knowledge society’ has fuelled not just educational ‘reform’, but a thorough reconceptualization of many key components of education. They then demonstrate how this has been reflected in practice, via case studies of recent changes in curriculum and assessment in Ireland and Queensland, Australia. In Ireland, the NCCA’s review of senior cycle education and the associated consultation process have culminated in the identification of a number of ‘key skills’ (e.g. personal effectiveness, critical thinking, working with others) as the core of a proposed new curriculum. There is no accompanying explanation of how these skills will be assessed, however. In Queensland, the development of the “Queensland Assessment Task” is described as offering a promising opportunity to capture rich information about student achievement in a range of processing skills. Looney & Klenowski compare the two cases, drawing parallels between their emphases on concepts such as ‘skills’ and ‘learning power’, as opposed to ‘content’ and ‘information’. They argue that both policy initiatives illustrate a true transformation in education, but that precisely how assessment practices, in particular high-stakes testing, will be informed by this transformation remains unclear.
This study explores the AfL strategies of sharing learning intentions and identifying success criteria in a phonics lesson for children with mild general learning difficulties, and the introduction of a Teacher Learning Community (TLC), a professional tool designed to support the implementation of AfL strategies in the classroom. Data were collected through the process of observation, documentation from the TLC meetings and Lesson Reviews, children’s lesson sheets and a researcher’s log. The findings reveal a number of challenges associated with the use of AfL strategies in the special classroom.
This action research investigates the implementation of self- and peer-assessment strategies in the context of process writing with fourth class pupils. Pupils received a series of lessons on writing, during which specific learning targets and success criteria were introduced. Data were collected through observations of the lessons, pupils’ writing samples, focus groups with pupils and interviews with teachers. Feedback to and from peers, self-reflection, feedback from the teacher, and engagement emerged as significant themes facilitating the process of self- and peer-assessment. Elements of writing that improved throughout the course of the ten week study included word usage, lead sentences, character descriptions and titles. On the basis of these findings, Lambert identifies areas for further research.
This is a comprehensive document considering the role of assessment in primary education. It opens with an overview of the developments pertaining to assessment that took place during the period 1997-2008 as a result of the Education Act (1998), the Revised Primary School Curriculum (1999), and the introduction of mandatory standardised testing at two stages during primary schooling. In Chapter 2, three major purposes of assessment are identified and explored, namely: (i) to support the process of teaching and learning, (ii) to report on pupils’ progress and (iii) accountability. It is acknowledged that all three are valid, and that the purpose of an assessment should determine the type of assessments to be used. Chapter 3 outlines the general assessment policies and practices in Ireland, whilst Chapter 4 reports on the findings arising from a questionnaire administered to teachers relating to specific assessment practices in schools. Chapter 5 considers international assessment practices, whilst Chapter 6 offers a series of recommendations regarding assessment policy and practice for the future, including the allocation of time for planning for assessment, the provision of professional development in relation to assessment, and the development of standardised assessments of Irish, amongst others. The second half of the document presents the proceedings of the Consultative Conference on Education (2008).
In this paper, O’Leary puts forward a model of what he considers to be a balanced assessment system for Irish schools. He opens by considering the increasing prominence of assessment in the Irish education discourse, and provides a comprehensive definition of the term, drawing attention to its expansion in recent years to include the notion of assessment for learning as well as assessment of learning. He contends that good assessment should inform decision-making, acknowledging the challenges arising from the fact that various stakeholders in education have different decisions to make. These diverse needs, he argues, are what necessitate a balanced assessment system, and he laments the situation in many countries, whereby bureaucratic requirements are prioritised at the expense of teaching and learning. His principle argument is that assessment should serve the needs of learners first and foremost, and he makes a series of recommendations as to how this might be achieved. These include prioritising classroom assessment and resisting the introduction of mandated national testing.
Six years on from Hall’s criticisms of assessment policy and practice in primary schools, this paper provides an overview of the developments that have taken place since then, whilst simultaneously considering the situation at post-primary level. Looney notes that certain cultural and economic factors in Ireland have fostered widespread faith in its education system, with the result that the response to any issues arising is typically to demand additional resources, as opposed to seeking fundamental change. She sees this as the major reason behind the fact that ‘assessment-led reform’, which has heavily featured in educational policy internationally, has not yet occurred in Ireland. Looney echoes many of Hall’s initial concerns regarding primary school assessment, but notes some progress, namely an emerging dialogue surrounding good practice, in which teachers are included, and increasing recognition of the need for professional development in the area of assessment for learning. In response to the recent government proposal to introduce mandated standardized testing in literacy and numeracy, she warns against the ‘assessment hierarchy’ that this may create, and reiterates the many different purposes of assessment. Finally, Looney argues that post-primary assessment is also in urgent need of reform, (specifically, a move away from the focus on high-stakes state examinations) but that little to no progress has been made in this domain in comparison to the emerging changes evident at primary level.
In this paper, Kilfeather, O’Leary and Varley document their development of a set of performance-based tasks to facilitate science assessment in primary schools. This project was conducted over a four-year period in response to both the introduction of science as a subject area at primary level, and the emphasis on assessment as an integral part of teaching and learning under the revised primary curriculum of 1999. Five distinct stages of the project are described. Phase One involved locating extant performance tasks used in five English-speaking countries with science curricula at primary level, whilst Phase Two involved adapting these tasks to match the aims and objectives of the Irish curriculum. In Phase Three, a selection of the tasks were sent to a representative sample of primary teachers for evaluation, and in Phase Four, 11 of the tasks were evaluated ‘in action’ in different classroom settings. Evaluations of the tasks revealed a predominantly positive response, with teachers reporting active involvement of teachers and pupils in the tasks, pupil enjoyment of the tasks, and the potential to use the assessment information gleaned from the tasks in different ways. Finally, in Phase Five, amendments were made to the tasks on the basis of these evaluations. Kilfeather et al note that, as a result of this project, 124 tasks are now well aligned with the Irish primary science curriculum, and may be used for teaching, learning and assessment in science in Irish primary schools.
This research investigates the use of learning stories as a form of assessment over a ten-week period with a junior infant class. Ennis reports how this approach successfully highlighted learning in subjects such as language, mathematics, science, visual arts and music, and was associated with a high level of parental participation and engagement. The time required to implement the approach is noted as a significant challenge.
In this paper, Little considers the learner-centred approach and the integration of self-assessment with other forms of assessment in the context of second language learning. He reports on a project that has drawn on the Common European Framework of Reference for Languages (CEFR) and the European Language Portfolio (ERP) to define an English as a Second Language (ESL) curriculum for newcomer pupils in Irish primary schools, and outlines plans to develop assessment and reporting procedures for the ESL curriculum, in which learner self-assessment plays a central role.
Murphy, R. (2000). The validity of a portfolio approach to instruction and assessment in writing in the primary school. Master of Arts thesis, Dublin City University.
In light of the paradigm shift from summative to formative assessment, and the associated need to develop a range of alternative modes of assessment, this research explores the portfolio approach to assessing pupils’ writing at primary level. The Educational Research Centre’s Drumcondra Writing Project, which saw the collation of portfolios of children’s written work in natural settings over the course of the 1995-1996 school year, provided a springboard for this research. A selection of these portfolios was identified as being of especially high quality, and the teachers and pupils in question were invited to participate in this further study. Over the course of two years, portfolios of these pupils’ work were examined, and both pupils’ and teachers’ experiences of the processes were sought through written reflections and semi-structured interviews respectively, with a view to thoroughly exploring the use of portfolios as assessment tools in these exemplar cases. Murphy concludes that portfolios allow for and generate the use of formative assessment techniques, and the incorporation of feedback that is relevant for individual children. She invites further study on the use of portfolios for assessment purposes in other subject areas of the primary school curriculum, especially those for which assessment procedures are not currently evident, such as music, physical education, and visual arts.
Following on from Hall’s (2000) criticisms of assessment policy under the Revised Primary School Curriculum of 1999, Hall & Kavanagh report the findings from a series of interviews conducted with various interest groups in Irish primary education. They contend that, due to the lack of clarity in many aspects of the policy, the manner in which these groups understand the purposes and forms of assessment will determine how it will eventually be implemented. Stakeholders interviewed included teachers, parents, the then ‘shadow’ Minister of Education, the Chief Executive of the National Parents Council, a senior inspector at the DES and a senior official at the NCCA. Hall & Kavanagh conclude that these groups hold markedly different views about assessment, with each group tending to interpret the purposes of assessment primarily in relation to its own needs, rather than the needs of the learner. They also note a somewhat unanimous confidence in formal, standardized tests. On the basis of these findings, they emphasize the need for greater discussion and informed debate amongst these interest groups, and draw attention once more to the wealth of literature supporting the use of assessment to inform and guide pupils’ learning (as opposed to solely for purposes such as accountability).
In this paper, Hall provides a comprehensive evaluation of the Irish policy position on primary school assessment. She first chronicles key events that influenced the development of the policy, including the 1990 Review on the Primary Curriculum, the 1992 Green Paper on Education, the NCCA’S Programme for Reform (1993), the National Education Convention (1994), and the 1995 White Paper on Education, culminating in the recommendations for assessment set out in the draft document of the Revised Primary School Curriculum (1997). She documents a move towards and subsequently away from the marketization of education throughout this process, and associated discontinuities in the discourse surrounding assessment, most notably summative vs. formative understandings of assessment, and whether or not assessment should be used as a mechanism for teacher and school accountability. She then describes the policy in detail, outlining what she sees as its major strengths and weaknesses. Recognition of the importance of formative assessment practices is lauded as a key strength of the policy, due the alignment of this stance with contemporary research literature. Hall argues; however, that this is not accompanied by concrete guidelines on how to implement these practices. Furthermore, she believes that the policy’s assertion that all forms of assessment should have parity of esteem is heavily contradicted by the disproportionate attention afforded to standardised tests and their functions. She considers the factors that may have led to these undesirable features, and concludes with a number of recommendations. These include, among others, the redeployment of funds set aside for the development of standardised tests towards the provision of teacher training in formative assessment, and the need to ensure that all those involved in policy development are suitably informed by contemporary research.
Covid-19 Contingency Plans for Assessments
As third level institutions worldwide decided to cancel end of term exams for the majority of students as a result of the covid-19 pandemic, many of us were required to design new assignments and tasks to assess our students. The resources here were made available to help plan for these changes.
Advice for Choosing Alternative Assessments
Video explaining Pass/Fail Assignments
Summary Infographic on Pass/Fail Assignments
Exemplar illustrating Original v Pass/Fail Assignments
A Primer on Differences between Norm-Reference Based and Criterion-Referenced Assessments
A Primer on Criterion-Referenced Assessments and Rubrics
A Primer on Norm-Reference Based Assessment and Grading on the Curve
A Primer on Performance Standards, Cut Scores and Weights
Weighted Rubric with Scoring Guide (Example)
Guidance on Moving from Exams to Pass/Fail Assignments
Lecture Resources
The 2019 CARPE Lecture: Dr. Mathias von Davier, 'What you always wanted to know about Process Data but were too afraid to ask'.
In November 2025, CARPE hosted the event “100 Years of the Leaving Certificate: Past Insights, Future Directions” at the DCU Institute of Education in Dublin.
The event marked the centenary of the Leaving Certificate and brought together perspectives from research, policy and practice to support an informed and constructive dialogue on the role of assessment in Irish education. Across keynotes and panel discussions, the programme explored how high-stakes examinations shape learning and opportunity, how fairness and public trust can be protected, and what challenges and possibilities lie ahead for senior cycle assessment and reform.
The present PDF is intended as a record of the event and as a resource for colleagues interested in assessment policy and practice. It includes the slide decks provided by speakers (in the format received) and, where available, notes/minutes from the panel discussion. Please note that some presentations were originally shared as PDF files and are reproduced here accordingly; formatting has not been altered beyond what was necessary to compile the document.
carpe-proceedings-100-years-of-the-leaving-certificate-past-insights-future-directions.pdf