The Impact of Assessment Training on EFL Writing Classroom Assessment: Voices of Mexican University Teachers
El impacto de la capacitación en evaluación de la escritura en el aula de inglés como lengua extranjera: voces de profesores mexicanos universitarios
DOI:
https://doi.org/10.15446/profile.v23n1.85019Keywords:
EFL writing assessment, language assessment literacy, writing assessment training (en)alfabetización en evaluación de idiomas, capacitación en evaluación de escritura, evaluación de escritura en inglés como lengua extranjera (es)
The extent to which writing assessment training (WAT) impacts writing scores has been widely explored in L2 testing contexts. However, little is known of the benefits of WAT to classroom assessment of writing. This paper analyzes the impact of two WAT sessions on the classroom assessment of writing of eleven EFL Mexican university teachers. Twenty-two interview transcripts suggested an impact in three main areas: classroom teaching of writing, classroom assessment of writing, and teacher self-awareness. The category of teacher self-awareness displayed the most impact. The paper proposes a categorization of impact on writing assessment.
El impacto de la capacitación en evaluación de la escritura sobre los puntajes que los estudiantes obtienen en dicha habilidad se ha explorado ampliamente en contextos de exámenes a gran escala en L2. Sin embargo, se sabe poco de los beneficios de dicha capacitación en el aula. Este artículo analiza el impacto de dos sesiones de capacitación en la evaluación de la escritura en el salón de once profesores universitarios mexicanos de inglés como lengua extranjera. Veintidós transcripciones de entrevistas sugirieron impacto en tres áreas principales: enseñanza de la escritura en el aula, evaluación de la escritura en el aula y autoconciencia del profesor. La categoría de autoconciencia del profesor mostró el mayor impacto. El artículo propone una categorización del impacto en la evaluación de la escritura.
References
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice. Oxford University Press.
Baker, B. A., & Riches, C. (2018). The development of EFL examinations in Haiti: Collaboration and language assessment literacy development. Language Testing, 35(4), 557–581. https://doi.org/10.1177/0265532217716732
Chen, Q., Kettle, M. A., Klenowski, V., & May, L. (2013). Interpretations of formative assessment in the teaching of English at two Chinese universities: A sociocultural perspective. Assessment and Evaluation in Higher Education, 38(7), 831–846. https://doi.org/10.1080/02602938.2012.726963
Cohen, L., Manion, L., & Morrison, K. (2011). Research methods in education (7th ed). Routledge.
Coombe, C., Troudi, S., & Al-Hamly, M. (2012). Foreign and second language teacher assessment literacy: Issues, challenges and recommendations. In C. Coombe, P. Davidson, B. O’Sullivan, & S. Stoynoff (Eds.), The Cambridge guide to second language assessment (pp. 20–29). Cambridge University Press.
Council of Europe. (2009a). The manual for language test development and examination.
Council of Europe. (2009b). Relating language examinations to the common European framework of reference for languages: Learning, teaching, assessment (CEFR): A manual. https://bit.ly/3fsDXNR
Council of Europe. (2011). Manual for language test development and examining: For use with the CEFR. https://bit.ly/3fty0jR
Creswell, J. W. (2013). Research design: Qualitative, quantitative, and mixed methods approaches. Sage Publications.
Creswell, J. W. (2015). A concise introduction to mixed methods research. Sage Publications.
Crusan, D. (2010). Assessment in the second language writing classroom. The University of Michigan Press. https://doi.org/10.3998/mpub.770334
Crusan, D., Plakans, L., & Gebril, A. (2016). Writing assessment literacy: Surveying second language teachers’ knowledge, beliefs, and practices. Assessing Writing, 28, 43–56. https://doi.org/10.1016/j.asw.2016.03.001
Dörnyei, Z. (2007). Research methods in applied linguistics: Quantitative, qualitative and mixed methodologies. Oxford University Press.
Elder, C., Barkhuizen, G., Knoch, U., & Randow, J. (2007). Evaluating rater responses to an online training program for L2 writing assessment. Language Testing, 24(1), 37–64. https://doi.org/10.1177/0265532207071511
Elder, C., Knoch, U., Barkhuizen, G., & von Randow, J. (2005). Individual feedback to enhance rater training: Does it work? Language Assessment Quarterly, 2(3), 175–196. https://doi.org/10.1207/s15434311laq0203_1
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132. https://doi.org/10.1080/15434303.2011.642041
González, E. F. (2018). The impact of assessment training on English as a foreign language university professors classroom writing assessment: Reported practice and perceptions [Doctoral dissertation, University of Southampton]. https://bit.ly/3emIal7
González, E. F., & Vega-López, N. A. (2018). Exploring Mexican EFL elementary school teachers’ perceptions of online language assessment training. Journal of Applied Linguistics and Language Research, 5(1), 225–241.
Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385–402. https://doi.org/10.1177/0265532208090158
Jeong, H. (2013). Defining assessment literacy: Is it different for language testers and non-language testers? Language Testing, 30(3), 345–362. https://doi.org/10.1177/0265532213480334
Jin, Y., & Jie, W. (2017, July 17–21). Do workshops really work? Evaluating the effectiveness of training in language assessment literacy [Paper presentation]. 39th Language Testing Research Colloquium, Bogotá, Colombia.
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007). Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1(2), 112–133. https://doi.org/10.1177/1558689806298224
Knoch, U. (2011). Investigating the effectiveness of individualized feedback to rating behavior: A longitudinal study. Language Testing, 28(2), 179–200. https://doi.org/10.1177/0265532210384252
Koh, K., Burke, L. E. C., Luke, A., Gong, W., & Tan, C. (2017). Developing assessment literacy of teachers in Chinese language classrooms: A focus on assessment task design. Language Teaching Research, 22(3), 264–288. https://doi.org/10.1177/1362168816684366
Lam, R. (2014). Language assessment training in Hong Kong: Implications for language assessment literacy. Language Testing, 32(2), 169–197. https://doi.org/10.1177/0265532214554321
Leung, C., & Mohan, B. (2004). Teacher formative assessment and talk in classroom contexts: assessment as discourse and assessment of discourse. Language Testing, 21(3), 335–359. https://doi.org/10.1191/0265532204lt287oa
López-Mendoza, A. A., & Bernal-Arandia, R. (2009). Language testing in Colombia: A call for more teacher education and teacher training in language assessment. Profile: Issues in Teacher’ Professional Development, 11(2), 55–70.
Malone, M. E. (2013). The essentials of assessment literacy: Contrasts between testers and users. Language Testing, 30(3), 329–344. https://doi.org/10.1177/0265532213480129
Nier, V. C., Donovan, A. E., & Malone, M. E. (2013, October). Promoting assessment literacy for language instructors through an online course [Poster presentation]. East Coast Organization of Language Testers Conference, Washington, D.C.
Paltridge, B., & Phakiti, A. (Eds.). (2010). Continuum companion to research methods in applied linguistics. Continuum International.
Pavlenko, A. (2007). Autobiographic narratives as data in applied linguistics. Applied Linguistics, 28(2), 163–188. https://doi.org/10.1093/applin/amm008
Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309–327. https://doi.org/10.1177/0265532213480128
Scarino, A. (2017). Developing assessment literacy of teachers of languages: A conceptual and interpretative challenge. Papers in Language Testing and Assessment, 6(1), 18–40.
Shohamy, E., Gordon, C. M., & Kraemer, R. (1992). The effect of raters’ background and training on the reliability of direct writing tests. The Modern Language Journal, 76(1), 27–33. https://doi.org/10.1111/j.1540-4781.1992.tb02574.x
Stiggins, R. J. (1999). Evaluating classroom assessment training in teacher education programs. Educational Measurement: Issues and Practice, 18(1), 23–27. https://doi.org/10.1111/j.1745-3992.1999.tb00004.x
Strauss, A. L., & Corbin, J. (1994). Grounded theory methodology: An overview. In N. Denzin & Y. Lincoln (Eds.), Handbook of qualitative research (1st ed., pp. 273–285). Sage Publications.
Taber, K. S. (2000). Case studies and generalizability: Grounded theory and research in science education. International Journal of Science Education, 22(5), 469–487. https://doi.org/10.1080/095006900289732
Taylor, L. (2009). Developing assessment literacy. Annual Review of Applied Linguistics, 29, 21–36. https://doi.org/10.1017/S0267190509090035
Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403–412. https://doi.org/10.1177/0265532213480338
Vogt, K., & Tsagari, D. (2014). Assessment literacy for foreign language teachers: Findings of a European university. Language Assessment Quarterly, 11(4), 374–402. https://doi.org/10.1080/15434303.2014.960046
Volante, L., & Fazio, X. (2007). Exploring teacher candidates’ assessment literacy: Implications for teacher education reform and professional development. Canadian Journal of Education, 30(3), 749–770. https://doi.org/10.2307/20466661
Weigle, S. C. (1994). Effects of training on raters of ESL compositions. Language Testing, 11(2), 197–223. https://doi.org/10.1177/026553229401100206
Weigle, S. C. (1998). Using FACETS to model rater training effects. Language Testing, 15(2), 263–287. https://doi.org/10.1177/026553229801500205
Weigle, S. C. (2007). Teaching writing teachers about assessment. Journal of Second Language Writing, 16(3), 194–209. https://doi.org/10.1016/j.jslw.2007.07.004
Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, 149–162. https://doi.org/10.1016/j.tate.2016.05.010
Yan, X., Fan, J., & Zhang, C. (2017, July 17–21). Understanding language assessment literacy profiles of different stakeholder groups in China: The importance of contextual and experiential factors [Paper presentation]. 39th Language Testing Research Colloquium, Bogotá, Colombia.
How to Cite
APA
ACM
ACS
ABNT
Chicago
Harvard
IEEE
MLA
Turabian
Vancouver
Download Citation
CrossRef Cited-by
1. Sabah Al-Akbari, Marianne Nikolov, Ágnes Hódi. (2026). Language Assessment Literacy Development: A Case Study of Three EFL Teachers. Education Sciences, 16(1), p.101. https://doi.org/10.3390/educsci16010101.
2. Frank Giraldo, Lenny García. (2025). Evaluating an Online Language Assessment Course. Colombian Applied Linguistics Journal, 27(1), p.112. https://doi.org/10.14483/22487085.22116.
3. Xiaoli Su, Hongbiao Yin, Icy Lee. (2024). Let a hundred flowers bloom: Towards a coexistence of paradigms in language assessment literacy. Linguistics and Education, 84, p.101346. https://doi.org/10.1016/j.linged.2024.101346.
4. Frank Giraldo, Xun Yan. (2025). Evaluating an Online Assessment Course: Teachers’ Voices on Their Language Assessment Literacy. Profile: Issues in Teachers' Professional Development, 27(1), p.97. https://doi.org/10.15446/profile.v27n1.113304.
5. Taufiqulloh Taufiqulloh, Meyga Agustia Nindya, Anin Eka Sulistyawati, Didik Rinan Sumekto. (2025). Investigating Indonesian EFL students’ writing strategies: a framework for self-assessment. Language Testing in Asia, 15(1) https://doi.org/10.1186/s40468-025-00388-3.
Dimensions
PlumX
Article abstract page views
Downloads
License
Copyright (c) 2021 Elsa Fernanda González

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
You are authorized to copy and redistribute the material in any medium or format as long as you give appropriate credit to the authors of the articles and to Profile: Issues in Teachers' Professional Development as original source of publication. The use of the material for commercial purposes is not allowed. If you remix, transform, or build upon the material, you may not distribute the modified material.
Authors retain the intellectual property of their manuscripts with the following restriction: first publication is granted to Profile: Issues in Teachers' Professional Development.






























