Planning an Online Assessment Course for English Language Teachers in Latin America
La planeación de un curso de evaluación en línea para docentes de inglés de Latinoamérica
DOI:
https://doi.org/10.15446/profile.v25n2.104703Keywords:
assessment literacy, language assessment literacy, language testing, teacher professional development (en)desarrollo profesional docente, evaluación de lenguas extranjeras, literacidad en evaluación, literacidad en evaluación de lenguas extranjeras (es)
In this article, we report the results of a study through which we collected English language teachers’ needs and wants to design an online language assessment course. Through a mixed-methods approach, we asked 20 teachers from four Latin American countries what they wanted to learn in the course. The teachers wanted a course in which they could address the challenges they faced in assessment; discuss and develop new ways to assess; and learn about authentic, valid, and ethical assessment. Therefore, the findings suggest that the teachers wanted a course that mixed theory, practice, and principles of assessment. Additionally, the course should address emerging topics in English language assessment, namely bilingual assessment and the assessment of learners with special educational needs.
En este artículo reportamos los hallazgos de una investigación mixta acerca de los deseos y necesidades en evaluación de un grupo de docentes de inglés con el objetivo de diseñar un curso en línea de evaluación de lenguas extranjeras. Tras ser entrevistados, veinte docentes de inglés de cuatro países latinoamericanos informaron que deseaban un curso que les permitiera discutir los retos de la evaluación; estudiar maneras novedosas de evaluar, y aprender sobre la evaluación auténtica, válida y ética. Es decir, un curso que incorpore la teoría, la práctica y los principios de evaluación y que además explore temas emergentes en la evaluación del inglés como lengua extranjera: la evaluación bilingüe y la evaluación de estudiantes con necesidades educativas especiales.
References
American Federation of Teachers, National Council on Measurement in Education, & National Education Association. (1990). Standards for teacher competence in educational assessment of students. https://buros.org/standards-teacher-competence-educational-assessment-students
Arias, C. I., Maturana, L. M., & Restrepo, M. I. (2012). Evaluación de los aprendizajes en lenguas extranjeras: hacia prácticas justas y democráticas. Lenguaje, 40(1), 99–126. https://doi.org/10.25100/lenguaje.v40i1.4945
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford University Press.
Baker, B. (2021, July 2). Unpacking the concept of language assessment literacy for all key stakeholders [Conference session]. New Directions in English Language Assessment Conference, Bogotá, Colombia. https://bit.ly/3F9dOTT
Baker, B. A., & Riches, C. (2017). The development of EFL examinations in Haiti: Collaboration and language assessment literacy development. Language Testing, 35(4), 557–581. https://doi.org/10.1177/0265532217716732
Bøhn, H., & Tsagari, D. (2021). Teacher educators’ conceptions of language assessment literacy in Norway. Journal of Language Teaching and Research, 12(2), 222–233. https://doi.org/10.17507/jltr.1202.02
Boyd, E., & Donnarumma, D. (2018). Assessment literacy for teachers: A pilot study investigating the challenges, benefits and impact of assessment literacy training. In D. Xerri & P. Vella Briffa (Eds.), Teacher involvement in high-stakes language testing (pp. 105–126). Springer. https://doi.org/10.1007/978-3-319-77177-9_7
Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches. SAGE.
Crusan, D., Plakans, L., & Gebril, A. (2016). Writing assessment literacy: Surveying second language teachers’ knowledge, beliefs, and practices. Assessing Writing, 28, 43–56. https://doi.org/10.1016/j.asw.2016.03.001
Davies, A. (2008). Textbook trends in teaching language testing. Language Testing, 25(3), 327–347. https://doi.org/10.1177/0265532208090156
Díaz-Larenas, C., Alarcón-Hernández, P., & Ortiz-Navarrete, M. (2012). El profesor de inglés: sus creencias sobre la evaluación de la lengua inglesa en los niveles primario, secundario y terciario. Íkala, Revista de Lenguaje y Cultura, 17(1), 15–26. https://doi.org/10.17533/udea.ikala.10039
Dörnyei, Z. (2007). Research methods in applied linguistics. Oxford University Press.
Frodden, M., Restrepo, M., & Maturana, L. (2004). Analysis of assessment instruments used in foreign language teaching. Íkala, Revista de Lenguaje y Cultura, 9(1), 171–201. https://doi.org/10.17533/udea.ikala.3146
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132. https://doi.org/10.1080/15434303.2011.642041
Fulcher, G. (2020). Operationalizing assessment literacy. In D. Tsagari (Ed.), Language assessment literacy: From theory to practice (pp. 8–28). Cambridge Scholars.
George, D., & Mallery, P. (2003). SPSS for Windows step by step: A simple guide and reference. 11.0 update (4th ed.). Allyn & Bacon.
Giraldo, F. (2018). Language assessment literacy: Implications for language teachers. Profile: Issues in Teachers’ Professional Development, 20(1), 179–195. https://doi.org/10.15446/profile.v20n1.62089
Giraldo, F., & Murcia, D. (2018). Language assessment literacy for pre-service teachers: Course expectations from different stakeholders. GIST – Education and Learning Research Journal, (16), 56–77. https://doi.org/10.26817/16925777.425
Giraldo, F., & Murcia, D. (2019). Language assessment literacy and the professional development of pre-service language teachers. Colombian Applied Linguistics Journal, 21(2), 243–259. https://doi.org/10.14483/22487085.14514
Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385–402. https://doi.org/10.1177/0265532208090158
Inbar-Lourie, O. (2013a). Guest Editorial to the special issue on language assessment literacy. Language Testing, 30(3), 301–307. https://doi.org/10.1177/0265532213480126
Inbar-Lourie, O. (2013b, November). Language assessment literacy: What are the ingredients? [Paper presentation]. 4th CBLA SIG Symposium, University of Cyprus, Cyprus.
Inbar-Lourie, O. (2017). Language assessment literacy. In E. Shohamy, I. G. Or, & S. May (Eds.), Language testing and assessment: Encyclopedia of language and education (3rd ed., pp. 257–270). Springer. https://doi.org/10.1007/978-3-319-02261-1_19
International Language Testing Association. (2007). ILTA guidelines for practice in English. https://bit.ly/3F17GNp
Ivankova, N., & Greer, J. (2015). Mixed methods research and analysis. In B. Paltridge & A. Phakiti (Eds.), Research methods in applied linguistics: A practical resource (2nd ed., pp. 63–81). Bloomsbury Publishing.
Kleinsasser, R. C. (2005). Transforming a postgraduate level assessment course: A second language teacher educator’s narrative. Prospect, 20(3), 77–102.
Koh, K., Burke, L. E. C., Luke, A., Gong, W., & Tan, C. (2018). Developing the assessment literacy of teachers in Chinese language classrooms: A focus on assessment task design. Language Teaching Research, 22(3), 264–288. https://doi.org/10.1177/1362168816684366
Kremmel, B., Eberharter, K., Holzknecht, F, & Konrad, E. (2018). Fostering language assessment literacy through teacher involvement in high-stakes test development. In D. Xerri & P. Vella Briffa (Eds.), Teacher involvement in high-stakes language testing (pp. 173–194). Springer. https://doi.org/10.1007/978-3-319-77177-9_10
Kremmel, B., & Harding, L. (2019). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey. Language Assessment Quarterly, 17(1), 100–120. https://doi.org/10.1080/15434303.2019.1674855
Levi, T., & Inbar-Lourie, O. (2019). Assessment literacy or language assessment literacy: Learning from the teachers. Language Assessment Quarterly, 17(2), 168–182. https://doi.org/10.1080/15434303.2019.1692347
Malone, M. E. (2017). Training in language assessment. In E. Shohamy, I. G. Or, & S. May (Eds.), Language testing and assessment: Encyclopedia of language and education (3rd ed., pp. 225–239). Springer. https://doi.org/10.1007/978-3-319-02261-1_16
Montee, M., Bach, A., Donovan, A., & Thompson, L. (2013). LCTL teachers’ assessment knowledge and practices: An exploratory study. Journal of the National Council of Less Commonly Taught Languages, 13, 1–31.
Nier, V. C., Donovan, A. E., & Malone, M. E. (2009). Increasing assessment literacy among LCTL instructors through blended learning. Journal of the National Council of Less Commonly Taught Languages, 7, 94–118.
O’Loughlin, K. (2006). Learning about second language assessment: Insights from a postgraduate student on-line subject forum. University of Sydney Papers in TESOL, 1, 71–85.
QSR International. (n.d.). Nvivo® (Version 10) [Computer software]. https://bit.ly/3Xweiug
Restrepo-Bolívar, E. M. (2020). Monitoring preservice teachers’ language assessment literacy development through journal writing. Malaysian Journal of ELT Research, 17(1), 38–52.
Saldaña, J. (2016). The coding manual for qualitative researchers. SAGE Publications.
Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309–327. https://doi.org/10.1177/0265532213480128
Stabler-Havener, M. L. (2018). Defining, conceptualizing, problematizing, and assessing language teacher assessment literacy. Working Papers in Applied Linguistics & TESOL, 18(1), 1–22.
Sultana, N. (2019). Language assessment literacy: An uncharted area for the English language teachers in Bangladesh. Language Testing in Asia, 9(1), 2–14. https://doi.org/10.1186/s40468-019-0077-8
Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403–412. https://doi.org/10.1177/0265532213480338
Villa-Larenas, S., Quevedo, G., & González, F. (2021, July 1-3). Survey on language assessment literacy in Latin America: Preliminary results [Paper presentation]. New Directions in English Language Assessment Conference, Bogotá, Colombia.
Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11(4), 374–402. https://doi.org/10.1080/15434303.2014.960046
Walters, F. S. (2010). Cultivating assessment literacy: Standards evaluation through language-test specification reverse engineering. Language Assessment Quarterly, 7(4), 317–342. https://doi.org/10.1080/15434303.2010.516042
Yan, X. (2021, June 14–17). Towards a conceptual model of LAL development across stakeholder groups and contexts [Paper presentation]. Language Testing Research Colloquium, online.
Yan, X., & Fan, J. (2021). “Am I qualified to be a language tester?”: Understanding the development of language assessment literacy across three stakeholder groups. Language Testing, 38(2), 219–246. https://doi.org/10.1177/0265532220929924
Yan, X., Zhang, C., & Fan, J. J. (2018). “Assessment knowledge is important, but …”: How contextual and experiential factors mediate assessment practice and training needs of language teachers. System, 74, 158–168. https://doi.org/10.1016/j.system.2018.03.003
How to Cite
APA
ACM
ACS
ABNT
Chicago
Harvard
IEEE
MLA
Turabian
Vancouver
Download Citation
CrossRef Cited-by
1. Fabio Alberto Arismendi Gómez, Juan Felipe Zuluaga Molina, Juan Carlos Padilla Villada, Didier Armando Cano Mira, Alejandro Arroyave Tobón, Julieth Valencia Espinosa, Doris Colorado López, María Angélica Duque Narváez. (2025). Panorama de la enseñanza del francés en el departamento de Antioquia, Colombia. https://doi.org/10.17533/udea.978-958-501-240-0.
2. Frank Giraldo. (2025). Designing an Assessment Course for In-Service English Language Teachers in Colombia. Folios, (62), p.33. https://doi.org/10.17227/folios.62-20705.
3. Frank Giraldo, Xun Yan. (2025). Evaluating an Online Assessment Course: Teachers’ Voices on Their Language Assessment Literacy. Profile: Issues in Teachers' Professional Development, 27(1), p.97. https://doi.org/10.15446/profile.v27n1.113304.
4. Yaru Meng, Yu Cui, Vahid Aryadoust. (2025). EFL teachers’ formative assessment literacy and developmental trajectories: A comparative study of face-to-face and blended teaching modes. System, 132, p.103694. https://doi.org/10.1016/j.system.2025.103694.
Dimensions
PlumX
Article abstract page views
Downloads
License
Copyright (c) 2023 Frank Giraldo, Xun Yan

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
You are authorized to copy and redistribute the material in any medium or format as long as you give appropriate credit to the authors of the articles and to Profile: Issues in Teachers' Professional Development as original source of publication. The use of the material for commercial purposes is not allowed. If you remix, transform, or build upon the material, you may not distribute the modified material.
Authors retain the intellectual property of their manuscripts with the following restriction: first publication is granted to Profile: Issues in Teachers' Professional Development.






























