Published

2023-07-28

Planning an Online Assessment Course for English Language Teachers in Latin America

La planeación de un curso de evaluación en línea para docentes de inglés de Latinoamérica

DOI:

https://doi.org/10.15446/profile.v25n2.104703

Keywords:

assessment literacy, language assessment literacy, language testing, teacher professional development (en)
desarrollo profesional docente, evaluación de lenguas extranjeras, literacidad en evaluación, literacidad en evaluación de lenguas extranjeras (es)

Downloads

Authors

In this article, we report the results of a study through which we collected English language teachers’ needs and wants to design an online language assessment course. Through a mixed-methods approach, we asked 20 teachers from four Latin American countries what they wanted to learn in the course. The teachers wanted a course in which they could address the challenges they faced in assessment; discuss and develop new ways to assess; and learn about authentic, valid, and ethical assessment. Therefore, the findings suggest that the teachers wanted a course that mixed theory, practice, and principles of assessment. Additionally, the course should address emerging topics in English language assessment, namely bilingual assessment and the assessment of learners with special educational needs.

En este artículo reportamos los hallazgos de una investigación mixta acerca de los deseos y necesidades en evaluación de un grupo de docentes de inglés con el objetivo de diseñar un curso en línea de evaluación de lenguas extranjeras. Tras ser entrevistados, veinte docentes de inglés de cuatro países latinoamericanos informaron que deseaban un curso que les permitiera discutir los retos de la evaluación; estudiar maneras novedosas de evaluar, y aprender sobre la evaluación auténtica, válida y ética. Es decir, un curso que incorpore la teoría, la práctica y los principios de evaluación y que además explore temas emergentes en la evaluación del inglés como lengua extranjera: la evaluación bilingüe y la evaluación de estudiantes con necesidades educativas especiales.

References

American Federation of Teachers, National Council on Measurement in Education, & National Education Association. (1990). Standards for teacher competence in educational assessment of students. https://buros.org/standards-teacher-competence-educational-assessment-students

Arias, C. I., Maturana, L. M., & Restrepo, M. I. (2012). Evaluación de los aprendizajes en lenguas extranjeras: hacia prácticas justas y democráticas. Lenguaje, 40(1), 99–126. https://doi.org/10.25100/lenguaje.v40i1.4945

Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford University Press.

Baker, B. (2021, July 2). Unpacking the concept of language assessment literacy for all key stakeholders [Conference session]. New Directions in English Language Assessment Conference, Bogotá, Colombia. https://bit.ly/3F9dOTT

Baker, B. A., & Riches, C. (2017). The development of EFL examinations in Haiti: Collaboration and language assessment literacy development. Language Testing, 35(4), 557–581. https://doi.org/10.1177/0265532217716732

Bøhn, H., & Tsagari, D. (2021). Teacher educators’ conceptions of language assessment literacy in Norway. Journal of Language Teaching and Research, 12(2), 222–233. https://doi.org/10.17507/jltr.1202.02

Boyd, E., & Donnarumma, D. (2018). Assessment literacy for teachers: A pilot study investigating the challenges, benefits and impact of assessment literacy training. In D. Xerri & P. Vella Briffa (Eds.), Teacher involvement in high-stakes language testing (pp. 105–126). Springer. https://doi.org/10.1007/978-3-319-77177-9_7

Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches. SAGE.

Crusan, D., Plakans, L., & Gebril, A. (2016). Writing assessment literacy: Surveying second language teachers’ knowledge, beliefs, and practices. Assessing Writing, 28, 43–56. https://doi.org/10.1016/j.asw.2016.03.001

Davies, A. (2008). Textbook trends in teaching language testing. Language Testing, 25(3), 327–347. https://doi.org/10.1177/0265532208090156

Díaz-Larenas, C., Alarcón-Hernández, P., & Ortiz-Navarrete, M. (2012). El profesor de inglés: sus creencias sobre la evaluación de la lengua inglesa en los niveles primario, secundario y terciario. Íkala, Revista de Lenguaje y Cultura, 17(1), 15–26. https://doi.org/10.17533/udea.ikala.10039

Dörnyei, Z. (2007). Research methods in applied linguistics. Oxford University Press.

Frodden, M., Restrepo, M., & Maturana, L. (2004). Analysis of assessment instruments used in foreign language teaching. Íkala, Revista de Lenguaje y Cultura, 9(1), 171–201. https://doi.org/10.17533/udea.ikala.3146

Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132. https://doi.org/10.1080/15434303.2011.642041

Fulcher, G. (2020). Operationalizing assessment literacy. In D. Tsagari (Ed.), Language assessment literacy: From theory to practice (pp. 8–28). Cambridge Scholars.

George, D., & Mallery, P. (2003). SPSS for Windows step by step: A simple guide and reference. 11.0 update (4th ed.). Allyn & Bacon.

Giraldo, F. (2018). Language assessment literacy: Implications for language teachers. Profile: Issues in Teachers’ Professional Development, 20(1), 179–195. https://doi.org/10.15446/profile.v20n1.62089

Giraldo, F., & Murcia, D. (2018). Language assessment literacy for pre-service teachers: Course expectations from different stakeholders. GIST – Education and Learning Research Journal, (16), 56–77. https://doi.org/10.26817/16925777.425

Giraldo, F., & Murcia, D. (2019). Language assessment literacy and the professional development of pre-service language teachers. Colombian Applied Linguistics Journal, 21(2), 243–259. https://doi.org/10.14483/22487085.14514

Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385–402. https://doi.org/10.1177/0265532208090158

Inbar-Lourie, O. (2013a). Guest Editorial to the special issue on language assessment literacy. Language Testing, 30(3), 301–307. https://doi.org/10.1177/0265532213480126

Inbar-Lourie, O. (2013b, November). Language assessment literacy: What are the ingredients? [Paper presentation]. 4th CBLA SIG Symposium, University of Cyprus, Cyprus.

Inbar-Lourie, O. (2017). Language assessment literacy. In E. Shohamy, I. G. Or, & S. May (Eds.), Language testing and assessment: Encyclopedia of language and education (3rd ed., pp. 257–270). Springer. https://doi.org/10.1007/978-3-319-02261-1_19

International Language Testing Association. (2007). ILTA guidelines for practice in English. https://bit.ly/3F17GNp

Ivankova, N., & Greer, J. (2015). Mixed methods research and analysis. In B. Paltridge & A. Phakiti (Eds.), Research methods in applied linguistics: A practical resource (2nd ed., pp. 63–81). Bloomsbury Publishing.

Kleinsasser, R. C. (2005). Transforming a postgraduate level assessment course: A second language teacher educator’s narrative. Prospect, 20(3), 77–102.

Koh, K., Burke, L. E. C., Luke, A., Gong, W., & Tan, C. (2018). Developing the assessment literacy of teachers in Chinese language classrooms: A focus on assessment task design. Language Teaching Research, 22(3), 264–288. https://doi.org/10.1177/1362168816684366

Kremmel, B., Eberharter, K., Holzknecht, F, & Konrad, E. (2018). Fostering language assessment literacy through teacher involvement in high-stakes test development. In D. Xerri & P. Vella Briffa (Eds.), Teacher involvement in high-stakes language testing (pp. 173–194). Springer. https://doi.org/10.1007/978-3-319-77177-9_10

Kremmel, B., & Harding, L. (2019). Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey. Language Assessment Quarterly, 17(1), 100–120. https://doi.org/10.1080/15434303.2019.1674855

Levi, T., & Inbar-Lourie, O. (2019). Assessment literacy or language assessment literacy: Learning from the teachers. Language Assessment Quarterly, 17(2), 168–182. https://doi.org/10.1080/15434303.2019.1692347

Malone, M. E. (2017). Training in language assessment. In E. Shohamy, I. G. Or, & S. May (Eds.), Language testing and assessment: Encyclopedia of language and education (3rd ed., pp. 225–239). Springer. https://doi.org/10.1007/978-3-319-02261-1_16

Montee, M., Bach, A., Donovan, A., & Thompson, L. (2013). LCTL teachers’ assessment knowledge and practices: An exploratory study. Journal of the National Council of Less Commonly Taught Languages, 13, 1–31.

Nier, V. C., Donovan, A. E., & Malone, M. E. (2009). Increasing assessment literacy among LCTL instructors through blended learning. Journal of the National Council of Less Commonly Taught Languages, 7, 94–118.

O’Loughlin, K. (2006). Learning about second language assessment: Insights from a postgraduate student on-line subject forum. University of Sydney Papers in TESOL, 1, 71–85.

QSR International. (n.d.). Nvivo® (Version 10) [Computer software]. https://bit.ly/3Xweiug

Restrepo-Bolívar, E. M. (2020). Monitoring preservice teachers’ language assessment literacy development through journal writing. Malaysian Journal of ELT Research, 17(1), 38–52.

Saldaña, J. (2016). The coding manual for qualitative researchers. SAGE Publications.

Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309–327. https://doi.org/10.1177/0265532213480128

Stabler-Havener, M. L. (2018). Defining, conceptualizing, problematizing, and assessing language teacher assessment literacy. Working Papers in Applied Linguistics & TESOL, 18(1), 1–22.

Sultana, N. (2019). Language assessment literacy: An uncharted area for the English language teachers in Bangladesh. Language Testing in Asia, 9(1), 2–14. https://doi.org/10.1186/s40468-019-0077-8

Taylor, L. (2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403–412. https://doi.org/10.1177/0265532213480338

Villa-Larenas, S., Quevedo, G., & González, F. (2021, July 1-3). Survey on language assessment literacy in Latin America: Preliminary results [Paper presentation]. New Directions in English Language Assessment Conference, Bogotá, Colombia.

Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11(4), 374–402. https://doi.org/10.1080/15434303.2014.960046

Walters, F. S. (2010). Cultivating assessment literacy: Standards evaluation through language-test specification reverse engineering. Language Assessment Quarterly, 7(4), 317–342. https://doi.org/10.1080/15434303.2010.516042

Yan, X. (2021, June 14–17). Towards a conceptual model of LAL development across stakeholder groups and contexts [Paper presentation]. Language Testing Research Colloquium, online.

Yan, X., & Fan, J. (2021). “Am I qualified to be a language tester?”: Understanding the development of language assessment literacy across three stakeholder groups. Language Testing, 38(2), 219–246. https://doi.org/10.1177/0265532220929924

Yan, X., Zhang, C., & Fan, J. J. (2018). “Assessment knowledge is important, but …”: How contextual and experiential factors mediate assessment practice and training needs of language teachers. System, 74, 158–168. https://doi.org/10.1016/j.system.2018.03.003

How to Cite

APA

Giraldo, F. & Yan, X. (2023). Planning an Online Assessment Course for English Language Teachers in Latin America. Profile: Issues in Teachers’ Professional Development, 25(2), 147–164. https://doi.org/10.15446/profile.v25n2.104703

ACM

[1]
Giraldo, F. and Yan, X. 2023. Planning an Online Assessment Course for English Language Teachers in Latin America. Profile: Issues in Teachers’ Professional Development. 25, 2 (Jul. 2023), 147–164. DOI:https://doi.org/10.15446/profile.v25n2.104703.

ACS

(1)
Giraldo, F.; Yan, X. Planning an Online Assessment Course for English Language Teachers in Latin America. Profile: Issues Teach. Prof. Dev. 2023, 25, 147-164.

ABNT

GIRALDO, F.; YAN, X. Planning an Online Assessment Course for English Language Teachers in Latin America. Profile: Issues in Teachers’ Professional Development, [S. l.], v. 25, n. 2, p. 147–164, 2023. DOI: 10.15446/profile.v25n2.104703. Disponível em: https://revistas.unal.edu.co/index.php/profile/article/view/104703. Acesso em: 20 mar. 2026.

Chicago

Giraldo, Frank, and Xun Yan. 2023. “Planning an Online Assessment Course for English Language Teachers in Latin America”. Profile: Issues in Teachers’ Professional Development 25 (2):147-64. https://doi.org/10.15446/profile.v25n2.104703.

Harvard

Giraldo, F. and Yan, X. (2023) “Planning an Online Assessment Course for English Language Teachers in Latin America”, Profile: Issues in Teachers’ Professional Development, 25(2), pp. 147–164. doi: 10.15446/profile.v25n2.104703.

IEEE

[1]
F. Giraldo and X. Yan, “Planning an Online Assessment Course for English Language Teachers in Latin America”, Profile: Issues Teach. Prof. Dev., vol. 25, no. 2, pp. 147–164, Jul. 2023.

MLA

Giraldo, F., and X. Yan. “Planning an Online Assessment Course for English Language Teachers in Latin America”. Profile: Issues in Teachers’ Professional Development, vol. 25, no. 2, July 2023, pp. 147-64, doi:10.15446/profile.v25n2.104703.

Turabian

Giraldo, Frank, and Xun Yan. “Planning an Online Assessment Course for English Language Teachers in Latin America”. Profile: Issues in Teachers’ Professional Development 25, no. 2 (July 28, 2023): 147–164. Accessed March 20, 2026. https://revistas.unal.edu.co/index.php/profile/article/view/104703.

Vancouver

1.
Giraldo F, Yan X. Planning an Online Assessment Course for English Language Teachers in Latin America. Profile: Issues Teach. Prof. Dev. [Internet]. 2023 Jul. 28 [cited 2026 Mar. 20];25(2):147-64. Available from: https://revistas.unal.edu.co/index.php/profile/article/view/104703

Download Citation

CrossRef Cited-by

CrossRef citations4

1. Fabio Alberto Arismendi Gómez, Juan Felipe Zuluaga Molina, Juan Carlos Padilla Villada, Didier Armando Cano Mira, Alejandro Arroyave Tobón, Julieth Valencia Espinosa, Doris Colorado López, María Angélica Duque Narváez. (2025). Panorama de la enseñanza del francés en el departamento de Antioquia, Colombia. https://doi.org/10.17533/udea.978-958-501-240-0.

2. Frank Giraldo. (2025). Designing an Assessment Course for In-Service English Language Teachers in Colombia. Folios, (62), p.33. https://doi.org/10.17227/folios.62-20705.

3. Frank Giraldo, Xun Yan. (2025). Evaluating an Online Assessment Course: Teachers’ Voices on Their Language Assessment Literacy. Profile: Issues in Teachers' Professional Development, 27(1), p.97. https://doi.org/10.15446/profile.v27n1.113304.

4. Yaru Meng, Yu Cui, Vahid Aryadoust. (2025). EFL teachers’ formative assessment literacy and developmental trajectories: A comparative study of face-to-face and blended teaching modes. System, 132, p.103694. https://doi.org/10.1016/j.system.2025.103694.

Dimensions

PlumX

Article abstract page views

1960

Downloads

Download data is not yet available.