Published

2021-10-29

Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics

Tipificación de comportamientos de estudiantes relacionados con la búsqueda de ayuda en un sistema inteligente de tutorías para matemáticas

DOI:

https://doi.org/10.15446/ing.investig.v42n2.84495

Keywords:

Educational technology, Educational innovation, Mining sequence data, Intelligent tutoring system, Behavioral education. (en)
Tecnología Educativa, Innovación Tecnológica, Minería de Datos, Sistemas Tutores Inteligentes, Ciencias del Comportamiento (es)

Downloads

Authors

The use of tutoring systems has become normalized in secondary schools (grades 7-9) in many parts of the world. There have been studies analyzing the students' behavior, their affective responses, or the abuse of the system, but little has been done to discover other types of behavior. This paper presents evidence that there are different types of help-seeking behavior which can be typified in Mexican students interacting with the Scooter intelligent tutoring system (ITS), which was designed to teach mathematics at secondary-level. The implemented methodology consisted of applying discovery algorithms and data mining to typify students in terms of their help-seeking behaviors. The results and contributions of this work suggest that gaming the system with the aforementioned ITS may not always be useful. Future work will analyze other student groups who have used this software in other parts of the world to correlate these typologies to students' traits or opinions about mathematics and learning.

En muchas partes del mundo se ha normalizado el uso de sistemas de tutoría en las escuelas de secundaria (grados 7 a 9). Se han realizado estudios que analizan el comportamiento de los estudiantes, sus respuestas afectivas o el abuso del sistema, pero se ha hecho poco para descubrir otros tipos de comportamiento. Este artículo presenta evidencia de que existen diferentes tipos de comportamiento de búsqueda y solicitud de ayuda, los cuales pueden tipificarse en estudiantes que interactúan con el sistema tutor inteligente (STI) Scooter, diseñado para enseñar matemáticas a estudiantes de secundaria. La metodología implementada consistió en aplicar algoritmos de descubrimiento y minería de datos para tipificar a los estudiantes en términos de su comportamientos de búsqueda de ayuda. Los resultados y las contribuciones de este trabajo sugieren que “jugar con el sistema” del STI ya mencionado no siempre es útil. El trabajo futuro analizará otros conjuntos de estudiantes que han utilizado el tutor inteligente en otras partes del mundo para correlacionar estas tipologías con los rasgos u opiniones de los estudiantes sobre las matemáticas y el aprendizaje.

References

Aleven, V. (2013). Help-seeking and intelligent tutoring systems: Theoretical perspectives and a step towards theoretical integration. In R. Azevedo and V. Aleven (Eds.) International Handbook of Metacognition and Learning Technologies (pp. 311-335). Springer. https://doi.org/10.1007/978-1-4419-5546-3_21

Aleven, V., Roll, I., McLaren, B. M., and Koedinger, K. R. (2016). Help helps, but only so much: Research on help-seeking with intelligent tutoring systems. International Journal of Artificial Intelligence in Education, 26(1), 205-223. https://doi.org/10.1007/s40593-015-0089-1

Aleven, V., Stahl, E., Schworm, S., Fischer, F., and Wallace, R. (2003). Help-seeking and help design in interactive learning environments. Review of Educational Research, 73(3), 277-320. https://doi.org/10.3102/00346543073003277

Angeli, C. and N. Valanides (2019). Developing young children's computational thinking with educational robotics: An inter-action effect between gender and scaffolding strategy. Computers in Human Behavior, 105, 105954. https://doi.org/10.1016/j.chb.2019.03.018

Apaolaza, A. and Vigo, M. (2019). Assisted Pattern Mining for Discovering Interactive Behaviours on the Web. International Journal of Human-Computer Studies, 130, 196-208. https://doi.org/10.1016/j.ijhcs.2019.06.012

Baker, R. S., Corbett A. T., and Koedinger K. R. (2004). Detecting student misuse of intelligent tutoring systems. In J. C. Lester, R. M. Vicari, and F. Paraguaçu (Eds.) Intelligent Tutoring Systems, ITS 2004 (pp. 531-540). Springer. https://doi.org/10.1007/978-3-540-30139-4_50

Baker, R. S., Corbett, A. T., Koedinger, K. R., and Wagner, A. Z. (2004). Off-task behavior in the cognitive tutor classroom: when students game the system. In ACM (Eds.) Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 383-390). Association for Computer Machinery. https://doi.org/10.1145/985692.985741

Baker, R. S. and Inventado, P. S. (2014). Educational data mining and learning analytics. In J. A. Larusson and B. White (Eds.) Learning Analytics (pp. 61-75). Springer. DOI: https://doi.org/10.1007/978-1-4614-3305-7_4

Chang, M., D’Aniello, G., Gaeta, M., Orciuoli, F., Sampson, D., and Simonelli, C. (2020). Building ontology-driven tutoring models for intelligent tutoring systems using data mining. IEEE Access, 8, 48151-48162. https://doi.org/10.1109/ACCESS.2020.2979281

D’Aniello, G., Gaeta, A., Gaeta, M., and Tomasiello, S. (2018). Self-regulated learning with approximate reasoning and situation awareness. Journal of Ambient Intelligence and Humanized Computing, 9(1), 151-164. https://doi.org/10.1007/s12652-016-0423-y

Duffy, M. C. and Azevedo, R. (2015). Motivation matters: Inter-actions between achievement goals and agent scaffolding for self-regulated learning within an intelligent tutoring system. Computers in Human Behavior, 52, 338-348. https://doi.org10.1016/j.chb.2015.05.041

Falakmasir, M. H. and Habibi, J. (2010). Using educational data mining methods to study the impact of virtual classrooms in e-learning. In R. S.J.d. Baker, A. Merceron., P. I. Pavlik Jr. (Eds.) Educational Data Mining 2010 (pp. 241-248). ERIC. https://files.eric.ed.gov/fulltext/ED538834.pdf

Gabadinho, A., Ritschard, G., Mueller, N. S., and Studer, M. (2011). Analyzing and visualizing state sequences in R with TraMineR. Journal of Statistical Software, 40(4), 1-37. https://doi.org/10.18637/jss.v040.i04

Hershkovitz, A. and R. Nachmias (2010). Is Students' Activity in LMS Persistent? In R. S.J.d. Baker, A. Merceron., P. I. Pavlik Jr. (Eds.) Educational Data Mining 2010 (pp. 295-296). ERIC. https://files.eric.ed.gov/fulltext/ED538834.pdf

Jovanovic, M., Vukicevic, M., Milovanovic, M., and Minovic, M. (2012). Using data mining on student behavior and cognitive style data for improving e-learning systems: a case study. International Journal of Computational Intelligence Systems, 5(3), 597-610. https://doi.org/10.1080/18756891.2012.696923

Juhaňák, L., Zounek, J., and Rohlíková, L. (2019). Using process mining to analyze students' quiz-taking behavior patterns in a learning management system. Computers in Human Behavior, 92, 406-506. https://doi.org/10.1016/j.chb.2017.12.015

Lara-Muñoz, E., Rebolledo-Méndez, G., and Rojano-Cáceres, J. (2019). Mejorando el aprovechamiento de las actividades colaborativas por pares de estudiantes utilizando tecnología educativa en matemática. Revista Complutense De Educa-ción, 30(2), 441-460. https://doi.org/10.5209/RCED.57597

Padayachee, I. (2002). Intelligent tutoring systems: Architecture and characteristics. In SACLA (Eds.) Proceedings of the 32nd Annual SACLA Conference (pp. 1-8). South African Computer Lecturers’ Association.

Pardos, Z. A. and Heffernan, N. T. (2001). Using HMMs and bagged decision trees to leverage rich features of user and skill from an intelligent tutoring system dataset. Journal of Machine Learning Research W & CP. http://people.csail.mit.edu/zp/papers/pardos_JMLR_in_press.pdf

Peña-Ayala, A. (2014). Educational data mining: A survey and a data mining-based analysis of recent works. Expert Systems with Applications, 41(4), 1432-1462. https://doi.org/10.1016/j.eswa.2013.08.042

Radford, J., Bosanquet, P., Webster, R., and Blatchford, P. (2015). Scaffolding learning for independence: Clarifying teacher and teaching assistant roles for children with special educational needs. Learning and Instruction, 36, 1-10. https://doi.org/10.1016/j.learninstruc.2014.10.005

Rebolledo-Mendez, G., Huerta-Pacheco, N.S., Baker, R.S. et al. (2021). Meta-Affective Behaviour within an Intelligent Tutoring System for Mathematics. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-021-00247-1

Roll, I., Aleven, V., McLaren, B. M., and Koedinger, K. R. (2011). Improving students’ help-seeking skills using metacognitive feedback in an intelligent tutoring system. Learning and Instruction, 21(2), 267-280. https://doi.org/10.1016/j.learninstruc.2010.07.004

Romero, C., López, M. I., Luna, J. M., and Ventura, S. (2013). Predicting students' final performance from participation in online discussion forums. Computers & Education, 68, 458-472. https://doi.org/10.1016/j.compedu.2013.06.009

Tabandeh, Y. and A. Sami (2010). Classification of tutor system logs with high categorical features. JMLR: Workshop and Conference Proceeding, 8. https://pslcdatashop.web.cmu.edu/KDDCup/workshop/papers/JMLR_Y10.pdf

Tai, M., Arroyo, I., and Woolf, B. P. (2013) Teammate Relation-ships Improve Help-Seeking Behavior in an Intelligent Tutoring System. In H. Chad Lane, K. Yacef, J. Mostow, and P. Pavlik (Eds.) Artificial Intelligence in Education. AIED 2013 (pp. 239-248). https://doi.org/10.1007/978-3-642-39112-5_25

Taub, M., Azevedo, R., Rajendran, R., Cloude, E. B., Biswas, G., and Price, M. J. (2019). How are students’ emotions related to the accuracy of cognitive and metacognitive processes during learning with an intelligent tutoring system? Learning and Instruction, 72, 101200. https://doi.org/10.1016/j.learninstruc.2019.04.001

Vaessen, B. E., Prins, F. J., and Jeuring, J. (2014). University student's achievement goals and help-seeking strategies in an intelligent tutoring system. Computers & Education, 72, 196-208. https://doi.org/10.1016/j.compedu.2013.11.001

How to Cite

APA

Melendez-Armenta, R. A., Rebolledo-Mendez, G. & Huerta-Pacheco, N. S. (2022). Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics. Ingeniería e Investigación, 42(2), e84495. https://doi.org/10.15446/ing.investig.v42n2.84495

ACM

[1]
Melendez-Armenta, R.A., Rebolledo-Mendez, G. and Huerta-Pacheco, N.S. 2022. Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics. Ingeniería e Investigación. 42, 2 (Apr. 2022), e84495. DOI:https://doi.org/10.15446/ing.investig.v42n2.84495.

ACS

(1)
Melendez-Armenta, R. A.; Rebolledo-Mendez, G.; Huerta-Pacheco, N. S. Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics. Ing. Inv. 2022, 42, e84495.

ABNT

MELENDEZ-ARMENTA, R. A.; REBOLLEDO-MENDEZ, G.; HUERTA-PACHECO, N. S. Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics. Ingeniería e Investigación, [S. l.], v. 42, n. 2, p. e84495, 2022. DOI: 10.15446/ing.investig.v42n2.84495. Disponível em: https://revistas.unal.edu.co/index.php/ingeinv/article/view/84495. Acesso em: 13 mar. 2026.

Chicago

Melendez-Armenta, Roberto Angel, Genaro Rebolledo-Mendez, and N. Sofia Huerta-Pacheco. 2022. “Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics”. Ingeniería E Investigación 42 (2):e84495. https://doi.org/10.15446/ing.investig.v42n2.84495.

Harvard

Melendez-Armenta, R. A., Rebolledo-Mendez, G. and Huerta-Pacheco, N. S. (2022) “Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics”, Ingeniería e Investigación, 42(2), p. e84495. doi: 10.15446/ing.investig.v42n2.84495.

IEEE

[1]
R. A. Melendez-Armenta, G. Rebolledo-Mendez, and N. S. Huerta-Pacheco, “Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics”, Ing. Inv., vol. 42, no. 2, p. e84495, Apr. 2022.

MLA

Melendez-Armenta, R. A., G. Rebolledo-Mendez, and N. S. Huerta-Pacheco. “Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics”. Ingeniería e Investigación, vol. 42, no. 2, Apr. 2022, p. e84495, doi:10.15446/ing.investig.v42n2.84495.

Turabian

Melendez-Armenta, Roberto Angel, Genaro Rebolledo-Mendez, and N. Sofia Huerta-Pacheco. “Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics”. Ingeniería e Investigación 42, no. 2 (April 1, 2022): e84495. Accessed March 13, 2026. https://revistas.unal.edu.co/index.php/ingeinv/article/view/84495.

Vancouver

1.
Melendez-Armenta RA, Rebolledo-Mendez G, Huerta-Pacheco NS. Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics. Ing. Inv. [Internet]. 2022 Apr. 1 [cited 2026 Mar. 13];42(2):e84495. Available from: https://revistas.unal.edu.co/index.php/ingeinv/article/view/84495

Download Citation

CrossRef Cited-by

CrossRef citations2

1. Ahasanur Rahman, Amith Khandakar, Mohamed Arselene Ayari, Khalid Naji, Abdulla Khalid Al-Ali, Abdel Latif Sellami, Saleh Mohammed Ali Alhazbi. (2026). Artificial intelligence innovations challenges and emerging trends in engineering education. Discover Education, 5(1) https://doi.org/10.1007/s44217-026-01137-1.

2. Yong Zhu, Xiaotong Jin, Xuexin Wang, Xiao Yang. (2025). How start temporal landmarks affect consumers’ preference on uncertain promotional strategies: the role of perceived luck. Current Psychology, 44(3), p.2060. https://doi.org/10.1007/s12144-024-07172-1.

Dimensions

PlumX

Article abstract page views

1078

Downloads

Download data is not yet available.