Published
Typifying Students’ Help-Seeking Behavior in an Intelligent Tutoring System for Mathematics
Tipificación de comportamientos de estudiantes relacionados con la búsqueda de ayuda en un sistema inteligente de tutorías para matemáticas
DOI:
https://doi.org/10.15446/ing.investig.v42n2.84495Keywords:
Educational technology, Educational innovation, Mining sequence data, Intelligent tutoring system, Behavioral education. (en)Tecnología Educativa, Innovación Tecnológica, Minería de Datos, Sistemas Tutores Inteligentes, Ciencias del Comportamiento (es)
The use of tutoring systems has become normalized in secondary schools (grades 7-9) in many parts of the world. There have been studies analyzing the students' behavior, their affective responses, or the abuse of the system, but little has been done to discover other types of behavior. This paper presents evidence that there are different types of help-seeking behavior which can be typified in Mexican students interacting with the Scooter intelligent tutoring system (ITS), which was designed to teach mathematics at secondary-level. The implemented methodology consisted of applying discovery algorithms and data mining to typify students in terms of their help-seeking behaviors. The results and contributions of this work suggest that gaming the system with the aforementioned ITS may not always be useful. Future work will analyze other student groups who have used this software in other parts of the world to correlate these typologies to students' traits or opinions about mathematics and learning.
En muchas partes del mundo se ha normalizado el uso de sistemas de tutoría en las escuelas de secundaria (grados 7 a 9). Se han realizado estudios que analizan el comportamiento de los estudiantes, sus respuestas afectivas o el abuso del sistema, pero se ha hecho poco para descubrir otros tipos de comportamiento. Este artículo presenta evidencia de que existen diferentes tipos de comportamiento de búsqueda y solicitud de ayuda, los cuales pueden tipificarse en estudiantes que interactúan con el sistema tutor inteligente (STI) Scooter, diseñado para enseñar matemáticas a estudiantes de secundaria. La metodología implementada consistió en aplicar algoritmos de descubrimiento y minería de datos para tipificar a los estudiantes en términos de su comportamientos de búsqueda de ayuda. Los resultados y las contribuciones de este trabajo sugieren que “jugar con el sistema” del STI ya mencionado no siempre es útil. El trabajo futuro analizará otros conjuntos de estudiantes que han utilizado el tutor inteligente en otras partes del mundo para correlacionar estas tipologías con los rasgos u opiniones de los estudiantes sobre las matemáticas y el aprendizaje.
References
Aleven, V. (2013). Help-seeking and intelligent tutoring systems: Theoretical perspectives and a step towards theoretical integration. In R. Azevedo and V. Aleven (Eds.) International Handbook of Metacognition and Learning Technologies (pp. 311-335). Springer. https://doi.org/10.1007/978-1-4419-5546-3_21
Aleven, V., Roll, I., McLaren, B. M., and Koedinger, K. R. (2016). Help helps, but only so much: Research on help-seeking with intelligent tutoring systems. International Journal of Artificial Intelligence in Education, 26(1), 205-223. https://doi.org/10.1007/s40593-015-0089-1
Aleven, V., Stahl, E., Schworm, S., Fischer, F., and Wallace, R. (2003). Help-seeking and help design in interactive learning environments. Review of Educational Research, 73(3), 277-320. https://doi.org/10.3102/00346543073003277
Angeli, C. and N. Valanides (2019). Developing young children's computational thinking with educational robotics: An inter-action effect between gender and scaffolding strategy. Computers in Human Behavior, 105, 105954. https://doi.org/10.1016/j.chb.2019.03.018
Apaolaza, A. and Vigo, M. (2019). Assisted Pattern Mining for Discovering Interactive Behaviours on the Web. International Journal of Human-Computer Studies, 130, 196-208. https://doi.org/10.1016/j.ijhcs.2019.06.012
Baker, R. S., Corbett A. T., and Koedinger K. R. (2004). Detecting student misuse of intelligent tutoring systems. In J. C. Lester, R. M. Vicari, and F. Paraguaçu (Eds.) Intelligent Tutoring Systems, ITS 2004 (pp. 531-540). Springer. https://doi.org/10.1007/978-3-540-30139-4_50
Baker, R. S., Corbett, A. T., Koedinger, K. R., and Wagner, A. Z. (2004). Off-task behavior in the cognitive tutor classroom: when students game the system. In ACM (Eds.) Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 383-390). Association for Computer Machinery. https://doi.org/10.1145/985692.985741
Baker, R. S. and Inventado, P. S. (2014). Educational data mining and learning analytics. In J. A. Larusson and B. White (Eds.) Learning Analytics (pp. 61-75). Springer. DOI: https://doi.org/10.1007/978-1-4614-3305-7_4
Chang, M., D’Aniello, G., Gaeta, M., Orciuoli, F., Sampson, D., and Simonelli, C. (2020). Building ontology-driven tutoring models for intelligent tutoring systems using data mining. IEEE Access, 8, 48151-48162. https://doi.org/10.1109/ACCESS.2020.2979281
D’Aniello, G., Gaeta, A., Gaeta, M., and Tomasiello, S. (2018). Self-regulated learning with approximate reasoning and situation awareness. Journal of Ambient Intelligence and Humanized Computing, 9(1), 151-164. https://doi.org/10.1007/s12652-016-0423-y
Duffy, M. C. and Azevedo, R. (2015). Motivation matters: Inter-actions between achievement goals and agent scaffolding for self-regulated learning within an intelligent tutoring system. Computers in Human Behavior, 52, 338-348. https://doi.org10.1016/j.chb.2015.05.041
Falakmasir, M. H. and Habibi, J. (2010). Using educational data mining methods to study the impact of virtual classrooms in e-learning. In R. S.J.d. Baker, A. Merceron., P. I. Pavlik Jr. (Eds.) Educational Data Mining 2010 (pp. 241-248). ERIC. https://files.eric.ed.gov/fulltext/ED538834.pdf
Gabadinho, A., Ritschard, G., Mueller, N. S., and Studer, M. (2011). Analyzing and visualizing state sequences in R with TraMineR. Journal of Statistical Software, 40(4), 1-37. https://doi.org/10.18637/jss.v040.i04
Hershkovitz, A. and R. Nachmias (2010). Is Students' Activity in LMS Persistent? In R. S.J.d. Baker, A. Merceron., P. I. Pavlik Jr. (Eds.) Educational Data Mining 2010 (pp. 295-296). ERIC. https://files.eric.ed.gov/fulltext/ED538834.pdf
Jovanovic, M., Vukicevic, M., Milovanovic, M., and Minovic, M. (2012). Using data mining on student behavior and cognitive style data for improving e-learning systems: a case study. International Journal of Computational Intelligence Systems, 5(3), 597-610. https://doi.org/10.1080/18756891.2012.696923
Juhaňák, L., Zounek, J., and Rohlíková, L. (2019). Using process mining to analyze students' quiz-taking behavior patterns in a learning management system. Computers in Human Behavior, 92, 406-506. https://doi.org/10.1016/j.chb.2017.12.015
Lara-Muñoz, E., Rebolledo-Méndez, G., and Rojano-Cáceres, J. (2019). Mejorando el aprovechamiento de las actividades colaborativas por pares de estudiantes utilizando tecnología educativa en matemática. Revista Complutense De Educa-ción, 30(2), 441-460. https://doi.org/10.5209/RCED.57597
Padayachee, I. (2002). Intelligent tutoring systems: Architecture and characteristics. In SACLA (Eds.) Proceedings of the 32nd Annual SACLA Conference (pp. 1-8). South African Computer Lecturers’ Association.
Pardos, Z. A. and Heffernan, N. T. (2001). Using HMMs and bagged decision trees to leverage rich features of user and skill from an intelligent tutoring system dataset. Journal of Machine Learning Research W & CP. http://people.csail.mit.edu/zp/papers/pardos_JMLR_in_press.pdf
Peña-Ayala, A. (2014). Educational data mining: A survey and a data mining-based analysis of recent works. Expert Systems with Applications, 41(4), 1432-1462. https://doi.org/10.1016/j.eswa.2013.08.042
Radford, J., Bosanquet, P., Webster, R., and Blatchford, P. (2015). Scaffolding learning for independence: Clarifying teacher and teaching assistant roles for children with special educational needs. Learning and Instruction, 36, 1-10. https://doi.org/10.1016/j.learninstruc.2014.10.005
Rebolledo-Mendez, G., Huerta-Pacheco, N.S., Baker, R.S. et al. (2021). Meta-Affective Behaviour within an Intelligent Tutoring System for Mathematics. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-021-00247-1
Roll, I., Aleven, V., McLaren, B. M., and Koedinger, K. R. (2011). Improving students’ help-seeking skills using metacognitive feedback in an intelligent tutoring system. Learning and Instruction, 21(2), 267-280. https://doi.org/10.1016/j.learninstruc.2010.07.004
Romero, C., López, M. I., Luna, J. M., and Ventura, S. (2013). Predicting students' final performance from participation in online discussion forums. Computers & Education, 68, 458-472. https://doi.org/10.1016/j.compedu.2013.06.009
Tabandeh, Y. and A. Sami (2010). Classification of tutor system logs with high categorical features. JMLR: Workshop and Conference Proceeding, 8. https://pslcdatashop.web.cmu.edu/KDDCup/workshop/papers/JMLR_Y10.pdf
Tai, M., Arroyo, I., and Woolf, B. P. (2013) Teammate Relation-ships Improve Help-Seeking Behavior in an Intelligent Tutoring System. In H. Chad Lane, K. Yacef, J. Mostow, and P. Pavlik (Eds.) Artificial Intelligence in Education. AIED 2013 (pp. 239-248). https://doi.org/10.1007/978-3-642-39112-5_25
Taub, M., Azevedo, R., Rajendran, R., Cloude, E. B., Biswas, G., and Price, M. J. (2019). How are students’ emotions related to the accuracy of cognitive and metacognitive processes during learning with an intelligent tutoring system? Learning and Instruction, 72, 101200. https://doi.org/10.1016/j.learninstruc.2019.04.001
Vaessen, B. E., Prins, F. J., and Jeuring, J. (2014). University student's achievement goals and help-seeking strategies in an intelligent tutoring system. Computers & Education, 72, 196-208. https://doi.org/10.1016/j.compedu.2013.11.001
How to Cite
APA
ACM
ACS
ABNT
Chicago
Harvard
IEEE
MLA
Turabian
Vancouver
Download Citation
CrossRef Cited-by
1. Ahasanur Rahman, Amith Khandakar, Mohamed Arselene Ayari, Khalid Naji, Abdulla Khalid Al-Ali, Abdel Latif Sellami, Saleh Mohammed Ali Alhazbi. (2026). Artificial intelligence innovations challenges and emerging trends in engineering education. Discover Education, 5(1) https://doi.org/10.1007/s44217-026-01137-1.
2. Yong Zhu, Xiaotong Jin, Xuexin Wang, Xiao Yang. (2025). How start temporal landmarks affect consumers’ preference on uncertain promotional strategies: the role of perceived luck. Current Psychology, 44(3), p.2060. https://doi.org/10.1007/s12144-024-07172-1.
Dimensions
PlumX
Article abstract page views
Downloads
License
Copyright (c) 2021 Roberto Angel Melendez-Armenta, Genaro Rebolledo-Mendez, N. Sofia Huerta-Pacheco

This work is licensed under a Creative Commons Attribution 4.0 International License.
The authors or holders of the copyright for each article hereby confer exclusive, limited and free authorization on the Universidad Nacional de Colombia's journal Ingeniería e Investigación concerning the aforementioned article which, once it has been evaluated and approved, will be submitted for publication, in line with the following items:
1. The version which has been corrected according to the evaluators' suggestions will be remitted and it will be made clear whether the aforementioned article is an unedited document regarding which the rights to be authorized are held and total responsibility will be assumed by the authors for the content of the work being submitted to Ingeniería e Investigación, the Universidad Nacional de Colombia and third-parties;
2. The authorization conferred on the journal will come into force from the date on which it is included in the respective volume and issue of Ingeniería e Investigación in the Open Journal Systems and on the journal's main page (https://revistas.unal.edu.co/index.php/ingeinv), as well as in different databases and indices in which the publication is indexed;
3. The authors authorize the Universidad Nacional de Colombia's journal Ingeniería e Investigación to publish the document in whatever required format (printed, digital, electronic or whatsoever known or yet to be discovered form) and authorize Ingeniería e Investigación to include the work in any indices and/or search engines deemed necessary for promoting its diffusion;
4. The authors accept that such authorization is given free of charge and they, therefore, waive any right to receive remuneration from the publication, distribution, public communication and any use whatsoever referred to in the terms of this authorization.










