Correo Electrónico
DNINFOA - SIA
Bibliotecas
Convocatorias
Identidad U.N.
Publicado
Satisfaction level and correlation between performance and self-evaluation of physical therapy students in an objective structured clinical examination (OSCE) designed to assess clinical reasoning
Nivel de satisfacción y correlación entre el desempeño y la autoevaluación de los estudiantes de fisioterapia en una evaluación clínica objetiva estructurada (ECOE) diseñada para evaluar el razonamiento clínico
Palabras clave:
Physical Therapy, Competency-based education, Self-evaluation programs, Educational assessment (en)Fisioterapia, Educación basada en competencias, Programas de autoevaluación, Evaluación educacional (es)
Descargas
Introduction: The Objective Structured Clinical Evaluation (OSCE) is an instrument that allows evaluating clinical reasoning among physical therapy students, considering that knowing the correlation between their performance and their self-evaluation, as well as their level of satisfaction with this instrument, is essential.
Objectives: To determine the correlation between performance and self-evaluation (perceived performance) of physical therapy students in an OSCE designed to assess clinical reasoning, and to evaluate their level of satisfaction with this instrument.
Materials and methods: Analytical cross-sectional study conducted in 159 physical therapy students from a university in Chile who participated in an 11-station OSCE. Performance checklists and answer sheets were used for performance evaluation (passing score: 70% of the maximum score per station and in the OSCE). Two perception surveys were also used, one for self-evaluation of performance (for each station) and another to determine the students’ level of satisfaction with the OSCE. The correlation between performance in the OSCE (overall score, score by station, and score by type of station) and perceived performance was determined using the Spearman’s correlation coefficient.
Results: The level of satisfaction with the OSCE was high in 57.23% of the students. The correlation between the total score in the OSCE and perceived performance was significant, but weak (Rho=0.31; p<0.001). In students with a low satisfaction level with the OSCE, the correlation between performance and perceived performance was not significant (Rho=0.15; p=0.23), while in those with high satisfaction level it was significant and moderate (Rho=0.48; p<0.001).
Conclusions: Most students reported a high level of satisfaction with the OSCE. However, in most stations, the correlation between observed and perceived performance was weak and very weak.
Introducción. La Evaluación Clínica Objetiva Estructurada (ECOE) es un instrumento que permite evaluar el razonamiento clínico en estudiantes de fisioterapia, por lo que saber la correlación entre su desempeño y su autoevaluación, así como su nivel de satisfacción con esta herramienta, es esencial.
Objetivos. Determinar la correlación entre el desempeño y la autoevaluación (desempeño percibido) de estudiantes de fisioterapia en una ECOE diseñada para evaluar el razonamiento clínico, y evaluar su nivel de satisfacción con esta herramienta.
Materiales y métodos. Estudio transversal analítico realizado en 159 estudiantes de fisioterapia de una universidad de Chile que participaron en una ECOE de 11 estaciones. Se utilizaron listas de verificación de desempeño y hojas de respuesta para la evaluación del desempeño (nota aprobatoria: 70% de la nota máxima por estación y de la ECOE) y 2 encuestas de percepción, una para la autoevaluación del desempeño (para cada estación) y otra para determinar el nivel de satisfacción de los estudiantes con la ECOE. La correlación entre el desempeño en la ECOE (puntuación global, por estaciones y por tipo de estación) y el desempeño percibido (autoevaluación) se determinó mediante el coeficiente de correlación de Spearman.
Resultados. El nivel de satisfacción con la ECOE fue alto en el 57.23% de los estudiantes. La correlación entre el puntaje total en la ECOE y el desempeño percibido fue significativa, pero débil (Rho=0.31; p<0.001). En estudiantes con nivel de satisfacción bajo, la correlación entre el desempeño y el desempeño percibido no fue significativa (Rho=0.15; p=0.23), mientras que en aquellos con un nivel de satisfacción alto fue significativa y moderada (Rho=0.48; p<0.001).
Conclusiones. La mayoría de los estudiantes manifestaron tener un alto nivel de satisfacción con la ECOE. Sin embargo, en la mayoría de las estaciones la correlación entre el desempeño observado y el percibido fue débil y muy débil.
Descargas
Citas
Willis BW, Campbell AS, Sayers SP, Gibson K. Integrated clinical experience with concurrent problem-based learning is associated with increased clinical reasoning of physical therapy students in the United States. J Educ Eval Health Prof. 2018;15:30. https://doi.org/jdxs.
Atkinson HL, Nixon-Cave K. A tool for clinical reasoning and reflection using the international classification of functioning, disability and health (ICF) framework and patient management model. Phys Ther. 2011;91(3):416-30. https://doi.org/dtxr3p.
Huhn K, Gilliland SJ, Black LL, Wainwright SF, Christensen N. Clinical Reasoning in Physical Therapy: A Concept Analysis. Phys Ther. 2019;99(4):440-56. https://doi.org/gm2c9k.
McClure P, Tevald M, Zarzycki R, Kantak S, Malloy P, Day K, et al. The 4-Element Movement System Model to Guide Physical Therapist Education, Practice, and Movement-Related Research. Phys Ther. 2021;101(3):pzab024. https://doi.org/k8jp.
Baker SE, Painter EE, Morgan BC, Kaus AL, Petersen EJ, Allen CS, et al. Systematic Clinical Reasoning in Physical Therapy (SCRIPT): Tool for the Purposeful Practice of Clinical Reasoning in Orthopedic Manual Physical Therapy. Phys Ther. 2017;97(1):61-70. https://doi.org/gnf44v.
Jiménez-Tordoya EJ. Guía metodológica para elaborar el diagnóstico fisioterapéutico según la Clasificación Internacional del Funcionamiento (CIF), de la discapacidad y de la salud. Gac Med Bol. 2016;39(1):46-52.
Young M, Thomas A, Gordon D, Gruppen L, Lubarsky S, Rencic J, et al. The terminology of clinical reasoning in health professions education: Implications and considerations. Med Teach. 2019;41(11):1277-84. https://doi.org/gh2jnw.
Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. Br Med J. 1975;1(5955):447-51. https://doi.org/fvvpkw.
McCallum C, Bayliss J, Becker E, Nixon-Cave K, Colgrove Y, Kucharski-Howard J, et al. The integrated clinical education strategic initiatives project-development of parameters to guide harmonization in clinical education: A scoping review. Phys Ther. 2019;99(2):147-72. https://doi.org/k8jq.
Madrazo L, Lee CB, McConnell M, Khamisa K. Self-assessment differences between genders in a low-stakes objective structured clinical examination (OSCE). BMC Res Notes. 2018;11(1):393. https://doi.org/ggqjbz.
Sánchez-Ferrer F, González-de Dios J, Juste-Ruiz M, Compañ AF, Ramos JM. Encuesta de percepción de la evaluación clínica objetiva y estructurada (ECOE) por los estudiantes de sexto grado en medicina de la Universidad Miguel Hernández. FEM (Ed. impresa). 2017;20(3):137-40. https://doi.org/jdx5.
Tawanwongsri W, Phenwan T. Reflective and feedback performances on Thai medical students’ patient history-taking skills. BMC Med Educ. 2019;19(1):141. https://doi.org/jdzc.
Larsen T, Jeppe-Jensen D. The introduction and perception of an OSCE with an element of self- and peer-assessment. Eur J Dent Educ. 2008;12(1):2-7. https://doi.org/bqbhpq.
Taylor CA, Green KE. OSCE Feedback: A Randomized Trial of Effectiveness,Cost-Effectiveness and Student Satisfaction. Creative Education. 2013;4(6A):9-14. https://doi.org/jdx6.
Inayah AT, Anwer LA, Shareef MA, Nurhussen A, Alkabbani HM, Alzahrani AA, et al. Objectivity in subjectivity: do students’ self and peer assessments correlate with examiners’ subjective and objective assessment in clinical skills? A prospective study. BMJ Open. 2017;7(5):e012289. https://doi.org/k8js.
Behrens C, Morales V, Parra P, Hurtado A, Fernández R, Giaconi E, et al. Diseño e implementación de OSCE para evaluar competencias de egreso en estudiantes de medicina en un consorcio de universidades chilenas. Rev Med Chile. 2018;146(10):1197-204. https://doi.org/jdxw.
Cyr PR, Schirmer JM, Hayes V, Martineau C, Keane M. Integrating Interprofessional Case Scenarios, Allied Embedded Actors, and Teaching into Formative Observed Structured Clinical Exams. Fam Med. 2020;52(3):209-12. https://doi.org/jdxv.
Alemán-Belando S, Marín-Silvente C, Soriano-Giménez V, González-Gil A, Flores-Funes D, Ramírez-Romero P, et al. Cómo perciben los estudiantes del primer curso clínico del Grado en Medicina la prueba de Evaluación Clínica Objetiva Estructurada (ECOE). Educ Médica. 2019;20(Suppl 2):144-7. https://doi.org/gsrn.
McKay A, McCall J, Cairns AM. Peer assessment: Development and delivery of the OSCE. Eur J Dent Educ. 2023;27(2):234-9. https://doi.org/k8jt.
Villegas N, Cianelli R, Fernandez M, Henderson S, Sierra S, Alfonso Y, et al. Assessment of breastfeeding clinical skills among nursing students using the Objective Structured Clinical Examination (OSCE). Inv Educ Med. 2016;5(20):244-52. https://doi.org/gsrj.
Khan A, Ayub M, Shah Z. An Audit of the Medical Students’ Perceptions regarding Objective Structured Clinical Examination. Educ Res Int. 2016;2016:4806398. https://doi.org/jjv3.
Egloff-Juras C, Hirtz P, Luc A, Vaillant-Corroy AS. An Objective Structured Clinical Examination (OSCE) for French Dental Students: Feedback after 2 Years. Dent J (Basel). 2021;9(11):136. https://doi.org/k8jv.
Yusuf L. Objective Structured Clinical Examination? How students perceive their learning after OSCE. Pak J Med Sci. 2021;37(4):1206-10. https://doi.org/k8jd.
Figueroa-Arce N, Figueroa-González P, Gómez-Miranda L, Gutiérrez-Arias R, Contreras-Pizarro V. Implementation of Objective structured clinical examination (OSCE) as a tool to evaluate the development of clinical reasoning in physical therapy students. Rev. Fac. Med. 2021;70(2):e90746. https://doi.org/jjwb.
de la barra-Ortiz HA, Gómez-Miranda LA, de la Fuente-Astroza JI. Level of satisfaction and correlation between the performance and self-evaluation of physical therapy students in the objective structured clinical examination (OSCE) when using physical agents. Rev. Fac. Med. 2021;70(3):e92473. https://doi.org/k8jf.
Organización mundial de la Salud (OMS). Manual técnico de referencia para la higiene de las manos. OMS; 2010 [cited 2023 Dec 13]. Available from: https://bit.ly/3tikZpw.
Steiner WA, Ryser L, Huber E, Uebelhart D, Aeschlimann A, Stucki G. Use of the ICF model as a clinical problem-solving tool in physical therapy and rehabilitation medicine. Phys Ther. 2002;82(11):1098-107.
Matas A. Diseño del formato de escalas tipo Likert: un estado de la cuestión. Revista Electrónica de Investigación Educativa. 2018;20(1):38-47. https://doi.org/c86w.
World Medical Association. (WMA). WMA Declaration of Helsinki – Ethical principles for medical research involving human subjects. Fortaleza: 64th WMA General Assembly; 2013.
Khosravi-Khorashad A, Salari S, Baharvahdat H, Hejazi S, Lari SM, Salari M, et al. The assessment of undergraduate medical students’ satisfaction levels with the objective structured clinical examination. Iran Red Crescent Med J. 2014;16(8):e13088. https://doi.org/k8nn.
Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019;10:387-97. https://doi.org/gnnxss.
Doloresco F, Maerten-Rivera J, Zhao Y, Foltz-Ramos K, Fusco NM. Pharmacy Students’ Standardized Self-Assessment of Interprofessional Skills During an Objective Structured Clinical Examination. Am J Pharm Educ. 2019;83(10):7439. https://doi.org/k8np.
Garza KB, Hohmann NS, Kavookjian J, Kleppinger EL. Assessment of student performance on a mock new prescription counseling session and an objective structured clinical examination across five years. Curr Pharm Teach Learn. 2020;12(9):1046-55. https://doi.org/k8nq.
Medina MS, Castleberry AN, Persky AM. Strategies for Improving Learner Metacognition in Health Professional Education. Am J Pharm Educ. 2017;81(4):78. https://doi.org/gm2c2d.
Hall ACG, Evans DG, Higginbotham L, Thompson KS. The effects of mood and retrieval cues on semantic memory and metacognition. Scand J Psychol. 2020;61(3):333-47. https://doi.org/ghg3sk.
O’Carroll PJ, Fisher P. Metacognitions, worry and attentional control in predicting OSCE performance test anxiety. Med Educ. 2013;47(6):562-8. https://doi.org/k8nr.
Ferreira ÉMR, Pinto RZ, Arantes PMM, Vieira ÉLM, Teixeira AL, Ferreira FR, et al. Stress, anxiety, self-efficacy, and the meanings that physical therapy students attribute to their experience with an objective structured clinical examination. BMC Med Educ. 2020;20(1):296. https://doi.org/gmd37r.
Sánchez-Conde P, Clemente-Suárez VJ. Autonomic Stress Response of Nurse Students in an Objective Structured Clinical Examination (OSCE). Sustainability. 2021;13(11):5803. https://doi.org/k8ns.
Licencia
Derechos de autor 2024 Revista de la Facultad de Medicina
Esta obra está bajo una licencia Creative Commons Reconocimiento 3.0 Unported.
-
