Publicado

2018-01-01

Evaluation of post-graduate programs using a network data envelopment analysis model

Evaluación de los programas de post-grado usando un modelo de análisis envolvente de datos en red

DOI:

https://doi.org/10.15446/dyna.v85n204.60207

Palabras clave:

education, data envelopment analysis, network DEA, educational efficiency, bibliometric evaluation (en)
educación, análisis envolvente de datos, DEA en redes, eficiencia educacional, evaluación bibliométrica (es)

Autores/as

Despite standard Data Envelopment Analysis (DEA) models having been widely used in assessing efficiency in education, a few studies use Network DEA (NDEA) models in educational evaluation. In this paper, we proposed an alternative to the official evaluation performed every three years by CAPES (Brazilian agency for post-graduation programs regulation) using an NDEA model. The use of NDEA is justified because depending on the point of view, some variables can be considered either inputs or outputs. The use of NDEA avoids the need to decide whether a variable is an input or output of the entire process. This happens because a variable can be both an output for one stage and an input for another. Our relational NDEA model computes both productivity and quality assessments together with global efficiency using bibliometric data.
A pesar de que los modelos estándar del Análisis Envolvente de Datos (DEA) han sido ampliamente utilizados en la evaluación de la eficiencia en educación, existen pocos estudios que utilizan modelos DEA en red (Network DEA – NDEA) en la evaluación educativa. En el presente trabajo, se ha propuesto una alternativa a la evaluación oficial realizada a cada tres años por la CAPES (agencia brasileña para la regulación de los programas de post-graduación) mediante un modelo DEA en red. El uso de NDEA se justifica ya que dependiendo del punto de vista algunas variables pueden ser consideradas como entradas o como salidas. El uso de NDEA evita la necesidad de decidir si una variable es una entrada o una salida de todo el proceso. Esto ocurre porque una variable puede ser tanto una salida para una etapa y una entrada para otro. Nuestro modelo relacional NDEA evalúa tanto la productividad como la calidad junto con la eficiencia global, a partir de datos bibliométricos.

Descargas

Los datos de descargas todavía no están disponibles.

Citas

Kao, C., Network data envelopment analysis: A review. European Journal of Operational Research, 239(1), pp. 1-16, 2014. DOI: 10.1016/j.ejor.2014.02.039.

Johnes, G., Efficiency in English higher education institutions revisited: A network approach. Economics Bulletin, 33(4), pp. 2698-2706, 2013.

Soares de Mello, J.C.C.B., Gomes, E.G., Angulo-Meza, L., Soares de Mello, M.H.C. and Soares de Mello, A.J.R., Engineering post-graduate programmes: A quality and productivity analysis. Studies in Educational Evaluation, 32(2), pp. 136-152, 2006. DOI 10.1016/j.stueduc.2006.04.005.

Ruiz, C.F., Bonilla, R., Chavarro, D., Orozco, L.A., Zarama, R. and Polanco, X., Efficiency measurement of research groups using data envelopment analysis and Bayesian networks. Scientometrics, 83(3), pp. 711-721, 2010. DOI: 10.1007/s11192-009-0122-y.

Abramo, G., D'Angelo, C.A. and Pugini, F., The measurement of italian universities' research productivity by a non parametric-bibliometric methodology. Scientometrics, 76(2), pp. 225-244, 2008. DOI: 10.1007/s11192-007-1942-2.

Charnes, A., Cooper, W.W. and Rhodes, E., Measuring the efficiency of decision-making units. European Journal of Operational Research, 2(6), pp. 429-444, 1978. DOI: 10.1016/0377-2217(78)90138-8.

Färe, R. and Grosskopf, S., Network DEA. Socio-Economic Planning Sciences, 34(1), pp. 35-49, 2000. DOI 10.1016/S0038-0121(99)00012-9.

Kao, C., Efficiency decomposition in network data envelopment analysis: A relational model. European Journal of Operational Research, 192(3), pp. 949-962, 2009. DOI 10.1016/j.ejor.2007.10.008.

Thanassoulis, E., Portela, M.C. and Allen, R., Incorporating value judgments in: Cooper, W.W., Seiford, L.M. and Zhu, J., Eds., DEA. Handbook on Data Envelopment Analysis, ed New York, Boston, Dordrecht, London, Moscow: Kluwer Academic Publishers, 2004, pp 99-138. DOI 10.1007/1-4020-7798-X_4.

Thanassoulis, E., Kortelainen, M., Johnes, G. and Johnes, J., Costs and efficiency of higher education institutions in England: A DEA analysis. Journal of the Operational Research Society, 62(7), pp. 1282-1297, 2011. DOI 10.1057/jors.2010.68.

Gomes Junior, S.F., Soares de Mello, J.C.C.B. and Angulo-Meza, L., DEA nonradial efficiency based on vector properties. International Transactions in Operational Research, 20(3), pp. 341-364, 2013. DOI: 10.1111/itor.12000.

Tyagi, P., Yadav, S.P. and Singh, S.P., Relative performance of academic departments using DEA with sensitivity analysis. Evaluation and Program Planning, 32(2), pp. 168-177, 2009. DOI: 10.1016/j.evalprogplan.2008.10.002.

de França, J.M.F., de Figueiredo, J.N. and dos Santos Lapa, J., A DEA methodology to evaluate the impact of information asymmetry on the efficiency of not-for-profit organizations with an application to higher education in Brazil. Annals of Operations Research, 173, pp. 39-56, 2010. DOI 10.1007/s10479-009-0536-1.

Bougnol, M.-L. and Dulá, J.H., Validating DEA as a ranking tool: An application of DEA to assess performance in higher education. Annals of Operations Research, 145(1), pp. 339-365, 2006. DOI: 10.1007/s10479-006-0039-2.

Zhu, J., Multi-factor performance measure model with an application to Fortune 500 companies. European Journal of Operational Research, 123(1), pp. 105-124, 2000. DOI 10.1016/S0377-2217(99)00096-X.

Sexton, T.R. and Lewis, H.F., Two-stage DEA: An application to major league baseball. Journal of Productivity Analysis, 19(2-3), pp. 227-249, 2003. DOI 10.1023/A:1022861618317.

Chen, Y. and Zhu, J., Measuring information technology's indirect impact on firm performance. Information Technology and Management, 5, pp. 9-22, 2004. DOI 10.1023/B:ITEM.0000008075.43543.97.

Chen, Y., Cook, W.D., Li, N. and Zhu, J., Additive efficiency decomposition in two-stage DEA. European Journal of Operational Research, 196(3), pp. 1170-1176, 2009. DOI 10.1016/j.ejor.2008.05.011.

Tone, K. and Tsutsui, M., Network DEA: A slacks-based measure approach. European Journal of Operational Research, 197(1), pp. 243-252, 2009. DOI 10.1016/j.ejor.2008.05.027.

Moreno, P. and Lozano, S., A network DEA assessment of team efficiency in the NBA. Annals of Operations Research, 214, pp. 99-124, 2014. DOI: 10.1007/s10479-012-1074-9.

Moreno, P., Andrade, G.N., Angulo-Meza, L. and Soares de Mello, J.C.C.B., Evaluation of Brazilian electricity distributors using a network DEA model with shared inputs. IEEE Latin America Transactions, 13(7), pp. 2209-2216, 2015. DOI: 10.1109/TLA.2015.7273779.

Toloo, M., Emrouznejad, A. and Moreno, P., A linear relational DEA model to evaluate two-stage processes with shared inputs. Computational and Applied Mathematics, 36(1), pp. 1-17, 2015. DOI: 10.1007/s40314-014-0211-2.

Kao, C. and Hwang, S.N., Efficiency decomposition in two-stage data envelopment analysis: An application to non-life insurance companies in Taiwan. European Journal of Operational Research, 185(1), pp. 418-429, 2008. DOI 10.1016/j.ejor.2006.11.041.

Cooper, W.W., Seiford, L.M. and Tone, K., Data envelopment analysis: A comprehensive text with models, applications, references and DEA-solver software, 2007. DOI 10.1007/978-0-387-45283-8.

Waltman, L. and Van Eck, N.J., The inconsistency of the h-index. Journal of the American Society for Information Science and Technology, 63(2), pp. 406-415, 2012. DOI 10.1002/asi.21678.

Rubem, A.P.d.S., Moura, A.L, and Soares de Mello, J.C.C.B., Comparative analysis of some individual bibliometric indices when applied to groups of researchers. Scientometrics, 102(1), pp. 1019-1035, 2015. DOI: 10.1007/s11192-014-1428-y.