Publicado

2023-06-21

Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia

Big data analytics en evaluación de programas: analizando modelos para la evaluación de objetivos de desarrollo sostenible en Colombia

DOI:

https://doi.org/10.15446/cuad.econ.v42n89.95487

Palabras clave:

Big data analytics, sustainable development goals, Colombia, program evaluation, public policy (en)
análisis de big data, objetivos de desarrollo sostenible, Colombia, evaluación de programas, política pública (es)

Descargas

Autores/as

  • Wilman Carpeta Camacho Corvinus University of Budapest

New paradigms for evidence-based decisions such as big data analytics (BDA) have emerged to assess programmes in sustainable development goals (SDGs). The arguments supporting the contributions of BDA in the assessment of SDGs in Colombia are mixed. This article presents a qualitative review of a list of programmes that adopted BDA and assesses whether problems such as bias and wrong impressions of programme performance can be controlled with the adoption of these methods. The results vary depending on the quality of the data and the collection method. Unfortunately, Colombia faces challenges such as data privacy management and deficiency of institutional interoperability to exploit these techniques conveniently.

Nuevos paradigmas en decisiones basadas en evidencia como el análisis de big data (BDA) han aparecido para evaluar programas en objetivos de desarrollo sostenible (ODS). Los argumentos que sustentan los aportes de BDA en la medición de los ODS en Colombia son mixtos. Este artículo presenta una revisión cualitativa de una lista de programas que adoptaron BDA y evalúa si estas técnicas pueden controlar problemas como sesgos e impresiones erróneas sobre el desempeño de estos programas. Los resultados varían según la calidad de datos y recopilación. Infortunadamente, Colombia enfrenta desafíos para la gestión de privacidad de datos y deficiencia interoperativa institucional para explotar estas técnicas apropiadamente.

Referencias

AAPOR Big Data Task Force. (2015). AAPOR Report on Big Data. American Association for Public Opinion Research AAPOR. https://www.aapor.org/AAPOR_Main/media/MainSiteFiles/images/BigDataTask-ForceReport_FINAL_2_12_15_b.pdf

Attanasio, O., Bird, M., Cardona-Sosa, L., & Lavado, P. (2019). Freeing Financial Education via Tablets: Experimental Evidence from Colombia (Working Paper No. 25929). National Bureau of Economic Research. https://doi.org/10.3386/w25929 DOI: https://doi.org/10.3386/w25929

Australian Department of Industry, Innovation and Science. (2018). Data Strategy 2018-20. Canberra: Australian Government. https://www.industry.gov.au/sites/default/files/2018-12/data-strategy-2018-20.pdf

Bamberger, M. (2016). Integrating big data into the monitoring and evaluation of development programmes. UN Global Pulse. https://www.unglobalpulse.org/document/integrating-big-data-into-the-monitoring-and-evaluation-of-development-programmes/

Bamberger, M., Vaessen, J., & Raimondo, E. (2016). The evaluation of complex development interventions in the age of big data. Dealing with complexity in development evaluation [Ch.12]. SAGE Publications, Inc. https://dx.doi.org/10.4135/9781483399935

Bamberger, M., Raimondo, E., & Vaessen, J. (2019). Impact evaluation approaches and complexity. Dealing with complexity in development evaluation [Ch. 4]. SAGE Publications, Inc. https://dx.doi.org/10.4135/9781483399935 DOI: https://doi.org/10.4135/9781483399935

Bamberger, M., & York, P. (2020). Measuring results and impact in the age of big data: The nexus of evaluation, analytics, and digital technology. The Rockefeller Foundation. https://www.rockefellerfoundation.org/wp-content/uploads/Measuring-results-and-impact-in-the-age-of-big-data-by-York-and-Bamberger-March-2020.pdf

Barrera, F., Linden, L., & Urquiola, M. (2007). The effects of user fee reductions on enrollment. Evidence from a quasi-experiment. Bogotá D.C. http://www.leighlinden.com/Gratuidad%20Draft%202007-01.pdf

Big Data UN Global Working Group (2015). Survey of SDG-related Big Data projects. [PowerPoint Presentation]

Björkman, P., & Franco, S. (2017). How big data analytics affect decision-making. A study of the newspaper industry (Master’s Thesis). Department of Business Studies. Uppsala University. http://www.diva-portal.org/smash/get/diva2:1110878/FULLTEXT01.pdf

Bryman, A. (2012). Research Designs. Social research methods (4th ed, pp. 45-77). Oxford University Press.

Connelly, R., Playford, C., Vernon, G., & Dibben, C. (2016). The role of administrative data in the big data revolution in social science research. Social Science Research, 59(1), 1-12. https://doi.org/10.1016/j.ssresearch.2016.04.015 DOI: https://doi.org/10.1016/j.ssresearch.2016.04.015

Consejo Nacional de Política Económica y Social [CONPES]. (2018). National data exploitation policy Big data (CONPES Document 3920). Bogotá, D. C. Colombian Government. https://colaboracion.dnp.gov.co/CDT/Conpes/Econ%c3%b3micos/3920.pdf

Crawford, K. (2013, April 1). The hidden biases in big data. Harvard Business Review. https://hbr.org/2013/04/the-hidden-biases-in-big-data

Cultivando Futuro (2021). Big data Cultivando futuro Colombia [Big data harvesting future in Colombia]. https://cultivandofuturo.com/#/es

Departamento Administrativo Nacional de Estadística [DANE]. (2019). Boletín técnico de indicadores básicos de tenencia y uso de tecnologías de la información y comunicación – TIC en hogares y personas de 5 y más años de edad. Año 2018. [Technical bulletin of basic indicators of possession and use of information and communication technologies - ICT in households and people aged 5 and over. Year 2018]. Bogotá D.C: Colombian Government. https://www.dane.gov.co/files/investigaciones/boletines/tic/bol_tic_hogares_departamental_2018.pdf

Departamento Nacional de Planeación [DNP]. (2018). Colombia is the first country in Latin America with a public policy for the exploitation of Big Data. National Planning Department. (Accessed on Dec 12, 2020) https://www.dnp.gov.co/Paginas/Colombia-primer-pa%C3%ADs-en-Latinoam%C3%A9rica-con-una-pol%C3%ADtica-p%C3%BAblica-para-la-explotaci%C3%B3n-de-datos-Big-Data.aspx

Departamento Nacional de Planeación [DNP]. (2021). Data Analytics. DNP web portal. https://www.dnp.gov.co/programas/Desarrollo%20Digital/Paginas/Big%20Data.aspx#googtrans/gl/en

Einav, L., & Levin, J. (2013). The data revolution and economic analysis (Working paper no. 19035). NBER. https://doi.org/10.3386/w19035 DOI: https://doi.org/10.3386/w19035

Escobar Gutiérrez, E., Ramírez Roa, D. P., Quevedo Hernández, M., Insuasti Ceballos, H. D., Jiménez Ospina, A., Montenegro Helfer, P., Numpaque Cano, J. S., Rocha Ruiz, C. A., & Ruiz Saenz , J. A (2021). Aprovechamiento de datos para la toma de decisiones en el sector público. [Leveraging data for decision-making in the public sector]. DNP CAF. https://scioteca.caf.com/handle/123456789/1776

European Commission Directorate General for Informatics. (2016). Big data analytics for policy making (Report). European Commission. https://joinup.ec.europa.eu/sites/default/files/document/2016-07/dg_digit_study_big_data_analytics_for_policy_making.pdf

Fabra-Mata, J., & Mygind, J. (2019). Big data in evaluation: Experiences from using Twitter analysis to evaluate Norway’s contribution to the peace process in Colombia. Evaluation, 25(1), 6-22. https://doi.org/10.1177/1356389018804259 DOI: https://doi.org/10.1177/1356389018804259

Facebook. (2020). COVID-19 Survey & data page. Facebook. https://dataforgood.facebook.com/covid-survey/?date=2020-12-12&dates=2020-10-17_2020-12-12&region=WORLD

Fan, J., Han, F., & Liu, H. (2014). Challenges of Big Data analysis. National Science Review, 1(2), 293-314. https://doi.org/10.1093/nsr/nwt032 DOI: https://doi.org/10.1093/nsr/nwt032

Gertler, P., Martinez, S., Premand, P., Rawlings, L., & Vermeersch, C. (2016a). Choosing an impact evaluation method. In Impact Evaluation in Practice (Second edition, pp. 187-200). Inter-American Development Bank and The World Bank. https://www.worldbank.org/en/programs/sieftrust-fund/publication/impact-evaluation-in-practice DOI: https://doi.org/10.1596/978-1-4648-0779-4_ch11

Gertler, P., Martinez, S., Premand, P., Rawlings, L., & Vermeersch, C. (2016b). Choosing a sample. In Impact Evaluation in Practice (Second edition, pp. 261-290). Inter American De velopment Bank and The World Bank. https://www.worldbank.org/en/programs/sief-trust-fund/publication/impact-evaluation-in-practice DOI: https://doi.org/10.1596/978-1-4648-0779-4_ch15

Gertler, P., Martinez, S., Premand, P., Rawlings, L., & Vermeersch, C. (2016c). Causal inference and counterfactuals. In impact evaluation in practice (Second edition, pp. 47-62). Inter-American Development Bank and The World Bank. https://www.worldbank.org/en/programs/sief-trustfund/publica tion/impact-evaluation-in-practice DOI: https://doi.org/10.1596/978-1-4648-0779-4_ch3

Global Forest Watch (2021). Global deforestation rates and statistics by country: Colombia. Global Deforestation Rates & Statistics by Country | GFW (globalforestwatch.org)

Innpulsa Colombia, MIT Media Lab & Data Pop Alliance (2020). Entendiendo la estrategia de Big Data de Colombia [Understanding the big data strategy of Colombia]. http://datapopalliance.org/wp-content/uploads/2019/12/Si%CC%81ntesis-Estrategia-Nacional-de-Big-Data.pdf

Jensen, E. A., & Laurie, A. C. (2016). Doing real research: A practical guide to social research. SAGE.

Karlsson, T. F., Tarragona, P. H., & Jeewandara, M. (2019). Can big data revolutionise development economics? A literature review on Latin America. Cahiers Des Amériques Latines, 92, 155-175. https://doi.org/10.4000/cal.10097 DOI: https://doi.org/10.4000/cal.10097

Letouzé, E., Manske, J., Pestre, G., & Sangokoya, D. (2016). Opportunities and requirements for leveraging Big Data for official statistics and the sustainable development goals in Latin America. Data-Pop Alliance. White Papers Series. http://datapopalliance.org/wp-content/uploads/2016/05/Data-Pop-Alliance-LAC-NSO-EN.pdf

Lozano, A., & Bravo, M. A. (2020). Proyecto piloto de analítica de datos—Detección de anomalías en el SISBEN y movilidad. [Data analytics pilot project — Detection of anomalies in SISBEN and mobility]. https://datapopalliance.org/wp-content/uploads/2020/11/Documento8_SeguimientoPilotosSISBEN_DPAMIT.pdf

OECD. (2020). OECD Open, useful and Re-usable data (OURdata) Index: 2019. Secretary General of the OECD. OECD Direction of Public Governance. http://www.oecd.org/gov/digital-government/ourdata-index-policy-paper-2020.pdf

Olsson, N. O. E., & Bull-Berg, H. (2015). Use of big data in project evaluations. International Journal of Managing Projects in Business, 8(3), 491-512. https://doi.org/10.1108/IJMPB-09-2014-0063 DOI: https://doi.org/10.1108/IJMPB-09-2014-0063

Poel, M., Meyer, E., & Schroeder, R. (2018). Big data for policymaking: Great expectations, but with limited progress? Policy & Internet, 10(3), 347-367. https://doi.org/10.1002/poi3.176 DOI: https://doi.org/10.1002/poi3.176

Rodríguez, P., Palomino, N., & Mondaca, J. (2017). Using big data and its analytical techniques for public policy design and implementation in Latin America and the Caribbean. Interamerican Development Bank. https://publications.iadb.org/publications/english/document/Using-Big-Data-and-its-Analytical-Techniques-for-Public-Policy-Design-and-Implementation-in-Latin-America-and-the-Caribbean.pdf

Rossi, P., Lipsey, M., & Freeman, H. (2003a). Tailoring evaluations. Evaluation: A Sytematic Approach (Seventh edition, pp. 31-65). SAGE Publications.

Rossi, P., Lipsey, M., & Freeman, H. (2003b). Detecting, interpreting and analyzing program effects. Evaluation: A systematic approach (Seventh edition, pp. 301-330). SAGE Publications.

Sekaran, U., & Bougie, R. (2010). Research methods for business: A skill-building approach (5th edition). John Wiley and sons.

The Global Partnership for Sustainable Development Data (2017). Initiative environment data collaborative. https://www.data4sdgs.org/initiatives/environment-datacollaborative

The Task Team of the UN Global Working Group on Big Data (2020). Using big data for the sustainable development goals. https://unstats.un.org/bigdata/task-teams/sdgs/index.cshtml

The World Bank. (2014). Central America: Big data in action for development. Report No: ACS11163. Washington, D. C. https://openknowledge.worldbank.org/handle/10986/21325

The World Bank. International Bank for reconstruction and development. (2016). Big data innovation challenge. Pioneering approaches in datadriven development. https://openknowledge.worldbank.org/bitstream/handle/10986/25102/107751-REVISED-PUBLIC-BigData-Publication-e-version-FINAL.pdf?sequence=4&isAllowed=y

The World Bank. (n.d.). Bogota TransMilenio bus rapid transit. The World Bank Big Data Innovation Challenge. https://olcstage.worldbank.org/content/bogota-transmilenio-bus-rapid-transit

Tsoukias, A., Montibeller, G., Lucertini, G., & Belton, V. (2013). Policy analytics: An agenda for research and practice. EURO Journal on Decision Processes, 1(1-2), 115-134. https://doi.org/10.1007/s40070-013-0008-3 DOI: https://doi.org/10.1007/s40070-013-0008-3

UK Department for Digital, Culture, Media & Sport (2020). UK National Data Strategy. UK Government https://www.gov.uk/government/publications/uk-national-data-strategy/national-data-strategy

United Nations (2020). The global goals for sustainable development. https://www.globalgoals.org/

United Nations Development Program. (2021). Colombia in brief. https://www.co.undp.org/content/colombia/es/home/countryinfo.html

United Nations Office on Drugs and Crime [UNODC]. (2020). UNODC and illicit crop monitoring. Crop Monitoring and Colombia. https://www.unodc.org/unodc/en/crop-monitoring/index.html?tag=Colombia

United Nations Statistical Commission (2014). Big data and modernization of statistical systems. https://unstats.un.org/unsd/statcom/doc14/2014-11-BigData-E.pdf

Urquhart, C. (2017). Writing up a grounded theory study. Grounded theory for qualitative research: A practical guide (pp. 148-175). SAGE Publications, Ltd. https://doi.org/10.4135/9781526402196 DOI: https://doi.org/10.4135/9781526402196

Vaca, M., & Vega, J. (2019). A general overview of big data for sustainable development in Colombia. CEPEI. http://cepei.org/wp-content/uploads/2019/09/AgeneraloverviewBigData_Colombia_Vf.pdf

Cómo citar

APA

Carpeta Camacho, W. (2023). Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia. Cuadernos de Economía, 42(89), 233–264. https://doi.org/10.15446/cuad.econ.v42n89.95487

ACM

[1]
Carpeta Camacho, W. 2023. Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia. Cuadernos de Economía. 42, 89 (jun. 2023), 233–264. DOI:https://doi.org/10.15446/cuad.econ.v42n89.95487.

ACS

(1)
Carpeta Camacho, W. Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia. Cuad. econ 2023, 42, 233-264.

ABNT

CARPETA CAMACHO, W. Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia. Cuadernos de Economía, [S. l.], v. 42, n. 89, p. 233–264, 2023. DOI: 10.15446/cuad.econ.v42n89.95487. Disponível em: https://revistas.unal.edu.co/index.php/ceconomia/article/view/95487. Acesso em: 16 ago. 2024.

Chicago

Carpeta Camacho, Wilman. 2023. «Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia». Cuadernos De Economía 42 (89):233-64. https://doi.org/10.15446/cuad.econ.v42n89.95487.

Harvard

Carpeta Camacho, W. (2023) «Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia», Cuadernos de Economía, 42(89), pp. 233–264. doi: 10.15446/cuad.econ.v42n89.95487.

IEEE

[1]
W. Carpeta Camacho, «Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia», Cuad. econ, vol. 42, n.º 89, pp. 233–264, jun. 2023.

MLA

Carpeta Camacho, W. «Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia». Cuadernos de Economía, vol. 42, n.º 89, junio de 2023, pp. 233-64, doi:10.15446/cuad.econ.v42n89.95487.

Turabian

Carpeta Camacho, Wilman. «Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia». Cuadernos de Economía 42, no. 89 (junio 22, 2023): 233–264. Accedido agosto 16, 2024. https://revistas.unal.edu.co/index.php/ceconomia/article/view/95487.

Vancouver

1.
Carpeta Camacho W. Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia. Cuad. econ [Internet]. 22 de junio de 2023 [citado 16 de agosto de 2024];42(89):233-64. Disponible en: https://revistas.unal.edu.co/index.php/ceconomia/article/view/95487

Descargar cita

CrossRef Cited-by

CrossRef citations0

Dimensions

PlumX

Visitas a la página del resumen del artículo

241

Descargas

Los datos de descargas todavía no están disponibles.