Big data analytics in programme evaluation: Examining models for the assessment of sustainable development goals in Colombia
Big data analytics en evaluación de programas: analizando modelos para la evaluación de objetivos de desarrollo sostenible en Colombia
DOI:
https://doi.org/10.15446/cuad.econ.v42n89.95487Palabras clave:
Big data analytics, sustainable development goals, Colombia, program evaluation, public policy (en)análisis de big data, objetivos de desarrollo sostenible, Colombia, evaluación de programas, política pública (es)
Descargas
New paradigms for evidence-based decisions such as big data analytics (BDA) have emerged to assess programmes in sustainable development goals (SDGs). The arguments supporting the contributions of BDA in the assessment of SDGs in Colombia are mixed. This article presents a qualitative review of a list of programmes that adopted BDA and assesses whether problems such as bias and wrong impressions of programme performance can be controlled with the adoption of these methods. The results vary depending on the quality of the data and the collection method. Unfortunately, Colombia faces challenges such as data privacy management and deficiency of institutional interoperability to exploit these techniques conveniently.
Nuevos paradigmas en decisiones basadas en evidencia como el análisis de big data (BDA) han aparecido para evaluar programas en objetivos de desarrollo sostenible (ODS). Los argumentos que sustentan los aportes de BDA en la medición de los ODS en Colombia son mixtos. Este artículo presenta una revisión cualitativa de una lista de programas que adoptaron BDA y evalúa si estas técnicas pueden controlar problemas como sesgos e impresiones erróneas sobre el desempeño de estos programas. Los resultados varían según la calidad de datos y recopilación. Infortunadamente, Colombia enfrenta desafíos para la gestión de privacidad de datos y deficiencia interoperativa institucional para explotar estas técnicas apropiadamente.
Referencias
AAPOR Big Data Task Force. (2015). AAPOR Report on Big Data. American Association for Public Opinion Research AAPOR. https://www.aapor.org/AAPOR_Main/media/MainSiteFiles/images/BigDataTask-ForceReport_FINAL_2_12_15_b.pdf
Attanasio, O., Bird, M., Cardona-Sosa, L., & Lavado, P. (2019). Freeing Financial Education via Tablets: Experimental Evidence from Colombia (Working Paper No. 25929). National Bureau of Economic Research. https://doi.org/10.3386/w25929 DOI: https://doi.org/10.3386/w25929
Australian Department of Industry, Innovation and Science. (2018). Data Strategy 2018-20. Canberra: Australian Government. https://www.industry.gov.au/sites/default/files/2018-12/data-strategy-2018-20.pdf
Bamberger, M. (2016). Integrating big data into the monitoring and evaluation of development programmes. UN Global Pulse. https://www.unglobalpulse.org/document/integrating-big-data-into-the-monitoring-and-evaluation-of-development-programmes/
Bamberger, M., Vaessen, J., & Raimondo, E. (2016). The evaluation of complex development interventions in the age of big data. Dealing with complexity in development evaluation [Ch.12]. SAGE Publications, Inc. https://dx.doi.org/10.4135/9781483399935
Bamberger, M., Raimondo, E., & Vaessen, J. (2019). Impact evaluation approaches and complexity. Dealing with complexity in development evaluation [Ch. 4]. SAGE Publications, Inc. https://dx.doi.org/10.4135/9781483399935 DOI: https://doi.org/10.4135/9781483399935
Bamberger, M., & York, P. (2020). Measuring results and impact in the age of big data: The nexus of evaluation, analytics, and digital technology. The Rockefeller Foundation. https://www.rockefellerfoundation.org/wp-content/uploads/Measuring-results-and-impact-in-the-age-of-big-data-by-York-and-Bamberger-March-2020.pdf
Barrera, F., Linden, L., & Urquiola, M. (2007). The effects of user fee reductions on enrollment. Evidence from a quasi-experiment. Bogotá D.C. http://www.leighlinden.com/Gratuidad%20Draft%202007-01.pdf
Big Data UN Global Working Group (2015). Survey of SDG-related Big Data projects. [PowerPoint Presentation]
Björkman, P., & Franco, S. (2017). How big data analytics affect decision-making. A study of the newspaper industry (Master’s Thesis). Department of Business Studies. Uppsala University. http://www.diva-portal.org/smash/get/diva2:1110878/FULLTEXT01.pdf
Bryman, A. (2012). Research Designs. Social research methods (4th ed, pp. 45-77). Oxford University Press.
Connelly, R., Playford, C., Vernon, G., & Dibben, C. (2016). The role of administrative data in the big data revolution in social science research. Social Science Research, 59(1), 1-12. https://doi.org/10.1016/j.ssresearch.2016.04.015 DOI: https://doi.org/10.1016/j.ssresearch.2016.04.015
Consejo Nacional de Política Económica y Social [CONPES]. (2018). National data exploitation policy Big data (CONPES Document 3920). Bogotá, D. C. Colombian Government. https://colaboracion.dnp.gov.co/CDT/Conpes/Econ%c3%b3micos/3920.pdf
Crawford, K. (2013, April 1). The hidden biases in big data. Harvard Business Review. https://hbr.org/2013/04/the-hidden-biases-in-big-data
Cultivando Futuro (2021). Big data Cultivando futuro Colombia [Big data harvesting future in Colombia]. https://cultivandofuturo.com/#/es
Departamento Administrativo Nacional de Estadística [DANE]. (2019). Boletín técnico de indicadores básicos de tenencia y uso de tecnologías de la información y comunicación – TIC en hogares y personas de 5 y más años de edad. Año 2018. [Technical bulletin of basic indicators of possession and use of information and communication technologies - ICT in households and people aged 5 and over. Year 2018]. Bogotá D.C: Colombian Government. https://www.dane.gov.co/files/investigaciones/boletines/tic/bol_tic_hogares_departamental_2018.pdf
Departamento Nacional de Planeación [DNP]. (2018). Colombia is the first country in Latin America with a public policy for the exploitation of Big Data. National Planning Department. (Accessed on Dec 12, 2020) https://www.dnp.gov.co/Paginas/Colombia-primer-pa%C3%ADs-en-Latinoam%C3%A9rica-con-una-pol%C3%ADtica-p%C3%BAblica-para-la-explotaci%C3%B3n-de-datos-Big-Data.aspx
Departamento Nacional de Planeación [DNP]. (2021). Data Analytics. DNP web portal. https://www.dnp.gov.co/programas/Desarrollo%20Digital/Paginas/Big%20Data.aspx#googtrans/gl/en
Einav, L., & Levin, J. (2013). The data revolution and economic analysis (Working paper no. 19035). NBER. https://doi.org/10.3386/w19035 DOI: https://doi.org/10.3386/w19035
Escobar Gutiérrez, E., Ramírez Roa, D. P., Quevedo Hernández, M., Insuasti Ceballos, H. D., Jiménez Ospina, A., Montenegro Helfer, P., Numpaque Cano, J. S., Rocha Ruiz, C. A., & Ruiz Saenz , J. A (2021). Aprovechamiento de datos para la toma de decisiones en el sector público. [Leveraging data for decision-making in the public sector]. DNP CAF. https://scioteca.caf.com/handle/123456789/1776
European Commission Directorate General for Informatics. (2016). Big data analytics for policy making (Report). European Commission. https://joinup.ec.europa.eu/sites/default/files/document/2016-07/dg_digit_study_big_data_analytics_for_policy_making.pdf
Fabra-Mata, J., & Mygind, J. (2019). Big data in evaluation: Experiences from using Twitter analysis to evaluate Norway’s contribution to the peace process in Colombia. Evaluation, 25(1), 6-22. https://doi.org/10.1177/1356389018804259 DOI: https://doi.org/10.1177/1356389018804259
Facebook. (2020). COVID-19 Survey & data page. Facebook. https://dataforgood.facebook.com/covid-survey/?date=2020-12-12&dates=2020-10-17_2020-12-12®ion=WORLD
Fan, J., Han, F., & Liu, H. (2014). Challenges of Big Data analysis. National Science Review, 1(2), 293-314. https://doi.org/10.1093/nsr/nwt032 DOI: https://doi.org/10.1093/nsr/nwt032
Gertler, P., Martinez, S., Premand, P., Rawlings, L., & Vermeersch, C. (2016a). Choosing an impact evaluation method. In Impact Evaluation in Practice (Second edition, pp. 187-200). Inter-American Development Bank and The World Bank. https://www.worldbank.org/en/programs/sieftrust-fund/publication/impact-evaluation-in-practice DOI: https://doi.org/10.1596/978-1-4648-0779-4_ch11
Gertler, P., Martinez, S., Premand, P., Rawlings, L., & Vermeersch, C. (2016b). Choosing a sample. In Impact Evaluation in Practice (Second edition, pp. 261-290). Inter American De velopment Bank and The World Bank. https://www.worldbank.org/en/programs/sief-trust-fund/publication/impact-evaluation-in-practice DOI: https://doi.org/10.1596/978-1-4648-0779-4_ch15
Gertler, P., Martinez, S., Premand, P., Rawlings, L., & Vermeersch, C. (2016c). Causal inference and counterfactuals. In impact evaluation in practice (Second edition, pp. 47-62). Inter-American Development Bank and The World Bank. https://www.worldbank.org/en/programs/sief-trustfund/publica tion/impact-evaluation-in-practice DOI: https://doi.org/10.1596/978-1-4648-0779-4_ch3
Global Forest Watch (2021). Global deforestation rates and statistics by country: Colombia. Global Deforestation Rates & Statistics by Country | GFW (globalforestwatch.org)
Innpulsa Colombia, MIT Media Lab & Data Pop Alliance (2020). Entendiendo la estrategia de Big Data de Colombia [Understanding the big data strategy of Colombia]. http://datapopalliance.org/wp-content/uploads/2019/12/Si%CC%81ntesis-Estrategia-Nacional-de-Big-Data.pdf
Jensen, E. A., & Laurie, A. C. (2016). Doing real research: A practical guide to social research. SAGE.
Karlsson, T. F., Tarragona, P. H., & Jeewandara, M. (2019). Can big data revolutionise development economics? A literature review on Latin America. Cahiers Des Amériques Latines, 92, 155-175. https://doi.org/10.4000/cal.10097 DOI: https://doi.org/10.4000/cal.10097
Letouzé, E., Manske, J., Pestre, G., & Sangokoya, D. (2016). Opportunities and requirements for leveraging Big Data for official statistics and the sustainable development goals in Latin America. Data-Pop Alliance. White Papers Series. http://datapopalliance.org/wp-content/uploads/2016/05/Data-Pop-Alliance-LAC-NSO-EN.pdf
Lozano, A., & Bravo, M. A. (2020). Proyecto piloto de analítica de datos—Detección de anomalías en el SISBEN y movilidad. [Data analytics pilot project — Detection of anomalies in SISBEN and mobility]. https://datapopalliance.org/wp-content/uploads/2020/11/Documento8_SeguimientoPilotosSISBEN_DPAMIT.pdf
OECD. (2020). OECD Open, useful and Re-usable data (OURdata) Index: 2019. Secretary General of the OECD. OECD Direction of Public Governance. http://www.oecd.org/gov/digital-government/ourdata-index-policy-paper-2020.pdf
Olsson, N. O. E., & Bull-Berg, H. (2015). Use of big data in project evaluations. International Journal of Managing Projects in Business, 8(3), 491-512. https://doi.org/10.1108/IJMPB-09-2014-0063 DOI: https://doi.org/10.1108/IJMPB-09-2014-0063
Poel, M., Meyer, E., & Schroeder, R. (2018). Big data for policymaking: Great expectations, but with limited progress? Policy & Internet, 10(3), 347-367. https://doi.org/10.1002/poi3.176 DOI: https://doi.org/10.1002/poi3.176
Rodríguez, P., Palomino, N., & Mondaca, J. (2017). Using big data and its analytical techniques for public policy design and implementation in Latin America and the Caribbean. Interamerican Development Bank. https://publications.iadb.org/publications/english/document/Using-Big-Data-and-its-Analytical-Techniques-for-Public-Policy-Design-and-Implementation-in-Latin-America-and-the-Caribbean.pdf
Rossi, P., Lipsey, M., & Freeman, H. (2003a). Tailoring evaluations. Evaluation: A Sytematic Approach (Seventh edition, pp. 31-65). SAGE Publications.
Rossi, P., Lipsey, M., & Freeman, H. (2003b). Detecting, interpreting and analyzing program effects. Evaluation: A systematic approach (Seventh edition, pp. 301-330). SAGE Publications.
Sekaran, U., & Bougie, R. (2010). Research methods for business: A skill-building approach (5th edition). John Wiley and sons.
The Global Partnership for Sustainable Development Data (2017). Initiative environment data collaborative. https://www.data4sdgs.org/initiatives/environment-datacollaborative
The Task Team of the UN Global Working Group on Big Data (2020). Using big data for the sustainable development goals. https://unstats.un.org/bigdata/task-teams/sdgs/index.cshtml
The World Bank. (2014). Central America: Big data in action for development. Report No: ACS11163. Washington, D. C. https://openknowledge.worldbank.org/handle/10986/21325
The World Bank. International Bank for reconstruction and development. (2016). Big data innovation challenge. Pioneering approaches in datadriven development. https://openknowledge.worldbank.org/bitstream/handle/10986/25102/107751-REVISED-PUBLIC-BigData-Publication-e-version-FINAL.pdf?sequence=4&isAllowed=y
The World Bank. (n.d.). Bogota TransMilenio bus rapid transit. The World Bank Big Data Innovation Challenge. https://olcstage.worldbank.org/content/bogota-transmilenio-bus-rapid-transit
Tsoukias, A., Montibeller, G., Lucertini, G., & Belton, V. (2013). Policy analytics: An agenda for research and practice. EURO Journal on Decision Processes, 1(1-2), 115-134. https://doi.org/10.1007/s40070-013-0008-3 DOI: https://doi.org/10.1007/s40070-013-0008-3
UK Department for Digital, Culture, Media & Sport (2020). UK National Data Strategy. UK Government https://www.gov.uk/government/publications/uk-national-data-strategy/national-data-strategy
United Nations (2020). The global goals for sustainable development. https://www.globalgoals.org/
United Nations Development Program. (2021). Colombia in brief. https://www.co.undp.org/content/colombia/es/home/countryinfo.html
United Nations Office on Drugs and Crime [UNODC]. (2020). UNODC and illicit crop monitoring. Crop Monitoring and Colombia. https://www.unodc.org/unodc/en/crop-monitoring/index.html?tag=Colombia
United Nations Statistical Commission (2014). Big data and modernization of statistical systems. https://unstats.un.org/unsd/statcom/doc14/2014-11-BigData-E.pdf
Urquhart, C. (2017). Writing up a grounded theory study. Grounded theory for qualitative research: A practical guide (pp. 148-175). SAGE Publications, Ltd. https://doi.org/10.4135/9781526402196 DOI: https://doi.org/10.4135/9781526402196
Vaca, M., & Vega, J. (2019). A general overview of big data for sustainable development in Colombia. CEPEI. http://cepei.org/wp-content/uploads/2019/09/AgeneraloverviewBigData_Colombia_Vf.pdf
Cómo citar
APA
ACM
ACS
ABNT
Chicago
Harvard
IEEE
MLA
Turabian
Vancouver
Descargar cita
Licencia
LicenciaCuadernos de Economía a través de la División de Bibliotecas de la Universidad Nacional de Colombia promueve y garantiza el acceso abierto de todos sus contenidos. Los artículos publicados por la revista se encuentran disponibles globalmente con acceso abierto y licenciados bajo los términos de Creative Commons Atribución-No_Comercial-Sin_Derivadas 4.0 Internacional (CC BY-NC-ND 4.0), lo que implica lo siguiente: