Correo Electrónico
DNINFOA - SIA
Bibliotecas
Convocatorias
Identidad U.N.
Publicado
A catalog of API Gateway metrics and its quantitative evaluation
Un catálogo de métricas de API Gateway y su evaluación cuantitativa
DOI:
https://doi.org/10.15446/dyna.v92n237.118741Palabras clave:
API management, API gateway, design science research, software engineering, software metrics, software quality (en)administración de API, API Gateway, Design Science Research, ingeniería de software, métricas de software, calidad de software (es)
Descargas
In the rapidly evolving API Economy, quality of API management software has become a critical concern. This work analyzed the API management industry with a particular focus on the metrics available for various API Gateway products. The primary artifact is a catalog with 59 metrics, compiled from global industry reports and technical documentation of 68 leading API Gateway products. The Design Science Research (DSR) approach was adopted to design the catalog, and metrics were categorized based on clear definitions in recent scientific literature. Secondly, a quantitative analysis method was proposed and systematically performed. Findings indicate that the metrics mainly focus on latency, response time, API performance, error capturing, and traffic monitoring. Features such as caching, resource utilization, and system health were scarcely addressed by the examined products. The proposed artifacts provide an objective foundation for a deeper understanding of API Management software quality, and lay the groundwork for future research.
En la Economía de las API, la calidad del software de administración de API se ha convertido en una preocupación crítica. Este trabajo analizó productos de administración de API con un enfoque particular en las métricas disponibles en productos API Gateway. Se obtuvo un catálogo de 59 métricas, compiladas y categorizadas a partir de la literatura vigente, reportes globales y documentación técnica de 68 API Gateways. Se adoptó el enfoque Design Science Research (DSR) para el diseño. Adicionalmente, se propuso y se implementó un método de análisis cuantitativo. Los hallazgos indican que las métricas se centran principalmente en latencia, tiempo de respuesta, rendimiento, captura de errores y monitoreo del tráfico. Características como almacenamiento en caché, utilización de recursos y estado del sistema fueron escasamente abordadas. Los artefactos propuestos proporcionan una base objetiva para comprender más profundamente la calidad del software de administración de API, y sientan bases para futuras investigaciones.
Referencias
[1] Duan, Y., et al. Everything as a service (XaaS) on the cloud: origins, current and future trends. En 2015 IEEE 8th International Conference on Cloud Computing. IEEE, 2015. p. 621-628. DOI: https://doi.org/10.1109/CLOUD.2015.88
[2] Gamez-Diaz, A, Fernandez, P., and Ruiz-Cortes, A. An analysis of RESTful APIs offerings in the industry. International Conference on Service-Oriented Computing. Cham: Springer International Publishing, 2017. pp. 589-604. DOI: https://doi.org/10.1007/978-3-319-69035-3_43
[3] De, B. API Management: An Architect’s Guide to Developing and Managing APIs for Your Organization. Apress Berkeley, 2023. DOI: https://doi.org/10.1007/979-8-8688-0054-2
[4] Preibisch, S. API Development: a practical guide for business implementation success. New York: Springer Science+Business Media, 2018. DOI: https://doi.org/10.1007/978-1-4842-4140-0
[5] dos Santos, E. and Casas, S., Unveiling quality in API management: A systematic mapping study. Proceedings of L Latin American Computer Conference, (CLEI), 2024, pp 1-10. DOI: https://doi.org/10.1109/CLEI64178.2024.10700447
[6] Cassidy, L. and Hamilton, J. design science research approach to website benchmarking, Benchmarking: An International Journal 23(5), pp. 1054-1075, 2016. DOI: https://doi.org/10.1108/BIJ-07-2014-0064
[7] Peffers, K., et al. design science research methodology for information systems research, Journal of Management Information Systems, 24(3), pp. 45-77, 2007. DOI: https://doi.org/10.2753/MIS0742-1222240302
[8] Beyer, B., et al. Site reliability engineering: How Google runs production systems. Sebastopol: O'Reilly Media, Inc., 2016.
[9] Gregg, B. Thinking methodically about performance, Communication of the ACM, 56 (2), pp. 45-51, 2013. DOI: https://doi.org/10.1145/2408776.2408791
[10] Mathijssen, M., Overeem, M., and Jansen, S. Identification of practices and capabilities in API management: a systematic literature review. arXiv preprint, 2020. DOI: https://doi.org/10.48550/arXiv.2006.10481
[11] Overeem, M., Mathijssen, M., and Jansen, S. API-m-FAMM: A focus area maturity model for API Management, Information and Software Technology, 147, 2022. DOI: https://doi.org/10.1016/j.infsof.2015.03.007
[12] Yamamoto, R., et al, A quality model and its quantitative evaluation method for web APIs. Proceedings of 5th Asia-Pacific Software Engineering Conference (APSEC), 2018. pp. 598-607. DOI: https://doi.org/10.1109/APSEC.2018.00075
[13] Machini, A. and Casas, S., A preliminary GQM model to evaluate web API usability, Proceedings of Jornadas Argentinas de Informática (JAIIO), 2024. pp 1-13.
[14] Nybom, K., Ashraf, A. and Porres, I., Systematic Mapping Study on API Documentation Generation Approaches. 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), IEEE, Prague, 2018. pp 462–469. DOI: https://doi.org/10.1109/SEAA.2018.00081
[15] Casas, S., et al, Uses and applications of the OpenAPI/Swagger specification: a systematic mapping of the literature. 40th International Conference of the Chilean Computer Science Society (SCCC), IEEE, La Serena, Chile, 2021. pp 1–8, DOI: https://doi.org/10.1109/SCCC54552.2021.9650408
[16] Cummaudo, A., Vasa, R. and Grundy, J. What should I document? A preliminary systematic mapping study into API documentation knowledge. ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). IEEE, Porto de Galinhas, 2019. pp 1–6, DOI: https://doi.org/10.1109/ESEM.2019.8870148
[17] Mosqueira-Rey, E., et al. A systematic approach to API usability: Taxonomy-derived criteria and a case study, Information and Software Technology, 97, pp. 46-63, 2018. DOI: https://doi.org/10.1016/j.infsof.2017.12.010
[18] Rauf, I., Troubitsyna, E. and Porres, I. A systematic mapping study of API usability evaluation methods, Computer Science Review, 33, pp. 49-68, 2019. DOI: https://doi.org/10.1016/j.cosrev.2019.05.001
[19] Burns, C. et al, Usable results from the field of API usability: A systematic mapping and further analysis. 2012 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), IEEE, Innsbruck, 2012, pp 179–182, DOI: https://doi.org/10.1109/VLHCC.2012.6344511
[20] Diaz-Rojas, J. A., et al, Web API Security Vulnerabilities and Mitigation Mechanisms: A Systematic Mapping Study. 9th International Conference in Software Engineering Research and Innovation (CONISOFT), IEEE, San Diego, CA, USA, 2021. pp 207–218, DOI: https://doi.org/10.1109/CONISOFT52520.2021.00036
[21] Taibi, D., Lenarduzzi, V. and Pahl, C., Architectural Patterns for Microservices: A Systematic Mapping Study, Proceedings of the 8th International Conference on Cloud Computing and Services Science - (CLOSER), 2018. INSTICC. SciTePress, Funchal, pp 221–232, DOI: https://doi.org/10.5220/0006798302210232
[22] Koci, R., et al, Classification of Changes in API Evolution. IEEE 23rd International Enterprise Distributed Object Computing Conference (EDOC). IEEE, Paris, France, 2019. pp 243–249, DOI: https://doi.org/10.1109/EDOC.2019.00037
[23] Ofoeda, J., Boateng, R. and Effah, J. Application Programming Interface (API) Research: A Review of the Past to Inform the Future, International Journal of Enterprise Information Systems, 15(3), pp. 76-95, 2019. DOI: https://doi.org/10.4018/IJEIS.2019070105
Cómo citar
IEEE
ACM
ACS
APA
ABNT
Chicago
Harvard
MLA
Turabian
Vancouver
Descargar cita
Licencia
Derechos de autor 2025 DYNA
Esta obra está bajo una licencia internacional Creative Commons Atribución-NoComercial-SinDerivadas 4.0.
El autor o autores de un artículo aceptado para publicación en cualquiera de las revistas editadas por la facultad de Minas cederán la totalidad de los derechos patrimoniales a la Universidad Nacional de Colombia de manera gratuita, dentro de los cuáles se incluyen: el derecho a editar, publicar, reproducir y distribuir tanto en medios impresos como digitales, además de incluir en artículo en índices internacionales y/o bases de datos, de igual manera, se faculta a la editorial para utilizar las imágenes, tablas y/o cualquier material gráfico presentado en el artículo para el diseño de carátulas o posters de la misma revista.
