Are articles on COVID-19 more cited? Bibliometric analysis in a Latin American biomedical journal

¿Tienen los artículos sobre COVID-19 más citaciones? Análisis bibliométrico en una revista biomédica de Latinoamérica

Desde el inicio de la pandemia por COVID-19, los editores de revistas
científicas han procurado publicar artículos del tema lo más pronto
posible con el fin de divulgar los hallazgos sobre esta nueva
enfermedad de forma oportuna y así generar evidencias para la toma
de decisiones en salud, para lo cual han implementado estrategias
para agilizar sus procesos sin alterar el rigor del proceso de revisión
por pares. ^1,2

El impacto de los artículos publicados en revistas científicas puede
medirse por diversos parámetros; sin embargo, las citas en otras

publicaciones, como revistas, preprints, tesis, documentos técnicos,
entre otros, son uno de los principales indicadores.

Since the beginning of the COVID-19 pandemic, editors of scientific journals have made an effort to publish papers on the topic as quickly as they can in order to disseminate findings on this new disease in a timely manner and produce evidence for health decision making. To this end, they have implemented strategies to streamline their processes without altering the rigor of the peer review process.^1,2

The impact factor of articles published in scientific journals can be measured using various parameters; however, citations in other publications, such as journals, preprints, theses, technical papers, among others, are one of the main indicators.

Letter to the editor

Hugo Arroyo-Hernández1

1 Universidad Ricardo Palma - Instituto de Investigaciones en Ciencias Biomédicas- Lima - Peru.

Open access

Received: 24/01/2022

Accepted: 17/03/2022

Corresponding author: Hugo Arroyo-
Hernández. Instituto de Investigaciones en Ciencias Biomédicas, Universidad Ricardo Palma. Lima. Perú.
Email: hugoarroyo2007@gmail.com.

Keywords: COVID-19; Bibliometrics; Information Science (MeSH).

Palabras clave: COVID-19; Bibliometría; Ciencia de la Información (DeCS).

How to cite: Arroyo-Hernández H. Are articles on COVID-19 more cited? Bibliometric analysis in a Latin American biomedical journal. Rev. Fac. Med. 2023;71(1):e100661. English. doi: https://doi.org/10.15446/revfacmed.v71n1.100661.

Cómo citar: Arroyo-Hernández H. [¿Tienen los artículos sobre COVID-19 más citaciones? Análisis bibliométrico en una revista biomédica de Latinoamérica]. Rev. Fac. Med. 2023;71(1):e100661. English. doi: https://doi.org/10.15446/revfacmed.v71n1.100661.

Copyright: Copyright: ©2023 Universidad Nacional de Colombia. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, as long as the original author and source are credited.

Dear Editor

In order to determine whether the articles on COVID-19 published in the Revista Peruana de Medicina Experimental y Salud Pública were more cited compared to other articles, an analysis was performed using Harzing’s Publish or Perish 8.0 software. To begin, a Google Scholar search was conducted for papers published in 2019 and 2020 that had at least one citation up to the first week of November 2021; if the article published in English had additional citations, these were added to the article in Spanish. Cited articles were classified according to their type and whether or not they were related to COVID-19. In the statistical analysis, in which the dependent variable was the number of citations, medians with interquartile ranges were calculated based on the characteristics of the articles, and statistical differences were evaluated by means of the Mann–Whitney U test.

The search identified 120 cited articles, of which 63.3% were published in 2020; however, articles published in 2019 had a statistically higher median number of citations (p=0.032). In turn, articles on COVID-19 (15.8%) had a statistically higher median number of citations (p=0.009) than the other articles, with original articles (p=0.008) and review articles on COVID-19 (p=0.046) being the most cited (Table 1).

This finding shows that the articles on COVID-19 published in 2020 in the Revista Peruana de Medicina Experimental y Salud Pública were more cited than the articles published in 2019, which could be mainly related to the exponential growth that publications on this disease have had in Latin America.3 When comparing the number of citations that articles receive in a journal, it is expected to vary depending on the quality of the study and the relevance of the results obtained. However, in a study analyzing citations in three high-impact medical journals (New England Journal of Medicine, Journal of the American Medical Association, and Lancet), Zdravkovic et al.4 found that original articles on COVID-19 had higher citations than non-COVID articles, but that the quality of the research was lower than in those previously published.

Table 1. Characteristics of articles cited in the Revista Peruana de Medicina Experimental y Salud Pública. 2019-2020.

Characteristics		Articles	Citations		p-value *
		n (%)	Median	(IQR)
Year of publication (n=120)	2019	44 (36.67)	7	(2-12)	0.032
	2020	76 (63.33)	3	(1-9)
Articles on COVID-19 (n=120)	No	101 (84.17)	3	(2-9)	0.009
	Yes	19 (15.83)	11	(3-1)
Original articles on COVID-19 (n=69)	No	64 (92.75)	3	(2-9)	0.008
	Yes	5 (7.25)	11	(11-40)
Review articles on COVID-19 (n=6)	No	3 (50.0)	3	(3-6)	0.046
	Yes	3 (50.0)	36	(11-81)
Other articles on COVID-19 (n=45) †	No	34 (75.56)	3	(2-9)	0.708
	Yes	11 (24.44)	3	(2-11)

IQR: interquartile range.

* Mann–Whitney U test.

† including letters to the editor, symposia, featured articles, and editorials.

Source: Own elaboration.

Although it is beyond our scope to identify the quality of original articles on COVID-19, it could be concluded that the research conducted in developing or middle-income countries was mainly aimed at providing information on the epidemiology, clinical or diagnostic characteristics and treatment of the disease, as demonstrated by Espinosa et al.5 in a bibliometric study in which they analyzed research on COVID-19 in Latin America and the Caribbean. On the contrary, in countries with more investment and a better research infrastructure, research with more elaborate designs was carried out from the beginning.

It is worth noting that research conducted in developing countries is very likely to have played a significant role in the generation and validation of knowledge about the disease at an early stage of the pandemic in Latin America. It is also worth pointing out that, according to authors such as Ruano-Ravina et al.,6 review articles are the most cited.

Citation analysis allows assessing the use of research by the academic community, showing that it is more likely that we are dependent on the generation of knowledge that is published in high impact journals and that citations of COVID-19 research published in Latin American journals have been made mainly in journals from the same country or that make publications in the Spanish language. Further studies could explore citation networks between research areas and assess in detail the impact of COVID-19 research conducted during the pandemic in Latin America.

Conflicts of interest

The author is a member of the editorial board of the Revista Peruana de Medicina Experimental y Salud Pública.

Funding

None stated by the author.

Acknowledgments

None stated by the author.

References

1.Bermúdez-Tamayo C, Negrín-Hernández M, Ruiz-Cantero MT, March JC, Álvarez-Dardet C. La respuesta de Gaceta Sanitaria a la pandemia de COVID-19. Gestión rápida y transferencia. Gac Sanit. 2020;34(5):425-7. https://doi.org/j9hk.

2.Romani F. Adaptación del proceso editorial de la Revista Peruana de Medicina Experimental y Salud Pública durante la pandemia COVID-19. Rev Perú Med Exp Salud Pública. 2020;37(2):193-4. https://doi.org/gg7nhf.

3.Gregorio-Chaviano O, Limaymanta CH, López-Mesa EK. Análisis bibliométrico de la producción científica latinoamericana sobre COVID-19Análisis bibliométrico de la producción científica latinoamericana sobre COVID-19. Biomedica. 2020;40(Suppl 2):104-15. https://doi.org/fmvw.

4.Zdravkovic M, Berger-Estilita J, Zdravkovic B, Berger D. Scientific quality of COVID-19 and SARS CoV-2 publications in the highest impact medical journals during the early phase of the pandemic: A case control study. PLoS One. 2020;15(11):e0241826. https://doi.org/gk4nd7.

5.Espinosa I, Cuenca V, Eissa-Garcés A, Sisa I. A bibliometric analysis of COVID-19 research in Latin America and the Caribbean. Rev Fac Med. 2021;69(3):e94520. https://doi.org/j9hr.

6.Ruano-Ravina A, Álvarez-Dardet C. Evidence-based editing: factors inf luencing the number of citations in a national journal. Ann Epidemiol. 2012;22(9):649-53. https://doi.org/f372bg.