Journal impact factor: Mathematical and statistical properties
https://doi.org/10.26907/2541-7746.2024.4.485-498
Abstract
Using a commonly agreed definition of the journal impact factor, its various applications in the mathematical modeling of scientific research were investigated. Special attention was paid to the impact factor’s properties related to the disciplinary structure of science, the limitations of source data in existing databases, statistical reliability, the relevance of document types, and the effect of outliers. The potential bias resulting from journal self-citation practices was discussed.
About the Authors
A. M. Elizarov
Kazan Federal University
Russian Federation
Russian Federation
420008; Kazan
V. V. Pislyakov
HSE University
Russian Federation
Russian Federation
109028; Moscow
References
1. ExLibris. Ulrichsweb: General FAQ. 2018. URL: https://knowledge.exlibrisgroup.com/Ulrich's/Product_Documentation/Frequently_Asked_Questions_(FAQs)/Ulrichsweb.
2. Curcic D. Number of Academic Papers Published Per Year. 2023. URL: https://wordsrated.com/number-of-academic-papers-published-per-year/.
3. Moskaleva O., Pislyakov V., Sterligov I., Akoev M., Shabanova S. Russian Index of Science Citation : Overview and review. Scientometrics, 2018, vol. 116, no. 1, pp. 449–462. doi: 10.1007/s11192-018-2758-y.
4. Pislyakov V.V. Impact factor. The Great Russian Encyclopedia: A Science and Education Website. URL: https://bigenc.ru/c/impakt-faktor-c87b20/?v=8838250. (In Russian)
5. Garfield E. Citation indexes for science: A new dimension in documentation through association of ideas. Science, 1955, vol. 122, no. 3159, pp. 108–111. doi: 10.1126/science.122.3159.108.
6. Garfield E., Sher I.H. New factors in the evaluation of scientific literature through citation indexing. Am. Doc., 1963, vol. 14, no. 3, pp. 195–201. doi: 10.1002/asi.5090140304.
7. Gross P.L.K., Gross E.M. College libraries and chemical education. Science, 1927, vol. 66, no. 1713, pp. 385–389. doi: 10.1126/science.66.1713.385.
8. Hackh I. The periodicals useful in the dental library. Bull. Med. Libr. Assoc., 1936, Sept., vol. 25, nos. 1–2, pp. 109–112.
9. Raisig L.M. Mathematical evaluation of the scientific serial. Science, 1960, vol. 131, no. 3411, pp. 1417–1419. doi: 10.1126/science.131.3411.1417.
10. Pislyakov V.V. Bibliometric indicators in the Clarivate databases. In: Akoev M.A., Markusova V.A., Moskaleva O.V., Pislyakov V.V. Rukovodstvo po naukometrii: indikatory razvitiya nauki i tekhnologii [Handbook for Scientometrics: Science and Technology Development Indicators]. 2 ed. Yekaterinburg, Izd. Ural. Univ., 2021, pp. 177–220. doi: 10.15826/B978-5-7996-3154-3. (In Russian)
11. Zibareva I.V., Pislyakov V.V., Teplova T.N., Nefedov O.M. Bibliometric analysis of the journal Uspekhi Khimii (Russian Chemical Reviews). Herald Russ. Acad. Sci., 2008, vol. 78, no. 3, pp. 247–256. doi: 10.1134/S101933160803012X. (In Russian)
12. Archambault ´E., Larivi`ere V. History of the journal impact factor: Contingencies and consequences. Scientometrics, 2009, vol. 79, no. 3, pp. 635–649. doi: 10.1007/s11192-007-2036-x.
13. Gl¨anzel W., Moed H.F. Journal impact measures in bibliometric research. Scientometrics, 2002, vol. 53, no. 2, pp. 171–193. doi: 10.1023/A:1014848323806.
14. Garfield E., Sher I.H. Genetics Citation Index: Experimental Citation Indexes to Genetics with Special Emphasis on Human Genetics. Philadelphia, PA, Inst. Sci. Inf., 1963. xxvii, 864 p.
15. Pudovkin A.I., Garfield E. Rank normalization of impact factors will resolve Vanclay’s dilemma with TRIF. Scientometrics, 2012, vol. 92, no. 2, pp. 409–412. doi: 10.1007/s11192-012-0634-8.
16. Schubert A., Gl¨anzel W. Statistical reliability of comparisons based on the citation impact of scientific publications. Scientometrics, 1983, vol. 5, no. 1, pp. 59–73. doi: 10.1007/BF02097178.
17. Greenwood D.C. Reliability of journal impact factor rankings. BMC Med. Res. Methodol., 2007, vol. 7, art. 48. doi: 10.1186/1471-2288-7-48.
18. Bornmann L. Confidence intervals for Journal Impact Factors. Scientometrics, 2017, vol. 111, no. 3, pp. 1869–1871. doi: 10.1007/s11192-017-2365-3.
19. Stern D.I. Uncertainty measures for economics journal impact factors. J. Econ. Lit., 2013, vol. 51, no. 1, pp. 173–189. doi: 10.1257/jel.51.1.173.
20. Vanclay J.K. Impact factor: Outdated artefact or stepping-stone to journal certification? Scientometrics, 2012, vol. 92, no. 2, pp. 211–238. doi: 10.1007/s11192-011-0561-0.
21. Zitt M. The journal impact factor: Angel, devil, or scapegoat? A comment on J.K. Vanclay’s article 2011. Scientometrics, 2012, vol. 92, no. 2, pp. 485–503. doi: 10.1007/s11192-012-0697-6.
22. Bar-Ilan J. Journal report card. Scientometrics, 2012, vol. 92, no. 2, pp. 249–260. doi: 10.1007/s11192-012-0671-3.
23. Clarivate. Journal Citation Reports™ Reference Guide. 2023. URL: https://clarivate.com/wp-content/uploads/dlm_uploads/2023/08/JCR-Reference-Guide-2023-August-update-1.pdf.
24. Yablonsky A.I. Modeli i metody issledovaniya nauki [Models and Methods for the Study of Science]. Moscow, Editorial URSS, 2001. 398 p. (In Russian)
25. McVeigh M.E., Mann S.J. The journal impact factor denominator: Defining citable (counted) items. JAMA, 2009, vol. 302, no. 10, pp. 1107–1109. doi: 10.1001/jama.2009.1301.
26. Miranda R., Garcia-Carpintero E. Overcitation and overrepresentation of review papers in the most cited papers. J. Inform., 2018, vol. 12, no. 4, pp. 1015–1030. doi: 10.1016/j.joi.2018.08.006.
27. Aksnes D.W. Characteristics of highly cited papers. Res. Eval., 2003, vol. 12, no. 3, pp. 159–170. doi: 10.3152/147154403781776645.
28. Smith R. Journal accused of manipulating impact factor. BMJ, 1997, vol. 314, art. 461. doi: 10.1136/bmj.314.7079.461d.
29. Macdonald S. The gaming of citation and authorship in academic journals: A warning from medicine. Soc. Sci. Inf., 2022, vol. 61, no. 4, pp. 457–480. doi: 10.1177/05390184221142218.
30. Pislyakov V.V. Self-citation and its impact on research evaluation : Literature review. Part II. Nauchn.Tekh. Bibl., 2022, no. 3, pp. 85–104. doi: 10.33186/1027-3689-2022-3-85-104. (In Russian)
Review
For citations:
Elizarov A.M., Pislyakov V.V. Journal impact factor: Mathematical and statistical properties. Uchenye Zapiski Kazanskogo Universiteta. Seriya Fiziko-Matematicheskie Nauki. 2024;166(4):485-498. (In Russ.) https://doi.org/10.26907/2541-7746.2024.4.485-498
Views:
344
Email this article 