location: Current position: Home >> Scientific Research >> Paper Publications

Four pitfalls in normalizing citation indicators: An investigation of ESI's selection of highly cited papers

Hits:

Indexed by:期刊论文

Date of Publication:2018-11-01

Journal:JOURNAL OF INFORMETRICS

Included Journals:SCIE、SSCI

Volume:12

Issue:4

Page Number:1133-1145

ISSN No.:1751-1577

Key Words:Normalized citation impact; Essential science indicators; Highly cited papers; Publication month; Online-to-print delays; Citation impact indicators; Journal-to-field classification

Abstract:InCites Essential Science Indicators is becoming increasingly used to identify top-performing research and evaluate the impact of institutes. Unfortunately, our study shows that ESI indicators, as well as other normalized citation indicators, have the following flaws. First, the publication month and the online-to-print delay affect a paper's probability of becoming a Highly Cited Paper (HCP). Papers published in the earlier months of the year are more likely to accumulate enough citation counts to rank at the top 1% compared with those published in later months of the year. Papers with longer online-to-print delays have an apparent advantage for being selected as HCPs. Research field normalizations lead to the third pitfall. Different research fields have different citation thresholds for HCPs, making research field classification important for a journal. In addition, the uniform thresholds for both articles and reviews in ESI affect the reliability of HCP selection because, on average, reviews tend to have higher citation rates than articles. ESI's selection of HCPs provides an intuitive feel for the problems of normalized citation impact indicators, such as those provided in InCites and SciVal. (C) 2018 Elsevier Ltd. All rights reserved.

Pre One:期刊与会议的混合共被引网络分析——以计算机科学领域为例

Next One:Evaluating the Impact of Web-scale Discovery Services on Scholarly Content Seeking