Four pitfalls in normalizing citation indicators: An investigation of ESI’s selection of highly cited papers |
| |
| Authors: | Zhigang Hu Wencan Tian Shenmeng Xu Chunbo Zhang Xianwen Wang |
| |
| Institution: | 1. WISE Lab, Institute of Science of Science and S&T Management, Dalian University of Technology, Dalian, 116024, China;2. School of Information and Library Science, University of North Carolina at Chapel Hill, Chapel Hill, 27517, USA |
| |
| Abstract: | InCites Essential Science Indicators is becoming increasingly used to identify top-performing research and evaluate the impact of institutes. Unfortunately, our study shows that ESI indicators, as well as other normalized citation indicators, have the following flaws. First, the publication month and the online-to-print delay affect a paper’s probability of becoming a Highly Cited Paper (HCP). Papers published in the earlier months of the year are more likely to accumulate enough citation counts to rank at the top 1% compared with those published in later months of the year. Papers with longer online-to-print delays have an apparent advantage for being selected as HCPs. Research field normalizations lead to the third pitfall. Different research fields have different citation thresholds for HCPs, making research field classification important for a journal. In addition, the uniform thresholds for both articles and reviews in ESI affect the reliability of HCP selection because, on average, reviews tend to have higher citation rates than articles. ESI’s selection of HCPs provides an intuitive feel for the problems of normalized citation impact indicators, such as those provided in InCites and SciVal. |
| |
| Keywords: | Normalized citation impact Essential science indicators Highly cited papers Publication month Online-to-print delays Citation impact indicators Journal-to-field classification |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
