Aggregating productivity indices for ranking researchers across multiple areas

Authors:
Harlley Lima;Thiago H.P. Silva;Mirella M. Moro;Rodrygo L.T. Santos;Wagner Meira, Jr.;Alberto H.F. Laender
Affiliations:
Universidade Federal de Minas Gerais, Belo Horizonte, Brazil;Universidade Federal de Minas Gerais, Belo Horizonte, Brazil;Universidade Federal de Minas Gerais, Belo Horizonte, Brazil;Universidade Federal de Minas Gerais, Belo Horizonte, Brazil;Universidade Federal de Minas Gerais, Belo Horizonte, Brazil;Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
Venue:
Proceedings of the 13th ACM/IEEE-CS joint conference on Digital libraries
Year:
2013

Citing 15
Cited 0

Real life, real users, and real needs: a study and analysis of user queries on the web

Information Processing and Management: an International Journal
Cumulated gain-based evaluation of IR techniques

ACM Transactions on Information Systems (TOIS)
Lazy Associative Classification

ICDM '06 Proceedings of the Sixth International Conference on Data Mining
Are your citations clean?

Communications of the ACM
Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine

Journal of the American Society for Information Science and Technology
Multi-label Lazy Associative Classification

PKDD 2007 Proceedings of the 11th European conference on Principles and Practice of Knowledge Discovery in Databases
Differences in impact factor across fields and over time

Journal of the American Society for Information Science and Technology
Universality of citation distributions–A validation of Radicchi et al.'s relative indicator cf = c-c0 at the micro level using data from chemistry

Journal of the American Society for Information Science and Technology
An unsupervised heuristic-based hierarchical method for name disambiguation in bibliographic citations

Journal of the American Society for Information Science and Technology
A made-to-measure indicator for cross-disciplinary bibliometric ranking of researchers performance

Scientometrics
INTERACTING WITH PUBLIC POLICY: Are HCI researchers an endangered species in Brazil?

interactions
Proposals for evaluating the regularity of a scientist's research output

Scientometrics
Comparison of Brazilian researchers in clinical medicine: are criteria for ranking well-adjusted?

Scientometrics
Alternatives to the journal impact factor: I3 and the top-10% (or top-25%?) of the most-highly cited papers

Scientometrics
A brief survey of automatic methods for author name disambiguation

ACM SIGMOD Record

Quantified Score

Hi-index	0.00

Visualization

Abstract

The impact of scientific research has traditionally been quantified using productivity indices such as the well-known h-index. On the other hand, different research fields---in fact, even different research areas within a single field---may have very different publishing patterns, which may not be well described by a single, global index. In this paper, we argue that productivity indices should account for the singularities of the publication patterns of different research areas, in order to produce an unbiased assessment of the impact of scientific research. Inspired by ranking aggregation approaches in distributed information retrieval, we propose a novel approach for ranking researchers across multiple research areas. Our approach is generic and produces cross-area versions of any global productivity index, such as the volume of publications, citation count and even the h-index. Our thorough evaluation considering multiple areas within the broad field of Computer Science shows that our cross-area indices outperform their global counterparts when assessed against the official ranking produced by CNPq, the Brazilian National Research Council for Scientific and Technological Development. As a result, this paper contributes a valuable mechanism to support the decisions of funding bodies and research agencies, for example, in any research assessment effort.