An automated conflict of interest based greedy approach for conference paper assignment system |
| |
| Institution: | 1. College of Liberal Arts and Sciences, National University of Defense Technology, Changsha, China;2. Department of Mathematics, University of California, Los Angeles, USA;1. School of Information, Shanxi University of Finance & Economics, 030006, Taiyuan, China;2. CNKI, Inc., 100192, Beijing, China;1. Laboratory for Studies in Research Evaluation, Institute for System Analysis and Computer Science (IASI-CNR), National Research Council, Rome, Italy;2. Nordic Institute for Studies in Innovation, Research and Education, Oslo, Norway;3. University of Rome “Tor Vergata”, Dept of Engineering and Management, Rome, Italy;1. University of Hasselt, Belgium;2. University of Antwerp, Faculty of Social Sciences, B-2020, Antwerpen, Belgium;3. Centre for R&D Monitoring (ECOOM) and Dept. MSI, KU Leuven, Leuven, Belgium |
| |
| Abstract: | Reviewer Assignment Problem (RAP) is a crucial problem for the conference due to time constraints and inadequate availability of expert reviewers. A fair evaluation of paper is key to an author's success, paper quality, conference reputation, and productive usage of funds. Recent studies reflect on the issue of reviewer bias in bids favoring authors belonging to the top institution and higher authority. Existing Conference Management Systems (CMS) are solely dependent upon self-declared Conflict of Interest (CoI) made by the authors, and reviewers. In literature, existing studies considers topic similarity, potential CoI, and reviewer's workload as trivial factors for ensuring review quality. Other factors include the diversity and authority of a reviewer. Past studies propose several theoretical optimization models. In this paper, we first individually model the factors using the best possible strategy in a constrained-based optimization framework. We tried to propose a completely novel framework that can be practically implemented to improve upon the performance of existing CMS. We map the RAP to an equilibrium multi-job assignment problem. Moreover, we propose a meta-heuristic greedy solution to solve it using weighted matrix factorization. We re-define an assignment quality metric required to validate such assignments. A real conference assignment data set collected from EasyChair is used for a comparative study. The TPMS is used as a baseline because it also uses similar factors, and due to its integration with widely used Microsoft CMS. The results show that the mean assignment quality of the proposed method is superior to other benchmark RAP systems. |
| |
| Keywords: | Reviewer assignment problem Conflict of interest Co-authorship graph Equilibrium multi-job assignment |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
