Congestion avoidance and control
SIGCOMM '88 Symposium proceedings on Communications architectures and protocols
Chord: A scalable peer-to-peer lookup service for internet applications
Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications
A scalable distributed information management system
Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications
Characterizing and Mining the Citation Graph of the Computer Science Literature
Knowledge and Information Systems
Experiences from the Sigcomm 2005 European shadow PC experiment
ACM SIGCOMM Computer Communication Review
BAR fault tolerance for cooperative services
Proceedings of the twentieth ACM symposium on Operating systems principles
ACM SIGCOMM Computer Communication Review
One hop reputations for peer to peer file sharing workloads
NSDI'08 Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation
Viewpoint: Scaling the academic publication process to internet scale
Communications of the ACM - Rural engineering development
Viewpoint: Program committee overload in systems
Communications of the ACM - Security in the Browser
Paper rating vs. paper ranking
ACM SIGOPS Operating Systems Review
Do incentives build robustness in bit torrent
NSDI'07 Proceedings of the 4th USENIX conference on Networked systems design & implementation
Mutually controlled routing with independent ISPs
NSDI'07 Proceedings of the 4th USENIX conference on Networked systems design & implementation
A comparison of on-line computer science citation databases
ECDL'05 Proceedings of the 9th European conference on Research and Advanced Technology for Digital Libraries
WOWCS: the workshop on organizing workshops, conferences, and symposia for computer systems
ACM SIGOPS Operating Systems Review
Paper rating vs. paper ranking
ACM SIGOPS Operating Systems Review
How good is this conference?: evaluating conference reviewing and selectivity
BCS-HCI '12 Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers
Communications of the ACM
Towards more constructive reviewing of SIGCOMM papers
ACM SIGCOMM Computer Communication Review
| Hi-index | 0.02 |
This paper develops a model of computer systems research to help prospective authors understand the often obscure workings of conference program committees. We present data to show that the variability between reviewers is often the dominant factor as to whether a paper is accepted. We argue that paper merit is likely to be zipf distributed, making it inherently difficult for program committees to distinguish between most papers. We use game theory to show that with noisy reviews and zipf merit, authors have an incentive to submit papers too early and too often. These factors make conference reviewing, and systems research as a whole, less efficient and less effective. We describe some recent changes in conference design to address these issues, and we suggest some further potential improvements.