* Faculty       * Staff       * Students & Alumni       * Committees       * Contact       * Institute Directory
* Undergraduate Program       * Graduate Program       * Courses       * Institute Catalog      
* Undergraduate       * Graduate       * Institute Admissions: Undergraduate | Graduate      
* Colloquia       * Seminars       * News       * Events       * Institute Events      
* Overview       * Lab Manual       * Institute Computing      
No Menu Selected

* News


PeerRank: a new method for peer assessment

Speaker: Toby Walsh

February 28, 2014 - 4:00 p.m. to 5:00 p.m.
Location: JEC 3117
Hosted By: Dr. Lirong Xia (x6720)


I propose the PeerRank method for peer assessment. This constructs a grade for an agent based on the grades proposed by the agents evaluating the agent. Since the grade of an agent is a measure of their ability to grade correctly, the PeerRank method weights grades by the grades of the grading agent. The PeerRank method also provides an incentive for agents to grade correctly. It rewards agents who grade well, and penalises those that grade poorly. As the grades of an agent depend on the grades of the grading agents, and as these grades themselves depend on the grades of other agents, I define the PeerRank method by a fixed point equation similar to the PageRank method for ranking web-pages. I identify some formal properties of the PeerRank method, discuss some examples, compare with related work and evaluate the performance on some synthetic data.


Toby Walsh is Reseach Group Leader at NICTA. He is adjunct Professor at the Department of Computer Science and Engineering at the University of New South Wales, external Professor of the Department of Information Science at Uppsala University and an honorary fellow of the School of Informatics at Edinburgh University. He has been Editor-in-Chief of the Journal of Artificial Intelligence Research, and of AI Communications. He is on the editorial board of the Journal of Automated Reasoning and the Constraints journal. He has been elected a fellow of both the Association for the Advancement of Artificial Intelligence and the European Coordinating Committee for AI in recognition of his reseach and service to the community. He has been Secretary of the Associtation for Constraint Programming (ACP) and is Editor of CP News, the newsletter of the ACP. He is one of the Editors of the Handbook for Constraint Programming, and the Handbook for Satisfiability. He was Program Chair of the International Joint Conference on AI (IJCAI) in 2011, Conference Chair of the Constraint Programming (CP) Conference in 2008, Program and Conference Chair of the Satisfiability (SAT) Conference in 2005, Conference Chair of the International Joint Conference on Automated Reasoning (IJCAR) in 2004, Program Chair of the Constraint Programming (CP) Conference in 2001, and Chair of the Symposium on Abstraction, Reformulation and Approximation (SARA) in 2000.

Last updated: November 12, 2013