A trustability metric for code search based on developer karma

Authors:
Florian S. Gysin;Adrian Kuhn
Affiliations:
University of Bern, Switzerland;University of Bern, Switzerland
Venue:
Proceedings of 2010 ICSE Workshop on Search-driven Development: Users, Infrastructure, Tools and Evaluation
Year:
2010

Citing 9
Cited 1

Sourcerer: a search engine for open source code supporting structure-based search

Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applications
Linked: How Everything Is Connected to Everything Else and What It Means

Linked: How Everything Is Connected to Everything Else and What It Means
Why most open source development projects do not succeed?

ICSEW '07 Proceedings of the 29th International Conference on Software Engineering Workshops
Code Conjurer: Pulling Reusable Software out of Thin Air

IEEE Software
Software component recommendation using collaborative filtering

SUITE '09 Proceedings of the 2009 ICSE Workshop on Search-Driven Development-Users, Infrastructure, Tools and Evaluation
Internet-Scale Code Search

SUITE '09 Proceedings of the 2009 ICSE Workshop on Search-Driven Development-Users, Infrastructure, Tools and Evaluation
SUITE 2009: First international workshop on search-driven development - users, infrastructure, tools and evaluation

ICSE '09 COMPANION Proceedings of the 2009 31st International Conference on Software Engineering: Companion Volume
Automatic labeling of software components and their evolution using log-likelihood ratio of word frequencies in source code

MSR '09 Proceedings of the 2009 6th IEEE International Working Conference on Mining Software Repositories
Search User Interfaces

Search User Interfaces

SNIPR: complementing code search with code retargeting capabilities

Proceedings of the 2013 International Conference on Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

The promise of search-driven development is that developers will save time and resources by reusing external code in their local projects. To efficiently integrate this code, users must be able to trust it, thus trustability of code search results is just as important as their relevance. In this paper, we introduce a trustability metric to help users assess the quality of code search results and therefore ease the cost-benefit analysis they undertake trying to find suitable integration candidates. The proposed trustability metric incorporates both user votes and cross-project activity of developers to calculate a "karma" value for each developer. Through the karma value of all its developers a project is ranked on a trustability scale. We present JBender, a proof-of-concept code search engine which implements our trustability metric and we discuss preliminary results from an evaluation of the prototype.