Parallel Crawling and Capturing for On-Line Auction

Authors:
Cheng-Hsien Yu;Shi-Jen Lin
Affiliations:
National Central University, Tao-yuan, Taiwan 320 and China University of Technology, Hsin-chu, Taiwan 303;National Central University, Tao-yuan, Taiwan 320
Venue:
PAISI, PACCF and SOCO '08 Proceedings of the IEEE ISI 2008 PAISI, PACCF, and SOCO international workshops on Intelligence and Security Informatics
Year:
2008

Citing 4
Cited 1

Analyzing the economic efficiency of eBay-like online reputation reporting mechanisms

Proceedings of the 3rd ACM conference on Electronic Commerce
Exploring auction databases through interactive visualization

Decision Support Systems
Applications of flexible pricing in business-to-business electronic commerce

IBM Systems Journal
User heterogeneity and its impact on electronic auction market design: an empirical exploration

MIS Quarterly

Fuzzy rule optimization for online auction frauds detection based on genetic algorithm

Electronic Commerce Research

Quantified Score

Hi-index	0.00

Visualization

Abstract

The on-line auction is one of the most successful types of electronic marketplaces and has been the subject of many academic studies. In recent years, empirical research on on-line auction has been flourishing because of the availability of large amounts of high-quality bid data from on-line auction sites. Researcher can provide buyers and sellers with useful information, and help prevent fraud and reduce purchase cost. However, the increasingly large volumes of bid data have made data collection increasingly complex and time consuming, and there are no effective resources that can adequately support this work. So this study focuses on the parallel crawling and capturing of on-line auctions from the automatic agent perspective to help researchers collect auction data more effectively. The issues in this study include parallel crawling architecture, crawling strategies, content capturing strategies, and prototype system implementation. Finally we conduct an empirical experiment on eBay U.S. and Ruten Taiwan to evaluate the performance of our parallel crawling and capturing. The results of this study show that our parallel crawling and capturing methodology is able to work in the real world and generate good performance outcomes.