Being digital
Taking the byte out of cookies: privacy, consent, and the Web
Proceedings of the ethics and social impact component on Shaping policy in the information age
The anatomy of a large-scale hypertextual Web search engine
WWW7 Proceedings of the seventh international conference on World Wide Web 7
ACM Transactions on Internet Technology (TOIT)
Web page change and persistence---a four-year longitudinal study
Journal of the American Society for Information Science and Technology
Terrorism or civil disobedience: toward a hacktivist ethic
ACM SIGCAS Computers and Society
Scholarly use of the web: what are the key inducers of links to journal web sites?
Journal of the American Society for Information Science and Technology
Secrets and Lies: Digital Security in a Networked World
Secrets and Lies: Digital Security in a Networked World
Search engine coverage bias: evidence and possible causes
Information Processing and Management: an International Journal
Journal of the American Society for Information Science and Technology
Information Politics on the Web
Information Politics on the Web
Journal of the American Society for Information Science and Technology - Special issue: Webometrics
Data Protection: A Practical Guide to UK and EU Law
Data Protection: A Practical Guide to UK and EU Law
The web structure of e-government - developing a methodology for quantitative evaluation
Proceedings of the 15th international conference on World Wide Web
Factors affecting website reconstruction from the web infrastructure
Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries
Sindice.com: a document-oriented lookup index for open linked data
International Journal of Metadata, Semantics and Ontologies
Measuring the web crawler ethics
Proceedings of the 19th international conference on World wide web
Resources for Turkish morphological processing
Language Resources and Evaluation
Researching Personal Information on the Public Web: Methods and Ethics
Social Science Computer Review
Searching and browsing Linked Data with SWSE: The Semantic Web Search Engine
Web Semantics: Science, Services and Agents on the World Wide Web
Analysis of web logs: challenges and findings
PERFORM'10 Proceedings of the 2010 IFIP WG 6.3/7.3 international conference on Performance Evaluation of Computer and Communication Systems: milestones and future challenges
An extensive study of Web robots traffic
Proceedings of International Conference on Information Integration and Web-based Applications & Services
Hi-index | 0.00 |
Ethical aspects of the employment of Web crawlers for information science research and other contexts are reviewed. The difference between legal and ethical uses of communications technologies is emphasized as well as the changing boundary between ethical and unethical conduct. A review of the potential impacts on Web site owners is used to underpin a new framework for ethical crawling, and it is argued that delicate human judgment is required for each individual case, with verdicts likely to change over time. Decisions can be based upon an approximate cost-benefit analysis, but it is crucial that crawler owners find out about the technological issues affecting the owners of the sites being crawled in order to produce an informed assessment. © 2006 Wiley Periodicals, Inc.