ContentEx: a framework for automatic content extraction programs

Authors:
Linhai Song;Xueqi Cheng;Yan Guo;Yue Liu;Guodong Ding
Affiliations:
Institute of Computing Technology, Chinese Academy of Sciences and Graduate School of the Chinese Academy of Sciences, Beijing;Institute of Computing Technology, Chinese Academy of Sciences, Beijing;Institute of Computing Technology, Chinese Academy of Sciences, Beijing;Institute of Computing Technology, Chinese Academy of Sciences, Beijing;Institute of Computing Technology, Chinese Academy of Sciences, Beijing
Venue:
ISI'09 Proceedings of the 2009 IEEE international conference on Intelligence and security informatics
Year:
2009

Citing 2
Cited 1

DOM-based content extraction of HTML documents

WWW '03 Proceedings of the 12th international conference on World Wide Web
Automating Content Extraction of HTML Documents

World Wide Web

Find me opinion sources in blogosphere: a unified framework for opinionated blog feed retrieval

Proceedings of the fifth ACM international conference on Web search and data mining

Quantified Score

Hi-index	0.00

Visualization

Abstract

Web pages are often decorated with extraneous information (such as navigation bars, branding banners, JavaScript and advertisements). This kind of information may distract users from actual content they are really interested in and may reduce effects of many advanced web applications. Automatic content extraction has many applications ranging from providing data for web mining to realizing better accessing the web over mobile devices. In this paper, we propose ContentEx, a framework for automatic content extraction programs, which we use to organize codes of automatic content extraction programs and to facilitate the development of related solutions. We also introduce how we extract content from forum pages in this framework to fulfill the requirement from our actual application.