On text preprocessing for opinion mining outside of laboratory environments

Authors:
Gerald Petz;Michał Karpowicz;Harald Fürschuß;Andreas Auinger;Stephan M. Winkler;Susanne Schaller;Andreas Holzinger
Affiliations:
University of Applied Sciences Upper Austria, Austria;University of Applied Sciences Upper Austria, Austria;University of Applied Sciences Upper Austria, Austria;University of Applied Sciences Upper Austria, Austria;University of Applied Sciences Upper Austria, Austria;University of Applied Sciences Upper Austria, Austria;Medical Informatics, Statistics and Documentation, Medical University Graz, Austria
Venue:
AMT'12 Proceedings of the 8th international conference on Active Media Technology
Year:
2012

Citing 28
Cited 0

Genetic programming II: automatic discovery of reusable programs

Genetic programming II: automatic discovery of reusable programs
The nature of statistical learning theory

The nature of statistical learning theory
Information Retrieval

Information Retrieval
A brief survey of web data extraction tools

ACM SIGMOD Record
Support vector machine active learning with applications to text classification

The Journal of Machine Learning Research
Effects of adjective orientation and gradability on sentence subjectivity

COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Mining and summarizing customer reviews

Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining
Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews

ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
Word sense and subjectivity

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Sentiment classification on customer feedback data: noisy data, large feature vectors, and the role of linguistic analysis

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Determining the sentiment of opinions

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Extracting product features and opinions from reviews

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
A holistic lexicon-based approach to opinion mining

WSDM '08 Proceedings of the 2008 International Conference on Web Search and Data Mining
Sentiment analysis in multiple languages: Feature selection for opinion classification in Web forums

ACM Transactions on Information Systems (TOIS)
Text Extraction from the Web via Text-to-Tag Ratio

DEXA '08 Proceedings of the 2008 19th International Conference on Database and Expert Systems Application
Knowledge Creation in Marketing Based on Data Mining

ICICTA '08 Proceedings of the 2008 International Conference on Intelligent Computation Technology and Automation - Volume 01
Extracting article text from the web with maximum subsequence segmentation

Proceedings of the 18th international conference on World wide web
Language Identification on the Web: Extending the Dictionary Method

CICLing '09 Proceedings of the 10th International Conference on Computational Linguistics and Intelligent Text Processing
Mining comparative sentences and relations

AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
Genetic Algorithms and Genetic Programming: Modern Concepts and Practical Applications

Genetic Algorithms and Genetic Programming: Modern Concepts and Practical Applications
Web page cleaning for web mining through feature weighting

IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
Joint sentiment/topic model for sentiment analysis

Proceedings of the 18th ACM conference on Information and knowledge management
Boilerplate detection using shallow text features

Proceedings of the third ACM international conference on Web search and data mining
CETR: content extraction via tag ratios

Proceedings of the 19th international conference on World wide web
Web Data Mining: Exploring Hyperlinks, Contents, and Usage Data

Web Data Mining: Exploring Hyperlinks, Contents, and Usage Data
Predicting consumer sentiments from online text

Decision Support Systems
Disease-Disease Relationships for Rheumatic Diseases: Web-Based Biomedical Textmining an Knowledge Discovery to Assist Medical Decision Making

COMPSAC '12 Proceedings of the 2012 IEEE 36th Annual Computer Software and Applications Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

Opinion mining deals with scientific methods in order to find, extract and systematically analyze subjective information. When performing opinion mining to analyze content on the Web, challenges arise that usually do not occur in laboratory environments where prepared and preprocessed texts are used. This paper discusses preprocessing approaches that help coping with the emerging problems of sentiment analysis in real world situations. After outlining the identified shortcomings and presenting a general process model for opinion mining, promising solutions for language identification, content extraction and dealing with Internet slang are discussed.