A novel dual wing harmonium model aided by 2-D wavelet transform subbands for document data mining

Authors:
Haijun Zhang;Tommy W. S. Chow;M. K. M. Rahman
Affiliations:
Department of Electronic Engineering, City University of Hong Kong, 83 Tat Chee Avenue, Kowloon, Hong Kong;Department of Electronic Engineering, City University of Hong Kong, 83 Tat Chee Avenue, Kowloon, Hong Kong;Department of Electronic Engineering, City University of Hong Kong, 83 Tat Chee Avenue, Kowloon, Hong Kong
Venue:
Expert Systems with Applications: An International Journal
Year:
2010

Citing 18
Cited 0

Term-weighting approaches in automatic text retrieval

Information Processing and Management: an International Journal
A Theory for Multiresolution Signal Decomposition: The Wavelet Representation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Information processing in dynamical systems: foundations of harmony theory

Parallel distributed processing: explorations in the microstructure of cognition, vol. 1
Using linear algebra for intelligent information retrieval

SIAM Review
Exploring the similarity space

ACM SIGIR Forum
Probabilistic latent semantic indexing

Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Introduction to Modern Information Retrieval

Introduction to Modern Information Retrieval
Training products of experts by minimizing contrastive divergence

Neural Computation
A New Learning Algorithm for Mean Field Boltzmann Machines

ICANN '02 Proceedings of the International Conference on Artificial Neural Networks
Classification of Web Documents Using a Graph Model

ICDAR '03 Proceedings of the Seventh International Conference on Document Analysis and Recognition - Volume 1
Latent dirichlet allocation

The Journal of Machine Learning Research
Bayesian learning in undirected graphical models: approximate MCMC algorithms

UAI '04 Proceedings of the 20th conference on Uncertainty in artificial intelligence
The rate adapting poisson model for information retrieval and object recognition

ICML '06 Proceedings of the 23rd international conference on Machine learning
Wavelet transform and adaptive neuro-fuzzy inference system for color texture classification

Expert Systems with Applications: An International Journal
Harmonium Models for Video Classification

Statistical Analysis and Data Mining
Multilayer SOM with tree-structured data for efficient document retrieval and plagiarism detection

IEEE Transactions on Neural Networks
A generalized mean field algorithm for variational inference in exponential families

UAI'03 Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence
Image compression using the 2-D wavelet transform

IEEE Transactions on Image Processing

Quantified Score

Hi-index	12.05

Visualization

Abstract

A novel dual wing harmonium model that integrates multiple features including term frequency features and 2-D wavelet transform features into a low dimensional semantic space is proposed for the applications of document classification and retrieval. Terms are extracted from the graph representation of document by employing weighted feature extraction method. 2-D wavelet transform is used to compress the graph due to its sparseness while preserving the basic document structure. After transform, low-pass subbands are stacked to represent the term associations in a document. We then develop a new dual wing harmonium model projecting these multiple features into low dimensional latent topics with different probability distributions assumption. Contrastive divergence algorithm is used for efficient learning and inference. We perform extensive experimental verification in document classification and retrieval, and comparative results suggest that the proposed method delivers better performance than other methods.