MobiMine: monitoring the stock market from a PDA
ACM SIGKDD Explorations Newsletter
Financial Prediction Using Neural Networks
Financial Prediction Using Neural Networks
Neural Network Time Series Forecasting of Financial Markets
Neural Network Time Series Forecasting of Financial Markets
On the Privacy Preserving Properties of Random Data Perturbation Techniques
ICDM '03 Proceedings of the Third IEEE International Conference on Data Mining
Random-data perturbation techniques and privacy-preserving data mining
Knowledge and Information Systems
Random matrix theory and wireless communications
Communications and Information Theory
Detecting correlation between server resources for system management
Journal of Computer and System Sciences
Hi-index | 0.00 |
This paper describes a novel approach to detect correlation from data streams in the context of MobiMine -- an experimental mobile data mining system. It presents a brief description of the MobiMine and identifies the problem of detecting dependencies among stocks from incrementally observed financial data streams. This is a non-trivial problem since the stock-market data is inherently noisy and small incremental volumes of data makes the estimation process more vulnerable to noise. This paper presents EDS, a technique to estimate the correlation matrix from data streams by exploiting some properties of the distribution of eigenvalues for random matrices. It separates the "information" from the "noise" by comparing the eigen-spectrum generated from the observed data with that of random matrices. The comparison immediately leads to a decomposition of the covariance matrix into two matrices: one capturing the "noise" and the other capturing useful "information." The paper also presents experimental results using Nasdaq 100 stock data.