Time-dependent utility and action under uncertainty
Proceedings of the seventh conference (1991) on Uncertainty in artificial intelligence
Data networks (2nd ed.)
Hartstone: synthetic benchmark requirements for hard real-time applications
Proceedings of the working group on Ada performance issues 1990
Recent developments and trends in global optimization
Journal of Computational and Applied Mathematics - Special issue on numerical analysis 2000 Vol. IV: optimization and nonlinear equations
Distributed Detection and Data Fusion
Distributed Detection and Data Fusion
Rate-based query optimization for streaming information sources
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
Bayesian Networks for Data Mining
Data Mining and Knowledge Discovery
A Brief Introduction to Boosting
IJCAI '99 Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence
Chain: operator scheduling for memory minimization in data stream systems
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Adaptive filters for continuous queries over distributed data streams
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Dynamic bayesian networks: representation, inference and learning
Dynamic bayesian networks: representation, inference and learning
Reducing multiclass to binary: a unifying approach for margin classifiers
The Journal of Machine Learning Research
Boosting Chain Learning for Object Detection
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Aurora: a new model and architecture for data stream management
The VLDB Journal — The International Journal on Very Large Data Bases
Privacy-preserving Distributed Clustering using Generative Models
ICDM '03 Proceedings of the Third IEEE International Conference on Data Mining
Privacy-preserving k-means clustering over vertically partitioned data
Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
Supporting timeliness and accuracy in distributed real-time content-based video analysis
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Cost-efficient mining techniques for data streams
ACSW Frontiers '04 Proceedings of the second workshop on Australasian information security, Data Mining and Web Intelligence, and Software Internationalisation - Volume 32
Dynamic Load Distribution in the Borealis Stream Processor
ICDE '05 Proceedings of the 21st International Conference on Data Engineering
Fault-tolerance in the Borealis distributed stream processing system
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
Distributed Stream Management using Utility-Driven Self-Adaptive Middleware
ICAC '05 Proceedings of the Second International Conference on Automatic Computing
Improving classifier utility by altering the misclassification cost ratio
UBDM '05 Proceedings of the 1st international workshop on Utility-based data mining
Dealing with Overload in Distributed Stream Processing Systems
ICDEW '06 Proceedings of the 22nd International Conference on Data Engineering Workshops
Flow algorithms for two pipelined filter ordering problems
Proceedings of the twenty-fifth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Multi-site cooperative data stream analysis
ACM SIGOPS Operating Systems Review
Resource Management for Networked Classifiers in Distributed Stream Mining Systems
ICDM '06 Proceedings of the Sixth International Conference on Data Mining
Load shedding in a data stream manager
VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
A generic flow algorithm for shared filter ordering problems
Proceedings of the twenty-seventh ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Payoff-Based Dynamics for Multiplayer Weakly Acyclic Games
SIAM Journal on Control and Optimization
Proceedings of the international conference on Multimedia
| Hi-index | 0.01 |
In this paper, we discuss distributed optimization techniques for configuring classifiers in a real-time, informationally-distributed stream mining system. Due to the large volume of streaming data, stream mining systems must often cope with overload, which can lead to poor performance and intolerable processing delay for real-time applications. Furthermore, optimizing over an entire system of classifiers is a difficult task since changing the filtering process at one classifier can impact both the feature values of data arriving at classifiers further downstream and, thus, the classification performance achieved by an ensemble of classifiers, as well as the end-to-end processing delay. To address this problem, this paper makes three main contributions. 1) Based upon classification and queuing theoretic models, we propose a utility metric that captures both the performance and the delay of a binary filtering classifier system. 2) We introduce a low-complexity framework for estimating the system utility by observing, estimating, and/or exchanging parameters between the interrelated classifiers deployed across the system. 3) We provide distributed algorithms to reconfigure the system, and analyze the algorithms based upon their convergence properties, optimality, information exchange overhead, and rate of adaptation to nonstationary data sources. We provide results using different video classifier systems.