Data mining middleware for wide-area high-performance networks

Authors:
Robert L. Grossman;Yunhong Gu;David Hanley;Michal Sabala;Joe Mambretti;Alex Szalay;Ani Thakar;Kazumi Kumazoe;Oie Yuji;Minsun Lee;Yoonjoo Kwon;Woojin Seok
Affiliations:
National Center for Data Mining, University of Illinois at Chicago;National Center for Data Mining, University of Illinois at Chicago;National Center for Data Mining, University of Illinois at Chicago;National Center for Data Mining, University of Illinois at Chicago;International Center for Advanced Internet Research, Northwestern University;Johns Hopkins University;Johns Hopkins University;Kitakyushu JGNII Research Center, Japan;Kitakyushu JGNII Research Center, Japan;Korea Institute of Science and Technology Information, Republic of Korea;Korea Institute of Science and Technology Information, Republic of Korea;Korea Institute of Science and Technology Information, Republic of Korea
Venue:
Future Generation Computer Systems - IGrid 2005: The global lambda integrated facility
Year:
2006

Citing 16
Cited 2

Models and issues in data stream systems

Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Dynamic multidimensional histograms

Proceedings of the 2002 ACM SIGMOD international conference on Management of data
The SDSS skyserver: public access to the sloan digital sky server data

Proceedings of the 2002 ACM SIGMOD international conference on Management of data
Data management and transfer in high-performance computational grid environments

Parallel Computing - Parallel data-intensive algorithms and applications
Dynamic Histograms: Capturing Evolving Data Sets

ICDE '00 Proceedings of the 16th International Conference on Data Engineering
The Photonic TeraStream: enabling next generation applications through intelligent optical networking at iGRID2002

Future Generation Computer Systems - iGrid 2002
TeraScope: distributed visual data mining of terascale data sets over photonic networks

Future Generation Computer Systems - iGrid 2002
Experimental studies using photonic data services at IGrid 2002

Future Generation Computer Systems - iGrid 2002
Grid-enabled particle physics event analysis: experiences using a 10 Gb, high-latency network for a high-energy physics application

Future Generation Computer Systems - iGrid 2002
The rationale of the current optical networking initiatives

Future Generation Computer Systems - iGrid 2002
Microscopic examination of TCP flows over transatlantic links

Future Generation Computer Systems - iGrid 2002
Experiences in Design and Implementation of a High Performance Transport Protocol

Proceedings of the 2004 ACM/IEEE conference on Supercomputing
Hierarchical binary histograms for summarizing multi-dimensional data

Proceedings of the 2005 ACM symposium on Applied computing
Mining data streams: a review

ACM SIGMOD Record
Supporting Configurable Congestion Control in Data Transport Services

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Approximate frequency counts over data streams

VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases

OptIPuter: Enabling advanced applications with novel optical control planes and backplanes

Future Generation Computer Systems
Large scale computational science on federated international grids: The role of switched optical networks

Future Generation Computer Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we describe two distributed, data intensive applications that were demonstrated at iGrid 2005 (iGrid Demonstration US 109 and iGrid Demonstration US121). One involves transporting astronomical data from the Sloan Digital Sky Survey (SDSS) and the other involves computing histograms from multiple high-volume data streams. Both rely on newly developed data transport and data mining middleware. Specifically, we describe a new version of the UDT network protocol called Composible-UDT, a file transfer utility based upon UDT called UDT-Gateway, and an application for building histograms on high-volume data flows called BESH (for Best Effort Streaming Histogram). For both demonstrations, we include a summary of the experimental studies performed at iGrid 2005.