Distributed computing research issues in grid computing
ACM SIGACT News
The Grid: an application of the semantic web
ACM SIGMOD Record
Applying Chimera virtual data concepts to cluster finding in the Sloan Sky Survey
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Virtual Services in Data Grids
HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
Enabling Autonomic Compositions in Grid Environments
GRID '03 Proceedings of the 4th International Workshop on Grid Computing
Data webs for earth science data
Parallel Computing - Special issue: High performance computing with geographical data
Grid resource management
Automatically Composed Workflows for Grid Environments
IEEE Intelligent Systems
Application partitioning and hierarchical management in grid environments
DSM '04 Proceedings of the 1st international doctoral symposium on Middleware
Grid middleware services for virtual data discovery, composition, and integration
MGC '04 Proceedings of the 2nd workshop on Middleware for grid computing
A Novel Architecture for Realizing Grid Workflow using Tuple Spaces
GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
Grid-Based Galaxy Morphology Analysis for the National Virtual Observatory
Proceedings of the 2003 ACM/IEEE conference on Supercomputing
SPHINX: A Fault-Tolerant System for Scheduling in Dynamic Grid Environments
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
SPHINX: A Fault-Tolerant System for Scheduling in Dynamic Grid Environments
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
PPerfGrid: A Grid Services-based Tool for the Exchange of Heterogeneous Parallel Performance Data
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 4 - Volume 05
Lineage retrieval for scientific data processing: a survey
ACM Computing Surveys (CSUR)
Managing structural genomic workflows using web services
Data & Knowledge Engineering - Special issue: Biological data management
Overcoming barriers to restructuring in a modular visualisation environment
LCR '04 Proceedings of the 7th workshop on Workshop on languages, compilers, and run-time support for scalable systems
The Pegasus portal: web based grid computing
Proceedings of the 2005 ACM symposium on Applied computing
Integrating databases and workflow systems
ACM SIGMOD Record
A survey of data provenance in e-science
ACM SIGMOD Record
Hierarchical submission in a Grid environment
MGC '05 Proceedings of the 3rd international workshop on Middleware for grid computing
GLARE: A Grid Activity Registration, Deployment and Provisioning Framework
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
A framework for reliable and efficient data placement in distributed computing systems
Journal of Parallel and Distributed Computing - Special issue: Design and performance of networks for super-, cluster-, and grid-computing: Part I
Provenance management in curated databases
Proceedings of the 2006 ACM SIGMOD international conference on Management of data
Grid-based distributed search structure
Proceedings of the 44th annual Southeast regional conference
NFSv4 replication for grid storage middleware
Proceedings of the 4th international workshop on Middleware for grid computing
Pegasus: A framework for mapping complex scientific workflows onto distributed systems
Scientific Programming
A Semantic Web Service Based Approach for Augmented Provenance
WI '06 Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence
GRID '05 Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing
A brokerage system for solar data archives
Software—Practice & Experience
Data driven workflow planning in cluster management systems
Proceedings of the 16th international symposium on High performance distributed computing
Integrating existing scientific workflow systems: the Kepler/Pegasus example
Proceedings of the 2nd workshop on Workflows in support of large-scale science
Introducing secure provenance: problems and challenges
Proceedings of the 2007 ACM workshop on Storage security and survivability
GridDB: a data-centric overlay for scientific grids
VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Tracing lineage beyond relational operators
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
The architecture and implementation of the Vega Information Grid
International Journal of Web and Grid Services
Advanced data flow support for scientific grid workflow applications
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Falkon: a Fast and Light-weight tasK executiON framework
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Managing data quality in a terabyte-scale sensor archive
Proceedings of the 2008 ACM symposium on Applied computing
Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Provenance and scientific workflows: challenges and opportunities
Proceedings of the 2008 ACM SIGMOD international conference on Management of data
A three tier architecture applied to LiDAR processing and monitoring
Scientific Programming - Scientific Workflows
Scientific Programming - Scientific Workflows
A novel domain oriented approach for scientific grid workflow composition
Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Provenance Provisioning in Mobile Agent-Based Distributed Job Workflow Execution
ICCS '07 Proceedings of the 7th international conference on Computational Science, Part I: ICCS 2007
Experience in using a process language to define scientific workflow and generate dataset provenance
Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering
Towards provenance-aware geographic information systems
Proceedings of the 16th ACM SIGSPATIAL international conference on Advances in geographic information systems
A Logic Programming Approach to Scientific Workflow Provenance Querying
Provenance and Annotation of Data and Processes
Oceanographic Data Provenance Tracking with the Shore Side Data System
Provenance and Annotation of Data and Processes
Workflows and e-Science: An overview of workflow system features and capabilities
Future Generation Computer Systems
Atomicity and provenance support for pipelined scientific workflows
Future Generation Computer Systems
Efficiently discovering critical workflows in scientific explorations
Future Generation Computer Systems
Optimizing user views for workflows
Proceedings of the 12th International Conference on Database Theory
The case of the fake Picasso: preventing history forgery with secure provenance
FAST '09 Proccedings of the 7th conference on File and storage technologies
A formal model of provenance in distributed systems
TAPP'09 First workshop on on Theory and practice of provenance
A novel graph based approach for automatic composition of high quality grid workflows
Proceedings of the 18th ACM international symposium on High performance distributed computing
Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
ICCS 2009 Proceedings of the 9th International Conference on Computational Science
Using Workflow Medleys to Streamline Exploratory Tasks
SSDBM 2009 Proceedings of the 21st International Conference on Scientific and Statistical Database Management
Incrementally distributed B+ trees: approaches and challenges
Proceedings of the 47th Annual Southeast Regional Conference
Intelligent dataspaces for e-science
CIMMACS'08 Proceedings of the 7th WSEAS international conference on Computational intelligence, man-machine systems and cybernetics
Hierarchical Caches for Grid Workflows
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Use of grid computing for modeling virtual geospatial products
International Journal of Geographical Information Science - Distributed Geographic Information Processing Research
Cost and accuracy sensitive dynamic workflow composition over grid environments
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
Do You Know Where Your Data's Been? --- Tamper-Evident Database Provenance
SDM '09 Proceedings of the 6th VLDB Workshop on Secure Data Management
An Access Control Language for a General Provenance Model
SDM '09 Proceedings of the 6th VLDB Workshop on Secure Data Management
Preventing history forgery with secure provenance
ACM Transactions on Storage (TOS)
Understanding provenance black boxes
Distributed and Parallel Databases
Augmenting geospatial data provenance through metadata tracking in geospatial service chaining
Computers & Geosciences
An opportunistic algorithm for scheduling workflows on grids
VECPAR'06 Proceedings of the 7th international conference on High performance computing for computational science
Data genome: an abstract model for data evolution
ISICA'07 Proceedings of the 2nd international conference on Advances in computation and intelligence
Grid computing: experiment management, tool integration, and scientific workflows
Grid computing: experiment management, tool integration, and scientific workflows
Discuss of a distributed structure in access network
IITA'09 Proceedings of the 3rd international conference on Intelligent information technology application
Research on VLAN technology in L3 switch
IITA'09 Proceedings of the 3rd international conference on Intelligent information technology application
RDFProv: A relational RDF store for querying and managing scientific workflow provenance
Data & Knowledge Engineering
Mendel: efficiently verifying the lineage of data modified in multiple trust domains
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Efficient querying of distributed provenance stores
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Versioning for workflow evolution
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
A graph model of data and workflow provenance
TAPP'10 Proceedings of the 2nd conference on Theory and practice of provenance
PinDr0p: using single-ended audio features to determine call provenance
Proceedings of the 17th ACM conference on Computer and communications security
SSDBM'10 Proceedings of the 22nd international conference on Scientific and statistical database management
Incorporating data provenance in a medical CSCW system
DEXA'10 Proceedings of the 21st international conference on Database and expert systems applications: Part I
Elastic Cloud Caches for Accelerating Service-Oriented Computations
Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
The GHS grid scheduling system: implementation and performance comparison
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
A Decentralized Self-Organizing Service Composition for Autonomic Entities
ACM Transactions on Autonomous and Adaptive Systems (TAAS)
The Foundations for Provenance on the Web
Foundations and Trends in Web Science
Middleware for managing provenance metadata
Middleware '10 Posters and Demos Track
Provenance management in Swift
Future Generation Computer Systems
Virtual workflow system for distributed collaborative scientific applications on Grids
Computers and Electrical Engineering
A run-time system for efficient execution of scientific workflows on distributed environments
International Journal of Parallel Programming
Providing flexible tradeoff for provenance tracking
WISS'10 Proceedings of the 2010 international conference on Web information systems engineering
SPHINX: a scheduling middleware for data intensive applications on a grid
International Journal of Internet Protocol Technology
Gvu: a view-oriented framework for data management in grid environments
HiPC'06 Proceedings of the 13th international conference on High Performance Computing
A domain-specific interpreter for parallelizing a large mixed-language visualisation application
LCPC'05 Proceedings of the 18th international conference on Languages and Compilers for Parallel Computing
A model-based framework for developing and deploying data aggregation services
ICSOC'06 Proceedings of the 4th international conference on Service-Oriented Computing
Putting lipstick on pig: enabling database-style workflow provenance
Proceedings of the VLDB Endowment
Virtual states and transitions, virtual sessions and collaboration
ICCS'05 Proceedings of the 5th international conference on Computational Science - Volume Part III
Introduction to an agent-based grid workflow management system
ISPA'05 Proceedings of the 2005 international conference on Parallel and Distributed Processing and Applications
Planning enhanced grid workflow management system based on agent
WAIM'05 Proceedings of the 6th international conference on Advances in Web-Age Information Management
Datagridflows: managing long-run processes on datagrids
DMG 2005 Proceedings of the First VLDB conference on Data Management in Grids
Towards a model of provenance and user views in scientific workflows
DILS'06 Proceedings of the Third international conference on Data Integration in the Life Sciences
Exploring provenance in high performance scientific computing
Proceedings of the first annual workshop on High performance computing meets databases
A dynamic co-allocation service in multicluster systems
JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing
Building and accessing grid services
ISPA'04 Proceedings of the Second international conference on Parallel and Distributed Processing and Applications
A scientific workflow framework integrated with object deputy model for data provenance
WAIM '06 Proceedings of the 7th international conference on Advances in Web-Age Information Management
On the use of semantic annotations for supporting provenance in grids
Euro-Par'06 Proceedings of the 12th international conference on Parallel Processing
Parallelism in bioinformatics workflows
VECPAR'04 Proceedings of the 6th international conference on High Performance Computing for Computational Science
A protocol for recording provenance in service-oriented grids
OPODIS'04 Proceedings of the 8th international conference on Principles of Distributed Systems
Modeling and storing scientific protocols
OTM'06 Proceedings of the 2006 international conference on On the Move to Meaningful Internet Systems: AWeSOMe, CAMS, COMINF, IS, KSinBIT, MIOS-CIAO, MONET - Volume Part I
BPEL processes matchmaking for service discovery
ODBASE'06/OTM'06 Proceedings of the 2006 Confederated international conference on On the Move to Meaningful Internet Systems: CoopIS, DOA, GADA, and ODBASE - Volume Part I
XDTM: the XML data type and mapping for specifying datasets
EGC'05 Proceedings of the 2005 European conference on Advances in Grid Computing
The design and implementation of the KOALA co-allocating grid scheduler
EGC'05 Proceedings of the 2005 European conference on Advances in Grid Computing
Managing rapidly-evolving scientific workflows
IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
Applying provenance in distributed organ transplant management
IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
Enabling provenance on large scale e-science applications
IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
Provenance collection support in the kepler scientific workflow system
IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
Applying the virtual data provenance model
IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
A provenance model for manually curated data
IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
Security issues in a SOA-Based provenance system
IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
Exploring provenance in a distributed job execution system
IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
A scheduling middleware for data intensive applications on a grid
KES'06 Proceedings of the 10th international conference on Knowledge-Based Intelligent Information and Engineering Systems - Volume Part III
DEX: Digital evidence provenance supporting reproducibility and comparison
Digital Investigation: The International Journal of Digital Forensics & Incident Response
Demonstrating a lightweight data provenance for sensor networks
Proceedings of the 2012 ACM conference on Computer and communications security
MTCProv: a practical provenance query framework for many-task scientific computing
Distributed and Parallel Databases
A pro-middleware for grids computing
ISPA'07 Proceedings of the 5th international conference on Parallel and Distributed Processing and Applications
Toward the modeling of data provenance in scientific publications
Computer Standards & Interfaces
A framework for scalable distributed provenance storage system
Computer Standards & Interfaces
Nonintrusive collection and management of data provenance in scientific workflows
Concurrency and Computation: Practice & Experience
A comprehensive model for provenance
IPAW'12 Proceedings of the 4th international conference on Provenance and Annotation of Data and Processes
A comprehensive model for provenance
ER'12 Proceedings of the 2012 international conference on Advances in Conceptual Modeling
Proceedings of the third ACM conference on Data and application security and privacy
International Journal of Systems and Service-Oriented Engineering
SPADE: support for provenance auditing in distributed environments
Proceedings of the 13th International Middleware Conference
FlowRecommender: a workflow recommendation technique for process provenance
AusDM '09 Proceedings of the Eighth Australasian Data Mining Conference - Volume 101
A system for managing data provenance in in silico experiments
ADC '11 Proceedings of the Twenty-Second Australasian Database Conference - Volume 115
Taming massive distributed datasets: data sampling using bitmap indices
Proceedings of the 22nd international symposium on High-performance parallel and distributed computing
A workflow for the prediction of the effects of residue substitution on protein stability
PRIB'13 Proceedings of the 8th IAPR international conference on Pattern Recognition in Bioinformatics
Active data: a data-centric approach to data life-cycle management
PDSW '13 Proceedings of the 8th Parallel Data Storage Workshop
A reliable scheduling method in equipment grid using provenance information
Information Systems Frontiers
Semantics and Planning Based Workflow Composition for Video Processing
Journal of Grid Computing
Implementing interoperable provenance in biomedical research
Future Generation Computer Systems
Hi-index | 0.00 |
Much scientific data is not obtained from measurements but rather derived from other data by the application of computational procedures. We hypothesize that explicit representation of these procedures can enable documentation of data provenance, discovery of available methods, and on-demand data generation (so-called "virtual data"). To explore this idea, we have developed the Chimera virtual data system, which combines a virtual data catalog, for representing data derivation procedures and derived data, with a virtual data language interpreter that translates user requests into data definition and query operations on the database. We couple the Chimera system with distributed "Data Grid" services to enable on-demand execution of computation schedules constructed from database queries. We have applied this system to two challenge problems, the reconstruction of simulated collision eventdata from a high-energy physics experiment, and the search of digital sky survey data for galactic clusters, with promising results.