Computing location-based lineage from workflow specifications to optimize provenance queries
- Saumen Dey(corresponding author),
- Sven Köhler,
- ,
- Bertram Ludäscher
- University of California,
Open access
Abstract
We present a location-based approach for executing provenance lineage queries that significantly reduces query execution cost without incurring additional storage costs. The key idea of our approach is to exploit the fact that provenance graphs resemble the workflow graphs that generated them and that many workflow computation models assume workflow steps have statically defined data consumptionproduction (i.e., data input-output) rates. We describe a new lineage computation technique that uses the structure of workflow specifications together with consumption-production rates to pre-compute (i.e., to forecast) the access paths of all dependent data items prior to workflow execution. We also present experimental results showing that our approach can significantly out perform traditional data lineage query techniques.
Access to documents
Bibliographic Information
Output type
Original language
EnglishPages from-to (Number of pages)
Pages 180-193 (14 pages)Publication milestones
- Published - 2015
Publication status
Publisher
Springer VerlagPublication series
- Publication series name: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN (Print): 0302-9743
ISSN (Electronic): 1611-3349
Volume: 8628
ISBN (Electronic)
9783319164618Publication IDs
- Scopus: 84928798542
Host publication title
Provenance and Annotation of Data and Processes - 5th International Provenance and Annotation Workshop, IPAW 2014, Revised Selected PapersHost publication editors
- Beth Plale
- Bertram Ludäscher
- Bertram Ludäscher
