Astro-WISE: Tracing and Using Lineage for Scientific Data ProcessingMwebaze, J., Boxhoorn, D. & Valentijn, E., 2009, Proceedings of the 2009 International Conference on Network-Based Information Systems. NEW YORK: IEEE (The Institute of Electrical and Electronics Engineers), p. 475-480 6 p.
Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review
Most workflow systems that support data provenance primarily focus on tracing lineage of data. Data provenance by data lineage provides the derivation history of data including information about services and input data that contributed to the creation of a data product. We show that tracing lineage by means of full backward chaining not only enables users to share, discover and reuse the data, but also supports scientific data processing through storage, retrieval and (re)processing of digitized scientific data. In this paper, we present Astro-WISE, a distributed system for processing, analyzing and disseminating wide field imaging astronomical data. We show how Astro-WISE traces lineage of data and how it facilitates data processing, retrieval, storage, archiving. Particularly we show how it solves issues related to the changing data items typical for the scientific environment, such as physical changes in calibrations, our insight in these changes and improved methods for deriving results.
|Title of host publication||Proceedings of the 2009 International Conference on Network-Based Information Systems|
|Place of Publication||NEW YORK|
|Publisher||IEEE (The Institute of Electrical and Electronics Engineers)|
|Number of pages||6|
|Publication status||Published - 2009|
|Event||12th International Conference on Network Based Information Systems - , Indonesia|
Duration: 19-Aug-2009 → 21-Aug-2009
|Other||12th International Conference on Network Based Information Systems|
|Period||19/08/2009 → 21/08/2009|
12th International Conference on Network Based Information Systems
19/08/2009 → 21/08/2009Indonesia
- data lineage, persistence, provenance, target processing, dependencies, PROVENANCE