Publication

Astro-WISE: Tracing and Using Lineage for Scientific Data Processing

Mwebaze, J., Boxhoorn, D. & Valentijn, E., 2009, Proceedings of the 2009 International Conference on Network-Based Information Systems. NEW YORK: IEEE (The Institute of Electrical and Electronics Engineers), p. 475-480 6 p.

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Most workflow systems that support data provenance primarily focus on tracing lineage of data. Data provenance by data lineage provides the derivation history of data including information about services and input data that contributed to the creation of a data product. We show that tracing lineage by means of full backward chaining not only enables users to share, discover and reuse the data, but also supports scientific data processing through storage, retrieval and (re)processing of digitized scientific data. In this paper, we present Astro-WISE, a distributed system for processing, analyzing and disseminating wide field imaging astronomical data. We show how Astro-WISE traces lineage of data and how it facilitates data processing, retrieval, storage, archiving. Particularly we show how it solves issues related to the changing data items typical for the scientific environment, such as physical changes in calibrations, our insight in these changes and improved methods for deriving results.

Original languageEnglish
Title of host publicationProceedings of the 2009 International Conference on Network-Based Information Systems
Place of PublicationNEW YORK
PublisherIEEE (The Institute of Electrical and Electronics Engineers)
Pages475-480
Number of pages6
ISBN (Print)978-1-4244-4746-6
Publication statusPublished - 2009
Event12th International Conference on Network Based Information Systems - , Indonesia
Duration: 19-Aug-200921-Aug-2009

Other

Other12th International Conference on Network Based Information Systems
CountryIndonesia
Period19/08/200921/08/2009

Event

12th International Conference on Network Based Information Systems

19/08/200921/08/2009

Indonesia

Event: Other

    Keywords

  • data lineage, persistence, provenance, target processing, dependencies, PROVENANCE

ID: 5080057