Publication

Tracing and using data lineage for pipeline processing in Astro-WISE

Mwebaze, J., Boxhoorn, D. & Valentijn, E. A., Jan-2013, In : Experimental Astronomy. 35, 1-2, p. 131-155 25 p.

Research output: Contribution to journalArticleAcademicpeer-review

APA

Mwebaze, J., Boxhoorn, D., & Valentijn, E. A. (2013). Tracing and using data lineage for pipeline processing in Astro-WISE. Experimental Astronomy, 35(1-2), 131-155. https://doi.org/10.1007/s10686-011-9276-8

Author

Mwebaze, Johnson ; Boxhoorn, Danny ; Valentijn, Edwin A. / Tracing and using data lineage for pipeline processing in Astro-WISE. In: Experimental Astronomy. 2013 ; Vol. 35, No. 1-2. pp. 131-155.

Harvard

Mwebaze, J, Boxhoorn, D & Valentijn, EA 2013, 'Tracing and using data lineage for pipeline processing in Astro-WISE', Experimental Astronomy, vol. 35, no. 1-2, pp. 131-155. https://doi.org/10.1007/s10686-011-9276-8

Standard

Tracing and using data lineage for pipeline processing in Astro-WISE. / Mwebaze, Johnson; Boxhoorn, Danny; Valentijn, Edwin A.

In: Experimental Astronomy, Vol. 35, No. 1-2, 01.2013, p. 131-155.

Research output: Contribution to journalArticleAcademicpeer-review

Vancouver

Mwebaze J, Boxhoorn D, Valentijn EA. Tracing and using data lineage for pipeline processing in Astro-WISE. Experimental Astronomy. 2013 Jan;35(1-2):131-155. https://doi.org/10.1007/s10686-011-9276-8


BibTeX

@article{b3e23d87aff84f14b5714f224a327e26,
title = "Tracing and using data lineage for pipeline processing in Astro-WISE",
abstract = "Most workflow systems that support data provenance primarily focus on tracing lineage of data. Data provenance by data lineage provides the derivation history of data including information about services and input data that contributed to the creation of a data product. We show that tracing lineage by means of full backward chaining not only enables users to share, discover and reuse the data, but also supports scientific data processing through storage, retrieval and (re)processing of digitized scientific data. In this paper, we present Astro-WISE, a distributed system for processing, analyzing and disseminating wide field imaging astronomical data. We show how Astro-WISE traces lineage of data and how it facilitates data processing, retrieval, storage and archiving. Particularly we show how it solves issues related to the changing data items typical for the scientific environment, such as physical changes in calibrations, our insight in these changes and improved methods for deriving results.",
keywords = "Data lineage, Provenance, Pipeline data processing, Astro-WISE, PROVENANCE",
author = "Johnson Mwebaze and Danny Boxhoorn and Valentijn, {Edwin A.}",
year = "2013",
month = "1",
doi = "10.1007/s10686-011-9276-8",
language = "English",
volume = "35",
pages = "131--155",
journal = "Experimental Astronomy",
issn = "0922-6435",
number = "1-2",

}

RIS

TY - JOUR

T1 - Tracing and using data lineage for pipeline processing in Astro-WISE

AU - Mwebaze, Johnson

AU - Boxhoorn, Danny

AU - Valentijn, Edwin A.

PY - 2013/1

Y1 - 2013/1

N2 - Most workflow systems that support data provenance primarily focus on tracing lineage of data. Data provenance by data lineage provides the derivation history of data including information about services and input data that contributed to the creation of a data product. We show that tracing lineage by means of full backward chaining not only enables users to share, discover and reuse the data, but also supports scientific data processing through storage, retrieval and (re)processing of digitized scientific data. In this paper, we present Astro-WISE, a distributed system for processing, analyzing and disseminating wide field imaging astronomical data. We show how Astro-WISE traces lineage of data and how it facilitates data processing, retrieval, storage and archiving. Particularly we show how it solves issues related to the changing data items typical for the scientific environment, such as physical changes in calibrations, our insight in these changes and improved methods for deriving results.

AB - Most workflow systems that support data provenance primarily focus on tracing lineage of data. Data provenance by data lineage provides the derivation history of data including information about services and input data that contributed to the creation of a data product. We show that tracing lineage by means of full backward chaining not only enables users to share, discover and reuse the data, but also supports scientific data processing through storage, retrieval and (re)processing of digitized scientific data. In this paper, we present Astro-WISE, a distributed system for processing, analyzing and disseminating wide field imaging astronomical data. We show how Astro-WISE traces lineage of data and how it facilitates data processing, retrieval, storage and archiving. Particularly we show how it solves issues related to the changing data items typical for the scientific environment, such as physical changes in calibrations, our insight in these changes and improved methods for deriving results.

KW - Data lineage

KW - Provenance

KW - Pipeline data processing

KW - Astro-WISE

KW - PROVENANCE

U2 - 10.1007/s10686-011-9276-8

DO - 10.1007/s10686-011-9276-8

M3 - Article

VL - 35

SP - 131

EP - 155

JO - Experimental Astronomy

JF - Experimental Astronomy

SN - 0922-6435

IS - 1-2

ER -

ID: 5784552