Skip to ContentSkip to Navigation
About usNews and EventsNews articles

Extreme data lineage in ad-hoc astronomical data processing

30 November 2012

PhD ceremony: Mr. J. Mwebaze, 16.15 uur, Academiegebouw, Broerstraat 5, Groningen

Dissertation: Extreme data lineage in ad-hoc astronomical data processing

Promotor(s): prof. E.A. Valentijn

Faculty: Mathematics and Natural Sciences

This research addresses the problems encountered in tracing and using lineage of data, pixels and code with ad hoc astronomical data processing. We describe a data model for ad hoc-based data processing and provide methods for tracing, querying and viewing its lineage. We show that data, pixel and code lineage can be used to facilitate efficient processing through incremental re-computation, as well as semi-automatic modification of processing steps, and sub-image processing.

We describe an implementation of these techniques in an all-in-one system, Astro-WISE, that allows a scientist to archive raw data, calibrate data, perform post-calibration scientific analysis and archive all results in one environment. Astro-WISE combines the use of data, pixel and code lineage to support multiple surveys with a novel way to process wide-field astronomical data in a distributed environment.

We present an example to demonstrate Astro-WISE's efficiency in searching for rare astronomical objects: we discover several of the most distant quasars in the Universe.

Last modified:15 September 2017 3.42 p.m.

More news

  • 08 June 2018

    House prices in earthquake area fall on average by 9.3%

    The price of homes in the Groningen earthquake area fell by an average of 9.3% until 2015. This is the conclusion of PhD student Nicolás Durán and Professor of Spatial Econometrics Paul Elhorst from the University of Groningen. They analysed data from...

  • 08 June 2018

    Feringa honoured with bronze bust and book

    Feringa gilded with bronze bust and book

  • 06 June 2018

    UG in 120th place in the QS rankings

    This year, the University of Groningen (UG) holds 120th place in the QS World University Rankings for 2019. For the past two years, the UG has been in 113th place on this list of almost 1,000 universities worldwide. On a national scale, the UG has...