Analyzing Living Surveys: Visualization Beyond the Data Release

Buddelmeijer, H., Noorishad, P., Williams, D., Ivanova, M., Roerdink, J. B. T. M. & Valentijn, E. A., 1-Sep-2015, Astronomical Data Analysis Software and Systems XXIV (ADASS XXIV): Proceedings of a conference held 5-9 October 2014 at Calgary. Taylor, A. R. & Rosolowski, E. (eds.). San Francisco: Astronomical Society of the Pacific, p. 149-152 (Astronomical Society of the Pacific conference series; vol. 495).

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Surveys need to provide more than periodic data releases. Science often requires data that is not captured in such releases. This mismatch between the constraints set by a fixed data release and the needs of the scientists is solved in the Astro-WISE information system by extending its request-driven data handling into the analysis domain. This leads to Query-Driven Visualization, where all data handling is automated and scalable by exploiting the strengths of data pulling. Astro-WISE is data-centric: new data creates itself automatically, if no suitable existing data can be found to fulfill a request. This approach allows scientists to visualize exactly the data they need, without any manual data management, freeing their time for research. The benefits of query-driven visualization are highlighted by searching for distant quasars in KiDS, a 1500 square degree optical survey. KiDS needs to be treated as a living survey to minimize the time between observation and (spectral) followup. The first window of opportunity would be missed if it were necessary to wait for data releases. The results from the default processing pipelines are used for a quick and broad selection of quasar candidates. More precise measurements of source properties can subsequently be requested to downsize the candidate set, requiring partial reprocessing of the images. Finally, the raw and reduced pixels themselves are inspected by eye to rank the final candidate list. The quality of the resulting candidate list and the speed of its creation were only achievable due to query driven-visualization of the living archive.
Original languageEnglish
Title of host publicationAstronomical Data Analysis Software and Systems XXIV (ADASS XXIV)
Subtitle of host publicationProceedings of a conference held 5-9 October 2014 at Calgary
EditorsA.R. Taylor, E. Rosolowski
Place of PublicationSan Francisco
PublisherAstronomical Society of the Pacific
Publication statusPublished - 1-Sep-2015
EventAstronomical Data Analysis Software an Systems XXIV - Calgary, Canada
Duration: 5-Oct-20149-Oct-2014

Publication series

NameAstronomical Society of the Pacific conference series
ISSN (Print)050-3390


ConferenceAstronomical Data Analysis Software an Systems XXIV


Astronomical Data Analysis Software an Systems XXIV


Calgary, Canada

Event: Conference

ID: 23952421