Publication

Astro-WISE: Chaining to the Universe

Valentijn, E. A., Mc Farland, J., Snigula, J., Begeman, K. G., Boxhoorn, D. R., Rengelink, R., Helmich, E., Heraudeau, P., Verdoes Kleijn, G., Vermeij, R., Vriend, W-J., Tempelaar, M. J., Deul, E., Kuijken, K., Capaccioli, M., Silvotti, R., Bender, R., Neeser, M., Saglia, R., Bertin, E. & Mellier, Y., 1-Oct-2007, Astronomical Data Analysis Software and Systems XVI ASP Conference Series. Shaw, R. A., Hill, F. & Bell, D. J. (eds.). San Francisco, Vol. 376. p. 491

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

The recent explosion of recorded digital data and its processed derivatives threatens to overwhelm researchers when analysing their experimental data or looking up data items in archives and file systems. While current hardware developments allow the acquisition, processing and storage of hundreds of terabytes of data at the cost of a modern sports car, the software systems to handle these data are lagging behind. This problem is very general and is well recognized by various scientific communities; several large projects have been initiated, e.g., DATAGRID/EGEE {http://www.eu-egee.org/} federates compute and storage power over the high-energy physical community, while the international astronomical community is building an Internet geared Virtual Observatory {http://www.euro-vo.org/pub/} (Padovani 2006) connecting archival data. These large projects either focus on a specific distribution aspect or aim to connect many sub-communities and have a relatively long trajectory for setting standards and a common layer. Here, we report first light of a very different solution (Valentijn & Kuijken 2004) to the problem initiated by a smaller astronomical IT community. It provides an abstract scientific information layer which integrates distributed scientific analysis with distributed processing and federated archiving and publishing. By designing new abstractions and mixing in old ones, a Science Information System with fully scalable cornerstones has been achieved, transforming data systems into knowledge systems. This break-through is facilitated by the full end-to-end linking of all dependent data items, which allows full backward chaining from the observer/researcher to the experiment. Key is the notion that information is intrinsic in nature and thus is the data acquired by a scientific experiment. The new abstraction is that software systems guide the user to that intrinsic information by forcing full backward and forward chaining in the data modelling.
Original languageEnglish
Title of host publicationAstronomical Data Analysis Software and Systems XVI ASP Conference Series
EditorsR. A. Shaw, F. Hill, D. J. Bell
Place of PublicationSan Francisco
Pages491
Volume376
Publication statusPublished - 1-Oct-2007
Event Astronomical Data Analysis Software and Systems XVI ASP - Tuscon, Arizona, United States
Duration: 15-Oct-200618-Oct-2006

Conference

Conference Astronomical Data Analysis Software and Systems XVI ASP
CountryUnited States
CityTuscon, Arizona
Period15/10/200618/10/2006

Event

Astronomical Data Analysis Software and Systems XVI ASP

15/10/200618/10/2006

Tuscon, Arizona, United States

Event: Conference

ID: 17594356