The Design Strategy of Scientific Data Quality Control Software for Euclid Mission

Show simple item record Brescia, Massimo Cavuoti, Stefano Fredvik, Terje Haugan, Stein Vidar Hagfors Gozaliasl, Ghassem Kirkpatrick, Charles Kurki-Suonio, Hannu Longo, Giuseppe Nilsson, Kari Wiesmann, Martin
dc.contributor.editor Molinaro, M
dc.contributor.editor Shortridge, K
dc.contributor.editor Pasian, F 2019-11-28T09:51:01Z 2019-11-28T09:51:01Z 2019
dc.identifier.citation Brescia , M , Cavuoti , S , Fredvik , T , Haugan , S V H , Gozaliasl , G , Kirkpatrick , C , Kurki-Suonio , H , Longo , G , Nilsson , K & Wiesmann , M 2019 , The Design Strategy of Scientific Data Quality Control Software for Euclid Mission . in M Molinaro , K Shortridge & F Pasian (eds) , ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XXVI . Astronomical Society of the Pacific Conference Series , vol. 521 , Astronomical Society of the Pacific , San Francisco; USA , pp. 228-231 , Annual Conference for Astronomical Data Analysis Software and Systems (ADASS XXVI) , Trieste , Italy , 16/10/2016 .
dc.identifier.citation conference
dc.identifier.other PURE: 128447961
dc.identifier.other PURE UUID: 5378ca27-b9d5-45ff-ba2d-99efcda8a921
dc.identifier.other WOS: 000495812900054
dc.identifier.other ORCID: /0000-0002-4618-3063/work/65307875
dc.description.abstract The most valuable asset of a space mission like Euclid are the data. Due to their huge volume, the automatic quality control becomes a crucial aspect over the entire lifetime of the experiment. Here we focus on the design strategy for the Science Ground Segment (SGS) Data Quality Common Tools (DQCT), which has the main role to provide software solutions to gather, evaluate, and record quality information about the raw and derived data products from a primarily scientific perspective. The stake-holders for this system include Consortium scientists, users of the science data, and the ground segment data management system itself. The SGS DQCT will provide a quantitative basis for evaluating the application of reduction and calibration reference data (flat-fields, linearity correction, reference catalogs, etc.), as well as diagnostic tools for quality parameters, flags, trend analysis diagrams and any other metadata parameter produced by the pipeline, collected in incremental quality reports specific to each data level and stored on the Euclid Archive during pipeline processing. In a large programme like Euclid, it is prohibitively expensive to process large amount of data at the pixel level just for the purpose of quality evaluation. Thus, all measures of quality at the pixel level are implemented in the individual pipeline stages, and passed along as metadata in the production. In this sense most of the tasks related to science data quality are delegated to the pipeline stages, even though the responsibility for science data quality is managed at a higher level. The DQCT subsystem of the SGS is currently under development, but its path to full realization will likely be different than that of other subsystem; primarily because, due to a high level of parallelism and to the wide pipeline processing redundancy (for instance the mechanism of double Science Data Center for each processing function) the data quality tools have not only to be widely spread over all pipeline segments and data levels, but also to minimize the occurrences of potential diversity of solutions implemented for similar functions, ensuring the maximum of coherency and standardization for quality evaluation and reporting in the SGS. en
dc.format.extent 4
dc.language.iso eng
dc.publisher Astronomical Society of the Pacific
dc.relation.ispartofseries Astronomical Society of the Pacific Conference Series
dc.relation.isversionof 978-1-58381-929-6
dc.rights unspecified
dc.rights.uri info:eu-repo/semantics/openAccess
dc.subject 115 Astronomy, Space science
dc.title The Design Strategy of Scientific Data Quality Control Software for Euclid Mission en
dc.type Conference contribution
dc.contributor.organization Department of Physics
dc.contributor.organization Helsinki Institute of Physics
dc.contributor.organization Particle Physics and Astrophysics
dc.description.reviewstatus Peer reviewed
dc.relation.issn 1050-3390
dc.rights.accesslevel openAccess
dc.type.version publishedVersion

Files in this item

Total number of downloads: Loading...

Files Size Format View
521_0228.pdf 938.8Kb PDF View/Open

This item appears in the following Collection(s)

Show simple item record