pith. machine review for the scientific record. sign in

arxiv: 1410.3481 · v1 · submitted 2014-10-13 · 🌌 astro-ph.IM · cs.DL

Recognition: unknown

Data engineering for archive evolution

Authors on Pith no claims yet
classification 🌌 astro-ph.IM cs.DL
keywords dataastronomicalengineeringevenmetadatastandardsarchivalarchive
0
0 comments X
read the original abstract

From the moment astronomical observations are made the resulting data products begin to grow stale. Even if perfect binary copies are preserved through repeated timely migration to more robust storage media, data standards evolve and new tools are created that require different kinds of data or metadata. The expectations of the astronomical community change even if the data do not. We discuss data engineering to mitigate the ensuing risks with examples from a recent project to refactor seven million archival images to new standards of nomenclature, metadata, format, and compression.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.