Data processing, archival and dissemination pipeline for AstroSat: Challenges and strategies

The ground data processing, archival and dissemination of the science data for India’s first multi wavelength astronomical spacecraft, AstroSat is carried out from Indian Space Science Data Centre (ISSDC). The proposals submitted by users worldwide are grouped into observations and are observed in multiple orbit segments. Large volume of data in various configurations from different payloads and the inherent diversity of data products resulting from observations had demanded intricate procedures in handling the data processing, archival and dissemination scenario at ISSDC. The paper describes the layered approach followed in implementing a software stack for establishing and operating a completely automated pipeline for data processing, archival and dissemination of astronomical data. The operations of the automated pipeline, challenges faced during the implementation and the strategies adapted to overcome them are also summarized.