Assessing the quality of the Sentinel-5p TROPOMI cloud products and their reprocessing using ground-based Cloudnet data

<p>The retrieval of atmospheric composition from space-based measurements, by e.g., Sentinel-5p TROPOMI, is strongly affected by radiative interferences with clouds. Dedicated cloud data products, typically retrieved from measurements by the same sounder, are therefore essential. Cloud information is used to filter data and as input to the modelling of atmospheric radiative transfer and the conversion of slant column densities into vertical column densities.</p> <p>The three main TROPOMI cloud retrieval algorithms are: (i) L2_CLOUD OCRA/ROCINN CAL (Optical Cloud Recognition Algorithm/Retrieval of Cloud Information using Neural Networks; Clouds-As-Layers), (ii) L2_CLOUD OCRA/ROCINN CRB (Clouds-as Reflecting Boundaries), and (iii) the S5P support product FRESCO-S (Fast Retrieval Scheme for Clouds from Oxygen absorption bands for Sentinel). The cloud variables provided by these products (radiometric cloud fraction, cloud (top) height, and cloud albedo/cloud optical thickness) are subsequently used in the retrieval of the TROPOMI trace gas products. The quality of cloud products and trace gas products is routinely assessed by the ESA/Copernicus Atmospheric Mission Performance Cluster (ATM-MPC) validation service, with ad hoc support from Sentinel-5p Validation Team (S5PVT) AO projects.</p> <p>Version upgrades have had a significant impact on the characteristics of S5P cloud data. The change of the wavelength window in the FRESCO product since version 1.4 (&#8216;FRESCO-wide&#8217;) leads to a clear increase in the height of low clouds with a large impact on the tropospheric NO₂ retrieval (van Geffen, 2022), and improving the validation results regarding the tropospheric and total NO₂ column. The first upgrades of the ROCINN products (from v1 to v2.1-v2.3) led to an increase in correlation with CLOUDNET cloud height, but to a more negative bias for the low clouds, with ROCINN CRB cloud height even dropping below the CLOUDNET cloud base height on average. However, this effect seems alleviated with the latest upgrade to v2.4. The impact on the HCHO validation results is investigated but is less clear compared to the NO₂ case.</p> <p>To resolve the discontinuities due to the processor version jumps, a full mission reprocessing is currently ongoing and largely carried out for the L2_CLOUD and FRESCO-S products. The reprocessed ROCINN data have a lower dispersion and higher correlation with respect to the CLOUDNET cloud heights. The bias of the L2_CLOUD OCRA/ROCINN CAL CTH becomes more negative, but that of L2_CLOUD OCRA/ROCINN CRB CH bias improves. Finally, we also discuss the impact of the FRESCO-S reprocessing on the validation results.</p>