ALBERT

Description: Accurate determination of thermodynamic cloud phase is critical for establishing the radiative impact of clouds on climate and weather. Depolarization of the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) 532 nm signal provides a useful addition to other methods of thermodynamic phase discrimination that rely on temperature, cloud top altitude or a temperature-based cloud phase climatology. Active detection of the thermodynamic phase of multiple cloud layers in a vertical column using cloud layer-integrated depolarization and backscatter also alleviates ambiguities in cloud phase determination by passive radiometers. The CALIOP phase algorithm primarily uses vertically integrated cloud layer depolarization and attenuated backscatter to determine the dominant thermodynamic phase of hydrometeors present in a cloud layer segment, at horizontal resolutions for cloud layer detection varying between 333 m and 80 km, with cloud layer vertical resolutions between 60 m and 8 km. CALIOP ice cloud backscatter observations taken with a 0.3∘ near-nadir view between June 2006 and November 2007 include a significant amount of specular reflection from hexagonal smooth crystal faces that are oriented perpendicularly to the incident lidar beam (horizontally oriented ice – HOI). These specular reflections from HOI are shown here to occur between 0 and −40 ∘C, with a peak in the CALIOP distribution observed globally at −15 ∘C. Recent viewing angle testing occurring during 2017 at 1, 1.5 and 2∘ and reported here quantifies the impact of changing the viewing angle on these specular reflections and verifies earlier observations by POLDER. These viewing angle tests show that at the −15 ∘C peak of the HOI distribution the mean backscatter from all ice clouds decreases by 50 % and depolarization increases by a factor of 5 as the viewing angle increases from 0.3 to 3∘. To avoid these specular reflections, the CALIOP viewing angle was changed from 0.3 to 3∘ in November 2007, and since then CALIOP has been observing clouds almost continuously for 12–13 more years. This has provided more data for a thorough re-evaluation of phase determination and has motivated changes to the CALIOP cloud phase algorithm for Version 4 (V4). The V4 algorithm now excludes over-identification of HOI at 3∘, particularly in cold clouds. The V4 algorithm also considers cloud layer temperature at the 532 nm centroid and has been streamlined for more consistent identification of water and ice clouds. In V4 some cloud layer boundaries have changed because 532 nm layer-integrated attenuated backscatter in V4 has increased due to improved calibration and extended layer boundaries, while the corresponding depolarization has stayed about the same. There are more V4 cloud layers detected and, combined with increasing cloud edges, the V4 total atmospheric cloud volume increases by 6 %–9 % over V3 for high-confidence cloud phases and by 1 %–2 % for all cloudy bins. Collocated CALIPSO Imaging Infrared Radiometer (IIR) observations of ice and water cloud particle microphysical indices complement the CALIOP ice and water cloud phase determinations.

Description: The CALIPSO (Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations) level 3 aerosol profile product reports globally gridded, quality-screened, monthly mean aerosol extinction profiles retrieved by CALIOP (the Cloud-Aerosol Lidar with Orthogonal Polarization). This paper describes the quality screening and averaging methods used to generate the version 3 product. The fundamental input data are CALIOP level 2 aerosol extinction profiles and layer classification information (aerosol, cloud, and clear-air). Prior to aggregation, the extinction profiles are quality-screened by a series of filters to reduce the impact of layer detection errors, layer classification errors, extinction retrieval errors, and biases due to an intermittent signal anomaly at the surface. The relative influence of these filters are compared in terms of sample rejection frequency, mean extinction, and mean aerosol optical depth (AOD). The “extinction QC flag” filter is the most influential in preventing high-biases in level 3 mean extinction, while the “misclassified cirrus fringe” filter is most aggressive at rejecting cirrus misclassified as aerosol. The impact of quality screening on monthly mean aerosol extinction is investigated globally and regionally. After applying quality filters, the level 3 algorithm calculates monthly mean AOD by vertically integrating the monthly mean quality-screened aerosol extinction profile. Calculating monthly mean AOD by integrating the monthly mean extinction profile prevents a low bias that would result from alternately integrating the set of extinction profiles first and then averaging the resultant AOD values together. Ultimately, the quality filters reduce level 3 mean AOD by −24 and −31 % for global ocean and global land, respectively, indicating the importance of quality screening.

Description: This study applies fuzzy k-means (FKM) cluster analyses to a subset of the parameters reported in the CALIPSO lidar level 2 data products in order to classify the layers detected as either clouds or aerosols. The results obtained are used to assess the reliability of the cloud–aerosol discrimination (CAD) scores reported in the version 4.1 release of the CALIPSO data products. FKM is an unsupervised learning algorithm, whereas the CALIPSO operational CAD algorithm (COCA) takes a highly supervised approach. Despite these substantial computational and architectural differences, our statistical analyses show that the FKM classifications agree with the COCA classifications for more than 94 % of the cases in the troposphere. This high degree of similarity is achieved because the lidar-measured signatures of the majority of the clouds and the aerosols are naturally distinct, and hence objective methods can independently and effectively separate the two classes in most cases. Classification differences most often occur in complex scenes (e.g., evaporating water cloud filaments embedded in dense aerosol) or when observing diffuse features that occur only intermittently (e.g., volcanic ash in the tropical tropopause layer). The two methods examined in this study establish overall classification correctness boundaries due to their differing algorithm uncertainties. In addition to comparing the outputs from the two algorithms, analysis of sampling, data training, performance measurements, fuzzy linear discriminants, defuzzification, error propagation, and key parameters in feature type discrimination with the FKM method are further discussed in order to better understand the utility and limits of the application of clustering algorithms to space lidar measurements. In general, we find that both FKM and COCA classification uncertainties are only minimally affected by noise in the CALIPSO measurements, though both algorithms can be challenged by especially complex scenes containing mixtures of discrete layer types. Our analysis results show that attenuated backscatter and color ratio are the driving factors that separate water clouds from aerosols; backscatter intensity, depolarization, and mid-layer altitude are most useful in discriminating between aerosols and ice clouds; and the joint distribution of backscatter intensity and depolarization ratio is critically important for distinguishing ice clouds from water clouds.

Description: The Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) version 4.10 (V4) level 2 aerosol data products, released in November 2016, include substantial improvements to the aerosol subtyping and lidar ratio selection algorithms. These improvements are described along with resulting changes in aerosol optical depth (AOD). The most fundamental change in the V4 level 2 aerosol products is a new algorithm to identify aerosol subtypes in the stratosphere. Four aerosol subtypes are introduced for stratospheric aerosols: polar stratospheric aerosol (PSA), volcanic ash, sulfate/other, and smoke. The tropospheric aerosol subtyping algorithm was also improved by adding the following enhancements: (1) all aerosol subtypes are now allowed over polar regions, whereas the version 3 (V3) algorithm allowed only clean continental and polluted continental aerosols; (2) a new “dusty marine” aerosol subtype is introduced, representing mixtures of dust and marine aerosols near the ocean surface; and (3) the “polluted continental” and “smoke” subtypes have been renamed “polluted continental/smoke” and “elevated smoke”, respectively. V4 also revises the lidar ratios for clean marine, dust, clean continental, and elevated smoke subtypes. As a consequence of the V4 updates, the mean 532 nm AOD retrieved by CALIOP has increased by 0.044 (0.036) or 52 % (40 %) for nighttime (daytime). Lidar ratio revisions are the most influential factor for AOD changes from V3 to V4, especially for cloud-free skies. Preliminary validation studies show that the AOD discrepancies between CALIOP and AERONET–MODIS (ocean) are reduced in V4 compared to V3.

Description: Data products from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) on board Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) were recently updated following the implementation of new (version 4) calibration algorithms for all of the Level 1 attenuated backscatter measurements. In this work we present the motivation for and the implementation of the version 4 nighttime 532 nm parallel channel calibration. The nighttime 532 nm calibration is the most fundamental calibration of CALIOP data, since all of CALIOP's other radiometric calibration procedures – i.e., the 532 nm daytime calibration and the 1064 nm calibrations during both nighttime and daytime – depend either directly or indirectly on the 532 nm nighttime calibration. The accuracy of the 532 nm nighttime calibration has been significantly improved by raising the molecular normalization altitude from 30–34 km to the upper possible signal acquisition range of 36–39 km to substantially reduce stratospheric aerosol contamination. Due to the greatly reduced molecular number density and consequently reduced signal-to-noise ratio (SNR) at these higher altitudes, the signal is now averaged over a larger number of samples using data from multiple adjacent granules. Additionally, an enhanced strategy for filtering the radiation-induced noise from high-energy particles was adopted. Further, the meteorological model used in the earlier versions has been replaced by the improved Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), model. An aerosol scattering ratio of 1.01±0.01 is now explicitly used for the calibration altitude. These modifications lead to globally revised calibration coefficients which are, on average, 2–3 % lower than in previous data releases. Further, the new calibration procedure is shown to eliminate biases at high altitudes that were present in earlier versions and consequently leads to an improved representation of stratospheric aerosols. Validation results using airborne lidar measurements are also presented. Biases relative to collocated measurements acquired by the Langley Research Center (LaRC) airborne High Spectral Resolution Lidar (HSRL) are reduced from 3.6 %±2.2 % in the version 3 data set to 1.6 %±2.4 % in the version 4 release.

Description: According to climate model simulations, the changing altitude of middle and high clouds is the dominant contributor to the positive global mean longwave cloud feedback. Nevertheless, the mechanisms of this longwave cloud altitude feedback and its magnitude have not yet been verified by observations. Accurate, stable, and long-term observations of a metric-characterizing cloud vertical distribution that are related to the longwave cloud radiative effect are needed to achieve a better understanding of the mechanism of longwave cloud altitude feedback. This study shows that the direct measurement of the altitude of atmospheric lidar opacity is a good candidate for the necessary observational metric. The opacity altitude is the level at which a spaceborne lidar beam is fully attenuated when probing an opaque cloud. By combining this altitude with the direct lidar measurement of the cloud-top altitude, we derive the effective radiative temperature of opaque clouds which linearly drives (as we will show) the outgoing longwave radiation. We find that, for an opaque cloud, a cloud temperature change of 1 K modifies its cloud radiative effect by 2 W m−2. Similarly, the longwave cloud radiative effect of optically thin clouds can be derived from their top and base altitudes and an estimate of their emissivity. We show with radiative transfer simulations that these relationships hold true at single atmospheric column scale, on the scale of the Clouds and the Earth's Radiant Energy System (CERES) instantaneous footprint, and at monthly mean 2° × 2° scale. Opaque clouds cover 35 % of the ice-free ocean and contribute to 73 % of the global mean cloud radiative effect. Thin-cloud coverage is 36 % and contributes 27 % of the global mean cloud radiative effect. The link between outgoing longwave radiation and the altitude at which a spaceborne lidar beam is fully attenuated provides a simple formulation of the cloud radiative effect in the longwave domain and so helps us to understand the longwave cloud altitude feedback mechanism.

Description: The Cloud Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) mission released version 4.00 of their lidar level 1 data set in April of 2014, and subsequently updated this to version 4.10 in November of 2016. The primary difference in the newly released version 4 (V4) data is a suite of updated calibration coefficients calculated using substantially revised calibration algorithms. This paper describes the revisions to the V4 daytime calibration procedure for the 532 nm parallel channel. As in earlier releases, the V4 daytime calibration coefficients are derived by scaling the raw daytime signals to the calibrated nighttime signals acquired within a calibration transfer region, and thus the new V4 daytime calibration benefits from improvements made to the V4 532 nm nighttime calibration. The V4 calibration transfer region has been moved upward from the upper troposphere to the more stable lower stratosphere. The identification of clear-air columns by an iterative thresholding scheme, crucial to selecting the observation regions used for calibration, now uses uncalibrated 1064 nm data rather than recursively using the calibrated 532 nm data, as was done in version 3 (V3). A detailed account of the rationale and methodology for this new calibration approach is provided, along with results demonstrating the improvement of this calibration over the previous version. Extensive validation data acquired by NASA's airborne high spectral resolution lidar (HSRL) shows that during the daytime the average difference between collocated CALIPSO and HSRL measurements of 532 nm attenuated backscatter coefficients is reduced from 3.3 %±3.1 % in V3 to 1.0 %±3.5 % in V4.

Description: The Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Operations (CALIPSO) mission released version 4.1 (V4) of their lidar level 2 cloud and aerosol data products in November 2016. These new products were derived from the CALIPSO V4 lidar level 1 data, in which the calibration of the measured backscatter data at both 532 and 1064 nm was significantly improved. This paper describes updates to the V4 level 2 cloud–aerosol discrimination (CAD) algorithm that more accurately differentiate between clouds and aerosols throughout the Earth's atmosphere. The level 2 data products are improved with new CAD probability density functions (PDFs) that were developed to accommodate extensive calibration changes in the level 1 data. To enable more reliable identification of aerosol layers lofted into the upper troposphere and lower stratosphere, the CAD training dataset used in the earlier data releases was expanded to include stratospheric layers and representative examples of volcanic aerosol layers. The generic “stratospheric layer” classification reported in previous versions has been eliminated in V4, and cloud–aerosol classification is now performed on all layers detected everywhere from the surface to 30 km. Cloud–aerosol classification has been further extended to layers detected at single-shot resolution, which were previously classified by default as clouds. In this paper, we describe the underlying rationale used in constructing the V4 PDFs and assess the performance of the V4 CAD algorithm in the troposphere and stratosphere. Previous misclassifications of lofted dust and smoke in the troposphere have been largely improved, and volcanic aerosol layers and aerosol layers in the stratosphere are now being properly classified. CAD performance for single-shot layer detections is also evaluated. Most of the single-shot layers classified as aerosol occur within the dust belt, as may be expected. Due to changes in the 532 nm calibration coefficients, the V4 feature finder detects ∼9.0 % more features at night and ∼2.5 % more during the day. These features are typically weakly scattering and classified about equally as clouds and aerosols. For those tropospheric layers detected in both V3 and V4, the CAD classifications of more than 95 % of all cloud and daytime aerosol layers remain unchanged, as do the classifications of ∼89 % of nighttime aerosol layers. Overall, the nighttime net cloud and aerosol fractions remain unchanged from V3 to V4, but the daytime net aerosol fraction is increased by about 2 % and the daytime net cloud fraction is decreased by about 2 %.

Description: In August 2018, the Cloud–Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) project released a new level 3 stratospheric aerosol profile data product derived from nearly 12 years of measurements acquired by the spaceborne Cloud–Aerosol Lidar with Orthogonal Polarization (CALIOP). This monthly averaged, gridded level 3 product is based on version 4 of the CALIOP level 1B and level 2 data products, which feature significantly improved calibration that now makes it possible to reliably retrieve profiles of stratospheric aerosol extinction and backscatter coefficients at 532 nm. This paper describes the science algorithm and data handling techniques that were developed to generate the CALIPSO version 1.00 level 3 stratospheric aerosol profile product. Further, we show that the extinction profiles (retrieved using a constant lidar ratio of 50 sr) capture the major stratospheric perturbations in both hemispheres over the last decade resulting from volcanic eruptions, extreme smoke events, and signatures of stratospheric dynamics. Initial assessment of the product by intercomparison with the stratospheric aerosol retrievals from the Stratospheric Aerosol and Gas Experiment III (SAGE III) on the International Space Station (ISS) indicates good agreement in the tropical stratospheric aerosol layer (30∘ N–30∘ S), where the average difference between zonal mean extinction profiles is typically less than 25 % between 20 and 30 km (CALIPSO biased high). However, differences can exceed 100 % in the very low aerosol loading regimes found above 25 km at higher latitudes. Similarly, there are large differences (≥100 %) within 2 to 3 km above the tropopause that might be due to cloud contamination issues.

Description: Data products from the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) on board Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) were recently updated following the implementation of new (version 4.1) calibration algorithms for all of the level 1 attenuated backscatter measurements. In this work we present the motivation for and the implementation of the version 4.1 nighttime 532 nm parallel channel calibration. The nighttime 532 nm calibration is the most fundamental calibration of CALIOP data, since all of CALIOP’s other radiometric calibration procedures – i.e., the 532 nm daytime calibration and the 1064 nm calibrations during both nighttime and daytime – depend either directly or indirectly on the 532 nm nighttime calibration. The accuracy of the 532 nm nighttime calibration is significantly improved by raising the molecular normalization altitude from 30–34 km to 36–39 km to substantially reduce stratospheric aerosol contamination. Due to the greatly reduced molecular number density and consequently reduced signal-to-noise ratio at the higher altitudes used to avoid aerosols, the signal is averaged over a larger number of samples. The new calibration procedure is shown to eliminate biases introduced in earlier versions and consequently leads to an improved representation of stratospheric aerosols. Validation results using airborne lidar measurements are also presented. Biases relative to collocated measurements acquired by the Langley Research Center (LaRC) airborne High Spectral Resolution Lidar (HSRL) are reduced from 3.6 % ± 2.2 % in the version 3 data set to 1.6 % ± 2.4 % in the version 4.1 release.