ALBERT

Description: HadISDH is a near-global land surface specific humidity monitoring product providing monthly means from 1973 onwards over large-scale grids. Presented herein to 2012, annual updates are anticipated. HadISDH is an update to the land component of HadCRUH, utilising the global high-resolution land surface station product HadISD as a basis. HadISD, in turn, uses an updated version of NOAA's Integrated Surface Database. Intensive automated quality control has been undertaken at the individual observation level, as part of HadISD processing. The data have been subsequently run through the pairwise homogenisation algorithm developed for NCDC's US Historical Climatology Network monthly temperature product. For the first time, uncertainty estimates are provided at the grid-box spatial scale and monthly timescale. HadISDH is in good agreement with existing land surface humidity products in periods of overlap, and with both land air and sea surface temperature estimates. Widespread moistening is shown over the 1973–2012 period. The largest moistening signals are over the tropics with drying over the subtropics, supporting other evidence of an intensified hydrological cycle over recent years. Moistening is detectable with high (95%) confidence over large-scale averages for the globe, Northern Hemisphere and tropics, with trends of 0.089 (0.080 to 0.098) g kg−1 per decade, 0.086 (0.075 to 0.097) g kg−1 per decade and 0.133 (0.119 to 0.148) g kg−1 per decade, respectively. These changes are outside the uncertainty range for the large-scale average which is dominated by the spatial coverage component; station and grid-box sampling uncertainty is essentially negligible on large scales. A very small moistening (0.013 (−0.005 to 0.031) g kg−1 per decade) is found in the Southern Hemisphere, but it is not significantly different from zero and uncertainty is large. When globally averaged, 1998 is the moistest year since monitoring began in 1973, closely followed by 2010, two strong El Niño years. The period in between is relatively flat, concurring with previous findings of decreasing relative humidity over land.

Description: We report on preliminary steps in the homogenisation of HadISD, a sub-daily, station-based data set covering 1973–2013. Using temperature, dew point temperature, sea-level pressure and wind speeds, change points are detected using the Pairwise Homogenisation Algorithm from Menne and Williams Jr. (2009). Monthly-mean values and monthly-mean diurnal ranges (temperature and dew point temperature) or monthly-maximum values (wind speeds) are processed using the full network of 6103 stations in HadISD. Where multiple change points are detected within 1 year, they are combined and the average date is used. Under the assumption that the underlying true population of inhomogeneity magnitudes is Gaussian, inhomogeneity magnitudes as small as around 0.5 °C, 0.5 hPa or 0.5 m s−1 have been successfully detected. The change point dates and inhomogeneity magnitudes for each of the calculation methods will be provided alongside the data set to allow users to select stations which have different levels of homogeneity. We give an example application of this change point information in calculating global temperature values from HadISD and comparing these to CRUTEM4. Removing the most inhomogeneous stations results in a better match between HadISD and CRUTEM4 when matched to the same coverage. However, further removals of stations with smaller and fewer inhomogeneities worsen the match.

Description: We report on preliminary steps in the homogenisation of HadISD, a sub-daily, station-based dataset covering 1973–2013. Using temperature, dewpoint temperature, sea-level pressure and wind speeds, change points are detected using the Pairwise Homogenisation Algorithm from Menne and Williams Jr. (2009). Monthly mean values and monthly mean diurnal ranges (temperature and dewpoint temperature) or monthly maximum values (wind speeds) are processed using the full network of 6103 stations in HadISD. Where multiple change points are detected within one year, they are combined and the average date used. Under the assumption that the underlying true population of inhomogeneity magnitudes is Gaussian, adjustments as small as around 0.5 °C, 0.5 hPa or 0.5 m s−1 have been successfully detected. No strong biases are present in the distributions of the adjustment values. The change point dates and adjustment values for each of the calculation methods will be provided alongside the dataset to allow users to select stations which have different levels of homogeneity. We give an example application of this change point information in calculating global temperature values from HadISD and comparing these to CRUTEM4. Removing the most inhomogeneous stations results in a better match between HadISD and CRUTEM4 when matched to the same coverage. However, further removals of stations with smaller and fewer inhomogeneities worsens the match.

Description: This paper describes the creation of HadISD; an automatically quality-controlled synoptic resolution dataset of temperature, dewpoint temperature, sea-level pressure, wind speed, wind direction and cloud cover from global weather stations for 1973–2010. The full dataset consists of over 6000 stations, with 3375 long-term stations deemed to have sufficient sampling and quality for climate applications requiring sub-daily resolution. As with other surface datasets, coverage is heavily skewed towards Northern Hemisphere mid-latitudes. The dataset is constructed from a large pre-existing ASCII flatfile data bank that represents over a decade of substantial effort at data retrieval, reformatting and provision. The work proceeded in several steps: merging stations with multiple reporting identifiers; reformatting to netcdf; quality control; and then filtering to form a final dataset. Particular attention has been paid to maintaining true extreme values where possible within an automated objective process. Detailed validation has been performed on a subset of global stations and also on UK data using known extreme events to help finalise the QC tests. Further validation was performed on a selection of extreme events world-wide (Hurricane Katrina in 2005, the cold snap in Alaska in 1989 and heat waves in SE Australia in 2009). Some very initial analyses are performed to illustrate some of the types of problems to which the final data could be applied. Although the filtering has removed the poorest station records, no attempt has been made to homogenise the data thus far, due to the complexity of retaining the true distribution of high-resolution data when applying adjustments. Hence non-climatic, time-varying errors may still exist in many of the individual station records and care is needed in inferring long-term trends from these data. This dataset will allow the study of high frequency variations of temperature, pressure and humidity on a global basis over the last four decades. Both individual extremes and the overall population of extreme events could be investigated in detail to allow for comparison with past and projected climate.

Description: This paper describes the creation of HadISD: an automatically quality-controlled synoptic resolution dataset of temperature, dewpoint temperature, sea-level pressure, wind speed, wind direction and cloud cover from global weather stations for 1973–2011. The full dataset consists of over 6000 stations, with 3427 long-term stations deemed to have sufficient sampling and quality for climate applications requiring sub-daily resolution. As with other surface datasets, coverage is heavily skewed towards Northern Hemisphere mid-latitudes. The dataset is constructed from a large pre-existing ASCII flatfile data bank that represents over a decade of substantial effort at data retrieval, reformatting and provision. These raw data have had varying levels of quality control applied to them by individual data providers. The work proceeded in several steps: merging stations with multiple reporting identifiers; reformatting to netCDF; quality control; and then filtering to form a final dataset. Particular attention has been paid to maintaining true extreme values where possible within an automated, objective process. Detailed validation has been performed on a subset of global stations and also on UK data using known extreme events to help finalise the QC tests. Further validation was performed on a selection of extreme events world-wide (Hurricane Katrina in 2005, the cold snap in Alaska in 1989 and heat waves in SE Australia in 2009). Some very initial analyses are performed to illustrate some of the types of problems to which the final data could be applied. Although the filtering has removed the poorest station records, no attempt has been made to homogenise the data thus far, due to the complexity of retaining the true distribution of high-resolution data when applying adjustments. Hence non-climatic, time-varying errors may still exist in many of the individual station records and care is needed in inferring long-term trends from these data. This dataset will allow the study of high frequency variations of temperature, pressure and humidity on a global basis over the last four decades. Both individual extremes and the overall population of extreme events could be investigated in detail to allow for comparison with past and projected climate. A version-control system has been constructed for this dataset to allow for the clear documentation of any updates and corrections in the future.

Description: HadISDH.2.0.0 is the first gridded, multi-variable humidity and temperature climate-data product that is homogenised and annually updated. It provides physically consistent estimates for specific humidity, vapour pressure, relative humidity, dew point temperature, wet bulb temperature, dew point depression and temperature. It is a monthly-mean gridded (5° by 5°) product with uncertainty estimates that account for spatio-temporal sampling, climatology calculation, homogenisation and irreducible random measurement effects. It provides a unique tool for the monitoring of a variety of humidity-related variables which have different impacts and implications for society. HadISDH.2.0.0 is shown to be in good agreement both with other estimates where they are available, and with theoretical understanding. The dataset is available from 1973 to the present. The theme common to all variables is of a warming world with more water vapour present in the atmosphere. The largest increases in water vapour are found over the tropics and Mediterranean. Over the tropics and high northern latitudes the surface air over land is becoming more saturated. However, despite increasing water vapour over the mid-latitudes and Mediterranean, the surface air over land is becoming less saturated. These observed features may be due to atmospheric circulation changes, land–sea warming disparities and reduced water availability or changed land surface properties.

Description: HadISDH.2.0.0 is the first gridded, multi-variable humidity and temperature in situ observations-only climate-data product that is homogenised and annually updated. It provides physically consistent estimates for specific humidity, vapour pressure, relative humidity, dew point temperature, wet bulb temperature, dew point depression and temperature. It is a monthly mean gridded (5° by 5°) product with uncertainty estimates that account for spatio-temporal sampling, climatology calculation, homogenisation and irreducible random measurement effects. It provides a tool for the long-term monitoring of a variety of humidity-related variables which have different impacts and implications for society. It is also useful for climate model evaluation and reanalyses validation. HadISDH.2.0.0 is shown to be in good agreement both with other estimates and with theoretical understanding. The data set is available from 1973 to the present. The theme common to all variables is of a warming world with more water vapour present in the atmosphere. The largest increases in water vapour are found over the tropics and the Mediterranean. Over the tropics and high northern latitudes the surface air over land is becoming more saturated. However, despite increasing water vapour over the mid-latitudes and Mediterranean, the surface air over land is becoming less saturated. These observed features may be due to atmospheric circulation changes, land–sea warming disparities and reduced water availability or changed land surface properties.