Total Column Ozone
Using the data
Please note that these data are provided under the Creative Commons Attribution-NonCommercial-ShareAlike (CC BY-NC-SA) licence. Please make sure that you are aware of the terms and conditions of this licence before using the data. Under the terms of this licence, the acknowledgement that you are required to make when using the NIWA-BS combined total column ozone database is:
We would like to thank Bodeker Scientific, funded by the New Zealand Deep South National Science Challenge, for providing the combined NIWA-BS total column ozone database.
When using the BS-filled total column ozone database please include the following acknowledgement:
We would like to thank Bodeker Scientific for providing the BS-filled total column ozone database.
If you are going to be using this database in a publication, please let Greg Bodeker know (greg@bodekerscientific.com) since it helps when justifying applications for additional funding to be able to point to papers that have used these databases.
A note on differences between versions 3.4.x and 3.5.x
The version 3.5.x NIWA-BS/BS Filled TCO data sets should not be used henceforth for trend analysis and, as such, we have updated the version 3.4 database to the end of 2019 (now referred to as version 3.4.1 of the database). BS Filled version 3.4.1 is now a replacement for the version 3.5.2 database which also extends to the end of 2019. The reason for that is explained in a document available here.
Version 3.5.2
Last updated: 14 June 2022
The version 3.5.x NIWA-BS TCO data sets should not be used henceforth for trend analysis. See the above section 'A note on differences between versions 3.4.x and 3.5.x' for more detail.
Update: 14 April 2022
Version 3.5.2 the Bodeker Scientific filled (BS-filled) total column ozone database
Version 3.5.2 of the BS-filled TCO database is now available on Zenodo here.
Version 3.5.2 of the BS-filled Total Column Ozone (TCO) database provides a correction to version 3.5.1 of the same database – for reasons that we won’t go into, from 1984 to 1992, the filling over the polar cap was absent on around 1 day in 7. Version 3.5.2 and 3.5.1 of the filled database are otherwise identical. Please refer to version 3.5.1 (https://doi.org/10.5281/zenodo.4535247) for details on the creation of the database.
Version 3.5.1
Last updated: 14 June 2022
The version 3.5.x NIWA-BS TCO data sets should not be used henceforth for trend analysis. See the above section 'A note on differences between versions 3.4.x and 3.5.x' for more detail.
Update: 27 April 2021
Version 3.5.1 the National Institute of Water and Atmospheric Research - Bodeker Scientific (NIWA-BS) total column ozone database
Version 3.5.1 of the NIWA-BS total column ozone (TCO) database is now available. The generation of the database was funded through a project by the New Zealand Deep South National Science Challenge. This version of the database extends version 3.4 (see previous versions below) to the end of 2019. As with previous versions, the database is constructed by combining measurements from a number of different satellite-based instruments and extends from 1 November 1978 to 31 December 2019. Offsets and drifts between the different data sets are resolved through comparisons with the Dobson and Brewer ground-based instruments and through inter-satellite instrument comparisons.
Version 3.5.1 of the NIWA-BS total column ozone database is available on Zenodo here.
Version 3.5.1 the Bodeker Scientific filled (BS-filled) total column ozone database
Version 3.5.1 of the BS-filled TCO database is now available on Zenodo here. This database provides a gap-free extension of the NIWA-BS total column ozone database version 3.5.1.
A paper describing both the NIWA-BS and BS-filled TCO database has been published in ACP:
Bodeker, G.E. and Kremser, S., Indicators of Antarctic ozone depletion: 1979 to 2019, Atmos. Chem. Phys., doi:10.5194/acp-21-5289-2021, 2021
Both databases are provided as netCDF files. Daily data are provided as one file per year, containing the TCO fields, the uncertainty fields and, just for the NIWA-BS database, the count fields. Monthly fields are provided as one file per year and include TCO fields and the associated uncertainty fields. Note that because 25 values or more need to be available to calculate a monthly mean, for the NIWA-BS database, some monthly fields may be missing. Annual fields are also provided as one file per year and include TCO fields and the associated uncertainty fields. Note that because 12 valid monthly means need to be available to calculate an annual mean, for the NIWA-BS database, some annual mean fields may be missing.
Table 1: Structure of the NetCDF files
Versions 3.4.1 and 3.4
Version 3.4.1
We have updated the version 3.4 database to the end of 2019 (now referred to as version 3.4.1 of the database). For details, see the document in the above section 'A note on differences between versions 3.4.x and 3.5.x'.
Version 3.4
This version is an update of Version 3.3 by improving the screening of the raw satellite data and removing anomalous data prior to their use in the process that splices together the different data sets. As with previous versions, the database is constructed by combining measurements from a number of different satellite-based instruments and extends from 1 November 1978 to 31 December 2016. Offsets and drifts between the different data sets are resolved through comparisons with the Dobson and Brewer ground-based instruments and through inter-satellite instrument comparisons. Count fields, which detail the number of satellite measurements available in each grid cell, are only available for the daily-unpatched grids.
The construction of this version of the database is described in detail in Bodeker, G.E.; Nitzbon, J.; Tradowsky, J.S.; Kremser, S.; Schwertheim, A. and Lewis, J., A Global Total Column Ozone Climate Data Record, Earth System Science Data, 2020 available here.
Version 3.4 of the database is available on the Bodeker Scientific ftp server (please contact us to get access details) and netCDF files are available on Zenodo:
NIWA-BS Total Column Ozone Database V3.4 - DOI:10.5281/zenodo.1346424
BS Filled Total Column Ozone Database V3.4 - DOI:10.5281/zenodo.3908787
Table 2: Structure of the data available on the FTP server
Calculating the monthly means and their uncertainties
The uncertainties on the annual means are calculated using the same formulae. This approach has been validated through Monte Carlo testing.
Calculating filled fields
A complete description of how the filled fields (also called 'patched' fields), and their uncertainties, are calculated is provided here.
Accessing the data and publications
If you would like access to these data, or to be kept informed of updates to the database, please email Greg Bodeker at greg@bodekerscientific.com.
Descriptions of various versions of the data set are available in a number of publications that have made use of the data:
Bodeker, G.E and S. Kremser: Indicators of Antarctic ozone depletion: 1979 to 2019 (2021), Atmos. Chem. Phys., 21, 5289–5300, https://doi.org/10.5194/acp-21-5289-2021. [here]
Struthers, H., G. E. Bodeker, J. Austin, S. Bekki, I. Cionni, M. Dameris, M. A. Giorgetta, V. Grewe, F. Lefèvre, F. Lott, E. Manzini, T. Peter, E. Rozanov, and M. Schraner (2009), The simulation of the Antarctic ozone hole by chemistry-climate models, Atmospheric Chemistry and Physics, 9, 6363–6376. [acp-9-6363-2009.pdf].
Müller, R., J.-U. Grooß, C. Lemmen, D. Heinze, M. Dameris, and G. E. Bodeker (2008), Simple measures of ozone depletion in the polar stratosphere, Atmospheric Chemistry and Physics, 8, 251-264. [acp-8-251-2008.pdf]
Bodeker, G. E., H. Shiona, and H. Eskes (2005), Indicators of Antarctic ozone depletion, Atmospheric Chemistry and Physics, 5, 2603-2615. [acp-5-2603.pdf]
Previous versions
Version 3.3 (October 2017):
This update to previous versions of the database included:
New and updated sources of satellite-based TCO measurements were used viz. data from NPP-OMPS (National Polar-orbiting Partnership-Ozone Mapping and Profiler Suite), GOME-2 (Global Ozone Monitoring Experiment-2) and SCIAMACHY (Scanning Imaging Absorption Spectrometer for Atmospheric CHartographY) are now included in the combined data set.
Improved statistical methods are used to model the difference fields between data sets; zonal means of the difference fields are modelled using Legendre expansions which comprise the meridional component of a spherical harmonic expansion which is best suited for statistically describing a field on a sphere.
Measurement uncertainties on the source data sets, and the corrections applied to those data sets, have been collated and are propagated through to the combined ozone data set so that, for the first time, this data set is now provided with uncertainty estimates for each datum.
Version 3.2 (January 2017):
Updated the V3.0 methodology to more robustly model the difference fields between data sets at the poles. A patched data set was also provided
Version 3.0 (November 2015):
Version 3.0 of the NIWA-BS total column ozone (TCO) database has been constructed in a project funded by the New Zealand Deep South National Science Challenge. The database is constructed by combining measurements from a number of different satellite-based instruments. Offsets and drifts between the different data sets are resolved through comparisons with the Dobson and Brewer ground-based instruments and through inter-satellite instrument comparisons. This update to previous versions of the database includes:
New and updated sources of satellite-based TCO measurements are used viz. data from NPP-OMPS (National Polar-orbiting Partnership-Ozone Mapping and Profiler Suite), GOME-2 (Global Ozone Monitoring Experiment-2) and SCIAMACHY (Scanning Imaging Absorption Spectrometer for Atmospheric CHartographY) are now included in the combined data set.
Improved statistical methods are used to model the difference fields between data sets; zonal means of the difference fields are modelled using Legendre expansions which comprise the meridional component of a spherical harmonic expansion which is best suited for statistically describing a field on a sphere. A Bayesian information criterion is used to determine the number of terms used in the Legendre expansions.
Measurement uncertainties on the source data sets, and the corrections applied to those data sets, have been collated and are propagated through to the combined ozone data set so that, for the first time, this data set is now provided with uncertainty estimates for each datum.
This new version of the database is available here. The data are supplied as unpatched (no spatial or temporal interpolation) CF-Compliant NetCDF files.
At this time only daily 'unpatched' data are available. We are working on generating monthly mean and patched data files as had been available in previous versions of the database. This is now a little more challenging as we intend to capitalize on the uncertainty estimates being available to calculate monthly means and patched data that incorporate realistic uncertainties. If you need the monthly mean or patched data, please continue to use version 2.8 of the database for now (see below).
Version 2.8:
Version 2.8 of the total column ozone database made the following changes to previous versions:
corrections applied to the OMI data for their offset and drift against the ground-based Brewer and Dobson network have been recalculated based on the longer overlap period now available.
On the FTP server for version 2.8 of this database you will see three different directories, viz.:
Daily: These are the data at daily resolution. There are, in turn, three subdirectories, viz.:
LongPatched: In these files, longitudinal interpolation has been performed to fill data gaps. However, no interpolation is performed over more than 60o in longitude and 5o in latitude. In addition, temporal interpolation was performed when missing data were bracketed by available data at the same location on the preceding and following days.
Patched: In these files spatial linear interpolation has been performed to fill data gaps. However, no interpolation is performed over more than 60o in longitude and 10o in latitude. However, these criteria are relaxed poleward of 60o to permit interpolation over the polar caps. This interpolation method is described and validated in: Bodeker, G. E., B. J. Connor, J. B. Liley, and W. A. Matthews (2001), The global mass of ozone: 1978-1998, Geophys. Res. Lett., 28(14), 2819-2822. No temporal interpolation is performed.
Unpatched: In these files no spatial or temporal interpolation is performed.
All three of these data sets are available as NetCDF files. I have tried to make them CF compliant so that they can be used directly e.g. in the SPARC CCMVal activity.
Locations: These are daily data extracted from the daily resolution grid files using bilinear interpolation. Each file is a text file and contains a header describing the file contents. The values in the last column describe the extent of the interpolation required to derive a valid value. If a valid value was available from the 'Unpatched' daily grid files, this value will be 0. If it was necessary to go to the 'LongPatched' daily grid files, this value will be 1. If it was necessary to go to the 'Patched' daily grid files this value will be 2. If no value could be derived, this value will be -1000. If a location that you want data for is not currently available, please email me at greg@bodekerscientific.com with the name, latitude and longitude of the station you want data for, and I will see what I can do.
Monthly: These are data at monthly resolution. There have to be at least 25 valid values within a month to calculate a valid monthly mean. As with the daily data, there are three subdirectories containing data in which different degrees of spatial and/or temporal interpolation has been applied. Read the explanatory notes in the daily data section to see what these are. They are available both as NetCDF and as text files.
Text files: These are files in a raw text format. Within each annual file there is a block of data for each month. The first line in each monthly data block gives the month number of the year. Note that there may be missing months of data. The next 180 lines give the data. The first line is for the cells between 89oN and 90oN and the last line is for the cells between 89oS and 90oS. Each line of data holds 288 numbers. Each value is always three digits with -99 meaning no data available. There are no spaces between values to save on file size. The first value on each line is for the cell between 180oW and 178.75oW (each cell is 1.25 degrees in width). The last value on each line is for the cell between 178.75oE and 180oE.