Eubrewnet Wiki
Eubrewnet Documentation
Eubrewnet Documentation
Are the O3 and SO2 comming from the Direct Sun measures from the Brewers. Some considerations:
Are the O3 and SO2 recalculations with the standard algorithm from the Direct Sun measures and applying a verified by an operator set of constants. Some considerations:
ozone_product_1_0 Table | |||
---|---|---|---|
Field | Description | Unit | Reference |
brewerid | Brewer identification number | db.brewer_t | |
gmt | UT time of the measure in ISO 8601 format | GMT | ISO 8601 |
configid | Configuration identification Numer | db.configs_t | |
n_sum | Index of the daily summary | ||
date_index | Continuous date index (0.0 = 0000-00-00T00:00:00Z) based in Matlab datenum | days | db.b_ds_t.date.toordinal + 366 + db.b_ds_t.mmmm_gmt / SECONDS_IN_A_DAY |
sza | Solar zenith angle using time function | Degrees | Brewer Python Module (Solar Zenith Angle) |
airmass | Calculated airmass using time function | Brewer Python Module (Brewer Airmass) | |
temperature | Instrument temperature | Degrees | db.b_ds_summary_t.temp |
filt | Applied neutral density filter | db.b_ds_t.nd_filter_position / 64 | |
o3 | Calculated Ozone value with Standard algorithm + attenuation filter correction Ozone Level 1 | Dobson Units | Brewer Python Module (o3_so2) |
std_o3 | Standard deviation of the group of measures | Dobson Units | Brewer Operator Manual (Section 9.2.6) |
so2 | Calculated so2 value with Standard algorithm + attenuation filter correction | Dobson Units | Ozone Level 1 |
std_so2 | Standard deviation of the group of measures | Dobson Units | Brewer Operator Manual (Section 9.2.6) |
latitude | Latitude of the Brewer Location | Degrees | db.b_t, db.configs_t |
longitude | Longitude of the Brewer Location | Degrees | db.b_t, db.configs_t |
press | Medium Pressure of the Brewer Location | Milibars | db.b_t, db.configs_t |
ms8 | First double ratio | Brewer Python Module (o3_so2) | |
ms9 | Second double ratio | Brewer Python Module (o3_so2) | |
f1 | Corrected Operational-Wavelength counts per second for slit 1 (includes only instrumental corrections, does not include the Rayleigh correction) | Brewer Operator Manual (Appendix G) | |
f2 | Corrected Operational-Wavelength counts per second for slit 2 (includes only instrumental corrections, does not include the Rayleigh correction) | Brewer Operator Manual (Appendix G) | |
f3 | Corrected Operational-Wavelength counts per second for slit 3 (includes only instrumental corrections, does not include the Rayleigh correction) | Brewer Operator Manual (Appendix G) | |
f4 | Corrected Operational-Wavelength counts per second for slit 4 (includes only instrumental corrections, does not include the Rayleigh correction) | Brewer Operator Manual (Appendix G) | |
f5 | Corrected Operational-Wavelength counts per second for slit 5 (includes only instrumental corrections, does not include the Rayleigh correction) | Brewer Operator Manual (Appendix G) | |
configdate | UT Date of the used configuration in ISO 8601 format | GMT | db.b_t, db.configs_t |
configtype | Type of the used configuration: B header(1), ICF (2), Config (3) | db.b_t, db.icf_t db.configs_t | |
process_date | Date and time when the product was processed | GMT | ISO 8601 |
They are level 1.0 observations with filter and corrections Level 1.0 O3 and SO2 observations
The list of config values and where to find them in the upload form can be found in Eubrewnet Configuration.
Two Flags have been added to the O3 and SO2 for filter a correction representation:
Flag type | Flag name | Description | Value |
---|---|---|---|
Data filter | FLAG_OZONE_STD_FILT | Ozone standard deviation | 1 |
Data filter | FLAG_AIRMASS_FILT | Max airmass | 2 |
Data filter | FLAG_HG_FILT | Valid HG | 4 |
Data filter | FLAG_MIN_FILT | Min Ozone Value | 8 |
Data filter | FLAG_MAX_FILT | Max Ozone Value | 16 |
Data filter | Exclusion List | 32 | |
Correction Flag | Standard Lamp | 1 | |
Correction Flag | ETC filter dependent | 2 | |
Correction Flag | Straylight | 4 |
In case of Filter flag, the process of setting it works as related below:
In case of Correction flag, the process of setting it works as related below:
This function computes O3 and SO2 amount from Brewer measurements:
ozone_product_1_5 Table | |||
---|---|---|---|
Field | Description | Unit | Reference |
brewerid | Brewer identification number | db.brewer_t | |
gmt | UT time of the measure in ISO 8601 format | GMT | ISO 8601 |
configid | Configuration identification Numer | db.configs_t | |
n_sum | Index of the daily summary | ||
date_index | Continuous date index (1.0 = 0001-01-01T00:00:00Z) based in python date.toordinal | days | db.b_ds_t.date.toordinal + db.b_ds_t.mmmm_gmt / SECONDS_IN_A_DAY |
sza | Solar zenith angle using time function | Degrees | Brewer Python Module (Solar Zenith Angle) |
airmass | Calculated airmass using time function | Brewer Python Module (Brewer Airmass) | |
temperature | Instrument temperature | Degrees | db.b_ds_summary_t.temp |
filt | Applied neutral density filter | db.b_ds_t.nd_filter_position / 64 | |
o3 | Calculated Ozone value with Standard algorithm + attenuation filter correction + config corrections Ozone Level 1.5 | Dobson Units | Brewer Python Module (o3_so2_sl) |
std_o3 | Standard deviation of the group of measures | Dobson Units | Brewer Operator Manual (Section 9.2.6) |
so2 | Calculated so2 value with Standard algorithm + attenuation filter correction Ozone Level 1.5 | Dobson Units | Brewer Python Module (o3_so2_sl) |
std_so2 | Standard deviation of the group of measures | Dobson Units | Brewer Operator Manual (Section 9.2.6) |
latitude | Latitude of the Brewer Location | Degrees | db.b_t, db.configs_t |
longitude | Longitude of the Brewer Location | Degrees | db.b_t, db.configs_t |
press | Medium Pressure of the Brewer Location | Milibars | db.b_t, db.configs_t |
o3_0 | Calculated Ozone value with Standard algorithm + attenuation filter correction Ozone Level 1 | Dobson Units | Brewer Python Module (o3_so2) |
so2_0 | Calculated so2 value with Standard algorithm + attenuation filter correction Ozone Level 1 | Dobson Units | Brewer Python Module (o3_so2) |
r6 | Standard Lamp Double Ratio 2 | Brewer Python Module (Triangular Moving Average) | |
r6_ref | Ozone value for Standard Lamp of Reference (Double Ratio 2) | db.configs_t.r6_ref | |
r5 | Standard Lamp Double Ratio 1 | Brewer Python Module (Triangular Moving Average) | |
r5_ref | Ozone value for Standard Lamp of Reference (Double Ratio 1) | db.configs_t.r5_ref | |
filter_flag | APPLIED FLAGS: HG Filter, Max Airmass, O3 std (1 means True) | Level 1.5 Realtime Observation | |
correction_flag | APPLIED CORRECTIONS: Straylight, ETC Correction, Standard Lamp correction(1 means True) | Level 1.5 Realtime Observation | |
configdate | UT Date of the used configuration in ISO 8601 format | GMT | db.b_t, db.configs_t |
configtype | Type of the used configuration: B header(1), ICF (2), Config (3) | db.b_t, db.icf_t db.configs_t | |
process_date | Date and time when the product was processed | GMT |
Level 2.0 are 1.5 observations validated with a posterior calibration. The brewer instrument use the measurements of the internal halogen lamp to track the Ozone calibration, but is usually difficult to know if the changes recorded by the SL test are due to changes on the lamp or real changes on the instrumental response. Only with a subsequent calibration/comparison we can validate the SL correction.
The Level 2 data are produced when the operator activates the verification flag and validates (assign to level 2) the observations data between the current calibration and the previous verified one.
EUBREWNET can generate files with monthly data in the extCSV format requested by the WOUDC (see https://guide.woudc.org/en/)
To generate the WOUDC files, use the URL http://eubrewnet.aemet.es/eubrewnet/woudc/csv
with the following arguments:
brewerid
: Brewer serial number.date
: month to process, in the format YYYY-MM
, last
for the last month according to today's date.For example, use
http://eubrewnet.aemet.es/eubrewnet/woudc/csv?brewerid=157&date=2019-01
to get Brewer #157's highest level data (1.5 near real time, 1.6 consolidated NRT, or 2.0 final) for January 2019.
Note that EUBREWNET's 1.5, 1.6, and 2.0 data levels correspond to WOUDC's level 2.0 (see https://guide.woudc.org/en/#321-introduction). Files generated by EUBREWNET and submitted to the WOUDC will hence be stored at https://woudc.org/archive/Archive-NewFormat/TotalOzone_2.0_1/
The following arguments are optional:
brewerid
, you can use one of gaw_id
, woudc_id
, or stationid
to request the data for a station instead of a Brewer. stationid
corresponds to the internal EUBREWNET ID of the station. Note that the Brewer and station products might be different if more than one Brewer operates at a station.version
: this is EUBREWNET's processing algorithm version. If not specified, version 1.0
is used (note this is the only version available to the public as of April 2020)file_version
: this is used in the Data Generation Version field of the extCSV file (see https://guide.woudc.org/en/#32-the-woudc-extcsv-data-file-metadata), and is written as major_version.minor_version
. If not specified, the file version is automatically determined depending on whether a file for the same date is already available at the WOUDC: minor_version
will be increased by 1
(e.g., if the existing file is version 3.2
, the new file will be 3.3
)file_version
defaults to EUBREWNET's processing algorithm version, which itself defaults to 1.0
(see above) It is also possible to generate HDF files with monthly data in the GEOMS format (see https://evdc.esa.int/documents/1/geoms-1.0.pdf) accepted by the NDACC, AVDC, and other data centers.
To generate the GEOMS files, use the URL http://eubrewnet.aemet.es/eubrewnet/geoms/hdf
with the following arguments:
brewerid
: Brewer serial number.date
: month to process, in the format YYYY-MM
level
: EUBREWNET product level to be included in the file, either 1.5 or 2.0For example, use
http://eubrewnet.aemet.es/eubrewnet/geoms/hdf?brewerid=157&date=2019-02&level=1.5
to get Brewer #157's L1.5 data for February 2019.
The following arguments are optional:
brewerid
, you can use one of gaw_id
, woudc_id
, or stationid
to request the data for a station instead of a Brewer. stationid
corresponds to the internal EUBREWNET ID of the station. Note that the Brewer and station products might be different if more than one Brewer operates at a station.version
: this is EUBREWNET's processing algorithm version. If not specified, version 1.0 is used (note this is the only version available to the public as of April 2020)file_version
: this is used to fill the DATA_FILE_VERSION
global attribute of the HDF file (see https://evdc.esa.int/documents/1/geoms-1.0.pdf, page 17, section 4.2.9). If not specified, it defaults to 001
file_access
: this is used to fill the FILE_ACCESS
global attribute (see https://evdc.esa.int/documents/1/geoms-1.0.pdf, page 20, section 4.3.3). If more than one data center is specified, please separate their acronyms using only commas, e.g. AVDC,NDACC
(do not use semicolons! AVDC;NDACC
will not be interpreted correctly by the server!). If not specified, it defaults to NDACC
individual
: write all individual measurements instead of daily meansYou can check the GEOMS-HDF files using the AVDC GEOMS QA checker available at https://avdc.gsfc.nasa.gov/index.php?site=1473794367
EUBREWNET can also generate AMES files with monthly data in the format specified by NDACC (see http://ndaccdemo.org/data/formats)
To generate the AMES files, use the URL http://eubrewnet.aemet.es/eubrewnet/ndacc/ames
with the following arguments:
brewerid
: Brewer serial number.date
: month to process, in the format YYYY-MM
level
: EUBREWNET product level to be included in the file, either 1.5 or 2.0For example, use
http://eubrewnet.aemet.es/eubrewnet/ndacc/ames?brewerid=157&date=2019-02&level=1.5
to get Brewer #157's L1.5 data for February 2019.
As of September 2020, the error fields have a fixed value corresponding to 1% of the observation values.
The following arguments are optional:
brewerid
, you can use one of gaw_id
, woudc_id
, or stationid
to request the data for a station instead of a Brewer. stationid
corresponds to the internal EUBREWNET ID of the station. Note that the Brewer and station products might be different if more than one Brewer operates at a station.version
: this is EUBREWNET's processing algorithm version. If not specified, version 1.0 is used (note this is the only version available to the public as of September 2020)qualityflag
: this is the 4-bytes value to write at the end of the first line in the NDACC file (see https://www.ndsc.ncep.noaa.gov/data/formats/header/#DFlag). Defaults to 0001
individual
: write all individual measurements instead of daily means