This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
codes:ozoneproduct [2021/05/13 12:59] jlsolano [WOUDC extCSV files] |
codes:ozoneproduct [2022/10/05 09:14] (current) |
||
---|---|---|---|
Line 66: | Line 66: | ||
* //o3ds// and //o3ds_maxstd// values have to be set in [[devel:eubrewnetconfiguration|config]] | * //o3ds// and //o3ds_maxstd// values have to be set in [[devel:eubrewnetconfiguration|config]] | ||
* If not, a default value for std of 2.5 is used | * If not, a default value for std of 2.5 is used | ||
- | - Filtered by ozone slant column / air mass | + | * For other measurements (ZS, FZ, FM, ...) you can set specific thresholds in //Data and Metadata// → //Data Processing// → //Rejection Criteria//. A std of 4 is used by default for ZS measurements. |
- | * //mu_ds// and //mu_ds_value// values have to be set in [[devel:eubrewnetconfiguration|config]], and the model of the Brewer is Mk II or IV and the stray light correction has not been defined | + | - Filtered by ozone slant column / air mass |
- | * If not, a default value of 3.5 is used | + | * For DS measurements, //mu_ds// and //mu_ds_value// values have to be set in [[devel:eubrewnetconfiguration|config]] |
+ | - If the limits are defined, they are used. | ||
+ | - If not, the following default values are used: | ||
+ | * Single (no stray correction): 3.5 | ||
+ | * Single (with stray correction): 6 | ||
+ | * Double: 6 | ||
+ | * For other ozone measurements in which the Stray Light correction is not defined (ZS, FZ, FM, ...), 3.5 is the default value for Single Brewers, and 6 for Doubles. You can also set a specific value in //Data and Metadata// → //Data Processing// → //Rejection Criteria// | ||
- The measures has valid hg (step change lees than 2) before and after (see [[devel:brewerpythonmodule#check_hg|Brewer Python Module (Check HG)]]. | - The measures has valid hg (step change lees than 2) before and after (see [[devel:brewerpythonmodule#check_hg|Brewer Python Module (Check HG)]]. | ||
- Filtered by Minimun Values: lesser Ozone values than Maximun are discarded | - Filtered by Minimun Values: lesser Ozone values than Maximun are discarded | ||
Line 201: | Line 207: | ||
EUBREWNET can generate files with monthly data in the extCSV format requested by the WOUDC (see https://guide.woudc.org/en/) | EUBREWNET can generate files with monthly data in the extCSV format requested by the WOUDC (see https://guide.woudc.org/en/) | ||
- | To generate the WOUDC files, use the URL ''http://www.eubrewnet.org/eubrewnet/woudc/csv'' with the following arguments: | + | To generate the WOUDC files, use the URL ''http://eubrewnet.aemet.es/eubrewnet/woudc/csv'' with the following arguments: |
* ''brewerid'': Brewer serial number. | * ''brewerid'': Brewer serial number. | ||
Line 209: | Line 215: | ||
For example, use | For example, use | ||
| | ||
- | http://www.eubrewnet.org/eubrewnet/woudc/csv?brewerid=157&date=2019-01 | + | http://eubrewnet.aemet.es/eubrewnet/woudc/csv?brewerid=157&date=2019-01 |
- | to get Brewer #157's highest level data (L1.5, L1.6, or L2.0) for January 2019. | + | to get Brewer #157's highest level data (1.5 near real time, 1.6 consolidated NRT, or 2.0 final) for January 2019. |
- | Note that EUBREWNET's 1.5, 1.6, and 2.0 data levels correspond to WOUDC's level 2.0, see https://guide.woudc.org/en/#321-introduction. Files generated by EUBREWNET and submitted to the WOUDC will hence be stored at https://woudc.org/archive/Archive-NewFormat/TotalOzone_2.0_1/ | + | Note that EUBREWNET's 1.5, 1.6, and 2.0 data levels correspond to WOUDC's level 2.0 (see https://guide.woudc.org/en/#321-introduction). Files generated by EUBREWNET and submitted to the WOUDC will hence be stored at https://woudc.org/archive/Archive-NewFormat/TotalOzone_2.0_1/ |
The following arguments are optional: | The following arguments are optional: | ||
Line 221: | Line 227: | ||
* ''version'': this is EUBREWNET's processing algorithm version. If not specified, version ''1.0'' is used (note this is the only version available to the public as of April 2020) | * ''version'': this is EUBREWNET's processing algorithm version. If not specified, version ''1.0'' is used (note this is the only version available to the public as of April 2020) | ||
- | * ''file_version'': this is used in the Data Generation Version field of the extCSV file (see https://guide.woudc.org/en/#32-the-woudc-extcsv-data-file-metadata), and is written as ''major_version.minor_version''. If not specified, the file version is automatically determined depending on whether a file for the same date is already available at the WOUDC: | + | * ''file_version'': this is used in the Data Generation Version field of the extCSV file (see https://guide.woudc.org/en/#32-the-woudc-extcsv-data-file-metadata), and is written as ''major_version.minor_version''. If not specified, the file version is automatically determined depending on whether a file for the same date is already available at the WOUDC: |
- | ** if the file exists, the ''minor_version'' will be increased by ''1'' (e.g., if the existing file is version ''3.2'', the new file will be ''3.3'') | + | * if the file exists, the ''minor_version'' will be increased by ''1'' (e.g., if the existing file is version ''3.2'', the new file will be ''3.3'') |
- | ** if no file exists, ''file_version'' defaults to EUBREWNET's processing algorithm version, which itself defaults to ''1.0'' (see above) | + | * if no file exists, ''file_version'' defaults to EUBREWNET's processing algorithm version, which itself defaults to ''1.0'' (see above) |
Line 230: | Line 236: | ||
It is also possible to generate HDF files with monthly data in the GEOMS format (see https://evdc.esa.int/documents/1/geoms-1.0.pdf) accepted by the NDACC, AVDC, and other data centers. | It is also possible to generate HDF files with monthly data in the GEOMS format (see https://evdc.esa.int/documents/1/geoms-1.0.pdf) accepted by the NDACC, AVDC, and other data centers. | ||
- | To generate the GEOMS files, use the URL ''http://www.eubrewnet.org/eubrewnet/geoms/hdf'' with the following arguments: | + | To generate the GEOMS files, use the URL ''http://eubrewnet.aemet.es/eubrewnet/geoms/hdf'' with the following arguments: |
* ''brewerid'': Brewer serial number. | * ''brewerid'': Brewer serial number. | ||
Line 240: | Line 246: | ||
For example, use | For example, use | ||
| | ||
- | http://www.eubrewnet.org/eubrewnet/geoms/hdf?brewerid=157&date=2019-02&level=1.5 | + | http://eubrewnet.aemet.es/eubrewnet/geoms/hdf?brewerid=157&date=2019-02&level=1.5 |
to get Brewer #157's L1.5 data for February 2019. | to get Brewer #157's L1.5 data for February 2019. | ||
Line 253: | Line 259: | ||
* ''file_access'': this is used to fill the ''FILE_ACCESS'' global attribute (see https://evdc.esa.int/documents/1/geoms-1.0.pdf, page 20, section 4.3.3). If more than one data center is specified, please separate their acronyms using only commas, e.g. ''AVDC,NDACC'' (**do not** use semicolons! ''AVDC;NDACC'' will not be interpreted correctly by the server!). If not specified, it defaults to ''NDACC'' | * ''file_access'': this is used to fill the ''FILE_ACCESS'' global attribute (see https://evdc.esa.int/documents/1/geoms-1.0.pdf, page 20, section 4.3.3). If more than one data center is specified, please separate their acronyms using only commas, e.g. ''AVDC,NDACC'' (**do not** use semicolons! ''AVDC;NDACC'' will not be interpreted correctly by the server!). If not specified, it defaults to ''NDACC'' | ||
+ | |||
+ | * ''individual'': write all individual measurements instead of daily means | ||
You can check the GEOMS-HDF files using the AVDC GEOMS QA checker available at https://avdc.gsfc.nasa.gov/index.php?site=1473794367 | You can check the GEOMS-HDF files using the AVDC GEOMS QA checker available at https://avdc.gsfc.nasa.gov/index.php?site=1473794367 | ||
Line 260: | Line 268: | ||
EUBREWNET can also generate AMES files with monthly data in the format specified by NDACC (see http://ndaccdemo.org/data/formats) | EUBREWNET can also generate AMES files with monthly data in the format specified by NDACC (see http://ndaccdemo.org/data/formats) | ||
- | To generate the AMES files, use the URL ''http://www.eubrewnet.org/eubrewnet/ndacc/ames'' with the following arguments: | + | To generate the AMES files, use the URL ''http://eubrewnet.aemet.es/eubrewnet/ndacc/ames'' with the following arguments: |
* ''brewerid'': Brewer serial number. | * ''brewerid'': Brewer serial number. | ||
Line 270: | Line 278: | ||
For example, use | For example, use | ||
| | ||
- | http://www.eubrewnet.org/eubrewnet/ndacc/ames?brewerid=157&date=2019-02&level=1.5 | + | http://eubrewnet.aemet.es/eubrewnet/ndacc/ames?brewerid=157&date=2019-02&level=1.5 |
to get Brewer #157's L1.5 data for February 2019. | to get Brewer #157's L1.5 data for February 2019. | ||
Line 285: | Line 293: | ||
* ''individual'': write all individual measurements instead of daily means | * ''individual'': write all individual measurements instead of daily means | ||
+ |