User Tools

Site Tools


codes:ozoneproduct

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
codes:ozoneproduct [2021/05/13 13:06] – [WOUDC extCSV files] jlsolanocodes:ozoneproduct [2025/10/07 15:59] (current) – [The Process] ajberjon
Line 66: Line 66:
      * //o3ds// and //o3ds_maxstd// values have to be set in [[devel:eubrewnetconfiguration|config]]      * //o3ds// and //o3ds_maxstd// values have to be set in [[devel:eubrewnetconfiguration|config]]
      * If not, a default value for std of 2.5 is used      * If not, a default value for std of 2.5 is used
-   - Filtered by ozone slant column / air mass  +     * For other measurements (ZS, FZ, FM, ...) you can set specific thresholds in //Data and Metadata// → //Data Processing// → //Rejection Criteria//. A std of 4 is used by default for ZS measurements. 
-      * //mu_ds// and //mu_ds_value// values have to be set in [[devel:eubrewnetconfiguration|config]], and the model of the Brewer is Mk II or IV and the stray light correction has not been defined +   - Filtered by ozone slant column / air mass 
-      If not, a default value of 3.5 is used+     For DS measurements, //mu_ds// and //mu_ds_value// values have to be set in [[devel:eubrewnetconfiguration|config]] 
 +       - If the limits are defined, they are used. 
 +       - If not, the following default values are used: 
 +         * Single (no stray correction): 3.5 
 +         Single (with stray correction):
 +         * Double: 6 
 +     * For other ozone measurements in which the Stray Light correction is not defined (ZS, FZ, FM, ...), 3.5 is the default value for Single Brewers, and 6 for Doubles. You can also set a specific value in //Data and Metadata// → //Data Processing// → //Rejection Criteria//
    - The measures has valid hg (step change lees than 2) before and after (see [[devel:brewerpythonmodule#check_hg|Brewer Python Module (Check HG)]].    - The measures has valid hg (step change lees than 2) before and after (see [[devel:brewerpythonmodule#check_hg|Brewer Python Module (Check HG)]].
    - Filtered by Minimun Values: lesser Ozone values than Maximun are discarded    - Filtered by Minimun Values: lesser Ozone values than Maximun are discarded
Line 84: Line 90:
           * If not or 0.0 value, ETC filter dependent correction is not applied           * If not or 0.0 value, ETC filter dependent correction is not applied
    - Stray Light correction    - Stray Light correction
-          * //stray_light_a// and //stry_light_b// values has to be set in [[devel:eubrewnetconfiguration|config]] +          * //stray_light_a// and //stry_light_b// values has to be set in [[devel:eubrewnetconfiguration|config]] as described in [[https://doi.org/10.5194/acp-18-10347-2018|Rimer et al. (2018)]] 
-          * If not provided or both of them are 0.0, straylight correction is not applied+          * Alternatively, the  method based on PHYCS ([[https://doi.org/10.5194/amt-16-4785-2023|Savastiouk et all., 2023]]) may be employed, using the //alpha// and //beta// parameters. 
 +          * If not provided or parameters are 0.0, straylight correction is not applied
  
  
Line 146: Line 153:
  
   - The $O_3_0$ is the [[codes:productsdescription#ozone_level_1|Level 1 ozone]]   - The $O_3_0$ is the [[codes:productsdescription#ozone_level_1|Level 1 ozone]]
-  - The SL correction use the R6 reference value and the measure SL is smoothing  using a Triangular moving average filter (see [[devel:brewerpythonmodule#sl_tma|Brewer Python Module (Triangular Moving Average)]])+  - The SL correction uses the R6 reference value and the R6 from SL measurements smoothed using a [[devel:brewerpythonmodule#sl_tma|Triangular Moving Average]]. The correction is only applied if the difference between the two R6 values is more than 5 units.
   - The ETC filter correction is applied using the ETC correction function, the correction $ETC_N$ only affects to the measurements performed with filter #N   - The ETC filter correction is applied using the ETC correction function, the correction $ETC_N$ only affects to the measurements performed with filter #N
   - The Stray Light ETC filter correction as depend of he ozone is an iterative process, in most cases only one iteration is needed (OSC<1600 DU) and is enough with two iterations for all the cases (up to OSC 2000DU). On the database two iterations are defined by default.   - The Stray Light ETC filter correction as depend of he ozone is an iterative process, in most cases only one iteration is needed (OSC<1600 DU) and is enough with two iterations for all the cases (up to OSC 2000DU). On the database two iterations are defined by default.
Line 201: Line 208:
 EUBREWNET can generate files with monthly data in the extCSV format requested by the WOUDC (see https://guide.woudc.org/en/) EUBREWNET can generate files with monthly data in the extCSV format requested by the WOUDC (see https://guide.woudc.org/en/)
  
-To generate the WOUDC files, use the URL ''http://www.eubrewnet.org/eubrewnet/woudc/csv'' with the following arguments:+To generate the WOUDC files, use the URL ''http://eubrewnet.aemet.es/eubrewnet/woudc/csv'' with the following arguments:
  
   * ''brewerid'': Brewer serial number.   * ''brewerid'': Brewer serial number.
Line 209: Line 216:
 For example, use For example, use
      
-http://www.eubrewnet.org/eubrewnet/woudc/csv?brewerid=157&date=2019-01+http://eubrewnet.aemet.es/eubrewnet/woudc/csv?brewerid=157&date=2019-01
  
 to get Brewer #157's highest level data (1.5 near real time, 1.6 consolidated NRT, or 2.0 final) for January 2019. to get Brewer #157's highest level data (1.5 near real time, 1.6 consolidated NRT, or 2.0 final) for January 2019.
  
-Note that EUBREWNET's 1.5, 1.6, and 2.0 data levels correspond to WOUDC's level 2.0see https://guide.woudc.org/en/#321-introduction. Files generated by EUBREWNET and submitted to the WOUDC will hence be stored at https://woudc.org/archive/Archive-NewFormat/TotalOzone_2.0_1/+Note that EUBREWNET's 1.5, 1.6, and 2.0 data levels correspond to WOUDC's level 1.0 (see https://guide.woudc.org/en/#321-introduction). Files generated by EUBREWNET and submitted to the WOUDC will hence be stored at https://woudc.org/archive/Archive-NewFormat/TotalOzone_1.0_1/ (**Note the WOUDC level in EUBREWNET's files was changed from 2.0 to 1.0 in August 2024**)
  
 The following arguments are optional: The following arguments are optional:
Line 230: Line 237:
 It is also possible to generate HDF files with monthly data in the GEOMS format (see https://evdc.esa.int/documents/1/geoms-1.0.pdf) accepted by the NDACC, AVDC, and other data centers. It is also possible to generate HDF files with monthly data in the GEOMS format (see https://evdc.esa.int/documents/1/geoms-1.0.pdf) accepted by the NDACC, AVDC, and other data centers.
  
-To generate the GEOMS files, use the URL ''http://www.eubrewnet.org/eubrewnet/geoms/hdf'' with the following arguments:+To generate the GEOMS files, use the URL ''http://eubrewnet.aemet.es/eubrewnet/geoms_uncert/hdf'' with the following arguments:
  
   * ''brewerid'': Brewer serial number.   * ''brewerid'': Brewer serial number.
Line 240: Line 247:
 For example, use For example, use
      
-http://www.eubrewnet.org/eubrewnet/geoms/hdf?brewerid=157&date=2019-02&level=1.5+http://eubrewnet.aemet.es/eubrewnet/geoms_uncert/hdf?brewerid=157&date=2019-02&level=1.5
  
 to get Brewer #157's L1.5 data for February 2019. to get Brewer #157's L1.5 data for February 2019.
Line 254: Line 261:
   * ''file_access'': this is used to fill the ''FILE_ACCESS'' global attribute (see https://evdc.esa.int/documents/1/geoms-1.0.pdf, page 20, section 4.3.3). If more than one data center is specified, please separate their acronyms using only commas, e.g. ''AVDC,NDACC'' (**do not** use semicolons! ''AVDC;NDACC'' will not be interpreted correctly by the server!). If not specified, it defaults to ''NDACC''   * ''file_access'': this is used to fill the ''FILE_ACCESS'' global attribute (see https://evdc.esa.int/documents/1/geoms-1.0.pdf, page 20, section 4.3.3). If more than one data center is specified, please separate their acronyms using only commas, e.g. ''AVDC,NDACC'' (**do not** use semicolons! ''AVDC;NDACC'' will not be interpreted correctly by the server!). If not specified, it defaults to ''NDACC''
  
-You can check the GEOMS-HDF files using the AVDC GEOMS QA checker available at https://avdc.gsfc.nasa.gov/index.php?site=1473794367+  * ''individual'': write all individual measurements instead of daily means 
 + 
 +You can check the GEOMS-HDF files using the GEOMS QA checker available at https://geoms-tool.nilu.no/geoms_file_format_checker
  
 ===== NDACC AMES files ===== ===== NDACC AMES files =====
Line 260: Line 269:
 EUBREWNET can also generate AMES files with monthly data in the format specified by NDACC (see http://ndaccdemo.org/data/formats) EUBREWNET can also generate AMES files with monthly data in the format specified by NDACC (see http://ndaccdemo.org/data/formats)
  
-To generate the AMES files, use the URL ''http://www.eubrewnet.org/eubrewnet/ndacc/ames'' with the following arguments:+To generate the AMES files, use the URL ''http://eubrewnet.aemet.es/eubrewnet/ndacc/ames'' with the following arguments:
  
   * ''brewerid'': Brewer serial number.   * ''brewerid'': Brewer serial number.
Line 270: Line 279:
 For example, use For example, use
      
-http://www.eubrewnet.org/eubrewnet/ndacc/ames?brewerid=157&date=2019-02&level=1.5+http://eubrewnet.aemet.es/eubrewnet/ndacc/ames?brewerid=157&date=2019-02&level=1.5
  
 to get Brewer #157's L1.5 data for February 2019. to get Brewer #157's L1.5 data for February 2019.
Line 285: Line 294:
  
   * ''individual'': write all individual measurements instead of daily means   * ''individual'': write all individual measurements instead of daily means
 +
codes/ozoneproduct.1620911176.txt.gz · Last modified: 2021/05/13 13:06 by jlsolano