Eubrewnet Wiki

User Tools

Site Tools

Trace:
codes:calibration

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
codes:calibration [2024/02/29 12:40] – [Temperature Coefficients] ajberjoncodes:calibration [2024/09/19 10:06] (current) – external edit 127.0.0.1
Line 1: Line 1:
-===== Calibration Functions =====+/==== Calibration Functions =====
  
 This page provides a brief overview of the functions avaliable in Eubrewnet to determine Brewer configuration parameters. This page provides a brief overview of the functions avaliable in Eubrewnet to determine Brewer configuration parameters.
Line 7: Line 7:
   * Function: ''langley''   * Function: ''langley''
   * Description: Determine the ETC and the ETC filter corrections applying the Langley-plot method to each half day.   * Description: Determine the ETC and the ETC filter corrections applying the Langley-plot method to each half day.
-  * Access function example: https://rbcce.aemet.es/eubrewnet/data/cal/langley?brewerid=185&date=2022-04-01&enddate=2022-04-10&format=text +  * Access function example: https://eubrewnet.aemet.es/eubrewnet/data/cal/langley?brewerid=185&date=2022-04-01&enddate=2022-04-10&format=text 
-  * Input: a complete list of input arguments is provided next, but we strongly recommed to use the web interface at https://rbcce.aemet.es/eubrewnet/caldata/langley to access this function+  * Input: a complete list of input arguments is provided next, but we strongly recommed to use the web interface at https://eubrewnet.aemet.es/eubrewnet/caldata/langley to access this function
       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]
       - ''date'': see [[codes:dbaccess#common_inputs|Date in common inputs]]       - ''date'': see [[codes:dbaccess#common_inputs|Date in common inputs]]
Line 44: Line 44:
     * Function: ''fcor_o3dif''     * Function: ''fcor_o3dif''
     * Description: this function returns the ETC filter corrections (with respect to the mean of filters 1 and 2) as calculated from the ozone differences of near-simultaneous measurements taken with different filters. Mathematically, for two measurements taken with different filters at almost the same airmass μ and with a ΔO3L1 difference in the (uncorrected) ozone, Δfiltercorr=ΔO3L1∗μ∗abscoeff∗10     * Description: this function returns the ETC filter corrections (with respect to the mean of filters 1 and 2) as calculated from the ozone differences of near-simultaneous measurements taken with different filters. Mathematically, for two measurements taken with different filters at almost the same airmass μ and with a ΔO3L1 difference in the (uncorrected) ozone, Δfiltercorr=ΔO3L1∗μ∗abscoeff∗10
-    * Access function example: https://rbcce.aemet.es/eubrewnet/data/cal/fcor_o3dif?brewerid=185&format=text&minutes=15&airmass=0.03&date=2022-01-01&enddate=2022-02-01+    * Access function example: https://eubrewnet.aemet.es/eubrewnet/data/cal/fcor_o3dif?brewerid=185&format=text&minutes=15&airmass=0.03&date=2022-01-01&enddate=2022-02-01
     * Input:     * Input:
       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]
Line 64: Line 64:
     * Function: ''fcor_o3dif_raw''     * Function: ''fcor_o3dif_raw''
     * Description: this function returns the raw data used in the fcor_o3dif function. That is, it returns Δfiltercorr=ΔO3L1∗μ∗abscoeff∗10 for each pair of measurements, without referring the result to filters 1 and 2 nor calculating any median over a date range.     * Description: this function returns the raw data used in the fcor_o3dif function. That is, it returns Δfiltercorr=ΔO3L1∗μ∗abscoeff∗10 for each pair of measurements, without referring the result to filters 1 and 2 nor calculating any median over a date range.
-    * Access function example: https://rbcce.aemet.es/eubrewnet/data/cal/fcor_o3dif_raw?brewerid=185&format=text&minutes=15&airmass=0.03&date=2022-01-01&enddate=2022-02-01+    * Access function example: https://eubrewnet.aemet.es/eubrewnet/data/cal/fcor_o3dif_raw?brewerid=185&format=text&minutes=15&airmass=0.03&date=2022-01-01&enddate=2022-02-01
     * Input:     * Input:
       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]
Line 90: Line 90:
     * Function: ''fcor_fioavg''     * Function: ''fcor_fioavg''
     * Description: this function returns the ETC filter corrections (with respect to the mean of filters 1 and 2) as calculated from the results of the Brewer filter tests with the standard lamp, as found in the FIOAVG file.     * Description: this function returns the ETC filter corrections (with respect to the mean of filters 1 and 2) as calculated from the results of the Brewer filter tests with the standard lamp, as found in the FIOAVG file.
-    * Access function example: https://rbcce.aemet.es/eubrewnet/data/cal/fcor_fioavg?brewerid=185&format=text&date=2022-01-01&enddate=today+    * Access function example: https://eubrewnet.aemet.es/eubrewnet/data/cal/fcor_fioavg?brewerid=185&format=text&date=2022-01-01&enddate=today
     * Input:     * Input:
       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]
Line 120: Line 120:
       - ''alpha'': Outliers can be removed by giving the alpha parameter a value greater than zero. In this case, after performing the linear regression, all measures whose residuals are greater than the standard deviation of all residuals multiplied by the alpha factor will be removed, and the linear regression will be repeated. This process is repeated iteratively until all values are below this threshold.       - ''alpha'': Outliers can be removed by giving the alpha parameter a value greater than zero. In this case, after performing the linear regression, all measures whose residuals are greater than the standard deviation of all residuals multiplied by the alpha factor will be removed, and the linear regression will be repeated. This process is repeated iteratively until all values are below this threshold.
       - ''step'': optional, if passed uses the data from the JL measurements at the requested mic step. JL measurements are corrected using the linear temperature coefficient and the filter attenuations corresponding to each wavelength, as available in the AOD configuration operative at the beginning of the requested date range (''date'')       - ''step'': optional, if passed uses the data from the JL measurements at the requested mic step. JL measurements are corrected using the linear temperature coefficient and the filter attenuations corresponding to each wavelength, as available in the AOD configuration operative at the beginning of the requested date range (''date'')
-      - ''time'': optional, if passed, the time evolution of the lamp intensity is considered in the analysis, including in the linear regression a degree 3 dependence on time. +      - ''time'': optional, if passed, the time evolution of the lamp intensity is considered in the analysis, including in the linear regression a degree 3 dependence on time. 
 +      - ''urlconfig'': allows setting the configuration's parameters, overriding the values in Eubrewnet's database.
   * Output: the following fields are included in the output:   * Output: the following fields are included in the output:
       - ''channel'': Brewer measurement channels in the ozone position plus R5 and R6 (the latter are not included in the JL output)       - ''channel'': Brewer measurement channels in the ozone position plus R5 and R6 (the latter are not included in the JL output)
Line 130: Line 131:
       - ''tmin'': Minimum temperature used in the linear regression.       - ''tmin'': Minimum temperature used in the linear regression.
       - ''tmax'': Maximum temperature used in the linear regression.       - ''tmax'': Maximum temperature used in the linear regression.
-      - If the parameter 'time' is passed, three coefficients are returned (the time dependence considered is of degree 3) together with their standard errors: c,sc,d,sd,e,se. +      - If the parameter ''time'' is passed, three more coefficients are returned (the time dependence considered is of degree 3) together with their standard errors: c,sc,d,sd,e,se.  
 ---- ----
  
Line 166: Line 168:
   * Function: ''CI'' or ''CJ''    * Function: ''CI'' or ''CJ'' 
   * Description: Return the data from the CI (forward scan) or CJ (forward and backward scans) lamp tests. For CJ, the two scans are shown as two measurements with close but different times.   * Description: Return the data from the CI (forward scan) or CJ (forward and backward scans) lamp tests. For CJ, the two scans are shown as two measurements with close but different times.
-  * Example: [[https://rbcce.aemet.es/eubrewnet/data/get/CJ?brewerid=258&date=2023-04-01&enddate=2023-05-01&format=text&fields=gmt,lamp,raw_counts*]]+  * Example: [[https://eubrewnet.aemet.es/eubrewnet/data/get/CJ?brewerid=258&date=2023-04-01&enddate=2023-05-01&format=text&fields=gmt,lamp,raw_counts*]]
   * Input:   * Input:
       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]
Line 188: Line 190:
   * Function: ''CZ''    * Function: ''CZ'' 
   * Description: Return the data from the CZ lamp tests. Because in this test the wavelengths are defined by the Brewer operator, Eubrewnet's output is different than in the case of the CI/CJ tests. In particular,  the ''l'' in fields such as ''mmmm_l'' is now just a numerical index from 0 to 149, and the wavelengths are shown in the new ''wavelengths_l'' fields   * Description: Return the data from the CZ lamp tests. Because in this test the wavelengths are defined by the Brewer operator, Eubrewnet's output is different than in the case of the CI/CJ tests. In particular,  the ''l'' in fields such as ''mmmm_l'' is now just a numerical index from 0 to 149, and the wavelengths are shown in the new ''wavelengths_l'' fields
-  * Example: [[https://rbcce.aemet.es/eubrewnet/data/get/CZ?brewerid=183&date=2023-02-11&format=text]]+  * Example: [[https://eubrewnet.aemet.es/eubrewnet/data/get/CZ?brewerid=183&date=2023-02-11&format=text]]
   * Input: same as for the CI and CJ functions, see above   * Input: same as for the CI and CJ functions, see above
   * Output: the output is quite similar to that of the CI and CJ functions, the main difference being that the ''_l'' suffix is now a numerical index instead of a wavelength. There are also some new fields:   * Output: the output is quite similar to that of the CI and CJ functions, the main difference being that the ''_l'' suffix is now a numerical index instead of a wavelength. There are also some new fields:
Line 200: Line 202:
   * Function: ''NI''    * Function: ''NI'' 
   * Description: Return the data from the NI responsivity tests.    * Description: Return the data from the NI responsivity tests. 
-  * Example: [[https://rbcce.aemet.es/eubrewnet/data/get/NI?brewerid=185&date=2022-08-31&format=text]]+  * Example: [[https://eubrewnet.aemet.es/eubrewnet/data/get/NI?brewerid=185&date=2022-08-31&format=text]]
   * Input:   * Input:
       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]
Line 217: Line 219:
   * Functions: ''HS'' and ''HL''   * Functions: ''HS'' and ''HL''
   * Description: Return the data from the short (2950 – 2984 Å) and long (3331 – 3351 Å) wavelength-range Mercury lamp tests   * Description: Return the data from the short (2950 – 2984 Å) and long (3331 – 3351 Å) wavelength-range Mercury lamp tests
-  * Example: [[https://rbcce.aemet.es/eubrewnet/data/get/HL?brewerid=185&date=2022-08-31&format=text]]+  * Example: [[https://eubrewnet.aemet.es/eubrewnet/data/get/HL?brewerid=185&date=2022-08-31&format=text]]
   * Input:   * Input:
       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]       - ''brewerid'': see [[codes:dbaccess#common_inputs|Brewerid in common inputs]]
Line 241: Line 243:
       - ''enddate'': see [[codes:dbaccess#common_inputs|Enddate in common inputs]]       - ''enddate'': see [[codes:dbaccess#common_inputs|Enddate in common inputs]]
       - ''format'': see [[codes:dbaccess#format|Format]]       - ''format'': see [[codes:dbaccess#format|Format]]
 +      - ''debug'': In the output, individual measurements are returned instead of hourly averages.
   * Output:   * Output:
       - ''gmt'': UTC time.       - ''gmt'': UTC time.
-      - ''o3_avg'': Mean hourly ozone for brewerid. +      - ''o3_avg'': Mean hourly ozone L1.5 for brewerid. 
-      - ''o3_era5'' Total ozone column from ERA5.+      - ''o3_era5'' Total ozone column from ERA5 for the station at which the brewer was at ''date''.
       - ''diff'': difference between o3_avg and o3_era5 in Dobson units.       - ''diff'': difference between o3_avg and o3_era5 in Dobson units.
       - ''reldiff'': relative difference between o3_avg and o3_era5 in %       - ''reldiff'': relative difference between o3_avg and o3_era5 in %
-.+ 
 +---- 
 + 
 +==== ERA5 ==== 
 +  * Functions: ''ERA5'' 
 +  * Description: Retrieve the [[https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-pressure-levels|Total ozone column product from the ERA5 reanalysis provided by ECMWF]]. 
 +  * Example: [[http://eubrewnet.aemet.es/eubrewnet/data/get/ERA5?gaw_id=IZO&date=2022-01-01&enddate=2022-01-13&format=text]] 
 +  * Input: 
 +      - ''gaw_id'' or ''stationid'': GAW or Eubrewnet station id. 
 +      - ''date'': see [[codes:dbaccess#common_inputs|Date in common inputs]] 
 +      - ''enddate'': see [[codes:dbaccess#common_inputs|Enddate in common inputs]] 
 +      - ''format'': see [[codes:dbaccess#format|Format]] 
 + 
 +  * Output: 
 +      - ''gmt'': UTC time. 
 +      - ''o3'' Total ozone column from ERA5 for the station at which the brewer was at ''date''. 
 +      - ''stationid'': Eubrewnet station id. 
 + 
 +---- 
 + 
 +==== compareO3 ==== 
 +  * Functions: ''compareO3'' 
 +  * Description: compare the O3L1.5 measurements of two brewers 
 +  * Example: [[http://eubrewnet.aemet.es/eubrewnet/data/get/compareO3?brewerid=185&compid=258&date=2024-08-23&format=text&maxminutes=10&avg]] 
 +  * Input: 
 +      - ''brewerid'' and ''compid'': ids of the reference and to-be-compared brewers, respectively. 
 +      - ''maxminutes'': maximum difference in minutes between the measurements of the two brewers. If not provided, defaults to 2.5 minutes 
 +      - ''avg'': return the average of the comp measurements corresponding to each one of the reference. If not passed as an argument, each individual measurement is listed in the output 
 +      - ''date'': see [[codes:dbaccess#common_inputs|Date in common inputs]] 
 +      - ''enddate'': see [[codes:dbaccess#common_inputs|Enddate in common inputs]] 
 +      - ''format'': see [[codes:dbaccess#format|Format]] 
 + 
 +  * Output: 
 +      - ''gmt'' and ''compgmt'': UTC time of the reference and to-be-compared brewers, respectively. 
 +      - ''o3'' and ''compo3'': total ozone column values. 
 +      - ''airmass'' and ''compairmass'': airmasses. 
 +      - ''osc'' and ''composc'': OSC=ozone*airmass values 
 +      - ''filt'' and ''compfilt'': filter positions 
 +      - ''deltaminutes'': difference in minutes between the measurements 
 +      - (only if ''avg'' is passed as option) ''compn'' and ''compsdo3'': number of measurements and the standard deviation of the o3, respectively, for all the comp measurements within ''maxminutes'' of the time of the reference. Note the other comp fields correspond to averages of the comp measurements. 
 ---- ----
  
codes/calibration.1709210411.txt.gz · Last modified: 2024/02/29 12:40 by ajberjon