codes:calibration
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
codes:calibration [2024/02/08 16:45] jlsolano [Temperature Coefficients] |
codes:calibration [2024/04/19 09:48] (current) jlsolano [Temperature Coefficients] |
||
|---|---|---|---|
| Line 13: | Line 13: | ||
| - ''enddate'': see [[codes:dbaccess#common_inputs|Enddate in common inputs]] | - ''enddate'': see [[codes:dbaccess#common_inputs|Enddate in common inputs]] | ||
| - ''format'': see [[codes:dbaccess#format|Format]] | - ''format'': see [[codes:dbaccess#format|Format]] | ||
| - | - ''data'': input data used, available options are ''o3l15'' (default if the option is not passed in the url), ''o3l15v2'', ''o3l1'', ''sco3'' for the O3L1.5, O3L1.5V2, O3L1 and sun scan measurements, respectively. For the ''sco3'' option, the ''step'' option with the value of the micrometer step must be also passed in the url; if checking a mic step which does not correspond to the cal step, it's also recommended to pass the ozone absorption coefficient specific to that mic step using the ''urlconfig'' option, see below. Individual observations (not summaries) are used in all cases unless ''use_summaries'' is selected, see below. | + | - ''data'': input data used, available options are ''o3l15'' (default if the option is not passed in the url), ''o3l15v2'', ''o3l1'', ''sco3'', ''UNCL15'' for the O3L1.5, O3L1.5V2, O3L1, sun scan, and UNCL1.5 measurements, respectively. For the ''sco3'' option, the ''step'' option with the value of the micrometer step must be also passed in the url; if checking a mic step which does not correspond to the cal step, it's also recommended to pass the ozone absorption coefficient specific to that mic step using the ''urlconfig'' option, see below. Individual observations (not summaries) are used in all cases unless ''use_summaries'' is selected, see below. For the ''uncl15'' option, the fit is done using York's method (see [[https://github.com/duncombe/matlab/blob/master/york_curve_fit_0_01/york_fit.m|this MATLAB]] and [[https://gist.github.com/mikkopitkanen/ce9cd22645a9e93b6ca48ba32a3c85d0|this Python]] implementations) |
| + | - ''so2'': calculate the SO2 ETC instead of the (default) O3 one | ||
| - ''calc'': calculation to perform, available options are ''etc'' (Langley-plot with all the data, default option), ''filters'' (the Langley-plot fit is done using dummy variables for filters 3, 4, 5, and thus allows to determine the ETC filter correction of those filters with respect to the ETC obtained for the set measurements with filters 0, 1, and 2), and ''filters_etc'' (this option performs two fits: first, a ''filters'' run to determine the ETC filter corrections, and then an ''etc'' calculation using these ETC filter corrections). For ''etc'' runs, two different fits are performed: ''ms9'' vs ''airmass'' (brewer method) and ''ms9/airmass'' vs ''1/airmass'' (dobson method) | - ''calc'': calculation to perform, available options are ''etc'' (Langley-plot with all the data, default option), ''filters'' (the Langley-plot fit is done using dummy variables for filters 3, 4, 5, and thus allows to determine the ETC filter correction of those filters with respect to the ETC obtained for the set measurements with filters 0, 1, and 2), and ''filters_etc'' (this option performs two fits: first, a ''filters'' run to determine the ETC filter corrections, and then an ''etc'' calculation using these ETC filter corrections). For ''etc'' runs, two different fits are performed: ''ms9'' vs ''airmass'' (brewer method) and ''ms9/airmass'' vs ''1/airmass'' (dobson method) | ||
| - ''minairmass'': airmass minimum in ''etc'' calculations (defaults to 1.70 if the option is not passed in the url) | - ''minairmass'': airmass minimum in ''etc'' calculations (defaults to 1.70 if the option is not passed in the url) | ||
| Line 26: | Line 27: | ||
| - ''use_summaries'': if passed as an option, use summaries instead of individual observations for o3l15 and o3l15v2 data. Note the default values for ''minobs'' and ''filter_minobs'' (25 and 15, respectively) are provided as a guide for calculations with individual observations, the user must set suitable values (eg, 5 for ''minobs'') if ''use_summaries'' is passed. | - ''use_summaries'': if passed as an option, use summaries instead of individual observations for o3l15 and o3l15v2 data. Note the default values for ''minobs'' and ''filter_minobs'' (25 and 15, respectively) are provided as a guide for calculations with individual observations, the user must set suitable values (eg, 5 for ''minobs'') if ''use_summaries'' is passed. | ||
| - ''urlconfig'': allows setting the configuration's parameters, overriding the values in Eubrewnet's database. For example, to set a value of 0.4 for the ozone absorption coefficient, add ''&urlconfig&o3o3rate=0.4'' to the url, and to set specific values for the filter corrections add ''&urlconfig&fc=1,2,3,4,5'' | - ''urlconfig'': allows setting the configuration's parameters, overriding the values in Eubrewnet's database. For example, to set a value of 0.4 for the ozone absorption coefficient, add ''&urlconfig&o3o3rate=0.4'' to the url, and to set specific values for the filter corrections add ''&urlconfig&fc=1,2,3,4,5'' | ||
| - | - ''debug'': include debug output. As of 2023-06-29, this returns four additional vectorial fields, 'airmass', 'ms9', 'filt', and 'solartime', with the raw data used in the half-day langley fit. | + | - ''debug'': include debug output. As of 2023-06-29, this returns four additional vectorial fields, ''airmass'', ''ms9'', ''filt'', and ''solartime'', with the raw data used in the half-day langley fit. |
| * Output: | * Output: | ||
| - ''date'': date and time of each half-day langley, morning langleys correspond to 00 time, and afternoon ones, to 12 | - ''date'': date and time of each half-day langley, morning langleys correspond to 00 time, and afternoon ones, to 12 | ||
| - | - ''etc'': calculated ETC | + | - ''etc'': calculated ETC |
| - | - ''o3xabs'': calculated ozone multiplied by the ozone absorption coefficient | + | - ''rmse'' or ''u_etc'': root mean squared error or uncertainty in the ETC as calculated in the York method (only for the ''uncl15'' input) |
| + | - ''tau'': in the case of the determination of the O3 ETC, this corresponds to the ozone optical depth -- ie, the ozone multiplied by the ozone absorption coefficient. For the SO2 ETC, this is the sum of the SO2 and O3 optical depths, in the space of the SO2 ratios | ||
| - ''rsquared'': r<sup>2</sup> of the langley fit | - ''rsquared'': r<sup>2</sup> of the langley fit | ||
| - ''nobs'': number of observations used in the fit | - ''nobs'': number of observations used in the fit | ||
| Line 118: | Line 120: | ||
| - ''alpha'': Outliers can be removed by giving the alpha parameter a value greater than zero. In this case, after performing the linear regression, all measures whose residuals are greater than the standard deviation of all residuals multiplied by the alpha factor will be removed, and the linear regression will be repeated. This process is repeated iteratively until all values are below this threshold. | - ''alpha'': Outliers can be removed by giving the alpha parameter a value greater than zero. In this case, after performing the linear regression, all measures whose residuals are greater than the standard deviation of all residuals multiplied by the alpha factor will be removed, and the linear regression will be repeated. This process is repeated iteratively until all values are below this threshold. | ||
| - ''step'': optional, if passed uses the data from the JL measurements at the requested mic step. JL measurements are corrected using the linear temperature coefficient and the filter attenuations corresponding to each wavelength, as available in the AOD configuration operative at the beginning of the requested date range (''date'') | - ''step'': optional, if passed uses the data from the JL measurements at the requested mic step. JL measurements are corrected using the linear temperature coefficient and the filter attenuations corresponding to each wavelength, as available in the AOD configuration operative at the beginning of the requested date range (''date'') | ||
| + | - ''time'': optional, if passed, the time evolution of the lamp intensity is considered in the analysis, including in the linear regression a degree 3 dependence on time. | ||
| + | - ''urlconfig'': allows setting the configuration's parameters, overriding the values in Eubrewnet's database. | ||
| * Output: the following fields are included in the output: | * Output: the following fields are included in the output: | ||
| - | - ''channel'': Brewer measurement channels in the ozone position plus R5 and R6 (the later are not included in the JL output) | + | - ''channel'': Brewer measurement channels in the ozone position plus R5 and R6 (the latter are not included in the JL output) |
| - ''a'': intercept value for the linear regression. | - ''a'': intercept value for the linear regression. | ||
| - ''sa'': standard error of the intercept of the linear regression. | - ''sa'': standard error of the intercept of the linear regression. | ||
| Line 125: | Line 129: | ||
| - ''sb'': standard error of the slope of the linear regression. | - ''sb'': standard error of the slope of the linear regression. | ||
| - ''r2'': R-squared of the linear regression. | - ''r2'': R-squared of the linear regression. | ||
| + | - ''tmin'': Minimum temperature used in the linear regression. | ||
| + | - ''tmax'': Maximum temperature used in the linear regression. | ||
| + | - If the parameter ''time'' is passed, three more coefficients are returned (the time dependence considered is of degree 3) together with their standard errors: c,sc,d,sd,e,se. | ||
| ---- | ---- | ||
| Line 236: | Line 243: | ||
| - ''enddate'': see [[codes:dbaccess#common_inputs|Enddate in common inputs]] | - ''enddate'': see [[codes:dbaccess#common_inputs|Enddate in common inputs]] | ||
| - ''format'': see [[codes:dbaccess#format|Format]] | - ''format'': see [[codes:dbaccess#format|Format]] | ||
| + | - ''debug'': In the output, individual measurements are returned instead of hourly averages. | ||
| * Output: | * Output: | ||
| - ''gmt'': UTC time. | - ''gmt'': UTC time. | ||
| - | - ''o3_avg'': Mean hourly ozone for brewerid. | + | - ''o3_avg'': Mean hourly ozone L1.5 for brewerid. |
| - | - ''o3_era5'' Total ozone column from ERA5. | + | - ''o3_era5'' Total ozone column from ERA5 for the station at which the brewer was at ''date''. |
| - ''diff'': difference between o3_avg and o3_era5 in Dobson units. | - ''diff'': difference between o3_avg and o3_era5 in Dobson units. | ||
| - ''reldiff'': relative difference between o3_avg and o3_era5 in % | - ''reldiff'': relative difference between o3_avg and o3_era5 in % | ||
codes/calibration.1707410716.txt.gz · Last modified: 2024/02/08 16:45 by jlsolano
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 3.0 Unported
