- freely available
Water 2013, 5(2), 420-442; doi:10.3390/w5020420
Abstract: Dissolved oxygen concentration is a key parameter for characterizing natural and wastewaters and for assessing the global state of the environment in general. The decrease of dissolved oxygen levels in the world’s oceans, which is becoming increasingly obvious, is expected to have an impact on the whole ecosystem of the Earth, including the carbon cycle, the climate, etc. Dissolved oxygen measurements by sensors are often deemed easy measurements by routine laboratories. In reality, the physical and chemical processes underlying the measurements are complex and these measurements are not at all as robust as often considered. Recently an international in situ interlaboratory comparison measurement of dissolved oxygen concentration took place at the University of Tartu. The results revealed that the routine laboratories as a rule still do not fully master the art of dissolved oxygen concentration measurement: Out of altogether 63 measurement results obtained by the participants 52% were unacceptable according to the En numbers. Based on the analysis of the results of the intercomparison a set of tools and recommendations are given to the participants of how to improve the quality of their results.
Dissolved oxygen (below DO) content in natural waters is an indispensable quantity whenever data are collected for investigations of nature from a hydrobiological, ecological or environmental protection viewpoint . A sufficient concentration of DO is critical for the survival of most aquatic plants and animals as well as for waste water treatment . DO concentration is a key parameter for characterizing natural and wastewaters and for assessing the global state of the environment in general . The decrease of DO levels in the world’s oceans, which is becoming increasingly obvious [3,4,5,6], is expected to have an impact on the whole ecosystem of the Earth, including the carbon cycle , the climate [3,5], etc. The current understanding of the dynamics of the processes and their interrelation is still far from sufficient. Measurement and monitoring of dissolved oxygen concentration is essential for improving that understanding.
The majority of dissolved oxygen measurements are made with the use of amperometric  and optical sensors . The performance of these sensors has dramatically improved over the years . Nevertheless, accurate DO measurement with sensors is not easy because it is influenced by numerous uncertainty sources [8,10,11]. Therefore, the agreement between the sensor-based DO data from different laboratories has long been an issue and has caused a negative perception of the data using sensors in the oceanography community. Because of this, the recent issue of the World Ocean Atlas  was compiled taking into account only DO concentrations obtained with chemical titration methods (first of all the Winkler titration method, WM) and rejecting all sensor-based data. A similar decision was made in a recent study of DO decline rates in coastal oceans . Yet, oceanographers need large amounts of DO data, collected continuously around the clock during lengthy time periods (months), often far away from any human settlement. Only sensor-based automatic measurements can satisfy this need. It is thus important to make every effort to underpin the quality of sensor-based measurements.
DO concentration is a highly unstable parameter of water. Thus preparation of reference solutions that are stable for extended periods of time is almost impossible. This complicates the standardization of the measurements and preparation of certified reference materials (below CRM). This is as true for Winkler titration as it is for sensor measurement of DO concentration. Also Nordtest TR 537  pointed out that there is a “long-term” uncertainty component from the variation in the calibration, which is hard to measure, as no stable reference material or CRM is available for DO measurement. The method suggested in Nordtest TR 537 for Winkler titration was to calibrate the same thiosulfate solution several times during a few days and use the variation between the results for the uncertainty estimation. Nevertheless, the highly important long-term variation component is only estimated by educated guess in Nordtest TR 537, which cannot be considered fully satisfactory and the bias component of uncertainty is not addressed at all.
However, in this paper we present a tool for laboratories: A robust method to prepare an in-house reference material—water saturated with air—for DO measurement, which will help laboratories to estimate their measurement bias. This will enable the use of the increasingly popular Nordtest approach [13,14] and the MUkit software  for measurement uncertainty evaluation. In the Nordtest approach, among other things, control sample and routine sample replicate results are utilized for uncertainty evaluation. Also intercomparison measurement results may be exploited for uncertainty estimation with the Nordtest approach.
Intercomparison measurements are also a viable means of underpinning measurement quality with this unstable analyte. It is difficult to organize DO intercomparisons involving sending samples to the participating laboratories as is usually done in the case of interlaboratory comparisons in other chemical measurements. Given that most DO measurement instruments can be transported in situ, interlaboratory comparisons are a good alternative. (The instrument, also called analyzer, generally consists of an amperometric or optical sensor connected to a data processing and displaying unit). In situ interlaboratory comparisons are intercomparison measurements, where all the participants (with their own equipment and using their own competence) measure the same sample continuously at the same time, at the same site . This arrangement provides the best possibility for assessing participant performance in determining DO content in water (Participant—laboratory participating in the intercomparison and sending a worker and an instrument to the intercomparison).
Recently an international in situ interlaboratory comparison measurement of dissolved oxygen concentration took place at the University of Tartu . The results revealed that the routine laboratories as a rule still do not fully master the art of dissolved oxygen concentration measurement. The purpose of this communication is, based on the results of the interlaboratory comparison, to examine the performance of the laboratories in different parts of the intercomparison, and based on these data, uncover the problems that the participants have and to define a set of recommendations for the improvement of their performance. Also possible future actions for improving competency of DO sensor measurement will be discussed.
2. Experimental Section of the DO Intercomparison
The ESTDO-2012 in situ interlaboratory comparison measurement of dissolved oxygen concentration took place on 23 March 2012 at the Testing Centre of the University of Tartu (below UT), Estonia. The purpose of the intercomparison was twofold: To assess the agreement between the results of DO measurements performed by the personnel of the participant laboratories with their instruments according to their usual working procedures and to improve the measurement competence of the participants. There were thirteen participants to the DO intercomparison, below denoted as: A, B, C, D, E, F, G, H, I, J, K, L and M . The participants are listed in this report but the results are presented in random order, so that the results cannot be traced back to the participants. Every participant received a private letter revealing his/her result number and permitting assessment of performance.
The best comparison of measurement results is possible when the measured value is determined by the participants for the same object in the same location at the same time—in the so-called in situ mode . In this intercomparison the measurements were carried out in water produced by a MilliQ Advantage A10 setup (below MilliQ water) at four saturation concentrations (according to ISO 5814:2012 ), in tap water and in an oxygen-free environment at a concentration of practically 0 mg/L. The DO measurements were carried out in the apparatus shown in Scheme 1 and Figure 1. An additional image of the experimental setup is available from reference .
At saturation conditions the measurements were carried out as follows. Air-saturated MilliQ water was used as the reference medium (equilibrium saturation medium). The pressure, humidity and temperature of the air used for saturation were controlled and taken into account. The saturation medium was created in a modified (a second bath and a mechanical stirrer were added) thermostat CC2-K12 (Peter Huber Kältemaschinenbau GmbH, Germany) in MilliQ water with overall volume 3.9 L (Scheme 1). The obtained temperature variability was lower than 0.01 °C (expressed as standard deviation). The air used for saturation of the reference medium was taken from the air inlet situated on the roof of the building. The air used for saturation was first saturated with water to achieve relative humidity of 100% for the air. The air flow velocity during calibration was around 1 dm3 min−1. The ordinary aquarium spray was used for bubbling (at a depth of 13 cm). The estimated diameter of the bubbles was between 0.8 and 1.8 mm.
The measured environment was stirred using a four-bladed stirrer with constant speed (160 rpm). Thus the DO probes of the participants were arranged concentrically in the bath and were immersed approximately to the same depth for achieving the same velocity of water movement in the location of each sensor. According to our experience over the years , this setup permits achieving the best possible uniformity of the measurement conditions between the participants, and the differences between the DO concentrations in the vicinity of different sensors are negligible. Stirrer dimensions and its location in the reference medium are also given in Scheme 1.
2.1. Calibration of Measurement Equipment
As stated above the purpose of the intercomparison was to assess the agreement between the participant results obtained using their routine work procedures. Therefore the participants were requested to carry out calibration of their measurement instruments in the same way as they would in the case of ordinary field work according to their own procedures and calibration intervals.
2.2. The Measurement Conditions
As reference values (assigned values) for DO, the theoretical DO saturation concentrations were used and they were calculated as described in the standard ISO 5814:2012 . The experimental setup for creating the water saturated with air under carefully controlled conditions and the calculation method for obtaining the reference values and their uncertainties have been verified using the gravimetric Winkler titration method . The uncertainty of the reference value was estimated according to the ISO GUM. All the major uncertainty sources, such as temperature measurement, temperature instability, air pressure, air humidity, oxygen concentration in air, the mathematical model itself, possible over- or undersaturation, etc., were taken into account. The two most important uncertainty sources are possible over- or undersaturation and the uncertainty of the mathematical model itself . The uncertainties of the reference DO concentrations used in this intercomparison were conservatively estimated as ±0.15 mg/L (k = 2). The temperature of the MilliQ water was measured by calibrated digital thermometer Chub-E4 (Model No. 1529, Serial No. A44623, manufacturer Hart Scientific) with two Pt100 sensors (Serial No. 0818 and 0855). The last calibration was made in May 2011 (by the Estonian NMI, AS Metrosert). The uncertainties of all temperature measurements (including the bath instability uncertainty source) are ±0.05 °C (k = 2). The atmospheric pressure was measured by digital barometer PTB330 (Serial No. G37300007, manufactured by Vaisala Oyj, Finland, calibrated by manufacturer 19 September 2011) with uncertainty 10 Pa (k = 2). The level of air humidity after the second saturation vessel was measured using digital hygrometer Almemo 2290–8 with sensor ALMEMO FH A646 E1C (manufacturer AHLBORN Mess- und Regelungstechnik GmbH). The humidity of the air bubbled through the water in the second bath was around 100% RH. The uncertainties of all relative humidity measurements are ±5% RH (k = 2).
The timeline of the intercomparison is presented in Table 1. The measurements started at the highest temperature and every new temperature was lower than the preceding one. Lowering the temperature in order to arrive at the next temperature level started immediately after taking the readings of the participant and reference instruments at the preceding temperature. Sufficient time was allowed for stabilization of the temperature and dissolved oxygen content. Both parameters were monitored and measurements were started only after a stable plateau was seen. The criterion of stability was that DO reading of the monitoring instrument (with optical sensor) did not change by more than 0.01 mg/L during 10 min. The temperature always stabilized faster than the DO reading; therefore the stability of the DO reading automatically equaled the stability of the temperature reading.
|Time window||Reference value of DO concentration||Reference value of temperature||Air pressure||Medium|
|Cref||U, k = 2||tref||U, k = 2||mean||U, k = 2|
|10:39–10:47||8.24||0.15||24.84||0.05||100,757||10||MilliQ water saturated with air (below: SAT25)|
|12:45–12:46||9.07||0.15||19.91||0.05||100,757||10||MilliQ water saturated with air (below: SAT20)|
|14:38–14:42||10.05||0.15||15.04||0.05||100,926||10||MilliQ water saturated with air (below: SAT15)|
|16:56–17:00||12.74||0.15||5.07||0.05||100,932||10||MilliQ water saturated with air (below: SAT5)|
|17:25–17:28||–||–||–||–||–||–||Tapwater at room temperature (below: TAPW)|
|17:31–17:39||0.0||0.01||–||–||–||–||Oxygen-free tapwater (added: Na2SO3 + CoCl2) (below: ZERO)|
The normality of the data sets was tested according to the Kolmogorov-Smirnov normality test  at 0.05 significance level using SPSS® Statistics Version 20. The possible outliers were tested using Hampel’s test . According to the Hampel outlier test participant A produced outliers for DO measurement for all samples except SAT5. Results of participant C were outliers for samples SAT25, SAT20, SAT15 and TAPW. Results of participant H were outliers for samples SAT25 and SAT20. For temperature measurement no outliers were observed. A summary of the Kolmogorov-Smirnov normality test is given in Table 2. The test data for sample ZERO in DO determination was not normally distributed. For all other samples the null hypothesis was retained at a significance level of 0.05. If the result of participant A was removed, then the null hypothesis was also retained for measurement results of sample ZERO. Due to the low number of measurement results all the data were included in the statistical treatment.
|1||The distribution of SAT25 is normal with mean 8.15 and standard deviation 0.75.||One-Sample Kolmogorov-Smirnov Test||0.286||Retain the null hypothesis.|
|2||The distribution of SAT20 is normal with mean 8.97 and standard deviation 0.99.||One-Sample Kolmogorov-Smirnov Test||0.368||Retain the null hypothesis.|
|3||The distribution of SAT15 is normal with mean 9.81 and standard deviation 1.23.||One-Sample Kolmogorov-Smirnov Test||0.321||Retain the null hypothesis.|
|4||The distribution of SAT5 is normal with mean 12.34 and standard deviation 1.14.||One-Sample Kolmogorov-Smirnov Test||0.986||Retain the null hypothesis.|
|5||The distribution of TAPW is normal with mean 7.89 and standard deviation 1.65.||One-Sample Kolmogorov-Smirnov Test||0.112||Retain the null hypothesis.|
|6||The distribution of ZERO is normal with mean 0.31 and standard deviation 0.85.||One-Sample Kolmogorov-Smirnov Test||0.010||Reject the null hypothesis.|
|7||The distribution of T25 is normal with mean 24.88 and standard deviation 0.09.||One-Sample Kolmogorov-Smirnov Test||0.716||Retain the null hypothesis.|
|8||The distribution of T20 is normal with mean 19.91 and standard deviation 0.07.||One-Sample Kolmogorov-Smirnov Test||0.262||Retain the null hypothesis.|
|9||The distribution of T15 is normal with mean 15.02 and standard deviation 0.13.||One-Sample Kolmogorov-Smirnov Test||0.688||Retain the null hypothesis.|
|10||The distribution of T5 is normal with mean 5.20 and standard deviation 0.20.||One-Sample Kolmogorov-Smirnov Test||0.752||Retain the null hypothesis.|
Notes: Asymptotic significances are displayed; The significance level is 0.05.
The reference DO concentration values at different temperatures are given in Table 1. The results of the participant instruments are given in Table 3 and differences of the readings of the participant instruments from the reference values are given in Scheme 2, Scheme 3. Scheme 4 provides the same information (as in Scheme 2) with reduced DO concentration axis. The participant results were recorded in quadruplicate at about 1–3 min intervals using digital photos. Photographing allows recording all the readings within a very short time and preserving and archiving them for the solution of possible disputes. Herein after the word “participant value” or “participant instruments result” is used with the following meaning: It is the mean of the four readings taken as explained above.
The reliability of the reference values of DO was tested according to the criterion
The mean values and standard deviations of the thirteen participating laboratories under five different sets of conditions are presented in Table 4.
Single factor (one-way) analysis of variance (ANOVA) was applied for the data set for calculating the within-laboratory and the between-laboratory standard deviations sw and sb. sw describes the repeatability of measurements, while sb describes the reproducibility of measurements. In this proficiency test the reproducibility (sb) was on an average two to 31 times higher than the repeatability (sw). If the outliers were rejected, the ratio sb/sw remained mainly below 10, being highest for samples SAT25 and SAT20 for DO measurement and T25 for temperature measurement. For the robust measurements the ratio sb/sw should not exceed three . High values were observed mainly due to very low within-laboratory standard deviation. In this type of intercomparison, the above mentioned criterion is actually not applicable, since for the estimation of the within-laboratory standard deviation, successive measurements should be carried out in such a way that the sensor probe is taken out of the reference medium, allowed to settle to the room temperature, immersed again and then allowed to stabilize before the measurement result is recorded. However, this would have been very difficult to carry out in the setup used in our intercomparison.
|Medium a||DO concentration||Temperature|
|mean b||st. dev. c||% st. dev. c||mean b||st. dev. c|
Notes: a See Table 1 for the acronyms; b Mean values of all participating laboratories; c st. dev.: standard deviations.
3.1. Assessing the Agreement between the Participant Values and the Reference Values according to the En Approach
To assess the agreement between the values of the participants and the reference values using the En numbers , uncertainty data of the participant values are needed. The uncertainties of measurement values were estimated by the participants themselves. The expanded uncertainties are presented in Table 5.
Notes: a All expanded uncertainties are given with a coverage factor 2: U = kuc (k = 2). Dash means that no uncertainty was reported by the participant.
It can be seen from Table 1, Table 3, Table 5 that the deviations of the participant often result from the fact that the reference values are significantly higher than the expanded uncertainties of the participants, which means that the uncertainties are in many cases underestimated. We have currently no information about the methods that were used by the participants for estimating measurement uncertainties.
The En numbers for DO concentration are found as follows :
The En numbers for temperature:
Criteria for laboratory performance based on the En numbers:
|En| ≤ 1: (the result and reference value are accordant);
|En| > 1: (the result and reference value are not accordant).
The En number is strongly dependent on the uncertainty of the participant value. Therefore, a close to zero En value does not directly indicate a high quality of the participant value but only the agreement between it and the reference value (which, of course, is an important component of the quality of the result). The |En| numbers of the participants for DO measurement under four sets of conditions (saturation concentration under four temperatures) are given in Table 6. The |En| numbers of the participants for temperature measurement under four sets of conditions (saturation concentration under four temperatures) are given in Table 7.
Notes: a If participant did not report uncertainty its uncertainty was taken as zero; A–I are amperometric measurements; J–M are optical measurements.
Note: a If participant did not report uncertainty its uncertainty was taken as zero.
3.2. Assessing the Agreement between the Participant Values and the Consensus Values According to the Z-Score Approach
||z| Value||Acceptability of the Result||Required Action|
||z| ≤ 2|
|2 < |z| < 3|
||z| ≥ 3|
The |z| scores of the participants for DO measurement under six sets of conditions for DO and four for temperature measurement are presented in Table 9, Table 10, respectively, as well as in Scheme 5.
Notes: a A–I are amperometric measurements; J–M are optical measurements.
Note: a At 20 °C (SAT20) more than 50% of the results were the same. In such cases the Algorithm A breaks down and cannot be used. Instead the arithmetic mean and standard deviation were used as consensus value and target standard deviation, respectively.
3.3. DO Measurements in an Oxygen-Free Solution
The oxygen-free solution was prepared according to the standard ISO 5814:2012  by adding saturated sodium sulfite containing a catalytic amount of cobalt chloride solution to the water. This measurement was first of all meant to check the zero values of the participant instruments. Ideally the so-called “zero value” in the zero-oxygen medium should be zero. There are no predefined criteria available for the evaluation the closeness to zero. Therefore we use criteria based on our earlier experience presented in Table 11.
|Value, x a||Acceptability of the Result||Required Action|
||x| ≤ 0.1|
|0.1 < |x| < 0.3|
||x| ≥ 0.3|
Note: a The reading was recorded after 8 min.
Note: a The reading was recorded after 8 min.
Besides the reading itself, the response time also gives useful information. A short response time means that the sensor has been designed well and is in good working order. A long response time means that the sensor is ill-designed or, in the case of amperometric sensors, the internal electrolyte needs to be replaced and the cathode/anode cleaning or replacing. Response time is usually evaluated using the so-called response factor R%, which is defined as the percentage of reading change (from the final reading change) that occurs during a given time when the medium where the sensor is immersed changes to another:
In our case the sensor was initially immersed in tap water with a DO concentration around 8 mg L−1 and then the DO concentration was brought to zero. The readings were taken after 3 min. The criteria used for assessment of the response time are presented in Table 13.
|R% (3 min)||Acceptability of the Result|
|Participant||R%||Acceptability of the Result|
3.4. Comparing Different Analytical Methods
DO measurement results were grouped according to sensor type used. Most of the participants used sensors based on amperometric measurement (participants A–I). Four of participating laboratories used sensors based on optical measurement. The F-test was applied to find out if there was any significant difference between variances of the DO results obtained from the two different sensor types. If outliers were not rejected, the F-test resulted in unequal variances for all sample mediums. If outliers were rejected, the F-Test resulted in unequal variances only for samples SAT25, SAT15 and SAT5. Unequal variances resulted mainly from the large distribution of the DO results obtained with amperometric sensors. The low number of observations (n = 4) with the optical sensors also made the comparison of these two measurement methods difficult. Reasons for the high scattering of the results are discussed in more detail in Chapter 4.
Two-sample t-test (two-tailed; significance level 0.05) was applied to investigate possible significant differences between averages of the results obtained by the two different sensor types. No significant differences were observed for the averages independent of whether the outliers were rejected or not.
4. Conclusions of DO Intercomparison Results
DO measurements by sensors are often deemed easy measurements by routine laboratories. In reality, the physical and chemical processes underlying the measurements are complex and these measurements are not at all as robust as often considered [8,16]. The results of this intercomparison fully support this statement: Out of altogether 63 measurement results obtained by the participants, 33, which corresponds to 52%, were unacceptable according to the En numbers. According to the z-score approach, the picture is better, but still 11% of the results are unacceptable. The good performance in terms of z-scores is largely also due to the high spread of the participant results.
Assessment of participant performance was carried out in four ways: According to En and z-scores, the zero value and the response factor approach (R%). The En approach needs both an independent reference value and uncertainty estimates from the participants. If a participant has not presented uncertainties for the results or the presented uncertainties are too optimistic then the absolute values of the En scores are automatically inflated and may be above one even if the difference of the result from the reference value is not large. The z-score approach uses statistical criteria only and with the small number of laboratories it is usually very mild. The last two ways are specifically meant to assess whether the sensor is in good working order. Table 15 summarizes the findings of the organizers as recommendations for the laboratories.
According to the En numbers participants using optical sensor performed better than participants using amperometric sensor. In part this may be caused by the optical sensors being more robust in routine use than the amperometric sensors. The latter need careful and skilled maintenance and more frequent calibration in order to perform well. It is clearly seen that in many cases the amperometric sensors were not maintained and calibrated often enough. Measurement with amperometric sensors also needs more skill. However, this was not a factor in this intercomparison, because the sensors of the participants were kept immersed in the constantly stirred solution throughout the intercomparison.
|Participant||Sensor type||Organizer comment|
|A||amperometric||The sensor most probably is at the end of its lifetime (very high zero current and slow response). As a minimum, the electrolyte and membrane (or the whole sensing element) should be replaced. Then new calibration should be performed. Introducing a control chart for monitoring the instrument would be highly advisable.|
|B||amperometric||There is possibly a problem with the temperature measurement and/or compensation in the instrument. Uncertainty evaluation is needed.|
|C||amperometric||It is possible that the sensor is at the end of its lifetime (high zero current). The electrolyte and membrane (or the whole sensing element) should be replaced. More frequent calibration is needed. Uncertainty evaluation is needed. Introducing a control chart for monitoring the instrument would be highly advisable.|
|D||amperometric||It is possible that the sensor is at the end of its lifetime (high zero current). The electrolyte and membrane (or the whole sensing element) should be replaced. New calibration would be advisable. Introducing a control chart for monitoring the instrument would be highly advisable.|
|E||amperometric||More frequent calibration is needed. Uncertainty evaluation is needed. Introducing a control chart for monitoring the instrument would be highly advisable.|
|F||amperometric||There is possibly a problem with the temperature compensation in the instrument. Uncertainty evaluation is needed. Introducing a control chart for monitoring the instrument would be highly advisable.|
|G||amperometric||More frequent calibration is needed. Uncertainty evaluation is needed. Introducing a control chart for monitoring the instrument would be highly advisable.|
|H||amperometric||It is possible that the sensor is at the end of its lifetime (slow response). Calibration is needed. Uncertainty evaluation is needed. Introducing a control chart for monitoring the instrument would be highly advisable.|
|I||amperometric||There is possibly a problem with the temperature compensation in the instrument. Introducing a control chart for monitoring the instrument would be highly advisable.|
|L||optical||Participated in too few measurements to give an overall assessment. Uncertainty evaluation is needed.|
5. Aspects for Improving Quality of the Measurement Results
The commercial DO sensors use a linear calibration function, which calculates the dissolved oxygen concentration from the actual measured signal (current or fluorescence signal). The function is defined inside the sensor using two points—the zero oxygen concentration and the saturation concentration. The zero point is usually fixed electronically. So, the calibration basically consists of recording the signal in the reference medium, which in the case of the commercial DO sensors is usually air saturated with water vapor. Together with calibration the instrument is also automatically adjusted to display the actual concentration of dissolved oxygen.
It should be noted that there are small differences between sensor currents in water and in air. Because of the sensor geometry, in water a so-called unmoved diffusion layer exists, which leads to a signal depression of ~2%. However this is the problem only for amperometric sensors and, therefore, the calibration target for them is 102% in water vapor-saturated air . All commercial oxygen sensors are equipped with manuals that, among other things, describe how to carry out calibration. According to ISO 5814 the calibration should be checked daily and after relevant changes of ambient conditions (i.e., temperature or pressure) .
In the intercomparison, the elapsed time from the last calibration was very different from participant to participant ranging from a few days to over one year. Calibration frequency around once a year is unacceptably low, because the properties of the sensor change with time. This is also seen from the results of this intercomparison. At the same time carrying out calibration is very easy, so that frequent calibration is not a problem even at routine laboratory level.
5.2. “In-House” Reference Material for DO Measurement
Laboratories are encouraged to prepare their own “in-house” reference solution for dissolved oxygen determinations as was prepared in this interlaboratory comparison (see Scheme 1). This solution could be used for sensor calibrations as well as for controlling trueness of Winkler titration method in the laboratory. The steps for preparing the solution are as follows:
Prepare deionized water with a resistivity of 18 MΩ/cm. In ESTDO-2012 a MilliQ Advantage A 10 setup was used.
Place the deionized water into the vessel, which is in the thermostated water bath (for example at 20 °C).
Pump clean air at a flow rate of 1 L/min through two consecutive saturation bottles half filled with the same deionized water. This step is important to ensure that the air used is saturated with water (air humidity is 100%).
Saturate water (Step 2) with the air (Step 3) until the dissolved oxygen reading is stable. Stability criterion: DO reading should not change by more than 0.01 mg/L during 10 min. Usually this kind of stability will be achieved in 2 h (the timealso depends on theinitial concentration) at room temperature. Here the critical step besides the air flow velocity is the size of the air bubble. The optimum diameter of the bubble is between 1 and 2 mm. A smaller bubble size will produce supersaturation. Also, too high an air flow rate can produce supersaturation. We have carried out tests and found that the equilibrium saturation concentration can change in the range of ±0.03 mg/L if the diameters of the bubbles change in the range of 1.3–10 mm (at a temperature of 20 °C this means a relative difference of 0.33%). The bubble diameter was estimated from photographs of the bubbles taken against a ruler positioned in the water.
Measure the temperature of the water (Step 2) and the air pressure next to the water bath as accurately as is possible for your laboratory.
Calculate the dissolved oxygen saturation concentration (CO2_saturation, in Table 1 and in the main text this is equal to Cref) using Equations (6–8) or check the reference value from the ISO 5814:2012 Tables A.4 and A.5 in . ISO 5814 gives the solubility of oxygen in water vs. temperature and atmospheric pressure with 1 °C temperature interval and for air pressures such as 967 hPa, 1000 hPa, 1013 hPa and 1033 hPa.
In order to achieve the DO concentration in the reference medium with a k = 2 expanded uncertainty of 0.2 mg/L or lower, a measuring temperature with k = 2 expanded uncertainty in the range of 0.1 to 0.2 °C is safe. Sufficient k = 2 uncertainty for air pressure measurement is 500 Pa.
5.3. Setting up a Control Chart
A useful way to improve the quality of the measurement results is to maintain a control chart (Shewhart X-chart) . A control chart of the dissolved oxygen concentration measurement can be set up in two ways: Either by measuring oxygen in moist air (saturated with water) or in water saturated with air as was described, step by step, above. Ideally, a data point for the control chart should be recorded every day on which the measurements are done. This enables observing trends in the sensor behavior and taking action before things get out of hand. Detailed guidelines for setting up a control chart can be obtained from the Nordtest Technical Report 569 Internal Quality Control—Handbook for Chemical laboratories .
5.4. Sensor Lifetime
Sensor lifetime is strongly dependent on the sensor type, frequency of use and of maintenance, and the properties of the samples that are measured. It is therefore almost impossible to give a universal estimate of the lifetime. But the laboratories are encouraged to test their sensors (the zero current test and response time test as described above), maintain control charts and participate in interlaboratory comparisons.
6. Discussion and Future Plans
The current intercomparison revealed that a number of participants did not report uncertainties for their results, even though most of them are accredited according to the ISO/IEC 17025 , which states that competent laboratories must evaluate their measurement uncertainties (unless the nature of the measurements precludes this). Use of “in-house” reference material and routine sample replicate results together with control charts enable laboratories to estimate measurement uncertainty of the DO measurement with the Nordtest approach  more easily and more reliably than before. Näykki et al. recently published a paper presenting software support for the measurement of uncertainty evaluation based on the Nordtest approach . In addition setting up control charts and participating in interlaboratory comparison tests may be exploited to check if the self-declared uncertainty estimate is realistic .
Even though we managed to arrange the in situ intercomparison for DO and we may even have, in a controlled way, produced “in-house” reference material for dissolved oxygen measurement, the reference medium in both cases is deionized water, which may be far from the real sample matrix. The needs of the oceanographic community to compare their Seabird-type sensors—designed for use in the sea—are important to note. It was not possible during the ESTDO-2012 to include the Seabird-type sensors, because of the limited size of the setup used. More intercomparisons with real natural water sample matrix are needed, and one such in situ comparison is planned to be arranged in 2014 for DO measurements in the Baltic Sea area in Finland in the framework of the European Metrology Research Programme project ENV05 “Metrology for ocean salinity and acidity” . In this study, the DO measurements will be carried out directly on a ship with the “real sample”—low salinity seawater.
It remains first of all to the laboratories themselves to find out what their problems in particular cases are. However, the organizers hope that the present intercomparison will help them find the right direction.
This work was supported by the European Metrology Research Programme (EMRP), project ENV05 “Metrology for ocean salinity and acidity”. The EMRP is jointly funded by the EMRP participating countries within EURAMET and the European Union.
The work has also been partially supported by the grant No. 9105 from the Estonian Science Foundation and by the joint graduate school “Functional materials and technologies” of Tartu University and Tallinn Technical University receiving funding from the European Social Fund under project 1.2.0401.09-0079 in Estonia.
|1||Quantities, Constants and Result||Value||Unit|
|8||CO2_saturation_st (value at standard conditions)||9.09||mg/L|
|B7||T||=B3 + B21|
|B8||CO2_saturation_st||=(EXP($B$13 + $B$14/(B7) + ($B$15/(B7)^2) + ($B$16/(B7)^3) + ($B$17/(B7)^4)))|
- Nagy, S.A.; Dévai, G.Y.; Grigorszky, I.; Schitchen, C.S.; Tóth, A.; Balogh, E.; Andrikovics, S. The measurement of dissolved oxygen today—Tradition and topicality. Acta Zool. Acad. Sci. Hung. 2008, 54, 13–21. [Google Scholar]
- Hobbs, J.P.A.; McDonald, C.A. Increased seawater temperature and decreased dissolved oxygen triggers fish kill at the Cocos (Keeling) Islands, Indian Ocean. J. Fish Biol. 2010, 77, 1219–1229. [Google Scholar] [CrossRef]
- Keeling, R.F.; Garcia, H.E. The change in oceanic O2 inventory associated with recent global warming. Proc. Natl. Acad. Sci. USA 2002, 99, 7848–7853. [Google Scholar] [CrossRef]
- Shaffer, G.; Olsen, S.M.; Pedersen, J.O.P. Long-term ocean oxygen depletion in response to carbon dioxide emissions from fossil fuels. Nat. Geosci. 2009, 2, 105–109. [Google Scholar] [CrossRef]
- Keeling, R.F.; Körtzinger, A.; Gruber, N. Ocean Deoxygenation in a Warming World. Annu. Rev. Marter. Sci. 2010, 2, 199–229. [Google Scholar] [CrossRef]
- Gilbert, D.; Rabalais, N.N.; Diaz, R.J.; Zhang, J. Evidence for greater oxygen decline rates in the coastal ocean than in the open ocean. Biogeosci. Discuss. 2009, 6, 9127–9160. [Google Scholar] [CrossRef]
- Joos, F.; Plattner, G.-K.; Stocker, T.F.; Körtzinger, A.; Wallace, D.W.R. Trends in marine dissolved oxygen: Implications for ocean circulation changes and the carbon budget. EOS Trans. AGU 2003, 84, 197–204. [Google Scholar] [CrossRef]
- Helm, I.; Jalukse, L.; Leito, I. Measurement uncertainty estimation in amperometric sensors: A tutorial review. Sensors 2010, 10, 4430–4455. [Google Scholar] [CrossRef]
- McDonagh, C.; Burke, C.S.; MacCraith, B.D. Optical chemical sensors. Chem. Rev. 2008, 108, 400–422. [Google Scholar] [CrossRef]
- Johnson, K.S.; Needoba, J.A.; Riser, S.C.; Showers, W.J. Chemical sensor networks for the aquatic environment. Chemical sensor networks for the aquatic environment. Chem. Rev. 2007, 107, 623–640. [Google Scholar] [CrossRef]
- Jalukse, L.; Leito, I. Model-Based measurement uncertainty estimation in amperometric dissolved oxygen concentration measurement. Meas. Sci. Technol. 2007, 18, 1877–1886. [Google Scholar] [CrossRef]
- Garcia, H.E.; Locarnini, R.A.; Boyer, T.P.; Antonov, J.I. World Ocean Atlas 2005, Volume 3: Dissolved Oxygen, Apparent Oxygen Utilization, and Oxygen Saturation; Levitus, S., Ed.; NOAA Atlas NESDIS 63; US Government Printing Office: Washington, DC, USA, 2006. [Google Scholar]
- Magnusson, B.; Näykki, T.; Hovind, H.; Krysell, M. Handbook for Calculation of Measurement Uncertainty in Environmental Laboratories, 3.1 ed; Nordtest TR 537; Nordic Innovation: Oslo, Norway, 2012. [Google Scholar]
- International Standard Organization (ISO), Water Quality—Estimation of Measurement Uncertainty based on Validation and Quality Control Data; ISO 11352:2012; ISO: Geneva, Switzerland, 2012.
- Näykki, T.; Virtanen, A.; Leito, I. Software support for the Nordtest method of measurement uncertainty evaluation. Accred. Qual. Assur. 2012, 6, 603–612. [Google Scholar] [CrossRef]
- Jalukse, L.; Vabson, V.; Leito, I. In situ interlaboratory comparisons for dissolved oxygen concentration and pH. Accred. Qual. Assur. 2006, 10, 562–564. [Google Scholar] [CrossRef]
- Jalukse, L.; Helm, I.; Leito, I. Dissolved Oxygen Concentration Interlaboratory Comparison Measurement, Available online: http://www.ut.ee/katsekoda/ILC/O2_2012/ESTDO-2012_final_report.pdf (accessed on 8 April 2013).
- International Standard Organization (ISO), Water Quality—Determination of Dissolved Oxygen—Electrochemical Probe Method; ISO 5814:2012; ISO: Geneva, Switzerland, 2012.
- Leito, I.; Jalukse, L.; Helm, I. In Situ Interlaboratory Comparison of Dissolved Oxygen at University of Tartu. Available online: http://www.ut.ee/ams/in-situ-interlaboratory-comparison-of-dissolved-oxygen-at-university-of-tartu/ (accessed on 30 March 2012).
- Helm, I.; Jalukse, L.; Leito, I. A highly accurate method for determination of dissolved oxygen: Gravimetric Winkler method. Anal. Chim. Acta 2012, 741, 21–31. [Google Scholar]
- Corder, G.W.; Foreman, D.I. Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 2009. [Google Scholar]
- Linsinger, T.P.J.; Kandler, W.; Krska, R.; Grasserbauer, M. The Influence of different evaluation techniques on the results of interlaboratory comparisons. Accred. Qual. Assur. 1998, 3, 322–327. [Google Scholar] [CrossRef]
- Thompson, M.; Ellison, S.L.R.; Wood, R. The international harmonized protocol for the proficiency testing of analytical chemistry laboratories. Pure Appl. Chem. 2006, 78, 145–196. [Google Scholar] [CrossRef]
- Van der Veen, A.M.H.; Horvat, M.; Milačič, R.; Bučar, T.; Repinc, U.; Ščančar, J.; Jaćimovićet, R. Operation of a proficiency testing scheme of trace elements in sewage sludge with reference values. Accred. Qual. Assur. 2001, 6, 264–268. [Google Scholar] [CrossRef]
- International Standard Organization (ISO), Conformity Assessment—General Requirements for Proficiency Testing; EN ISO-IEC 17043:2010; ISO: Geneva, Switzerland, 2010.
- International Standard Organization (ISO), Statistical Methods for Use in Proficiency Testing by Interlaboratory Comparisons; ISO 13528:2005; ISO: Geneva, Switzerland, 2005.
- Benson, B.B.; Krause, D., Jr. The concentration and isotopic fractionation of gases dissolved in freshwater in equilibrium with the atmosphere. 1. Oxygen. Limnol. Oceanogr. 1980, 25, 662–671. [Google Scholar] [CrossRef]
- Mortimer, C.H. The oxygen content of air-saturated freshwaters over ranges of temperature and atmospheric pressure of limnological interest. Mitt. Int. Ver. Theor. Angew. Limnol. 1981, 22, 1–23. [Google Scholar]
- Hovind, H.; Magnusson, B.; Krysell, M.; Lund, U.; Mäkinen, I. Internal Quality Control, 4th ed; Nordtest Technical Report 569; Nordic Innovation: Oslo, Norway, 2011. [Google Scholar]
- International Standard Organization (ISO), General Requirements for the Competence of Testing and Calibration Laboratories; ISO/IEC 17025:2005; ISO: Geneva, Switzerland, 2005.
- Analytical Method Committee. Is My Uncertainty Estimate Realistic? Available online: http://www.rsc.org/images/realistic-estimate-technical-brief-15_tcm18-214874.pdf (accessed on 8 April 2013).
- European Metrology Research Programme. EMRP ENV05 project “Metrology for ocean salinity and acidity”. Available online: http://www.ptb.de/emrp/env05.html (accessed on 8 April 2013).
© 2013 by the authors; licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).