Next Article in Journal
A Multitasking-Oriented Robot Arm Motion Planning Scheme Based on Deep Reinforcement Learning and Twin Synchro-Control
Next Article in Special Issue
Evaluation of Full-Body Gestures Performed by Individuals with Down Syndrome: Proposal for Designing User Interfaces for All Based on Kinect Sensor
Previous Article in Journal
Multimodal Emotion Evaluation: A Physiological Model for Cost-Effective Emotion Classification
Previous Article in Special Issue
Study of Postural Stability Features by Using Kinect Depth Sensors to Assess Body Joint Coordination Patterns
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Optimal Use of Titanium Dioxide Colourant to Enable Water Surfaces to Be Measured by Kinect Sensors

1
Department of Civil and Structural Engineering, The University of Sheffield, Sir Frederick Mappin Building, Mappin Street, Sheffield S1 3JD, UK
2
School of Energy, Construction and Environment, Faculty of Engineering, Environment and Computing, Coventry University, Coventry CV1 5FB, UK
3
Centre for Agroecology, Water and Resilience, Coventry University, Wolston Lane, Coventry CV8 3LG, UK
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(12), 3507; https://doi.org/10.3390/s20123507
Submission received: 13 May 2020 / Revised: 10 June 2020 / Accepted: 17 June 2020 / Published: 21 June 2020

Abstract

:
Recent studies have sought to use Microsoft Kinect sensors to measure water surface shape in steady flows or transient flow processes. They have typically employed a white colourant, usually titanium dioxide (TiO2), in order to make the surface opaque and visible to the infrared-based sensors. However, the ability of Kinect Version 1 (KV1) and Kinect Version 2 (KV2) sensors to measure the deformation of ostensibly smooth reflective surfaces has never been compared, with most previous studies using a V1 sensor with no justification. Furthermore, the TiO2 has so far been used liberally and indeterminately, with no consideration as to the type of TiO2 to use, the optimal proportion to use or the effect it may have on the very fluid properties being measured. This paper examines the use of anatase TiO2 with two generations of the Microsoft Kinect sensor. Assessing their performance for an ideal flat surface, it is shown that surface data obtained using the V2 sensor is substantially more reliable. Further, the minimum quantity of colourant to enable reliable surface recognition is discovered (0.01% by mass). A stability test shows that the colourant has a strong tendency to settle over time, meaning the fluid must remain well mixed, having serious implications for studies with low Reynolds number or transient processes such as dam breaks. Furthermore, the effect of TiO2 concentration on fluid properties is examined. It is shown that previous studies using concentrations in excess of 1% may have significantly affected the viscosity and surface tension, and thus the surface behaviour being measured. It is therefore recommended that future studies employ the V2 sensor with an anatase TiO2 concentration of 0.01%, and that the effects of TiO2 on the fluid properties are properly quantified before any TiO2-Kinect-derived dataset can be of practical use, for example, in validation of numerical models or in physical models of hydrodynamic processes.

1. Introduction

The dynamic pattern on the free surface of open channel flows varies according to the flow rate and boundary conditions. Previous research has found that turbulence generated near the bottom of a channel by the bursting phenomenon is transferred towards the water surface [1]. More recent work has clarified somewhat the link by showing that water surface fluctuations in shallow flows can be associated with the underlying velocity field and turbulence, which can in turn be related to the flow conditions, boundary conditions and hydraulic processes [2,3,4,5,6,7]. Despite this, there is still a lack of detailed explanation regarding the link between free-surface features and the underlying flow conditions [1,8,9,10]. Investigating the relationship between the underlying flow and the free surface is crucial as it has the potential to enable remote, nonintrusive measurement of flow processes. It could therefore find applications in remote flow monitoring, sediment entrainment studies and pollutant transport.
However, this potential can only be realised via an ability to accurately characterise the three-dimensional dynamic surface roughness patterns of turbulent flows. Several techniques exist for measuring water surface position [11,12,13,14,15,16,17,18], but these techniques are either prohibitively expensive and complex, limited in their spatial resolution or difficult to implement in the field, or generally measure only in one or two dimensions.
Based on limitations identified by previous studies of other techniques (e.g., point gauges, surface profiling systems [19,20,21,22] or laser scanners [23]), there is a need for measurement techniques that can be affordable, easy to use and accurate at the same time. To date, Microsoft Kinect sensors have been used for a range of scientific applications including: (i) 3D indoor mapping [24], (ii) real-time 3D modelling [25], (iii) health care [26,27], (iv) surveillance [28], (v) earth sciences [29], (vi) morphological measurements [30,31] and (vii) musculoskeletal disorders [32]. Gonzalez-Jorge et al. [33] demonstrated how the depth accuracy of these sensors is dependent on the distance to the measured objects and other studies have explored the differences in accuracy and reliability between the two sensors for common 3D reconstruction applications [34,35,36,37,38]. Gonzalez-Jorge et al. [34] highlighted how Kinect Version 2 (KV2) performs more accurately in indoor conditions, and Wasenmüller and Stricker’s comprehensive comparison of KV1 and KV2 [35] also found KV2 to provide superior data quality. However, no direct comparison between KV1 and KV2 has been presented for dynamic water surfaces, which are ostensibly smooth and reflective.
Nichols and Rubinato [39] first presented an initial examination of the use of Kinect sensors for low-cost 3D measurements of flowing water surfaces, and other studies have since applied the same technique [40,41,42,43,44]. While the popularity of using Kinect sensors for hydraulic experiments is growing, more research is needed to explore this potential and limitations of Kinect technology under multiple hydraulic and experimental conditions. Nichols and Rubinato [39] showed that the Kinect has the potential to measure gravity waves and may also be used to measure turbulence-generated free-surface roughness. They showed that titanium dioxide (TiO2) could be used to colour the water and cause its surface to become opaque so that the infrared signals from Kinect sensors can be reflected, and Martinez-Aranda et al. [40,41] subsequently employed the same methodology to measure free-surface shape during dam break flows and shallow turbulent flows. A very limited number of studies have used the Kinect–TiO2 methodology, and these are summarised in Table 1. Very few studies specify the concentration used, or the specific type of TiO2 used.
The use of colourant for water surface visualisation is not unprecedented for other optical measurement systems. Tsubaki and Fujita [12] proposed a new stereoscopic measurement for fluctuating free surfaces by mixing an unspecified amount of an unspecified white dye into the water to make the water opaque so that the surface appears solid. Cobelli [45] measured the free-surface deformation by projecting a fringe pattern by a video projector and recording it using a digital camera. A “standard, highly concentrated titanium dioxide pigment paste” was reportedly used at a 0.5% concentration and was said to “not affect water’s hydrodynamical properties” but without proof or justification. The concentration was said to be a compromise between diluteness and high fringe pattern contrast, and it was reported that below the saturation point of 10% by volume, phase separation (forming multiple layers with different properties) will not occur. Other colourants have also been explored. Aureli et al. [46] detected the topography of water surfaces based on light absorption by the water body. They coloured the water by adding methylene blue, which acts as a variable-density filter. The colouring agent concentrations were chosen to achieve the maximum sensitivity for all laboratory test conditions, but the actual concentrations used were not reported. They found that a reduction in the colour agent concentration can lead to reduction of the overall sensitivity. Chatellier et al. [47] mixed a mass concentration of 10% polyoxide ethylene powder. Cang et al. [48] measured the wave height by a binocular camera, using an unspecified colourant at an unspecified concentration to turn the water “milky white” to decrease the penetration of light.
Despite all the insights provided, there is still only limited evidence regarding the effect of TiO2 concentration on the fluid properties, such as surface tension and viscosity. This can intrinsically affect the very phenomena being studied. Tadeu [49] showed that rutile TiO2 increases the viscosity of water by over 10% at just a 1% concentration and decreases surface tension by almost 30% at a concentration of 1%. Przadka et al. [50] investigated the use of TiO2 in Fourier profilometry, another optical method of surface reconstruction. They found that the rutile TiO2 indeed did affect surface wave behaviour on water, while anatase TiO2 only marginally affected the wave behaviour. However, this was for a transient wave of several millimetres in amplitude; many applications require the examination of continuous waves with smaller amplitudes, and the effect of TiO2 in these conditions has never been studied.
No study has ever sought to establish an optimal concentration of TiO2 for practical use with Kinect sensors, which use infrared rather than visible light, infrared being known to perform differently in optical sensing applications [51,52]. Nor has any paper explored the differences between the two common versions of the Kinect sensor in the application of water surface measurement.
This paper aims to establish the optimal TiO2 concentration and sensor choice, and present evidence that the fluid properties can be substantially affected by the TiO2 and thus this effect demands deeper study before TiO2–Kinect data can be reliably interpreted.
This paper is organised as follows: Section 2 presents a comparison of the two sensor types and establishes a minimum TiO2 concentration for reliable use. It also explores the post-processing techniques that can be used to improve data quality as a function of spatial and temporal accuracy. Section 3 explores the effect of TiO2 concentration on fluid properties. Finally, in Section 4, conclusions are presented and recommendations for future work are given.

2. Sensor Accuracy and Minimum Colourant Concentration

This section describes the experimental design, equipment and methodology applied to calibrate and validate the Microsoft Kinect Version 1 (KV1) and Microsoft Kinect Version 2 (KV2) measurements, and the comparative results of the sensors’ performance.

2.1. Kinect Sensors

KV1 contains an infrared (IR) imaging emitter coupled with an IR camera. The 3D images obtained are produced from a light coding technique. The IR emitter generates a speckle pattern on the object under study; this object needs to be opaque and ideally matte in order to diffuse the projected pattern which will be captured by the IR sensor. The image received by the sensor is compared with the original pattern by an on-board processor, which uses the relative distortion to associate depth information to each pixel [24,53]. In contrast, KV2 uses the Time-of-Flight technique (ToF) which is a method for measuring the distance between a sensor and an object based on the time difference (or phase difference) between the emission of a signal and its return to the sensor, after being reflected by the object. This type of technique is often used on LIDAR sensors for autonomous vehicles. The resolution of the depth map for KV1 is 480 × 640 and for KV2 is 424 × 512. Typically, depth and RGB data are recorded by both devices at 30 frames per second (fps), which has been shown to be reliable by previous studies [35,39,44]. The data presented here were also recorded at 30 fps. KV1 and KV2 are displayed in the experimental setup in Figure 1.

2.2. Kinect Data Calibration

A preliminary procedure was undertaken to calibrate KV1 and KV2. The devices were positioned facing downwards (vertical view direction, see Figure 1) with their front faces at a distance of 1.5 m above the floor of a rectangular wave tank with cross-section of 355 mm by 210 mm. This provided an ideal field of view with high resolution and high accuracy due to being within the optimal distance [34]. The sensors were installed close to each other as shown in Figure 1, with a horizontal separation of 40 mm between their infrared detectors. For calibration, the tank was temporarily removed and a 500 mm by 300 mm chequerboard pattern was placed at a range of vertical positions to horizontally and vertically calibrate the KV1 and KV2. A spatial calibration function known as “fitgeotrans” was used to calculate a geometric transformation from the detected calibration board vertices (see Figure 2) to an orthogonal grid whereby 1 pixel = 1 mm horizontally. This allowed the effects of lens distortion to be mitigated by dewarping the images using the geometric transform.
The depth values recorded by the Kinect sensors nominally correspond to the distance from the sensor to the object being detected, in mm; however, since this was found to not be exact, the sensor output here was treated as a unitless value for which a calibration was required to assign it meaningful units in terms of mm. The depth data for the different vertical positions of the calibration board were therefore used to produce a linear depth calibration for each pixel location (example for the central pixel is given in Figure 3). All pixels showed a linear calibration with similar constants. Figure 3 also shows the calibration equation for the example pixel, showing that the sensor output relates approximately to the distance from the sensor to the surface. However, the offset shows that this distance is not from the front face of the sensor (9.3 mm offset for KV1, −7.8 mm offset for KV2), and more critically the gradient does not have a unity magnitude, so using the raw data would produce a 3.5% error in depth changes for KV1, and 0.22% for KV2. This further emphasises the superiority of the KV2 sensor for reliable scientific measurements, though a thorough calibration such as that in Figure 3 is still recommended.

2.3. Accuracy of KV1 vs. KV2—Stationary Surface Measurement Accuracy and How to Improve It

Solid surface data was used to assess the accuracy and variability in the depth measurement for both sensors. Figure 4 shows the time-averaged surfaces (from 30-s recordings) for seven different heights recorded by KV1 (left) and KV2 (right). The sensors were in the same configuration as in Section 2.2 with a vertical (downward) view direction. It can be seen that the spatial variability is significantly lower for KV2, and does not significantly vary with surface height (average spatial standard deviation across all time-averaged surfaces for KV1 = 1.88 mm, and for KV2 = 0.66 mm), suggesting the KV2 sensor to be around 3 times more reliable for time-resolved processes where surface “texture” is important.
Figure 5 shows the frequency spectrum of the noise in the time series recorded by KV1 and KV2 for the stationary solid flat surface measurements. The spectrum was similar for all locations on the surface and all surface heights, so these spectra are spatially averaged. The ground truth in this case, since the surface was stationary, is zero amplitude across the full spectrum. It can be seen that KV2 exhibits a relatively flat spectrum, with no noise components above 0.2 mm in amplitude, whereas KV1 exhibits noise up to almost 1 mm, particularly below 1 Hz. This can be important for studies of low-frequency phenomena or single events such as dam breaks [54,55,56,57] where the behaviour of interest is in the order of mm. In these cases, it would be an order of magnitude more reliable to use a KV2 sensor.
Figure 6 shows the standard deviation of a time series from one point on the surface as a function of the cutoff frequency of a third-order low-pass Butterworth filter applied to the data. This graph is similar for any point on the surface, so the figure shown is an average of the graph for each spatial location. It can be seen that with a cutoff frequency close to the Nyquist, the standard deviation tends toward the unfiltered values of 2.62 mm for KV1 and 2.04 mm for KV2. Depending on the free-surface dynamics of interest, the noise in the signal can thus be reduced by filtering to improve the signal-to-noise ratio. For example, a 1 Hz surface feature can be observed with system noise below 1.3 mm for KV1 and 0.6 mm for KV2. This further demonstrates that the KV2 sensor is preferable, particularly for measurement of small-scale surface features.
Another option for removing noise is to apply a spatial filter that is smaller than the smallest length scale of interest. Figure 7 shows the spatial standard deviation in surface height for a single instant in time for both KV1 and KV2, as a function of the window size of a two-dimensional median filter. It can be seen that the spatial noise for an instantaneous surface measurement is similar on the two sensors when unfiltered (2.52 mm for KV1 and 2.64 mm for KV2), but as the filtering window is increased, the KV2 data is significantly smoother, with standard deviation below 0.8 mm for a window size of 50 mm (where KV1 gives standard deviation of over 1.3 mm).

2.4. TiO2 Concentration and Still-Water Stability Tests

To establish the optimal TiO2 concentration for the sensors to accurately capture the free surface, the calibration board was removed and the tank was replaced and filled with water to a depth of 140 mm. Nineteen different concentrations of TiO2 in approximately uniform increments were studied [41], ranging from 0% to 0.0162% by mass. The TiO2 used in this study was anatase titanium (IV) oxide from Acros Organics (Fair Lawn, New Jersey, United States) with molecular weight 79.88 kg/kmol. After TiO2 was added, the fluid was mixed by hand using a small paddle. Uniform mixing was visually observed to occur after 20 s but mixing was maintained for at least 1 min to ensure homogeneity of concentration. Any surface fluctuations were allowed to dissipate over a short time period and the Kinect data were then recorded for 10 s at 30 fps.
Figure 8 shows the changes in time and space averaged depth detected by KV1 and KV2 as the concentration of TiO2 (%) was increased. While KV1 approached the correct value more quickly, neither sensor showed a reliable measurement until after a concentration of 0.01% by mass. Previous studies did not examine the accuracy of measurement as a function of TiO2 concentration [40,42,43], and did not state the TiO2 concentration used, so it is impossible to know whether those measurements were collected with an appropriate amount of TiO2. Martinez-Aranda et al. [41] stated a TiO2 concentration of 1.2%, which Figure 8 shows to be approximately 100 times greater than that which is necessary.
It is also important to understand the behaviour of TiO2 colourant within still water or low Reynolds number flows, where the TiO2 may settle under gravity. Przadka [50] found a TiO2 solution of 4% appeared to an optical camera system to have dropped by 0.23 mm after 30 min, but this may not be the same for the optimal 0.01% concentration, and also when sensed using infrared rather than visible light. Figure 9 shows the change in perceived depth over time for KV1 and KV2 after mixing the 0.01% of anatase TiO2 in the tank. Ten-second recordings were taken at intervals of approximately 1 min for a period of 25 min. The perceived depth can be observed to slowly decrease over time. The KV1 sensor shows more scattered perceived depths, which suggests that it may not be very reliable soon after the solution is allowed to rest. Previous studies have used KV1 [40,42,43], however, these results would suggest that KV2 is more reliable when there is a chance of TiO2 settlement. These data demonstrate two key findings: (1) KV2 again shows a more stable response than KV1; (2) there is a decrease in measured depth over time, meaning that fluid should be continuously mixed (perhaps by turbulence in the case of a turbulent flow) in order to maintain accuracy. The apparent settling is an order of magnitude faster than that measured by Przadka [50] using an optical camera rather than the infrared sensors employed by Kinect. This has implications for studies such as dam breaks, where the fluid may be resting behind the dam for an unspecified period of time before being released.

3. Effect of TiO2 Concentration on Fluid Properties

Section 2 established a minimum TiO2 concentration of 0.01%. It is thought that overdosing can have a significant effect on the hydrodynamics, because a 1% concentration of TiO2 is reported to reduce the surface tension by almost 30% and increase the fluid viscosity by over 10% [46]. Viscosity proportionally affects the flow Reynolds number, which is crucial for understanding turbulence processes and also drag and energy losses resulting from flow around obstacles. Laiadi and Merzougui [58] showed that changes in surface tension can affect the free-surface profile in shallow flows, while Balabel and Alzaed [59] showed that changes in surface tension and viscosity can affect the propagation of the wave front in dam break scenarios. This may explain why Martinez-Aranda et al. [41] found that their experimental TiO2–Kinect data did not match the established model data, particularly in the vicinity of obstacles, where surface tension and viscosity effects would be more apparent. These experimental uncertainties are also apparent in comparison with other models [60].
Przadka et al. [50] found anatase TiO2 to marginally affect wave properties, but this was for a transient wave of larger magnitude than the waves often of interest in turbulent flows. Hence, this section will systematically explore the effect of anatase TiO2 concentration on surface tension and gravity wave behaviour for small-scale, continuously generated waves. The relevance of this is that the effect of TiO2 may then be inferred for a given concentration. It can therefore be used to elucidate the potential impact on previous studies that used TiO2 indiscriminately, and to inform experimental design of future TiO2–Kinect measurements.

3.1. Effect of TiO2 on Surface Tension

The liquid surface tension was measured using a KRUSS tensiometer (model no. K11MK4) (Figure 10) with the plate method. Samples of water with different concentrations of TiO2 (0–2%) were prepared and well mixed before the measurement. A plate was lifted up from the surface of the sample in the container and the force required to raise the plate from the liquid surface was measured to determine the surface tension. Each measurement was repeated five times and averaged.
Figure 11 shows the surface tension as a function of TiO2 concentration. It can be seen that even small concentrations cause a change in surface tension, with concentrations above 1% reducing the surface tension by over 0.5%. This difference may be enough to substantially affect fluid behaviour in the capillary wave regime or where a fluid is in contact with a solid obstacle.

3.2. Effect of TiO2 on Gravity–Capillary Waves

The purpose of this test was to investigate the effect of anatase TiO2 concentration on the behaviour of gravity–capillary waves on a still-water surface. Due to the stability issues with TiO2–Kinect measurement in still water and low TiO2 concentrations, the water surface was characterised using a Digital Image Correlation system (DIC) Q-400 (www.dantec-dynamics.com), which only required the background to be broadly white, with some darker floating tracers at the free surface. DIC is an optical measurement method based on stochastic pattern (speckles) recognition on the object to be measured. It is widely used in full-field displacement and strain measurement. The DIC system observes speckles with two cameras from different directions, and the 3D measurement can then be achieved by identifying and tracking these speckles. An amount of 5000 mL of tap water with different concentrations of TiO2 (0.01–1.2% by mass) was added to the tank with horizontal dimensions 355 mm × 210 mm. Black pepper was randomly distributed on the surface of the liquid to be used as speckles floating on the fluid surface (Figure 12). A continuous wave was excited by a 25 mm diameter sphere moving up and down sinusoidally, connected to a servo motor controlled by an Arduino Uno microprocessor (Arduino AG, Italy) at a frequency of 2.5 Hz and amplitude of 0.25 mm. Tests were repeated 10 times for each concentration and a 10 s period was recorded for every measurement.
The displacement of the wave in the vertical direction was evaluated from the videos of the two cameras. Eight gauge points were chosen along the direction of the travelling wave, with different distances from the centre of the sphere generating the waves as illustrated in Figure 13.
The vertical displacement of the eight chosen gauge points was computed by the Dantec dynamics software Istra-4D version 4.4.7.507 (the control software of the system Q-400). The exported data from ISTRA 4D in HDF5 format were imported into MATLAB R2019a and then processed. The wave height decreases as the gauge point moves further away from the sphere (centre of the wave), as shown in Figure 14. A phase shift is also recognisable, illustrating the translation and celerity of the wave.
Figure 15 shows the standard deviation of the recorded wave signal in mm for gauge point 1, for 10 repeated measurements at each concentration. The cross markers show the mean value for each concentration. It is apparent that the wave height is substantially affected by the TiO2 concentration. For a TiO2 concentration of 1%, the wave height is reduced by more than 25% compared with a 0.01% concentration. This has significant impact for all studies utilising TiO2–Kinect measurements to characterise free-surface dynamics. Figure 16 shows the mean value of standard deviation for each concentration as a function of distance from the wave centre. It is clear that at all distances, the impact of TiO2 concentration on wave height is clearly apparent.
Figure 17 shows the phase velocity of the wave, measured between gauge points 1 and 8, for each concentration. The wave speed was calculated by the ratio of separation of gauges (1 and 8) and the time phase lag. The phase shift was determined from analytical signal theory (Hilbert transform).
There is a clear trend in TiO2 concentration reducing the phase speed of the wave, with a 1% concentration reducing the phase speed by as much as 13.91% compared to 0.01% concentration. This again indicates that the behaviour of water surfaces with high TiO2 concentrations (>0.01%) may be substantially different to that of water alone, meaning studies of water waves that use higher concentrations cannot be directly interpreted or applied unless the effect of the high concentration is carefully assessed.

4. Conclusions and Recommendations

This study examined the use of titanium dioxide with two generations of the Microsoft Kinect sensor, KV1 and KV2, in order to evaluate their performance against an ideal flat surface. Studies were conducted to establish the optimal anatase TiO2 concentration and sensor choice, and presented evidence that the fluid properties can be substantially affected by the TiO2. Results obtained can be summarised as follows:
  • KV2 is more accurate and more reliable spatially and temporally for scientific applications.
  • A TiO2 concentration of at least 0.01% is required for reliable Kinect measurements of surface shape.
  • TiO2 concentration above 0.01% substantially affects fluid properties and must be taken into account if using TiO2-Kinect-derived data for model validation or other practical purposes.
  • TiO2 of >1% is more significantly affected, showing a 27.85% reduction in gravity wave height and a 13.91% reduction in phase speed compared with a 0.01% concentration. It is strongly recommended to use the lower concentration to more closely represent pure water dynamics.
  • TiO2 must remain well mixed, so this technique is not recommended for low Re flows or transient processes involving still water.
These results confirm that it is essential to consider the effects of TiO2 concentration before TiO2-Kinect data can be reliably interpreted, and suggest the employment of KV2 sensors for future studies with a TiO2 concentration of 0.01%.
If the above limitations and considerations are properly accounted for, this data does support the use of the TiO2-Kinect technique, under carefully controlled and understood conditions, to measure dynamic free-surface roughness. Future research should also include a frequency sensitivity test to characterise the response to stimuli at different frequencies, perhaps by measuring gravity waves in water coloured with TiO2, or fluctuation of a solid surface. The TiO2-Kinect method may play a pivotal role in the development of a suite of fast, accurate and cost-effective free-surface measurement techniques [61,62,63] that could enhance the understanding of underlying phenomena in rivers and oceans as well as flooded urban areas as climate change increases flood risk.

Author Contributions

A.N. secured the funding for this study; A.N. and M.R. supervised the work conducted; Y.-H.C. conducted the calibration and solid-surface tests; J.W. conducted the water-surface tests; Y.-H.C., J.W., A.N. and M.R. conducted the analysis; A.N. and M.R. wrote the original draft; A.N., M.R., J.W. and Y.-H.C. edited and completed the paper. All authors have read and agreed to the published version of the manuscript.

Funding

This work was completed under the University of Sheffield “Early Career Researcher Scheme” funded by EPSRC, the A*STAR UK-IHPC Singapore attachment scheme and the STREAM Centre for Doctoral Training (EP/L015412/1).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Konmori, S.; Murakami, Y.; Ueda, H. The relationship between surface renewal and busting motions in an open channel flow. J. Fluid Mech. 1989, 203, 103–123. [Google Scholar] [CrossRef]
  2. Horoshenkov, K.; Nichols, A.; Tait, S.; Maximov, G. The pattern of surface waves in a shallow free-surface flow. J. Geophys. Res. Earth Surf. 2013, 118, 1864–1876. [Google Scholar] [CrossRef]
  3. Nichols, A. Free Surface Dynamics in Shallow Turbulent Flows. Ph.D. Thesis, University of Bradford, Bradford, UK, 2013. [Google Scholar]
  4. Fujita, I.; Furutani, Y.; Okanishi, T. Advection features of water surface profile in turbulent open-channel flow with hemisphere roughness elements. Vis. Mech. Process. 2011, 1. [Google Scholar] [CrossRef]
  5. Roy, A.G.; Buffin-Blanger, T.; Lamarre, H.; Kirkbride, A.D. Size, shape and dynamics of large scale turbulent flow structures in a gravel bed river. J. Fluid Mech. 2004, 500, 1–27. [Google Scholar] [CrossRef] [Green Version]
  6. Gabreil, E.; Tait, S.; Shao, S.; Nichols, A. SPHysics simulation of laboratory shallow free surface turbulent flows over a rough bed. J. Hydraul. Res. 2018, 56, 727–747. [Google Scholar] [CrossRef] [Green Version]
  7. Evers, F.M.; Hager, W.H. Spatial impulse waves: Wave height decay experiments at laboratory scale. Landslides 2016, 13, 1395–1403. [Google Scholar] [CrossRef]
  8. Rashidi, M.; Hetsroni, G.; Benerjee, S. Wave-turbulence interaction in free-surface channel flows. Phys. Fluids 1992, 4, 2727–2738. [Google Scholar] [CrossRef]
  9. Savelsberg, R.; Van de Water, W. Experiments on free-surface turbulence. J. Fluid Mech. 2008, 619, 95. [Google Scholar] [CrossRef] [Green Version]
  10. Smolentsev, S.; Miranghaie, R. Study of a free-surface in open channel water flow in the regime from weak to strong turbulence. Int. J. Multiph. Flow 2005, 31, 921–939. [Google Scholar] [CrossRef]
  11. Boon, J.; Brubaker, J. Acoustic-microwave water level sensor comparisons in an estuarine environment. Ocean. Int. Conf. 2008. [Google Scholar] [CrossRef]
  12. Tsubaki, R.; Fujita, I. Stereoscopic measurement of a fluctuating free surface with discontinuities. Meas. Sci. Technol. 2005, 16, 1894–1902. [Google Scholar] [CrossRef]
  13. Takamasa, T.; Hazuku, T. Measuring inter-facial waves on film flowing down a vertical plate wall in the entry region using laser focus displacement meters. Int. J. Heat Mass Transf. 2000, 43, 2807–2819. [Google Scholar] [CrossRef]
  14. Lommer, M.; Levinsen, M. Using laser-induced fluorescence in the study of surface water turbulence. J. Fluoresc. 2002, 12, 45–50. [Google Scholar] [CrossRef]
  15. Rubinato, M.; Martins, R.; Kesserwani, G.; Leandro, J.; Djordjevic, S.; Shucksmith, J.D. Experimental calibration and validation of sewer/surface flow exchange equations in steady and unsteady flow conditions. J. Hydrol. 2017, 552, 421–432. [Google Scholar] [CrossRef]
  16. Rubinato, M.; Martins, R.; Shucksmith, J. Quantification of energy losses at a surcharging manhole. Urban Water J. 2018, 15, 234–241. [Google Scholar] [CrossRef] [Green Version]
  17. Rubinato, M.; Lee, S.; Martins, R.; Shucksmith, J. Surface to sewer flow exchange through circular inlets during urban flood conditions. J. Hydroinformatics 2018, 20, 564–576. [Google Scholar] [CrossRef] [Green Version]
  18. Beg, M.; Carvalho, R.; Tait, S.; Brevis, W.; Rubinato, M.; Schellart, A.; Leandro, J. A comparative study of manhole hydraulics using stereoscopic PIV and different RANS models. Water Sci. Technol. 2018, 2017, 87–98. [Google Scholar] [CrossRef]
  19. Hahn, E.; Lyn, D. Anomalous contraction scour? Vertical-contraction case. J. Hydraul. Eng. 2010, 136, 137–141. [Google Scholar] [CrossRef] [Green Version]
  20. Coleman, S.E.; Andrews, D.P.; Webby, M.G. Overtopping breaching of non-cohesive homogeneous embankments. J. Hydraul. Eng. 2002, 128, 829–838. [Google Scholar] [CrossRef]
  21. Gabl, R.; Steynor, J.; Forehand, D.I.M.; Davey, T.; Bruce, T.; Ingram, D.M. Capturing the Motion of the Free Surface of a Fluid Stored within a Floating Structure. Water 2019, 11, 50. [Google Scholar] [CrossRef] [Green Version]
  22. Park, J.; Sung, H.J.; Park, J.S. PIV measurement of flow around an arbitrarily moving free surface. Exp. Fluids 2015, 56. [Google Scholar] [CrossRef]
  23. Gonzalez, E.; Femarques, J.; Diaz-Pache, F.; Agudo, J.; Gomez, L. Experimental validation of a sediment transport two dimensional depth-averaged numerical model using PIV and 3D scanning technologies. J. Hydraul. Res. 2008, 46, 489–503. [Google Scholar] [CrossRef]
  24. Khoshelham, K.; Elberink, S. Accuracy and resolution of Kinect depth data for indoor mapping applications. Sensors 2012, 12, 1437–1454. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Izadi, S.; Kim, D.; Hilliges, O.; Molyneaux, D.; Newcombe, R.; Kholi, P.; Shotton, J.; Hodges, S.; Freeman, D.; Davidson, A.; et al. Kinect fusion: Real-time 3D reconstruction and interaction using a moving depth camera. In Proceedings of the UIST’11, Santa Barbara, CA, USA, 16–19 October 2011. [Google Scholar]
  26. Chang, Y.; Chen, S.; Huang, J. A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities. Res. Dev. Disabil. 2011, 32, 2566–2570. [Google Scholar] [CrossRef]
  27. Patel, S.; Chauhan, Y. Heart attack detection and medical attention using motion sensing device. Int. J. Sci. Res. Publ. 2014, 4, 468–471. [Google Scholar]
  28. Boulos, M.N.K.; Resch, B.; Crowley, D.N.; Breslin, J.G.; Sohn, G.; Burtner, R.; Pike, W.A.; Jezierski, E.; Chuang, K.Y.S. Crowdsourcing, citizen sensing and sensor web technologies for public and environmental health surveillance and crisis management: Trends, OGC standards and application examples. Int. J. Health Geogr. 2011, 10, 67. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Mankoff, K.; Russo, T. The Kinect: A low-cost, high-resolution, short-range 3D camera. Earth Surf. Process. Landforms 2013, 38, 926–936. [Google Scholar] [CrossRef]
  30. Amaral, S.; Caldeira, L.; Viseu, T.; Ferreira, R. Designing Experiments to Study Dam Breach Hydraulic Phenomena. J. Hydraul. Eng. 2020, 146, 04020014. [Google Scholar] [CrossRef]
  31. Amaral, S.; Viseu, T.; Ferreira, R. Experimental methods for local-scale characterization of hydro-morphodynamic dam breach processes. Breach detection, 3D reconstruction, flow kinematics and spatial surface velocimetry. Flow Meas. Instrum. 2019, 70, 70. [Google Scholar] [CrossRef]
  32. Manghisi, V.M.; Uva, A.E.; Fiorentino, M.; Bevilacqua, V.; Trotta, G.F.; Monno, G. Real time RULA assessment using Kinect v2 sensor. Appl. Ergon. 2016, 65, 481–491. [Google Scholar] [CrossRef]
  33. Gonzalez-Jorge, H.; Riveiro, B.; Vazquez-Fernandez, E.; Martinez-Sanchez, J.; Aria, P. Metrological evaluation of Microsoft Kinect and Asus Xtion sensors. Measurement 2013, 46, 1800–1806. [Google Scholar] [CrossRef]
  34. Gonzalez-Jorge, H.; Rodriguez-Gonzalvez, P.; Martinez-Sanchez, J.; Gonzalez-Aguilera, D.; Aria, P.; Gesto, M.; Diaz-Vilarino, L. Metrological comparison between Kinect I and Kinect II sensors. Measurement 2015, 70, 21–26. [Google Scholar] [CrossRef]
  35. Wasenmüller, O.; Stricker, D. Comparison of Kinect v1 and v2 Depth Images in Terms of Accuracy and Precision. In Proceedings of the Computer Vision–ACCV 2016 Workshops, Taipei, Taiwan, 20–24 November 2016. [Google Scholar]
  36. Amon, C.; Fuhrman, F. Evaluation of the spatial resolution accuracy of the face tracking system for Kinect for Windows V1 and V2. In Proceedings of the 6th Congress of Alps-Adria Acoustics Association, Graz, Austria, 16–17 October 2014. [Google Scholar]
  37. Hong, S.; Saavedra, G.; Matines-Corral, M. Full parallax three-dimensional display from Kinect v1 and v2. Opt. Eng. 2016, 56, 41305. [Google Scholar] [CrossRef] [Green Version]
  38. Samir, M.; Golkar, E.; Rahni, A. Comparison between the Kinect™ V1 and Kinect™ V2 for respiratory motion tracking. In Proceedings of the IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Kuala Lumpur, Malaysia, 19–21 October 2015. [Google Scholar]
  39. Nichols, A.; Rubinato, M. Remote sensing of environmental processes via low-cost 3D free-surface mapping. In Proceedings of the 4th IHAR Europe Congress, Liege, Belgium, 27–29 July 2016. [Google Scholar]
  40. Martinez-Aranda, S.; Fernandez-Pato, J.; Caviedes-Voullieme, D.; Garcia-Palacin, I.; Garcia-Navarro, P. Towards transient experimental water surfaces: Strengthening two-dimensional SW model validation. In Proceedings of the 13th International Conference on Hydroinformatics, Palermo, Italy, 1–6 July 2018. [Google Scholar]
  41. Martinez-Aranda, S.; Fernandez-Pato, J.; Caviedes-Voullieme, D.; Garcia-Palacin, J.; Garcia-Navarro, P. Towards transient experimental water surfaces: A new benchmark datasets for 2D shallow water solvers. Adv. Water Resour. 2018, 121, 130–149. [Google Scholar] [CrossRef]
  42. Combes, B.; Guibert, A.; Memin, E.; Heitz, D. Free-surface flows from Kinect: Feasibility and limits. In Proceedings of the Forum on Recent Developments in Volume Reconstruction Techniques Applied to 3D Fluid and Solid Mechanics, FVR2011, Poitiers, France, 29 November–1 December 2011. [Google Scholar]
  43. Toselli, F.; De Lillo, F.; Onorato, M.; Boffetta, G. Measuring surface gravity waves using a Kinect sensor. J. Mech. B/Fluids 2019, 74, 260–264. [Google Scholar] [CrossRef] [Green Version]
  44. Cho, Y.H.; Rubinato, M.; Nichols, A. The Kinect sensor as a tool for remote flow characterization. In Proceedings of the 37th IAHR World Congress 2017, Kuala Lumpur, Malaysia, 13–18 August 2017; pp. 5600–5607. [Google Scholar]
  45. Cobelli, P.J.; Maurel, A.; Pagneux, V.; Petitjeans, P. Global measurement of water waves by Fourier transform profilometry. Exp. Fluids 2009, 46, 1037. [Google Scholar] [CrossRef]
  46. Aureli, F.; Maranzoni, A.; Mignosa, P.; Ziveri, C. An image processing technique for measuring free surface of dam-break flows. Exp. Fluids 2011, 50, 665–675. [Google Scholar] [CrossRef]
  47. Chatellier, L.; Jarny, S.; Gibouin, F.; David, L. A parametric PIV/DIC method for the measurement of free surface flows. Exp. Fluids 2013, 54, 1488. [Google Scholar] [CrossRef]
  48. Cang, Y.; He, H.; Qiao, Y. Measuring the wave height based on binocular cameras. Sensors 2019, 19, 1338. [Google Scholar] [CrossRef] [Green Version]
  49. Tadeu Abrahao, R. Study on the Dispersion of Titanium Dioxide Pigment Particles in Water. Ph.D. Thesis, Escola Politecnica da Universidade de Sao Paulo, Sao Paulo, Brazil, 2013. [Google Scholar]
  50. Przadka, A.; Cabane, B.; Pagneux, V.; Maurel, A.; Petitjeans, P. Fourier transform profilometry for water water waves: How to achieve clean water attenuation with diffusive reflection at the water surface. Exp. Fluids 2012, 52, 519–527. [Google Scholar] [CrossRef]
  51. Stuart, A.D. Some applications of infrared optical sensing. Sens. Actuators B Chem. 1993, 11, 185–193. [Google Scholar] [CrossRef]
  52. Singh, V.; Lin, P.T.; Patel, N.; Lin, H.; Li, L.; Zou, Y.; Deng, F.; Ni, C.; Hu, J.; Giammarco, J.; et al. Mid-infrared materials and devices on a Si platform for optical sensing. Sci. Technol. Adv. Mater. 2014, 15, 14603. [Google Scholar] [CrossRef] [PubMed]
  53. Yang, L.; Zhang, L.; Dong, H.; Alelaiwi, A.; El Saddik, A. Evaluating and Improving the Depth Accuracy of Kinect for Windows v2. IEEE Sens. J. 2015, 15, 1. [Google Scholar] [CrossRef]
  54. Khosravi, K.; Rostaminejad, M.; Cooper, J.R.; Mao, L.; Melesse, A.M. Chapter 31—Dam break analysis and flood inundation mapping: The case study of Sefid-Roud Dam, Iran. In Extreme Hydrology and Climate Variability, Monitoring Modelling, Adaptation and Mitigation; Elsevier: Amsterdam, The Netherlands, 2019; pp. 395–405. [Google Scholar]
  55. Valiani, A.; Caleffi, V. Dam break in rectangular channels with different upstream-downstream widths. Adv. Water Resour. 2019, 132, 103389. [Google Scholar] [CrossRef] [Green Version]
  56. Shu, A.; Wang, S.; Rubinato, M.; Wang, M.; Qin, J.; Zhu, F. Numerical modeling of debris flows induced by dam-break using the Smoothed Particle Hydrodynamics (SPH) method. Appl. Sci. 2020, 10, 2954. [Google Scholar] [CrossRef]
  57. Shao, S.; Lo, E.Y.M. Incompressible SPH method for simulating Newtonian and non-Newtonian flows with a free surface. Adv. Water Resour. 2003, 26, 787–800. [Google Scholar] [CrossRef]
  58. Laiadi, A.; Merzougui, A. Free surface flows over a successive obstacles with surface tension and gravity effects. AIMS Math. 2019, 4, 316–326. [Google Scholar] [CrossRef]
  59. Balabel, A.; Alzaed, A. Computational fluid dynamics of dam-break problem with different fluid properties using the level set method. Energy Res. 2018, 2, 52–61. [Google Scholar] [CrossRef]
  60. Le Hocine, A.; Lacey, R.; Poncet, S. Multiphase modeling of the free surface flow through a Darrieus horizontal axis shallow-water turbine. Renew. Energy 2019, 143, 1890–1901. [Google Scholar] [CrossRef]
  61. Rojas, S.; Rubinato, M.; Nichols, A.; Shucksmith, J. Cost effective measuring technique to simultaneously quantify 2D velocity fields and depth-averaged solute concentrations in shallow water flows. J. Flow Meas. Instrum. 2018, 64, 213–223. [Google Scholar] [CrossRef]
  62. Dolcetti, G.; Krynkin, A.; Horoshenkov, K.V.; Tait, S.J. An Acoustic Technique to Measure the Velocity of Shallow Turbulent Flows Remotely. In Free Surface Flows and Transport Processes. GeoPlanet: Earth and Planetary Sciences; Kalinowska, M., Mrokowska, M., Rowiński, P., Eds.; Springer: Cham, Switzerland, 2018. [Google Scholar]
  63. Horoshenkov, K.; Van Rentergham, T.; Nichols, A.; Krynkin, A. Finite difference time domain modelling of sound scattering by the dynamically rough surface of a turbulent open channel flow. Appl. Acoust. 2016, 110, 13–22. [Google Scholar] [CrossRef] [Green Version]
Figure 1. KV1 (left) vs. KV2 (right) used for this study.
Figure 1. KV1 (left) vs. KV2 (right) used for this study.
Sensors 20 03507 g001
Figure 2. Chequerboard points identification for the spatial calibration; image shown is the raw image prior to dewarping.
Figure 2. Chequerboard points identification for the spatial calibration; image shown is the raw image prior to dewarping.
Sensors 20 03507 g002
Figure 3. Depth calibration for KV1 and KV2.
Figure 3. Depth calibration for KV1 and KV2.
Sensors 20 03507 g003
Figure 4. Measurements of solid surface by KV1 (left) and KV2 (right).
Figure 4. Measurements of solid surface by KV1 (left) and KV2 (right).
Sensors 20 03507 g004
Figure 5. Frequency spectrum of noise of KV1 and KV2 for solid surfaces.
Figure 5. Frequency spectrum of noise of KV1 and KV2 for solid surfaces.
Sensors 20 03507 g005
Figure 6. STD for reducing filter frequency cutoff for KV1 and KV2 for solid surfaces.
Figure 6. STD for reducing filter frequency cutoff for KV1 and KV2 for solid surfaces.
Sensors 20 03507 g006
Figure 7. STD for increasing moving average window size for KV1 and KV2 on solid surfaces.
Figure 7. STD for increasing moving average window size for KV1 and KV2 on solid surfaces.
Sensors 20 03507 g007
Figure 8. Perceived depth vs. concentration of TiO2.
Figure 8. Perceived depth vs. concentration of TiO2.
Sensors 20 03507 g008
Figure 9. Perceived depth over time for TiO2 solution.
Figure 9. Perceived depth over time for TiO2 solution.
Sensors 20 03507 g009
Figure 10. Surface tension measurement by KRUSS tensiometer with plate method.
Figure 10. Surface tension measurement by KRUSS tensiometer with plate method.
Sensors 20 03507 g010
Figure 11. Surface tension of water as a function of TiO2 concentration. Error bars represent maximum and minimum of 5 repeats, markers represent the average.
Figure 11. Surface tension of water as a function of TiO2 concentration. Error bars represent maximum and minimum of 5 repeats, markers represent the average.
Sensors 20 03507 g011
Figure 12. Two views of two DIC cameras from two directions.
Figure 12. Two views of two DIC cameras from two directions.
Sensors 20 03507 g012
Figure 13. A section of evaluated displacement in z-direction by ISTRA 4D (x is the distance between the gauge point and centre of the sphere).
Figure 13. A section of evaluated displacement in z-direction by ISTRA 4D (x is the distance between the gauge point and centre of the sphere).
Sensors 20 03507 g013
Figure 14. Time series of vertical displacement of four gauge points for concentration 1.2%.
Figure 14. Time series of vertical displacement of four gauge points for concentration 1.2%.
Sensors 20 03507 g014
Figure 15. Standard deviation of wave fluctuation at gauge point 1 for different concentrations. Circles represent 10 repeats for each concentration, crosses represent the mean.
Figure 15. Standard deviation of wave fluctuation at gauge point 1 for different concentrations. Circles represent 10 repeats for each concentration, crosses represent the mean.
Sensors 20 03507 g015
Figure 16. Standard deviation of wave fluctuations over distance for a range of concentrations.
Figure 16. Standard deviation of wave fluctuations over distance for a range of concentrations.
Sensors 20 03507 g016
Figure 17. Averaged wave speed from 10 repeats versus different concentrations. Circles represent 10 repeats for each concentration, crosses represent the mean.
Figure 17. Averaged wave speed from 10 repeats versus different concentrations. Circles represent 10 repeats for each concentration, crosses represent the mean.
Sensors 20 03507 g017
Table 1. Studies employing the Kinect–TiO2 method.
Table 1. Studies employing the Kinect–TiO2 method.
PaperAuthorKinect VersionColourant
Free-surface flows from Kinect: feasibility and limits. Proc., Forum on Recent Developments in Volume Reconstruction Techniques Applied to 3D Fluid and Solid Mechanics (FVR 2011), Chasseneuil, France 2011. [42]Combès, B., Guibert, A., Memin, E., Heitz D.1“white dye”, concentration not stated
Remote sensing of environmental processes via low-cost 3D free-surface mapping, 4th IAHR Europe Congress, Liege, Belgium, 27–29 July 2016. [39]Nichols, A., Rubinato, M.1TiO2, concentration not stated
P. Towards transient experimental water surfaces: A new benchmark dataset for 2D shallow water solvers. Advances in Water Resources, 121, 130–149, 2018. [40]Martinez-Aranda, S., Fernandez-Pato, J., Caviedes-Voullieme, D., Garcia-Palacin, I., Garcia-Navarro, P.1TiO2, concentration 1.2%
Measuring surface gravity waves using a Kinect sensor. Journal of Mechanics – B/Fluids, 2018. [43]Toselli, F., De Lillo, Onorato, M., Boffetta, G.1“commercial paint”, concentration 1%
Towards transient experimental water surfaces: strengthening two-dimensional SW model validation. 13th International Conference on Hydroinformatics, Palermo, 1–6 July 2018. [41] Martinez-Aranda, S., Fernandez-Pato, J., Caviedes-Voullieme, D., Garcia-Palacin, I., Garcia-Navarro, P.1TiO2, concentration 1.2%

Share and Cite

MDPI and ACS Style

Nichols, A.; Rubinato, M.; Cho, Y.-H.; Wu, J. Optimal Use of Titanium Dioxide Colourant to Enable Water Surfaces to Be Measured by Kinect Sensors. Sensors 2020, 20, 3507. https://doi.org/10.3390/s20123507

AMA Style

Nichols A, Rubinato M, Cho Y-H, Wu J. Optimal Use of Titanium Dioxide Colourant to Enable Water Surfaces to Be Measured by Kinect Sensors. Sensors. 2020; 20(12):3507. https://doi.org/10.3390/s20123507

Chicago/Turabian Style

Nichols, Andrew, Matteo Rubinato, Yun-Hang Cho, and Jiayi Wu. 2020. "Optimal Use of Titanium Dioxide Colourant to Enable Water Surfaces to Be Measured by Kinect Sensors" Sensors 20, no. 12: 3507. https://doi.org/10.3390/s20123507

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop