Next Article in Journal
Development of Numerical Modelling Techniques for a Firefighting Water Tank with an Anti-Wave Plate under Seismic Loads
Next Article in Special Issue
A Technical-Thematic Civil Protection Exercise in Italy: UAS Fleets-Based Activities Supporting Emergency Response in Seismic Scenarios
Previous Article in Journal
Optimizing Sensory Attributes: Exploring the Placement of the Ideal-Product Question in Check-All-That-Apply Methodology
Previous Article in Special Issue
Distributed Navigation in Emergency Scenarios: A Case Study on Post-Avalanche Search and Rescue Using Drones
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Use of UAVs to Obtain Necessary Information for Flooding Studies: The Case Study of Somes River, Floresti, Romania

by
Raluca Gâlgău
1,
Sanda Marioara Naș
2,
Virgil Mihai Radulescu
2,*,
Ioel Samuel Vereș
2 and
Mircea Vasile Bondrea
2
1
Department of Terrestrial Measurement and Cadastre, Faculty of Civil Engineering, Technical University of Cluj-Napoca, 400020 Cluj-Napoca, Romania
2
Land Measurements and Cadaster Department, Faculty of Construction, Technical University of Cluj-Napoca, 400114 Cluj-Napoca, Romania
*
Author to whom correspondence should be addressed.
Appl. Sci. 2023, 13(21), 11688; https://doi.org/10.3390/app132111688
Submission received: 29 September 2023 / Revised: 19 October 2023 / Accepted: 23 October 2023 / Published: 25 October 2023
(This article belongs to the Special Issue UASs Application in Emergency)

Abstract

:
Floods are natural disasters that cause damage, loss of life, and economic problems throughout the world. Part of these losses can be minimized with the help of different methodologies and tools used to prepare simulations, analyses, and data monitoring to predict such phenomena in time. The metropolitan area of Cluj-Napoca, Romania, is the study area of this paper and it is located in Floresti, the largest rural settlement in Romania. In this area, changes in urbanization, land use, and the expansion of urban areas in a chaotic mode represent a problem. This study focuses on an area prone to flooding due to its proximity to the Somes River. Previous events of this type have caused economic losses that must be considered. This approach combines photogrammetric methods for obtaining data from the field with topographical methods for establishing control points and GIS methods for data processing, modeling, and simulation to obtain the necessary data for flood prevention and intervention.

1. Introduction

1.1. General Context

Floods are the most widespread and disastrous weather-related natural disaster. Among the meteorological factors that can trigger a flood, the recurring ones are intense or prolonged precipitation, snow melting, or factors related to the direct or indirect action of mankind, such as the breaking of dams or dikes. It should also be considered that floods can occur in a few minutes or a longer period and can last for weeks, with disastrous consequences that can last for years [1]. Flood risks are projected to increase globally because of the action of humanity, which affects the phenomenon of flooding, such as the factors that accelerate global warming and chaotic urban development [2,3,4,5]. When such floods occur, rapid mapping and keeping under observation will be vital for stakeholders in assessing the impact (authorities and especially the directly affected people) and coordinating disaster relief efforts. The speed of monitoring and obtaining useful information can often be the difference between life and death for dozens, hundreds, or even thousands of victims. However, the traditional methods of monitoring and prediction are often expensive, dangerous, and impractical.
The most serious event in the area studied in this paper, which took place with the Someș River and was the main actor, took place 52 years ago when, due to heavy rainfall, the river burst its banks, flooding roads, railways, and fields. The most affected towns in the Cluj area were Dej and Gherla, where the situation reached a critical point exceeding 8 m of accumulated water, starting from the base to the surface.
The importance of the reservoirs Tarnița and Fântânele played an important role in protecting the city of Cluj-Napoca, taking over the great floods from Dej and Gherla, where Someșul Mic and Someșul Mare left incredible material and human damage.

1.2. The Purpose of the Present Study

The purpose of this paper is to develop a complete workflow, which includes all the stages to accomplish a simulation in the case of the increase in the water flow of the Someșul Mic River. To achieve the final goal, namely, the simulation of the process of increasing the water flow, the following steps were necessary:
  • Creation of the topographic map for the studied area using the UAV technique.
  • Data processing developed following drone flight.
  • Preparation of documentation.
  • Creating a simulation to present possible disasters.
To achieve the final goal, it was necessary to consider all logistical, physical, and material elements, starting from the journey to the place where the follow-up study was to be conducted, the necessary equipment for its realization, and the specialized topographic equipment to the calculation of the necessary financial resources.
The inundability study has as its main purpose prevention against the dangers to which residents living in buildings in areas with high vulnerability from the point of view of placement may be exposed. It is our duty, as geodetic engineers, to support the institutions responsible for the safety and proper functioning of things. The purpose of the work is to fulfill a civic needs that our society needs.
The need for this research topic lies on the fact that previous works in the field have, in most cases, separated the aspect of taking geospatial data from the field from the aspect of processing these data with the help of GIS software and flood simulation software (for example, HEC-RAS 6.4.1.). Thus, in the case of this paper, a complete working model is proposed that covers all the phases necessary for the acquisition, processing, and use of the spatial information necessary for emergency interventions in the case of flooding, simulation, and forecasting of floods.
This study does not aim to replace other methods of conducting inundation studies, but to complement them with a new approach, considering the fact that each of the alternative methods also presents disadvantages that will be further discussed in the Section 4.
On the other hand, the importance of this study also derives from the studied area, which presents particularities related to a location in the proximity of a large city, in an extremely inhabited area—the new urban area—on the bank of a river with a considerable flood potential. The study area around the dam on the Somes River was chosen because this area represents the most sensitive and interesting study area along the Somes River, due to the potential for direct and immediate impact on a vast number of inhabitants (over 55,000).
To complete this workflow and create a complete methodology, the following stages were necessary:
  • Establishing a network of ground control points (GCP).
  • Obtaining details from the field.
  • Achievement of an orthophoto plane with the help of a drone.
  • Creation of a digital topographical plan.
  • Completing the necessary documentation.
A significant study area was chosen that is located in the town of Floresti in Cluj County. The area is located in the vicinity of the second largest city in Romania (Cluj-Napoca), which in recent years has seen intensive urban development and reaches a commune with the largest number of inhabitants in Romania.
As a result, the interest in this study has increased in recent years due to the increasingly aggressive weather phenomena, with their frequency having possible destructive effects and increasing the risk level on constructions as well as residential houses in the studied area. Rainfall has been a major problem over the years, leading to imminent disasters; this is precisely what is sought to be prevented by conducting this follow-up study. The impact and risk on an upward slope, present on the surrounding sites of the Someș River because of the increase in its water flow, were simulated in this work.

1.3. UAV (Unmanned Aerial Vehicle)

There are numerous situations in the specialized literature in which studies and simulations of inundation were conducted starting from images taken using drone technology.
There are different approaches to this research area. The first approach aims to highlight a methodology for updating data concerning a hydrodynamic model, based on data acquired with the help of drones (UAVs). The model thus proposed is also very effective in the case of the need for the online updating of risk maps in the case of floods and their timely correction [6].
Other approaches in specialized works use artificial intelligence models to develop a model for the automatic identification of flooded buildings using UAV aerial images [7]. There are also very useful studies that used novel ways of measuring water depth for small bodies of water, which are typically more difficult to measure using classical technology [8]. More and more fields identify the opportunity to use drones to collect necessary data in a faster, more precise, and non-intrusive way [9,10,11]. Overflowing rivers can be the cause of catastrophic floods, mainly due to their morphological characteristics. These floods can occur due to flow variations, determined by heavy rains and the lack of systematization and regulation of the riverbanks. It is therefore necessary to use combined topo-geodesic and photogrammetric data acquisition techniques to obtain images and geospatial data necessary for the automatic extraction of interesting characteristic attributes [12].
There are different methods we can use to generate DEMs. It has been demonstrated that the use of airborne LiDAR (Light Detecting and Ranging) sensors can produce very accurate and high-resolution DEMs but with higher acquisition and processing costs than in the case of drones equipped with photogrammetric sensors [13,14].
A comparative approach of UAV-UAS imagery and historical satellite datasets has proven extremely useful, as satellite imagery, such as the Landsat or Sentinel archives, extends decades back in time, allowing for the evaluation of changes over a historical time interval [15,16,17,18].
Several studies have presented and discussed the opportunity of UAV LiDAR data acquisition, referring primarily to the advantage of LiDAR to penetrate vegetation, which leads to an easier classification of points on the ground, of characteristic geometries of interest in the case flood studies, or even the lack of such a classification [19].
The recent development of tools for the study of flood behavior makes it possible to model and simulate them, as well as highlight the characteristics of the drainage network, with the help of the GIS platform, where various data sources can be introduced, analyzed, modeled, and simulated, including those made with the help of UAVs [20,21,22,23,24]. The combination of UAVs with water-level sensors has proven useful because this approach can provide a unitary and quasi-complete vision of the history and chronology of a flood phenomenon [25].
A careful analysis of a significant sample (about 60) of papers helped to classify the sensors needed for similar studies, highlighting terrestrial photogrammetry at 31.7% and aerial photogrammetry at 26.7%, as the most frequently used low-cost detection method [26]. If we refer to other types of sensors that are useful for estimating and preventing the effects of floods, ground-penetrating radar can obtain, in certain conditions, accurate estimates about the soil and water [27,28,29].
It thus becomes obvious that technological advances in unmanned aerial vehicles (UAVs) offer a wealth of capabilities for the efficient and orderly production of images and topographical data, which are useful in the study, modeling, simulation, and prevention of floods [30,31,32,33,34,35,36].
The effectiveness of the use of UAVs in the activity of providing information necessary for monitoring, simulating, modeling, and preventing floods has been demonstrated in numerous case studies that concern various geographical areas.
Thus, The Drone Watch project brought together the commercial flood modeling and risk specialist Ambiental Ltd. (Amersfoort, The Netherlands) and UAV imagery specialists Caintech Ltd. (Inverness, UK) and the University of Leicester, Loughborough University, and Imperial College London to use UAV technology to obtain information almost in real-time about the floods that occurred after winter storms in Cumbria (UK) in the winter of 2015. The near real-time accurate mapping of the flood extent and property and infrastructure damage in urban and rural areas was required for the estimation of insurance loss and insurance claim validation [37].
In Queensland, Australia, in 2019, and in Luxembourg in 2022, UAVs were used to obtain necessary information for accurate modeling with high-quality elevation data. Considering the nature of information retrieval, drone mapping, and photogrammetry can provide finer-resolution elevation data than can be achieved through mapping with manned aircraft [38].
To protect the lives and livelihoods of people, The Gambia has partnered with UNESCO to establish a state-of-the-art, end-to-end early warning system for floods that relies heavily on drones. The observation area is mainly based on the drainage basin of the Gambia River, the most sensitive area from the point of view of flooding in The Gambia. This partnership with UNESCO was established because, in 2010–2018, about 35,000 Gambians were directly affected by the consequences of floods. Thus, the drones managed to quickly identify any safe sites, unsafe areas, and evacuation routes. In addition, drones help with the rapid identification of damaged and at-risk individuals in post-disaster situations [39].
The Utah Water Research Laboratory used UAVs on 25 May 2023 to obtain information with the help of over five flight sessions that spanned 19 m. Drone imagery revealed how the floodwaters affected surrounding neighborhoods, farmland, and grassland. The data collected from drones during a flood helped fine-tune flood predictions and modeling [40].

2. Materials and Methods

2.1. Study Area

The study was conducted along the Someșul Mic River, in the Florești Commune, Cluj County. In this area, the studied river has the tributaries Capușul, Nadășul, and Borșa, each presenting large fluctuations in flow and water level. The length of the Someșul Mic River is 178 km, and it is formed by the union of two other rivers, namely, Someșul Rece and Someșul Cald (Figure 1).
The geographical coordinates of the studied area are 47°8′41″ North Latitude and 23°54′48″ East Longitude. The course of water on the Someș-Tisa section has a moderate continental temperate climatic behavior, with its constant nature being its main characteristic. Average annual temperatures recorded along the Someș River are between 0 and 9 degrees Celsius, depending on the landform it crosses. The rain showers reach limits in the range of 1000–to 1400 mm in mountainous areas such as the Rodnei and Călimani Mountains, and in the studied area (Apuseni Mountains), they reach values in the range of 800–to 1200 mm.

2.2. Equipment Used

In Romania, accessing and using GNSS corrections from permanent stations requires access to the ROMPOS state network or another private network from the existing ones. In our case, we used the GNSS corrections received from the ROMPOS network managed by the National Cadaster and Real Estate Advertising Agency (ANCPI) [41].
For additional precision of the results, it was necessary to coordinate the determination of ground control points (GGPs), and for this purpose, a GNSS Geomax (Geomax Widnau AG-Switzerland) Zenith 10 system with the Getac controller was used [42]. In order to obtain a better precision of the coordinates of the points, corrections were received using the GSM modem connected to the Internet to receive the RTK (real-time kinematics) corrections. A number of six ground control points were determined, with known coordinates, three on one side and three on the other side of the river, as shown in Table 1.
Both the number and the position of the ground control points (GCPs) were chosen taking into account the specialized literature, which describes a minimal number of 4 control points for areas smaller than 20 hectares, as is the case of this study area [43,44,45,46,47].
The DJI Phantom 4 drone was used (produced by DJI, Shenzen, China), having the advantage of being compact, with high precision, and being frequently used in low-altitude flights. The manufacturer has come up with a revolutionary technology for this model compared to old systems, with the aim of achieving the highest level of precision, facilitating pilots with a reduced number of control points on the ground, compared to earlier solutions (Figure 2).
The camera has a 1/2.3” CMOS sensor effective pixels of 12.4 M, an ISO range of 100–3200 (video) and 100–1600 (photo), an electronic shutter speed of 8–1/8000 s, and an image size of 4000 × 3000.
The first step while conducting this work was the lifting of the elements from the land. Taking into account one of the most valuable features of topography in the case of floods, namely, the rate of precision related to the speed of results, the authors chose to conduct the measurements for this case study with the help of photogrammetric methods, according to the UAV (Unmanned Aerial Vehicle) technique, a method increasingly used in recent years because speed, accuracy, and precision are the key elements that offer the greatest potential in the development of topography; digital methods offer more possibilities than classical ones [48].
For the good profitability of the work, GNSS-type systems were also used. The connection of these systems to the satellites was performed in advance with the help of the ROMPOS national network.
Reflective targets were used to mark the six control points (Figure 3). There were two groups of points: the first three control points were marked on the left bank of the Someș (from where the drone took off) and the other three on the right bank of the Someș. In places where the targets could not be mounted due to concrete, a special spray was used to mark the topographic points in a bright color so that they could be easily seen in the aerial photographs taken with the UAV technology.
To acquire the data necessary for the case study, it was necessary to make two flights. The first flight covered the area in the immediate vicinity of the dam and the second flight covered the dam itself, it being necessary to perform the simulation of the dam cracking. Because the dam was not included in the first flight, being a key element in the simulation, the extracted data were still used to create the Digital Terrain Model. The processing of the data resulting from the second flight was conducted in relation to the first and is exemplified in the following.
The most important thing when starting any topographical work is the reconnaissance of the terrain. This was performed in the case of the measurements in this paper, carefully choosing the areas where the six control points were mounted, as they would later be useful for the georeferencing of the resulting orthophoto plane. Three reference points were installed on the left bank of the Someș River and the other three on the right bank. The areas of the control points were carefully chosen, aiming to choose an open area to ensure the easy visibility of the targets from the drone. The points were materialized by targets printed on a resistant material in the grass and dirt areas (Figure 3) and by spray (in a color that was as obvious as possible) in the shape of an “L” in the concrete areas. The markings in a parking lot, in the area where the corner that had to be visible from the drone was marked with an arrow, were also used as reference points. The control point itself was taken either as the center of the square, in the case of targets printed on material or plastic, or in the center of the “L”-shaped marking. In practice, it is recommended that these reference marks are not located at a distance greater than 200 m, as this can considerably affect the accuracy of the work.
After choosing the mounting areas of the landmarks and their materialization, they determined their coordinates with the help of GNSS equipment. To achieve this step, the static measurement method was used. We started with the first point, which was near the drone’s takeoff and landing area. In general, in practice, the most often used static measurement method is the one that offers the highest accuracy. In general, the only impediment this method presents is the need to park in areas as open as possible, offering an unobstructed view of the sky. In the case of the static method, the GNSS equipment was installed in a fixed station, with the observation period being 60 min for each point.
After determining the coordinates of the six control points using the static mode, the actual flight was started. The first step in making the flight was approval from the Romanian Civil Aeronautical Authority (AACR). For the aerial images to be of the highest possible quality, the weather conditions were monitored both the evening before and the morning of the flight because too aggressive wind and precipitation can affect the actual flight. The take-off and landing area was chosen in an open area, without trees and vegetation to be able to monitor the drone from the immediate vicinity of the take-off point, which is the same as the landing point. As can be seen in Figure 4, the first flight had a duration of about 14 min over an area of about 20 ha (198,809 m2), at 120 m height.
Since the greatest clarity was chosen in the construction of the cloud of points, the execution time of the process was a long one, more precisely approximately 60 h. This is due to the number of pixels that this level of clarity produces.
Since there were many constructions and excessive vegetation in the area chosen for the study, a so-called cleaning was necessary to have a DEM as clean as possible to create the level curves (Figure 5).
Immediately after this texture was obtained, the software allowed the generation of the inclined model (Figure 6). With the help of the previously generated structures, the DEM (Digital Elevation Model) was drawn. The georeferencing system used was Pulkovo 1942 (58)/Stereo 70. Relatedly, the cloud of points needed to use some classifications in the case of the DEM as well. Finally, the steps taken previously to achieve the graphic format of the measurements obtained with the help of UAV technology led to the acquisition of the orthophoto plane.

3. Results

3.1. Obtaining the Orthophoto Plan and the Digital Elevation Model (DEM)

The first concrete result needed for the inundation study was the orthoimage of the study area (Figure 7). To have a better view of the orthophoto plane in the studied area, the option “Show Base Map” was used, which more clearly highlights the surroundings adjacent to the area of interest.
Therefore, all the stages necessary for the generation of the orthophoto plane were completed, with each stage having its own characteristics. At the beginning of the process, 185 aerial photographs were aligned, generating 232,347 points, representing the totality of drone position points and image intersections. The ultra-high-quality point cloud was then built, generating a volume of 561,249,646 points, which then produced 154,314,192 faces of the mesh. The mesh was used to build the tilted model with a diversity of nine levels and a resolution of 3.16 cm/pixel. From this model, the DEM was obtained with a plane resolution of 57,438 × 51,180 and a terrestrial resolution of 3.16 cm/pixel.
The next step to construct the digital model of the ground was to obtain the characteristic level curves (Figure 8). These contour lines were created in the Global Mapper 23 program (Blue Marble Geographics, Hallowell, ME, USA). To create the level curves, the authors decided to use the DEM exported from the AgiSoft Metashape 1.8.5. program, saved with the “.tiff” extension.
The next step was to export the contour lines from the Global Mapper program. The curves were exported as a “.dxf” type file, which was necessary for compatibility with the ArcGIS 10.5 program (ESRI-United States of America). The contour lines represent the basis on which the digital terrain model will be created later.
Since “.dxf” files do not allow us to add elevation values, there is a crucial step in determining the Raster Model, namely, the transformation of the contour lines into a “.shp” file (shape file). For the subsequent processing of the digital model, the extension of the ArcGIS program, namely, ArcScene, was used.
The digital model of the ground can be observed in the figure below (Figure 9).

3.2. Achievement of the Inundation Simulation Using the Hec-Ras Program

To conduct the simulation, the data from the second flight were used, data that were processed according to the procedure used for the first flight. To simulate the dam cracking, the Hec-Ras 6.4.1. software (US Army Corps of Engineers, Hydrologic Engineering Center-United States of America) was used.
Before starting the work, the measuring system was set. Since the Hec-Ras software uses the imperial measurement system, it was necessary to change the settings to the metric system. After this, the areas of interest were set up, namely, the possibly flooded area and the accumulation area.
Since the DEM with which the simulation was conducted was previously georeferenced, it was not necessary to choose a spatial reference system, and it was then possible and easy to select the necessary DEM. After importing the DEM, the choice of the area to be studied followed, a step achieved by creating the geometries.
To continue the work, two functions of the program were used, namely, “2D Flow Area” and “Storage Area”. The “Storage Area” option was used to define the portion of the Someș River, accessing “Edit Geometry” and selecting the portion of the Someș River to be studied. The “2D Flow Area” option was used to create a perimeter that represents the potentially flooded area. After the creation of the Someș River area and the possibly floodable area, the realized geometry was saved.
The next step consists of defining the area of the studied dam, accessing the “Tools” → “SA/2D Conn” option, and then generating a polyline in the middle of the dam so that this function connects the two previously mentioned areas, namely, the area of the Someș River and the flood area. After making the connection between the zones, it was necessary to create a boundary that defines the end of the flood zone (Figure 10).
Creating the layered structure of the potentially flooded area was the next step.
The subsequent step represented the creation of points called “Cells”, and the “Force Mesh Recomputation” option was used to perform the next step. The elevations at which the Someș River is located led to the determination of the river’s volume. The minimum elevation of the river is 335.146 m–0 m3 and the maximum elevation is 408.927 m–1055.577 × 103 m3.
The dam is defined as a unifying element that makes the connection between the Someș River, which represents the water drainage area, and the water overflow area, represented by the possibly flooded area.
The graph represented in Figure 11 was automatically generated by the software Hec-Ras and the graph represents the dam itself.
The dam breaching parameters were established, and after accessing the “Breach” function, it was necessary to use “Breach This Structure”, which is necessary for processing the parameter values.
The main conditions that the program imposes are the internal limits, represented in this case by the Someș River, and the external limits of the flood zone. Each of these limits is set according to each one, namely, the internal one by the flow of water from the river, reported in a time interval, and the external one by the friction of the water with the flood zone. The graphic representation was made with the help of the “BC Lines” function, with the condition that the outer limit should be perpendicular to the axis of the water flow and at a height as high as possible, so that, in the end, the spread of water does not reach the boundary of the polygon that includes the flood zone. If these conditions are not respected, the risk will be the occurrence of errors. The simulations considered extremely important elements that can define a flood, such as the friction force of the water and the flow speeds.
As shown in Figure 12, the dam overflow started on 20 March 2022, starting at 23:00, the overflow time interval being defined hour by hour, and the flooding duration was 5 days until the date of 25 March 2022, until 02:00.
Next followed the setting of the minimum elevation, namely, 335.00 m as previously presented, and then it was possible to initialize the simulation. The time intervals for the flood and crack process were then set and then the processing time was set to 15 s.
In the following (Figure 13), the results of the performed simulation are presented. For better visibility and clarity of the figures, we chose to present the initial and intermediate stages of the floods in Appendix A and Appendix B, respectively.

4. Discussion

This study proposed an approach that highlights how surveying equipment, photogrammetric equipment (UAVs, Unmanned Aerial Vehicles), and GIS software can contribute to the creation of a complete workflow that can be ensured in an extremely short time (almost real-time) to obtain useful information for the prevention, simulation, and rapid intervention in the case of floods. Both the equipment and the software used belong to the entry-level–medium category from the point of view of costs. However, the obtained results allow the generation of extremely valuable maps and information for those who are responsible for the intervention in the flood study area.
The use of technology was chosen as an alternative to the use of satellite images taking into account the fact that, for the type of images of phenomena that extend over a longer period of time, it is recommended to use satellite images, but for ongoing phenomena, it is more difficult to use these images satellite images for Romania and similar countries that do not invest in emerging technologies. This means that, in such regions, the specialists have exclusively available commercial satellite images with resolutions lower than 0.5 m, which do not provide the clarity and precision necessary for the most accurate modeling of the terrain. In other words, for simulation and forecasting, it is better to use satellite images, because they can look at a more general framework (the entirety of the Somes River, in our case), but for punctual emergency intervention, to see the amount and area of the affected areas, it is recommended to use UAV equipment.
The type of revisiting of the satellites must also be considered, which sometimes can take 5–10 days, so that the provision of exclusive information based on satellite images from such sensors, for a phenomenon that happens in a few hours, can be late. Thus, we refer to a commercial resolution of 1m, a maximum of 0.5 m compared to 2–3 cm/pixel with the drone, which allows obtaining DEMs much more precisely and in a more accurate way.
One of the advantages of using UAV images is that they can also be taken on days with a lot of clouds, by flying below the cloud ceiling, which is simply impossible for satellite images. Another aspect related to costs is also important: the processing and interpretation of satellite images involve better-trained specialists; thus, it requires higher costs [49,50,51,52].
Of course, in addition to the advantages presented related to obtaining images using UAV compared to satellites, there are also several limitations and disadvantages, which are listed below:
  • The obligation to obtain flight authorization from relevant institutions makes flying in certain areas difficult, or even extremely limited, with the need for special flight permits.
  • The limited flight ceiling, for example, in the study area, it was limited by law to a maximum of 120 m above the ground.
  • For weather conditions related to wind, it is recommended that UAV flights be conducted in wind conditions of a maximum of 12–18 mph.
  • The take-off and landing area must be relatively flat, respecting distances from crowds of people and without endangering people not involved in the UAV flight.
  • Cold weather can be an impediment, given that the flight takes place in cold weather conditions that do not comply with the technical specifications of the UAV equipment (less than −5 degrees Celsius).
  • The position of the Sun can affect the quality of certain photos, depending on the location of the drone’s photo sensor.
  • For the legal operation of UAV flights, qualified personnel with pilot licenses are required.
  • Certain areas (waters and lakes) present particularities of reflectivity that make it very difficult or even impossible to process images in specialized software (Pix4D, AgiSoft, etc.).
First, an orthorectified image was obtained by processing the images obtained from the UAV flights. An average error of 2–3 cm was obtained, compared to significantly chosen points (dam edge, road marks, etc.) measured with the help of GNSS (Global Navigation Satellite System) technology. The points determined with the help of GNSS can be the subject of field measurements and office jobs that would involve several days of measurements and office calculations for an equivalent study area (approximately 2 hectares). This would include grid point verification and compensation, point density by planimetric displacement method, and complex calculations.
It must be considered that, following some field activities (UAV flights) that totaled 1 h of fieldwork, information was obtained with a tolerable error for the preparation of analyses, simulations, and GIS modeling for flood studies.
Also, a DEM of the study area was obtained, which proved useful in the subsequent preparation of the simulation and flood studies. The generated 3D model respects the relief and level curves that exist in the area.
Research, articles, case studies, and works previously published by specialists in this field of study have focused on the separate study of the way in which useful geospatial information can be obtained with the help of terrestrial measurement technologies or GIS analysis with predetermined information. The main topic that this study proposed to analyze is related to the efficient and fast way in which information related to floods can be obtained from the ground, with the help of UAV, because in the case of an intervention in the event of a disaster, time is the most considerable challenge.
The contributions of photogrammetry and topography to the field of preventing the effects of natural disasters have been known for several years. However, there are certain regions (the studied one is an example) where the authorities are still skeptical about the use of UAV information in the case of rapid intervention, complaining of a certain dubious accuracy.
Our study was concerned with an important area located in the immediate vicinity of the city of Cluj-Napoca, Romania. We therefore studied an extremely populated area (approximately 450,000 inhabitants in the metropolitan area), Floresti Commune, an urban locality with the largest population in Romania, according to the most recent population census (approximately 55,000 inhabitants). Although the operation of UAVs (Unmanned Aerial Vehicles) could also present certain risks, especially in the case of fully autonomous flights, these risks can be avoided by announcing the flights in advance. They have the advantage of durability.

5. Conclusions

Monitoring a disastrous event is important at present because the consequences of such a phenomenon directly affect society. The involvement of the authors in this research area was motivated by this and aimed to contribute to the prevention of disasters and to the limitation of material and (especially) human damage caused by them. The purpose of this work was the study of an area with high flood potential of the residential houses in the immediate vicinity.
As in any other field, there are advantages and disadvantages to the use of photogrammetric measurement methods, such as: The first significant advantage is the time taken to take aerial photograms; and the reduced staff, as only one authorized person is required to perform the flight. Important disadvantages to mention are the tracking of favorable weather conditions, the energy deficit of the battery, the need for the presence of a specialized person in the processing of the data acquired in the field for their correctness, and, from the authors’ point of view, the high cost of the necessary equipment in order to conduct photogrammetric measurements. In terms of the latter disadvantage, this study was conducted with UAV and GNSS equipment at the entry-level range.
The purpose of this work was to develop a complete workflow that includes all the stages conducted to accomplish a simulation in the case of the increase in the water flow of the Someșul Mic River. To achieve the final goal, namely, the simulation of the process of increasing the water flow, it was necessary to undertake the following steps:
  • The creation of a topographic map for the studied area using UAV technique was achieved after downloading and processing the images taken during the two UAV flights. Good precisions were obtained (2–3 cm/pixel), sufficient to create an orthophoto image, which faithfully reflected the studied area and that are the basis for the preparation of subsequent documents (DEM, level curves, flood simulation, etc.)
  • The data processing developed following the drone flight was undertaken with the Agisoft Metashape 1.8.5 software, processed and transformed into shapefiles with the help of Global Mapper, and processed with the help of the HEC-RAS software to obtain the estimated results.
  • The preparation of documentation was conducted by converting the file formats resulting from the images by transforming them into HEC-RAS-compatible files (shapefiles).
  • Creating a simulation to present possible disasters: The elevations at which the Someș River is located led to the determination of the river’s volume. The minimum elevation of the river is 335.146 m–0 m3 and the maximum elevation is 408.927 m–1055.577 × 103 m3.
The dam was defined as a unifying element that connects the Someș River, which represents the water drainage area, and the water overflow area, represented by the possibly flooded area. The intended simulation was successfully conducted for the three phases of the possible flood (primary, intermediate, and final), which proves that the initial data taken with the drone were suitable for creating a complete workflow.
This study therefore implemented a complete workflow model, starting at the stage of retrieving primary information (in the form of images from the drone), continuing with the stage of downloading and processing, and ending with the stage of transformation, modeling, and processing using specialized flood simulation software.
In the future, the authors aim for this simulation to be used by specialists to help people in areas possibly affected by natural disasters. The development of the study procedure can be conducted by adding several cycles of measurements with the aim of a more thorough detailing, for a better clarity of the evolution of the possible flooding process. Another approach direction for future studies is related to the applications of UAV LiDAR sensors for collecting information that can be used for flooding monitoring and simulations. The greatest desire of the authors of this paper is that the effort put into the development of this simulation model be a direct support in avoiding a disaster.

Author Contributions

R.G., S.M.N., V.M.R., I.S.V. and M.V.B. contributed equally to the work. All authors have read and agreed to the published version of the manuscript.

Funding

This research benefited from funding from the TUCN Development Program.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available upon request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Applsci 13 11688 g0a1

Appendix B

Applsci 13 11688 g0a2

References

  1. Ulloa, N.I.; Yun, S.-H.; Chiang, S.-H.; Furuta, R. Sentinel-1 Spatiotemporal Simulation Using Convolutional LSTM for Flood Mapping. Remote Sens. 2022, 14, 246. [Google Scholar] [CrossRef]
  2. Miller, J.D.; Hutchins, M. The impacts of urbanization and climate change on urban flooding and urban water quality: A review of the evidence concerning the United Kingdom. J. Hydrol. Reg. Stud. 2017, 12, 345–362. [Google Scholar] [CrossRef]
  3. Kundzewicz, Z.; Kanae, S.; Seneviratne, S.; Handmer, J.; Nicholls, N.; Peduzzi, P.; Mechler, R.; Bouwer, L.M.; Arnell, N.; Mach, K.; et al. Flood risk and climate change: Global and regional perspectives. Hydrol. Sci. J. 2014, 59, 1–28. [Google Scholar] [CrossRef]
  4. Hirabayashi, Y.; Mahendran, R.; Koirala, S.; Konoshima, L.; Yamazaki, D.; Watanabe, S.; Kim, H.; Kanae, S. Global flood risk under climate change. Nat. Clim. Chang. 2013, 3, 816–821. [Google Scholar] [CrossRef]
  5. Vousdoukas, M.I.; Mentaschi, L.; Voukouvalas, E.; Verlaan, M.; Jevrejeva, S.; Jackson, L.P.; Feyen, L. Global probabilistic projections of extreme sea levels show intensification of coastal flood hazard. Nat. Commun. 2018, 9, 2360. [Google Scholar] [CrossRef]
  6. Karamuz, E.; Romawicz, R.; Doroszkiewicz, J. The use of unmanned aerial vehicles in flood hazard assessment. J. Flood Risk Manag. 2020, 13, e12622. [Google Scholar] [CrossRef]
  7. Yang, K.; Zhang, S.; Yang, X.; Wu, N. Flood Detection Based on Unmanned Aerial Vehicle System and Deep Learning. Hindawi Complex. 2022, 2022, 9. [Google Scholar] [CrossRef]
  8. Tseng, K.-H.; Yang, T.-H.; Chen, P.-Y.; Chien, H.; Chen, C.-F.; Hung, Y.-C. Exploring the Feasibility of Mitigating Flood Hazards by an Existing Pond System in Taoyuan, Taiwan. Drones 2023, 7, 1. [Google Scholar] [CrossRef]
  9. Iqbal, U.; Riaz, M.Z.B.; Zhao, J.; Barthelemy, J.; Perez, P. Drones for Flood Monitoring, Mapping and Detection: A Bibliometric Review. Drones 2023, 7, 32. [Google Scholar] [CrossRef]
  10. Mohsan, S.A.H.; Khan, M.A.; Noor, F.; Ullah, I.; Alsharif, M.H. Towards the Unmanned Aerial Vehicles (UAVs): A Comprehensive Review. Drones 2022, 6, 147. [Google Scholar] [CrossRef]
  11. Alsamhi, S.H.; Shvetsov, A.V.; Kumar, S.; Shvetsova, S.V.; Alhartomi, M.A.; Hawbani, A.; Rajput, N.S.; Srivastava, S.; Saif, A.; Nyangaresi, V.O. UAV Computing-Assisted Search and Rescue Mission Framework for Disaster and Harsh Environment Mitigation. Drones 2022, 6, 154. [Google Scholar] [CrossRef]
  12. La Salandra, M.; Colacicco, R.; Dellino, P.; Capolongo, D. An Effective Approach for Automatic River Features Extraction Using High-Resolution UAV Imagery. Drones 2023, 7, 70. [Google Scholar] [CrossRef]
  13. Mazzoleni, M.; Paron, P.; Reali, A.; Juizo, D.; Manane, J.; Brandimarte, L. Testing UAV-derived topography for hydraulic modeling in a tropical environment. Nat. Hazards 2020, 103, 139–163. [Google Scholar] [CrossRef]
  14. Sampson, C.C.; Fewtrell, T.J.; Duncan, A.; Shaad, K.; Horritt, M.S.; Bates, P.D. Use of terrestrial laser scanning data to drive decametric resolution urban inundation models. Adv. Water Resour. 2012, 41, 1–17. [Google Scholar] [CrossRef]
  15. Morgan, B.E.; Chipman, J.W.; Bolger, D.T.; Dietrich, J.T. Spatiotemporal Analysis of Vegetation Cover Change in a Large Ephemeral River: Multi-Sensor Fusion of Unmanned Aerial Vehicle (UAV) and Landsat Imagery. Remote Sens. 2021, 13, 51. [Google Scholar] [CrossRef]
  16. Howarth, P.J.; Wickware, G.M. Procedures for change detection using Landsat digital data. Int. J. Remote Sens. 1981, 2, 277–291. [Google Scholar] [CrossRef]
  17. Singh, A. Digital change detection techniques using remotely sensed data. Int. J. Remote Sens. 1989, 10, 989–1003. [Google Scholar] [CrossRef]
  18. Zhu, Z.; Woodcock, C.E. Continuous change detection and classification of land cover using all available Landsat data. Remote Sens. Environ. 2014, 144, 152–171. [Google Scholar] [CrossRef]
  19. Pereira, L.G.; Fernandez, P.; Mourato, S.; Matos, J.; Mayer, C.; Marques, F. Quality Control of Outsourced LiDAR Data Acquired with a UAV: A Case Study. Remote Sens. 2021, 13, 419. [Google Scholar] [CrossRef]
  20. Bilașco, Ş.; Hognogi, G.-G.; Rosca, S.; Pop, A.-M.; July, V.; Fodorean, I.; Marian-Potra, A.-C.; Sestras, P. Flash Flood Risk Assessment and Mitigation in Digital-Era Governance Using Unmanned Aerial Vehicle and GIS Spatial Analyzes Case Study: Small River Basins. Remote Sens. 2022, 14, 2481. [Google Scholar] [CrossRef]
  21. Martin, C.; Kamar, O.; Berzosa, I.; Badiola, J.L. Smart GIS platform that facilitates the digitalization of the integrated urban drainage system. Environ. Model. Softw. 2020, 123, 104568. [Google Scholar] [CrossRef]
  22. Da Silva, L.B.L.; Alencar, M.H.; de Almeida, A.T. Multidimensional flood risk management under climate changes: Bibliometric analysis, trends and strategic guidelines for decision-making in urban dynamics. Int. J. Disaster Risk Reduct. 2020, 50, 101865. [Google Scholar] [CrossRef]
  23. Niedzielski, T.; Witek, M.; Spallek, W. Observing river stages using unmanned aerial vehicles. Hydrol. Earth Syst. Sci. 2016, 20, 3193–3205. [Google Scholar] [CrossRef]
  24. Koschitzki, R.; Schwalbe, E.; Krohnert, M.; Cardenas, C.; Maas, H. Multi-temporal photogrammetric analysis to monitor the river Las Minas, Punta Arenas, Chile. IEEE Lat. Am. Trans. 2018, 16, 2481–2489. [Google Scholar] [CrossRef]
  25. García-López, S.; Vélez-Nicolás, M.; Martínez-López, J.; Sánchez-Bellón, A.; Pacheco-Orellana, M.J.; Ruiz-Ortiz, V.; Muñoz-Pérez, J.J.; Barbero, L. Using UAV Photogrammetry and Automated Sensors to Assess Aquifer Recharge from a Coastal Wetland. Remote Sens. 2022, 14, 6185. [Google Scholar] [CrossRef]
  26. Ahmed, T.; Creedon, L.; Gharbia, S.S. Low-Cost Sensors for Monitoring Coastal Climate Hazards: A Systematic Review and Meta-Analysis. Sensors 2023, 23, 1717. [Google Scholar] [CrossRef]
  27. Wang, X.; Xie, H. A Review on Applications of Remote Sensing and Geographic Information Systems (GIS) in Water Resources and Flood Risk Management. Water 2018, 10, 608. [Google Scholar] [CrossRef]
  28. Lu, Y.; Song, W.; Lu, J.; Wang, X.; Tan, Y. An Examination of Soil Moisture Estimation Using Ground Penetrating Radar in Desert Steppe. Water 2017, 9, 521. [Google Scholar] [CrossRef]
  29. Steelman, C.M.; Endres, A.L.; Jones, J.P. High-resolution ground-penetrating radar monitoring of soil moisture dynamics: Field result, interpretation, and comparison with unsaturated flow model. Water Resour. Res. 2012, 48, 184–189. [Google Scholar] [CrossRef]
  30. Annis, A.; Nardi, F.; Petroselli, A.; Apollonio, C.; Arcangeletti, E.; Tauro, F.; Belli, C.; Bianconi, R.; Grimaldi, S. UAV-DEMs for Small-Scale Flood Hazard Mapping. Water 2020, 12, 1717. [Google Scholar] [CrossRef]
  31. Sammartano, G.; Spanò, A. DEM Generation Based on UAV Photogrammetry Data in Critical Areas. In Proceedings of the 2nd International Conference on Geographical Information Systems Theory, Applications and Management, Rome, Italy, 26–27 April 2016; pp. 92–98. [Google Scholar]
  32. Polat, N.; Uysal, M. DTM Generation with UAV Based Photogrammetric Point Cloud. Int. Arch. Photogram. Remote Sens. Sleep. Inf. Sci.—ISPRS Arch. 2017, 42, 77–79. [Google Scholar] [CrossRef]
  33. Arif, F.; Abdul Maulud, K.N.; Ab Rahman, A.A. Generation of Digital Elevation Model through Aerial Technique. IOP Conf. Ser. Earth Environ. Sci. 2018, 169, 012093. [Google Scholar] [CrossRef]
  34. Manfreda, S.; McCabe, M.F.; Miller, P.E.; Lucas, R.; Madrigal, V.P.; Mallinis, G.; Dor, E.B.; Helman, D.; Estes, L.; Ciraolo, G.; et al. On the Use of Unmanned Aerial Systems for Environmental Monitoring. Remote Sens. 2018, 10, 641. [Google Scholar] [CrossRef]
  35. Aguilar, F.J.; Rivas, J.R.; Nemmaoui, A.; Peñalver, A.; Aguilar, M.A. UAV-Based Digital Terrain Model Generation under Leaf-off Conditions to Support Teak Plantations Inventories in Tropical Dry Forests. A Case of the Coastal Region of Ecuador. Sensors 2019, 19, 1934. [Google Scholar] [CrossRef] [PubMed]
  36. Pellicani, R.; Argentiero, I.; Manzari, P.; Spilotro, G.; Marzo, C.; Ermini, R.; Apollonio, C. UAV and Airborne LiDAR Data for Interpreting Kinematic Evolution of Landslide Movements: The Case Study of the Montescaglioso Landslide (Southern Italy). Geosciences 2019, 9, 248. [Google Scholar] [CrossRef]
  37. CRANFIELD UNIVERSITY. Available online: https://www.cranfield.ac.uk/case-studies/research-case-studies/drone-watch (accessed on 14 October 2023).
  38. GEONADIR. Available online: https://geonadir.com/using-drones-flooding-management/ (accessed on 12 October 2023).
  39. UNESCO. Available online: https://www.unesco.org/en/articles/sentinels-above-how-drones-are-helping-gambia-cope-rising-flood-risk (accessed on 14 October 2023).
  40. Route-Fifty. Available online: https://www.route-fifty.com/management/2023/07/flood-management-gets-boost-drones/388746/ (accessed on 13 October 2023).
  41. Romanian Position Determination System. Available online: www.rompos.ro (accessed on 27 September 2022).
  42. GNSS Geomax Zenith 10. Available online: https://geomax-positioning.com/products/gnss (accessed on 17 August 2022).
  43. Godfather, S.M.; Bondrea, M.V.; Rădulescu, V.M.; Galgău, R.; Veres, I.S.; Bondrea, R.; Rădulescu, A.T. The Use of UAVs for Land Use Planning of Brownfield Regeneration Projects-Case Study: Former Brick Factory, Cluj Napoca, Romania. Land 2023, 12, 315. [Google Scholar] [CrossRef]
  44. Crommelinck, S.; Bennett, R.; Gerke, M.; Yang, M.Y.; Vosselman, G. Contour Detection for UAV-Based Cadastral Mapping. Remote Sens. 2017, 9, 171. [Google Scholar] [CrossRef]
  45. Zhou, Y.; Rupnik, E.; Meynard, C.; Thom, C.; Pierrot-Deseilligny, M. Simulation and Analysis of Photogrammetric UAV Image Blocks—Influence of Camera Calibration Error. Remote Sens. 2020, 12, 22. [Google Scholar] [CrossRef]
  46. Stöcker, C.; Nex, F.; Koeva, M.; Gerke, M. High-Quality UAV-Based Orthophotos for Cadastral Mapping: Guidance for Optimal Flight Configurations. Remote Sens. 2020, 12, 3625. [Google Scholar] [CrossRef]
  47. Varga, Z.; Vörös, F.; Pál, M.; Kovács, B.; Jung, A.; Elek, I. Performance and Accuracy Comparisons of Classification Methods and Perspective Solutions for UAV-Based Near-Real-Time “Out of the Lab” Data Processing. Sensors 2022, 22, 8629. [Google Scholar] [CrossRef]
  48. Orsini, C.; Benozzi, E.; Williams, V.; Rossi, P.; Mancini, F. UAV Photogrammetry and GIS Interpretations of Extended Archaeological Contexts: The Case of Tacuil in the Calchaquí Area (Argentina). Drones 2022, 6, 31. [Google Scholar] [CrossRef]
  49. Kotsi, E.; Vassilakis, E.; Diakakis, M.; Mavroulis, S.; Konsolaki, A.; Filis, C.; Lozios, S.; Lekkas, E. Using UAS-Aided Photogrammetry to Monitor and Quantify the Geomorphic Effects of Extreme Weather Events in Tectonically Active Mass Waste-Prone Areas: The Case of Medicane Ianos. Appl. Sci. 2023, 13, 812. [Google Scholar] [CrossRef]
  50. Notti, D.; Giordan, D.; Caló, F.; Pepe, A.; Zucca, F.; Galve, J.P. Potential and Limitations of Open Satellite Data for Flood Mapping. Remote Sens. 2018, 10, 1673. [Google Scholar] [CrossRef]
  51. Zhang, Z.; Zhu, L. A Review on Unmanned Aerial Vehicle Remote Sensing: Platforms, Sensors, Data Processing Methods, and Applications. Drones 2023, 7, 398. [Google Scholar] [CrossRef]
  52. Matese, A.; Toscano, P.; Di Gennaro, S.F.; Genesio, L.; Vaccari, F.P.; Primicerio, J.; Belli, C.; Zaldei, A.; Bianconi, R.; Gioli, B. Intercomparison of UAV, Aircraft and Satellite Remote Sensing Platforms for Precision Viticulture. Remote Sens. 2015, 7, 2971–2990. [Google Scholar] [CrossRef]
Figure 1. Somes River in the studied zone (our own source).
Figure 1. Somes River in the studied zone (our own source).
Applsci 13 11688 g001
Figure 2. The UAS equipment used for retrieving information (our own source).
Figure 2. The UAS equipment used for retrieving information (our own source).
Applsci 13 11688 g002
Figure 3. Mounting of the targets on the ground.
Figure 3. Mounting of the targets on the ground.
Applsci 13 11688 g003
Figure 4. Processing of the data obtained using photogrammetric methods.
Figure 4. Processing of the data obtained using photogrammetric methods.
Applsci 13 11688 g004
Figure 5. The cloud of points after classifications.
Figure 5. The cloud of points after classifications.
Applsci 13 11688 g005
Figure 6. Building and georeferencing the DEM.
Figure 6. Building and georeferencing the DEM.
Applsci 13 11688 g006
Figure 7. The orthophoto plane resulting from the processing of the information taken with the UAV.
Figure 7. The orthophoto plane resulting from the processing of the information taken with the UAV.
Applsci 13 11688 g007
Figure 8. Level curves.
Figure 8. Level curves.
Applsci 13 11688 g008
Figure 9. The digital elevation model (DEM) results from the processing of the UAV images.
Figure 9. The digital elevation model (DEM) results from the processing of the UAV images.
Applsci 13 11688 g009
Figure 10. Definition of the Florești dam area.
Figure 10. Definition of the Florești dam area.
Applsci 13 11688 g010
Figure 11. Dam section.
Figure 11. Dam section.
Applsci 13 11688 g011
Figure 12. Details of the simulation process.
Figure 12. Details of the simulation process.
Applsci 13 11688 g012
Figure 13. The last phase of the flood. Greater depths are shown in dark blue and shallower depths in light blue.
Figure 13. The last phase of the flood. Greater depths are shown in dark blue and shallower depths in light blue.
Applsci 13 11688 g013
Table 1. List of GCP (ground control point) coordinates. Coordinate system: Romania, Stereo 70.
Table 1. List of GCP (ground control point) coordinates. Coordinate system: Romania, Stereo 70.
GCP No.North (X)East (Y)Elevation (Z)
1584,306.6158384,245.8419367.2239
2584,301.8881384,517.4902366.8630
3584,680.0783384,706.8169365.8707
4584,211.9466384,228.9209368.1579
5584,207.2164384,231.7458368.0768
6584,337.3075384,685.4259366.7049
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Gâlgău, R.; Naș, S.M.; Radulescu, V.M.; Vereș, I.S.; Bondrea, M.V. The Use of UAVs to Obtain Necessary Information for Flooding Studies: The Case Study of Somes River, Floresti, Romania. Appl. Sci. 2023, 13, 11688. https://doi.org/10.3390/app132111688

AMA Style

Gâlgău R, Naș SM, Radulescu VM, Vereș IS, Bondrea MV. The Use of UAVs to Obtain Necessary Information for Flooding Studies: The Case Study of Somes River, Floresti, Romania. Applied Sciences. 2023; 13(21):11688. https://doi.org/10.3390/app132111688

Chicago/Turabian Style

Gâlgău, Raluca, Sanda Marioara Naș, Virgil Mihai Radulescu, Ioel Samuel Vereș, and Mircea Vasile Bondrea. 2023. "The Use of UAVs to Obtain Necessary Information for Flooding Studies: The Case Study of Somes River, Floresti, Romania" Applied Sciences 13, no. 21: 11688. https://doi.org/10.3390/app132111688

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop