A New Methodology for Mapping Past Rockfall Events: From Mobile Crowdsourcing to Rockfall Simulation Validation

: Rockfalls are one of the most common natural hazards in mountainous areas that pose high risk to people and their activities. Rockfall risk assessment is commonly performed with the use of models that can simulate the potential rockfall source, propagation and runout areas. The quality of the models can be improved by collecting data on past rockfall events. Mobile crowdsourcing is becoming a common approach for collecting ﬁeld data by using smartphones, the main advantages of which are the use of a harmonised protocol, and the possibility of creating large datasets due to the simultaneous use by multiple users. This paper presents a new methodology for collecting past rockfall events with a mobile application, where the locations and attributes of rockfall source areas and rockfall deposits are collected, and the data are stored in an online database which can be accessed via the WebGIS platform. The methodology also presents an approach for calculating an actual source location based on viewshed analysis which greatly reduces the problem of ﬁeld mapping of inaccessible source areas. Additionally, we present a rockfall database in the Alpine Space that has been created by the presented methodology, and an application of collected data for the calibration and validation of two rockfall models (CONEFALL and Rockyfor3D). raster


Introduction
Rockfall is a fragmented rock or a block that has detached from a surface slope or cliff by falling, sliding, toppling, bouncing or rolling [1]. Because rockfalls occurs suddenly, usually without any visible warning signs, they are extremely difficult (or impossible) to predict, and pose a great potential threat to people and infrastructure [2,3]. Rockfall models are useful tools for assessing rockfall risk, as well as the planning of rockfall protection measures in high-risk areas since they can be used to predict rockfall trajectories, distribution and intensity of impacts, and magnitude of rockfall events [4][5][6]. The quality of rockfall risk assessment is directly linked to the available databases of past rockfall events since this information allows for the analysis of spatial distribution of the process, its frequency and magnitude. The most important features that are needed for the determination of spatial distribution, frequency and magnitude of a rockfall event, are the location of the rockfall source (release) area and locations of the corresponding deposits (rock blocks and their volumes) [7][8][9][10][11]. The spatial distribution of the rockfall phenomena is used for rockfall propagation analyses which are performed with various empirical and probabilistic models [4][5][6]12,13], namely for the purpose of calibration, validation and verification of the model's performance [4,6,14]. Moreover, rockfall deposit volumes are needed for studying rockfall frequency-size distribution laws, and the temporal occurrence of rockfalls for calculating the rockfall

Materials and Methods
The Figure 1 presents the methodological framework of the whole work-flow from data collection in the field to its synchronisation with a complete database, visualisation and its possible further use. The framework is divided into two working parts: into field work and data processing. The field work consists of collecting rockfall source and deposit data directly in the field with the use of mobile application (either smartphone or tablet), while the data processing part consists of uploading collected data to the existing database, visualisation of data in WebGIS, and calculation of energy line angle values for possible further use of the data in rockfall modelling. on a smartphone or tablet; (8) it does not require an internet connection for use in the field since collected data can be stored on the device and later synchronised with online database; (9) the maps required for the field work can be downloaded to the device; and (10) the application is compatible with external GNSS receivers which enables the collection of data with greater location accuracy, and with the option of using the average location.

Collection of Data in the Field
The collection of data begins with by capturing the location of the rockfall source area. Since rockfall source areas are generally inaccessible or difficult to access (e.g., rock cliffs), the user collects the location of the standing point from which the rockfall source area is visible. From this point one also measures the angle and azimuth towards an actual rockfall source area ( Figure 2-Step 1), and also enters additional attributes that describe the source area (see Section 2.1.3). The actual location of the rockfall source area is calculated subsequently in the data processing stage (see Section 2.3). In

Characterisation of the Mobile Application
The collection of a rockfall source area and its deposits in the field is performed with the Collector for ArcGIS mobile application [51]. The application enables the configuration of the data collection form which was in the case of this study configured to store data as two separate point shapefiles (for source and deposits). The application provides a simple interface and, therefore, enables easy and quick collection of data. The main characteristics of this mobile application are [51]: (1) it provides geolocation (latitude and longitude) as a point shapefile; (2) it enables the collection of various attributes by direct input or form a pre-defined list of attribute possibilities that are accessed via a drop-down menu; (3) the collected data can be edited throughout the whole process; (4) the application can be used by several users simultaneously by enabling authorship tracking option and time tracking option; (5) multiple photographs can be added to each collected feature; (6) it is available for various operating systems (e.g., Android, iOS, Windows); (7) the application can be used on a smartphone or tablet; (8) it does not require an internet connection for use in the field since collected data can be stored on the device and later synchronised with online database; (9) the maps required for the field work can be downloaded to the device; and (10) the application is compatible with external GNSS receivers which enables the collection of data with greater location accuracy, and with the option of using the average location.

Collection of Data in the Field
The collection of data begins with by capturing the location of the rockfall source area. Since rockfall source areas are generally inaccessible or difficult to access (e.g., rock cliffs), the user collects the location of the standing point from which the rockfall source area is visible. From this point one also measures the angle and azimuth towards an actual rockfall source area ( Figure 2-Step 1), and also enters additional attributes that describe the source area (see Section 2.1.3). The actual location of the rockfall source area is calculated subsequently in the data processing stage (see Section 2.2.2). In the next step the user measures the locations of corresponding rock deposits and records additional attributes (see Section 2.1.3). Since the rockfall source area is generally a single area (representing a larger area), the survey form is structured so that multiple rockfall deposits are added to the individual rockfall source area using the concept "one-to-many" (Figure 2-Step 2). This means that each object in the original attribute table (rockfall source area) is linked to the multiple objects in the associated table (rockfall deposit area). Due to this relationship, each rockfall source area feature point has its own unique identification number (SOURCE_ID) that links together all corresponding deposits, while each deposit also has its own unique ID (DEPOSIT_ID). The number of corresponding rockfall deposits to a single rockfall source area is unlimited. If one has an Internet connection in the field, the collected data are directly synchronised with the existing database; if there is no Internet connection, the data are temporarily stored on the mobile device and synchronised after the field collection of data.

Data Attributes
Besides the location (X and Y coordinate) of an individual feature (being automatically stored), the rockfall source area record can have up to 14 attributes, and rockfall deposits up to 17 attributes ( Figure 3). All records store information about the date and time at which the data were collected along with information about the author who entered the new source or deposit, and information about when and by whom the input was changed. Both attributes are stored automatically since the user has a specific account with which they use the application. Some attributes for both features are optional and do not have to be collected, while the majority of them are obligatory, meaning that one cannot store a feature before filling-in those attributes. Attributes that are not obligatory are: notes (both source and deposit feature-user can enter observations about that feature; e.g., temporal information about the rockfall event), information about the measuring equipment that was used (stored with the rockfall source feature-e.g., type of GNSS receiver, equipment for measuring of angle and azimuth), photographs (both source and deposit feature), and tree DBH (stored with the rockfall deposit feature-DBH = diameter at breast height: 1.3 m; in case the rock had been stopped by a tree).
Other attributes (shown in Figure 3) are obligatory for the collection and description of the source or deposit, and were determined based on the various classifications used for describing the phenomena, emphasizing that the collected data can be used to model rockfalls. Numerical data (e.g., angle and azimuth for the source area, rock dimension and tree DBH for the rock deposit) have upper and lower limits that can be entered in order to avoid possible mistakes while entering the numbers into the application (angle values 0-90 • , azimuth values 0-360 • ). Each rockfall deposit must be measured in all three dimensions, and in order to be collected the rock should have at least one dimension (x, y or z) larger than 50 cm. Type of rockfall source, forest information, the shape of rockfall deposit, and stopping cause of rockfall deposit are categorical attributes and predefined, meaning that the user can only choose between defined categories from the drop-down menu. The type of rockfall source area categories were formed based on the typology by Ancelin et al. [52], while rock shape categories are based on Dorren [4]. Stopping cause of rockfall deposits were determined based on the most common situations observed in the field. Forest information provides information about whether the rock source area or deposit are located within a forest or not. Step 1-concept of defining rockfall source area and deposit areas in the field; Step 2-mobile application Collector for ArcGIS interface (leftentering data for source area, middle-the list of recorded rockfall deposits, right-the collected features presented on the Web Map, red dot-source point, green points-deposit points); Step 3data that are being collected with the Collector for ArcGIS are being stored to the cloud-based database on the ArcGIS Online Server. With that they are also synchronised with existing web rockfall database (after the field work). Collected data are then directly visualised in the WebGIS Platform as a Web Map that enables displaying, analysing and querying of stored data in the cloud. Step 1-concept of defining rockfall source area and deposit areas in the field; Step 2-mobile application Collector for ArcGIS interface (left-entering data for source area, middle-the list of recorded rockfall deposits, right-the collected features presented on the Web Map, red dot-source point, green points-deposit points); Step 3-data that are being collected with the Collector for ArcGIS are being stored to the cloud-based database on the ArcGIS Online Server. With that they are also synchronised with existing web rockfall database (after the field work). Collected data are then directly visualised in the WebGIS Platform as a Web Map that enables displaying, analysing and querying of stored data in the cloud.   Other attributes (shown in Figure 3) are obligatory for the collection and description of the source or deposit, and were determined based on the various classifications used for describing the phenomena, emphasizing that the collected data can be used to model rockfalls. Numerical data (e.g., angle and azimuth for the source area, rock dimension and tree DBH for the rock deposit) have upper and lower limits that can be entered in order to avoid possible mistakes while entering the numbers into the application (angle values 0-90°, azimuth values 0-360°). Each rockfall deposit must be measured in all three dimensions, and in order to be collected the rock should have at least one dimension (x, y or z) larger than 50 cm. Type of rockfall source, forest information, the shape of rockfall deposit, and stopping cause of rockfall deposit are categorical attributes and predefined, meaning that the user can only choose between defined categories from the drop-down menu. The type of rockfall source area categories were formed based on the typology by Ancelin et al. [52], while rock shape categories are based on Dorren [4]. Stopping cause of rockfall deposits were determined based on the most common situations observed in the field. Forest information provides information about whether the rock source area or deposit are located within a forest or not.

Synchronisation of Data and Visualisation in the WebGIS Platform
The WebGIS platform is intended for the visualisation of the data collected with a mobile application, and since it provides a simple and interactive graphic user interface it can be used by the lay public. It represents the link between the geographical data (collected rockfall events) collected by the Collector for ArcGIS application and the cloud-based online database held on Esri's ArcGIS Online server. The platform for showing past rockfall events is implemented through the Esri online Web Map application ( Figure 2-Step 3). Users of the WebGIS can only view the collected data since the mobile application has the purpose of collecting rockfall events which can in in combination with an external GNSS receiver be performed with higher accuracy. However, there are many other

Synchronisation of Data and Visualisation in the WebGIS Platform
The WebGIS platform is intended for the visualisation of the data collected with a mobile application, and since it provides a simple and interactive graphic user interface it can be used by the lay public. It represents the link between the geographical data (collected rockfall events) collected by the Collector for ArcGIS application and the cloud-based online database held on Esri's ArcGIS Online server. The platform for showing past rockfall events is implemented through the Esri online Web Map application ( Figure 2-Step 3). Users of the WebGIS can only view the collected data since the mobile application has the purpose of collecting rockfall events which can in in combination with an external GNSS receiver be performed with higher accuracy. However, there are many other functionalities that crowd users can utilize on that platform which enables the display and querying of data in form of charts, map views and images. The displayed data originate from the original, live data that from the rockfall database, and with each new entry from the mobile application, it is automatically added to the Web Map. The web application is publicly available and the data can also be downloaded by the user. The WebGIS application does not enable the direct upload of the new events by the user unless one contacts the administrator. Additionally, the source of data can be tracked for each feature to see whether it was collected from some other source or with the mobile application.

Calculation of an Actual Rockfall Source Area and Energy Line Angles
The calculation of an actual rockfall source area is performed by use of a specially designed tool (called ELA, energy line angle) in the ArcGIS environment [53] (summarised on Figure 4). This tool calculates an actual source area location by using the location of a measured rockfall source area in the field, the locations of rockfall deposits and high-resolution digital terrain model-DTM (inputs into the tool). The final outputs of the tool are two: an actual location of the rockfall source area, and energy line angles for each rockfall deposit. The first output of the tool is calculated on the basis of visibility ISPRS Int. J. Geo-Inf. 2020, 9, 514 8 of 21 analysis by using the Viewshed 2 tool in ArcMap 10.5 [52]. This tool calculates the surface (based on DTM) visible from one location-in this case the location of the rockfall source area collected in the field, while the view is limited by the angle and azimuth toward an actual rockfall source area.   Based on the angle and azimuth measurements towards the actual source area, the actual location is calculated using the viewshed analysis. Based on the location of an actual rockfall source area and locations of corresponding rockfall deposits, the distance between individual pairs is calculated which is further used for calculation of energy line angles (together with the change in altitude).
The second is a set of energy line angles for each rock deposit, calculated on the basis of Heim's [54] principle. Based on this principle (Figure 4), the run-out distance (L) of a rockfall deposit can be estimated by using the intersection of a line connecting the top of the rockfall cliff with a slope equal to: with the topography, where ∆z is equal to the difference in elevation between the top of the rockfall cliff and L being the distance between the top of the rockfall cliff and an individual rockfall deposit [55]. Therefore, the coordinates of an actual rockfall source area point and corresponding rockfall deposits are used for calculating the run-out distance (L) of individual rockfall deposits as well as the difference (∆z) in elevation between the source point and deposit points ( Figure 5). Using Equation (1), the value of γ is calculated which presents the value of an energy line angle as output that is appended to the existing attribute table.
using the energy line angle (ELA) tool. Input data include the location of a field collected rockfall source area, corresponding deposits (calculation performed per rockfall), and a digital terrain model (DTM). Based on the angle and azimuth measurements towards the actual source area, the actual location is calculated using the viewshed analysis. Based on the location of an actual rockfall source area and locations of corresponding rockfall deposits, the distance between individual pairs is calculated which is further used for calculation of energy line angles (together with the change in altitude).

Case Study: Rockfall Database in the Alpine Space
After designing the mobile application, we began collecting data within the Alpine Space area (the Alps and their surrounding lowlands-Italy, France, Switzerland, Germany, Austria and Slovenia). The purpose of creating a historical rockfall database was to develop a new rockfall model called ROCK-EU (Interreg Alpine Space project ROCKtheALPS) [56]. For the duration of the project we surveyed 1516 locations of rockfall sites and have collected data on 4448 corresponding rockfall deposits; via other sources we also additionally added 1181 rockfalls with 2574 rock deposits. The field survey was conducted by experts from various research fields (e.g., experts from forestry, geology, environmental engineering etc.). After the field survey, the collected features were synchronised with the existing online database, and the data were then directly transferred to the WebGIS.
The WebGIS outlook is structured in a way that the Web Map with collected features represents the largest part of the website ( Figure 5); the navigation pane is limited to small icons that can be popped-up by clicking on them. This pane includes the five sections: (i) short introduction explaining the content of the Web Map, (ii) list of layers, (iii) rockfall statistics tools, (iv) available basemaps for the Web Map, and (v) download section from where Web Map data can be exported. By clicking on an individual rockfall source point or deposit point ( Figure 6), a pop-up window will appear with a list of all attributes that were collected along with the photographs of that source/deposit if they were taken.
By selecting a rockfall source point one can also obtain a list of all rock deposits that were collected at this site and via that list all those deposit attributes can be accessed. WebGIS tools enable simple statistical analyses of collected attributes (Figure 7), e.g., about the ratio between different source types or rockfall deposit shapes etc. The analyses can be performed for the whole Web Map extent at once or by using a spatial limitation query such as reduction of the Web Map extent or definition of the Web Map extent for the wanted analysis. The user of the WebGIS can change the Web Map's basemap (e.g., topographic, imagery, streets etc.) for better visualisation, and the collected data can be exported in a common shapefile format to be further used in different GIS programs. The datum used in all WebGIS is EPSG:3857.
geology, environmental engineering etc.). After the field survey, the collected features were synchronised with the existing online database, and the data were then directly transferred to the WebGIS.
The WebGIS outlook is structured in a way that the Web Map with collected features represents the largest part of the website ( Figure 5); the navigation pane is limited to small icons that can be popped-up by clicking on them. This pane includes the five sections: (i) short introduction explaining the content of the Web Map, (ii) list of layers, (iii) rockfall statistics tools, (iv) available basemaps for the Web Map, and v) download section from where Web Map data can be exported. By clicking on an individual rockfall source point or deposit point ( Figure 6), a pop-up window will appear with a list of all attributes that were collected along with the photographs of that source/deposit if they were taken. By selecting a rockfall source point one can also obtain a list of all rock deposits that were collected at this site and via that list all those deposit attributes can be accessed. WebGIS tools enable simple statistical analyses of collected attributes (Figure 7), e.g., about the ratio between different source types or rockfall deposit shapes etc. The analyses can be performed for the whole Web Map   Based on the collected data, basic statistics were calculated in order to obtain an overview of rockfalls in this area. The average recorded length of rockfall runout zone was 250 m; the shortest runout was 5 m and the longest 1828 m. Most rockfall deposits stopped at the energy line angle 49° ( Figure 8); after energy line angle 52° the frequency of the energy line angle drops drastically. The second peak is between 20° and 40°. The most common rockfall source type is rock cliff (99.1%), followed by bare rock (0.5%) and ground rocks (0.4 %), while there was no example of the type "rocks behind the trees". Rockfall source area locations were mainly located outside the forest area (97.1%). Average volume of rockfall deposits was 2.3 m 3 , and the majority of rocks had a volume smaller than 1 m 3 . The most common rockfall shapes were undefined (45.7%) and rectangular (30.4%). The main stop cause of rocks were other rocks (69.9 %), followed by undefined/normal stop (12.4%) and trees (9.1%). Those trees had an average DBH of 28.4 cm. More than a half of the rockfall deposits were deposited outside the forest area (66.7%).
Altitudinal zonation of the vegetation in the Alps which represent specific vegetation and climate features and can both have a great impact on formation of rockfall source areas (release of Figure 7. Available statistics about both features (source and deposit area). The statistics can be calculated for the whole Web Map extent or for a spatially limited area that can either be chosen with a different spatial extent of the Web Map or by using a user-defined area (e.g., spatial selection via point, line, or polygon).
Based on the collected data, basic statistics were calculated in order to obtain an overview of rockfalls in this area. The average recorded length of rockfall runout zone was 250 m; the shortest runout was 5 m and the longest 1828 m. Most rockfall deposits stopped at the energy line angle 49 • (Figure 8); after energy line angle 52 • the frequency of the energy line angle drops drastically. The second peak is between 20 • and 40 • . The most common rockfall source type is rock cliff (99.1%), followed by bare rock (0.5%) and ground rocks (0.4 %), while there was no example of the type "rocks behind the trees". Rockfall source area locations were mainly located outside the forest area (97.1%).
Average volume of rockfall deposits was 2.3 m 3 , and the majority of rocks had a volume smaller than 1 m 3 . The most common rockfall shapes were undefined (45.7%) and rectangular (30.4%). The main stop cause of rocks were other rocks (69.9 %), followed by undefined/normal stop (12.4%) and trees (9.1%). Those trees had an average DBH of 28.4 cm. More than a half of the rockfall deposits were deposited outside the forest area (66.7%). As can be seen in Figure 9 the majority of individual rockfall sources is located in the first three zones as well as the rockfall deposits. The majority of deposits were collected in the second, montane zone. The maximum recorded rockfall source altitude was 3570 m, while for rockfall deposit it was a little lower: 3309 m. The average recorded rockfall source altitude was 1341 m, and the average rockfall deposit altitude 1211 m. The prevailing slope orientation of both sources and deposits was west (25% and 32%), followed by northwest and southwest oriented slopes.

Application of Collected Data for Calibration and Validation of Rockfall Modelling
The application of the methodology was tested for calibration and validation of two rockfall models: the empirical rockfall model CONEFALL [55], and the probabilistic process-based rockfall trajectory model Rockyfor3D [59]. The CONEFALL model uses the energy line method based on a simple Coulomb frictional model for calculating the rockfall propagation areas calculated on the basis of a conical shape. Rockyfor3D is a physically-based model that calculates trajectories of single individually falling rocks in three dimensions (3D). For detailed descriptions of both models see references in the beginning of the paragraph. In order to demonstrate the calibration and validation applicability of data collected with the mobile application based on the proposed methodology, rockfall, the characteristics of two rockfalls were collected. Tested rockfalls are located in the northwestern part of Slovenia (Europe) in the Julian Alps (Figure 10  Altitudinal zonation of the vegetation in the Alps which represent specific vegetation and climate features and can both have a great impact on formation of rockfall source areas (release of rock material), and transportation and deposition of the rockfall deposits (presence of forest vegetation or not). The greatest change in the vegetation cover occurs with the increasing altitude since there will be no more obstacles that could reduce the velocity of the rocks or completely stop them. The features collected with the application offered us an insight into the topography and rockfall activity of the Alpine Space. Following the vegetation and altitudinal features of the Alps we were able to analyze rockfalls based on five zones (we took lower height limits for north-facing slopes) [57], namely foothill slope (0-900 m), montane zone (901-1500 m), subalpine zone (1501-2200 m), alpine zone (2201-2900 m), and nival zone (>2900 m). Analyses were combined with the DEM model of 25 m for the whole Alpine Space, provided by Copernicus [58].
As can be seen in Figure 9 the majority of individual rockfall sources is located in the first three zones as well as the rockfall deposits. The majority of deposits were collected in the second, montane zone. The maximum recorded rockfall source altitude was 3570 m, while for rockfall deposit it was a little lower: 3309 m. The average recorded rockfall source altitude was 1341 m, and the average rockfall deposit altitude 1211 m. The prevailing slope orientation of both sources and deposits was west (25% and 32%), followed by northwest and southwest oriented slopes.

Application of Collected Data for Calibration and Validation of Rockfall Modelling
The application of the methodology was tested for calibration and validation of two rockfall models: the empirical rockfall model CONEFALL [55], and the probabilistic process-based rockfall trajectory model Rockyfor3D [59]. The CONEFALL model uses the energy line method based on a simple Coulomb frictional model for calculating the rockfall propagation areas calculated on the basis of a conical shape. Rockyfor3D is a physically-based model that calculates trajectories of single individually falling rocks in three dimensions (3D). For detailed descriptions of both models see references in the beginning of the paragraph. In order to demonstrate the calibration and validation applicability of data collected with the mobile application based on the proposed methodology, rockfall, the characteristics of two rockfalls were collected. Tested rockfalls are located in the north-western part of Slovenia (Europe) in the Julian Alps (Figure 10  As can be seen in Figure 9 the majority of individual rockfall sources is located in the first three zones as well as the rockfall deposits. The majority of deposits were collected in the second, montane zone. The maximum recorded rockfall source altitude was 3570 m, while for rockfall deposit it was a little lower: 3309 m. The average recorded rockfall source altitude was 1341 m, and the average rockfall deposit altitude 1211 m. The prevailing slope orientation of both sources and deposits was west (25% and 32%), followed by northwest and southwest oriented slopes.

Application of Collected Data for Calibration and Validation of Rockfall Modelling
The application of the methodology was tested for calibration and validation of two rockfall models: the empirical rockfall model CONEFALL [55], and the probabilistic process-based rockfall trajectory model Rockyfor3D [59]. The CONEFALL model uses the energy line method based on a simple Coulomb frictional model for calculating the rockfall propagation areas calculated on the basis of a conical shape. Rockyfor3D is a physically-based model that calculates trajectories of single individually falling rocks in three dimensions (3D). For detailed descriptions of both models see references in the beginning of the paragraph. In order to demonstrate the calibration and validation applicability of data collected with the mobile application based on the proposed methodology, rockfall, the characteristics of two rockfalls were collected. Tested rockfalls are located in the northwestern part of Slovenia (Europe) in the Julian Alps (Figure 10    The modelling results were validated using goodness-of-fit (GOF) indices [60], based on a pixelby-pixel comparison between the observed and modelled rockfall area, resulting in four possible outcomes: (i) true positive-TP (actual rockfall and modelled rockfall area; correct prediction), (ii) true negative-TN (no rockfall and no modelled rockfall area), (iii) false positive-FP (no rockfall area but modelled as one), and iv) false negative-FN (no rockfall area and also not modelled as one). These indices are used for quantification of model performance since they assess the model's performance using the relation between the benefits (true positive) and costs (false positives). The modelling results were validated using goodness-of-fit (GOF) indices [60], based on a pixel-by-pixel comparison between the observed and modelled rockfall area, resulting in four possible outcomes: (i) true positive-TP (actual rockfall and modelled rockfall area; correct prediction), (ii) true negative-TN (no rockfall and no modelled rockfall area), (iii) false positive-FP (no rockfall area but modelled as one), and (iv) false negative-FN (no rockfall area and also not modelled as one). These indices are used for quantification of model performance since they assess the model's performance using the relation between the benefits (true positive) and costs (false positives). Formetta et al. [60] have shown the variation of different indices that can be used for the validation analysis, however they state that even one is enough to evaluate the model's performance. Consequently, we have used two of the most suitable indices based on their experience: the success index (SI), and the average index (AI):

Krnica Rockfall
Using the locations of the rockfall source area and rockfall deposits, and the ELA tool, energy line angles for individual rockfall deposit were calculated for the Krnica rockfall. The average value of energy line angle was 51 • with a minimum value being of 43 • and a maximum 64 • , while the later angle of rockfall deposition zone was ±19 • . When modelling with CONEFALL we used three scenarios with different sets of parameters: (i) energy line angle 32 • and lateral angle ±16 • (since these values are most commonly proposed in the literature) [61], (ii) energy line angle 43 • and lateral angle ±19 • (calculated based on field measurements), and (iii) energy line angle 43 • and lateral angle ±25 • (increased lateral angle so that all locations of rockfall deposits are located within the modelled area). The CONEFALL model requires two input datasets: DTM and rockfall source area raster. For DTM we used LiDAR data with a grid cell size 1 × 1 m [62], and for the rockfall source area we used the location (one grid cell) of the actual rockfall source calculated with the ELA tool. Since the model uses the aspect of the surface for calculating the direction of the rockfall runout area, the rockfall source area was given based on the median value of the aspect of the larger rockfall source area determined by mapping using an orthophoto image and positions of rockfall deposits. For the purpose of showing the match between the recorded rockfall deposits, we only used one rockfall grid cell.
The modelling results are shown in Figure 11. When using the combination of values from the literature (32 • ± 16 • ) it can be observed that the model has some predictive power (Table 1)

Trenta Rockfall
The Rockyfor3D model requires several input data and parameters to be set before starting the modelling procedure, specifically rockfall source area, DTM, number of simulations, additional fall height from the source area, variation of the rock volume (%), rock density (kg/m 3 ), rock block dimensions (d1, d2, d3), rock block shape, soil types on the surface slope, and surface roughness coefficients (rg70, rg20, rg10) that represent 70%, 20% and 10% of the mean obstacle height (MOH; height of the rocks) on the surface slope [59]. Additionally, the model enables rockfall simulations with the effect of forest and/or simulations using nets.
For the purpose of calibrating the model, we used the proposed methodology for collecting data on dimensions of rockfall deposits (d1, d2, d3), and their shape. Additionally, as our purpose was also to validate the modelled rockfall propagation area, we collected the positions of the rockfall deposits at the maximum outline of rockfall in order to obtain the real shape of the rockfall. After the simulations, the actual rockfall outline was after the simulations compared to the raster map called "propagation probability" which is a simulation result of Rockyfor3D that presents the most realistic spatial distribution of the rockfall event. Along with the collection of the rockfall deposits we also mapped the soil types and rg coefficients. Based on the rg coefficients we divided three areas: (i) scree slope area, and (ii) rocky terrain overgrown by dwarf pines and conifers, and (iii) steep terrain with surface rockiness in the mixed forest. The whole area was set to have one soil type (talus slope with Ø > ~10 cm, or compact soil with large rock fragments). Collection of the rockfall deposits with the proposed methodology and mobile application enabled us to calculate the following realistic data: rock block dimensions that we used in the simulation were set to d1 = 1.4 m, d2 = 0.9 m, d3 = 0.8 m, while the prevailing rock shape of deposits was set to rectangular. Other input data/parameters were set to: DTM with grid cell size 2 × 2 m [62], the number of simulations was 1000, initial fall height to 50 m (calculated based on the height difference using DTM data), variability of rock volume was set to ±0 %, and the modelling was performed by taking into account the effect of forest (input data into the model were the XY coordinates of trees with their DBH).
The surface roughness coefficients were those that have the most effect on the final runout area, and by adjusting its values based on the locations of rockfall deposits we were able to determine the best combination. After fine-tuning the model we have used surface roughness coefficients (rg70, rg20, rg10) of 0.14, 0.36 and 0.65. The model is able to simulate the shape of rockfall propagation and runout area correctly also capturing the trajectories of individual rocks that were stopped in the forest in the northern part of the runout area ( Figure 12). The largest overestimation compared to the real rockfall outline are occurred in both lateral directions (on average by 20 m at the southern lateral part, and by 28 m at the northern lateral part). In smaller part at the maximum runout extent the model

Trenta Rockfall
The Rockyfor3D model requires several input data and parameters to be set before starting the modelling procedure, specifically rockfall source area, DTM, number of simulations, additional fall height from the source area, variation of the rock volume (%), rock density (kg/m 3 ), rock block dimensions (d1, d2, d3), rock block shape, soil types on the surface slope, and surface roughness coefficients (rg70, rg20, rg10) that represent 70%, 20% and 10% of the mean obstacle height (MOH; height of the rocks) on the surface slope [59]. Additionally, the model enables rockfall simulations with the effect of forest and/or simulations using nets.
For the purpose of calibrating the model, we used the proposed methodology for collecting data on dimensions of rockfall deposits (d1, d2, d3), and their shape. Additionally, as our purpose was also to validate the modelled rockfall propagation area, we collected the positions of the rockfall deposits at the maximum outline of rockfall in order to obtain the real shape of the rockfall. After the simulations, the actual rockfall outline was after the simulations compared to the raster map called "propagation probability" which is a simulation result of Rockyfor3D that presents the most realistic spatial distribution of the rockfall event. Along with the collection of the rockfall deposits we also mapped the soil types and rg coefficients. Based on the rg coefficients we divided three areas: (i) scree slope area, and (ii) rocky terrain overgrown by dwarf pines and conifers, and (iii) steep terrain with surface rockiness in the mixed forest. The whole area was set to have one soil type (talus slope with Ø >~10 cm, or compact soil with large rock fragments). Collection of the rockfall deposits with the proposed methodology and mobile application enabled us to calculate the following realistic data: rock block dimensions that we used in the simulation were set to d1 = 1.4 m, d2 = 0.9 m, d3 = 0.8 m, while the prevailing rock shape of deposits was set to rectangular. Other input data/parameters were set to: DTM with grid cell size 2 × 2 m [62], the number of simulations was 1000, initial fall height to 50 m (calculated based on the height difference using DTM data), variability of rock volume was set to ±0 %, and the modelling was performed by taking into account the effect of forest (input data into the model were the XY coordinates of trees with their DBH).
The surface roughness coefficients were those that have the most effect on the final runout area, and by adjusting its values based on the locations of rockfall deposits we were able to determine the best combination. After fine-tuning the model we have used surface roughness coefficients (rg70, rg20, rg10) of 0.14, 0.36 and 0.65. The model is able to simulate the shape of rockfall propagation and runout area correctly also capturing the trajectories of individual rocks that were stopped in the forest in the northern part of the runout area ( Figure 12). The largest overestimation compared to the real rockfall outline are occurred in both lateral directions (on average by 20 m at the southern lateral part, and by 28 m at the northern lateral part). In smaller part at the maximum runout extent the model underestimated the actual rockfall extent on average by 6 m. The GOF indices AI and SI show that the model is able to correctly predict approximately 90 % (Table 1) of the actual rockfall propagation area. One of the outputs of the Rockyfor3D model is also a raster map with the minimum recalculated energy line angles per raster cell in • . In order to validate a correlation between the energy line angle and the rock volumes we compared the following two parameters. As can be observed on Figure 13, there is no correlation between the energy line value and the rockfall deposit volume.  (Table 1) of the actual rockfall propagation area. One of the outputs of the Rockyfor3D model is also a raster map with the minimum recalculated energy line angles per raster cell in °. In order to validate a correlation between the energy line angle and the rock volumes we compared the following two parameters. As can be observed on Figure 13, there is no correlation between the energy line value and the rockfall deposit volume.

Discussion
This paper presents a new methodology for collecting rockfall data directly on the field by using a mobile Esri application Collector for ArcGIS. The main purpose of its use is to collect new rockfall  (Table 1) of the actual rockfall propagation area. One of the outputs of the Rockyfor3D model is also a raster map with the minimum recalculated energy line angles per raster cell in °. In order to validate a correlation between the energy line angle and the rock volumes we compared the following two parameters. As can be observed on Figure 13, there is no correlation between the energy line value and the rockfall deposit volume.

Discussion
This paper presents a new methodology for collecting rockfall data directly on the field by using a mobile Esri application Collector for ArcGIS. The main purpose of its use is to collect new rockfall events that have not yet been recorded in the existing databases, which could later on be united with the data of known rockfall sites. It enables the collection of two crucial forms of information about

Discussion
This paper presents a new methodology for collecting rockfall data directly on the field by using a mobile Esri application Collector for ArcGIS. The main purpose of its use is to collect new rockfall events that have not yet been recorded in the existing databases, which could later on be united with the data of known rockfall sites. It enables the collection of two crucial forms of information about the rockfall: the locations of the source area and rockfall deposits, and additional attributes describing the specifics of each rockfall (e.g., source area type, rockfall deposit shape and stop cause, location in the forest or not etc.). Since the location of the source area is difficult to measure directly in the field, an approach to calculating it based on the azimuth and angle value from the visible spot toward an actual source, in combination with a of digital terrain model (DTM), has been shown. The main advantages of this approach are: (1) the collected data are saved in standard vector file (polygon shapefile, .shp) and can be further analyzed with different GIS software; (2) the collection of data is unified and harmonised meaning that the collection of data is replicable and comparable with different rockfall sites; (3) the collected data can be updated directly in the field with the existing online database and data can be processed in real time; (4) the collected attributes are applicable for calibration and validation of rockfall models. The amount of data and level of detail that can be collected with this approach presents a great advantage compared to traditional field surveying (e.g., using paper application forms).
The collected data are visualised in WebGIS also provided by Esri, and are available online to be accessed by the users at different expert levels, namely we can distinguish between three classes of user: • Level 1 user: can access the WebGIS platform only for visualisation of the collected data. • Level 2 user: can access the WebGIS platform for visualisation and can use the mobile application for collection of data and for updating the data on the WebGIS platform. • Level 3 user: has the same abilities as the Level 2 user, and can additionally operate with the geodatabase by updating it with external data, can control the WebGIS and mobile application, and perform complex queries and analyses on data in the geodatabase.
Generally, the Level 1 users can be labeled as lay public, while Level 2 and 3 users correspond to expert users due to the nature of attributes that need to be collected and the equipment that is required for the collection of data. The further planned upgrade of the WebGIS platform in a way that would allow public participation so that they would only record the location of a new rockfall sitting, and then an expert team could use that information to visit that site and perform a complete survey of that rockfall according to the approach presented in this paper. This would also require the preparation of guidelines for the procedure of data collection for the non-experts, and an establishment of an administrative team that would check the validity of records provided by them. Moreover, use of the application could also be upgraded in the way that other gravitational processes could be collected (e.g., avalanches, landslides, debris slides) in a similar manner in order to collect data on all major natural hazards in alpine areas.
The main purposes of the Results section of this paper was to show that the mobile application: (i) can be used for collection of data at the regional scale (since it was used for creating a database in the Alpine Space); and (ii) can be used for calibration and validation of rockfall models. Based on the collected rockfall events in the Alpine Space, we were able to get an insight to the rockfall statistics at the regional scale which is a first at Alpine scale. Observing the energy line angles, we can detect two peaks in values. First is between energy line angle values 46 • to 57 • , while the second is between 20 • and 36 • , which means that the majority of recorded rockfall events had a quite short runout length. There are differences between the recorded number of events in altitude classes between rockfall sources and deposits. If the representation of the rockfall sources is more equalized between the classes (except the altitude class > 2900 m where there are only 11 events), there is a clear difference in classes with rockfall deposits which have by far the highest frequency in the altitude class 900-1500 m. The least records were are for both rockfall areas sources/deposits in the highest altitude class since the high-altitude rockfalls were not recorded in the database. In this study we did not focus on studying the differences in the altitude classes but the main purpose was to show the use of the mobile application for even creating a rockfall database at such scale. However, the results represent the start of future study.
Applicability of the results to rockfall modelling was shown briefly through the use of two models: the empirical model CONEFALL, and the physically-based, probabilistic Rockyfor3D model. We intentionally chose models with completely different modelling approaches in order to portray the versatile use of the collected data by the new methodology. The collected data were crucial for the calibration of both models, and we have shown that without site-specific data the simulation results would model rockfall propagation and runout area in a non-realistic way. Since the CONEFALL model models the rockfall runout area in a conical shape, fine-tuning of the model is of even greater importance. Namely, the modelling method is highly dependent on the geomorphology of the studied area, meaning that the chosen parameters such as the rockfall source area and energy line angle that defines the maximum runout zone must be performed on the basis of local observations [55]. In this sense, the proposed methodology presents an efficient tool for rockfall models that use similar statistical modelling approaches. For empirical models the most important information is the maximum extent of the rockfall area; in these cases, it might suffice to collect rockfall only the maximum outline of deposited rockfall runout. CONEFALL was in the case of this paper used at the local level (one rockfall site) but due to the simple rockfall propagation and runout area it is more appropriate for use at larger regional scales. For the representation purposes of this paper we also used one rockfall source cell meaning that the model was more sensitive for modelling the direction of the rockfall propagation area. With more source cells the neighboring source cells form a joint runout area taking into account the direction of all source cells. More input parameters for modelling with the mobile application were collected for simulations with Rockyfor3D (rock source area, rock deposits shape and dimensions). In the case of models that require more input parameters, calibration of the model required more input, but the final results provide the shape of the rockfall propagation and runout area that for the most part matches with the shape of collected rockfall deposits, proving that the model is suitable for use at the local scale. We have shown that the volume of rockfall deposits does not necessarily correlate with the volume of the rocks which confirms the findings of some authors [63].

Conclusions
In the present study, a new methodology and mobile application for collecting data on past rockfall events (rockfall source areas and rockfall deposits) has been presented. Since existing rockfall databases lack data about past events or are often characterised as incomplete, non-harmonised, and thus uncertain, there is a need for an approach that would solve the presented issues. With the development of technologies, the collection of data via smartphones is increasingly being used, leading our research to form a methodology that would be based on collecting past rockfall events with a mobile device (using the Collector for ArcGIS) which enables a uniform, quick and simple approach to the collection of data in the field. Data that are being collected in the field are temporarily stored on the mobile device and then uploaded to the common database in the ArcGIS Online cloud, meaning two things: (i) the application can be used by an unlimited number of users simultaneously; and (ii) data can be shown and analysed directly, in real-time, on the WebGIS platform. The collected data are further available to various classes of user (based on their user level) and can be applied in different rockfall risk analyses. Using the methodology, the partners of the "ROCKtheALPS" project have built a large (transnational)-scale database and used it to model rockfalls and rockfall protection forests in the Alpine Space. However, the use of the application does not stop here-it has the potential to be used by larger crowds and further expand the barriers on known past rockfall events or even other mass movement processes (e.g., avalanches, landslides, debris flows). Rockfall databases do not only pose great importance to the scientific community but also raise the awareness of the rockfall associated risk to the general public.
As has been shown, the collected attributes of rockfall source and deposits can be used to provide input parameters for the calibration of empirical and process-based rockfall models, and can also be used to validate the modelled rockfall risk by obtaining several rockfall propagation statistics. This methodology is especially suitable for deriving energy line angles which are an important input parameter in empirical models. As energy line angles strongly depend on the geomorphology of the surface they cannot be applied blindly, the choice of appropriate energy line angle must be based on local field observations. By developing a tool for calculating energy line angles based on the rockfall source area and corresponding deposits, this process is greatly simplified. The validation of simulation results needs a lot of ground truth data, the collection of which is a time-consuming activity. Implementing tools are able to support this field survey is of great importance for rockfall risk mapping. Having a large dataset for validating simulation results can help in adopting different solutions, not only limited to an "event validity" approach but allowing the statistical validation of the model. Funding: This research was funded by Interreg Alpine Space projects "ROCKtheALPS" (ASP 462) and "GreenRisk 4ALPs" (ASP 635).