1. Introduction
Construction material identification plays a critical role in automated construction monitoring, digital twin generation, and building information modelling (BIM) [
1]. Terrestrial laser scanning (TLS) has emerged as a powerful technology for capturing high-resolution three-dimensional representations of construction environments, providing both geometric information and radiometric measurements in the form of LiDAR intensity [
2,
3].
Despite its potential, reliable material classification using TLS data remains challenging. Raw LiDAR intensity is influenced by geometric factors such as scanning distance and incidence angle, making it difficult to directly interpret as a material property [
2,
3,
4]. Although previous studies have shown that radiometric correction can improve the stability of intensity-based features, materials with similar reflectance characteristics often remain difficult to distinguish. To address this limitation, geometric descriptors such as surface roughness have been introduced; however, most existing approaches rely on a limited representation of surface texture.
Furthermore, many approaches incorporate image-based colour features to improve classification performance. While effective under controlled conditions, these features are highly dependent on illumination and environmental conditions, reducing their reliability in practical construction scenarios [
5].
To address these challenges, this study proposes a machine-learning framework that integrates radiometric and multiscale geometric descriptors derived solely from TLS point clouds. A reflectance-related radiometric descriptor is derived from the local relationship between measured LiDAR intensity and a geometry-dependent factor, while plane-residual roughness and normal-variation roughness are calculated at multiple neighbourhood scales to capture both surface-height variation and directional geometric structure. These TLS-derived features are then used within an automated machine-learning framework to identify an effective classification model.
The central hypothesis of this study is that combining a reflectance-related radiometric descriptor with multiscale geometric roughness information can improve the discrimination of construction materials compared to using a single roughness scale, while avoiding reliance on RGB colour information.
The main contributions of this study are:
The integration of a reflectance-related radiometric descriptor with multiscale plane-residual and normal-variation roughness features for material representation;
The use of normal-variation roughness to capture directional surface variation complementary to conventional plane-residual roughness;
The application of an AutoML framework to select and combine suitable classifiers for the resulting TLS-derived feature set.
The proposed approach therefore aims to provide a discriminative TLS-derived feature representation that does not rely on RGB colour information and is consequently less dependent on ambient illumination and image-acquisition conditions.
3. Methodology
3.1. Data Acquisition Using Terrestrial Laser Scanning
Point-cloud data used in this study were collected using a Trimble TX8 terrestrial laser scanner, a time-of-flight LiDAR system operating at a wavelength of approximately 1.5 µm in the near-infrared region, which is invisible to the human eye. The scanner captures high-density three-dimensional point clouds together with backscattered laser intensity measurements.
A set of commonly encountered construction materials was selected for the experiments, including Asphalt, Concrete, Carpet, PVC Vinyl Tile, Laminated MDF Board, Painted Surface, and Ceiling Tile as shown in
Figure 1.
Asphalt and Concrete surfaces were captured under outdoor conditions, while the remaining materials were acquired from indoor building surfaces. Rather than using isolated laboratory specimens, the dataset was obtained from real construction and building surfaces within the University of Auckland environment. This allowed the TLS measurements to include naturally occurring variation in surface condition, range, and acquisition geometry.
Only points located at scanning distances from 4 m up to, but not including, 10 m were retained for the analysis. Points outside this interval were excluded to maintain a consistent acquisition-distance range across all material classes.
The dataset was organised into separate training and held-out testing subsets acquired from different scanner positions and spatially distinct regions of the material surfaces. No point samples were shared between the training and test datasets. Although both subsets were collected within the same general study area, the use of different scan positions and non-overlapping material regions reduced the risk of point-level spatial leakage between model development and evaluation. After application of the distance criterion and validity checks for the final multiscale feature set, the unbalanced training dataset contained 1,141,122 points, while the held-out test dataset contained 1,296,822 points. Class balancing was applied only to the training dataset, as described in
Section 3.4.3, while the primary test dataset retained its original class distribution.
3.2. Reflectance-Related Radiometric Descriptor from LiDAR Intensity
As discussed in
Section 2, TLS intensity is influenced by acquisition geometry and cannot be directly interpreted as an intrinsic material property. Therefore, in this study, a geometric correction was applied to derive a reflectance-related descriptor. The radiometric behaviour of LiDAR backscatter can be approximated using a simplified laser radar model:
where
is the recorded LiDAR intensity;
represents the intrinsic reflectance of the surface;
is the distance between the scanner and the target point;
is the incidence angle between the laser beam and the surface normal;
is a system constant related to sensor characteristics;
represents a bias term associated with sensor noise.
Equation (1) provides the physical motivation for accounting for range and angular effects in the measured TLS intensity. In the implemented workflow, however, an absolute surface reflectance coefficient was not calculated. Instead, a relative reflectance-related radiometric descriptor was derived from the local relationship between measured intensity and a geometry-dependent factor, following the general formulation used by Yuan et al. [
19].
For each point, the scanning distance was calculated from its three-dimensional co- ordinates relative to the scanner. A coordinate-derived angular factor was also calculated from the point position. Following the formulation adopted from Yuan et al. [
19], this angular term is denoted by (
cos θ) and is used as a geometric approximation rather than as a directly measured incidence angle based on an independently estimated surface normal. The resulting distance-and-angle-dependent quantity was used as the explanatory variable for local intensity regression.
A Euclidean neighbourhood with a radius of 0.10 m was defined around each point. Neighbourhoods containing fewer than 20 points were excluded from this calculation. Within each valid neighbourhood, an ordinary least-squares linear regression with an intercept was fitted between the measured LiDAR intensity and the geometry-dependent explanatory variable. The fitted regression slope, denoted here as Slope_SKL, was retained as the reflectance-related radiometric descriptor used for classification.
Slope_SKL should therefore be interpreted as a relative local intensity–geometry regression descriptor rather than an absolute physical reflectance coefficient. Because the slope is estimated locally from measured intensity values, it is not constrained to be positive. Negative values can occur where local intensity variations, measurement noise, surface heterogeneity, or a weak local intensity–geometry relationship produce a negative fitted gradient. These values were retained rather than truncated because they form part of the empirically derived feature distribution.
Figure 2 illustrates the relationship between measured LiDAR intensity and the geometry-dependent factor for representative construction materials. Differences in the local intensity–geometry response between materials provide the basis for using the fitted regression slope as a radiometric classification feature.
The resulting Slope_SKL descriptor was used directly as one of the machine-learning predictors. No calibration targets with known reflectance values were required, and the descriptor was not interpreted as an absolute or intrinsic reflectance measurement.
3.3. Surface Roughness Estimation from Point Clouds
Surface roughness describes the micro-scale geometric variability of a material sur- face and provides important information for distinguishing materials with similar radio- metric responses. In terrestrial laser scanning (TLS), roughness can be derived directly from the local geometry of the point cloud by analysing the spatial distribution of neighbouring points. Unlike reflectance, which represents radiometric properties, roughness captures the structural characteristics of surface texture.
For each point, local neighbourhoods were defined as cubes with side lengths of 0.10, 0.20, and 0.30 m, centred on the point and identified using a KD-tree with a Chebyshev-distance metric. These neighbourhood sizes were used to capture surface variation at different spatial scales. The 0.20 m scale maintains comparability with the roughness calculation used by Yuan et al. [
19], while the 0.10 and 0.30 m scales provide finer- and broader-scale representations of local surface structure. Neighbourhoods containing fewer than 20 points were excluded from the corresponding roughness calculation to avoid unstable plane and normal estimates in sparsely sampled regions. Within each valid neighbourhood, a local plane was fitted using the Random Sample Consensus (RANSAC) algorithm according to the general plane equation:
Candidate planes were generated from randomly sampled point triplets, with a maximum of 100 trials. Neighbouring points with an orthogonal distance of less than 2 mm from a candidate plane were treated as inliers. After identification of the largest inlier set, the plane was refitted using singular value decomposition (SVD) to obtain a least-squares estimate of the final plane parameters. This formulation is independent of surface orientation and is therefore applicable to horizontal, inclined, and vertical surfaces.
Figure 3 illustrates the calculation of plane-residual roughness using a local point-cloud neighbourhood, a fitted plane, and the orthogonal distances of neighbouring points from the plane.
where
represents the unsigned orthogonal distance between neighbouring point
and the locally fitted plane, and
denotes the number of points in the neighbourhood. Ra was calculated as the population standard deviation of these orthogonal distances. The same procedure was applied separately at the 0.10, 0.20, and 0.30 m neighbourhood scales, producing three plane-residual roughness descriptors for each valid point.
Although Ra captures the magnitude of point-to-plane surface variation, it does not fully represent directional changes in local surface geometry. A second descriptor, nor- mal-variation roughness (
), was therefore calculated from the angular variation in neighbouring surface normals. For each central point, a unit normal vector was estimated using PCA/SVD within the corresponding local neighbourhood. Because PCA/SVD-de- rived normal vectors have an arbitrary sign, the angular difference between the central- point normal and each valid neighbouring-point normal was calculated using the absolute value of their dot product. This makes the angular difference invariant to normal-vector orientation.
was then defined as the population standard deviation of these angular deviations and was expressed in radians:
As illustrated in
Figure 4, the normal-variation roughness descriptor quantifies the angular dispersion between the surface normal of each neighbouring point and the surface normal estimated at the central point within a local neighbourhood.
Where
ni is the unit normal vector estimated at the central point
Pi,
nj is the unit normal vector estimated at neighbouring point
Pj,
θij is the angular deviation between the two normal vectors,
is the mean angular deviation within the valid neighbourhood, and
mi is the number of valid neighbouring points with estimated normal vectors. The resulting
Rn,i value is expressed in radians and represents the local angular dispersion of surface normals [
25,
26].
Together, the multiscale
and
descriptors characterise two complementary aspects of local surface geometry: the magnitude of point-to-plane deviations and the directional variation in surface normals. Calculating both descriptors at multiple neighbourhood scales enables finer and broader surface structures to be represented within the classification feature set [
27].
3.4. Machine-Learning Framework for Material Classification
3.4.1. Feature Construction
The final classification feature set was designed to combine radiometric information with geometric surface characteristics measured at multiple spatial scales. For each valid TLS point, seven predictors were used:
Slope_SKL, representing the local reflectance-related intensity–geometry regression descriptor described in
Section 3.2;
at 0.10 m, representing plane-residual roughness calculated using a 0.10 m cube neighbourhood;
at 0.10 m, representing normal-variation roughness calculated using a 0.10 m cube neighbourhood;
at 0.20 m, representing plane-residual roughness calculated using a 0.20 m cube neighbourhood;
at 0.20 m, representing normal-variation roughness calculated using a 0.20 m cube neighbourhood;
at 0.30 m, representing plane-residual roughness calculated using a 0.30 m cube neighbourhood;
at 0.30 m, representing normal-variation roughness calculated using a 0.30 m cube neighbourhood.
Together, these predictors combine one radiometric descriptor with six geometric descriptors representing plane-residual and normal-variation roughness at three spatial scales. This multiscale feature representation was used to capture both fine and broader variations in material surface structure.
The predictor set therefore consisted of Slope_SKL and the six multiscale Ra and Rn features. Point coordinates, raw LiDAR intensity, RGB colour values, scanning distance, material labels, and dataset identifiers were not included as predictor variables. The material class was used only as the classification target, while dataset identifiers were retained only for data organisation and evaluation.
3.4.2. Automated Machine Learning Using the Fast Lightweight Automated Machine Learning (FLAML)
The Fast Lightweight Automated Machine-Learning (FLAML) framework was used for automated model selection and hyperparameter optimisation [
21]. FLAML performs cost-aware optimisation across multiple candidate machine-learning algorithms and their hyperparameter configurations within a specified computational budget. This approach was adopted to avoid manually preselecting a particular classifier and to allow the model configuration to be determined empirically from the training data.
In this study, the task was defined as multiclass classification using the seven TLS-derived predictors described in
Section 3.4.1. Model optimisation was performed using three-fold cross-validation, with macro F1-score used as the optimisation metric so that performance across all seven material classes contributed equally to model selection.
A computational search budget of 900 s was specified for the AutoML optimisation. The candidate estimators evaluated during the FLAML search comprised LightGBM, XGBoost, limited-depth XGBoost, CatBoost, histogram-based gradient boosting, Random Forest, and Extra Trees. A fixed random seed of 42 was used to support reproducibility. Parallel computation was enabled during the search. FLAML’s automatic data augmentation and internal sampling options were disabled because class balancing had already been applied explicitly to the training dataset. Ensemble construction was enabled to allow FLAML to combine suitable trained models when this improved the optimisation objective.
The implementation used FLAML version 2.3.6, scikit-learn version 1.7.0, and Python version 3.13.2.
3.4.3. Model Training and Evaluation
The training and held-out test datasets were maintained separately throughout model development and evaluation. The two datasets were derived from different scanner positions and spatially distinct regions of the material surfaces, with no shared point samples between the training and held-out test sets. After feature validity checks, the unbalanced training dataset contained 1,141,122 points. The class-specific numbers of valid training and held-out test points are summarised in
Table 1.
Because the number of observations differed substantially among material classes, class balancing was applied only to the training dataset before model optimisation.
The smallest training class contained 64,296 points. Therefore, each of the seven material classes was reduced to 64,296 observations using distance-stratified random undersampling without replacement, resulting in a balanced training dataset of 450,072 points. Sampling was performed within 0.25 m scanning-distance intervals to reduce distortion of the original distance distribution within each material class. A fixed random seed of 42 was used to make the sampling procedure reproducible.
The held-out test dataset was not balanced or resampled and retained its original class distribution, comprising 1,296,822 points. No test observations were used during class balancing, model selection, or hyperparameter optimisation. The seven predictors described in
Section 3.4.1 were used as model inputs, while the material class served as the target variable.
Model selection and hyperparameter optimisation were performed on the balanced training dataset using the FLAML procedure described in
Section 3.4.2. After model development was completed, the resulting fitted model was applied to the held-out test dataset without further training or parameter tuning.
Classification performance was evaluated using overall accuracy, balanced accuracy, macro-averaged precision, macro-averaged recall, macro F1-score, weighted precision, weighted recall, and weighted F1-score. A normalised confusion matrix and class-specific performance statistics were additionally examined to identify material classes and material pairs associated with the largest classification errors. The Python scripts reproducing the preprocessing, feature extraction, model training, held-out evaluation, and ablation workflow are provided in the
Supplementary Materials.
3.5. Use of Generative Artificial Intelligence Tools
During the preparation of this manuscript, ChatGPT by (OpenAI, GPT-5.6 Sol) was used to assist with Python code development, figure, and language editing. The tool was not used to develop the study design, collect data, generate raw experimental data, conduct the analysis, extract features, train the model, or interpret the results. All methodological decisions, data processing, feature extraction, model training, result interpretation, and scientific conclusions were carried out by the authors. The authors reviewed and edited all AI-assisted outputs and take full responsibility for the accuracy, integrity, and content of the manuscript.
4. Results and Discussion
The final model obtained through the FLAML optimisation and ensemble-construction process was evaluated on the held-out test dataset containing 1,296,822 points. The test dataset retained its original class distribution and was not used during class balancing, model selection, or hyperparameter optimisation. The final stacking classifier achieved an overall classification accuracy of 90.44%, a balanced accuracy of 87.42%, and a macro F1-score of 87.85%. The weighted F1-score was 90.41%. The difference between overall accuracy and balanced accuracy reflects the unequal class distribution in the held-out test dataset and highlights the importance of reporting class-balanced metrics in addition to overall accuracy. The overall classification performance metrics are summarised in
Table 2.
To quantify the separate contributions of the radiometric and geometric descriptors, an ablation study was performed using four progressively enriched feature sets. All feature configurations were evaluated using the same balanced training dataset and the same held-out test dataset. The first scenario used only the reflectance-related radiometric descriptor, Slope_SKL. The second added the conventional single-scale plane-residual roughness calculated at 0.20 m. The third extended
Ra to the three neighbourhood scales of 0.10, 0.20, and 0.30 m, while the fourth represented the complete proposed feature set by additionally including multiscale normal-variation roughness
Rn. The results of the feature-ablation analysis are summarised in
Table 3.
The ablation results show that Slope_SKL alone provided limited discrimination among the seven material classes, achieving an accuracy of 48.17% and a macro F1-score of 37.25%. Adding single-scale plane-residual roughness at 0.20 m produced the largest initial improvement, increasing accuracy to 85.91% and macro F1-score to 82.34%. This demonstrates that local geometric surface variation provides substantial discriminatory information beyond the radiometric descriptor alone.
Extending Ra from the single 0.20 m neighbourhood to the three-scale representation produced a modest additional improvement in overall accuracy, macro F1-score, and weighted F1-score. Accuracy increased from 85.91% to 86.34%, while macro F1-score increased from 82.34% to 83.31%. Balanced accuracy decreased slightly from 85.62% to 85.09%, indicating that the benefit of multiscale Ra was not uniform across all material classes.
The addition of multiscale Rn produced a clearer improvement across all reported aggregate metrics. Relative to the multiscale Ra configuration, accuracy increased by 4.10 percentage points, balanced accuracy by 2.32 percentage points, macro F1-score by 4.53 percentage points, and weighted F1-score by 3.76 percentage points. These results indicate that Ra provides the dominant geometric contribution, while Rn supplies complementary information related to directional variation in local surface normals that is not fully represented by point-to-plane-residual roughness alone.
The class-specific performance of the final stacking classifier was further examined using the normalised confusion matrix shown in
Figure 5. The diagonal elements represent the proportion of correctly classified points within each material class. Most classes achieved high recall, particularly Asphalt, Ceiling Tile, PVC Vinyl Tile, and Laminated MDF Board, whereas Carpet showed the lowest recall and therefore remained the most challenging material to classify.
The normalised confusion matrix in
Figure 5 shows that most material classes were classified with high recall. Asphalt achieved the highest recall at 98.14%, followed by Ceiling Tile at 97.45%, PVC Vinyl Tile at 93.33%, and Laminated MDF Board at 93.28%. Concrete achieved a recall of 88.45%, while Painted Surface achieved 81.87%. Carpet was the most challenging class, with a recall of 59.42%.
The largest remaining confusion occurred between Carpet and Asphalt, with approximately 36.49% of Carpet points classified as Asphalt. Smaller proportions of Carpet points were classified as Painted Surface (1.88%) and PVC Vinyl Tile (1.73%). Other notable errors included approximately 14.94% of Painted Surface points classified as Carpet, 5.97% of Concrete points classified as Asphalt, 6.12% of Laminated MDF Board points classified as Concrete, and 5.30% of PVC Vinyl Tile points classified as Carpet.
These results indicate that the proposed multiscale feature set provides strong discrimination for most material classes, but some overlap remains in the combined radiometric–geometric feature space. In particular, the lower recall for Carpet suggests that its Slope_SKL, Ra, and Rn distributions overlap with those of Asphalt for a portion of the test data. This class-specific behaviour is also reflected in the difference between the overall accuracy (90.44%) and balanced accuracy (87.42%), emphasising the importance of considering both aggregate and class-specific performance.
The ablation analysis provides a more direct assessment of feature contribution than model-specific importance scores. The results show that plane-residual roughness provides the largest improvement beyond the radiometric descriptor, while normal-variation roughness contributes additional complementary information when incorporated at multiple spatial scales. This supports the use of the combined multiscale radiometric–geometric representation rather than reliance on a single descriptor or a single neighbourhood scale.
An important advantage of the proposed approach is that it avoids reliance on illumination-dependent colour features. RGB- and HSV-derived descriptors may vary with illumination conditions, shadows, and image-acquisition settings [
5]. In contrast, the proposed framework relies exclusively on TLS-derived radiometric and geometric descriptors. The results therefore demonstrate that effective construction-material discrimination can be achieved without incorporating image-based colour information.
The evaluation was performed using separate training and held-out test datasets, with class balancing applied only to the training data. The held-out test dataset retained its original class distribution and was not used during model selection or hyperparameter optimisation. Nevertheless, the results should be interpreted within the acquisition conditions represented by the present dataset. Although the data were obtained from real indoor and outdoor building surfaces, further validation using independent scan campaigns, additional buildings, scanner positions, material conditions, and environmental settings is required to establish broader transferability and generalisation.
From a computational perspective, feature extraction represents a substantial component of the workflow because multiscale neighbourhood searches, RANSAC plane fitting, surface-normal estimation, and roughness calculation are performed for individual point-cloud neighbourhoods. KD-tree-based neighbourhood searches and parallel processing were used to support processing of the large TLS datasets. The AutoML optimisation was performed using a 900 s computational budget with three-fold cross-validation and macro F1-score as the optimisation metric. Future work should investigate further computational improvements, including spatial downsampling, parallel neighbourhood processing, and tiled point-cloud processing, and should report detailed runtime and memory requirements for large-scale construction scenes.
5. Conclusions
This study presented a TLS-only framework for construction material classification using a reflectance-related radiometric descriptor together with multiscale geometric roughness features. The radiometric information was represented by the local intensity–geometry regression descriptor, Slope_SKL, while plane-residual roughness Ra and normal-variation roughness Rn were calculated using cube neighbourhoods with side lengths of 0.10, 0.20, and 0.30 m. The resulting seven-feature representation therefore combined radiometric response with complementary measures of local surface magnitude and directional variation.
Model development was performed using FLAML with three-fold cross-validation and macro F1-score as the optimisation metric. Class balancing was applied only to the training dataset, while the held-out test dataset retained its original class distribution. The final stacking classifier achieved an overall accuracy of 90.44%, balanced accuracy of 87.42%, and macro F1-score of 87.85% on 1,296,822 held-out test points. These results reflect scan-position-separated held-out validation within the same general study area and should not be interpreted as evidence of cross-site generalisation.
The ablation analysis confirmed that geometric roughness provides substantial discriminatory information beyond the radiometric descriptor. Plane-residual roughness contributed the largest improvement, while multiscale normal-variation roughness provided additional complementary information. Class-specific evaluation showed that most materials were well-discriminated, although Carpet remained the most challenging class because of confusion with Asphalt.
Overall, the findings demonstrate that combining a reflectance-related radiometric descriptor with multiscale plane-residual and normal-variation roughness provides an effective TLS-only representation for construction material classification. The framework achieved strong performance without relying on RGB- or HSV-based colour information, supporting its potential for automated construction monitoring and digital twin applications.
Future work should focus on independent validation across additional buildings, scan campaigns, material conditions, and acquisition geometries. It should also investigate material-specific neighbourhood scales for Ra and Rn calculation, with the aim of identifying the cube side length that best represents the characteristic surface structure of each material and potentially improves class discrimination.