3.1. Inferences over the Iraqi Test Areas
Table 5 presents the model’s performance metrics over the validation area and three independent test areas in Iraq. It also includes the results of control experiments designed to evaluate the impact of different input bands and modalities, specifically COP-30 DEM, S-1 SAR, and S-2 RGB data. These experiments were conducted by training, validating, and testing separate models using the fixed set of hyperparameters shown in
Table 2 on different band composites. Metrics are presented together with
confidence intervals, calculated from 10 independent model runs with different random seeds.
The model trained with the proposed false-colour composite—the first configuration—achieved the highest performance over the test areas with an Average Precision of , an F1-score of , and a pixel-wise IoU-score of . The second configuration, based solely on COP-30 DEM data, followed with a decrease of up to 5 percentage points ( Average Precision, F1-score, and IoU-score). The third configuration, which includes only the S-1 backscatter information, performed worse with an Average Precision of and an IoU-score of . The fourth configuration, consisting of S-2 RGB data, performed similarly to the third configuration. The results suggest that the topographic information contained in the COP-30 DEM and its derivatives is the primary factor driving the model’s performance. The S-1 SAR bands (VV, VH) offer valuable complementary information, although they are not sufficient alone for robust detection, like the S-2 RGB data. Notably, both Composites 1 and 2 overcome the S-2 RGB baseline.
A visual evaluation of the predicted masks on the Iraq test dataset helps interpret these quantitative results.
Figure 4 and
Figure 5 show examples of the model’s segmentation inferences overlaid on the S-1 + COP-30 DEM false-colour composites. In the best-performing tiles (
Figure 4a–d,h), the predicted masks closely follow the geometry of the ground-truth labels, proving high spatial reliability of the detections. This property is particularly relevant for any subsequent analyses requiring the precise delineation of site boundaries, such as morphometric measurements or spatial statistics on archaeological
tells. In some instances, however, the visual inspection highlights inconsistencies with the ground-truth annotations. In
Figure 4e, for example, the predicted masks encompass a large area outside the archaeological
tell, overpredicting to nearby areas. In some examples, labels appear slightly over- or undersized (
Figure 4f,g) or are potentially missing (
Figure 5a,b). Such discrepancies represent inherent uncertainties in this type of modelling, which arise from the model’s inaccuracy and also from the uncertainty typical of archaeological datasets, particularly when ground truth information is derived from the manual interpretation of remote sensing data. In addition, the model seems to be prone to producing inaccurate predictions at the edges of image tiles, where the lack of contextual information prevents the model from accurately recognising features (
Figure 4e and
Figure 5b–d). This behaviour was further investigated in
Supplementary Materials Section S4.
Other examples of misclassification are presented in
Figure 5f–h as, for example, challenges in correctly predicting large
tells which heavily affect pixel-based performance metrics. Extremely large
tells, in fact, occupy a high number of pixels, spanning multiple tiles. In addition, they are often composed of aggregated or combined mounds, which may not have been internally discerned in the ground truth (
Figure 5e). These complex formations combine multiple archaeological and geomorphological features, producing heterogeneous topographic signatures that make it difficult to delineate which parts correspond to actual human occupation and which derive solely from fluvial or sedimentary processes. Such ambiguous cases should therefore not necessarily be seen as model errors but rather reflect the complex nature of the archaeological landscape and segmentation tasks under such ambiguous conditions, which is rich in potential candidates that show the same features of archaeological abandoned settlements.
Overall, the results show that the performance on the separate test dataset remains consistent with that obtained on the validation dataset. While a drop in performance is observed for Composites 3 and 4, Composites 1 and 2 show solid generalisation ability, confirming the model’s capacity to perform robustly on spatially distinct but morphologically similar areas. The evaluation of the trained YOLOv8-Seg model on the three independent test areas demonstrated its ability to automatically detect and segment
tell sites in the satellite SAR products. The observed performance metrics, Average Precision and F1-score, suggest a promising level of automation for large-scale prospection, significantly reducing the time and effort required for visual inspection. A comparison with a pixel-based Random Forest classification baseline and an evaluation of the pipeline’s robustness against seasonal effects are provided in
Supplementary Materials Sections S5 and S6, respectively. Moreover, a discussion of how this pipeline can reduce the visual inspection effort by operating as a pre-screening tool is reported in
Supplementary Materials Section S7. Finally,
Table 6 shows the performance metrics for the final merged inventory, following the post-processing steps described in
Section 2.4.5.
3.2. Transferability and Regional Fine-Tuning to Iran
To evaluate the broader applicability of the proposed workflow, we conducted a transferability test on an independent archaeological landscape in Iran, in the Khuzestan province.
The results of this direct model transfer to the Iranian test area are reported in
Table 7. Applying the model trained on the Iraqi dataset directly to this new domain yielded a significant performance degradation in configurations that include DEM-derived information. Specifically, the DEM-based model (Configuration 2) experienced the most severe performance drop, with its Average Precision falling to
(versus
in the Iraqi test area). Similarly, the multimodal composite (Configuration 1) achieved an Average Precision of
, an F1-score of
, and a pixel-wise IoU-score of
, to be compared to
,
, and
, respectively, on the Iraqi test area.
Notably, the S-1-based configuration (Configuration 3) demonstrated the highest stability in zero-shot transfer, with an Average Precision of . This performance pattern suggests a topographic domain shift between the two landscapes. While the proposed multimodal configuration appears less context-dependent than the DEM-only mode, likely because the consistency of the S-1 features counterbalances the topographic shift, confirming that complementary SAR and elevation datasets improve geographic transferability, a noticeable performance gap remains compared to the Iraqi test area. This suggests that data multimodality alone cannot fully bypass regional geomorphological shift, indicating the necessity of weight adaptation through regional fine-tuning.
Visual inspection of the model’s inferences in the Iranian context (
Figure 6) revealed a higher number of false positives and false negatives (
Figure 6e,f). Label-related issues similar to those observed in the Iraqi test data also occur in the Iran dataset, where large false positives or false negatives are typically associated with extensive mounds (
Figure 6g,h). The lower performance observed in the Iranian test area can likely be attributed to distinct geomorphological and land use conditions compared to the Iraqi landscape (see
Section 2.1 for an overview of the contexts).
Whereas the Iraqi plains are predominantly flat and characterised by extensive fluvial ridges, the Iranian terrain is more irregular, with incised valleys, localised aggradation, and slope terracing. Land-use patterns are also different, with Iraq characterised by large, continuous agricultural fields, while Iran has smaller, fragmented plots with denser and higher vegetation that further modifies the surface topography. Differences are also evident in
tell morphology, with Iranian
tells exhibiting a more pronounced relative elevation to the mean plain level over smaller areas than those in Iraq (on average twice as high for half the areal extent, see
Table 1).
The initial transferability analysis suggested that regional fine-tuning would be necessary to achieve comparable performance to that observed in Iraq. To test this, we evaluated several fine-tuning strategies over a subset of the Iranian test area, detailed in
Supplementary Materials Section S3. The results, presented in
Table 8, confirm the effectiveness of this approach. The fine-tuning strategies resulted in a substantial increase in performance across all metrics. Specifically, the best fine-tuned model (
Fine-tuning 200
tiles, with 20
new sites,
frozen backbone) achieved an Average Precision of
, restoring it to levels comparable to those achieved in the Iraqi test area. Compared to the initial
No Fine-tuning baseline (Average Precision:
), fine-tuning led to an approximate doubling of the Average Precision. Even compared to the
Histogram Matching baseline (Average Precision:
), the fine-tuned model showed a substantial improvement, confirming that simply mitigating the TPI distribution shift via histogram matching is insufficient compared to adapting the model weights to the new target distribution, highlighting the need to learn complex, region-specific morphological patterns. Notably, the IoU-score did not improve in line with the Average Precision and F1-score, exhibiting a saturation-like behaviour. We attribute this to the presence of a very large
tell site (an annotation outlier) that comprises almost half of the total “
Tell Site” pixels in the subset test area. This specific site was not detected, which tends to distort pixel-based metrics such as IoU score. In such cases, object-based metrics become a more reliable indicator of overall model performance. The effectiveness of the small dataset size (200 tiles, with only
containing at least one archaeological instance) suggests that the learned weights are highly transferable and only require minor local adaptation.
From a machine learning perspective, the success of the frozen backbone strategy demonstrates that the deep spatial features learned by the YOLOv8-Seg backbone in Iraq are fundamentally robust and transferable. The network does not suffer from representational collapse, but rather, the underlying representation of a tell remains valid, requiring only an adaptation of the final prediction heads and confidence threshold to suppress the natural background topography of the Iranian landscape. Consequently, while zero-shot transfer is constrained by regional geomorphology, targeted fine-tuning, with the incorporation of a small number of Iran-specific tell site data and characteristic landscape features, offers an effective and necessary step that lowers the operational barrier for reusing pre-trained models across highly diverse geographical contexts.
3.3. Archaeological Interpretation
This section analyses the model’s predictions in relation to the contextual information available in the GIS environment (e.g., orthophotos, thematic cartography, and topographic data) and assesses whether the observed reliabilities and uncertainties can be explained by the characteristics of landscape and remote sensing data (see
Figure 7). Even if it is not possible to establish a direct comparison between the SAR products and the high-resolution RGB imagery due to date mismatches, it can be reasonably assumed that, in most situations, land divisions and, therefore, agricultural land use remain stable over multiple years within the same land parcels.
The highest spatial overlap between predicted masks and ground-truth labels is observed in relatively clear situations, where
tell morphologies are small and approximately oval, and land divisions closely follow the mound outline (
Figure 7a). In some cases, detection is further supported by a coherent association between topographic change and land-use patterns, such as persistent agricultural parcel boundaries that follow the outline of the mound. From a modelling perspective, this association is relevant because it reinforces the spatial coherence between surface morphology and landscape texture visible in the GIS data. The observed patterns may equally reflect geomorphological constraints, soil moisture conditions, or modern land-management decisions, none of which can be independently verified within the scope of the available data. In several cases, however, more challenging conditions such as non-uniform land cover, e.g., uncultivated areas left as bare soil and characterised by sparse and patchy vegetation, do not appear to significantly affect the model’s predictions (
Figure 7b). From a topographic perspective, additional challenges include the spatial continuity between many
tells and fluvial ridge systems, where elevation remains nearly constant over long stretches of the plain. In these contexts,
tells are not isolated high-relief features but rather embedded within the ridge morphology (
Figure 7c). Despite these geomorphological conditions, the model is frequently able to delineate
tell features with a high degree of spatial accuracy.
The most frequent mismatches occur when the ground-truth annotations extend beyond the actual topographic mound and include portions of adjacent flat land (
Figure 7e,f). These patches are clearly evident in the RGB imagery due to their irregular or oval shapes and their frequently bare or uncultivated surfaces, which contrast with the regular agricultural landscape. Annotations derived from legacy studies, therefore, sometimes enclose the entire patch and are not limited to the topographic prominence of the
tells, especially in large archaeological areas where materials are scattered over wide extents and multiple
tells are present. This ambiguity, inherent in the dataset characteristics, leads to two complementary outcomes in the model’s prediction. In some cases (
Figure 7g), the model slightly overpredicts the ground truth, extending beyond the mound limits and into the entire land parcel. In other instances, the model underpredicts by fragmenting large composite areas into smaller units that closely follow the topographic prominence of individual
tells (see
Figure 5e).
A visual inspection of the 253 false positive detections in the Iraq test area reveals that 57 instances (
) may correspond to previously unrecorded
tell sites (
Figure 7h). These features are consistent with known sites in terms of size and morphology, with a median area of
hectares and typical dimensions of less than 200 m, both lower than median values computed for the test area (see
Table 1b). Those
tells are often a bit smaller, low in relief, or lack distinctive surface features such as agricultural boundaries or distinct land use from the surrounding area, making their identification challenging. The presence of these sites among the false positives is primarily due to limitations in the original visual survey. During large-scale visual inspections, less prominent or previously unknown
tells can be occasionally overlooked. Factors such as vegetation cover, subtle morphological boundaries, modern disturbances, and visually noisy contexts can make sites difficult to identify. Beyond these limitations, the archaeological dataset itself should be regarded as inherently incomplete, as existing inventories inevitably reflect uneven survey intensity and historical research biases. Therefore, these detections should not be considered model errors but rather highlight potential archaeological features that are missing from the original test dataset. The reliability of these predictions, as legitimate archaeological sites, is further demonstrated by the identification of looting activity in at least six of these newly identified sites. Since looting can be a direct indicator of buried archaeological deposits, these cases provide independent evidence of the model’s ability to identify locations of high interest. An additional 68 false positive detections correspond to elongated depositional alluvial features (e.g., levees, crevasse splays) that share morphological similarities with
tell sites. Those features are valuable for landscape characterisation and archaeological prospection, as they highlight candidate locations for future ground-truth survey.
A separate evaluation was also conducted on predictions that fall below the detection threshold (see
Section 2.4.5). Visual inspection confirmed the archaeological plausibility of a subset of these predictions, some of which correspond to features already present in the ground truth, while others represent previously unrecorded candidates. A subset of these detections consists of small, oval
tells, often less than 1 hectare in size, characterised by minimal elevation change but a clear visual contrast with the surrounding agricultural landscape, for example, through sparse vegetation or regular field patterns. At a broader territorial scale, these sub-threshold detections may still represent archaeological evidence. While their inclusion increases false positives and reduces precision, it also highlights the model’s potential to improve recall by detecting subtle features that are easily overlooked during standard visual interpretation, particularly in extensive and low-contrast landscapes.
The model supports the archaeological prospection in two ways. On the one hand, by focusing on a reduced number of candidates, it enables a more efficient allocation of resources for field survey inspections, prioritising areas with the highest probability of archaeological presence and reducing the time and costs associated with traditional landscape surveys. Moreover, the model can identify potential sites that human operators might miss during manual documentation and traditional archaeological surveys, greatly improving the reliability of prospection in large-scale studies. On the other hand, the confidence score associated with each detection provides a measure of model certainty, allowing researchers to rank candidates prioritising higher-confidence detections over lower-confidence ones. While the integration with other remote sensing datasets (e.g., optical imagery and historical maps) and field ground truthing activities remains necessary to confirm the nature and significance of the detected features, the model offers a systematic and scalable method that overcomes some of the limitations of visual inspection and incomplete ground truth, supporting informed decision making during the exploratory phases of research.
3.4. Explainability
The inspection of EigenCAM visualisations [
61] provides insights into how the model identifies and prioritises spatial patterns potentially associated with archaeological
tells. This analysis was conducted within the GIS environment, comparing the model’s explanations with SAR products and high-resolution RGB imagery. In several cases (e.g.,
Figure 8a–c), the model’s attention maps highlight localised topographic reliefs suggesting that the model effectively exploits elevation-derived information. However, in some cases (e.g.,
Figure 9a), the model focuses on bare-soil uncultivated areas enclosed by curvilinear roads or ditches, whose shape resembles the oval morphologies typical of
tells, but without actual topographic relief. This indicates a sensitivity to textural and soil moisture patterns that are similar to those associated with the
tell features in the S-1 data.
In areas with incised channels and strong elevation contrasts (e.g.,
Figure 9b), the model’s saliency maps mark abrupt elevation changes. In addition, depositional features at river bends (e.g.,
Figure 8d) are highlighted, likely due to their morphological similarity to
tells. Such activations reflect the influence of local relief and sedimentary patterns, suggesting that geomorphological features can either generate classification ambiguity or provide clues to support correct predictions. In the Iranian test area, the presence of high vegetation clustered in small patches (e.g.,
Figure 9c,d), which is largely absent from the Iraqi training dataset, creates topographic anomalies leading to detection errors: these failures are reflected in the high level of noise characterising the corresponding activation maps.
Overall, the EigenCAM analysis suggests that the model captures meaningful topographic and textural signals associated with potential archaeological objects, but it can also be confused by natural or agricultural structures that share similar morphometric characteristics. The interpretability analysis is therefore essential not only to validate the model’s reasoning but also to guide future refinements, which may include expanding the training dataset with hard negative and positive examples, such as agricultural terraces and vegetated tells.