4.1. Data Presentation and Experiment Analysis
This chapter presents the experimental results of RTT estimation using RELM, which is tested on the activation function. It then discusses the selection of the regularization constant C, performed by brute force and using the proposed function. Then, the proposed function is compared with several machine learning models built and with those from existing research. Finally, the proposed function is implemented for several regression problems from the “UC Irvine Machine Learning Repository.”
The accuracy results remain unchanged within the range of
to
and
to
, so the data plot is omitted.
Figure 5 illustrates the
C constant data, with a range of
to
, which is displayed more clearly to show the accuracy values for RMSE and MAE.
Figure 5 illustrates the accuracy of error values using MAE and RMSE on both validation and test data. The diagram shows that the best RMSE is achieved at
.
Figure 6 then depicts the accuracy of MAPE and
errors within the same range.
Figure 6 shows that by using the ReLU activation function, the regularization constant is changed from
to
. In addition, to achieve the highest accuracy, this study selected
with the ReLU activation function. It used a hidden layer size of 150 as the optimal parameter, based on the lowest RMSE value. However, the above experiments were conducted through trial and error and took considerable time. Each time
C was changed, the program should be run, and the resulting error accuracy noted, so it would take quite a long time if done one at a time. Because the regularization constant was changed from
to
, the trial-and-error time was less noticeable. However, if the regularization constant were adjusted from
to
, it would raise questions about its impact on the model’s performance. Therefore, in the future, an algorithm was suggested to select this
.
To ensure that the model was not too adaptive to the training set to produce a high accuracy value. The experiments were conducted using cross-validation on the previously best hidden layer, and execution time was also displayed to observe the program’s performance, as shown in
Table 1. The cross-validation results are expressed as mean ± standard deviation across the 5 folds to demonstrate stability and reduce the risk of optimistic estimates from a single split.
Furthermore, in terms of error accuracy and execution time, Hidden Layer 150 has the fastest execution time. Additionally, after experimenting with cross-validation, the accuracy displayed is relatively optimal. The optimal parameters after the experiment are a hidden layer size of 150 and a , using ReLU as the activation function.
The results of the model against the test data are shown in a line plot graph in
Figure 7. To improve the RELM algorithm, experiments were conducted by implementing a brute-force approach to determine the value of the constant
C in the RELM model. The advantage of this enhanced RELM was that the algorithm only performed the best search using validation data, thereby reducing execution time. By limiting the value of
C from
to
, the algorithm searched for the value of
C within the specified range using the brute force approach.
This study focused on the program’s execution time.
Table 2 illustrates the program execution time when using brute force as a constant selection. For the accuracy value, using brute-force search, the optimal
was found to be
through trial and error. The difference was that at this moment, upper and lower limits were provided to determine the value of the constant
C. However, there was a weakness in this function: if
to
, there was no optimal value. In this case, the program generated the best value of
C within that range, even if it was not the optimal one.
Figure 8 shows the graph of the
, based on the RMSE accuracy. To solve this problem, if no optimal value existed within this range, a function was created using the previously described tolerance limit. The initial value of
C was set to
. Then, it was divided into two parts:
when
C was increasing, and
when
C was decreasing.
Table 3 gives the program execution time. The execution time is longer than that of brute force. If
C were decreasing, the algorithm would have run only to
because the accuracy remained the same or worsened after five consecutive backward iterations; therefore, it stopped at
for
. If
C was increasing, even when finding the best accuracy at
, the algorithm still ran forward to
. However, the accuracy was worse when five iterations were performed in reverse after finding the best accuracy, so
was stopped at
. Examining the iterations, brute force performed 25 iterations from
to
, whereas the proposed function performed only 13 iterations from
to
. Therefore, it can optimize the RELM algorithm without the need for trial-and-error to find the regularization constant.
Applying the results of the previous experiments, the proposed RELM was configured with 150 hidden neurons, the ReLU activation function, and the selected regularization constant
. To ensure a fair comparison, all baseline models were evaluated under the same data split and preprocessing pipeline (standardization of
X using training statistics only and normalization of
Y using training statistics only, followed by de-normalization for reporting metrics). We compared the proposed method against several regression baselines, including Support Vector Regression (SVR), Generalized Additive Model (GAM), Decision Tree Regression,
k-Nearest Neighbors (KNN), Random Forest, Gradient Boosted Decision Trees (GBDT), and Extreme Learning Machine (ELM).
Table 4 summarizes the predictive performance and execution time results.
Overall, the proposed Enhanced RELM achieves consistently low error across both validation and testing sets while maintaining very low computational cost. Notably, its inference time is among the fastest, which is important for practical RTT estimation systems that require near real-time predictions.
Furthermore, this study compares different strategies for selecting the RELM regularization constant C. The first strategy is a trial-and-error approach, where C is manually adjusted across repeated runs to obtain a satisfactory result; although it can be quick for a single run, it is not systematic and may require many attempts. The second strategy is a brute-force grid search over a predefined range (e.g., to ), which requires 25 evaluations to identify the best value within the grid; however, if the optimal C lies outside the chosen range, the method returns only the best value within the grid.
In contrast, the proposed adaptive search function does not require preset upper and lower bounds. It iteratively expands or contracts C (by a factor of 10) and stops based on a tolerance criterion, reducing unnecessary evaluations when improvements become marginal. In our experiments, the adaptive search explored approximately to and required only 12 evaluations to reach the selected C value, resulting in a more efficient selection process than brute-force search while preserving strong predictive performance.
4.2. Real-World Evaluation Using Public WiFi RSS–RTT Dataset
While the preceding experiments demonstrate the effectiveness of the proposed Enhanced RELM under a controlled simulation environment, real-world wireless networks exhibit substantially different characteristics, including non-line-of-sight (NLOS) propagation, severe multipath effects, intermittent signal loss, and measurement noise that cannot be fully captured by synthetic datasets. To further assess the robustness and practical applicability of the proposed method, an additional evaluation was conducted using a publicly available real-world WiFi RSS–RTT dataset published by Feng et al. [
46].
The dataset consists of three indoor deployment scenarios with distinct propagation conditions: a lecture theatre environment with entirely line-of-sight (LOS) links, an office environment with mixed LOS and NLOS conditions, and a corridor environment dominated by NLOS propagation. WiFi RTT and RSS measurements were collected using Google WiFi routers and a Google Pixel 3 smartphone, with ground-truth spatial coordinates obtained via grid-based reference-point labeling. Invalid RTT measurements (100,000 mm) and RSS values (−200 dBm), indicating missing or inaudible signals, were filtered prior to model training and evaluation.
For each scenario, the access point (AP) with the most valid RTT samples in the test set was automatically selected as the prediction target to ensure sufficient data support. The remaining RTT measurements from other APs, together with RSS values from all APs, were used as input features. To maintain fairness and consistency with the simulation-based experiments, the same standardized evaluation pipeline was applied: features were standardized using only training-set statistics, target RTT values were normalized during training and denormalized for metric reporting, and the proposed adaptive regularization-constant selection was performed exclusively on the validation set.
Table 5 summarizes the predictive performance of the proposed Enhanced RELM across the three real-world scenarios. In the lecture theatre environment, where LOS propagation is stable, the proposed method achieves near-meter accuracy, indicating that the learned mapping remains informative under practical measurement noise. In the office environment, where mixed LOS/NLOS conditions are present, the accuracy degrades moderately but remains reliable, reflecting partial obstruction and multipath effects. In contrast, the corridor environment, dominated by NLOS propagation and severe multipath, exhibits substantially higher prediction errors and near-zero
values, indicating that RTT measurements in such conditions are weakly correlated with spatial distance.
These results show that the observed performance degradation in NLOS-dominated environments is primarily driven by the physical characteristics of the wireless channel rather than the model’s learning capacity. Importantly, the proposed Enhanced RELM demonstrates consistent and realistic behavior across diverse propagation conditions, avoiding overly optimistic performance estimates and reinforcing the validity of the evaluation protocol.
We note that this dataset contains IEEE 802.11 mc WiFi RTT measurements (often used for ranging/positioning) rather than TCP RTT from transport sessions. Therefore, this experiment is reported as an out-of-domain robustness check, not as direct evidence that the model generalizes to operational TCP networks.
4.3. Discussion
Several studies, such as those by Subramanya et al. [
37], have attempted to illustrate network bottlenecks by simulating a dumbbell topology, while other works, such as Jacobsson et al. [
47], constructed network datasets to estimate RTT using features including queue state and link delay. In a similar spirit, this study develops a custom-built RTT dataset by simulating a dumbbell network topology across a broad range of delays in a controlled environment. This design enables systematic benchmarking and precise control over RTT variability, while acknowledging that certain real-world effects, such as packet loss, jitter, and dynamic routing changes, are not fully captured in simulation.
The near-perfect values observed in the simulation-based experiments should therefore be interpreted in the context of this controlled environment. Since RTT dynamics are generated under systematic delay configurations with limited uncontrolled noise sources, the resulting input–output relationship is highly structured. When strict leakage-prevention and validation protocols are applied, such conditions can naturally yield very high values. This behavior does not indicate overfitting but rather reflects the deterministic nature of the simulated setting.
To examine whether the proposed approach remains valid beyond this controlled scenario, an additional evaluation was conducted using a publicly available real-world WiFi RSS–RTT dataset with diverse propagation characteristics, including line-of-sight (LOS), mixed LOS/NLOS, and dominant NLOS environments. The results reveal a clear dependence of performance on the underlying wireless propagation conditions. In LOS-dominated environments, the proposed Enhanced RELM achieves near-meter accuracy, demonstrating that the learned mapping remains informative under practical measurement noise. In mixed LOS/NLOS scenarios, the performance degrades moderately but remains reliable. In contrast, in corridor environments dominated by NLOS propagation, the prediction accuracy deteriorates significantly, with high RMSE values and near-zero . This outcome is consistent with the known instability of WiFi RTT measurements under severe multipath and obstruction, indicating that the primary limitation arises from the physical characteristics of the wireless channel rather than the model’s learning capacity.
Jordaan et al. [
48] highlighted that the regularization parameter
C in RELM plays a critical role in balancing model complexity and prediction error. Similarly, Li et al. [
49] noted that identifying an optimal
C value is challenging due to its interaction with other model factors. In this study, an adaptive heuristic was proposed to select the regularization constant on a logarithmic scale without requiring predefined upper and lower bounds. Experimental results demonstrate that the
C value obtained using the proposed heuristic consistently yields high predictive accuracy with reduced execution time, effectively reducing the number of grid-search evaluations required.
Several studies have explored RTT prediction using machine learning techniques such as RNNs [
9], LSTMs [
25], hybrid neuro-fuzzy networks [
28], adaptive filtering methods [
27], and CNN-based models [
29]. However, direct numerical comparison across prior studies is generally not strictly comparable due to differences in datasets, feature representations, and evaluation protocols. To mitigate this issue and enable a fair within-study comparison, representative baseline models from the literature were re-implemented and evaluated under the same experimental pipeline as the proposed method, including an identical train/validation/test split, training-only normalization, and validation-only hyperparameter selection. The results reported in
Table 6 demonstrate that the proposed Enhanced RELM achieves a favorable accuracy–efficiency trade-off on the considered simulation dataset.
Overall, the combined evidence from simulation-based and real-world evaluations indicates that the proposed Enhanced RELM provides reliable, computationally efficient RTT estimation under informative signal conditions. At the same time, the real-world experiments highlight the inherent limitations imposed by wireless propagation physics, particularly under NLOS conditions. Further validation on operational networks with dynamic traffic patterns, packet loss, and routing changes remains an important direction for future work.
Limitations. The simulation-based evaluation uses a single dumbbell topology and a controlled delay-injection procedure; thus, the results do not generalize across different topologies, routing dynamics, packet-loss regimes, or highly variable traffic patterns. Extending the evaluation to multiple topologies and operational traces with loss/jitter/path changes is an important next step.