This section presents the results obtained from system code simulations and experimental data for various steady-state and transient conditions, as outlined in
Table 3 and
Table 4. The aim is to assess the behavior of the natural circulation loop as well as validate the RELAP5-3D code. To evaluate the predictive capability of the model against experimental measurements, several statistical error metrics were employed. The coefficient of determination (
) assesses how well the model captures the overall experimental trend. The mean absolute error (MAE) quantifies the average magnitude of deviations in physical units, while the mean absolute percentage error (MAPE) provides a normalized, dimensionless measure for cross-variable comparison. The mean bias error (MBE) indicates whether RELAP5-3D model systematically overpredicts or underpredicts the experimental data. Collectively, these metrics offer a robust and transparent framework to assess model accuracy, identify systematic biases, and build confidence in the simulation results. The statistical performance metrics, including
, MAE, MAPE, and MBE, together with the relative percentage error (RPE), are formally defined in Equations (
27)–(
31).
where
N is the number of data points,
is the experimental value,
is the predicted value from the RELAP5-3D model,
is the mean of the experimental values, and
i is the data index.
5.1. Startup and Steady State Analysis
Various steady-state conditions for NC have been established at different heater power levels.
Figure 8 shows the temperature profile across the heater as obtained from the RELAP5-3D code and experimental data at a heater power of 1000 W and a cooling mass flow rate of 0.126 kg/s. At the beginning of the NC transient, the sudden imbalance between heat input and the initial fluid motion leads to the appearance of these peaks. When power is first applied, the heater wall temperature rises quickly, but the fluid in contact with it is still relatively stagnant. This creates a rapid local temperature gradient and strong buoyancy forces, which momentarily accelerate the flow and drive an overshoot in outlet temperature. As circulation strengthens, cooler fluid from the inlet mixes with the hot region, reducing the gradient and damping the peak. In RELAP5, where all the thermal power is deposited directly in the immersed heater, this effect is amplified because the fluid receives the full input power instantly, leading to sharper peaks. In the experiment, part of the power goes to the guard rings and structural heat capacity, so the heating is distributed and the peaks are less pronounced. It can be noted that the code properly captured the NC phenomenon across the loop, although it reached a steady state slightly faster than the experiment, likely due to the code and experimental limitations discussed below.
Figure 9 presents the temperature difference across both the heater and the cooler, with maximum deviations of 8% and 5%, respectively. Additionally, the loop mass flow rate, as predicted by the code and observed by the experimental data, is shown in
Figure 10, with flow rates of approximately 0.029 and 0.031 kg/s, respectively.
The steady-state behavior of the NCL under different heater power levels, with water as the working fluid, is illustrated in
Figure 11. This figure presents a comparison between the inlet and outlet temperatures at both the heater and cooler, across different power levels, as predicted by RELAP5-3D and as observed in experimental data. It can be observed that there is a linear relationship between the system parameters (e.g., heater and cooler inlet and outlet temperatures and mass flow rate) and heating power for all pressure conditions considered, which is consistent with theoretical expectations. Furthermore, the temperature differences between the inlet and outlet of the heater which provide the primary driving head for the system are greater than those observed in the cooler under all heating powers and pressures. Also, the loop flow rates increase linearly with rising heater power, as shown in
Figure 12.
For the loop mass flow rate and temperature across the heater and cooler, it is observed that for a heater power up to 1 kW, the deviations between code predictions and experimental data are minimal. However, as heater power increases, the code tends to underestimate both the temperature and mass flow rate in the NCL. These discrepancies may arise from different sources which amplify differences, while the code increasingly underestimates both the temperatures and the mass flow. First, the test loop’s thin insulation layer causes external losses to grow rapidly with power, so the model carries too much heat away, depressing the mean loop temperature and yielding cooler ports. Second, with no primary flowmeter, the experimental
is inferred from the energy balance; as power rises, larger external losses and port-zone mixing decrease the measured
, biasing the inferred
upwards and widening the apparent gap. Third, the RELAP5-3D model assigns all thermal power to the immersed heater, while, in the experiment, power is split between the immersed section and the guard heater/structures. The simplification in power distribution may increase the heat delivered to the fluid; consequently, the model inflates the rise in heater-side enthalpy (
) and the buoyancy driving head, misrepresenting the component inlet/outlet (port) temperatures and the loop mass flow (
). Combined with the geometric simplifications, these factors make the 1D deck overly resistive at high temperatures, further underpredicting circulation and explaining why discrepancies grow with heater power and why the code trends low in both.
Table 6 and
Table 7 summarize the relative errors between the code predictions and experimental data under the specified conditions for heater and cooler temperature and loop mass flow rate, respectively.
For the selected tests for RELAP5-3D simulation, the statistical error metrics presented in
Figure 13 provide a quantitative assessment of the agreement between experimental measurements and RELAP5-3D simulation results. The grouped bar chart (left) compares four global performance indicators—mean bias error (MBE), mean absolute error (MAE), mean absolute percentage error (MAPE), and the coefficient of determination (
) for the three principal output parameters, namely mass flow rate, heater temperature rise, and cooler temperature drop. The MBE values are very small (
for mass flow,
°C for heater for heater
, and
°C for heater for cooler
), indicating minimal systematic bias between RELAP5-3D and experiment. The MAE values remain below 1 unit in all cases (
for mass flow,
°C for heater
, and
°C for heater for cooler
), while the MAPE values are modest (8.56% for mass flow, 8.43% for heater
, and 9.49% for cooler
), confirming that deviations are small in both absolute and relative terms. Furthermore, the consistently high
values (0.82 for mass flow, 0.92 for heater
, and 0.87 for cooler
) demonstrate that the RELAP5-3D model reasonably captures the experimental trends across the tested power range.
The right panel shows the relative percentage error (RPE) given by Equation (
31) as a grouped bar plot at each power level for the three key variables. Positive values indicate overprediction by the model, while negative values indicate underprediction. For the mass flow rate, the model underpredicts consistently, with errors increasing in magnitude from about
at 400 W to nearly
at 3000 W. This systematic underestimation reflects not only limitations in how frictional losses, local resistances, and distributed heat losses are represented in the model, but also uncertainties in the experimental loop arising from the absence of a dedicated flowmeter. Regarding heater and cooler temperature differences, the model tends to underpredict these values at lower power levels (below 2000 W), with errors ranging from
at 400 W to around
at 1000 W. At higher powers, however, it progressively overpredicts these values, reaching approximately
for heater
and
for cooler
at 3000 W. This crossover behavior indicates a sensitivity of the thermal–hydraulic correlations used in RELAP5-3D to the operating regime, which may be influenced by nonlinearities in natural circulation, increased heat losses at high power, and the distribution of power between the immersed heater and guard heater. Nonetheless, most RPE values remain within
up to 2000 W, indicating stable predictive capability across the operating window.