1. Introduction
Steam Methane Reforming (SMR) is a pivotal industrial process for hydrogen generation that primarily converts methane and steam into hydrogen and carbon monoxide at elevated temperatures [
1]. This endothermic reaction normally occurs over a nickel-based catalyst in tubular reactors housed in gas-fired furnaces [
2]. The process typically works at 700–1000 °C with pressures ranging from 3 to 25 bar to convert natural gas feedstock into syngas [
1,
3]. The created carbon monoxide can then undergo a water-gas shift reaction with more steam, yielding more hydrogen and carbon dioxide in a somewhat exothermic process [
4].
As shown in
Figure 1, the SMR is a well-established pathway for large-scale hydrogen production; however, it requires substantial energy input owing to the highly endothermic primary reforming step (See
Figure 2), which is usually powered by non-renewable fuels [
5,
6]. The conventional steam methane reforming process mainly comprises Steam Methane Reforming (SMR) and the Water Gas Shift Reaction (WGSR):
Steam Methane Reforming (SMR):
Water Gas Shift Reaction (WGSR):
Alternatively,
Direct Steam Reforming (DSR):
Furthermore, according to Le Châtelier’s principle, SMR requires a lower pressure despite being a highly endothermic reaction. Typically, in large-scale scenarios, the outlet temperature ranges from 850 °C to 950 °C to achieve optimum methane conversion [
1,
2,
5]. Industrial SMR processes typically operate at higher pressures to boost throughput and minimize equipment size, thus necessitating even higher temperatures to sustain a favorable equilibrium for hydrogen production [
1].
Despite widespread deployment, steam methane reforming (SMR) operates at elevated temperatures and pressures, resulting in a significant carbon footprint. From a global perspective, SMR facilities account for nearly 3% of all CO
2 emissions [
2,
5]. Consequently, this substantial environmental impact underscores the urgent need to develop sustainable hydrogen production methods and integrate carbon capture technologies into existing SMR plants.
Figure 1.
The donut chart above reveals the current global most adopted Hydrogen gas (H
2) production pathways. The Steam Methane Reforming (SMR) is about ∼75% as shown. Thus, this reveals both the Technological and Commercial Readiness Level (TRL & CRL) of the SMR production for the production of Hydrogen gas (H
2). The donut chart is based on data reported in [
7,
8,
9].
Figure 1.
The donut chart above reveals the current global most adopted Hydrogen gas (H
2) production pathways. The Steam Methane Reforming (SMR) is about ∼75% as shown. Thus, this reveals both the Technological and Commercial Readiness Level (TRL & CRL) of the SMR production for the production of Hydrogen gas (H
2). The donut chart is based on data reported in [
7,
8,
9].
Figure 2.
The schematic diagram above presents the conventional Process Flow Diagram (PFD) for conventional Steam Methane Reforming (SMR). The SMR process encompasses multiple stages for the production of blue hydrogen (H
2), facilitated by the carbon (IV) oxide (CO
2) capture unit. Additionally, as depicted in the CO removal process indicated by the red dotted line, the SMR incorporates two water-gas shift (WGS) reactors: a high-temperature shift (HTS) and a low-temperature shift (LTS). While CO
2 is absorbed by the Amine CO
2 removal unit, hydrogen (H
2) is generated via the Pressure Swing Adsorption Unit. The blue dotted boundary line delineates the supplementary carbon-capturing units necessary to achieve net-zero emissions targets. It worth noting that this conceptual schematic process flow diagram was based on [
10,
11].
Figure 2.
The schematic diagram above presents the conventional Process Flow Diagram (PFD) for conventional Steam Methane Reforming (SMR). The SMR process encompasses multiple stages for the production of blue hydrogen (H
2), facilitated by the carbon (IV) oxide (CO
2) capture unit. Additionally, as depicted in the CO removal process indicated by the red dotted line, the SMR incorporates two water-gas shift (WGS) reactors: a high-temperature shift (HTS) and a low-temperature shift (LTS). While CO
2 is absorbed by the Amine CO
2 removal unit, hydrogen (H
2) is generated via the Pressure Swing Adsorption Unit. The blue dotted boundary line delineates the supplementary carbon-capturing units necessary to achieve net-zero emissions targets. It worth noting that this conceptual schematic process flow diagram was based on [
10,
11].
Hydrogen is increasingly recognized as the cornerstone of global energy transition, offering a carbon-free energy carrier that can decarbonize sectors that are difficult to abate, such as heavy industry, chemicals, and long-haul transportation [
12,
13]. The donut chart in
Figure 3 shows global hydrogen consumption in megatonnes (Mt) per year in various sectors. The donut chart on the left in
Figure 3 shows the hydrogen consumption for methanol, refining, iron and steel, ammonia, and other applications, totalling approximately 93.7 Mt per H
2 over the period of 2019 to 2023. Similarly, the donut chart on the right side reveals the projection of the International Energy Agency’s Net Zero Emissions (IEA-NZE) for 2030, totaling an estimated 148.6 Mt per H
2.
Despite the promise of hydrogen as a clean energy carrier, its sustainability is predicated on its production method. As depicted in
Figure 4, hydrogen can be produced from renewable (green pathways) or non-renewable sources (grey, blue, or black pathways). However, the Steam Methane Reforming process is primarily associated with non-renewable sources, which results in the production of grey hydrogen. Furthermore, when SMR is combined with carbon capture and storage (CCS), the resulting hydrogen is typically referred to as blue hydrogen. This classification highlights the dual challenge of SMR despite its technological maturity, it remains carbon-intensive unless emissions are mitigated effectively.
However, the sustainability of hydrogen production remains a challenge. Currently, most hydrogen is produced by steam methane reforming (SMR), a process that emits significant amounts of CO
2 unless paired with costly carbon capture and storage (CCS) systems. This dependence on fossil-based hydrogen has prompted the search for alternative production pathways that combine economic viability with deep decarbonization potential [
16,
17,
18].
A process flow diagram (PFD) illustrates a schematic for Steam Methane Reforming powered by Induction Heating (IH), leading to the production of hydrogen (H
2) and capture of carbon (IV) oxide (CO
2), as depicted in
Figure 2. The investigation or training of the proposed hybrid Bayesian neural network was based on various input data, such as Methane Conversion (%), Time on Stream (TOS) on the catalytic surface, Power Input (W), Temperature (°C), Magnetic Flux, and other significant variables that influence steam methane reforming through induced heating.
Recently, modern SMR systems have integrated artificial intelligence, machine learning, and data-driven optimization to enhance reactor control, improve predictive accuracy, and reduce emissions. Moreover, hybrid physics-informed models and digital twins can facilitate improved forecasting of hydrogen yield and operational degradation processes, exceeding the capabilities of traditional models [
19,
20].
The methodology employed in this study is more accurately characterized as a bootstrap-based Gaussian jittering data-augmentation strategy, as opposed to other data augmentation approaches. While this stochastic augmentation does not replace a systematic exploration of the input space, it is applied solely to the training subset thus providing a controlled, transparent, and reproducible means of enriching limited experimental data in a manner consistent with plausible measurement uncertainty.
Within this framework, the Hybrid Bayesian Neural Network (H-BNN) particularly benefits from the augmented data, as the additional perturbed samples facilitate more stable parameter learning while maintaining uncertainty-aware prediction. As a result, the H-BNN framework is not only more reproducible from a modelling perspective but also more practically applicable for reliable hydrogen-production forecasting, as well as further analysis, such as post-processing of derived performance indicators, including hydrogen yield (Y
H2) and specific energy consumption (SEC). Consequently, SMR can bridge established industrial practices and innovations, with its future deployment depends on advancements in carbon capture, methane leakage control, AI-driven optimization, and economic alignment with renewable hydrogen production [
20,
21,
22].
In this study, a hybrid Bayesian Neural Network (H-BNN) framework was developed and deployed to predict hydrogen gas production generated from steam methane reforming via induction heating. The dataset used in the training (70%) of the H-BNN was scarce hence the theme of this study. Furthermore, the training set of the dataset was scaled up to a ten times to optimally train the proposed neural network frameworks. It is worth noting that the test (15%) and validation (15%) sets were left unadulterated to maintain the integrity of the datasets and prediction efficiency of the H-BNN.
1.1. The Hybrid-Bayesian Neural Network (H-BNN)
A Hybrid Bayesian Neural Network (H-BNN) combines the deterministic function-approximation capability of a standard Feedforward Neural Network (FNN) with the uncertainty-quantification capacity of a Bayesian approximation. In the present study, the objective was to preserve the strong predictive performance of a deterministic neural network while simultaneously quantifying predictive uncertainty in the estimation of hydrogen production. Accordingly, the H-BNN was designed as a deterministic FNN backbone regularized through Monte Carlo (MC) dropout, which enables an efficient approximation to Bayesian inference.
The central idea is to retain dropout during both training and inference so that the network can be interpreted as sampling from an approximate posterior distribution over the weights. Following the variational interpretation of dropout established by Gal and Ghahramani (2016), the repeated application of dropout at different layers may be viewed as an approximate variational inference scheme in a deep probabilistic model [
23,
24]. In this manner, the H-BNN preserves the computational simplicity of a conventional FNN while incorporating a practical mechanism for uncertainty estimation. It is important to acknowledge that this interpretation is approximate and is based on simplifying assumptions. Therefore, in the present study, MC dropout was employed as a computationally efficient method for approximating uncertainty, rather than as an exact representation of Bayesian posterior inference.
1.2. Monte Carlo Dropout and Kullback–Leibler (KL) Divergence
1.2.1. Monte Carlo Dropout
Monte Carlo (MC) dropout is a stochastic regularization and approximate inference technique in which dropout remains active during both training and inference. In this setting, each forward pass samples a different subnetwork of the full model, thereby yielding a stochastic prediction of the form:
where
denotes the approximate variational distribution induced by dropout. Repeated forward passes for the same input produce a set of stochastic outputs,
,
, …,
, from which the predictive mean and predictive variance can be estimated as
Here, represents the mean prediction across the T stochastic forward passes, whereas provides an estimate of predictive uncertainty arising from the approximate posterior over the weights.
1.2.2. KL Divergence in Variational Inference
In Bayesian learning, the true posterior distribution of the weights, p(W ), is generally intractable. Variational inference therefore introduces a tractable approximation and seeks to minimize the Kullback-Leibler (KL) divergence between the approximate and true posteriors:
Because direct minimization of Equation (
3) is not computationally convenient, the optimization is instead formulated through the evidence lower bound (ELBO), given by
Maximizing L
ELBO is equivalent to minimizing
. For model training, however, the objective is more conveniently expressed in minimization form as the negative ELBO. In the present H-BNN framework, this variational objective is approximated in practice by a prediction-error term together with a regularization term:
where the first term corresponds to a mean-squared-error approximation of the negative log-likelihood under a Gaussian observation assumption, and the second term serves as a tractable surrogate for the KL regularization implied by the variational formulation. Thus, the H-BNN combines accurate deterministic learning with an approximate Bayesian treatment of weight uncertainty.
As shown in the algorithm (See Algorithm A1), the proposed H-BNN framework is computationally more efficient than a classic Bayesian Neural Network (BNN) because it retains a deterministic FNN backbone for feature learning while introducing Bayesian uncertainty through the MC-dropout approximation. Consequently, the H-BNN reduces the computational burden typically associated with full Bayesian neural networks, while still providing uncertainty-aware predictions for the target variable.
1.3. Preliminary Correlation Analysis Among Variables
Before deploying the hybrid Bayesian neural network (H-BNN), a general correlation analysis was performed among the features derived from the steam methane reforming dataset, as shown in
Table 1. This included both input variables (e.g., methane flow rate, magnetic flux, and key variables influencing the SMR process) and output variables (e.g., mass of hydrogen, and energy metrics such as energy index and specific energy consumption).
Computation of the Correlation Coefficient Among the Variables
Let
denote a full set of numerical variables. Recall, the Pearson correlation coefficient
between any two variables
and
is given by:
where:
and are the k-th samples of variables and ,
and are the sample means,
∈, where indicates a perfect positive correlation and indicates a perfect negative correlation.
1.4. Variables, Along with Their Respective Definitions
In this study, the following variables in
Table 1 were considered potential key factors influencing a typical case of steam methane reforming via induction heating.
As shown in
Table 1, the bolded rows—Specific Energy Consumption per 1 kg per H
2 (SEC (kWh/kg H
2)), Hydrogen Yield (%), and Mass of Hydrogen (MoH (Kg))—were further considered to understand the underlying energy efficiency of the referenced datasets extracted from the literature, as well as to support the prediction of hydrogen production.
1.5. Deployed Mathematical Models-MoH, SEC & YH2
The Chemistry of Reactions for the Steam Methane Reforming (SMR) are given as:
- 1.
Direct Steam Reforming (DSR) - 2.
Steam Methane Reforming (SMR) - 3.
Water Gas Shift Reaction (WGSR)
In general, the Steam Methane Reforming reaction (SMR) equation can be written as:
The mathematical derivations or framework deployed in this study follow a run-wise time-discretized structure so that hydrogen production, hydrogen yield, cumulative energy input, and specific energy consumption are computed consistently within each experimental run. Furthermore, the mathematical framework was deployed to harmonize heterogeneous steam methane reforming (SMR) data extracted from different literature sources (See
Table 2) on a common time-resolved basis. Accordingly, the stoichiometric coefficient for hydrogen formation is written as:
In the following derivation, each experimental record j contains the reported operating variables [mL ], [bar], [°C], [h], and [W], together with methane conversion [%] and hydrogen yield [%].
- 1.
Unit conversions and methane-feed definition
The following unit conversions are first introduced:
Thus, the methane inlet molar flow rate is obtained directly from the ideal-gas law:
where
J
.
The corresponding methane inlet mass flowrate is given by:
where
g
.
- 2.
Time discretisation and run segmentation
Since the experimental data are recorded as discrete time points indexed by j, with time on stream measured in hours [h]. Also, the extracted data contains multiple experimental runs hence, a new run starts whenever the time on stream is reset (i.e., when ).
Thus it is worth assigning a run identifier
such that within each run the sequence of time points is strictly non-decreasing:
Within each run
r, we define the time increment between successive samples:
Importantly, this approach is applied in the computation of the output variables to ensure that time intervals are not mixed across different runs.
This initial zeroth-order assumption over the initial interval ensures that the cumulative quantities are accurately reconstructed within each experimental run, thereby preventing the intermixing of time intervals across different experiments.
- 3.
Methane conversion and reacted methane flowrate
The reacted methane molar flowrate is computed from the reported methane conversion (See
Table 2):
The cumulative methane fed and cumulative methane reacted within run
r, up to sample
k, are then written as:
- 4.
Hydrogen yield basis and hydrogen molar formation rate
The hydrogen yield is defined on a methane-fed basis as follows:
where,
is the stoichiometric coefficient of hydrogen in the adopted reaction basis (Refer to Equation (
7)). Hence for consistency, the hydrogen molar formation rate is most consistently written as:
Equation (
17) is then applied uniformly to all harmonized data from
Table 2.
- 5.
Instantaneous and cumulative mass of hydrogen
The instantaneous hydrogen mass formation rate is obtained as follows:
where
g
.
The hydrogen mass formed during interval
j is given by:
and the cumulative hydrogen mass up to sample
k within run
r is given by:
Equation (
20) represents the accumulated hydrogen produced over the time increments within each run.
- 6.
Instantaneous and cumulative hydrogen volume
Similarly, the instantaneous hydrogen volumetric flowrate follows the ideal-gas law:
The hydrogen volume formed during interval
j is then given by:
and the cumulative hydrogen volume up to sample
k is:
While not considered in this study, if the volume of the gas under standard conditions is required instead of those under reactor conditions, Equation (
23) would be evaluated using the specified reference temperature and pressure.
- 7.
Cumulative hydrogen yield
The cumulative hydrogen yield is expressed on a methane-fed basis. The theoretical cumulative hydrogen mass obtainable from the methane fed up to sample
k is given:
Hence, the cumulative hydrogen yield is given by:
provided that
. Otherwise,
by convention.
- 8.
Cumulative energy input
The incremental electrical energy input in interval
j is
where
is the measured power in watts.
The cumulative energy input up to sample
k within run
r is given by:
- 9.
Specific energy consumption for hydrogen production
The cumulative specific energy consumption with respect to hydrogen production is defined as the cumulative energy input divided by the cumulative hydrogen mass:
provided that
. If
,
is left undefined or set to zero by convention at the beginning of a run.
- 10.
Energy Index per kg CO2 per kg H2
The energy index per kg CO2 per kg H2 is computed as follows:
A stoichiometric CO
2-equivalent index can be computed from the amount of methane reacted as follows:
where
g mol
−1.
Then the corresponding cumulative Energy Index per kg CO
2 per kg H
2 is obtained as follows:
It is important to recognize that Equation (
30) serves as a stoichiometric CO
2-equivalent indicator derived from reacted methane rather than offering a direct measurement of actual emissions from the process.
Equations (
8)–(
30) have been constructed to convert raw literature data into harmonized runwise cumulative variables, assessed on a consistent temporal, stoichiometric, and energetic framework. This approach is particularly effective for synthesizing experiments of diverse durations and scales, as it derives hydrogen production, hydrogen volume, hydrogen yield, cumulative energy input, and specific energy consumption from interval-wise contributions within each run, rather than through direct row-wise multiplication by time-on-stream (TOS).
3. Datasets and Machine Learning
The dataset was built using data collected from the extensive literature on steam methane reforming powered by induction heating. All key potential factors that usually influence the process were carefully considered, including Power Input, Temperature, Time on Surface (for catalyzed pyrolysis), and Hydrogen Yield. The sources of the extracted datasets are listed in
Table 2.
Once the dataset was curated or prepared, key variables were used as inputs for training the H-BNN algorithm. Key variables such as the Specific Energy Consumption (SEC), Hydrogen Yield (
), and Mass of Hydrogen (MoH) were first computed following the computational routines according to the mathematical derivations documented in
Section 1.5. Subsequently, six key variables in
Table 1 were input into the H-BNN algorithm (See Algorithm A1). As shown in
Table 3, after a rigorous hyperparameter search, an optimized neural network architecture comprising six input variables (selected key variables) and a hidden layer with 256, 128, 64, and 1 output layers was obtained. Notably, this architecture was trained using the training set (70%), which was augmented up to ten times (
k = 10) owing to the scarcity of the dataset.
In addition, the discrete operating conditions in the original raw extracted datasets were one-hot encoded before training; thus, the final neural network input dimension equalled the total number of encoded features rather than the number of raw operating variables alone. Therefore, the model retained a single input layer, but the number of input neurons increased to reflect the expanded encoded representation of the experimental conditions.
Finally, the scale factor k was reduced to several lower values to observe the performance of the H-BNN, BNN, and FNN. In addition, as shown in
Table 4, specific activation functions, such as ReLU, Tanh, and GeLU were applied to generate the target variable. The Gelu activation function was chosen as the best option for computing the “Monte Carlo Dropout” in both the hybrid and classic BNN. Furthermore, as tabulated in
Table 4, for each training session, rigorous optimization was performed to obtain the most robust neural network architecture across the proposed scale factors. A detailed overview of the data pre-processing is presented in
Appendix A.2. Thus, the number of input vectors after feature encoding became 22, as shown in
Table 4.
Preliminary Analysis of the Datasets
In this section, the preliminary outcomes of the statistical analysis of the mined datasets from the literature extracted dataset (See
Table 2) are outlined. The calculated performance indicators, such as the Specific Energy Consumption (SEC) revealed that while hydrogen production is achievable, the energy efficiencies observed within this dataset remain significantly higher than the established literature benchmarks. The decision to incorporate these performance indicators hinges on the fact that a pilot experimental setup can only be scaled up if it is economically viable and profitable.
Furthermore, in this study, the preliminary analysis of the mined data yielded critical insights into the SMR process. While, valuable for comprehending process dynamics and identifying key variables, its inherent scale mismatch, restricted parameter space, and substantial efficiency gap of energy consumption metrics relative to industrial benchmarks pose challenges for making reliable predictions in large-scale industrial contexts. The neural network models developed—FNN, BNN, and hybrid BNN (or H-BNN), using the dataset, only excelled at interpolating within the observed experimental ranges. Therefore, it would be better to prioritize expanding the dataset to encompass scenarios that are more closely aligned with industrial-scale optimal efficiency, thereby enhancing the predictive capabilities and direct applicability of such models for industrial purposes.
As shown in
Table 5 SEC and MoH show moderate correlation of
. This fairly demonstrates or implies the energy cost of producing hydrogen gas in the SMR process. Furthermore, the preliminary data analysis on steam methane reforming via induction heating shows the following:
- (A)
From the correlation matrix in
Table 5, a strong negative correlation between Methane Conversion Efficiency (Y
H2) and SEC (
) or MoH (
), indicates that a higher efficiency lowers specific energy consumption. The high values observed for SEC can be attributed to the following:
- (I)
Thermal dissipation of auxiliary components, such as gas separation and purification units, heat exchangers, and preheaters.
- (II)
Studies have indicated that processes exhibiting greater hydrogen selectivity generally require less energy per unit of hydrogen generated, because there is a reduced need for further separation, recycling, or downstream processing to refine the hydrogen product. Conversely, this efficiency is not consistently achievable for innovative technologies in the experimental or pilot stages. Therefore, the hydrogen yield or selectivity from effluent gases such as carbon monoxide (CO), unconverted methane (CH
4), oxygen (O
2), carbon dioxide (CO
2), nitrogen (N
2), unused steam (H
2O), and soot (carbon black) may incur high thermal costs in such scenarios. Overall, maximizing methane conversion is crucial for reducing energy consumption per unit of hydrogen [
28,
29].
- (B)
From
Table 5, F (mL/h) and SEC (kWh/kg H
2) reveal a low but positive correlation of ∼0.456, suggesting higher flow rate cuts specific energy consumption or use, as expected.
- (C)
In addition, time on surface (TOS) and flow rate (F) were strongly positively correlated with the mass of hydrogen (MoH) produced, with approximate values of ∼ and ∼, respectively, which was also expected for total production.
- (D)
In summary, the correlation analysis presented in
Table 5 along with the binned analyses shown in
Table 6 indicate that a greater magnetic flux, particularly within the (21–30) × 10
−3 T range, and enhanced methane conversion efficiency are consistently linked to better energy efficiency as the SEC is reduced.
The dataset used in this study typically indicates a significantly inefficient steam methane reforming operation, which is considerably lower than industrial standards. In laboratory or pilot-scale scenarios, heat losses are often more pronounced than in industrial facilities, leading to a higher specific energy consumption (SEC) for each mole of liberated hydrogen. Therefore, the efficiency of methane conversion is critical for enhancing energy usage. Additionally, information regarding magnetic flux (B), which is one of the key factors for induction heating, shows the optimal conditions for heating. Finally, based on the extracted data,
Table 7 lists the most energy-efficient operating point (lowest SEC).
Table 5.
Correlation Matrix of Key Parameters (Balanced Split View). (A) Correlations between operating and output variable; (B) Correlations between operating and output variable.
Table 5.
Correlation Matrix of Key Parameters (Balanced Split View). (A) Correlations between operating and output variable; (B) Correlations between operating and output variable.
| (A) |
| | p (W) | B (mT) | F (mL/h) | TOS (h) |
| p (W) | 1.000 | 0.207 | 0.978 | 0.773 |
| B (mT) | 0.207 | 1.000 | 0.120 | 0.106 |
| F (mL/h) | 0.978 | 0.120 | 1.000 | 0.789 |
| TOS (h) | 0.773 | 0.106 | 0.789 | 1.000 |
| (%) | −0.367 | −0.337 | −0.359 | −0.344 |
| SEC (kWh/kg H2) | 0.495 | 0.204 | 0.388 | 0.492 |
| MoH (g) | 0.881 | 0.109 | 0.901 | 0.895 |
| (B) |
| | TOS (h) | (%) | SEC (kWh/kg H2) | MoH (g) |
| p (W) | 0.773 | −0.367 | 0.495 | 0.881 |
| B (mT) | 0.106 | −0.337 | 0.204 | 0.109 |
| F (mL/h) | 0.789 | −0.359 | 0.388 | 0.901 |
| TOS (h) | 1.000 | −0.344 | 0.492 | 0.895 |
| (%) | −0.344 | 1.000 | −0.658 | −0.210 |
| SEC (kWh/kg H2) | 0.492 | −0.658 | 1.000 | 0.306 |
| MoH (g) | 0.895 | −0.210 | 0.306 | 1.000 |
Furthermore, it can be inferred that the potential causes of high specific energy consumption (SEC) per hydrogen yield at laboratory, pilot, or modular scale may include:
- (A)
Catalyst deactivation which can result in poor reaction kinetics.
- (B)
Unconverted methane, which could also lead to a lower hydrogen yield and, ultimately, a higher SEC.
- (C)
Carbon deposits or formation on the catalyst surface or bed void, which in turn can cause blockage and further inefficiency, leading to a higher SEC.
- (D)
The heat loss in the reactor system is significant at small scales, where heat integration is less efficient.
- (E)
Inefficient reactor design may lead to suboptimal heat and mass transfer, which subsequently affects the SEC values.
- (F)
Energy losses occur in auxiliary devices, such as compressors or pumps.
Table 6.
Binned Analysis of SEC by Magnetic Flux (B (mT)).
Table 6.
Binned Analysis of SEC by Magnetic Flux (B (mT)).
| B – Bin | Mean | Median | Min | Max | Count |
|---|
| 0–10 mT | – | – | – | – | 0 |
| 11–20 mT | – | – | – | – | 0 |
| 21–30 mT | 4415.47 | 4844.42 | 3151.43 | 5568.20 | 36 |
| 31–40 mT | – | – | – | – | 0 |
| 41–50 mT | 5018.06 | 4806.87 | 3855.66 | 8708.56 | 70 |
| 51–60 mT | – | – | – | – | 0 |
Table 7.
Most Energy-Efficient Operating Point (Lowest SEC).
Table 7.
Most Energy-Efficient Operating Point (Lowest SEC).
| Parameter | Value |
|---|
| p (W) | 650 |
| B (mT) | 28.5 |
| F (L/h) | 3 |
| TOS (h) | 0.5 |
| MoH ( kg) | 0.0351 |
| SEC (kWh/kg H2) | 3151.43 |
| 68.98 |
4. Result and Discussion
The mined datasets obtained from the literature, whose works were aligned with the study, were used to develop the proposed neural networks: hybrid BNN (or H-BNN), classic BNN, and FNN. As illustrated in
Figure 5, the datasets were curated and prepared to train the models, as shown in the workflow. The prepared dataset was divided into ratios of 70%, 15%, and 15% for the Training, Validation and Testing sets. Code execution was carried-out on a local machine equipped with an Intel Core Ultra 7 155H processor (16 cores, 22 threads, up to 4.8 GHz), 32 GB LPDDR5x RAM, and an NVIDIA GeForce RTX 4050 GPU with 6 GB of dedicated memory. Furthermore, Google Colab was deployed using a PyTorch-based Python environment (Python 3.x), with gradient computations performed via automatic differentiation and GPU acceleration enabled via CUDA when available.
The hybrid Bayesian Neural Network (H-BNN) was trained on a dataset extracted from the literature (see
Table 2), which originated from different experiments on steam methane reforming (SMR) via induction heating. In addition, the experimental designs for the respective referenced studies based on SMR were on different scales based on the information provided in
Table 2, such as the length and diameter of the reactor and other important variables. Furthermore, in this study, six (6) most important variables—temperature (T), pressure (P), flow rate (F), hydrogen yield (Y), power input (p), and time on stream (TOS) were considered in the training of the H-BNN, as shown in Algorithm A1, MoH was considered the target variable for predicting hydrogen production in SMR. Moreover, as illustrated in the workflow in
Figure 5, the classic Bayesian Neural Network (BNN) and Feedforward Neural Network (FNN) were deployed to serve as a “sanity check” on the proposed hybrid BNN.
The post-processed H-BNN results in
Table 8 further show that in addition to predicting MoH, other meaningful trends such as hydrogen yield and specific energy consumption (SEC) across the augmentation scales of
, 5, and 10 could also be obtained.
As shown in
Table 9,
Table 10 and
Table 11, the scaling factor
k significantly impacted training performance. The H-BNN achieved the best trade-off compared to classic BNN and FNN models. This stems from H-BNN’s effective combination of FNN’s deterministic power and Bayesian uncertainty quantification, at lower computational cost than classic BNN.
Furthermore, as shown in
Table 12,
Table 13 and
Table 14, the H-BNN, BNN, and FNN predictions of the hydrogen mass across the activation functions (GeLU, ReLU, and Tanh) highlight the predictive efficiency of H-BNN. Notably, reducing
k from 10 to 2 reveals the capacity of H-BNN in terms of predictiveness and robustness within data-scarce scenarios, even with a training set of 70% of data points, balanced validation (15%), and test (15%) sets (See
Figure 6,
Figure 7 and
Figure 8).
The graphical comparisons presented in
Figure 6,
Figure 7 and
Figure 8 indicate that all three neural network models achieved rapid convergence during training. However, variations in convergence behavior and predictive quality were observed across different augmentation scales. Generally, the FNN and BNN demonstrated smoother and more stable loss trajectories, whereas the H-BNN exhibited a noisier negative log-likelihood profile, particularly at
and
. This behavior aligns with the stochastic optimization characteristic of the H-BNN and the increased complexity of learning both the predictive mean and uncertainty structure from a limited dataset sourced from the literature. Nonetheless, the parity plots reveal that the H-BNN remained the most competitive architecture overall, with its most pronounced relative advantage manifesting under the lower-data condition at
.
At , the H-BNN (GELU) demonstrated superior predictive performance among the models presented, achieving a mean absolute error (MAE) of g, a mean squared error (MSE) of g2, and an value of . In comparison, the FNN (ReLU) recorded values of g, g2, and , whereas the BNN (ReLU) exhibited g, g2, and , respectively. The parity plot for the H-BNN at this scale is notably closest to the ideal line, and the low-MoH inset further corroborates that the model maintained a high fidelity in the low-production region. Furthermore, the H-BNN achieved a coverage of , which, although still below the nominal calibration, surpassed the corresponding BNN coverage of . These findings suggest that the proposed H-BNN is particularly effective when the amount of augmented training information is limited.
At , the comparative trend continued to favor the H-BNN, although the margin of improvement reduced. In the presented comparison, the H-BNN (Tanh) achieved a Mean Absolute Error (MAE) of g, a Mean Squared Error (MSE) of g2, and an of , surpassing the performance of the FNN (ReLU), which recorded g, g2, and , as well as the BNN (ReLU), which recorded g, g2, and . The parity plot for the H-BNN once again demonstrated the closest alignment with the ideal line, particularly for the higher MoH points, despite a noticeably noisier loss history. This indicates that the stochasticity observed in the H-BNN training curve did not result in a suboptimal predictive performance for the test set. However, the quality of uncertainty remained limited, with a coverage of , suggesting that the predictive intervals were still under-calibrated despite the strong accuracy of point predictions.
At , the H-BNN (Tanh) demonstrated superior performance among the models presented, achieving a Mean Absolute Error (MAE) of g, a Mean Squared Error (MSE) of g2, and an value of . In comparison, the FNN (GELU) recorded values of g, g2, and , whereas the BNN (GELU) achieved g, g2, and . Furthermore, the H-BNN exhibited the highest interval coverage at this scale, with a coverage of , whereas the BNN (GELU) displayed significantly lower uncertainty performance, with only coverage. Despite the H-BNN’s loss curve being more irregular than those of the FNN and BNN, its parity plot and summary metrics confirmed its superior predictive performance among the models depicted in the figure.
The post-processed results of the H-BNN, as detailed in
Table 8, further substantiate that the model successfully preserved physically meaningful trends in the predicted mass of hydrogen (MoH), hydrogen yield, and specific energy consumption (SEC) across the examined augmentation scales of
, 5, and 10. Notably, the predicted MoH values remained closely aligned with the corresponding true values for all cases, with only minor deviations observed across the three augmentation conditions. For instance, under the first operating condition, the true MoH of
g was predicted as
g,
g, and
g for
, 5, and 10, respectively, indicating a stable model response to the augmentation scale. Similarly, for the third operating condition, which corresponds to the highest MoH level among the listed cases, the H-BNN predicted
g,
g, and
g relative to the true value of
g, thereby demonstrating a consistent predictive behaviour even in the higher-production regime.
A comparable trend was observed for the hydrogen yield and specific energy consumption (SEC). The predicted hydrogen yield values were generally marginally higher than the corresponding actual values, indicating that the H-BNN could capture the anticipated production trend while slightly overestimating the conversion performance in certain instances. For instance, under the second operating condition, the actual hydrogen yield of increased to predicted values of , , and for , 5, and 10, respectively. Concurrently, the SEC predictions were slightly lower than the actual values, suggesting that the model tended to predict more energy-efficient hydrogen production than that empirically observed. Notably, the predicted SEC for the fifth operating condition decreased from the actual value of kWh kg−1 H2 to , , and kWh kg−1 H2 for , 5, and 10, respectively. Overall, the relatively minor variation in the post-processed outputs across the three augmentation scales suggests that the H-BNN maintained robust predictive consistency, with the strongest overall point-prediction performance still observed under the lower-data condition, particularly at .
In general, graphical and numerical analyzes demonstrate that the H-BNN architecture exhibits superior competitiveness under conditions of reduced data, with its most pronounced relative advantage observed at . Concurrently, the model maintained robustness across the examined augmentation scales and upheld physically coherent trends in MoH, hydrogen yield, and SEC. These results confirm the appropriateness of the H-BNN as a data-driven predictive framework for hydrogen-production modelling using limited and heterogeneous datasets derived from the literature.
5. Conclusions
This study introduces a hybrid Bayesian neural network (H-BNN) to predict hydrogen production from literature-derived datasets with limited, heterogeneous observations across experimental designs. The model was trained, validated, and tested on a curated dataset featuring key operating variables: temperature, flow rate, catalyst/bed loading, power input, and time on stream (TOS). These inputs enabled accurate mass of hydrogen (MoH) predictions. The H-BNN delivered robust point predictions across augmentation scales. Moreover, data augmentation improved generalization, with H-BNN showing the greatest relative advantage under low-data conditions, particularly at k = 2 as discussed previously.
The procedure for deploying the H-BNN model is described in detail. Across the evaluated augmentation scales, the H-BNN achieved high predictive accuracy, with values of approximately 0.997, 0.989, and 0.992 for , , and , respectively, for the validation-selected models. Correspondingly, the model yielded MAE values of 0.0126 g, 0.0207 g, and 0.0217 g, respectively, which correspond to errors on the order of kg. These results affirm that the proposed H-BNN is highly effective for hydrogen-production prediction under data-scarce conditions, particularly when compared with the benchmark FNN and BNN models. However, although the H-BNN improved the predictive uncertainty representation relative to the classical BNN, the uncertainty intervals remained below the nominal calibration across the investigated cases and should thus be interpreted as informative, rather than fully calibrated.
Finally, the Monte Carlo dropout component in the H-BNN model captures the predictive uncertainty, providing a valuable basis for robust data-driven inference. The post-processed results further demonstrated that the H-BNN was capable of recovering physically meaningful trends not only in MoH but also in hydrogen yield and specific energy consumption (SEC), as shown in
Table 8. Accordingly, depending on the nature and size of the available dataset, the proposed model has the potential to be extended to predict other output variables, such as SEC and emission-related indicators, in the context of steam methane reforming powered by induction heating.