1. Introduction
In recent years, fractional calculus has been increasingly used to solve and more precisely model the dynamic behaviors of the systems [
1]. Therefore, fractional calculus has found widespread application in solving real-world problems across various fields such as power and energy systems, materials science, electronics, signal processing, and control systems. This broad range of applications has been clearly demonstrated in recent studies. For example, fractional calculus has been employed in diverse areas, ranging from the investigation of adsorption phenomena and complex fluids in physics [
2] to the analysis of efficiency behavior in system dynamics environments [
3]. In the context of power and energy systems, the advantages of fractional calculus have been utilized in intelligent controller designs for wind energy applications [
4,
5] and in the generalized modeling of electrohydraulic systems [
6]. In the field of signal processing, it has been applied to fundamental image-processing tasks [
7] and the analysis of non-stationary signals [
8]. Furthermore, in materials science, it has been used to describe the rheological models of viscoelastic materials [
9], while in electronics, it has provided effective solutions for thermal impedance modeling of IGBT devices [
10] and for the control of electric springs [
11]. Fractional calculus is also used in real-world applications, especially in cases where sensitivity and accuracy are essential. For example, I. Pataro et al. developed a fractional-order PID controller based on fractional calculus to control a solar collector field system [
12]. Another example from the health domain is the fractional-order SEIHR-M model proposed by Rui Hu et al. for investigating the transmission dynamics of COVID-19 in Malaysia [
13]. Fractional calculus is used to solve complex mathematical models in disciplines such as physics, chemistry, and biology, to improve the accuracy of deep learning models, and to simulate system behavior in electrical engineering. To illustrate the efficiency of fractional calculus on neural networks, C. Coelho et al. presented a survey of neural network-based computer vision techniques for denoising, enhancement, object detection, segmentation, and restoration [
14]. Also, X. Zhang et al. address the discrepancies in electric spring (ES) models by establishing a fractional-order ES model based on the fractional-order characteristics of inductors and capacitors, analyzing its operational features, and proposing a fuzzy adaptive fractional-order PI
λD
μ control strategy to enhance the system’s control performance [
15]. Moreover, M. Higazy et al. construct a novel 6D fractional-order chaotic model, analyze its complex dynamics and fundamental properties, and propose an active fractional-order controller for chaos control, with potential applications in data encryption [
16]. In addition, AF. Mohammed et al. propose a novel Hybrid Intelligent Fractional-Order Proportional Derivative2+Integral (FOPDD+I) controller for Automatic Voltage Regulation (AVR) systems, which leverages Adaptive Neuro-Fuzzy Inference System (ANFIS) to optimize performance and achieve superior transient response compared to conventional methods [
17]. The success of fractional calculus in real-world applications depends on how well these applications minimize errors and how realistically accurate models can be created.
Fractional-order (FO) operators generalize classical integer-order derivatives and integrals by allowing the order to take non-integer values. FO derivative operator introduces a frequency-dependent phase lead, which enables finer tuning of phase margin and damping, reducing overshoot while preserving amplitude characteristics. FO integral operator provides frequency-dependent gain and phase lag, improving low-frequency response and steady-state performance compared to classical integer-order integrals. These properties make FO operators highly effective for frequency–response shaping and precise control design, offering flexibility not achievable with integer-order operators alone. For example, in practical control applications, FO derivative operators can improve phase margin, reduce overshoot, and provide better frequency–response shaping compared to classical integer-order derivatives.
Although FO modeling provides more accurate results, one of the most important problems encountered is that FO derivative/integral operators cannot be realized directly [
18,
19]. To realize an FO derivative/integral operator, the FO transfer function is approximately converted into an integer-order approximate model in a defined frequency interval, and for this, approximation methods such as Oustaloup, Matsuda, Modified Stability Boundary Locus (MSBL), etc., are used [
18,
20,
21,
22,
23,
24]. However, since each of these methods is an approximation method, it is inevitable that a difference, i.e., an error, will occur between the real responses and the time and frequency response obtained by the approximation method during the realization. It is crucial to minimize the error for more accurate realization performance [
25,
26].
In this study, it is aimed at increasing the accuracy and efficiency in the realization of FO operators. Thus, an optimization method is applied to minimize the nonlinear multi-variable error functions which are based on the difference between the approximate frequency response obtained by the MSBL method and the analytical frequency response in a defined frequency range. In the first stage, analytical frequency response and MSBL approximation method-based frequency response are obtained for the FO derivative operator in a defined frequency interval. In the second stage, the cost function, which includes the difference between the analytically obtained frequency response and the approximation-based frequency response, is minimized by using FMINCON optimization algorithms, and an optimized integer-order transfer function is obtained. FMINCON minimizes an objective function under certain persistence, finds the minimum of constrained nonlinear multi-variable optimization function and optimizes the approximate integer-order transfer function obtained by MSBL method. The optimization algorithm used in FMINCON method was Sequential Quadratic Programming (SQP) in this study. In the third stage, considering an FO derivative operator, to evaluate the performance of the optimization results, the frequency and time responses based on approximation methods and the proposed method are analyzed in comparison with those of analytical responses. The RMSE and MAPE error comparisons are presented in tables. Furthermore, the real-world applicability and accuracy of the optimized transfer function for an FO derivative operator are successfully simulated in Vitis Model Composer Hub and experimentally implemented on an FPGA.
As a result, the proposed method provides a notable improvement in the frequency accompanying with a slight enhancement in the time response in general. The FMINCON method is employed for the first time in this study to enhance the approximate integer-order transfer function of an FO operator. The coefficients of the approximate transfer function obtained by the MSBL method for the derivative operator in a defined frequency range are taken as initial values, and then these coefficients are optimized using the FMINCON method. The proposed method minimizes the cost function and obtains a slightly modified approximate integer-order transfer function that exhibits more accurate convergence performance in the frequency response. It is observed that FMINCON is an applicable and promising method to optimize the frequency responses of approximate integer-order transfer function of the MSBL approximation method. However, one can apply this optimization to any other approximation method to improve the approximation performance. The proposed approach was applied to an FOPID controller and an FO low pass filter to compare the performance of the method with other approximation methods. The frequency and time responses are obtained, and comparative graphical analysis is performed. According to the comparative analysis, it has been concluded that the frequency-based optimization yielded satisfactory results in the realization of FO circuits. The main contribution of the study can be explained briefly as follows: to the authors’ knowledge, this study is the first to implement a frequency response-based optimization method for FO functions. This method can be generalized to other approximation methods, and more effective FO circuit performance can be observed, especially in applications where frequency response accuracy is important.
2. Materials and Methods
In this study, the fifth-order approximate continuous-time transfer function for FO derivative operator was obtained in a defined frequency interval by using MSBL approximation method. Then, the exact frequency response and frequency response based on MSBL approximation method were graphically illustrated. To minimize the difference between the exact and approximate frequency responses, a cost function based on the error between exact and approximate response was obtained. Then, the coefficients of the approximate transfer function were optimized and slightly modified using FMINCON nonlinear-constrained optimization method. The frequency response based on the proposed method is compared with exact frequency response and approximation-based frequency responses. RMSE and MAPE error values are presented as tables. In addition, it has been checked whether the improvement in the frequency response causes any deviation in the time response. Then, the optimized transfer function was realized on an FPGA board to check the applicability. Also, the specified method was applied to an FO low pass filter and an FOPID controller, and the results were analyzed comparatively.
2.1. Determination of Approximate Transfer Functions for Derivative Operator
In this study, the proposed optimization is applied to the integer-order transfer function obtained by MSBL approximation method in a defined frequency range. So, this approximation method was briefly explained. The MSBL approximation method provides a systematic approach for representing FO operators with integer-order transfer functions. The MSBL approximation process begins by selecting the desired frequency interval, typically denoted as [ωmin, ωmax], over which the approximation is to be valid. The order of the approximation, n, is then chosen based on the required accuracy and implementation complexity. For an nth order approximation, the method systematically places the poles and zeros of the integer-order transfer function on the real axis in the complex frequency domain. These poles and zeros are distributed logarithmically across the selected frequency range to ensure a uniform approximation quality.
Mathematically, the approximate transfer function for the fractional derivative operator
using the MSBL approximation method can be expressed as
where
is a gain factor, and
and
represent the zeros and poles, respectively. The poles are typically determined as
The zeros are then calculated as
The gain
K is adjusted to ensure that the magnitude of the approximate transfer function matches the original operator at a reference frequency, often chosen as the geometric mean of the frequency range [
18].
Additionally, in-depth information about FO approximation methods such as MSBL, Oustaloup, and Matsuda is presented in the literature [
27]. To provide a clear comparison, the core principles of the MSBL, Oustaloup, and Matsuda methods, which are also considered in this study, are briefly introduced. The Oustaloup approximation, often implemented as the Oustaloup Recursive Approximation (ORA) filter, also approximates the sα operator using a filter of N poles and N zeros within the specified frequency range [ω
min, ω
max]. Its defining characteristic is the use of a recursive geometric progression to determine the locations of these poles and zeros. This recursive placement is specifically designed to achieve a transfer function that approximates the constant magnitude slope (in dB/decade) and, critically, the constant phase (in degrees) of the ideal fractional operator within the specified band [
27,
28]. The Matsuda method, in contrast, is a frequency-domain fitting technique. It approximates the operator by logarithmically spacing several frequency points within the target range and performing a least squares fit to match the gain and phase of the ideal operator, sα. This method systematically determines the poles, zeros, and overall gain of the integer-order transfer function (Equation (5)) to best match the frequency–response characteristics of the ideal operator, and it is often noted for its high accuracy in the frequency domain [
27].
Therefore, while all three methods (MSBL, Oustaloup, and Matsuda) aim to produce a stable, rational integer-order transfer function, their core difference lies in the pole–zero placement strategy: MSBL uses a direct logarithmic distribution, Oustaloup uses a recursive geometric progression to maintain a flat phase response, and Matsuda uses a direct frequency–response fitting algorithm. As noted, in-depth analyses and derivations of these methods are available in the literature.
Using the mentioned FO approximation methods, different integer-order transfer functions can be obtained. The general expression of the approximate transfer function for an FO operator can be written as follows:
where the FO of the operator is α, and it is a real number between 0 and 1. The derivative operator takes a positive value in the notation; on the other hand, the integer operator takes the negative value. Also, n is the order of approximation method. The numerator polynomial coefficients A = [r
n r
n−1 r
n−2…r
2 r
1 r
0] and the denominator polynomial coefficients B = [p
n p
n−1 p
n−2…p
2 p
1 p
0] are calculated by several FO approximation methods to achieve a band limited frequency domain approximation to the FO element
.
The 5th order approximate transfer functions for the FO derivative operator s
0.5 were obtained for the frequency interval of [0.01, 100) rad/s by considering the MSBL, Oustaloup, and Matsuda approximation methods as follows:
2.2. Application of FMINCON Method to Optimize the Transfer Function Coefficients for Frequency Response Optimization
Optimization methods are crucial for improving transfer functions to ensure that the system model behaves as closely as possible to its intended dynamics. Especially in FO complicated systems, coefficients derived from theoretical approximations may not directly provide the desired performance due to numerical rounding errors and practical implementation limitations. In these cases, optimization algorithms minimize the error function and enable the most appropriate coefficients to be found in terms of amplitude, phase, and stability criteria.
The approximate error functions denoting the difference between the analytical and approximate values for phase (
) and magnitude (
) responses are defined, respectively, as
where
is the numerator and denominator coefficient vector that is optimized, m represents the number of sampling points in the defined frequency range. To obtain an accurate model, a logarithmic distribution of 1000 different solution points in the frequency range of 0.01 rad/s to 100 rad/s was considered. In this expression,
is calculated in degree as
, and
is calculated in dB as
.
is the approximate phase value calculated based on the 5th order FO approximation method, and
is the approximate magnitude value calculated based on the 5th order FO approximation method.
The cost function, which will be minimized by using FMINCON method, is written as
where
and
are the weight coefficients for phase and magnitude, respectively. The weight coefficients were selected empirically;
was set to 0.1 and
was set to 2.
The FMINCON function in MATLAB 2025b is a powerful tool for solving constrained optimization problems. This function can handle nonlinear constraints and generally find solutions using different algorithms such as the Interior Point Algorithm, the SQP algorithm, the Active Set Algorithm, and the Trust Region Reflective Algorithm [
29,
30,
31,
32]. The FMINCON-based optimization refines the coefficients of the 5th order transfer function through constrained nonlinear minimization of a weighted multi-objective cost function that combines magnitude and phase errors. By iteratively adjusting the pole–zero locations within feasible physical boundaries, the algorithm ensures that the approximated model reproduces the true system’s dynamic behavior more accurately. This process enhances the alignment between the model’s and the exact system’s natural frequencies and damping ratios, resulting in a more physically consistent frequency response.
In this study, the SQP algorithm, which is based on a quadratic approach to solving the optimization problem iteratively, is used because it is one of the most effective methods aimed at solving nonlinear problems in constraints [
30,
33]. The nonlinear multi-variable cost function combines weighted magnitude and phase errors, both of which depend nonlinearly on the model parameters through the polynomial structure of the transfer function. Consequently, the cost surface is smooth but nonconvex, with multiple local minima corresponding to different pole–zero configurations. FMINCON’s SQP approach efficiently explores this landscape and converges to the parameter set that yields the minimum combined error while maintaining the system’s physical realizability. MATLAB’s FMINCON function with the SQP algorithm was employed to solve the constrained nonlinear optimization problem for the frequency response of the approximate FO operator. SQP iteratively approximates the problem by solving a quadratic subproblem at each step, linearizing constraints, and updating the coefficients along a search direction that reduces a combined merit function [
34]. This process continues until convergence to a solution that satisfies the Karush–Kuhn–Tucker (KKT) conditions, resulting in the optimized coefficients of the fifth-order transfer function [
35].
To optimize the frequency response of the FO operator, firstly, the cost function given in Equation (11) is determined. Then, this cost function is optimized by FMINCON method. Following the multi-variable optimization based on a weighted multi-objective cost function, the coefficients of the 5th-order transfer function are fine-tuned in a coupled manner to minimize magnitude and phase errors. This coordinated correction reshapes the pole–zero distribution rather than merely altering numerical values, leading to a model that more accurately reproduces the system’s natural frequencies, damping ratios, and overall dynamic response. Thus, both amplitude and phase characteristics are improved while ensuring the stability and physical realizability of the system. At the end of the optimization, a new transfer function, whose coefficients have slightly changed compared to the transfer function obtained by MSBL approximation method, is obtained.
As a result, the optimized approximate MSBL transfer function was obtained as follows:
Also, this transfer function can be decomposed by using the partial fraction expansion (PFE) method as
Each rational expression in this equation represents a first-order LPF, and the rightmost constant represents the gain factor. To improve numerical stability and minimize coefficient quantization effects, the continuous-time 5th order transfer function was expressed as the sum of five first-order components using partial fraction expansion. Each first-order section was converted to discrete-time function via the Tustin method and implemented in parallel on the FPGA. This approach significantly enhances numerical robustness, as the stability of each section can be individually verified and maintained within the unit circle.
2.3. Digital Realization on FPGA
To realize the continuous-time transfer function on an FPGA in digital form, it is necessary to convert the continuous-time transfer function to a discrete-time transfer function. Various conversion methods are available for this purpose, including zero-order hold (ZOH), first-order hold (FOH), impulse-invariant mapping, Tustin approximation (bilinear transform), zero–pole matching, and least squares approaches. Each method offers its own set of strengths and limitations, and the choice of a suitable method is governed by the particular requirements of the system under study and the characteristics of the input signals [
36,
37,
38,
39]. In this study, all the methods mentioned above were tested in MATLAB. It was found that, for the transfer function under consideration, the Tustin method with a sample time of 10 ms yields relatively better error rates within the defined frequency range.
When the optimized continuous-time approximate transfer function given in Equation (13), which represents the main transfer function as a sum of first-order low pass filter form, is converted into a discrete-time transfer function using the Tustin method in MATLAB, the resulting function in the z-domain is obtained as follows:
Each rational part of Equation (14) can be represented as a difference equation as shown in the following example, in which the first rational component of Equation (14) is written as a difference equation:
Each rational term in the transfer function relies on both present and past input values, as well as previous output values, and is therefore implemented as a sum of Infinite Impulse Response (IIR) filters. In this work, each first-order IIR filter is implemented in the Direct form I structure as depicted below.
Figure 1 provides a design example for the first rational component on the right-hand side of Equation (14).
Equation (14) represents the combination of five distinct IIR filter equations along with a static gain of 20.6626. This equation is implemented in Simulink as the sum of IIR filters using the Vitis Model Composer Hub system generator tool (the official website:
https://www.xilinx.com/products/design-tools/vitis/vitis-model-composer.html, accessed on 8 October 2025). The tool generates the corresponding IP core for the function, which is then utilized in the Vivado Design Suite for synthesis, Register Transfer Level (RTL) analysis, implementation, and bitstream generation for deployment on the FPGA device. The overall process is illustrated in the block diagram shown in
Figure 2.
The Vitis Model Composer Hub system generator, developed by Xilinx Inc. from San Jose, CA, USA, enables the implementation of FPGA applications through a model-based design approach within MATLAB Simulink [
40]. This tool operates by providing a dedicated digital signal processing (DSP) block set tailored for Xilinx devices within the Simulink environment, allowing designers to construct models according to specific design requirements.
In this work, a subsystem block is used for each rational component (IIR filter) contained in the transfer function, and these subsystems are integrated with pre-configured adder blocks. Gateway blocks are used to facilitate communication between Simulink and FPGA blocks [
19,
41].
4. Conclusions
In practical applications of FO systems, because the FO operator cannot be implemented directly, frequency-domain approximation methods are often used to represent the FO transfer functions with integer-order approximate ones. For a more accurate implementation, it is crucial that the frequency responses based on the integer-order transfer functions obtained by these methods greatly agree with the analytically obtained responses. To enhance reliability and minimize errors, FMINCON optimization algorithm is applied to the cost function that considers the difference between analytically obtained frequency response and the frequency response of the integer-order transfer function obtained by the MSBL approximation method. The frequency–time responses of the optimized approximate transfer function were comparatively analyzed by considering the analytically obtained frequency–time responses and the frequency–time responses based on the MSBL, Oustaloup, and Matsuda approximation methods. Also, quantitative metrics such as RMSE and MAPE were employed to evaluate the approximation performance of the methods considered in both frequency and time domains. As a result of the optimization, a new transfer function, whose coefficients have been slightly modified, is obtained. This method was applied to an FO operator, an FOPID controller, and an FO low pass filter to check whether the predicted improvement in the realization performance was achieved. Application results have revealed that the proposed method generally resulted in expected improvements in the frequency response. Such improvements in the frequency response are particularly valuable for achieving optimal control performance in FO control systems. Additionally, the time responses for the FO operator and the FOPID controller were investigated, and it was observed that the proposed method did not have a salient negative effect on the time response but rather provided a small improvement in the time response in general.
Furthermore, to show the practicality and make a comparative analysis, the fifth-order approximate transfer functions based on the MSBL, Oustaloup, Matsuda approximation methods, and the proposed method, were digitally implemented for the derivative operator s0.5 on an FPGA using the Vitis Model Composer Hub system generator block within the MATLAB Simulink environment. The results of the FPGA implementation confirmed the effectiveness of the proposed method by exhibiting good agreement with the analytical frequency response in the defined frequency range. Following the realization in simulation environment, the optimized transfer function was experimentally implemented on a Nexys 4 DDR Artix-7 FPGA (XC7A100T). It was observed that the FPGA implementation and simulation results were in good agreement with each other when the gain and phase shift are considered at the operating frequency. The agreement confirms that FPGA provides high accuracy and reliability in replicating the dynamic behavior in the specified frequency range.
These findings demonstrate that applying an optimization method immediately after applying any integer-order approximation method to an FO system and then proceeding with the implementation will increase the accuracy and reliability of the implementation. The proposed FMINCON-based optimization is not specific to the MSBL method and can be generalized for other methods. It can also be directly applied to other FO approximation methods, such as Carlson, CFE, Oustaloup, etc., to improve their frequency responses. At this point, it is crucial to carefully select the optimization method to be applied.