An Optimal Framework for WDM Systems Using Analytical Characterization of Refractive Index-Related Nonlinear Impairments

Abstract

Nonlinear effects in the optical transmission systems (OTSs) are considered as the major performance limiting factor to provide high transmission rates over ultra-long distances. As the demands for system capacity, transmission range and the number of users is increasing exponentially with the development of mobile broadband, new challenges are being faced by the backbone optical networks. Mainly, the refractive index related non-linearities (RIrNLs) need to be characterized to design an optimal OTS for error-free transmission with provision of wavelength division multiplexing (WDM) to support for multiple channels. This paper provides an estimation technique of RIrNLs for long-haul transmission and their treatment for different channel spacing and the number of channels in a WDM system operating frequency domain multiple in multiple out (FD-MIMO) equalizer based digital signal processing (DSP) receiver and microstrip Chebyshev low pass filter. The main focus of this work is to utilize the existing structure of OTS for RIrNLs treatment with a low cost solution. Thus, by varying the parameters of the third order dispersion parameters, group velocity dispersion parameters, phase modulation dispersion and nonlinear refractive index, the impact of RIrNLs is investigated in detail to enhance the transmission range and capacity of the current OTS. The proposed system is analyzed in terms of range of input power, fiber length and received power for OTS figure of merits including bit error rate (BER) and optical signal-to-noise ratio (OSNR). Using duo-binary modulation, the BER achieved in this work is <${10}^{-5}$ till 500 km range, for maximum number of 32 channels, with 100 Gbps aggregate data rate, which shows the feasibility and effectiveness of our proposed model.

1. Introduction

Nonlinear effects in long haul optical transmission systems (OTSs) are the major limitations on the high capacity, long haul and ultra-reliable transmission [1]. The performance of a simple OTS is severly affected by the non-linear effects, which are developed when high capacity signals are communicated over extensive distances [2,3]. As a result, the performance is degraded, which leads to errors and data integrity issues. These nonlinear effects can be categorized into two types. The first is refractive index-related nonlinearities (RIrNLs), such as cross phase modulation (XPM) [4], self phase modulation (SPM) [5], and four wave mixing (FWM) [6]. The second type of non-linearities are scattering-related, which includes stimulated Raman scattering (SRS) [7] and stimulated berillouin scattering (SBS) [8]. The refractive index-related nonlinearities (RIrNLs) generate unwanted frequencies inside the optical medium, due to mixing of transmitted optical signals with each other or with the carrier wavelength during their propagation. Instead of using multiple fibers [9], the transmission of multiple data channels [10] is always desirable but the extra signals inside the single mode fiber (SMF) cause power penalty problems in long-haul cases because of the erbium doped fiber amplifier (EDFA) saturation in each transmission span and channel filtering at the receiver in a wavelength division multiplexing (WDM) system.

1.1. Related Work

The main features of OTSs are high capacity and long-haul transmission due to huge amount of available bandwidth and extremely low propagation loss. To ensure transmission integrity, a large volume of literature exists on treatment of channel effects. Some advanced contributions and their limitations are presented as follow. Digital signal processing techniques for compensating inter-and intra-channel fiber non-linearities have been investigated in [11], and input parameters such as launch power and fiber length are used to carry out simulation work. Self phase modulation (SPM) non-linear issue is investigated in [12] where conversion between different formats, such as 8-quadrature amplitude modulation (8-QAM) to quadrature phase shift keying (QPSK) and on off keying (OOK), is performed through optical methods to adapt to the channel conditions. Different values of optical signal-to-noise ratio (OSNR), optical power, and chromatic dispersion have been used to conduct analysis on the performance of the proposed system, however, the format conversion to a lower order results in decreased data rates. In [13], the authors discuss intermodel non-linear issues in few-mode fiber using 16-QAM up to 36 km transmission and report mitigation of the XPM non-linear effect. High cost components are used in [14], such as indium phosphate and silicon photonics to achieve high bandwidth in the presence of fiber non-linearities. The voltra-assisted method is explained in [15], in which the authors overcome the limitations of optical phase conjugation (OPC) technique. In [16], the authors mitigate nonlinearity for 92-channel 22.5 buad rate, using 16-QAM modulation format. Similarly, SPM and XPM nonlinear parameters are discussed in [17], implementing 16-QAM and 64-QAM super channels and advanced equalization procedures. In [18], linearly swept optical source methodology is developed for mitigating high order FWM effects. The impact of nonlinearity inside optical fiber is investigated by spectral efficient frequency division multiplexing (SEFDM) technique and the work is compared with orthogonal-FDM (O-FDM). In [19], nonlinear mitigation technique is reported for multi subcarrier PM-16-QAM using symbol rate optimization in 31 channel WDM system. In [20], the authors have explored nonlinear compensation mechanism with the help of multi-channel digital back propagation in Nyquist spaced optical communication system. However, the effect of RIrNLs still needs to be investigated, in terms of analytical characterization, to understand their effect to achieve an optimum mitigation solution, which is the main focus of our paper. Moreover, modern systems require multiplexing of several channels for which different parameters for a WDM based system need to be analyzed in this context. Therefore, we present a detailed analysis of RIrNLs and their treatment by varying input power, fiber length, channel spacing, and the number of channels. We present a WDM system with a 100 Gb/s aggregate data rate, which can support transmission distances up to 500 km, with 32 number of channels. The performance analysis has been conducted for a range of non-linear distortions. To the best of our knowledge, such performance has only been possible with the mathematically proposed mitigation technique for second and third order non-linearities.

1.2. Major Contributions

The major contributions of this paper are listed below.

• Transmission distances of up to 500 km have been used in this work and the corresponding nonlinear effects have been investigated.
• The proposed system is analyzed through an analytical and simulation model. The characterization is presented through a mathematical model and an optimal design is proposed using frequency domain-multiple in multiple out (FD-MIMO) equalizer and microstrip chedyshev low pass filter.
• The parameters used for simulation analysis include channel spacing, nonlinear refractive index, fiber length, input power, and nonlinear dispersion, to ensure a comprehensive analysis.
• The performance of the proposed model is quantified in terms of BER and OSNR, where these two parameters are achieved below ${10}^{-9}$ and above 25, respectively.
• FWM, XPM and SPM are reduced successfully till 500 km covered distance for channel spacing as low as 25 GHz and number of channels as much as 32.

The OptiSystem software package, used in this work for simulation investigations, provides a library of multiple optical components that enables users to plan, test, and simulate different types of OTSs. The modeling of end-to-end downlink transmission system in this paper has been performed by the characterization of each component, careful investigation of interdependencies among different components, modeling of noise for active components in the system and other considerations to realize a practical OTN. The varying refractive index response and intrinsic group velocity delay for SMF, and DSP block are modeled in MATLAB and integrated with the optisystem.

The remainder of this work is arranged as follows. Section 2 presents the proposed system model layout, followed by the description of analytical model in Section 3. Section 4 summarizes results and discussion of the presented system. Finally, the conclusion is presented in Section 5.

2. Proposed Model Layout

This section clarifies the framework of the proposed system and performance against RIrNLs. The increase in transmission channels gives rise to further distortion effects including channel-to-channel interference or beating noise, saturation of EDFA due to distribution of the overall transmit power to multiple channels, wavelength dependent chromatic dispersion interaction with several wavelengths as compared to the single channel. The WDM system is idealized by using 4 to 32 number of continuous wave (CW) laser sources to investigate the corresponding increase in non-linear effects due to the multiple channel transmission. An advanced duo-binary modulation technique is implemented at the transmitter side, whose function is to adjust the spectral width of the input optical signal, as presented in Figure 1. Each channel is modulated with a 3.125 Gb/s data rate signal which provides an aggregate data rate of 100 Gb/s for 32 numbers or channels.

Duo-binary modulation is implemented by using an electrical time delay line with an exclusive OR gate, which encloses pseudo-random binary sequence (PRBS) generator and uses two LiNb Mach–Zehnder modulators (MZMs) as a simulation model in Optisystem software. This model implements duo-binary modulator through a duo-binary precoder, an electrical subtractor, $\chi$, and delay, $\tau$, to generate duo-binary signal. After modulation from each channel, the data are multiplexed using dense wavelength division multiplexer (DWDM) which has −100 dB threshold noise and 3 dB dynamic noise. After multiplexing, optical signals are transmitted over SMF. Above 500 km, SMF is used with five spans of 100 km each. To minimize RIrNLs, linear dispersion and attenuation, each span is connected with EDFA and semiconductor optical amplifier (SOA). At the receiver, $R_x$, side, the data is de-multiplexed (DeMUX) and optical signals are converted to electrical form using avalanche photo diode (APD) with 1 A/W responsivity and $100\times {10}^{-24}$ W/Hz thermal power density. The gain of diode is maximized several times and enables greater sensitivity as compare to conventional photo diode (PD). The signal then proceeds to microstrip Chebyshev low pass filter to minimize the factors of chromatic dispersion (CD), and amplified spontaneous noise (ASE). The filtered signals are then purified from RIrNLs by employing limiting RF amplifier and enhanced DSP system. The proposed DSP receiver includes a FD-MIMO equalizer, synchronizing block to balance the flow of multiple received wavelengths and time domain equalizer (TDE) to support the phase behavior of the received signals. The internal procedure of FDE-MIMO equalizer is presented in Figure 2, employing overlap save technique. Moreover, 3R-regenerator component is installed for re-shaping, re-timing and re-amplification of the received signals, where they are linked to a BER analyzer to investigate the received pulse property. The list of parameters with their values for the simulation are described in

Table 1. Simulation parameters with their values and units.

Description	Magnitude
Reference wavelength	1550 nm
Attenuation	0.2 dB/km
Input power	−6 dBm to 6 dBm
Received power	−27 dBm to −16 dBm
Channel spacing	50 GHz to 200 GHz
Length of fiber	500 km
Nonlinear effective area	80 m${}^2$
Number of Channel	4–32
Nonlinear dispersion	−3 ps${}^3$/km

. As compared to [19,20,21], the authors have investigated the performance of duo-binary modulation for accumulative distortion effects caused due to transmission of large number of WDM channels over long-haul distances, while varying the wavelength dependent chromatic dispersion and refractive index of the optical fiber.

Refractive Index Related Non-Linearities

The induced non-linearities in optical systems are composed of two types; the first type relates to nonlinearities due to scattering phenomena [19], and the second type of nonlinearities are associated with refractive index of the optical fiber. The second type of nonlinearities are known as RIrNLs. FWM, XPM and SPM nonlinear factors are the main subparts of RIrNLS. A brief explanation of each nonlinear parameter is given below.

Four wave mixing (FWM) is an intermodulation incident that occurs inside an optical fiber [20], whereby interaction among the channel frequencies generate new unwanted frequencies, as shown in Figure 3. It is particularly important for WDM-based OTN, where multiple wavelengths travel through the same fiber. From Figure 3, it is clear that ${\vartheta }_{f00}$, ${\vartheta }_{f01}$, and ${\vartheta }_{f02}$ are induced unwanted pulses with original ${\vartheta }_{fii}$, ${\vartheta }_{fjj}$ and ${\vartheta }_{fkk}$ imparted optical signals, respectively. FWM nonlinearity is generated due to the third order susceptibility [21], when high power is launched to ensure the propagation of high capacity optical signals over long distances. The distortion caused by FWM is worse than the other two subtypes of RIrNLs.

Another phenomena which is important for WDM-based systems is the cross phase modulation (XPM) which happens due to variation in refractive index of the optical fiber along the transmission length. Phase shift in the optical pulse is induced due to alternating refractive index of the fiber as the signal travels through it. This phenomenon leads to a change in optical signal frequency spectrum as shown in Figure 4. This effect is directly proportional to the number of channels passing inside the SMF [22]. Figure 4 depicts that the output signal is disturbed due to XPM factor. As the number of channels in a WDM framework changes dynamically, an adaptive equalization is required to cancel the XPM influence on optical signals.

An associated kind of RIrNLs is the self phase modulation (SPM), caused due to the self modulation of an optical signal in a SMF. It leads to spectral broadening [23] and phase delay [24], as shown in Figure 5. Though it is not directly caused by the WDM transmission, the effect of SPM increases with the launched power levels and the optical pulse spreads and tends to overlap the neighboring optical channels. Consequently, a particular signal of interest is not distinguished by the receiver for WDM channels. Moreover, the penalty in power is also caused on account of SPM.

XPM, SPM and FWM are collectively addressed as RIrNs, because these are generated due to the variation in the refractive index. As these effects have strong contribution in degradation of a WDM system, the proposed model aims to minimize them through mathematical modeling and verification through simulations. Features, such as duo-binary modulation, channel spacing, nonlinear effective area and refractive index, and nonlinear dispersion are discussed in this paper to investigate RIrNLs. This section demonstrates the framework of the proposed work, while the next section concentrates on the analytical model and the proposed solution.

3. Analytical Modeling

The proposed system aims to maintain system fidelity for long distance transmission, system volume and data rates. This section presents a detailed analytical model for analyzing RIrNLs. The parameters which affect the amount of RIrNLs are cross-section area of SMF, amount of light intensity propagating through the fiber, number of channels in the WDM system, and data rate. These factors generate an-harmonic motions of photons inside the SMF [25], where the behavior of induced polarization ${\Omega }_P$ no more remains linear, which is given as

$${\Omega }_P={\epsilon }_0{\kappa }^{{}^{\prime }}E+{\epsilon }_0{\kappa }^{{}^{″}}{E}^2+{\epsilon }_0{\kappa }^{{}^{‴}}{E}^3.$$

(1)

Here, ${\epsilon }_0$ describes free space permittivity, E means electrical field intensity, and ${\kappa }^{{}^{\prime }}$, ${\kappa }^{{}^{″}}$ and ${\kappa }^{{}^{‴}}$ determine first, second and third order susceptibility, respectively.

The effects of RIrNLs for optical medium are originated from the electric diplole polarization induction, which is mainly due to the ${\kappa }^{{}^{\prime }}$, while the ${\kappa }^{{}^{″}}$ does not contribute for silica based propagation mediums [26] and ${\kappa }^{{}^{‴}}$ produces very low order nonlinear effects. Thus, by neglecting ${\kappa }^{{}^{″}}$, the induced polarization from (1) becomes

$${\Omega }_P={\epsilon }_0{\kappa }^{{}^{\prime }}E\cos (\Phi t-zx)+{\epsilon }_0{\kappa }^{{}^{‴}}{E}^3{\cos }^3(\Phi t-zx).$$

(2)

In (2), both linear and nonlinear parameters are included.

For the phase wave explored in (2), the intensity $\iota$ of pulse [27] is defined as

$$\iota =\frac{1}{2}c{\epsilon }_0{n}_0{E}_0^2.$$

(3)

Here, c denotes the light velocity, and linear refractive index is represented by $n_0$ at low electrical fields [28]. Thus, (2) simplifies to

$${\Omega }_P={\epsilon }_0{\kappa }^{{}^{\prime }}E\cos (\Phi t-zx)+\frac{3}{2}\frac{{\kappa }^{{}^{‴}}}{c{\epsilon }_0{n}_0}\iota E\cos (\Phi t-zx),$$

(4)

The effective susceptibility, ${\kappa }_e$, of the optical medium is calculated as

$${\kappa }_e={\kappa }^{{}^{\prime }}+\frac{3}{2}\frac{{\kappa }^{{}^{‴}}}{c{\epsilon }_0{n}_0}\iota ,$$

(5)

and the effective refractive index, $n_e$, is measured as

$$n_e=n_0+n_r\iota .$$

(6)

In (6), $n_r$ represents nonlinear refractive index, which is given as

$$n_r=\frac{3}{4}\frac{{\kappa }^{{}^{‴}}}{c{\epsilon }_0{n}_0^2}.$$

(7)

In addition, RIrNLs enlarge with the increase in length of fiber. As length of fiber gets larger, the interaction of a signal with the fiber and other traveling signals increases, which results in enhancing the effect of RIrNLs [28]. This optical power, in terms of length of fiber, $\Gamma$, and attenuation, $\alpha$, is written as

$${\rho }_r={\rho }_i{exp}^{-\alpha \Gamma },$$

(8)

where ${\rho }_i$ and ${\rho }_r$ determine input and output powers. For length, $\Gamma$, the effective length, ${\Gamma }_e$, of the fiber is given as

$${\rho }_i{\Gamma }_e={\int }_{\Gamma =0}^{\Gamma =w}{\rho }_r(\Gamma )d\Gamma .$$

(9)

From (8) and (9), ${\Gamma }_e$ is written as

$${\Gamma }_e=\frac{1-{exp}^{-\alpha \Gamma }}{\alpha }.$$

(10)

The effective length after installing optical amplifiers with $\Gamma$ and amplifier spaced distance z [29], is defined as

$${\Gamma }_e=\frac{1-{exp}^{-\alpha {\Gamma }^2}}{\alpha }\frac{\Gamma }{z}.$$

(11)

Cross sectional area, ${\xi }_{eff}$, of fiber core has inverse relation to $\iota$ [30] and can be estimated as

$${\xi }_{eff}=\frac{{\int }_m{\int }_{b}mdmdb}{{\int }_m{\int }_{b}mdmdb\iota (m,b)},$$

(12)

where m and b are the polar coordinates. Due to the SPM, different parts of the optical signal undergo different phase shifts, which results in frequency chirping incident. Broadening of spectrum is the initial impact of SPM, which gets larger for high launch power. Hence, based on wavelength, $\lambda$, $\Gamma$ and E, the phase, $\varpi$, [31] is defined as

$$\varpi =\frac{2\pi }{\lambda }n\Gamma .$$

(13)

Here, n represents refractive index. In terms of linear and nonlinear phenomena, (13) is written as

$$\varpi =\frac{2\pi }{\lambda }(n_0+n_r\iota {\Gamma }_e).$$

(14)

The first portion of the above equation is called linear phase ${\varpi }_0$, and the second portion is known as nonlinear phase shift ${\varpi }_r$. For time dependent phase angle, the modulated optical carrier frequency, ${\vartheta }_c$, based on frequency spectrum, ${\vartheta }_0$, Ref. [32] is given as

$${\vartheta }_c={\vartheta }_0+\frac{d\varpi }{dt}.$$

(15)

The SPM is a type of RIrNLs which causes fluctuations in the transmitted signal. In addition, XPM is another major RIrNL which happens when multi optical signals propagate over fiber simultaneously. For this effective refractive index, $n_e$ is expressed as

$$n_e=n_0+n_r\frac{{\rho }_i}{{\xi }_e}.$$

(16)

Due to XPM, propagation constant H becomes power dependent, and is defined as

$$H=H_0+H_r\rho ,$$

(17)

where $H_0$ is linear propagation constant and $H_r$ is nonlinear propagation constant. Furthermore, the nonlinear phase shift, ${\varpi }_r$, is calculated as

$${\varpi }_r={\int }_0^{\Gamma }(H_e-H_0)dm.$$

(18)

When multiple channels are transmitted simultaneously, the nonlinear phase shift in a signal is related with co-channels. Therefore,

$${\varpi }_r=H_e{\Gamma }_e({\rho }_{v0}+2{\rho }_{v1}),$$

(19)

where ${\rho }_{v0}$ and ${\rho }_{v1}$ are the powers of two co-channels. This equation demonstrates that XPM degrades the system reliability several folds as compared to SPM.

From (1) and (2), it is described that induced polarization composes of both linear and RIrNLs terms. The FWM nonlinear impact is caused by the third order susceptibility. In this process, photons of transmitted signals annihilate and result in production of new photons at various frequencies. In contrast to SPM and XPM, FWM is independent of bit rate and dependent on channel spacing and fiber dispersion. To calculate the effect of FWM, the induced polarization is written as

$$\begin{array}{cc}\hfill & {\Omega }_P=\frac{3}{4}{\epsilon }_0{\kappa }^{{}^{‴}}\sum _{a=1}^i{E}_a^2+\frac{3}{4}{\epsilon }_0{\kappa }^{{}^{‴}}\sum _{a=1}^i\sum _{a>s}\sum _{s>l}{E}_a{E}_s{E}_l\hfill \\ & \cos (2{\vartheta }_{ii}+{\vartheta }_{jj}+{\vartheta }_{kk})t-(H_{ii}+H_{jj}+H_{kk})z\hfill \\ & +\cos ({\vartheta }_{ii}+{\vartheta }_{jj}+{\vartheta }_{kk})t-(H_{ii}+H_{jj}+H_{kk})z\hfill \\ & +\cos ({\vartheta }_{ii}-{\vartheta }_{jj}+{\vartheta }_{kk})t-(H_{ii}-H_{jj}+H_{kk})z\hfill \\ & +\cos ({\vartheta }_{ii}-{\vartheta }_{jj}-{\vartheta }_{kk})t-(H_{ii}-H_{jj}-H_{kk})z.\hfill \end{array}$$

(20)

The primary portion in the above equation represents SPM and XPM, while the secondary part denotes FWM. It explains that FWM occurs due to the mixing of different frequencies. As RIrNLs are the main causes of power penalty and system performance deduction, the proposed system mitigates their effects by employing NRZ duo-binary modulation, large effective area and uneven channel spacing. Moreover, RIrNLs can be limited by controlling nonlinear dispersion through a dispersion compensation fiber (DCF). The BER is used for the analysis of RIrNLs and phase noise parameters; this means that if these issues exist, then we do not know how many bits can be transferred including low error size per bit. BER is given as

$$\mathrm{BER}=\frac{1}{2erf\sqrt{\frac{\mathrm{OSNR}}{2}}}$$

(21)

The $erf$ denotes error function the optical signal to noise ratio (OSNR) is described as

$$OSNR=E_{SNR}\frac{\phi }{2B_r.m_{sys}}$$

(22)

where $B_r$ defines the reference bandwidth, $E_{SNR}$ is the electrical SNR, $\phi$ is the total transmission symbol rate measured in Gbps and the last term $m_{sys}$ describes the system margin.

4. Results and Discussion

This section elaborates the simulation results of the proposed system. Optisystem Ver.13 simulation software is used to carry out the simulations, which contains most of the components used for the design of a practical optical communication system. The performance metric of BER, specified by the number of error bits per transmitted ones, is performed at the receiver end in Optisystem by using a clock recovery module, followed by a data recovery component. The Optisystem makes use of the sequence length and makes several iterations to estimate the BER values. The threshold of 10${}^{-3}$ is used in this work as mentioned by a dotted line in the figures containing results. The BERs of eye diagrams are found to be higher than the considered threshold value before Nonlinearities compensation, but is much lower (BER < 10${}^{-5}$) with application of the proposed compensation technique. In order to discuss pre-FEC BER, the optical transmission system interfaces on series of packet transport routers support monitoring the condition of an optical network by using pre-FEC BER. In the Optisystem, BER is estimated using a Gaussian algorithm with transmission of a short sequence of bits. After the bit recovery, the BER test set calculates the error bits and use the transmitter channel information to produce the BER. Figure 6 describes the flow chart for connection among analytical and simulation models.

Figure 7 presents the BER performance of the system against the effective non-linear area of the optical fiber. The simulations are conducted for different channel spacings used for the proposed WDM system. The results show that the performance of the system against RIrNLs improves with the increase in area and is optimum at 80 ${\mathrm{m}}^2$ effective area. Similarly, Figure 8 presents the OSNR results for different channel spacings, as the effective area is varied. The simulation results are plotted for a 32-channel WDM system, with an aggregate data rate of 100 Gbps.

Figure 9 includes the results for BER versus effective area for different number of channels. The plot indicates that RIrNLs increase with the number of channels, for a fixed channel spacing of 50 GHz. However, the proposed system provides low BER values, even for 32 channels after the mitigation of RIrNLs effects. Moreover, the projected model examines simulation results in up to 500 km of fiber length as shown in Figure 10. The results also show that the proposed model has the ability to support multi channels for up to 500 km of optical path covered, by treating RIrNLs.

The system performance will degrade with a reduced channel spacing. For this purpose, an additional analysis has been performed and results have been included in the paper for Dense-WDM spacings of 12.5 GHz and 25 GHz. Since each channel carries data bandwidth of 3.16 GHz, further reduction in channel spacing causes severe distortion and very high BER. The results section has been updated with the results for 12.5 GHz and 25 GHz channel spacings for 32 number of total channels. The results for receiver sensitivity are shown in terms of received optical power. The BER threshold of 10${}^{-3}$ has been considered to analyze the receiver sensitivity. The laser frequency for first channel is 193.1 THz, which corresponds to the wavelength of 1552.5 nm. For 32 number of channels with 25 GHz spacings, the range for the WDM system is from 193.1 THz to 193.875 THz. For distinct channel spacings such as 12.5, 25 and 50 GHz, the developed model is tested for different values of nonlinear refractive index and BER results are obtained, as mentioned in Figure 11. This figure demonstrates that RIrNLs are managed efficiently at 2.6 $\times {10}^{-17}$ m${}^2$ /W nonlinear refractive index. Figure 12 is obtained by performing the simulations for different data rates per channel, which shows that data rate up to 3.125 Gb/s per user can be supported by lowest channel spacing value of 12.5 GHz, for 32 number of channels. Though an aggregate data rates of 100 Gb/s (32 × 3.125 Gb/s) is obtained for all 12.5 GHz channel spacings, the results in Figure 12 show that higher data rates can be achieved using channel spacing of 25 GHz or 50 GHz, as the BER performance is below the threshold for values greater than 3.125 Gb/s user data rate.

The BER results for different input optical power levels and received power are presented in Figure 13 and Figure 14 respectively, for different number of channels and at 100 Gbps aggregate data rate. Finally, Figure 15 shows the BER results for different values of nonlinear dispersion parameter. It is clear from the results that the lower value of nonlinear dispersion results in low range of RIrNLs. Figure 15 also presents BER for different number of channels by using 25 GHz and 50 GHz channel spacings at 500 km transmission length. Comparing the obtained results with recently published work, the 8 channel WDM system presented in [33,34,35,36] provides transmission up to 25 km with 25 GHz channel spacing, in the presence of FWM non-linearities. Additionally, an advanced receiver presented in [34] enables the 8-channel WDM transmission up to 100 km with 100 GHz channel spacing with BER of 5.3 × ${10}^{-6}$ by mitigating the SPM, XPM and FWM non-linearities. Thus, the work presented in this paper is of considerable importance, as it provides lower BER rates for 500 km transmission, 32 channels and 12.5 GHz channel spacing.

Comparing the obtained results with the experimental study of data transmission over 500 km of fiber transmission [37,38,39,40], the use of DSP for interference mitigation and compensation of non-linear effects allows one to increase the number of channels from four [37] to thirty-two channels. Similar results have been achieved as [38] without the use of polarization multiplexing, which reduces the complexity of our proposed system. The relative group delay analysis performed in [39] shows a maximum of 430 psec value, which can easily be compensated using a larger frame size during the transmission. The 13.3 dB OSNR achieved in [40] after 500 km transmission through a low loss fiber justifies our BER results and received eye diagram, as explained in the next paragraph.

Lastly, we explore the efficiency of the proposed model and its ability to minimize RIrNLs based on the basis of eye-diagrams for different channel spacings. Figure 16a–c shows the results for 12.5, 25, and 50 GHz channel spacing without RIrNLs compensation at 500 km distance cover and 100 Gbps aggregate data rate. While the eye diagrams after RIrNLs compensation are shown in Figure 16d–f, which clearly demonstrates improvement in performance.

5. Conclusions

Mitigation of RIrNLs’ effects, including XPM, FWM and SPM, are analyzed in this paper with an analytical and simulation model, in order to design an optimal OTS using FD-MIMO equalizer-based enhanced DSP receiver and microstrip Chebyshev low pass filter for long-haul transmission. These impacts are investigated for distinct values of channel spacing, transmission length, number of channels, input and received power, nonlinear refractive index, nonlinear dispersion and nonlinear effective area, in a 32 channel WDM system. The simulations are performed using OSNR and BER as performance metrics. Results show that the proposed design maintains its continuity at 2.6 $\times {10}^{-17}$ m${}^2$/W refractive index, 80 m${}^2$ effective area, up to 500 km fiber length with the conventional 6 dBm input optical power. The impacts of RIrNLs are minimized through implementation of the proposed optimum design and using duo-binary modulation, semiconductor optical amplifier and filters. The BER achieved in this work is <${10}^{-5}$ till 500 km range, for a maximum number of 32 channels, with 100 Gbps aggregate data rate. This shows the feasibility and effectiveness of the proposed model.