Measuring and Assessing Performance of Mobile Broadband Networks and Future 5G Trends

: Mobile broadband (MBB) is one of the critical goals in ﬁfth-generation (5G) networks due to rising data demand. MBB provides very high-speed internet access with seamless connections. Existing MBB, including third-generation (3G) and fourth-generation (4G) networks, also requires monitoring to ensure good network performance. Thus, performing analysis of existing MBB assists mobile network operators (MNOs) in further improving their MBB networks’ capabilities to meet user satisfaction. In this paper, we analyzed and evaluated the multidimensional performance of existing MBB in Oman. Drive test measurements were carried out in four urban and suburban cities: Muscat, Ibra, Sur and Bahla. This study aimed to analyze and understand the MBB performance, but it did not benchmark the performance of MNOs. The data measurements were collected through drive tests from two MNOs supporting 3G and 4G technologies: Omantel and Ooredoo. Several performance metrics were measured during the drive tests, such as signal quality, throughput (downlink and unlink), ping and handover. The measurement results demonstrate that 4G technologies were the dominant networks in most of the tested cities during the drive test. The average downlink and uplink data rates were 18 Mbps and 13 Mbps, respectively, whereas the average ping and pong loss were 53 ms and 0.9, respectively, for all MNOs.


Introduction
Mobile broadband (MBB) networks are growing very fast, as they provide high-speed internet access. The demand for data is rapidly increasing due to a huge number of users accessing data through several cellular technologies and various types of internet services. Spectrum demand for mobile communication systems is growing due to the increase in the number of wireless technologies and applications. Intelligent technologies are required to fully utilize and monitor current spectrums [1,2]. Dynamic spectrum access uses increase spectrum efficiency (SE) by adjusting radio resources. Performance and quality measurements become essential for all of the concerned mobile network operators to maintain and monitor the quality of service (QoS) of their existing networks. Therefore, fifth-generation (5G) networks provide enhanced MBB which supports high-speed data, video streaming with low latency and seamless mobility. Real measurements of MBB performance are affected by several factors, such as a variety of user devices, physical impairments, mobility and accessibility configuration [3]. Therefore, mobile networks need to be monitored to ensure user satisfaction in terms of QoS and quality of experience (QoE). The international telecommunication union (ITU) introduced a new term called the mean opinion score (MOS), which assesses mobile network providers to evaluate end-user satisfaction by obtaining users' opinions of a network's performance [4]. The MOS metric is widely used for several services and applications such as audio, audio-visual and video. These services have various methods to assist in scoring their service quality.
Drive test is an important method for mobile operators to measure and assess the capacity, coverage and QoS of mobile radio networks. The drive test consists of two basic types: user-equipment-based testing and benchmark testing. The former is based on monitoring live end-user mobile devices such as smartphones and tablets, which provides the mobile operators with the performance of their networks. The latter is used many user devices and runs voice calls and data connections on other operators' networks in any particular area in order to determine the performance of each mobile network. Several works have been carried out in the investigation and evaluation of the performance of the existing MBB. In [5], the authors highlight the importance of QoE in cellular networks with various radio access technologies (fourth-generation (4G), 5G and beyond), where they provide the literature on the most advanced measurement methods in QoE. In addition, the QoE is further investigated by different metrics and models for web QoE estimation [6]. The web QoE helps mobile network operators (MNOs) understand their customer's usage service patterns, perceive quality and point towards areas to improve. However, in other studies [7,8], the authors investigate QoS and QoE by conducting an experimental study of the current MBB supporting third-generation (3G) and 4G networks in Malaysia. A specific application installed on a smartphone handset collected the drive test data from several rural and urban regions. The measurement data of three MNOs are associated with several performance indicators such as coverage, latency, satisfaction and speed for two MBB services: web browsing and video streaming. The work in [9] analyzed data measurement using several key performance indicators (KPIs) in 4G networks, such as signal quality and download throughput. The drive test considered the actual road traffic conditions at a vehicle speed of 30 km/h. The experimental results demonstrated that the achieved throughput leads to different profiles in terms of time evolution. In [10], the authors investigated the performance of nine MNOs in Europe during times when restrictions were in place due to the COVID-19 outbreak. This investigation included several KPIs such as web QoE, signal coverage, throughput and round-trip-time (RTT). The measurement results showed approximate 46% increases in page load time at different times during the COVID-19 period. The findings indicated that the MNOs had managed their network performance during the pandemic period, although some short-term performance degradations were observable. In [11], the authors presented time and space mapping of outdoor electromagnetic field exposure induced by base station antennas in 4G cellular networks using artificial neural networks. The data were obtained from electromagnetic field exposure sensor networks. In [12], an embedded vehicle-to-everything platform was used to perform drive tests on a public cellular network. The field measurements were conducted based on existing passive network quality indicators and application-level information to forecast uplink transmission power using a novel machine learning technique. Concering indoor environments, the authors of [13] conducted MBB measurements to analyze the network performance in indoor buildings of several areas in Malaysia. The measurement data were collected from three MNOs using mobile smartphones for two types of MBB services: video streaming and web browsing. The measurement results demonstrated that 80% of 4G and 3G networks coverage have good received signal strengths, whereas only 20% reach the threshold level. In addition, 4G networks were the most accessed web and video cycles compared with 3G networks. The authors of [14] conducted multiple measurements (static and dynamic) in live LTE networks in terms of throughput to benchmark Austrian MNOs. The finding showed that the static measurements are not applicable for benchmarking of MNOs due to different small-scale fading patterns, whereas excellent benchmarking can be obtained by using dynamic measurements.
In this paper, we investigate and evaluate the performance of existing MBBs (Omantel and Ooredoo) in four cities in Oman. These cities are categorized as urban areas such as Muscat and suburban such as Ibra, Bahla and Sur. Several KPIs were used to analyze the MBBs, such as signal level and quality, throughput, ping rate and handover rate. This investigation study provides valuable data measurements that can be used for future network improvements and pinpointing during the deployment of 5G networks. The rest of this paper is organized as follows: Section 2 provides an overall background on the MBB networks and coverage. Section 3 describes the methodology and experimental design. The performance of the MBBs is analyzed and evaluated in Section 4. Section 5 provides study limitations and 5G trends. Section 6 concludes the paper.

Oman Mobile Broadband
The demand for data is rapidly increasing due to a huge number of users accessing data through several cellular technologies and various types of internet services. Spectrum demand for mobile communication systems is growing due to the increase in wireless technologies and applications. Ericsson reported that the gulf cooperation council countries are among the most advanced information and communication technology (ICT) markets in the world [15]. The statistics demonstrated that over 90% of mobile subscriptions were for MBB at the end of 2020. It is estimated that this percentage will increase up to 95% in 2026. The report showed that 4G networks are the dominant technology, making up about 80% of subscriptions at the end of 2020.
In the Oman telecommunications regulatory authority (TRA) report, the Oman's telecom industry saw significant repercussions due to COVID-19, as evidenced by increasing demand for services during lockdown and reduced average expenditure owing to various special offers by service providers [16]. The report discussed the MBB usage in gigabytes (GBs): there was a 27.61% growth in the total GBs consumed, although active MBB subscriptions dropped by 8.72%. However, in the second quarter of 2020, 59.8% of the land area was covered by at least a 3G mobile network, whereas 99.3% of the population was covered with at least a 3G mobile network [16]. Figure 1 demonstrates the coverage network map of 2G, 3G, 4G and 5G mobile networks for Omantel and Ooredoo in Muscat, the capital city of Oman. These data are based on the nPerf application, which collects the data from tests carried out by users' devices [17]. The application retains tests with a maximum geolocation precision of 50 m for coverage data. From Figure 1, it can be seen that 4G networks are the dominant technology for all MNOs. It displays the collected data for two years between November 2019 and November 2021, in which approximately 136,045 and 140,024 pieces of data were collected for Omantel and Ooredoo, respectively. The data were obtained from tests performed by nPerf app users. These tests were carried out in the field under real-world settings.
Omantel recorded a few 5G coverage points (violet color), whereas there is no record for 5G coverage in Ooredoo. To provide complete 5G network coverage, MNOs would need to build more base stations, especially in populated areas.
For wider coverage and to fulfil the demand for MBB services, MNOs need to deploy a large number of base stations. Thus, MNOs should build new base stations with various cellular technologies based on the type of planning area to serve a large population of users with a good QoS level. For wider coverage and to fulfil the demand for MBB services, MNOs need to deploy a large number of base stations. Thus, MNOs should build new base stations with various cellular technologies based on the type of planning area to serve a large population of users with a good QoS level. Table 1 and Figure 2 show the growth in the number of sites per technology and average SE of the main MNOs in Oman for 2015 to 2020. The statistical data were obtained from prominent agencies, such as the operators' annual reports, regulators, MTC [18] and Ooredoo [19]. The existing 2G, 3G and 4G networks have several versions: GSM, GPRS and EDGE, HSDPA, HSUPA, HSPA and HSPA+, and LTE and LTE-A, respectively. The typical average SE for each technology is 0.17 bps/Hz, 4.87 bps/Hz and 23.16 bps/Hz for 2G, 3G and 4G networks, respectively. In this regard, the average SE for all sites is calculated by multiplying the number of the overall sites with the typical average SE for each technology. The total SE and SE growth are combined to present the expected results for Oman.   Figure 2 show the growth in the number of sites per technology and average SE of the main MNOs in Oman for 2015 to 2020. The statistical data were obtained from prominent agencies, such as the operators' annual reports, regulators, MTC [18] and Ooredoo [19]. The existing 2G, 3G and 4G networks have several versions: GSM, GPRS and EDGE, HSDPA, HSUPA, HSPA and HSPA+, and LTE and LTE-A, respectively. The typical average SE for each technology is 0.17 bps/Hz, 4.87 bps/Hz and 23.16 bps/Hz for 2G, 3G and 4G networks, respectively. In this regard, the average SE for all sites is calculated by multiplying the number of the overall sites with the typical average SE for each technology. The total SE and SE growth are combined to present the expected results for Oman. Figure 3 shows the SE growth of the two considered MNOs in Oman. The existing MNOs were labeled as X and Y due to confidential issues; this study does not benchmark the MNOs' performance. The data indicate that the SE and growth ratio will radically increase within the next years. The average spectrum efficiency per site and growth ratios overall operators in 2020 was 10.06 bps/Hz and 1.89, respectively. It can be seen that this increase is due to the outcome of the continuous migration and upgrading of the mobile cellular systems from old to new technologies.   Figure 3 shows the SE growth of the two considered MNOs in Oman. The existing MNOs were labeled as X and Y due to confidential issues; this study does not benchmark the MNOs' performance. The data indicate that the SE and growth ratio will radically increase within the next years. The average spectrum efficiency per site and growth ratios overall operators in 2020 was 10.06 bps/Hz and 1.89, respectively. It can be seen that this increase is due to the outcome of the continuous migration and upgrading of the mobile cellular systems from old to new technologies.  Each operator/mobile service provider has a different strategy for future mobile network deployment and development. This plan is usually confidential and cannot be publicly shared. Therefore, any related data cannot be easily obtained. Acquire real data from operator/mobile service providers regarding network performance and strategic plans for the future deployment of mobile networks is challenging.

Methodology and Experimental Design
This section presents the test methodology of the measurement campaign to evaluate  Each operator/mobile service provider has a different strategy for future mobile network deployment and development. This plan is usually confidential and cannot be publicly shared. Therefore, any related data cannot be easily obtained. Acquire real data from operator/mobile service providers regarding network performance and strategic plans for the future deployment of mobile networks is challenging.

Methodology and Experimental Design
This section presents the test methodology of the measurement campaign to evaluate the existing MNOs with several performance metrics relevant to the user experience. The data collection was carried out using a commercial android application developed by Gyokov Solutions called "G-NetTrack", installed in two Samsung Galaxy handsets [20]. In addition, several applications were tested in terms of performance metrics, recording logfile, continuity of testing and stability. This application supports drive tests for outdoor scenarios and provides a wide range of features such as map visualization, cell scanning loading cells, cell measurement for serving and neighbor cells. G-NetTrack has been used in numerous research papers such as [21][22][23], which means it is considered a reliable application for collecting data measurements. Figure 4 visualizes the information of data measurement for cell and network information.   Table 2 displays the collected data during the drive test that was saved in the log file after completing the measurements. There were six main KPIs used to analyze the MNOs' performance, namely: signal level (RSRP), signal quality (RSRQ), channel quality indicator (CQI), ping, throughput (downlink (DL) and uplink (UL) data) and handover rate. All these KPIs were recorded in the log file according to MNOs.   Table 2 displays the collected data during the drive test that was saved in the log file after completing the measurements. There were six main KPIs used to analyze the MNOs' performance, namely: signal level (RSRP), signal quality (RSRQ), channel quality indicator (CQI), ping, throughput (downlink (DL) and uplink (UL) data) and handover rate. All these KPIs were recorded in the log file according to MNOs. Table 3 shows the setting parameters of the data sequence for each mobile device. Both devices were set up with the same settings in order to achieve a fair comparison. The data sequence started with the ping test first and then was followed by a DL/UL test, where there was a 1 s time pause between test cycles. A larger size of the download file was selected which could not be downloaded fully in the allocated download time in order to achieve a higher download speed. Ping Measured the required time to send an amount of data and receive a response in ms. DL/UL Downlink/uplink data transfer speed in kbps.

Handover
The process of transferring voice calls or data sessions from one serving cell to a target cell. The data measurements were performed in four cities: Muscat, Ibra, Bahla and Sur. In this regard, the MBB performance of the two national MNOs (Omantel and Ooredoo) was investigated and evaluated. However, this study aimed to analyze and understand the MBB performance, but it did not benchmark the performance of MNOs. Thus, the existing MNOs were labeled as X and Y in the discussed and demonstrated results. Prepaid subscriber identification module (SIM) cards with the same data package were used for each MNO to ensure peer to peer comparison. Figure 5 displays the general methodology of the data measurements and analysis. The two mobile devices were fixed on a mobile phone stand holder inside a car, as shown in Figure 6. Then, the mobile devices collected the data from the MNO towers and then stored them on the device's memory that could be used for analysis after completing the data campaign. Figure 7 displays the experimental testbed (measurement area) where the data measurements were taken on the orange route.      Figure 8 shows the block diagram of the general data measurement. In the drive test, first, the app was set up, setting several parameters of data sequences such as ping upload time and URL, data rate time (down/upload) and tested file with one gigabyte in size. Once these parameters were set, the drive test logged the data measurement from the starting point and stopped at the ending points. The signal level and quality were measured continuously during the drive test. In addition, several events such as handover and cell reselection were recorded during the data measurements. All these data measurements were associated with the timestamp and GPS coordinates (longitude and latitude). Sustainability 2022, 14, x FOR PEER REVIEW 10 of 23  Figure 8 shows the block diagram of the general data measurement. In the drive test, first, the app was set up, setting several parameters of data sequences such as ping upload time and URL, data rate time (down/upload) and tested file with one gigabyte in size. Once these parameters were set, the drive test logged the data measurement from the starting point and stopped at the ending points. The signal level and quality were measured continuously during the drive test. In addition, several events such as handover and cell reselection were recorded during the data measurements. All these data measurements were associated with the timestamp and GPS coordinates (longitude and latitude).    Figure 8 shows the block diagram of the general data measurement. In the drive test, first, the app was set up, setting several parameters of data sequences such as ping upload time and URL, data rate time (down/upload) and tested file with one gigabyte in size. Once these parameters were set, the drive test logged the data measurement from the starting point and stopped at the ending points. The signal level and quality were measured continuously during the drive test. In addition, several events such as handover and cell reselection were recorded during the data measurements. All these data measurements were associated with the timestamp and GPS coordinates (longitude and latitude).

Performance Evolution
The evolution of existing MBBs is essential to ensure that a network provides a highquality user experience. This experimental research was conducted to analyze the actual performance of the current national MNOs in Oman. It is an extension of the work that was carried out in our previous work in [24]. All the measurements were conducted during the daytime with the same operating system and test sequences for both operators in each city in order to achieve a fair comparison. The measurement results are demonstrated and discussed for each KPI: RSRP, RSSI, RSRQ, CQI, ping, throughput and handover rate. The measurements were collected in the daytime for all MNOs. The car speed was limited up to 70 km/h for all outdoor scenarios. Figure 9 illustrates the car speeds during the drive test. It can be observed that the speed was maintained below 70 km/h and sometimes reached 0 km/h at traffic lights.
The evolution of existing MBBs is essential to ensure that a network provides a highquality user experience. This experimental research was conducted to analyze the actual performance of the current national MNOs in Oman. It is an extension of the work that was carried out in our previous work in [24]. All the measurements were conducted during the daytime with the same operating system and test sequences for both operators in each city in order to achieve a fair comparison. The measurement results are demonstrated and discussed for each KPI: RSRP, RSSI, RSRQ, CQI, ping, throughput and handover rate. The measurements were collected in the daytime for all MNOs. The car speed was limited up to 70 km/h for all outdoor scenarios. Figure 9 illustrates the car speeds during the drive test. It can be observed that the speed was maintained below 70 km/h and sometimes reached 0 km/h at traffic lights.       Figure 11 displays the measured data of RSRP and RSSI for the two MNOs. Both of the operators' average RSRP and RSSI levels are between −85 dBm and −57 dBm and −81 dBm and −68 dBm, respectively. This finding indicates that both operators have good network coverage in the measurement area. However, the minimum RSRP for all tested cities and operators is below −120 dBm. This value represents the mobile device at the cell edge where RSRP levels for usable signal typically range from −75 dBm (near to base station) to −120 dBm (at the cell edge of network coverage). The data measurements show that all the MNOs cover all the tested cities with 4G networks.  Figure 12 shows the levels of RSRQ in the measured areas for the two MNOs. Many resource blocks with measured RSRP and RSSI were used over the same bandwidth for each MNO. The RSRQ value helps the base station perform cell reselections or intra-inter handovers. The figure shows the average RSRQ level that varied between −9 dB and −11 dB, where the RSRQ achieved a maximum and minimum value of −5 dB and −20 dB, respectively.  Figure 12 shows the levels of RSRQ in the measured areas for the two MNOs. Many resource blocks with measured RSRP and RSSI were used over the same bandwidth for each MNO. The RSRQ value helps the base station perform cell reselections or intrainter handovers. The figure shows the average RSRQ level that varied between −9 dB and −11 dB, where the RSRQ achieved a maximum and minimum value of −5 dB and −20 dB, respectively. Figure 13 illustrates the level of CQI for the measured MNOs in the four cities. The MNOs used CQI to monitor the channel quality between evolved NodeBs (eNB) and mobile devices. The CQI reported value ranges from 0 to 15, indicating the modulation and coding level at which a mobile device could operate on. The CQI provides information about the quality conditions of the communication channel. It can be seen that the average CQI levels vary between 11 and 8 for all MNOs in all cities, where all MNOs obtain a maximum value of CQI of approximately 15. The high CQI level indicates a high RSRQ. A more reliable connection is usually the result of higher RSRQ and CQI. Thus, the CQI is a key metric for LTE systems, where MNOs typically use it to determine the relationship between radio link conditions and throughput.  Figure 13 illustrates the level of CQI for the measured MNOs in the four cities. The MNOs used CQI to monitor the channel quality between evolved NodeBs (eNB) and mobile devices. The CQI reported value ranges from 0 to 15, indicating the modulation and coding level at which a mobile device could operate on. The CQI provides information about the quality conditions of the communication channel. It can be seen that the average CQI levels vary between 11 and 8 for all MNOs in all cities, where all MNOs obtain a maximum value of CQI of approximately 15. The high CQI level indicates a high RSRQ. A more reliable connection is usually the result of higher RSRQ and CQI. Thus, the CQI is a key metric for LTE systems, where MNOs typically use it to determine the relationship between radio link conditions and throughput.

Data Rate
Data rate is the most important monitoring metric in mobile cellular networks; it is used to evaluate internet speed performance. It defines the amount of data delivered over a network during a specified period, typically measured in bits per second (bps). Figure 14 displays the throughput of the measured MNOs in terms of minimum, maximum and average for all cities. The figure demonstrates the DL/UL throughput for each MNO in the four measured cities. The maximum data rates in DL are approximately more than 100 Mbps in Ibra and Sur and below 50 Mbps in Muscat and Bahla for both MNOs. However, all measured cities achieve approximate similar maximum UL data rates for both MNOs. In addition, both MNOs achieve a good average throughput in Ibra and Sur compared with Muscat and Bahla. The reason for this result is that Muscat and Bahla are very crowded cities compared with Ibra and Sur, which require a bandwidth boost.

Latency (Ping, Packet Loss)
Ping measures the reaction time of speed connection and is recorded as ping count, where a lower ping rate is better than a higher rate. In practice, the RTT of 4G networks tends to be in the range of 30 to 100 ms. Figure 15 shows the ping of the measured MNOs in terms of average, standard deviation and packet loss. The results show that the MNOs achieve an average ping rate lower than 50 ms for all cities within the accepted range, indicating good speed connections. Overall, operator Y achieves a lower average ping rate compared with operator X in the measured cities. Besides, it also obtains an average packet loss of approximately zero compared with operator X in all cities except Muscat.

Data Rate
Data rate is the most important monitoring metric in mobile cellular networks; it is used to evaluate internet speed performance. It defines the amount of data delivered over a network during a specified period, typically measured in bits per second (bps). Figure  14 displays the throughput of the measured MNOs in terms of minimum, maximum and average for all cities. The figure demonstrates the DL/UL throughput for each MNO in the four measured cities. The maximum data rates in DL are approximately more than 100 Mbps in Ibra and Sur and below 50 Mbps in Muscat and Bahla for both MNOs. However, all measured cities achieve approximate similar maximum UL data rates for both MNOs. In addition, both MNOs achieve a good average throughput in Ibra and Sur compared with Muscat and Bahla. The reason for this result is that Muscat and Bahla are very crowded cities compared with Ibra and Sur, which require a bandwidth boost.

Latency (Ping, Packet Loss)
Ping measures the reaction time of speed connection and is recorded as ping count, where a lower ping rate is better than a higher rate. In practice, the RTT of 4G networks tends to be in the range of 30 to 100 ms. Figure 15 shows the ping of the measured MNOs in terms of average, standard deviation and packet loss. The results show that the MNOs

Handover
In mobile cellular networks, handover is a process of transferring voice calls or data sessions from one serving cell to a target cell. Several mobility issues occur during the handover process, such as ping-pong handover and radio link failure. These issues significantly affect the communication quality in terms of long interruption time and throughput degradation [25]. There are two types of handovers, namely intra-frequency handover and inter-frequency handover. The former occurs among base stations that operate in the same network technology. The latter occurs among base stations that operate in different network technologies. Figure 16 illustrates the handover number of the two MNOs for all cities. The data measurements show that 4G networks were the dominant serving network in most cities except Bahla city, where operator X has experience with 3G networks. From Figure 16, the most recorded handovers occur within the same technology (4G-to-4G handover) except Bahla city (operator X), where 4G-to-3G handovers are detected due to radio link communication exchanged from 4G to 3G technology. Generally, operator Y achieves a lower handover number than operator X in all cities except Bahla. A possible reason for this finding is the operators' settings of mobility management, which depend on several factors such as time-to-trigger, handover margin, handover events and handover offset.

Handover
In mobile cellular networks, handover is a process of transferring voice calls or data sessions from one serving cell to a target cell. Several mobility issues occur during the handover process, such as ping-pong handover and radio link failure. These issues significantly affect the communication quality in terms of long interruption time and throughput degradation [25]. There are two types of handovers, namely intra-frequency handover and inter-frequency handover. The former occurs among base stations that operate in the same network technology. The latter occurs among base stations that operate in different network technologies. Figure 16 illustrates the handover number of the two MNOs for all cities. The data measurements show that 4G networks were the dominant serving network in most cities except Bahla city, where operator X has experience with 3G networks. From Figure 16, the most recorded handovers occur within the same technology (4G-to-4G handover) except Bahla city (operator X), where 4G-to-3G handovers are detected due to radio link communication exchanged from 4G to 3G technology. Generally, operator Y achieves a lower handover number than operator X in all cities except Bahla. A possible reason for this finding is the operators' settings of mobility management, which depend on several factors such as time-to-trigger, handover margin, handover events and handover offset.

Analysis Summary
Several performance metrics were analyzed for two MNOs in four cities in Oman. Figure 17 exhibits a comparison among cities taking account of signal level and quality, throughput, ping rate and handover number. Figure 17a shows that MNOs in all cities have almost the same signal levels and qualities. Higher UL and DL throughput is achieved by operator X and Y, respectively, in Ibra city, as shown in Figure 17b. In Figure 17c, operator X in Bahla obtains a higher ping rate compared with other cities. Additionally, operator X in Muscat achieves a higher handover number, as shown in Figure 17d. Table 4 summarizes the signal level and quality (RSRP, RSRQ and CQI). Table 5 summarizes throughput, ping rate and handover number. Digits that are in bold type refer to best performance. All the MNOs cover the measured area with 4G at measurement time with good signal quality and data rates. These demonstrated results of each operator depend on several factors such as bandwidth capacity, the number of sites, the number of active users and the type of subscribers. These factors significantly affect the data rate and QoS that may improve or degrade the network performance.

Analysis Summary
Several performance metrics were analyzed for two MNOs in four cities in Oman. Figure 17 exhibits a comparison among cities taking account of signal level and quality, throughput, ping rate and handover number. Figure 17a shows that MNOs in all cities have almost the same signal levels and qualities. Higher UL and DL throughput is achieved by operator X and Y, respectively, in Ibra city, as shown in Figure 17b. In Figure  17c, operator X in Bahla obtains a higher ping rate compared with other cities. Additionally, operator X in Muscat achieves a higher handover number, as shown in Figure 17d. Table 4 summarizes the signal level and quality (RSRP, RSRQ and CQI). Table 5 summarizes throughput, ping rate and handover number. Digits that are in bold type refer to best performance. All the MNOs cover the measured area with 4G at measurement time with good signal quality and data rates. These demonstrated results of each operator depend on several factors such as bandwidth capacity, the number of sites, the number of active users and the type of subscribers. These factors significantly affect the data rate and QoS that may improve or degrade the network performance.

Study Limitations
This investigation study presented the performance of existing MBB networks. Several limitations can be discussed as follows:

1.
Limited drive test: The data measurements were collected in four cities, whereas larger areas would be better but more time consuming. Thus, this work can be extended to other areas, especially densely populated cities. Moreover, this work can also include rural areas which are outside the densely populated urban areas in towns or cities.

2.
Indoor scenarios: This study can be further extended to include the performance of MBB in indoor environments such as shopping malls while considering single and multi-floor scenarios. Indoor coverage would become much more important due to the high demands of modern usage cases. Thus, further investigation in indoor environments will provide an overview of how MBB performs in a complicated internal building's structure that can interfere with radio frequencies. 3.
One-time drive test: This study was carried out during the daytime where the cell traffic load was at a normal capacity. Hence, drive tests during peak and peak-off hours can be included in further investigations. In the peak period, most of the subscribers are likely to be online and demand more resources, whereas the data rate demand is low in the off-peak period. 4.
MBB services: Due to application limitations, this study was limited to two types of MBB services: web browsing and file (DL and UL) tests. Other services tests such as video streaming and voice can be included in future study, but it will require an application that can support these services.

5.
Beyond MBB services: Several factors other than MBB services have not been considered in this study, such as tariffs, prices, data packages, policies, privacy, billing, etc. These factors are not important in the analysis of network performance, but it will be more useful for the benchmarking stages. 6.
Measurement time: The measurements of this study were collected once for each area where the network performance of MNOs was not measured with various climatic conditions with multiple drive tests. Thus, a one-time drive test may not provide the actual network performance of each MNOs. Therefore, this study can be extended further to multiple, longer drive tests for each area. 7.
Auto technology: In this study, the mobile device chose the available network technology (i.e., 2G, 3G or 4G) to connect to a serving cell. However, this did not provide the network performance of each technology of MNO independently. It can be recommended to include a locked technology scenario where the mobile device is locked to one technology at each measurement time. 8.
User Mobility: The data measurements were collected with the medium mobility of car speed (≤70 kh/h). Therefore, various mobility scenarios could be considered for the drive test, such as low, medium and high speeds. These scenarios lead to the provision of more details on the network performance with respect to user mobility. 9.
5G networks: This study focused on existing MBB networks (3G and 4G) because there are only limited commercial 5G MBB networks deployed in Oman. Therefore, the current study can be extended to involve 5G MBB using supported mobile phones and applications.

5G Trends
The Oman TRA allocates the frequency band 3400-3600 MHz to the licensed MNOs to be used for 5G networks with a bandwidth of 100 MHz for each MNO. Omantel and Ooredoo are allocated frequency bands of 3400-3500 MHz and 3500-3600 MHz, respectively. Recently, both operators have deployed their 5G networks at the non-standalone stage. Approximately 1300 5G sites have been deployed in 11 governates for the two MNOs, as shown in Figure 18.

G Trends
The Oman TRA allocates the frequency band 3400-3600 MHz to the licensed MNOs to be used for 5G networks with a bandwidth of 100 MHz for each MNO. Omantel and Ooredoo are allocated frequency bands of 3400-3500 MHz and 3500-3600 MHz, respectively. Recently, both operators have deployed their 5G networks at the non-standalone stage. Approximately 1300 5G sites have been deployed in 11 governates for the two MNOs, as shown in Figure 18. In addition, they launched super-fast and reliable 4G and 5G fixed wireless (FWA) access. A trial demonstrated Omantel and Ericsson's ability to deliver multi-gigabit speeds of the FWA using a carrier bandwidth of 800 MHz at 26 GHz. Ooredoo and Nokia initially covered 3000 homes in city centers with the 5G FWA services using Nokia equipment [11]. In addition, TRA Oman declared that a third operator mobile license (Vodafone) would be in operation soon to support and improve MBB performance.

Conclusions
This study presented a performance analysis of the existing national MNOs in Oman. A drive test was conducted in urban and suburban areas. The network performance of the MNOs was analyzed by several performance metrics such as signal level and quality (RSRP, RSRQ and CQI), DL/UL throughput, ping rate and handover number. The measurement results showed that the MNOs in all cities have almost the same signal and quality levels. Higher UL and DL throughput is achieved in Ibra city, whereas operator X obtains a higher ping rate than other cities in Bahla. Additionally, operator X achieves a In addition, they launched super-fast and reliable 4G and 5G fixed wireless (FWA) access. A trial demonstrated Omantel and Ericsson's ability to deliver multi-gigabit speeds of the FWA using a carrier bandwidth of 800 MHz at 26 GHz. Ooredoo and Nokia initially covered 3000 homes in city centers with the 5G FWA services using Nokia equipment [11]. In addition, TRA Oman declared that a third operator mobile license (Vodafone) would be in operation soon to support and improve MBB performance.

Conclusions
This study presented a performance analysis of the existing national MNOs in Oman. A drive test was conducted in urban and suburban areas. The network performance of the MNOs was analyzed by several performance metrics such as signal level and quality (RSRP, RSRQ and CQI), DL/UL throughput, ping rate and handover number. The measurement results showed that the MNOs in all cities have almost the same signal and quality levels. Higher UL and DL throughput is achieved in Ibra city, whereas operator X obtains a higher ping rate than other cities in Bahla. Additionally, operator X achieves a higher handover number in Muscat city. In addition, the 4G networks were the dominant networks during the drive test except for operator X in Bahla city; the 3G network was recorded on one long route. Overall, MNOs achieve an average DL and UL throughput of approximately 8 Mbps and 13 Mbps, respectively, with an average ping rate and loss of 53 ms and 0.9, respectively, in the considered cities. It can be concluded that all the MNOs performed well and maintained good coverage and capacity during the drive test. In future work, this study can be further extended to include the performance of MBB in rural areas and indoor environments such as shopping malls. More importantly, the performance of 5G MBB networks will be considered in our future research.