Opensignal is the independent global standard for analyzing consumers' connectivity experiences. Our industry reports are the definitive guide to understanding what happens when people use their mobile and broadband connections in their daily life.
Opensignal is the independent global standard for analyzing consumers' connectivity experiences. Our industry reports are the definitive guide to understanding what happens when people use their mobile and broadband connections in their daily life.
Our users observed the fastest average download speeds of 31.4 Mbps on Batelco’s network, followed by Zain and stc with 26.1 Mbps and 22.6 Mbps, respectively. However, we observed completely different operator placings when looking at our users’ average upload speeds. Zain and stc share the Upload Speed Experience award with scores in the 9.2-9.5 Mbps range, ahead of Batelco at 8.2 Mbps.
Besides having the fastest average download speeds, our users on Batelco’s network also enjoyed the best multiplayer mobile gaming experience, as well as the best experience for over-the-top (OTT) voice services together with Zain. In Games Experience Batelco scored 71.5 points, ahead of Zain and stc with statistically tied scores in the 61.6-64.3 point range. This means that, while Batelco placed in the Fair category (65-75), stc and Zain obtained Poor ratings (40-65) for Games Experience. In Voice App Experience, Batelco and Zain shared first place with scores in the 78.4-79.3 point range.
In the Coverage section, Batelco and stc are joint winners for the Availability award having scored above 98%, ahead of Zain with 95.1%. However, we have a three-way tie in 4G Coverage Experience as Batelco, stc and Zain all had statistically tied scores in the 9.7-10 point range on a 10 point scale. While Availability represents the proportion of time all Opensignal users on an operator’s network had either a 3G, 4G or 5G connection, 4G Coverage Experience analyzes the locations where customers of a network operator received a 4G signal relative to the locations visited by users of all network operators.
Zain wins the Excellent Consistent Quality award with a 0.9 percentage point margin over second-placed Batelco. In Core Consistent Quality, stc beats Zain by 1.8 percentage points. Our measures of consistent quality quantify how often users’ experience on a network was sufficient to support common applications’ requirements. Excellent Consistent Quality analyzes the percentage of users' tests that met the minimum recommended thresholds for watching HD video, completing group video conference calls and playing games. Core Consistent Quality uses thresholds for less demanding applications.
Our users on Batelco, stc and Zain all had a similar mobile video streaming experience as the three operators achieved statistically tied Video Experience scores in the 48.3-49.1 point range on a 100 point scale. This means that Batelco, stc and Zain are joint winners for the Video Experience award, with scores placing in the Fair category (40-55).
In our first report on the mobile network experience in Bahrain we see a highly competitive landscape with all three mobile operators winning multiple awards. Batelco is the sole winner in Games Experience and Download Speed Experience, while stc and Zain are the outright winners for Core Consistent Quality and Excellent Consistent Quality, respectively. All three operators are joint winners in four additional categories, each.
Bahrain’s mobile operators have been investing in 5G to improve their users’ mobile experience. Batelco launched its commercial 5G network in June 2019 and later claimed nationwide 5G coverage in October 2020. Mobile operator stc — previously branded as Viva — launched its home broadband 5G network in June 2019 and has since worked on expanding its 5G reach. Finally, Zain launched commercial 5G services in June 2020 and later announced further investments to expand its 4G and 5G networks.
In this report we examine the mobile network experience of the three mobile network operators in Bahrain — Batelco, stc and Zain — over a period of 90 days starting on February 1, 2022 and ending on May 1, 2022, to see how they fared. We have used 5G measurements in addition to those from previous generations of mobile network technology when determining the overall scores for each award.
Opensignal’s Video Experience quantifies the quality of video streamed to mobile devices by measuring real-world video streams over an operator's networks. The metric is based on an International Telecommunication Union (ITU) approach, built upon detailed studies which have derived a relationship between technical parameters, including picture quality, video loading time and stall rate, with the perceived video experience as reported by real people. To calculate video experience, we are directly measuring video streams from end-user devices and using this ITU approach to quantify the overall video experience for each operator on a scale from 0 to 100. The videos tested include a mixture of resolutions — including Full HD (FHD) and 4K / Ultra HD (UHD) — and are streamed directly from the world’s largest video content providers.
In addition to Video Experience, we report on the following metrics related to video experience:
Opensignal’s Games Experience measures how mobile users experience real-time multiplayer mobile gaming on an operator’s network. Measured on a scale of 0-100, it analyzes how our users’ multiplayer mobile gaming experience is affected by mobile network conditions including latency, packet loss and jitter.
Games Experience quantifies the experience when playing real-time multiplayer mobile games on mobile devices connected to servers located around the world. The approach is built on several years of research quantifying the relationship between technical network parameters and the gaming experience as reported by real mobile users. These parameters include latency (round trip time), jitter (variability of latency) and packet loss (the proportion of data packets that never reach their destination). Additionally, it considers multiple genres of multiplayer mobile games to measure the average sensitivity to network conditions. The games tested include some of the most popular real-time multiplayer mobile games (such as Fortnite, Pro Evolution Soccer and Arena of Valor) played around the world.
Calculating Games Experience starts with measuring the end-to-end experience from users’ devices to internet end-points that host real games. The score is then measured on a scale from 0 to 100.
In addition to Games Experience, we report on the following metrics related to games experience:
Opensignal's Voice App Experience measures the quality of experience for over-the-top (OTT) voice services — mobile voice apps such as WhatsApp, Skype and Facebook Messenger — using a model derived from the International Telecommunication Union (ITU) approach for quantifying overall voice call quality and a series of calibrated technical parameters. This model characterizes the exact relationship between the technical measurements and perceived call quality. Voice App Experience for each operator is calculated on a scale from 0 to 100.
In addition to Voice App Experience, we report on the following metrics related to voice app experience:
Measured in Mbps, Download Speed Experience represents the typical everyday speeds a user experiences across an operator’s mobile data networks.
In addition to Download Speed Experience, we report on the following metrics related to download speeds:
Upload Speed Experience measures the average upload speeds for each operator observed by our users across their mobile data networks. Typically upload speeds are slower than download speeds, as current mobile broadband technologies focus resources on providing the best possible download speed for users consuming content on their devices. As mobile internet trends move away from downloading content to creating content and supporting real-time communications services, upload speeds are becoming more vital and new technologies are emerging that boost upstream capacity.
In addition to Upload Speed Experience, we report on five supporting metrics related to upload speeds:
Our availability metrics are not a measure of a network’s geographical extent. They won’t tell you whether you are likely to get a signal if you plan to visit a remote rural or nearly uninhabited region. Instead, they measure what proportion of time people have a network connection, in the places they most commonly frequent — something often missed by traditional coverage metrics. Looking at when users have a connection rather than where, provides us with a more precise reflection of the true user experience.
We also keep track of the instances that leave mobile users most frustrated: when there is no signal to connect to at all. The most common dead zones users struggle with occur indoors. As most of our availability data is collected indoors (as that’s where users spend most of their time), we’re particularly astute at detecting areas of zero signal.
Our availability metrics take a user-centric, time-based approach that complements the user-centric and geographical-based methodology used by our reach metrics.
Availability shows the proportion of time all Opensignal users on an operator’s network had either a 3G, 4G or 5G connection.
4G Coverage Experience measures how mobile subscribers experience 4G coverage on an operator’s network. Measured on a scale of 0-10, it analyzes the locations where customers of a network operator received a 4G signal relative to the locations visited by users of all network operators.
In simple terms, 4G Coverage Experience measures the mobile coverage experience in all the locations that matter most to everyday users — i.e. all the places where they live, work and travel. It considers all the areas that Opensignal users visit, the portion of locations that 4G is available to them, and locations that more users visit have higher importance to them.
Consistent Quality measures how often users’ experience on a network was sufficient to support common applications’ requirements. It measures download speed, upload speed, latency, jitter, packet loss, time to first byte and the percentage of tests attempted which did not succeed due to a connectivity issue on either the download or server response component.
Full details on how the Consistent Quality metrics — Excellent Consistent Quality and Core Consistent Quality — are calculated can be found here.
Excellent Consistent Quality is the percentage of users’ tests that met the minimum recommended performance thresholds to watch HD video, complete group video conference calls and play games.
Consistent Quality measures how often users’ experience on a network was sufficient to support common applications’ requirements. It measures download speed, upload speed, latency, jitter, packet loss, time to first byte and the percentage of tests attempted which did not succeed due to a connectivity issue on either the download or server response component.
Full details on how the Consistent Quality metrics — Excellent Consistent Quality and Core Consistent Quality — are calculated can be found here.
Core Consistent Quality is the percentage of users’ tests that met the minimum recommended performance thresholds for lower performance applications including SD video, voice calls and web browsing.
Collecting billions of individual measurements daily from over 100 million devices globally, Opensignal independently analyzes mobile and broadband user experience on every major network operator around the globe.
Opensignal is the leading global provider of independent insights into consumers' connectivity experiences and choice of carrier. Our proprietary insights into mobile and broadband networks give operators the solutions they need to profitably compete and win, from executive level scorecards and public validation to pin-point level engineering analytics and consumer decision dynamics.
Journalists, please retain the Opensignal logo and copyright
(© Opensignal Limited) information when using this image.
This image may not be used for any commercial purpose, including use in advertisements or other promotional content, without prior written consent.
For every metric we calculate statistical confidence intervals indicated on our graphs. When confidence intervals overlap, our measured results are too close to declare a winner. In those cases, we show a statistical draw. For this reason, some metrics have multiple operator winners.
In our bar graphs we represent confidence intervals as boundaries on either sides of graph bars.
In our supporting-metric charts we show confidence intervals as +/- numerical values.
Why confidence intervals are vital in analyzing mobile network experience