Mobile Network Experience Report Russia December 2020

Russia

Mobile Network Experience Report
December 2020

Opensignal is the independent global standard for analyzing consumer mobile experience. Our industry reports are the definitive guide to understanding the true experience consumers receive on wireless networks.

Author
Sam Fenwick Senior Analyst

Key Findings

All four operators’ Download Speed Experience scores have improved significantly

Our users on all four of Russia’s national operators’ networks have seen their average download speeds rise by between 0.9-1.5 Mbps (5.6-11.4%) since our last report. Our MTS users saw the largest improvement in absolute terms with their speeds improving by 1.5 Mbps (11.4%), while our Beeline users saw the least with a rise of 0.9 Mbps (7.2%).

Tele2 draws level with MegaFon to jointly win the Video Experience award

Tele2 and MegaFon are joint winners of the Video Experience award. This is a step down for MegaFon as it won the award outright in our previous report, which was our first look at the Russian mobile network experience. This change was driven principally by a 2.2 point drop in MegaFon’s Video Experience score as Tele2’s rose by just 0.1 points.

Beeline catches MegaFon on Upload Speed Experience

While both our MegaFon and Beeline users saw modest declines in their average upload speeds, those on Beeline had the more resilient experience as its score for this measure of the mobile experience fell by 0.2 Mbps versus MegaFon’s drop of 0.4 Mbps. As a result, the two operators are joint winners for the Upload Speed Experience award, in contrast to our last report when MegaFon won the award outright.

Tele2 wins three awards outright: Games Experience, Voice App Experience and 4G Availability

Tele2 is now the only operator to hold more than one award as a sole winner. While Tele2 still lays claim to the same awards that it won outright last time — Games Experience, Voice App Experience and 4G Availability, its rival MegaFon has not fared as well. Out of the three awards that it won outright in our previous report — Video Experience, Download speed Experience and Upload Speed Experience — MegaFon is now the sole winner for Download Speed Experience alone.

Introduction

In this report, we've analyzed our data gathered in the 90 days from the start of August 2020 to see how Russia’s four national operators — MegaFon, Tele2, Beeline and MTS — measure up.

Our users across all four operators have seen their average download speeds increase by 0.9-1.5 Mbps. Despite these improvements in average download speeds, MegaFon’s lead is essentially unchanged since our last report — clocking in at least 6.1 Mbps. These changes also mean that MTS has moved into second-place for Download Speed Experience, after being neck-and-neck with Beeline in our previous report. The changes in the overall download speeds seen by our users were driven by improvements in operators’ 4G Download Speed scores, with there being little change in average 3G download speeds.

Looking at our experiential metrics, our users have seen falls in their Video Experience and Voice App Experience since our last report across all four operators. There was one exception, namely our Tele2 users saw a 0.1 point improvement in their Video Experience. However, none of these declines caused any of the four operators to drop down a category for either measure of the mobile experience. As a result, MegaFon and Tele2 have stayed in the Very Good (65-75) category for Video Experience, while Beeline and MTS still have to make do with a Good (55-65) rating. For Voice App Experience, MegaFon, Tele2 and Beeline remain in the Acceptable (74-80) category, while MTS continues to have a Poor (66-74) rating.

Our users spent 2.7-4.6 percentage points less of their time connected to 4G services, when compared to our previous report. This is likely an impact of the COVID-19 pandemic, which in many countries has caused users to spend more time in different locations than they did before its onset. The fact that average download speeds actually increased, despite lower 4G Availability scores and operators’ Video Experience and Voice App Experience have fallen only slightly, is a testament to the resilience of the Russian mobile experience when faced with an unprecedented situation.

All four operators have also been busy increasing their coverage as our users saw their 4G Coverage Experience improve by 0.2-0.4 points, depending on their choice of operator. Both our MegaFon and Tele2 users were at the high-end of that range, while it was our MTS users who saw their 4G Coverage Experience improve by 0.2 points. The former is perhaps not surprising, given news that Tele2 has expanded its coverage to 68 out of 83 regions.

Looking ahead, it is interesting to note the Russian government’s plans to allocate frequencies in the 4.8 GHz band to a single operator to create a 5G network, as the more widely used frequencies for 5G in the 3.4-3.8 GHz and 700 MHz bands are unavailable. How a single operator-model will work and whether the problems associated with non-standard frequency use can be resolved without making 5G prohibitively expensive to deploy in Russia are key questions at this time.

Opensignal Awards Table

Mobile Experience Awards Russia
December 2020, Russia Report
Video Experience
Games Experience
Voice App Experience
Download Speed Experience
Upload Speed Experience
4G Availability
4G Coverage Experience
Download Image
Mobile Experience Awards Winners
December 2020, Russia
Games Experience
Voice App Experience
Download Speed Experience
4G Availability
4G Coverage Experience
Mobile Experience Awards Draws
December 2020, Russia
Video Experience
Upload Speed Experience
Download Image

Overview

Click on metric labels below for a quick preview
Video Experience
in 0-100 points
MegaFon
65.5
Tele2
65.7
Beeline
62.1
MTS
64.8
0 10 20 30 40 50 60 70 80 90 100
The brackets represent confidence intervals.
Download Image

National Analysis

Video Experience

Video Experience
in 0-100 points
MegaFon
65.5
Tele2
65.7
Beeline
62.1
MTS
64.8
0 10 20 30 40 50 60 70 80 90 100
The brackets represent confidence intervals.
Download Image
Video Experience
Additional Metrics
in 0-100 points
4G Video Experience
69.5 (± 0.19) 68.1 (± 0.20) 65.4 (± 0.25) 67.4 (± 0.19)
3G Video Experience
49.8 (± 0.52) 55.1 (± 0.74) 50.6 (± 0.71) 54.7 (± 0.54)
+/- numeric values represent confidence intervals.
Mobile Network Experience Report | December 2020 | © Opensignal Limited
4G Video Experience in 0-100 points
69 (± 0.19)
68 (± 0.20)
65 (± 0.25)
67 (± 0.19)
3G Video Experience in 0-100 points
50 (± 0.52)
55 (± 0.74)
51 (± 0.71)
55 (± 0.54)
Mobile Network Experience Report | December 2020 | © Opensignal Inc.

Games Experience

Games Experience
in 0-100 points
MegaFon
43.8
Tele2
50.9
Beeline
49.1
MTS
38.4
0 10 20 30 40 50 60 70 80 90 100
The brackets represent confidence intervals.
Download Image
Games Experience
Additional Metrics
in 0-100 points
4G Games Experience
50.6 (± 0.32) 56.0 (± 0.35) 58.6 (± 0.33) 41.3 (± 0.16)
3G Games Experience
34.5 (± 0.09) 37.1 (± 0.23) 35.0 (± 0.11) 33.9 (± 0.09)
+/- numeric values represent confidence intervals.
Mobile Network Experience Report | December 2020 | © Opensignal Limited
4G Games Experience in 0-100 points
51 (± 0.32)
56 (± 0.35)
59 (± 0.33)
41 (± 0.16)
3G Games Experience in 0-100 points
35 (± 0.09)
37 (± 0.23)
35 (± 0.11)
34 (± 0.09)
Mobile Network Experience Report | December 2020 | © Opensignal Inc.

Voice App Experience

Voice App Experience
in 0-100 points
MegaFon
74.7
Tele2
77.1
Beeline
75.7
MTS
72.9
0 10 20 30 40 50 60 70 80 90 100
The brackets represent confidence intervals.
Download Image
Voice App Experience
Additional Metrics
in 0-100 points
4G Voice App Experience
76.6 (± 0.14) 78.4 (± 0.14) 77.9 (± 0.13) 74.6 (± 0.10)
3G Voice App Experience
67.1 (± 0.28) 71.6 (± 0.33) 68.1 (± 0.31) 66.2 (± 0.27)
+/- numeric values represent confidence intervals.
Mobile Network Experience Report | December 2020 | © Opensignal Limited
4G Voice App Experience in 0-100 points
77 (± 0.14)
78 (± 0.14)
78 (± 0.13)
75 (± 0.10)
3G Voice App Experience in 0-100 points
67 (± 0.28)
72 (± 0.33)
68 (± 0.31)
66 (± 0.27)
Mobile Network Experience Report | December 2020 | © Opensignal Inc.

Download Speed Experience

Download Speed Experience
in Mbps
MegaFon
20.8
Tele2
13.0
Beeline
14.1
MTS
14.7
06.2512.518.7525
The brackets represent confidence intervals.
Download Image
Download Speed Experience
Additional Metrics
in Mbps
4G Download Speed
24.6 (± 0.17) 14.4 (± 0.10) 16.3 (± 0.13) 16.7 (± 0.10)
3G Download Speed
5.7 (± 0.06) 7.0 (± 0.08) 6.6 (± 0.08) 7.1 (± 0.07)
+/- numeric values represent confidence intervals.
Mobile Network Experience Report | December 2020 | © Opensignal Limited
4G Download Speed in Mbps
25 (± 0.17)
14 (± 0.10)
16 (± 0.13)
17 (± 0.10)
3G Download Speed in Mbps
6 (± 0.06)
7 (± 0.08)
7 (± 0.08)
7 (± 0.07)
Mobile Network Experience Report | December 2020 | © Opensignal Inc.

Upload Speed Experience

Upload Speed Experience
in Mbps
MegaFon
6.7
Tele2
5.9
Beeline
6.7
MTS
6.1
01.8753.755.6257.5
The brackets represent confidence intervals.
Download Image
Upload Speed Experience
Additional Metrics
in Mbps
4G Upload Speed
8.1 (± 0.06) 6.9 (± 0.06) 8.3 (± 0.07) 7.3 (± 0.05)
3G Upload Speed
1.1 (± 0.02) 1.5 (± 0.03) 1.3 (± 0.02) 1.4 (± 0.02)
+/- numeric values represent confidence intervals.
Mobile Network Experience Report | December 2020 | © Opensignal Limited
4G Upload Speed in Mbps
8 (± 0.06)
7 (± 0.06)
8 (± 0.07)
7 (± 0.05)
3G Upload Speed in Mbps
1 (± 0.02)
2 (± 0.03)
1 (± 0.02)
1 (± 0.02)
Mobile Network Experience Report | December 2020 | © Opensignal Inc.

4G Availability

4G Availability
% of time
MegaFon
78.2
Tele2
82.4
Beeline
75.6
MTS
76.1
021.2542.563.7585
The brackets represent confidence intervals.
Download Image

4G Coverage Experience

4G Coverage Experience
in 0-10 points
MegaFon
5.9
Tele2
5.4
Beeline
5.4
MTS
6.3
0 1 2 3 4 5 6 7 8 9 10
The brackets represent confidence intervals.
Download Image
Learn more

Opensignal measures the real-world experience of consumers on mobile networks in the places they live, work and travel.

We continually adapt our methodology to best represent the true experience of smartphone users. Therefore, comparisons of the results to past reports should be considered indicative only.

For every metric we calculate statistical confidence intervals indicated on our graphs. When confidence intervals overlap, our measured results are too close to declare a winner. In those cases, we show a statistical draw. For this reason, some metrics have multiple winners.

In our bar graphs we represent confidence intervals as boundaries on either sides of graph bars. In our supporting-metric charts we show confidence intervals as +/- numerical values.

More about Methodology

Subscribe to our newsletter and get our latest reports and analyses delivered right to your inbox every 2 weeks. We will not share your email address with third parties.

Journalists, please retain the Opensignal logo and copyright
(© Opensignal Limited) information when using this image.

This image may not be used for any commercial purpose, including use in advertisements or other promotional content, without prior written consent.

For every metric we calculate statistical confidence intervals indicated on our graphs. When confidence intervals overlap, our measured results are too close to declare a winner. In those cases, we show a statistical draw. For this reason, some metrics have multiple operator winners.

In our bar graphs we represent confidence intervals as boundaries on either sides of graph bars.

In our supporting-metric charts we show confidence intervals as +/- numerical values.

Why confidence intervals are vital in analyzing mobile network experience