Opensignal is the independent global standard for analyzing consumers' connectivity experiences. Our industry reports are the definitive guide to understanding what happens when people use their mobile and broadband connections in their daily life.
Opensignal is the independent global standard for analyzing consumers' connectivity experiences. Our industry reports are the definitive guide to understanding what happens when people use their mobile and broadband connections in their daily life.
Vodafone is the first Italian operator to win Opensignal’s new Reliability Experience award. It does so with a score of 890 points on a 100-1000 point scale and a lead of 12 points over second-placed Iliad’s 878 points. Reliability Experience measures the ability of our users to connect to and successfully complete basic tasks on operators’ networks.
WindTre is once again the outright winner of the 5G Availability award, this time with a score of 24.5% and a lead of four percentage points over second-placed Iliad’s 20.5%. 5G Availability is an important measure of the mobile experience as users can only enjoy the superior experience that 5G provides when they have an active 5G connection.
As was the case in the last report, Iliad is the outright winner of the 5G Games Experience award, winning it this time with a score of 77.5 points on a 100-point scale and a lead of around one point over statistically tied Vodafone and WindTre. Similarly, Vodafone keeps hold of the overall Games Experience award with a score of 70 points on a 100-point scale and a lead of one point over second-placed TIM.
Vodafone takes home all four of our speed awards: Download Speed Experience, Upload Speed Experience, 5G Download Speed and 5G Upload Speed. It retains the former two from the previous report and has replaced TIM as the outright winner of both 5G speed awards. Vodafone wins Download Speed Experience with a score of 50.2Mbps and a lead of 10Mbps (25%) over second-placed Fastweb. Vodafone scores an impressive 231.3Mbps for 5G Download Speed, 58Mbps (34%) faster than the 172.9Mbps seen by our users with now-second-placed TIM.
As was the case in the last report, our Iliad users spend the highest proportion of time with a 3G, 4G or 5G connection. Therefore Iliad remains the outright winner of the Availability award. It wins this time with a score of 98.5% and a lead of less than a percentage points over second-placed WindTre’s 98%. Iliad and WindTre are the only two operators to have ever won the Availability award in our reports on Italy and the two shared it back in our May 2023 report.
Once again, Vodafone collects the most awards. The operator wins eight out of 15 awards outright, including Opensignal’s new Reliability Experience award. Vodafone also shares the Video Experience award with Iliad — a minor step down from the last report when it won all of the overall experience awards outright. Iliad continues to win 5G Games Experience and Availability outright, while also placing first for 5G Voice App Experience. In addition, Iliad is now a joint winner alongside WindTre for the 5G Video Experience award. The only other operator to win an award outright is WindTre, which has kept a firm grip on the 5G Availability Award.
The biggest ongoing saga in the Italian mobile market is Vodafone Group’s proposed sale of Vodafone Italy to Swisscom, which intends to to merge it with Fastweb, Swisscom’s Italian subsidiary. In September, Swisscom announced that Italy’s competition authority (Autorita Garante della Concorrenza e del Mercato, AGCM) had opened a thorough investigation to assess the impact of the deal given its concerns that the deal could affect competition in the fixed broadband wholesale services market. Later in the same month, Vodafone Group said that the sale would not require shareholder approval. Swisscom expects that if the deal is approved, it would be finalised in Q1 2025. Should the deal go through, the implications will be particularly significant for WindTre, given that it is currently Fastweb’s roaming partner for 4G and legacy technologies and the two operators operate a shared 5G network.
Back in April, WindTre said that it had begun the first phase of its 3G switch-off, which involves ending its use of the 2100MHz band — the spectrum will be reallocated to support 4G and 5G services. Repurposing spectrum in this way helps reduce congestion and improve users’ mobile experience. TIM announced it had shut down its 3G network in October 2022, while Vodafone’s was fully shut down by the end of February 2021.
Also, in April 2024, Italy’s Ministry for Enterprises and Made in Italy (Ministero delle imprese e del made in Italy, MIMIT) announced new — less stringent — electromagnetic field (EMF) limits, upping them to 15 volts per meter (V/m) up from the previous threshold of 6V/m. However, this is still very strict, given that the International Commission on Non-Ionizing Radiation Protection recommends 61V/m. Asstel (the Italian mobile telecoms trade association) has complained in the past that such limits require its members to deploy more transmitters, increasing costs and lowering energy efficiency.
In this report we examine the mobile network experience of the five main mobile network operators in Italy — Vodafone, Fastweb, TIM, Iliad and WindTre — over a period of 90 days starting on July 01, 2024, and ending on September 28, 2024, to see how they fared.
Vodafone has gone from winning the Video Experience award outright in the previous report to being a joint winner alongside Iliad due to their statistically tied scores of 67.1-67.3 points on a 100-point scale. They have a lead of around one point over TIM, which places in third with its score of 66.5 points. Fastweb and WindTre share fourth place with statistically tied scores of 65.5-65.6 points.
All operators place in the Good (58-68) category. This indicates that our users are, on average, able to stream video at 720p or better with satisfactory loading times and little stalling.
Video Experience scores account for adaptive bitrate streaming (ABR), a technology that allows Opensignal to accurately represent users' real video experience including video streams up to 4K quality.
Opensignal’s Video Experience quantifies the quality of video streamed to mobile devices by measuring real-world video streams over an operator's networks. The metric is based on an International Telecommunication Union (ITU) approach, built upon detailed studies which have derived a relationship between technical parameters, including picture quality, video loading time and stall rate, with the perceived video experience as reported by real people. To calculate video experience, we are directly measuring video streams from end-user devices and using this ITU approach to quantify the overall video experience for each operator on a scale from 0 to 100. The videos tested include a mixture of resolutions — including Full HD (FHD) and 4K / Ultra HD (UHD) — and are streamed directly from the world’s largest video content providers.
In addition to Video Experience, we report on the following metrics related to video experience:
Our Vodafone users continue to have the best available overall experience in Italy when playing multiplayer mobile games over cellular connections. Vodafone wins the Games Experience award this time around with a score of 70 points on a 100-point scale and a lead of one point over TIM, which is in second place with 69 points. Iliad comes third with a score of 68.2 points. WindTre is in fourth place with 66.9 points. Fastweb is fifth with a score of 66.3 points.
All operators place in the Fair (65-75) category. This means that users find the experience to be ‘average’. In most cases the game is responsive to the actions of the player with most users feeling like they have control over the game. The majority of players notice a delay between their actions and the outcomes in the game.
Opensignal’s Games Experience measures how mobile users experience real-time multiplayer mobile gaming on an operator’s network. Measured on a scale of 0-100, it analyzes how our users’ multiplayer mobile gaming experience is affected by mobile network conditions including latency, packet loss and jitter.
Games Experience quantifies the experience when playing real-time multiplayer mobile games on mobile devices connected to servers located around the world. The approach is built on several years of research quantifying the relationship between technical network parameters and the gaming experience as reported by real mobile users. These parameters include latency (round trip time), jitter (variability of latency) and packet loss (the proportion of data packets that never reach their destination). Additionally, it considers multiple genres of multiplayer mobile games to measure the average sensitivity to network conditions. The games tested include some of the most popular real-time multiplayer mobile games (such as Fortnite, Pro Evolution Soccer and Arena of Valor) played around the world.
Calculating Games Experience starts with measuring the end-to-end experience from users’ devices to internet end-points that host real games. The score is then measured on a scale from 0 to 100.
In addition to Games Experience, we report on the following metrics related to games experience:
Vodafone is the outright winner of the Voice App Experience award. It wins with a score of 78 points on a 100-point scale and by a very slender margin given second-placed Iliad’s score of 77.8 points. WindTre and TIM share third place with identical scores of 76.9 points, while Fastweb places last with a fractionally lower 76.4 points.
All five operators place in the Acceptable (74-80) category — some users are satisfied but others experience perceptible call quality impairments. For example, they may hear distortion or clicking sounds for a short duration and/or the volume may not be sufficiently loud. However, listeners are generally able to comprehend without repetition.
Opensignal's Voice App Experience measures the quality of experience for over-the-top (OTT) voice services — mobile voice apps such as WhatsApp, Skype and Facebook Messenger — using a model derived from the International Telecommunication Union (ITU) approach for quantifying overall voice call quality and a series of calibrated technical parameters. This model characterizes the exact relationship between the technical measurements and perceived call quality. Voice App Experience for each operator is calculated on a scale from 0 to 100.
In addition to Voice App Experience, we report on the following metrics related to voice app experience:
Vodafone continues to be the outright winner of the Download Speed Experience award. It wins this time around with a score of 50.2Mbps and a lead of 10Mbps (25%) over Fastweb, which is in second place with its score of 40.1Mbps. WindTre comes third with 38.2Mbps. TIM is in fourth place with a score of 37.6Mbps, while Iliad is in last place with 31.2Mbps.
All five operators’ average overall download speeds have increased from those seen in the previous report. Vodafone users saw the largest improvement — a rise of 12Mbps. WindTre's score has risen by 9Mbps, while both Fastweb’s and TIM’s scores rose by 6Mbps. Iliad's score has increased by 4Mbps.
Measured in Mbps, Download Speed Experience represents the typical everyday speeds a user experiences across an operator’s mobile data networks.
In addition to Download Speed Experience, we report on the following metrics related to download speeds:
Our Vodafone users once again see the fastest overall average upload speeds in Italy. Vodafone therefore continues to be the outright winner of the Upload Speed Experience award, this time with a score of 11.7Mbps. This gives it a lead of 2Mbps (16%) over second-placed WindTre’s 10.1Mbps. Fastweb is in third place with a score of 9.4Mbps. TIM is fourth with 8.9Mbps, while Iliad is in last place with its score of 7.8Mbps.
Vodafone's score has increased the most in percentage terms from the previous report, rising by 13%, while WindTre's and Iliad’s scores have both risen by 7% — while Fastweb's has risen by 5%. TIM's score hasn't changed by a significant amount from the previous report.
Upload Speed Experience measures the average upload speeds for each operator observed by our users across their mobile data networks. Typically upload speeds are slower than download speeds, as current mobile broadband technologies focus resources on providing the best possible download speed for users consuming content on their devices. As mobile internet trends move away from downloading content to creating content and supporting real-time communications services, upload speeds are becoming more vital and new technologies are emerging that boost upstream capacity.
In addition to Upload Speed Experience, we report on five supporting metrics related to upload speeds:
Iliad and WindTre are the joint winners of the 5G Video Experience award, knocking TIM — the outright winner in the last report — from the winners’ podium. Iliad and WindTre win with statistically tied scores of 75.2-75.3 points on a 100-point scale and a very narrow lead over Fastweb, which places in third with its score of 74.9 points. Vodafone and TIM share fourth place with statistically tied scores of 73.8-74.1 points.
All operators place in the Very Good (68-78) category. This indicates that our users are, on average, able to stream video at 1080p or better with satisfactory loading times and little stalling.
5G Video Experience scores account for adaptive bitrate streaming (ABR), a technology that allows Opensignal to accurately represent users' real video experience including video streams up to 4K quality.
5G Video Experience quantifies the quality of mobile video experienced by Opensignal users on real-world video streams when they were connected to 5G. The metric is based on an International Telecommunication Union (ITU) approach, built upon detailed studies which have derived a relationship between technical parameters, including picture quality, video loading time and stall rate, with the perceived video experience as reported by real people. To calculate 5G Video Experience, we are directly measuring video streams from end-user devices and using this ITU approach to quantify the video experience observed by our users on each operator’s 5G network on a scale from 0 to 100. The videos tested include a mixture of resolutions — including Full HD (FHD) and 4K / Ultra HD (UHD) — and are streamed directly from the world’s largest video content providers.
As was the case in the previous report, Iliad is the outright winner of the 5G Games Experience awad. This means that our Iliad users have the best available experience when playing multiplayer mobile games over 5G connections in Italy. Iliad wins with a score of 77.5 points on a 100-point scale and a lead of around one point over Vodafone and WindTre, which share second-place with their statistically tied scores of 76.1-76.4 points. TIM and Fastweb and share fourth place with statistically tied scores of 74.2-74.7 points.
Vodafone, Iliad and WindTre place in the Good (75-85) category, while Fastweb and TIM place one category lower, in Fair (65-75).
A Good (75-85) rating means that most users deem the experience acceptable. The gameplay experience is generally controllable and the user receives immediate feedback between their actions and the outcomes in the game. Most users do not experience a delay between their actions and the game. A Fair (65-75) rating means that users find the experience to be ‘average’. In most cases the game is responsive to the actions of the player with most users feeling like they have control over the game. The majority of players notice a delay between their actions and the outcomes in the game.
5G Games Experience measures how mobile users experience real-time multiplayer mobile gaming on an operator's 5G network. It analyzes how our users’ multiplayer mobile gaming experience was affected by mobile network conditions including latency, packet loss and jitter. 5G Games Experience for each operator is calculated on a scale from 0 to 100.
5G Games Experience quantifies the experience when playing real-time multiplayer mobile games on mobile devices connected to servers located around the world. The approach is built on several years of research quantifying the relationship between technical network parameters and the gaming experience as reported by real mobile users. These parameters include latency (round trip time), jitter (variability of latency) and packet loss (the proportion of data packets that never reach their destination). Additionally, it considers multiple genres of multiplayer mobile games to measure the average sensitivity to network conditions. The games tested include some of the most popular real-time multiplayer mobile games (such as Fortnite, Pro Evolution Soccer and Arena of Valor) played around the world. Calculating 5G Games Experience starts with measuring the end-to-end experience from users’ devices to internet end-points that host real games.
Our Iliad users have the best available experience when using over-the-top voice apps over 5G connections — making Iliad the outright winner of the 5G Voice App Experience award. It wins with a score of 82 points on a 100-point scale, giving it a lead of under one point over second-placed WindTre. WindTre is followed by Vodafone with its score of 80.8 points, while Fastweb and Tim are in fourth and fifth place, respectively, with 80.4 points and 79.6 points.
Four out of five Italian national operators achieve a Good (80-87) rating for 5G voice app services. This means that many users are satisfied, but some experience minor quality impairments. The exception is TIM, which places one category lower — Acceptable (74-80).
5G Voice App Experience quantifies the experience of Opensignal users when using over-the-top voice apps — such as WhatsApp, Skype and Facebook Messenger — on an operator’s 5G network. It uses a model derived from the International Telecommunication Union (ITU) approach for quantifying overall voice call quality and a series of calibrated technical parameters. This model characterizes the exact relationship between the technical measurements and perceived call quality. 5G Voice App Experience for each operator is calculated on a scale from 0 to 100.
Vodafone has replaced TIM as the sole winner of the 5G Download Speed award. Our Vodafone users now see the fastest average 5G download speeds in Italy — 231.3Mbps, which is 58Mbps (34%) faster than the 172.9Mbps seen by users with now-second-placed TIM. Fastweb is in third place with a score of 151.2Mbps. WindTre is in fourth place with 122.1Mbps, followed by Iliad with its score of 71.7Mbps.
The average 5G download speeds seen by our Vodafone users have increased by 29Mbps, while those seen on WindTre have risen by 20Mbps. Fastweb's score has increased by 12Mbps. However, TIM's has fallen by 66Mbps and Iliad's score hasn't changed a significant amount since the previous report.
5G Download Speed shows the average download speed experienced by Opensignal users across an operator’s 5G network. 5G Download Speed for each operator is calculated in Mbps (Megabits per second).
As is the case with the 5G Download Speed award, the 5G Upload Speed award has gone from being won outright by TIM in the last report to being claimed by Vodafone. Vodafone wins with a score of 21.4Mbps and a lead of around 3Mbps (15%) over Fastweb, TIM and WindTre which all share second place with their statistically tied scores of 18.6-18.7Mbps. Iliad is in last place with a score of 12.7Mbps.
Our users with WindTre, Fastweb and Iliad have all seen their average 5G upload speeds improve from the last report, with relative improvements of 13%, 11% and 7%, respectively. In contrast, TIM's score has fallen by 4Mbps (18%), while Vodafone's score hasn't changed by a statistically significant amount since the previous report.
5G Upload Speed measures the average upload speeds experienced by Opensignal users across an operator’s 5G network. 5G Upload Speed for each operator is calculated in Mbps (Megabits per second).
As was the case in the previous report, Fastweb and WindTre share the 5G Coverage Experience award. They do so with identical scores of 5.9 points on a 10-point scale and a lead of around one point over third-placed Vodafone’s 4.6 points. Iliad is in fourth place with a score of 4.1 points, while TIM is last with 3.4 points.
Both TIM's and Vodafone’ scores have increased by two points from those seen in the previous report, while Iliad's, WindTre's and Fastweb's scores have all improved by one point.
The Opensignal Coverage Experience metric measures the extent of mobile networks in the places people live, work and travel. The metric represents the experience users receive as they travel around areas where they would reasonably expect to find coverage.
Traditional coverage metrics typically estimate either a percentage of land area covered, or a percentage of population covered; often neither will be an accurate measurement of the true user expectation and experience. In many markets there are areas where neither population density nor geographic area reflect the importance of coverage to users. For example, in a large mountain range most users will not expect coverage in the wilderness, but poor coverage in the relatively small area of a ski resort is critical for the enjoyment of a holiday. Estimates based purely on population give undue significance to coverage in the most densely populated areas.
Coverage Experience measures geographic coverage of populated areas and therefore more accurately reflects the coverage expectations and experience of typical users. It can give a result that is somewhat different to traditional estimates based on either geographic or population measures. The metric uses a scale from 0 to 10.
5G Coverage Experience shows the proportion of places Opensignal users with a 5G device and a 5G subscription had an active 5G connection.
Iliad continues to win the Availability award outright, doing so this time around with a score of 98.5% and a lead of less than a percentage points over second-placed WindTre’s 98%. Vodafone is in third place with a score of 97.4%. TIM and Fastweb share fourth place with statistically tied scores of 96.3-96.4%.
TIM's Availability has risen by two percentage points from the previous report, while both Vodafone's and Fastweb's scores have increased by one percentage point. Both WindTre's and Iliad’s scores have dropped by less than a percentage point.
Our availability metrics are not a measure of a network’s geographical extent. They won’t tell you whether you are likely to get a signal if you plan to visit a remote rural or nearly uninhabited region. Instead, they measure what proportion of time people have a network connection, in the places they most commonly frequent — something often missed by traditional coverage metrics. Looking at when users have a connection rather than where, provides us with a more precise reflection of the true user experience.
We also keep track of the instances that leave mobile users most frustrated: when there is no signal to connect to at all. The most common dead zones users struggle with occur indoors. As most of our availability data is collected indoors (as that’s where users spend most of their time), we’re particularly astute at detecting areas of zero signal.
Our availability metrics take a user-centric, time-based approach that complements the user-centric and geographical-based methodology used by our reach metrics.
Availability shows the proportion of time all Opensignal users on an operator’s network had either a 3G, 4G or 5G connection.
Once again, WindTre is the outright winner of the 5G Availability award. It wins this time around with a score of 24.5% and a lead of four percentage points over second-placed Iliad’s 20.5%. Fastweb is in third place with a score of 18.9%. Vodafone follows in fourth place with its score of 18.2%, up from 12.4% since our 2023 report. While TIM is in last place with 12.8%, this has jumped from 5.5% last time around. 5G Availability is the proportion of time that our 5G users have an active 5G connection.
Our availability metrics are not a measure of a network’s geographical extent. They won’t tell you whether you are likely to get a signal if you plan to visit a remote rural or nearly uninhabited region. Instead, they measure what proportion of time people have a network connection, in the places they most commonly frequent — something often missed by traditional coverage metrics. Looking at when users have a connection rather than where, provides us with a more precise reflection of the true user experience.
We also keep track of the instances that leave mobile users most frustrated: when there is no signal to connect to at all. The most common dead zones users struggle with occur indoors. As most of our availability data is collected indoors (as that’s where users spend most of their time), we’re particularly astute at detecting areas of zero signal.
Our availability metrics take a user-centric, time-based approach that complements the user-centric and geographical-based methodology used by our reach metrics.
5G Availability shows the proportion of time Opensignal users with a 5G device and a 5G subscription had an active 5G connection.
Vodafone continues to win the Consistent Quality award outright, this time with a score of 79.5% and a lead of four percentage points over Iliad, which places in second with its score of 75.9%. TIM comes third with a score of 75%, jumping from fifth place in the previous report. WindTre comes fourth with 72.3%. Fastweb is in fifth with a score of 72.1%.
TIM has seen the greatest improvement in Consistent Quality compared to the previous report — a rise of 17 percentage points. Iliad saw the next largest improvement, as its score has increased by eight percentage points. Both WindTre's and Vodafone’s scores have increased by four percentage points, while Fastweb's score rose by three percentage points.
This metric measures if the network is sufficient to support common mobile application requirements at a level that is ‘good enough’ for users to maintain (or complete) various typical demanding tasks on their devices. It assesses a number of experience indicators such as download speed, upload speed, latency, jitter, packet loss, and time to first byte.
Consistent Quality measures if the network is sufficient to support common mobile application requirements at a level that is ‘good enough’ for users to maintain (or complete) various typical tasks on their devices.
We combine different experience indicators such as download speed, upload speed, latency, jitter, packet discard, and time to first byte to calculate Consistent Quality. These components are evaluated against thresholds recommended by various more demanding common applications used for a range of common tasks.
To calculate the metric value, the proportion of tests that pass the requirements of Consistent Quality is multiplied by the test success ratio, which is the proportion of completed tests to all tests conducted. Tests that pass indicate that activities such as video calling, uploading an image to social media, or using smart home applications will be possible without noticeable lag or slowdown.
Vodafone is the first Italian operator to win Opensignal’s new Reliability Experience award. It does so with a score of 890 points on a 100-1000 point scale and a lead of 12 points over second-placed Iliad’s 878 points. TIM is in third place with its score of 853 points. Fastweb and WindTre share fourth place with identical scores of 841 points.
Opensignal’s Reliability Experience measures the ability of our users to connect to and successfully complete (basic) tasks on operators’ networks. It consists of the following components:
Signal Availability — The proportion of time Opensignal users can successfully connect to a mobile network
Data Connectivity — the proportion of time when the network is available and the device can connect to the internet
Task completion — whether tasks initiated by the user’s device are completed
Sufficiency — The probability that (basic) tasks will be executed sufficiently well for the user
Opensignal’s Reliability Experience measures the ability of Opensignal users to connect to and successfully complete (basic) tasks on communication service providers’ (CSP) networks. It analyzes how much Opensignal users’ experience is affected by the radio access and core network, along with issues that prevent them from connecting to the internet even if they have a connection to their CSP’s network. It also factors in users’ ability to successfully use lower performance applications including SD video, over-the-top voice calls and web browsing.
Collecting billions of individual measurements daily from over 100 million devices globally, Opensignal independently analyzes mobile and broadband user experience on every major network operator around the globe.
Opensignal is the leading global provider of independent insights into consumers' connectivity experiences and choice of carrier. Our proprietary insights into mobile and broadband networks give operators the solutions they need to profitably compete and win, from executive level scorecards and public validation to pin-point level engineering analytics and consumer decision dynamics.
Journalists, please retain the Opensignal logo and copyright
(© Opensignal Limited) information when using this image.
This image may not be used for any commercial purpose, including use in advertisements or other promotional content, without prior written consent.
For every metric we calculate statistical confidence intervals indicated on our graphs. When confidence intervals overlap, our measured results are too close to declare a winner. In those cases, we show a statistical draw. For this reason, some metrics have multiple operator winners.
In our bar graphs we represent confidence intervals as boundaries on either sides of graph bars.
In our supporting-metric charts we show confidence intervals as +/- numerical values.
Why confidence intervals are vital in analyzing mobile network experience