Skip to main content

Broadband Network Experience Metrics

Definitions Based on Real-World Network Experiences

Consistent Quality Consistent Quality

Broadband Consistent Quality (BCQ) measures the network experience from the perspective of a single device, assuming that connectivity has first been established. BCQ specifically measures whether the network can consistently meet the needs of common tasks for a single device. It sets thresholds for performance metrics like download and upload speeds at levels appropriate for individual rather than multiple device usage (unlike the broader sufficiency thresholds used in the Broadband Reliability metric).

BCQ uses six key performance indicators: download and upload speeds, latency, jitter, packet loss, and time to first byte, setting thresholds appropriate for individual rather than multiple device usage. These components are evaluated against thresholds recommended for various demanding common applications used for a range of common tasks.

To calculate the metric value, the proportion of tests that pass the requirements of CQ is multiplied by the test success ratio, which is the proportion of completed tests to all tests conducted. Tests that pass indicate that activities such as video calling, uploading an image to social media, or using smart home applications will be possible without noticeable lag or slowdown.

The pre-determined thresholds for the component performance metrics are:

  • Download Speed > 5 Mbps
  • Upload Speed > 1.5 Mbps
  • Latency < 50ms
  • Jitter < 12ms
  • Packet discard < 1%
  • Time to first byte <0.8s
Video Experience Video Experience

Opensignal’s Video Experience quantifies the quality of video streamed to mobile end user devices by measuring real-world video streams over an operator's networks. The metric is based on an International Telecommunication Union (ITU) approach , built upon detailed studies which have derived a relationship between technical parameters, including picture quality, video loading time and stall rate, with the perceived video experience as reported by real people.

Opensignal’s Video Experience quantifies the quality of video streamed to mobile end user devices by measuring real-world video streams over an operator's networks. The metric is based on an International Telecommunication Union (ITU) approach , built upon detailed studies which have derived a relationship between technical parameters, including picture quality, video loading time and stall rate, with the perceived video experience as reported by real people.

Use the scale to relate the Video Experience
scores to the actual experience our users received

Excellent (78 or above)

Our users were, on average, able to stream video at 1080p or better with fast loading times and no stalling.

Very Good (68 or more but less than 78)

Our users were, on average, able to stream video at 1080p or better with satisfactory loading times and little stalling.

Good (58 or more but less than 68)

Our users were, on average, able to stream video at 720p or better with satisfactory loading times and little stalling.

Fair (48 or more but less than 58)

Our users were, on average, able to stream video at 720p or better with satisfactory loading times and substantial stalling.

Poor (Under 48)

Our users, on average, encountered very high loading times or high levels of stalling or were only able to stream the video at resolutions below 720p.

Download Speed (average) Download Speed

Measured in Mbps, Opensignal's Download Speed represents the average download speed a user experiences over Wi-Fi across an operator’s broadband network from an application host (CDN).

Upload Speed (average) Upload Speed

Measured in Mbps, Opensignal's Upload Speed represents the average upload speed a user experiences on WiFi across an operator’s broadband network to an application host (CDN).

Reliability Experience Reliability Experience

Opensignal's Broadband Reliability Experience measures the ability of a household to connect to the internet and to successfully complete 'uninterrupted' tasks across multiple devices, encompassing work and recreational activities. While Reliability incorporates and expands upon elements akin to Broadband Consistent Quality, it uniquely includes assessments of initial connectivity and continuous completion of tasks, making it more comprehensive in scenarios involving multiple simultaneous connections.

A reliable broadband service has become a necessity in our rapidly developing digital era as the individuals' day-to-day efficiency and recreational pursuits are directly impacted by the dependability of their internet service. A reliable connection allows users to have uninterrupted experiences such as accessing vital information, communicating with family members or streaming videos without a lag.

Calculated on a scale of 100-1000 — with higher scores being better — Reliability consists of the following components:

The pre-determined thresholds for the component performance metrics are:

  • Connectivity - successfully connecting to the broadband network. The percentage of tests that are connected to all eligible tests indicating whether users are able to connect to the WiFi network.
  • Completion - successfully completing the tasks (e.g. streaming video, sending/receiving texts, making video and voice calls). The percentage of tests that are complete indicating whether users are able to complete a task when they are able to connect to the network.
  • Sufficiency - having sufficient connection in order to start and sustain a ‘good enough’/’uninterrupted’ session. The percentage of tests that pass all the required thresholds of sufficiency indicating whether users have a sufficient session when they are able to connect to the network on completed tasks.