Opensignal’s public reports are designed to allow an objective comparison of different networks.
Our analytics encompass data science best practices to ensure that results can be trusted and are not misleading.
We believe these analytics policies, when combined with the measurement philosophy laid out in our Experience Charter, lead the industry and produce the most accurate reports and insights which reveal the true experience.
Consistent methodology: Opensignal’s analytics methodology has been developed independently over several years and examined by many industry stakeholders. Fundamental to our approach is that we never change our methodology to suit the needs of a particular country or operator. Our methodology only changes as we make improvements which are consistently applied. By doing this we ensure that global comparisons can be made.
Real users with equal weighting: Our analytics are designed to ensure that each user equally contributes to results. Our analysis ensures as far as possible that we only include data from devices that display normal user behavior and not the behavior of test and engineering devices, research projects, etc.
Confidence intervals always considered: We always use confidence intervals in our analytical conclusions. They are clearly displayed in our charts, unless including them lessens readability. Confidence intervals represent the upper and lower bound interval that a value will fall between. Using confidence intervals is standard scientific practice when reporting on sampled data.
Only statistically significant conclusions drawn: If a difference between operators for a given metric is not statistically significant we declare it a draw and report each operator as a 'joint winner'. Where confidence intervals are large we do not report the data at all to ensure that we only publish results in which we are confident.
Only an operator’s direct customers are included: To ensure that our data truly represents the experience of an operator’s own customers we exclude measurements generated by inbound and outbound international roamers and MVNOs as they may be subject to different service agreements. Measurements generated by national roamers are attributed to the user’s home operator as that is part of their network experience. MVNOs and international roamers are reported separately where indicated.
Consistent standard time intervals used: We normally only report on standard time intervals and the most recent data, we do not “cherry-pick” an arbitrary time period in a report to support a predetermined conclusion. Where a different time window is being used this will always be clearly identified.
Comparisons must be like-for-like operators: In comparisons we only include operators whose network is widely represented across the area under study. Regional operators are not shown in national comparisons.