IMDEA Networks Institute Publications Repository

A Long Way to the Top: Significance, Structure, and Stability of Internet Top Lists

Scheitle, Quirin and Hohlfeld, Oliver and Gamba, Julien and Jelten, Jonas and Zimmermann, Torsten and Strowes, Stephen and Vallina-Rodriguez, Narseo (2018) A Long Way to the Top: Significance, Structure, and Stability of Internet Top Lists. In: The 18th ACM Internet Measurement Conference (IMC 2018), 31 October - 2 November 2018, Boston, MA, USA.

[img] PDF (A Long Way to the Top: Significance, Structure, and Stability of Internet Top Lists) - Published Version
Download (2638Kb)

Abstract

A broad range of research areas including Internet measurement, privacy, and network security rely on lists of target domains to be analysed; researchers make use of target lists for reasons of necessity or efficiency. The popular Alexa list of one million domains is a widely used example. Despite their prevalence in research papers, the soundness of top lists has seldom been questioned by the community: little is known about the lists’ creation, representativity, potential biases, stability, or overlap between lists. In this study we survey the extent, nature, and evolution of top lists used by research communities. We assess the structure and stability of these lists, and show that rank manipulation is possible for some lists. We also reproduce the results of several scientific studies to assess the impact of using a top list at all, which list specifically, and the date of list creation. We find that (i) top lists generally overestimate results compared to the general population by a significant margin, often even an order of magnitude, and (ii) some top lists have surprising change characteristics, causing high day-to-day fluctuation and leading to result instability. We conclude our paper with specific recommendations on the use of top lists, and how to interpret results based on top lists with caution.

Item Type: Conference or Workshop Papers (Paper)
Additional Information: https://doi.org/10.1145/3278532.3278574
Subjects: UNSPECIFIED
Divisions: UNSPECIFIED
Depositing User: Narseo Vallina
Date Deposited: 14 Oct 2018 13:56
Last Modified: 14 Oct 2018 13:56
URI: http://eprints.networks.imdea.org/id/eprint/1887

Actions (login required)

View Item View Item