IMDEA Networks Institute Publications Repository

Separating Wheat from Chaff: Winnowing Unintended Prefixes using Machine Learning

Lutu, Andra and Bagnulo, Marcelo and Cid-Sueiro, Jesus and Maennel, Olaf (2014) Separating Wheat from Chaff: Winnowing Unintended Prefixes using Machine Learning. In: The 33rd Annual IEEE International Conference on Computer Communications (IEEE INFOCOM 2014), 27 April - 2 May 2014, Toronto, Canada.

PDF (Separating Wheat from Chaff: Winnowing Unintended Prefixes using Machine Learning) - Published Version
Download (629Kb) | Preview


In this paper, we propose the use of prefix visibility at the interdomain level as an early symptom of anomalous events in the Internet. We focus on detecting anomalies which, despite their significant impact on the routing system, remain concealed from state of the art tools. We design a machine learning system to winnow the prefixes with unintended limited visibility – symptomatic of anomalous events – from the prefixes with intended limited visibility – resulting from legitimate routing operations. We train a winnowing algorithm with ground-truth data on 20,000 operational limited visibility prefixes (LVPs) already classified by the operators of the origin networks. The ground-truth was collected using the BGP Visibility Scanner, a tool we developed to provide operators with a multi-angle view on the efficacy of their routing policies. We build a dataset with the pre-classified prefixes and the features describing their visibility status dynamics. We further use this dataset to derive a boosted decision tree which winnows unintended LVPs with an accuracy of 95%.

Item Type: Conference or Workshop Papers (Paper)
Depositing User: Andra Lutu
Date Deposited: 20 Jan 2014 09:04
Last Modified: 01 Dec 2014 09:09

Actions (login required)

View Item View Item