The Internet Routing Entropy Monitor

The Internet Routing Entropy Monitor is a tool for operators, practitioners, and theoreticians to obtain historic information about the information-theoretical entropy of Internet routing. The entropy closely characterizes the amount of information contained in an Internet routing table, and so it gives a glimpse into the short and long-term scalability and sustainability perspectives of the Internet data plane. The Internet Routing Entropy Monitor provides daily updated statistics from several real IP routers' forwarding tables and makes the raw data freely available for download.

The original intention to create the Internet Routing Entropy Monitor was to verify the seemingly unintuitive finding that the Internet routing ecosystem, shaped by the loosely orchestrated interactions of a huge number of autonomous decision makers, exhibits surprisingly low information-theoretical entropy, indicating that there is a very high level of regularity in Internet routes. This, on the one hand, suggests that routing table compression algorithms have high potential to reduce the memory footprint of routing tables, a key to dispel worrying Internet routing scalability concerns [1], [2]. On the other hand, compelling questions arise regarding the very nature and origin of this vast regularity. It is the hope of the fib_comp team that this service will prove itself useful for the Internet community to answer these fundamental questions.

The main difference from other routing monitoring services, like the University of Oregon Route Views Project, is that in contrast to those services that monitor the Routing Information Base (RIB), the Internet Routing Entropy Monitor analyses the Forwarding Information Base (FIB). Chiefly, the FIB contains correct and timely next-hop distribution (something the RIB, by nature, lacks), which is in turn indispensable to obtain accurate information-theoretical statistics from the Internet data plane.

Currently, the Internet Routing Entropy Monitor keeps track of 20 vantage points located in two remote Autonomous Systems (ASes), the Internet2 (AS 11537) and the HBONE (AS 1955). The IPv4 forwarding tables (FIBs) are downloaded from the vantage point routers on a daily basis, from which 4 FIBs are full-BGP while the rest are smaller FIB instances with internal routes predominantly. Statistics are created and published each day from the collected data.

To make the Internet Routing Entropy Monitor more useful, we need more data from as many routers as possible.

Please, give us your data! Share us your FIBs!

You can offer your FIBs for analysis via filling out the forms below.
Remember: our custom download scripts cause negligible CPU load on your router and the data we offer for download is next-hop-anonymized, making it impossible for others to reconstruct your routing policies.

[+] Background

Click the '+' sign to expand

Global statistics

The below diagrams give a glimpse into the data collected from each vantage point. For the statistics on individual vantage points, click here. All the diagrams are freely clickable. To magnify a region, draw a rectangle on the diagram. Click the right mouse button to reset to the time series. Click here for some background on these statistics and here for an explanation of the parameters given in the diagrams.

Entropy (\(H_0\))

loading
Loading...

Number of raw FIB entries

loading
Loading...

Vantage point statistics

The below table shows the statistics on the FIBs collected from the individual vantage point routers. Click on the '+' sign to expand the per-FIB statistics, which can then be collapsed again by clicking on the '-' sign.

FIB name Source Last update #Entries #Next-hops Entropy Size (KB)
[+] Atlanta Internet2 2017-02-27 0 0 0.0 0.0
[+] Chicago Internet2 2017-02-27 0 0 0.0 0.0
[+] Cleveland Internet2 2017-02-27 0 0 0.0 0.0
[+] Houston Internet2 2017-02-27 0 0 0.0 0.0
[+] KansasCity Internet2 2017-02-27 0 0 0.0 0.0
[+] LosAngeles Internet2 2017-02-27 0 0 0.0 0.0
[+] NewYork Internet2 2017-02-27 0 0 0.0 0.0
[+] SaltLakeCity Internet2 2017-02-27 0 0 0.0 0.0
[+] Seattle Internet2 2017-02-27 0 0 0.0 0.0
[+] Washington Internet2 2017-02-27 0 0 0.0 0.0
[+] hbone_bme HBONE 2017-02-27 632820 104 1.135109 78.18
[+] hbone_debrecen HBONE 2017-02-27 2002 107 3.35378 3.13
[+] hbone_miskolc HBONE 2017-02-27 1996 106 3.395394 3.08
[+] hbone_pecs HBONE 2017-02-27 1999 100 3.350107 3.05
[+] hbone_sopron HBONE 2017-02-27 2008 98 3.345894 3.03
[+] hbone_szeged HBONE 2017-02-27 632802 99 3.366956 3.06
[+] hbone_szolnok HBONE 2015-12-15 1971 88 3.297515 2.82
[+] hbone_veszprem HBONE 2017-02-27 1998 97 3.335723 3.03
[+] hbone_vh1 HBONE 2017-02-27 633429 227 2.113675 161.75
[+] hbone_vh2 HBONE 2017-02-27 632668 171 2.546317 4.52

Download

If you need access to the next-hop anonymized data, please send an email to fib_comp [at] lendulet.tmit.bme.hu.

Call for FIBs

It is our intention to continuously improve and extend the Internet Routing Entropy Monitor. For this, we need data above all!

Please, give us your data! Share us your FIBs!

We can use the FIB from any production router you happen to have access to. Routers in the Default Free Zone are preferred, but any FIB dumps are highly welcome. It is essential though that the router be a production router, so that the dump contain data with the real next-hops. Dumps form collectors, monitors, looking glasses, etc., all obscure next-hop info and hence are uninteresting to us. Furthermore, we mostly solicit daily FIB dumps (e.g., via SNMP) that we can utilize for our historic analyses. However, occasional BGP dumps are also warmly welcome.

To include your router as a vantage point, it is best if you provide us daily SNMP access to the inetCidrRouteTable object (namely, the inetCidrRouteDest entries within it) on your device. Alternatively, we can parse the output of "show ip bgp" or "show ip route" commands or, if the need arises, we can implement custom parsers for essentially any format. What is important is that the data contain enough information for us to recover at least the "IP prefix -> next-hop" associations.

Share us daily FIB dumps

We would be happy to include your router as a full-fledged vantage point for the Internet Routing Entropy Monitor. If you can offer a full-fledged data source for analysis, please fill in the form below or contact us directly at fib_comp [at] lendulet.tmit.bme.hu. Once you give us access to your router, you will see daily activity from the 152.66.244.0/24 prefix on your router at around midnight (but the time frame is negotiable) and we begin to include your data in our analysis within one or two days.

Name*:
E-mail*:
Format (compressed RIB dump, etc.)*:
Router (the device the FIB is taken from, IP address, type (edge, core, etc.), anything you can give to localize the device in the Internet)*:
Comments: (any further comment you have):
Checking this box, you assign the fib_comp project unlimited irrevocable rights to store, analyze, publish statistics from, distribute freely in next-hop-anonymized form, or use for any non-commercial purposes, the data you share*:
CAPTCHA Image [ New Captcha ]
* Required fields

Share us a FIB dump

If you happen to have some random BGP dump or any FIB-related data, we are interested!

Please, fill in the form below and upload your FIBs.

Name*:
E-mail*:
Date the dump is taken*:
Format (compressed RIB dump, etc.)*:
Router (the device the FIB is taken from, IP address, type (edge, core, etc.), anything you can give to localize the device in the Internet)*:
Comments: (any further comment you have):
FIB File*:
Checking this box, you assign the fib_comp project unlimited irrevocable rights to store, analyze, publish statistics from, distribute freely in next-hop-anonymized form, or use for any non-commercial purposes, the data you share*:
CAPTCHA Image [ New Captcha ]
* Required fields

Acknowledgements

The fib_comp team would like to thank for the Internet2, the NIIF HBONE for making their data available for analysis. Special thanks go to Levente Csikor for creating and maintaining the website.

The members of the fib_comp team:

References

[1] Gábor Rétvári, János Tapolcai, Attila Kőrösi, András Majdán, and Zalán Heszberger. Compressing IP forwarding tables: towards entropy bounds and beyond. In ACM SIGCOMM 2013, pages 111-122, 2013. [ bib | DOI | slides | paper ]
[2] Gábor Rétvári, Zoltán Csernátony, Attila Kőrösi, János Tapolcai, András Császár, Gábor Enyedi, and Gergely Pongrácz. Compressing IP forwarding tables for fun and profit. In Eleventh ACM Workshop on Hot Topics in Networks (HotNets-XI). ACM, October 2012. [ bib | slides | paper ]

We are greatly thankful for your help.
the fib_comp team

Old clustrmap info - ClustrMap needed to be reregistered
Valid XHTML 1.0 Strict Valid CSS!