ABSTRACT
The key to optimizing the performance of an anycast-based system (e.g., the root DNS or a CDN) is choosing the right set of sites to announce the anycast prefix. One challenge here is predicting catchments. A naïve approach is to advertise the prefix from all subsets of available sites and choose the best-performing subset, but this does not scale well. We demonstrate that by conducting pairwise experiments between sites peering with tier-1 networks, we can predict the catchments that would result if we announce to any subset of the sites. We prove that our method is effective in a simplified model of BGP, consistent with common BGP routing policies, and evaluate it in a real-world testbed. We then present AnyOpt, a system that predicts anycast catchments. Using AnyOpt, a network operator can find a subset of anycast sites that minimizes client latency without using the naïve approach. In an experiment using 15 sites, each peering with one of six transit providers, AnyOpt predicted site catchments of 15,300 clients with 94.7% accuracy and client RTTs with a mean error of 4.6%. AnyOpt identified a subset of 12 sites, announcing to which lowers the mean RTT to clients by 33ms compared to a greedy approach that enables the same number of sites with the lowest average unicast latency.
Supplemental Material
Available for Download
AnyOpt: Predicting and Optimizing IP Anycast Performance: Public Review
- 2016. BGP Best Path Selection Algorithm. https://www.cisco.com/c/en/us/support/docs/ip/border-gateway-protocol-bgp/13753-25.html Retrieved Jun 28, 2021 fromGoogle Scholar
- 2020. Understanding BGP Path Selection. https://www.juniper.net/documentation/en_US/junos/topics/reference/general/routing-protocols-address-representation.html Retrieved Jun 28, 2021 fromGoogle Scholar
- Hussein A. Alzoubi, Seungjoon Lee, Michael Rabinovich, Oliver Spatscheck, and Jacobus Van Der Merwe. 2011. A Practical Architecture for an Anycast CDN. ACM Trans. Web 5, 4, Article 17 (Oct. 2011), 29 pages. 1559-1131 Google ScholarDigital Library
- Ruwaifa Anwar, Haseeb Niaz, David Choffnes, Ítalo Cunha, Phillipa Gill, and Ethan Katz-Bassett. 2015. Investigating Interdomain Routing Policies in the Wild. In Proceedings of the 2015 Internet Measurement Conference (Tokyo, Japan) (IMC '15). Association for Computing Machinery, New York, NY, USA, 71--77. Google ScholarDigital Library
- Giorgio Ausiello, Pierluigi Crescenzi, Giorgio Gambosi, Viggo Kann, Alberto Marchetti-Spaccamela, and Marco Protasi. 2012. Complexity and approximation: Combinatorial optimization problems and their approximability properties. Springer Science & Business Media. https://www.springer.com/gp/book/9783540654315Google ScholarDigital Library
- Hitesh Ballani, Paul Francis, and Sylvia Ratnasamy. 2006. A Measurement-Based Deployment Proposal for IP Anycast. In Proceedings of the 6th ACM SIGCOMM Conference on Internet Measurement (Rio de Janeriro, Brazil) (IMC '06). Association for Computing Machinery, New York, NY, USA, 231--244. Google ScholarDigital Library
- Matt Calder, Ashley Flavel, Ethan Katz-Bassett, Ratul Mahajan, and Jitendra Padhye. 2015. Analyzing the Performance of an Anycast CDN. In Proceedings of the 2015 Internet Measurement Conference (Tokyo, Japan) (IMC '15). Association for Computing Machinery, New York, NY, USA, 531--537. Google ScholarDigital Library
- Ignacio Castro, Juan Camilo Cardona, Sergey Gorinsky, and Pierre Francois. 2014. Remote Peering: More Peering without Internet Flattening. In Proceedings of the 10th ACM International on Conference on Emerging Networking Experiments and Technologies (Sydney, Australia) (CoNEXT '14). Association for Computing Machinery, New York, NY, USA, 185--198. Google ScholarDigital Library
- Danilo Cicalese, Jordan Augé, Diana Joumblatt, Timur Friedman, and Dario Rossi. 2015. Characterizing IPv4 Anycast Adoption and Deployment. In Proceedings of the 11th ACM Conference on Emerging Networking Experiments and Technologies (Heidelberg, Germany) (CoNEXT '15). Association for Computing Machinery, New York, NY, USA, Article 16, 13 pages. Google ScholarDigital Library
- Gérard Cornuéjols, George Nemhauser, and Laurence Wolsey. 1983. The uncapicitated facility location problem. Technical Report. Cornell University Operations Research and Industrial Engineering. https://hdl.handle.net/1813/8491Google Scholar
- Ricardo de Oliveira Schmidt, John Heidemann, and Jan Harm Kuipers. 2017. Anycast Latency: How Many Sites Are Enough?. In Passive and Active Measurement, Mohamed Ali Kaafar, Steve Uhlig, and Johanna Amann (Eds.). Springer International Publishing, Cham, 188--200. https://link.springer.com/chapter/10.1007/978-3-319-54328-4_14Google Scholar
- Wouter B. de Vries, Salmān Aljammāz, and Roland van Rijswijk-Deij. 2020. Global-Scale Anycast Network Management with Verfploeter. In NOMS 2020 - 2020 IEEE/IFIP Network Operations and Management Symposium. 1--9. Google ScholarDigital Library
- Wouter B. de Vries, Ricardo de O. Schmidt, Wes Hardaker, John Heidemann, Pieter-Tjerk de Boer, and Aiko Pras. 2017. Broad and Load-Aware Anycast Mapping with Verfploeter. In Proceedings of the 2017 Internet Measurement Conference (London, United Kingdom) (IMC '17). Association for Computing Machinery, New York, NY, USA, 477--488. Google ScholarDigital Library
- Dino Farinacci, Tony Li, Stanley P. Hanks, David Meyer, and Paul S. Traina. 2000. Generic Routing Encapsulation (GRE). RFC 2784. RFC Editor. 1--9 pages. 2070-1721 https://www.rfc-editor.org/rfc/rfc2784.txtGoogle Scholar
- Ashley Flavel, Pradeepkumar Mani, David Maltz, Nick Holt, Jie Liu, Yingying Chen, and Oleg Surmachev. 2015. FastRoute: A Scalable Load-Aware Anycast Routing Architecture for Modern CDNs. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15). USENIX Association, Oakland, CA, 381--394. https://www.usenix.org/conference/nsdi15/technical-sessions/presentation/flavelGoogle Scholar
- Lixin Gao and Jennifer Rexford. 2001. Stable Internet Routing without Global Coordination. IEEE/ACM Trans. Netw. 9, 6 (Dec. 2001), 681--692. 1063-6692 Google ScholarDigital Library
- Danilo Giordano, Danilo Cicalese, A. Finamore, M. Mellia, M. Munafo, Diana Joumblatt, and D. Rossi. 2016. A First Characterization of Anycast Traffic from Passive Traces. In IFIP workshop on Traffic Monitoring and Analysis (TMA). ouvain La Neuve, Belgium, 30--38. https://hal-imt.archives-ouvertes.fr/hal-01383092Google Scholar
- Vasileios Giotsas, George Nomikos, Vasileios Kotronis, Pavlos Sermpezis, Petros Gigis, Lefteris Manassakis, Christoph Dietzel, Stavros Konstantaras, and Xenofontas Dimitropoulos. 2021. O Peer, Where Art Thou? Uncovering Remote Peering Interconnections at IXPs. IEEE/ACM Transactions on Networking 29, 1 (2021), 1--16. Google ScholarDigital Library
- Krishna P. Gummadi, Stefan Saroiu, and Steven D. Gribble. 2002. King: Estimating Latency between Arbitrary Internet End Hosts. In Proceedings of the 2nd ACM SIGCOMM Workshop on Internet Measurment (Marseille, France) (IMW '02). Association for Computing Machinery, New York, NY, USA, 5--18. Google ScholarDigital Library
- Pierre Hanjoul and Dominique Peeters. 1987. A facility location problem with clients' preference orderings. Regional Science and Urban Economics 17, 3 (1987), 451--473. 0166-0462 Google ScholarCross Ref
- Ethan Katz-Bassett, Colin Scott, David R. Choffnes, Ítalo Cunha, Vytautas Valancius, Nick Feamster, Harsha V. Madhyastha, Thomas Anderson, and Arvind Krishnamurthy. 2012. LIFEGUARD: Practical Repair of Persistent Route Failures. In Proceedings of the ACM SIGCOMM 2012 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (Helsinki, Finland) (SIGCOMM '12). Association for Computing Machinery, New York, NY, USA, 395--406. Google ScholarDigital Library
- Thomas Koch, Ke Li, Calvin Ardi, Ethan Katz-Bassett, Matt Calder, and John Heidemann. 2021. Anycast in Context: A Tale of Two Systems. In Proceedings of the 2021 Conference of the ACM Special Interest Group on Data Communication (Virtual Event) (SIGCOMM '21). Association for Computing Machinery, New York, NY, USA, 20. Google ScholarDigital Library
- F Thomson Leighton, Ravi Sundaram, Matthew Levine, and Adrian Soviani. 2007. Method for generating a network map. US Patent 7,251,688.Google Scholar
- Matthew Lentz, Dave Levin, Jason Castonguay, Neil Spring, and Bobby Bhattacharjee. 2013. D-Mystifying the D-Root Address Change. In Proceedings of the 2013 Conference on Internet Measurement Conference (Barcelona, Spain) (IMC '13). Association for Computing Machinery, New York, NY, USA, 57--62. Google ScholarDigital Library
- Zhihao Li, Dave Levin, Neil Spring, and Bobby Bhattacharjee. 2018. Internet Anycast: Performance, Problems, & Potential. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (Budapest, Hungary) (SIGCOMM '18). Association for Computing Machinery, New York, NY, USA, 59--73. Google ScholarDigital Library
- Jinjin Liang, Jian Jiang, Haixin Duan, Kang Li, and Jianping Wu. 2013. Measuring Query Latency of Top Level DNS Servers. In Passive and Active Measurement, Matthew Roughan and Rocky Chang (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 145--154. https://link.springer.com/chapter/10.1007/978-3-642-36516-4_15Google Scholar
- Ziqian Liu, Bradley Huffaker, Marina Fomenkov, Nevil Brownlee, and kc claffy. 2007. Two Days in the Life of the DNS Anycast Root Servers. In Passive and Active Network Measurement, Steve Uhlig, Konstantina Papagiannaki, and Olivier Bonaventure (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 125--134. https://link.springer.com/chapter/10.1007/978-3-540-71617-4_13Google Scholar
- Chris Metz. 2002. IP anycast point-to-(any) point communication. IEEE Internet Computing 6, 2 (2002), 94--98. Google ScholarDigital Library
- Giovane C.M. Moura, Ricardo de O. Schmidt, John Heidemann, Wouter B. de Vries, Moritz Muller, Lan Wei, and Cristian Hesselman. 2016. Anycast vs. DDoS: Evaluating the November 2015 Root DNS Event. In Proceedings of the 2016 Internet Measurement Conference (Santa Monica, California, USA) (IMC '16). Association for Computing Machinery, New York, NY, USA, 255--270. Google ScholarDigital Library
- NTT Labs. 2020. BGP implemented in the Go Programming Language. https://github.com/osrg/gobgp.Google Scholar
- Craig Partridge, Trevor Mendez, and Walter Milliken. 1993. Host Anycasting Service. RFC 1546. RFC Editor. 2070-1721 https://www.rfc-editor.org/rfc/rfc1546.txtGoogle Scholar
- Jon Postel. 1981. Internet Control Message Protocol. RFC 777. RFC Editor. 1--14 pages. 2070-1721 https://www.rfc-editor.org/rfc/rfc777.txtGoogle Scholar
- Yakov Rekhter, Tony Li, and Susan Hares. 2006. A Border Gateway Protocol 4 (BGP-4). RFC 4271. RFC Editor. 1--103 pages. 2070-1721 https://www.rfc-editor.org/rfc/rfc4271.txtGoogle Scholar
- Sandeep Sarat, Vasileios Pappas, and Andreas Terzis. 2005. On the Use of Anycast in DNS. In Proceedings of the 2005 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (Banff, Alberta, Canada) (SIGMETRICS '05). Association for Computing Machinery, New York, NY, USA, 394--395. Google ScholarDigital Library
- Brandon Schlinker, Italo Cunha, Yi-Ching Chiu, Srikanth Sundaresan, and Ethan Katz-Bassett. 2019. Internet Performance from Facebook's Edge. In Proceedings of the Internet Measurement Conference (Amsterdam, Netherlands) (IMC '19). Association for Computing Machinery, New York, NY, USA, 179--194. Google ScholarDigital Library
- Kyle Schomp, Onkar Bhardwaj, Eymen Kurdoglu, Mashooq Muhaimen, and Ramesh K. Sitaraman. 2020. Akamai DNS: Providing Authoritative Answers to the World's Queries. In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (Virtual Event, USA) (SIGCOMM '20). Association for Computing Machinery, New York, NY, USA, 465--478. Google ScholarDigital Library
- Pavlos Sermpezis and Vasileios Kotronis. 2019. Inferring Catchment in Internet Routing. Proc. ACM Meas. Anal. Comput. Syst. 3, 2, Article 30 (June 2019), 31 pages. Google ScholarDigital Library
- RIPE NCC Staff. 2015. RIPE Atlas: A global internet measurement network. Internet Protocol Journal 18, 3 (2015).Google Scholar
- Akamai Technologies. 2020. Prolexic Routed. https://www.akamai.com/us/en/multimedia/documents/product-brief/prolexic-routed-product-brief.pdf Retrieved Jan 28, 2021 fromGoogle Scholar
- Lan Wei and John Heidemann. 2017. Does anycast hang up on you?. In 2017 Network Traffic Measurement and Analysis Conference (TMA). 1--9. Google ScholarCross Ref
- Einav Yoav. 2019. Amazon found every 100ms of latency cost them 1% in sales. https://www.gigaspaces.com/blog/amazon-found-every-100ms-of-latency-cost-them-1-in-sales/ Retrieved Jan 28, 2021 fromGoogle Scholar
Index Terms
- AnyOpt: predicting and optimizing IP Anycast performance
Recommendations
Two days in the life of the DNS anycast root servers
PAM'07: Proceedings of the 8th international conference on Passive and active network measurementThe DNS root nameservers routinely use anycast in order to improve their service to clients and increase their resilience against various types of failures. We study DNS traffic collected over a two-day period in January 2006 at anycast instances for ...
Towards a global IP anycast service
SIGCOMM '05: Proceedings of the 2005 conference on Applications, technologies, architectures, and protocols for computer communicationsIP anycast, with its innate ability to find nearby resources in a robust and efficient fashion, has long been considered an important means of service discovery. The growth of P2P applications presents appealing new uses for IP anycast. Unfortunately, ...
Comments