skip to main content
10.1145/3452296.3472935acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
research-article
Public Access

AnyOpt: predicting and optimizing IP Anycast performance

Published:09 August 2021Publication History

ABSTRACT

The key to optimizing the performance of an anycast-based system (e.g., the root DNS or a CDN) is choosing the right set of sites to announce the anycast prefix. One challenge here is predicting catchments. A naïve approach is to advertise the prefix from all subsets of available sites and choose the best-performing subset, but this does not scale well. We demonstrate that by conducting pairwise experiments between sites peering with tier-1 networks, we can predict the catchments that would result if we announce to any subset of the sites. We prove that our method is effective in a simplified model of BGP, consistent with common BGP routing policies, and evaluate it in a real-world testbed. We then present AnyOpt, a system that predicts anycast catchments. Using AnyOpt, a network operator can find a subset of anycast sites that minimizes client latency without using the naïve approach. In an experiment using 15 sites, each peering with one of six transit providers, AnyOpt predicted site catchments of 15,300 clients with 94.7% accuracy and client RTTs with a mean error of 4.6%. AnyOpt identified a subset of 12 sites, announcing to which lowers the mean RTT to clients by 33ms compared to a greedy approach that enables the same number of sites with the lowest average unicast latency.

Skip Supplemental Material Section

Supplemental Material

video-presentation.mp4

mp4

138 MB

video-long.mp4

mp4

258 MB

References

  1. 2016. BGP Best Path Selection Algorithm. https://www.cisco.com/c/en/us/support/docs/ip/border-gateway-protocol-bgp/13753-25.html Retrieved Jun 28, 2021 fromGoogle ScholarGoogle Scholar
  2. 2020. Understanding BGP Path Selection. https://www.juniper.net/documentation/en_US/junos/topics/reference/general/routing-protocols-address-representation.html Retrieved Jun 28, 2021 fromGoogle ScholarGoogle Scholar
  3. Hussein A. Alzoubi, Seungjoon Lee, Michael Rabinovich, Oliver Spatscheck, and Jacobus Van Der Merwe. 2011. A Practical Architecture for an Anycast CDN. ACM Trans. Web 5, 4, Article 17 (Oct. 2011), 29 pages. 1559-1131 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Ruwaifa Anwar, Haseeb Niaz, David Choffnes, Ítalo Cunha, Phillipa Gill, and Ethan Katz-Bassett. 2015. Investigating Interdomain Routing Policies in the Wild. In Proceedings of the 2015 Internet Measurement Conference (Tokyo, Japan) (IMC '15). Association for Computing Machinery, New York, NY, USA, 71--77. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Giorgio Ausiello, Pierluigi Crescenzi, Giorgio Gambosi, Viggo Kann, Alberto Marchetti-Spaccamela, and Marco Protasi. 2012. Complexity and approximation: Combinatorial optimization problems and their approximability properties. Springer Science & Business Media. https://www.springer.com/gp/book/9783540654315Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Hitesh Ballani, Paul Francis, and Sylvia Ratnasamy. 2006. A Measurement-Based Deployment Proposal for IP Anycast. In Proceedings of the 6th ACM SIGCOMM Conference on Internet Measurement (Rio de Janeriro, Brazil) (IMC '06). Association for Computing Machinery, New York, NY, USA, 231--244. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Matt Calder, Ashley Flavel, Ethan Katz-Bassett, Ratul Mahajan, and Jitendra Padhye. 2015. Analyzing the Performance of an Anycast CDN. In Proceedings of the 2015 Internet Measurement Conference (Tokyo, Japan) (IMC '15). Association for Computing Machinery, New York, NY, USA, 531--537. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Ignacio Castro, Juan Camilo Cardona, Sergey Gorinsky, and Pierre Francois. 2014. Remote Peering: More Peering without Internet Flattening. In Proceedings of the 10th ACM International on Conference on Emerging Networking Experiments and Technologies (Sydney, Australia) (CoNEXT '14). Association for Computing Machinery, New York, NY, USA, 185--198. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Danilo Cicalese, Jordan Augé, Diana Joumblatt, Timur Friedman, and Dario Rossi. 2015. Characterizing IPv4 Anycast Adoption and Deployment. In Proceedings of the 11th ACM Conference on Emerging Networking Experiments and Technologies (Heidelberg, Germany) (CoNEXT '15). Association for Computing Machinery, New York, NY, USA, Article 16, 13 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Gérard Cornuéjols, George Nemhauser, and Laurence Wolsey. 1983. The uncapicitated facility location problem. Technical Report. Cornell University Operations Research and Industrial Engineering. https://hdl.handle.net/1813/8491Google ScholarGoogle Scholar
  11. Ricardo de Oliveira Schmidt, John Heidemann, and Jan Harm Kuipers. 2017. Anycast Latency: How Many Sites Are Enough?. In Passive and Active Measurement, Mohamed Ali Kaafar, Steve Uhlig, and Johanna Amann (Eds.). Springer International Publishing, Cham, 188--200. https://link.springer.com/chapter/10.1007/978-3-319-54328-4_14Google ScholarGoogle Scholar
  12. Wouter B. de Vries, Salmān Aljammāz, and Roland van Rijswijk-Deij. 2020. Global-Scale Anycast Network Management with Verfploeter. In NOMS 2020 - 2020 IEEE/IFIP Network Operations and Management Symposium. 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Wouter B. de Vries, Ricardo de O. Schmidt, Wes Hardaker, John Heidemann, Pieter-Tjerk de Boer, and Aiko Pras. 2017. Broad and Load-Aware Anycast Mapping with Verfploeter. In Proceedings of the 2017 Internet Measurement Conference (London, United Kingdom) (IMC '17). Association for Computing Machinery, New York, NY, USA, 477--488. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Dino Farinacci, Tony Li, Stanley P. Hanks, David Meyer, and Paul S. Traina. 2000. Generic Routing Encapsulation (GRE). RFC 2784. RFC Editor. 1--9 pages. 2070-1721 https://www.rfc-editor.org/rfc/rfc2784.txtGoogle ScholarGoogle Scholar
  15. Ashley Flavel, Pradeepkumar Mani, David Maltz, Nick Holt, Jie Liu, Yingying Chen, and Oleg Surmachev. 2015. FastRoute: A Scalable Load-Aware Anycast Routing Architecture for Modern CDNs. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15). USENIX Association, Oakland, CA, 381--394. https://www.usenix.org/conference/nsdi15/technical-sessions/presentation/flavelGoogle ScholarGoogle Scholar
  16. Lixin Gao and Jennifer Rexford. 2001. Stable Internet Routing without Global Coordination. IEEE/ACM Trans. Netw. 9, 6 (Dec. 2001), 681--692. 1063-6692 Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Danilo Giordano, Danilo Cicalese, A. Finamore, M. Mellia, M. Munafo, Diana Joumblatt, and D. Rossi. 2016. A First Characterization of Anycast Traffic from Passive Traces. In IFIP workshop on Traffic Monitoring and Analysis (TMA). ouvain La Neuve, Belgium, 30--38. https://hal-imt.archives-ouvertes.fr/hal-01383092Google ScholarGoogle Scholar
  18. Vasileios Giotsas, George Nomikos, Vasileios Kotronis, Pavlos Sermpezis, Petros Gigis, Lefteris Manassakis, Christoph Dietzel, Stavros Konstantaras, and Xenofontas Dimitropoulos. 2021. O Peer, Where Art Thou? Uncovering Remote Peering Interconnections at IXPs. IEEE/ACM Transactions on Networking 29, 1 (2021), 1--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Krishna P. Gummadi, Stefan Saroiu, and Steven D. Gribble. 2002. King: Estimating Latency between Arbitrary Internet End Hosts. In Proceedings of the 2nd ACM SIGCOMM Workshop on Internet Measurment (Marseille, France) (IMW '02). Association for Computing Machinery, New York, NY, USA, 5--18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Pierre Hanjoul and Dominique Peeters. 1987. A facility location problem with clients' preference orderings. Regional Science and Urban Economics 17, 3 (1987), 451--473. 0166-0462 Google ScholarGoogle ScholarCross RefCross Ref
  21. Ethan Katz-Bassett, Colin Scott, David R. Choffnes, Ítalo Cunha, Vytautas Valancius, Nick Feamster, Harsha V. Madhyastha, Thomas Anderson, and Arvind Krishnamurthy. 2012. LIFEGUARD: Practical Repair of Persistent Route Failures. In Proceedings of the ACM SIGCOMM 2012 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (Helsinki, Finland) (SIGCOMM '12). Association for Computing Machinery, New York, NY, USA, 395--406. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Thomas Koch, Ke Li, Calvin Ardi, Ethan Katz-Bassett, Matt Calder, and John Heidemann. 2021. Anycast in Context: A Tale of Two Systems. In Proceedings of the 2021 Conference of the ACM Special Interest Group on Data Communication (Virtual Event) (SIGCOMM '21). Association for Computing Machinery, New York, NY, USA, 20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. F Thomson Leighton, Ravi Sundaram, Matthew Levine, and Adrian Soviani. 2007. Method for generating a network map. US Patent 7,251,688.Google ScholarGoogle Scholar
  24. Matthew Lentz, Dave Levin, Jason Castonguay, Neil Spring, and Bobby Bhattacharjee. 2013. D-Mystifying the D-Root Address Change. In Proceedings of the 2013 Conference on Internet Measurement Conference (Barcelona, Spain) (IMC '13). Association for Computing Machinery, New York, NY, USA, 57--62. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Zhihao Li, Dave Levin, Neil Spring, and Bobby Bhattacharjee. 2018. Internet Anycast: Performance, Problems, & Potential. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (Budapest, Hungary) (SIGCOMM '18). Association for Computing Machinery, New York, NY, USA, 59--73. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Jinjin Liang, Jian Jiang, Haixin Duan, Kang Li, and Jianping Wu. 2013. Measuring Query Latency of Top Level DNS Servers. In Passive and Active Measurement, Matthew Roughan and Rocky Chang (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 145--154. https://link.springer.com/chapter/10.1007/978-3-642-36516-4_15Google ScholarGoogle Scholar
  27. Ziqian Liu, Bradley Huffaker, Marina Fomenkov, Nevil Brownlee, and kc claffy. 2007. Two Days in the Life of the DNS Anycast Root Servers. In Passive and Active Network Measurement, Steve Uhlig, Konstantina Papagiannaki, and Olivier Bonaventure (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 125--134. https://link.springer.com/chapter/10.1007/978-3-540-71617-4_13Google ScholarGoogle Scholar
  28. Chris Metz. 2002. IP anycast point-to-(any) point communication. IEEE Internet Computing 6, 2 (2002), 94--98. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Giovane C.M. Moura, Ricardo de O. Schmidt, John Heidemann, Wouter B. de Vries, Moritz Muller, Lan Wei, and Cristian Hesselman. 2016. Anycast vs. DDoS: Evaluating the November 2015 Root DNS Event. In Proceedings of the 2016 Internet Measurement Conference (Santa Monica, California, USA) (IMC '16). Association for Computing Machinery, New York, NY, USA, 255--270. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. NTT Labs. 2020. BGP implemented in the Go Programming Language. https://github.com/osrg/gobgp.Google ScholarGoogle Scholar
  31. Craig Partridge, Trevor Mendez, and Walter Milliken. 1993. Host Anycasting Service. RFC 1546. RFC Editor. 2070-1721 https://www.rfc-editor.org/rfc/rfc1546.txtGoogle ScholarGoogle Scholar
  32. Jon Postel. 1981. Internet Control Message Protocol. RFC 777. RFC Editor. 1--14 pages. 2070-1721 https://www.rfc-editor.org/rfc/rfc777.txtGoogle ScholarGoogle Scholar
  33. Yakov Rekhter, Tony Li, and Susan Hares. 2006. A Border Gateway Protocol 4 (BGP-4). RFC 4271. RFC Editor. 1--103 pages. 2070-1721 https://www.rfc-editor.org/rfc/rfc4271.txtGoogle ScholarGoogle Scholar
  34. Sandeep Sarat, Vasileios Pappas, and Andreas Terzis. 2005. On the Use of Anycast in DNS. In Proceedings of the 2005 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems (Banff, Alberta, Canada) (SIGMETRICS '05). Association for Computing Machinery, New York, NY, USA, 394--395. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Brandon Schlinker, Italo Cunha, Yi-Ching Chiu, Srikanth Sundaresan, and Ethan Katz-Bassett. 2019. Internet Performance from Facebook's Edge. In Proceedings of the Internet Measurement Conference (Amsterdam, Netherlands) (IMC '19). Association for Computing Machinery, New York, NY, USA, 179--194. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Kyle Schomp, Onkar Bhardwaj, Eymen Kurdoglu, Mashooq Muhaimen, and Ramesh K. Sitaraman. 2020. Akamai DNS: Providing Authoritative Answers to the World's Queries. In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (Virtual Event, USA) (SIGCOMM '20). Association for Computing Machinery, New York, NY, USA, 465--478. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Pavlos Sermpezis and Vasileios Kotronis. 2019. Inferring Catchment in Internet Routing. Proc. ACM Meas. Anal. Comput. Syst. 3, 2, Article 30 (June 2019), 31 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. RIPE NCC Staff. 2015. RIPE Atlas: A global internet measurement network. Internet Protocol Journal 18, 3 (2015).Google ScholarGoogle Scholar
  39. Akamai Technologies. 2020. Prolexic Routed. https://www.akamai.com/us/en/multimedia/documents/product-brief/prolexic-routed-product-brief.pdf Retrieved Jan 28, 2021 fromGoogle ScholarGoogle Scholar
  40. Lan Wei and John Heidemann. 2017. Does anycast hang up on you?. In 2017 Network Traffic Measurement and Analysis Conference (TMA). 1--9. Google ScholarGoogle ScholarCross RefCross Ref
  41. Einav Yoav. 2019. Amazon found every 100ms of latency cost them 1% in sales. https://www.gigaspaces.com/blog/amazon-found-every-100ms-of-latency-cost-them-1-in-sales/ Retrieved Jan 28, 2021 fromGoogle ScholarGoogle Scholar

Index Terms

  1. AnyOpt: predicting and optimizing IP Anycast performance

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          SIGCOMM '21: Proceedings of the 2021 ACM SIGCOMM 2021 Conference
          August 2021
          868 pages
          ISBN:9781450383837
          DOI:10.1145/3452296

          Copyright © 2021 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 9 August 2021

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate554of3,547submissions,16%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader