Edith Cohen
Balachander Krishnamurthy
Jennifer Rexford
ABSTRACT
The rapid growth of the World Wide Web has caused serious performance degradation on the Internet. This paper offers an end-to-end approach to improving Web performance by collectively examining the Web components --- clients, proxies, servers, and the network. Our goal is to reduce user-perceived latency and the number of TCP connections, improve cache coherency and cache replacement, and enable prefetching of resources that are likely to be accessed in the near future. In our scheme, server response messages include piggybacked information customized to the requesting proxy. Our enhancement to the existing request-response protocol does not require per-proxy state at a server, and a very small amount of transient per-server state at the proxy, and can be implemented without changes to HTTP 1.1. The server groups related resources into volumes (based on access patterns and the file system's directory structure) and applies a proxy-generated filter (indicating the type of information of interest to the proxy) to tailor the piggyback information. We present efficient data structures for constructing server volumes and applying proxy filters, and a transparent way to perform volume maintenance and piggyback generation at a router along the path between the proxy and the server. We demonstrate the effectiveness of our end-to-end approach by evaluating various volume construction and filtering techniques across a collection of large client and server logs.
- 1.B. M. Duska, D. Marwood, and M. J. Feeley, "The measured access characteristics of World-Wide-Web client proxy caches," in Proc. USENIX Syrup. on Internet Technologies and Systems, pp. 23-35, December 1997. http://www, cs. ubc. ca/spider/marwood/Proj ects/ SPA/wwwap.]] Google Scholar
Digital Library
- 2."Squid intemet object cache." http://squid.nlanr.net/Squid.]]Google Scholar
- 3.R. Caceres, F. Douglis, A. Feldmann, G. Glass, and M. Rabinovich, "Web proxy caching: The devil is in the details," in Proc. Workshop on lnternet Server Performance, June 1998. http: //www. cs. wisc. edu/-cao/WI 8P98. html.]]Google ScholarDigital Library
- 4.A. Bestavros, R. L. Carter, and M. E. Crovella, "Application-level document caching in the Intemet," in Proc. inter. Workshop on Services in Distributed and Networked Environments, June 1995. http://www, cs. bu. edu/f acuity/best/res/ papers/Home, html.]] Google ScholarDigital Library
- 5.P. Cao and S. Irani, "Cost-aware WWW proxy caching algorithms," in Proc. USENiX Syrup. on Internet Technologies and Systems, pp. 193-206, December 1997. http://www, cs. wisc. edu/-cao/papers/gd-s ize. html.]] Google ScholarDigital Library
- 6.S. Williams, M. Abrams, C. R. Standbridge, G. Abdulla, and E. A. Fox, "Removal policies in network caches for World Wide Web documents," in Proc. A CM SIGCOMM, pp. 293-305, August 1996. http://www, acm. org/s igc omm/s igc omm96 / program.html.]] Google ScholarDigital Library
- 7.V. Cate, "Alex - A global filesystem," in Prec. USENIX File System Workshop, pp. 1-12, May 1992.]]Google Scholar
- 8.A. Dingle and T. Paxtl, "Web cache coherence," in Prec. World Wide Web Conference, May 1996. http: //www5conf. inria, fr/f ich_html/papers/P2/ Overview.html.]] Google ScholarDigital Library
- 9.S. D. Gribble and E. A. Brewer, "System design issues for lnternet middleware services: Deductions from a large client trace," in Prec. USENIX Syrup. on Internet Technologies and Systems, December 1997. http: //www. usenix, org/events/us it s97.]] Google ScholarDigital Library
- 10.B. Krishnamurthy and C. E. Wills, "Study of piggyback cache validation for proxy caches in the World Wide Web," in Prec. USENIX Syrup. on {nternet Technologies and Systems, pp. 1-12, December 1997. http://www, research, art. com/~bale/papers/ pcv-us itsg7, ps. gz]] Google ScholarDigital Library
- 11.V. N. Padmanabhan and J. C. Mogul, "Improving HTTP latency," Computer Networks and {SDN Systems, vol. 28, pp. 25-35, December 1995. http://www .ncsa. uiuc. edu/SDG/IT94/ Proceedings/DDay/mogul/HTTPLat ency. html.]] Google ScholarDigital Library
- 12.H. F. Nielsen, J. Gettys, A. Baird-Smith, E. Prud'hommeaux, H. W. Lie, and C. Lilley, "Network performance effects of HTTP/1.1, CSS1, and PNG," in Prec. A CM SIGCOMM, pp. 155-166, August 1997. http://www, inri a. f r/rodeo / s igcomm97 / program.html.]] Google ScholarDigital Library
- 13.J. C. Mogul, "Hinted caching in the Web," in Prec. A CM SIGOPS European Workshop, pp. 129-140, 1996. http: //mosqui toner, stanford, edu/s igops96/ papers/mogul, ps.]] Google ScholarDigital Library
- 14.A. Bestavros, "Using speculation to reduce server load and service time on the WWW,' in Proc. A CM Inter. Conf. on Information and Knowledge Management, 1995. http://www, cs. bu. edu/faculty/best/res/papers/ Home. html.]] Google ScholarDigital Library
- 15.V. N. Padmanabhan and J. C. Mogul, "Using predictive prefetching to improve World Wide Web latency,'' Computer Communication Review, vol. 26, no. 3, pp. 22-36, 1996. http://daedalus, cs. berkeley, edu/publications/ ccr-july96, ps. gz.]] Google ScholarDigital Library
- 16.Z. Jiang and L. Kleinrock, "Prefetching links on the WWW," in Prec. IEEE Inter. Conf. on Communications, pp. 483-489, June 1997. ht tp://millennium, cs. ucla. edu/- j i ang/Research/ Publ i cat i on/pre f e t ch. ps.]]Google Scholar
- 17.M. Crovella and P. Barford, "The network effects of prefetching," in Prec. IEEE INFOCOM, pp. 1232-1240, April 1998. http: //www. cs. bu. edu/f aculty/crovella/ papers, html.]]Google Scholar
- 18.T. M. Kroeger, D. E. Long, and J. C. Mogul, "Exploring the bounds of Web latency reduction from caching and prefetching," in Prec. USENIX Syrup. on Internet Technologies and Systems, pp. 13-22, December 1997. ht tp://www, cse. ucsc. edu/~ tmk/ideal, ps.]] Google ScholarDigital Library
- 19.C. Liu and P. Cao, "Maintaining strong cache consistency in the World Wide Web," in Prec. IEEE Inter. Conf. on Distributed Computing Systems, pp. 326-334, May 1997. http://www, cs. wisc. edu/~cao/papers/icache, html.]] Google ScholarDigital Library
- 20.B. Krishnamurthy and C. E. Wills, "Piggyback server invalidation for proxy cache coherency," in Proc. World Wide Web Conference, pp. 185-194, April 1998. http://www .research. art. corn/~bale/papers/ psi-www7.ps, gz]] Google ScholarDigital Library
- 21.E. Cohen, B. Krishnamurthy, and J. Rexford, "Improving end-to-end performance of the web using server volumes and proxy filters," Tech. Rep. 980206-01, AT&T Labs- Research, February 1998. http://www, research, att. com/-bala/papers/ mar ia-tm, ps. gz.]]Google ScholarDigital Library
- 22.R. Fielding, J. Gettys, J. C. Mogul, H. Frystyk, and T. Berners-Lee, "Hypertext transfer protocol- HTTP/1.1,", Internet Draft, March 13 1998. This is a work in progress. http: //www. w3. org/Prot ocols/HTTP / 1.1/ draft- i et f-http-v 11-spec-rev-03. txt.]] Google ScholarDigital Library
- 23.J. C. Mogul, F. Douglis, A. Feldmann, and B. Krishnamurthy, "Potential benefits of delta encoding and data compression for HTTP," in Prec. A UM SIGCOMM, pp. 181-194, August 1997. http://www, inria, fr/rodeo/sigcomm97/ program, html.]] Google ScholarDigital Library
- 24.E. Cohen, B. Krishnamurthy, and J. Rexford, "Evaluating server-assisted cache replacement in the web," in Prec. European Symposium on Algorithms, August 1998. http://www .research. att. corn/~bale/papers/ esa98.ps, gz]] Google ScholarDigital Library
- 25.F. DougHs, A. Feldmann, B. Krishnamurthy, and J. Mogul, "Rate of change and other metrics: A live study of the World Wide Web," in Prec. USENIX Syrup. on Internet Technologies and Systems, pp. 147- 158, December 1997. http://www .research. art. com/-bal a/papers/ roc-us its97, ps. gz]] Google ScholarDigital Library
- 26.M. F. Arlitt and C. L. WiRiamson, "Internet Web servers: Workload characterization and implications," IEEE/A CM Trans. on Networking, vol. 5, pp. 631-644, October 1997. ftp://ftp, cs. usask, ca/pub/discus/ paper. 96-3 .ps. Z.]] Google ScholarDigital Library
Index Terms
- Improving end-to-end performance of the Web using server volumes and proxy filters
Recommendations
Improving end-to-end performance of the Web using server volumes and proxy filters
The rapid growth of the World Wide Web has caused serious performance degradation on the Internet. This paper offers an end-to-end approach to improving Web performance by collectively examining the Web components --- clients, proxies, servers, and the ...
Web Pre-fetching at Proxy Server Using Sequential Data Mining
ICCCT '12: Proceedings of the 2012 Third International Conference on Computer and Communication TechnologyReducing latency for accessing web objects is a major challenge in Proxy Server and various techniques such as web caching and Web pre-fetching is used for it. In this paper we have integrated the approach of web caching and pre-fetching using ...
Criticality aware tiered cache hierarchy: a fundamental relook at multi-level cache hierarchies
ISCA '18: Proceedings of the 45th Annual International Symposium on Computer ArchitectureOn-die caches are a popular method to help hide the main memory latency. However, it is difficult to build large caches without substantially increasing their access latency, which in turn hurts performance. To overcome this difficulty, on-die caches ...
Comments