skip to main content
article

Evaluating Network Processors using NetBench

Published:01 May 2006Publication History
Skip Abstract Section

Abstract

The Network Processor market is one of the fastest growing segments of the microprocessor industry today. In spite of this increasing market importance, there does not exist a common framework to compare the performance of different Network Processor designs. Our primary goal in this study is to fill this gap by creating the NetBench benchmarking suite. NetBench is designed to represent Network Processor workloads. It contains 11 programs that form 18 different applications. The programs are selected from all levels of packet processing: Small, low-level code fragments as well as large application-level programs are included in the suite. These applications are representative of the Network Processor applications in the market. Using the SimpleScalar simulator to model an ARM processor, we study these programs in detail and compare key characteristics, such as instructions per cycle, instruction distribution, cache behavior, and branch prediction accuracy with the programs from MediaBench. Using statistical analysis, we show that the simulation results for the programs in NetBench have significantly different characteristics than programs in MediaBench. Finally, we present performance measurements from Intel IXP1200 Network Processor to show how NetBench can be utilized.

References

  1. Barrett, D. and Silverman, R. 2001. SSH: The Secure Shell, The Definitive Guide. O'Reilly Publishers, Sebastopol, CA.]] Google ScholarGoogle Scholar
  2. Burger, D. and Austin, T. 1997. The SimpleScalar Tool Set, Version 2.0. University of Wisconsin, Technical report.]]Google ScholarGoogle Scholar
  3. Cell-Relay. CRC-32 Calculation, Test Cases and HEC Tutorial. http://cell.onecall.net/cell-relay/publications/software/.]]Google ScholarGoogle Scholar
  4. C-Port Corp. C-5 Digital Communications Processor Product Brief. http://www.cportcorp.com/products/pdf/c5brief.pdf.]]Google ScholarGoogle Scholar
  5. Crowley, P., Fiuczynski, M. E., Baer, J. L., and Bershad, B. N. 2000. Characterizing Processor Architectures for Programmable Network Interfaces. In Proceedings of International Symposium on Supercomputing, Santa Fe, NM.]] Google ScholarGoogle Scholar
  6. EEMBC. An Industry Standard Benchmark. http://www.eembc.org/Benchmark/networking.asp]]Google ScholarGoogle Scholar
  7. Freebsd Project. FreeBSD Operating System. http://freebsd.org]]Google ScholarGoogle Scholar
  8. Halfhill, T. R. 1999. Intel Network Processor Targets Routers. Microprocessor Report 13--12, 1--26.]]Google ScholarGoogle Scholar
  9. Improv Inc. The Jazz PSA platform. http://www.improvsys.com/Products/Jazz.]]Google ScholarGoogle Scholar
  10. Intel Corp. 2000. Intel Pentium III Processor and Intel 815E Performance Brief.]]Google ScholarGoogle Scholar
  11. Intel Corp. SA-110 Microprocessor Technical Reference Manual. ftp://download.intel.com/design/strong/applnots/27819401.pdf.]]Google ScholarGoogle Scholar
  12. International Organization for Standardization. 1984. ISO Information Processing Systems---Data Communication High-Level Data Link Control Procedure---Frame Structure.]]Google ScholarGoogle Scholar
  13. Lee, C., Potkonjak, M., and Mangione-Smith, W. H. 1997a. MediaBench: A Tool for Evaluating and Synthesizing Multimedia and Communications Systems. In Proceedings of International Symposium on Microarchitecture, Research Triangle Park, NC, December. 330-- 335.]] Google ScholarGoogle Scholar
  14. Lee, C.-C., Chen, I.-C. K., and Mudge, T. N. 1997b. The bi-mode branch predictor. In Proceedings of International Symposium on Microarchitecture, Research Triangle Park, NC, December. 4--13.]] Google ScholarGoogle Scholar
  15. Memik, G. and Mangione-Smith, W. H. The NetBench Web Site, http://istanbul.icsl.ucla.edu/NetBench.]]Google ScholarGoogle Scholar
  16. MMC Networks. Leading the Network Processor Revolution, http://www.mmcnet.com/Solutions.]]Google ScholarGoogle Scholar
  17. Nemirovsky, A. 2000. Towards Characterizing Network Processors: Needs and Challenges, XStream Logic Inc.]]Google ScholarGoogle Scholar
  18. Network Processor Forum. Network Processor Forum, http://www.npforum.org.]]Google ScholarGoogle Scholar
  19. PMC-Sierra Inc. URL-based Switching, PMC-2002232, http://www.pmcsierra.com.]]Google ScholarGoogle Scholar
  20. Rivest, R. 1992. The MD5 Message-Digest Algorithm.]] Google ScholarGoogle Scholar
  21. Roesch, M. The Open Source Network Intrusion Detection System Web Site, http://www.snort.org.]]Google ScholarGoogle Scholar
  22. RSA Data Security. RSA Security Downloads, http://www.rsasecurity.com/download.]]Google ScholarGoogle Scholar
  23. Russell, P. IPCHAINS version 1.3.10, http://netfilter.filewatcher.org/ipchains.]]Google ScholarGoogle Scholar
  24. Senie, D. Changing the Default for Directed Broadcasts in Routers. Request for Comment (RFC) 2644.]] Google ScholarGoogle Scholar
  25. Shreedhar, M. and Varghese, G. 1995. Efficient Fair Queuing using Deficit Round Robin. In Proceedings of SIGCOMM'95, Cambridge, MA, Aug/Sep.]] Google ScholarGoogle Scholar
  26. Standard Performance Evaluation Council. Spec CPU2000: Performance Evaluation in the New Millennium, Version 1.1.]]Google ScholarGoogle Scholar
  27. The Nlanr Project. NLANR Network Traffic Packet Header Traces, http://moat.nlanr.net/Traces.]]Google ScholarGoogle Scholar
  28. The OpenBSD Project. Manual pages: sftp(1), http://www.openbsd.org.]]Google ScholarGoogle Scholar
  29. The OpenSSL Project. The Open Source Toolkit for SSL/TSL, http://www.openssl.org.]]Google ScholarGoogle Scholar
  30. Transaction Processing Council. TPC Benchmarks, http://www.tpc.org.]]Google ScholarGoogle Scholar
  31. Wolf, T. and Franklin, M. 2000. CommBench---A Telecommunication Benchmark for Network Processors. In Proceedings of IEEE International Symposium on Performance Analysis of Systems and Software, Austin/TX, (April).]] Google ScholarGoogle Scholar
  32. Woo, S. E. A. 1995. The SPLASH-2 Programs: Characterization and Methodological Considerations. In Proceedings of International Symposium on Computer Architecture, Santa Margherita Ligure, Italy, June. 24--36.]] Google ScholarGoogle Scholar
  33. XStream Corp. XStream Logic Packet Processing Core, http://www.xstreamlogic.com/architectural_files.]]Google ScholarGoogle Scholar
  34. Yeh, T. H. and Patt, Y. 1992. Alternative implementations of two-level adaptive branch prediction. In Proceedings of International Symposium on Computer Architecture, Queensland, Australia, May. 124--134.]] Google ScholarGoogle Scholar

Index Terms

  1. Evaluating Network Processors using NetBench

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            • Published in

              cover image ACM Transactions on Embedded Computing Systems
              ACM Transactions on Embedded Computing Systems  Volume 5, Issue 2
              May 2006
              253 pages
              ISSN:1539-9087
              EISSN:1558-3465
              DOI:10.1145/1151074
              Issue’s Table of Contents

              Copyright © 2006 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 1 May 2006
              Published in tecs Volume 5, Issue 2

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • article

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader