Shimin Chen
Manos Athanassoulis
Phillip B. Gibbons
Ippokratis Pandis
Abstract
TPC-E is a new OLTP benchmark recently approved by the Transaction Processing Performance Council (TPC). In this paper, we compare TPC-E with the familiar TPCC benchmark in order to understand the behavior of the new TPC-E benchmark. In particular, we compare the I/O access patterns of the two benchmarks by analyzing two OLTP disk traces. We find that (i) TPC-E is more read intensive with a 9.7:1 I/O read to write ratio, while TPC-C sees a 1.9:1 read-to-write ratio; and (ii) although TPC-E uses pseudo-realistic data, TPC-E's I/O access pattern is as random as TPC-C. The latter suggests that like TPC-C, TPC-E can benefit from SSDs, which have superior random I/O support. To verify this, we replay both disk traces on an Intel X25-E SSD and see dramatic improvements for both TPC-C and TPC-E.
- M. Canim, B. Bhattacharjee, G. A. Mihaila, C. A. Lang, and K. A. Ross. An object placement advisor for DB2 using solid state storage. PVLDB, 2(2):1318--1329, 2009. Google Scholar
Digital Library
- S. Chen. FlashLogging: exploiting flash devices for synchronous logging performance. In SIGMOD, 2009. Google ScholarDigital Library
- G. Graefe. The five-minute rule twenty years later. In DaMoN Workshop, 2007. Google ScholarDigital Library
- S. Kavalanekar, B. L. Worthington, Q. Zhang, and V. Sharda. Characterization of storage workload traces from production windows servers. In 4th International Symposium on Workload Characterization (IISWC), 2008.Google ScholarCross Ref
- S.-W. Lee, B. Moon, C. Park, J.-M. Kim, and S.-W. Kim. A case for flash memory SSD in enterprise database applications. In SIGMOD, 2008. Google ScholarDigital Library
- Transaction Processing Performance Council. TPC-C Benchmark Revision 5.10.1. http://www.tpc.org/tpcc/.Google Scholar
- Transaction Processing Performance Council. TPC-E Benchmark Version 1.9.0. http://www.tpc.org/tpce/.Google Scholar
- Transaction Processing Performance Council. TPC-E Benchmark Overview. http://www.tpc.org/ tpce/spec/TPCEpresentation.ppt, February 2007.Google Scholar
Index Terms
- TPC-E vs. TPC-C: characterizing the new TPC-E benchmark via an I/O comparison study
Recommendations
New TPC benchmarks for decision support and web commerce
For as long as there have been DBMS's and applications that use them, there has been interest in the performance characteristics that these systems exhibit. This month's column describes some of the recent work that has taken place in TPC, the ...
New Initiatives in the TPC
Performance Evaluation and BenchmarkingAbstractTPC stands for stricter standards and tougher tests in system benchmarking for over 30 years, during which technology advanced enormously. In order to stay relevant the TPC had to adapt to the advancing technology or become obsolete. Initially, ...
Overview of TPC Benchmark E: The Next Generation of OLTP Benchmarks
Performance Evaluation and BenchmarkingSet to replace the aging TPC-C, the TPC Benchmark E is the next generation OLTP benchmark, which more accurately models client database usage. TPC-E addresses the shortcomings of TPC-C. It has a much more complex workload, requires the use of RAID-...
Comments