1、Experimental MethodologyZhongying Niu1AgendaBenchmarkMacro-benchmarkMicro-benchmarkTrace-driven benchmarkMonitor toolsPerformance comparison2Macro-benchmarkSynthetic benchmarkIozone, Iometer, Bonnie+, Postmark, etc.Application benchmarkTPC-C, TPC-H, Spec SFS97, SPEC WEB99, SPEC SDM, etc.3IozoneA ben

2、chmark for testing performance: Read, write, re-read, re-write, read backwards, read strided, fread, fwrite, random read/write, pread/pwrite variants, aio_read, aio_write, mmapExamples of running Iozone./iozone -s 2g -i0 -i1 -i2 -f /mnt/test -Rab 20040619-2g_1_1_1_1m.xls4IozoneCommand line options-a

3、 Used to select full automatic mode. Produces output that covers all tested for record sizes of 4k to 16M for of 64k to 512M.-b Iozone will create a binary Excel compatible output of results.-f Used to specify the for the temporary test.-i # Used to specify which tests to run. (0=write/rewrite, 1=re

4、ad/re-read, 2=random-read/write, )-s # Used to specify the size, in Kbytes, of the test.-R Generate Excel report.5Iometer An I/O subsystem measurement and characterization tool for single and clustered systems.Both a workload generator and a measurement tool.Iometer consists of two programs, Iometer

5、 and Dynamo.Iometer is the controlling program.Dynamo is the workload generator.6IometerIometer can be used for measurement and characterization of:Performance of disk and network controllers.Bandwidth and latency capabilities of buses.Network throughput to attached drives.Shared bus performance.Sys

6、tem-level hard drive performance.System-level network performance.7Iometer8Bonnie+Usage:bonnie+ -d scratch-dir -s size(Mb):chunk-size(b) -n number-to-stat:max-size:min-size:num-directories -m machine-name -r ram-size-in-Mb -x number-of-tests -u uid-to-use:gid-to-use -g gid-to-use -q -f -b -p process

7、es | -yExamples of running Bonnie+bonnie+ -d /global/oradata m sun3510 s 2048 r 10249Bonnie+bonnie+ -d /global/oradata -s 8192 -m d2org -u oracleVersion 1.03 -Sequential Output- -Sequential Input- -Random- -Per Chr- -Block- -Rewrite- -Per Chr- -Block- -Seeks-Machine Size K/sec %CP K/sec %CP K/sec %C

8、P K/sec %CP K/sec %CP /sec %CPd2org 8G 15681 55 26302 23 13877 31 26420 91 88215 49 462.6 5 -Sequential Create- -Random Create- -Create- -Read- -Delete- -Create- -Read- -Delete- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 1245 10 + + 3541 27 2837 21 + + 385 3d2org,8G,15681,55,2630

9、2,23,13877,31,26420,91,88215,49,462.6,5,16,1245,10,+,+,3541,27,2837,21,+,+,385,310PostmarkTo simulate heavy small- loadsPostMark was designed to create a large pool of continually changing files and to measure the transaction rates for a workload approximating a large Internet e-mail serverPostMark

10、configuration parameters:The number of files created: 500 Files range: between 500 bytes and 9.77 kilobytes in sizeThe number of transactions: 500/per fileBlock sizes for reads and writes: 512 bytes11Micro-benchmarkper operation latency, completion timecommon operations: creat, link, rename, chmod, stat, access, write and mkdir, etc.12Trace-driven benchmarkGat