JP2009015437A - Benchmark test device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a benchmark test device handling a change in the architecture of an OS (Operating System) or hardware. <P>SOLUTION: This benchmark test device 1 has: a hardware condition input reception means 21 receiving input of a hardware condition; a benchmark program generation means 33 generating a benchmark program based on the hardware condition input to the hardware condition input reception means; and a simulation execution means 34 executing simulation based on the benchmark program generated by the benchmark program generation means, and outputting a benchmark. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a benchmark test apparatus for evaluating the performance of hardware and software of a computer system.

  Conventionally, a test for measuring the performance of computer system hardware and software is called a benchmark test. An index (or measurement program itself) output as a result is called a benchmark. Hereinafter, the output index is referred to as a benchmark, and the measurement program is referred to as a benchmark program.

The benchmark test includes a test that is performed by operating a computer or software that is actually a test target, and a test that is performed as a simulation by executing a benchmark program. As an example of the latter, an invention relating to a performance evaluation program generation device for a computer system provided with a source code input means for inputting a plurality of similar programs / source codes similar to an evaluation object into the device is disclosed (for example, Patent Documents). 1). This apparatus analyzes each input similar program source code, extracts the number of generated processing instructions, and generates a benchmark test program (benchmark program) based on the number of generated processing instructions.
JP 11-296399 A

  However, although the above-mentioned conventional apparatus can measure the performance of software in a general purpose to some extent, it cannot cope with changes in hardware and OS (Operating System).

  The present invention has been made to solve such problems, and a main object of the present invention is to provide a benchmark test apparatus that can cope with changes in hardware and OS architecture.

  In order to achieve the above object, one aspect of the present invention includes a hardware condition input receiving unit that receives input of hardware conditions, and a benchmark program based on the hardware conditions input to the hardware condition input receiving unit. A benchmark test apparatus comprising: a generated benchmark program generating means; and a simulation executing means for executing a simulation based on the benchmark program generated by the benchmark program generating means and outputting a benchmark.

  According to this aspect of the present invention, since the benchmark program is generated based on the hardware condition input to the hardware condition input receiving means, it is possible to cope with a change in hardware architecture.

  In one aspect of the present invention, a benchmark input receiving unit that receives a benchmark input obtained using real hardware is provided, and the benchmark program generating unit is configured to output the simulation executing unit and the benchmark input receiving unit. It may be a means for changing the method of generating the benchmark program based on the comparison with the input benchmark.

  In one aspect of the present invention, there is provided OS condition information acquisition means for acquiring OS condition information, and the benchmark program generation means is means for generating a benchmark program based on the OS conditions acquired by the OS condition information acquisition means. There may be.

  In one aspect of the present invention, the hardware condition received by the hardware condition input receiving unit may include a CPU type and a CPU version.

  ADVANTAGE OF THE INVENTION According to this invention, the benchmark test apparatus which can respond to the change of the architecture of hardware or OS can be provided.

  Hereinafter, the best mode for carrying out the present invention will be described with reference to the accompanying drawings.

  Hereinafter, a benchmark test apparatus 1 according to an embodiment of the present invention will be described. The benchmark test apparatus 1 is configured as a computer unit such as an ECU (Electronic Control Unit) to which a CPU, RAM, ROM, HDD, and the like are connected via a bus, for example. FIG. 1 is a diagram illustrating functional blocks included in the benchmark test apparatus 1. The benchmark test apparatus 1 includes a benchmark source management unit 10, a hardware information management unit 20, and a benchmark program generation unit 30 as functional blocks that function when a program stored in a ROM is expanded (loaded) on the RAM. And a benchmark result management unit 40.

  The benchmark source management unit 10 is a part that performs source management of a benchmark test target that does not depend on hardware, and includes a source code input unit 11, a source code analysis unit 12, and an analysis result database 13.

  The source code input unit 11 is a registration unit for source code to be benchmarked. Although the language of the source code is not specified, for example, registration is performed not as an assembler level but as a source code at a level independent of hardware such as C language. Registration of the source code is performed by connecting, inserting, connecting, or transferring information by wired or wireless communication.

  The source code analysis unit 12 is an analysis unit for the source code input to the source code input unit 11.

  The analysis result database 13 is a database that stores the analysis result of the source code analysis unit 12. The information stored in the analysis result database 13 includes, for example, the type of instruction used, the number of instructions, inter-process communication, memory access frequency / data size, and device access frequency / size. The device means a character device, block device, network device, or the like.

  The hardware information management unit 20 includes a hardware condition input unit 21, a hardware information database 22, and an OS benchmark library 23.

  The hardware condition input unit 21 accepts input of hardware information as a benchmark test target as a condition for generating a benchmark program. The information that can be accepted includes CPU type, CPU version, CPU command set option support information, CPU clock, CPUI number, etc. Memory related items include the presence / absence of cache, cache size, cache way size, main memory type, main memory capacity, main memory operating speed, etc., and bus related items include bus and protocol type, bus operating speed, etc. It is. In addition, information input such as graphic performance, network performance, and storage performance may be accepted.

  The hardware information database 22 is a database that stores information input to the hardware condition input unit 21. For example, an RDB (relational database; one piece of data is expressed as a set of a plurality of items (fields). Information is held by a method of representing a set of data as a table called a table), and it is possible to flexibly cope with update / change of each item.

  The OS benchmark library 23 includes a benchmark program for an OS (Operating System) installed on hardware. This is because the system performance varies greatly depending on the OS performance (file system, system call, scheduler implementation method). Here, a file system is a collection of abstract data types, and is implemented for storage, hierarchical structure, and data manipulation / access / search. The system call means a mechanism used to call the OS kernel function or an API function provided in the OS.

  Examples of benchmark programs stored in the OS benchmark library 23 include those that measure file system performance (such as iobench), those that measure network performance (such as netperf), those that measure scheduler performance, and those that measure computing performance. And the like (such as dhrystone), those that measure graphic drawing performance (such as x11perf and glperf), and those that measure real-time response performance.

  The benchmark program generation / execution unit 30 is a functional block that generates a benchmark program corresponding to hardware, and includes a program generation library 31, an algorithm update unit 32, a benchmark program generation unit 33, a benchmark program execution unit 34, Have.

  The program generation library 31 is a library for generating a benchmark program. For example, it holds basic benchmark programs such as Dhrystone and Whetstone. In addition, a library of synthetic benchmark programs for evaluating a science and technology calculation library or the like as a system may be included.

  The algorithm update unit 32 has a function of updating or newly registering an algorithm of the benchmark program. With this function block, when the function of the benchmark program becomes obsolete, a new one can be added at any time.

  The benchmark program generation unit 33 appropriately selects (and synthesizes) a benchmark program from the program generation library 31 and the OS benchmark library 23 based on the information stored in the hardware information database 22, and the benchmark program execution unit The execution binary of the format which 34 can execute is produced | generated. Information (conditions) for selecting a benchmark program or the like is held in the storage unit of the benchmark program generation unit 33 and is changed by the algorithm update unit 32 as needed.

  The benchmark program execution unit 34 emulates a function based on the input hardware condition using the execution binary generated by the benchmark program generation unit 33, and executes a simulation for outputting a benchmark.

  With such a function, it is possible to flexibly cope with changes in hardware and OS. In a conventional benchmark test device, when the hardware or OS performance (CPU clock, etc.) that is a prerequisite for the computer system to be tested is changed, the benchmark is corrected by changing parameters, etc. Although it is possible, it has not been possible to cope with changes in hardware or OS architecture (design concept). In this respect, in the benchmark test apparatus 1 of the present embodiment, the algorithm of the benchmark program and the method of program selection (and synthesis etc.) from the library are changed, so that it is possible to cope with changes in hardware and OS architecture.

  The benchmark result management unit 40 includes a benchmark result input unit 41 and a benchmark result storage unit 42.

  The benchmark result input unit 41 receives not a benchmark as a simulation result by the present apparatus but an input of a benchmark obtained using actual hardware.

  The benchmark result accumulation unit 42 stores the benchmark input to the benchmark result input reception unit 40. Then, based on the comparison with the benchmark as a simulation result by the present apparatus, a benchmark program selection (and synthesis, etc.) and a correction instruction for the algorithm itself are output to the algorithm update unit 32 and the benchmark program generation unit 33. .

  With such a function, when the benchmark as a simulation result by the present apparatus deviates from the actual performance, it can be appropriately corrected. Therefore, the performance of the computer system can be measured more accurately.

  The best mode for carrying out the present invention has been described above with reference to the embodiments. However, the present invention is not limited to these embodiments, and various modifications can be made without departing from the scope of the present invention. And substitutions can be added.

  The present invention can be used in the automobile manufacturing industry, the automobile parts manufacturing industry, and the like.

It is a figure which shows the functional block which the benchmark test apparatus 1 has.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Benchmark test apparatus 10 Benchmark source management part 11 Source code input part 12 Source code analysis part 13 Analysis result database 20 Hardware information management part 21 Hardware condition input part 22 Hardware information database 23 OS benchmark library 30 Benchmark program generation and Execution unit 31 Library for program generation 32 Algorithm update unit 33 Benchmark program generation unit 34 Benchmark program execution unit 40 Benchmark result management unit 41 Benchmark result input unit 42 Benchmark result storage unit

Claims (4)

Hardware condition input receiving means for receiving input of hardware conditions;
Benchmark program generating means for generating a benchmark program based on the hardware conditions input to the hardware condition input receiving means;
Simulation execution means for executing a simulation based on the benchmark program generated by the benchmark program generation means and outputting a benchmark;
Benchmark test equipment with The benchmark test apparatus according to claim 1,
Benchmark input acceptance means that accepts benchmark input obtained using real hardware,
The benchmark program generating means is means for changing the method of generating the benchmark program based on a comparison between the output of the simulation executing means and the benchmark input to the benchmark input receiving means.
Benchmark test equipment. The benchmark test apparatus according to claim 1 or 2,
OS condition information acquisition means for acquiring OS condition information is provided,
The benchmark program generation means is means for generating a benchmark program based on the OS conditions acquired by the OS condition information acquisition means.
Benchmark test equipment. A benchmark test apparatus according to any one of claims 1 to 3,
The hardware conditions received by the hardware condition input receiving means include a CPU type and a CPU version.
Benchmark test equipment.

Images