CN103793328A

CN103793328A - Method for completing data base performance test by using automatic procedure

Info

Publication number: CN103793328A
Application number: CN201410061771.1A
Authority: CN
Inventors: 张远斌
Original assignee: Inspur Electronic Information Industry Co Ltd
Current assignee: Inspur Electronic Information Industry Co Ltd
Priority date: 2014-02-24
Filing date: 2014-02-24
Publication date: 2014-05-14

Abstract

The invention provides a method for completing a data base performance test by using an automatic program, and belongs to the technical field of data base performance test application of computers. According to the method, a new data base operation system is developed, and the TPC-H is adopted as a test benchmark to test and measure the ability, about inquiry and decision support, of the data base operation system. In order to improve test efficiency, simplify operation and shorten test time, the java programming language is used to develop the automatic program TPCHAuto, and a user can use the automatic tool to complete whole test required by a TPC-H model.

Description

A kind of method that uses automated procedures to complete database performance measurement

Technical field

The present invention relates to Computer Database performance test applied technical field, specifically a kind of method that uses automated procedures to complete database performance measurement.

Background technology

TPC Benchmark H (TPC-H) is the benchmark of a decision support, and it is revised and formed by a series of inquiries towards business application and parallel data.The data of the inquiry of selecting in benchmark and composition database commercially all have widely representative and are easy to realize.This benchmark has been illustrated three aspects of decision support system (DSS).Analyze a large amount of data; Carry out the inquiry of high complexity; Answer business problem crucial, that often need answer.By carry out a series of inquiries for standard database under controllable environment, TPC-H assesses the performance of various decision support system (DSS).Simulation generates random challenge, than most of OLTP affairs complexity many, comprise various operations and selectivity restriction, produce highdensity activity in the database server side of tested person system, in certain is observed specific entrance and has the database of certain scale, carry out, when realization with owing to synchronizeing the restriction producing with online product database.

So complicated test model, if the test of being undertaken progressively by manual mode need to be wasted a large amount of man power and materials, and the accuracy of test result cannot be guaranteed in these complicated manual operation.

Summary of the invention

For above-mentioned reasons, this is similar to this full automatic testing tool of TPCHAuto with regard to one of needs and realizes, TPCHAuto instrument is to use the compiling of java program language, this has also just guaranteed that TPCHAuto instrument has possessed the portability of java program language equally, security, the features such as concurrency and support visualized graph interface.

The object of this invention is to provide a kind of method that uses automated procedures to complete database performance measurement.

TPCHAuto instrument need have following functions module: (1) data importing and cleaning module (2) complete test transaction module (3) statistics and process test duration module (4) operation interface configuration module;

The data importing of telling and cleaning modular design, routine call DBGEN instrument generates test data, and the test data of the fixed size that instrument is generated, is inserted in database by insert statement, in the time having new data to import, this module also will complete the cleaning work of legacy data;

The described test transaction module that completes designs, and this module completes the test affairs of TPC-H test, Power@Size test and Throughtput@Size test; Power Size has tested one and has inquired about stream and a renewal stream, and Throughtput completes multiple queries stream and multiple renewal is flowed, the size of concrete several Size of depending on, i.e. the size of data volume;

Described statistics and processing test duration modular design, final test result QphH@Size and Price-per-QphH@Size are added up and calculated to this module by time and the result of the test such as Power@Size and Throught@Size of affairs test, and generate test report according to TPC-H standard.

Described operation interface configuration module design, this module has mainly designed the operation interface of TPCHAuto instrument, and user can carry out by this operation interface the operation in each stage of whole TPC-H test.

SQL92 standard is followed in the database definition of TPC-H and data manipulation, and some DBSM not exclusively support SQL92, this requires under the semantic constant prerequisite of assurance, and TPCHAuto has the function of transferring data type and modification SQL statement.Testing tool need to be set up 8 tables in tested database, loads the data of the quantity of user's formulation, in the time of repeated test, also will have the function of data in cleaning table.

TPCHAuto can set up inquiry stream according to user's requirement, and be inquiry stream numbering, control the minimum requirements that inquiry stream is not less than TPC-H standard, multiple queries stream and renewal stream colleague send request of access as measured data storehouse, these requests of the concurrent inquiry of DBMS simultaneously.Each inquiry in each stream and to upgrade execution time of operation measured and record, deposits hereof with XML form.In the time that test completes, TPCHAuto can select measurement index Power Size by automat, Throughput Size, QphH Size and Price-per-QphH Size.And generate test report according to TPC-H standard.

TPCHAuto can make user pass through gui interface configuration parameter, as SF or data volume, inquiry stream number, database server address, measured data library name etc., with dynamically testing progress before this of word and graphics mode.User is test and test automatically separately.The former tests with go-ahead mode guiding user; The latter user only need to set up test parameter, and TPCHAuto can complete whole tests automatically, middle without any need for manual intervention.

The invention has the beneficial effects as follows:

Object-oriented Programming Design, java language development that automation tools TPCHAuto uses, graphic user interface, has realized the robotization of test and Throughput test from data loading to Power, the whole process of generation test report; Thereby reach and shortened the test duration, reduce difficulty of test, improve the objects such as test result accuracy.

Accompanying drawing explanation

Accompanying drawing 1 is pressed face type object designs, the graph of a relation between class and class for TPCHAuto structure.

Embodiment

With reference to the accompanying drawings, content of the present invention is described to its implementation and the course of work with instantiation.

In TPCHAuto structure, be divided into 6 parts, by face type object designs, between class and class, be related to the processing of concrete kind structure:

MainFrame class: bear the mutual of user and TPCHDriver, it comprises label, knob, text area etc. and response events.User can be at this parameters as the size of the link information of the type of DBMS, database, data volume (SF).In interface, can dynamically show testing progress information and test result information.

DataCreater class: the data volume rank SF specifying according to user, check whether hard drive space meets the demand of loading data, then call DBGEN and produce data, load data.

DbControl class: realize the operation relevant to database, as database connection, DML and DDL operation etc.TPCHDriver connects by JDBC.

DbCreater class: initialization data storehouse, comprises and build table and loading data.TPC-H standard recommendation often does a test and all will empty database, the data of reloading.

QueryStream class: call QGEN and produce inquiry stream, 22 SELECT statements that comprise random chronological order in inquiry stream.

RefreshStream class: call QGEN and produce renewal stream, INSERT statement and DELETE statement in stream are embedded in loop program.

PowerTest class: simulation single query stream and single renewal stream, realize Power test.

ThoughputTest class: simulate n concurrent user, i.e. n inquiry stream.

AutoTest class: call DataCreater, DbCreater, QueryStream.

DBGEN and QGEN process:

DBGEN and QGEN, as the annex of TPC-H standard, are C source programs, default operating in Unix operating system, access pad database.They can be transplanted on the machine that ANSI C compiler is provided easily.DBGEN and QGEN before use need to be take makefile.suite as masterplate, create a makefile file, and fill in the option in makefile file, as compiler CC, database D ATABASE, gallery MACHINE, loadtype WORKLOAD, file destination OBJ, executable file EXE and chained library LIBS etc.

DBGEN is for generation of the data in test library, and the data of generation are stored in text, and DATAReady class reads the data in text, is assembled into INSERT statement, as data inserting in table.DBGEN can be with parameter, the data number of times producing as-s parameter adjustment scale ,-C parameter control, the generation data which time be-S parameter select to carry out, the number that stream is upgraded in-U parameter adjustment.For example dbgen – s 100 – S 1-C 100 (producing the file of first 1GB), dbgen – s 100 – S 2 – C 100 (producing the file of second 1GB), dbgen – s 100 – U 5(produce 5 users' that SF is 100GB renewal stream)

QGEN is for generation of SELECT statement, and the SELECT statement of generation is kept at text.TranQuery class reads the SELECT statement in text, composition inquiry stream.QGEN is equivalent to a text filter, the variable with ": " in $ DSS_QUERY/<name>.sql module is replaced to the parameter of automatic generation.QGEN also has a lot of parameters, but in the ordinary course of things, does not need to use these parameters.

User only need to set up test parameter, and TPCHAuto can complete whole tests automatically, middle without any need for manual intervention, has shortened the test duration, reduces difficulty of test, has improved test result accuracy.

Claims

1. a method that uses automated procedures to complete database performance measurement, it is characterized in that developing a robotization handling implement TPCHAuto who is applied to TPC-H standardized test, this TPCHAuto instrument need have following functions module: (1) data importing and cleaning module (2) complete test transaction module (3) statistics and process test duration module (4) operation interface configuration module;

Described statistics and processing test duration modular design, final test result QphH@Size and Price-per-QphH@Size are added up and calculated to this module by time and the result of the test such as Power@Size and Throught@Size of affairs test, and generate test report according to TPC-H standard;

2. a kind of method that uses automated procedures to complete database performance measurement according to claim 1, it is characterized in that Object-oriented Programming Design, java language development that TPCHAuto uses, graphic user interface, can set up inquiry stream according to user's requirement, and be inquiry stream numbering, control the minimum requirements that inquiry stream is not less than TPC-H standard, multiple queries stream and renewal stream colleague send request of access as measured data storehouse, these requests of the concurrent inquiry of DBMS simultaneously; Each inquiry in each stream and to upgrade execution time of operation measured and record, deposits hereof with XML form; In the time that test completes, TPCHAuto can automat choosing measure Power Size, Throughput Size, and QphH Size and Price-per-QphH Size, and generate test report according to TPC-H standard.