CN114138577B

CN114138577B - TPC-H test method and device, computer equipment and storage medium

Info

Publication number: CN114138577B
Application number: CN202111432769.7A
Authority: CN
Inventors: 魏加旺
Original assignee: Suzhou Inspur Intelligent Technology Co Ltd
Current assignee: Suzhou Inspur Intelligent Technology Co Ltd
Priority date: 2021-11-29
Filing date: 2021-11-29
Publication date: 2024-01-19
Anticipated expiration: 2041-11-29
Also published as: CN114138577A

Abstract

The invention relates to a TPC-H test method and device on ARM architecture equipment, computer equipment and a storage medium, and belongs to the technical field of testing. Constructing a main source code file, a parameter configuration file, a database definition, a creation file and a data query command definition file by executing a pre-generated program on ARM architecture equipment, and generating an executable program based on ARM architecture; and running the executable program, importing test data, executing SQL sentences and completing TPC-H test on the ARM architecture processor. The method can realize TPC-H performance evaluation of the ARM architecture processor, and can compare and evaluate the performance of the multi-architecture processor under a unified standard.

Description

TPC-H test method and device, computer equipment and storage medium

Technical Field

The invention belongs to the technical field of testing, and particularly relates to a TPC-H testing method and device on ARM architecture equipment, computer equipment and a storage medium.

Background

The Transaction Performance Committee (TPC), a non-profit organization created by tens of member companies, formulated standard specifications, performance and price metrics for business application benchmark tests, is an objective, fair, audit-tight evaluation institution widely accepted in the industry.

TPC-H is the performance evaluation standard of the decision support system formulated by TPC organization, and is used for evaluating the capability of the server in terms of data mining and analysis processing. The TPC-H test model defines 8 tables and 22 queries for a sales and management system of commodity retail industry, and the test has the characteristics of complexity, diversified access modes, randomness and the like, is quite similar to the actual application, and has wide reference significance.

The TPC organization only prescribes the test rule of TPC-H and provides the generation tool of data used for TPC-H test and the generation tool of 22 inquiry sentences, each manufacturer can select the software and hardware environment of hardware, database, operating system and the like by himself, and select the size of the test data in the test data scale of 1GB,10GB,30GB, …,30000GB and 100000GB, and all the data inquiry sentences must be generated by the official provision tool. The benchmark test includes 22 queries (Q1-Q22), the main evaluation index of which is the response time of each query, i.e., the time required from submitting a query to returning a result. The unit of measure of TPC-H benchmarking is the number of queries performed per hour, qphh@size, where H represents the average number of complex queries performed by the system per hour and size represents the size of the database scale, which can reflect the system's ability to process queries.

Currently, the TPC authorities provide test tools based on the x86 architecture, and 2 DBgen executable programs for test data generation are dbgen.exe of the Windows platform and DBgen of the Linux platform, respectively. The user can use these two tools for data generation and query SQL generation, respectively.

The prior art can realize testing on an X86 architecture and evaluate the TPC-H test performance index of the server. However, on the ARM architecture server, neither Windows nor Linux (various Linux-based operating systems) can be executed, so TPC-H testing cannot be implemented, and it becomes difficult to evaluate the OLAP level of the ARM server.

Disclosure of Invention

The invention aims to overcome the defects and shortcomings of the prior art, and provides a TPC-H test method and a TPC-H test system on an ARM architecture processor, which are used for constructing a main source code file, a parameter configuration file, a database definition, a creation file and a data query command definition file by executing a pre-generated program on ARM architecture equipment to generate an executable program based on an ARM architecture; and running the executable program, importing test data, executing SQL sentences and completing TPC-H test on the ARM architecture processor. The method can realize TPC-H performance evaluation of the ARM architecture processor, and can compare and evaluate the performance of the multi-architecture processor under a unified standard.

According to one aspect of the present invention, there is provided a TPC-H test method on an ARM architecture device, the method comprising the steps of:

decompressing the TPC-H tool package on ARM architecture equipment, and deleting an original test data generation program and an original query statement generation program in the tool package;

copying a pre-generated program construction main source code file, a parameter configuration file, a database definition, a creation file and a data query command definition file to a designated file directory of ARM architecture equipment;

performing source code compiling on the program construction main source code file and the parameter configuration file to generate a TPC-H executable test data generation program and a query statement generation program based on ARM architecture equipment;

running the test data generating program and the query statement generating program to generate test data and database query statements;

executing a creation command according to the database definition and the creation file, and creating a database and a data table;

executing a creation command according to the data query command definition file, and creating a main key and an external key required by a database and a data table in TPC-H test;

and importing the generated test data, executing the database query statement, and completing TPC-H test on ARM architecture equipment.

Preferably, before decompressing the TPC-H toolkit on the ARM architecture device and deleting the original test data generating program and the query statement generating program in the toolkit, the method further includes:

acquiring a TPC-H tool package;

and installing a Linux operating system on the ARM architecture device, and copying the TPC-H toolkit to the lower part of the Linux operating system.

Preferably, before copying the pre-generated program construction main source code file, parameter configuration file, database definition and creation file, and data query command definition file to the appointed file directory of the ARM architecture device, the method further comprises:

according to the TPC-H data specification, the development program constructs a main source code file, a parameter configuration file, a database definition and a creation file and a data query command definition file.

Preferably, the program constructs a main source code file for:

and the data query command definition file is associated with the parameter configuration file, the database definition and creation file and the data query command definition file, and defines the database type, the compiling language type, the operating system type and the program output format, so as to generate a test data generation file and a query statement generation file which can be executed on ARM architecture equipment.

Preferably, the parameter profile is for:

configuration information used for TPC-H tests is defined, including one or more of TPC-H characters used, character type, character length, character format, output file type.

Preferably, the database definition and creation file are used for:

deleting the existing TPC-H database, creating a new TPC-H database, switching to the new TPC-H database, creating a data table, and setting the type and length of the table characters.

Preferably, the data query command definition file is used for:

and calling the newly created TPC-H database, deleting the original primary key, adding the database table and the primary key and the external key used by the database table.

According to a second aspect of the present invention, the present invention further provides a TPC-H test apparatus on an ARM architecture device, including:

the initialization module is used for decompressing the TPC-H tool package on ARM architecture equipment and deleting the original test data generation program and the query statement generation program in the tool package; copying a pre-generated program construction main source code file, a parameter configuration file, a database definition, a creation file and a data query command definition file to a designated file directory of ARM architecture equipment;

the running module is used for constructing a main source code file and a parameter configuration file for the program, performing source code compiling, and generating a TPC-H executable test data generating program and a query statement generating program based on ARM architecture equipment; running the test data generating program and the query statement generating program to generate test data and database query statements; executing a creation command according to the database definition and the creation file, and creating a database and a data table; executing a creation command according to the data query command definition file, and creating a main key and an external key required by a database and a data table in TPC-H test;

and the test module is used for importing the generated test data, executing the database query statement and completing TPC-H test on ARM architecture equipment.

According to a third aspect of the present invention there is also provided a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterised in that the processor when executing the computer program performs the steps of:

According to a fourth aspect of the present invention there is also provided a computer readable storage medium having stored thereon a computer program, characterized in that the computer program when executed by a processor performs the steps of:

The beneficial effects are that: on the premise of conforming to the official data specification of TPC-H, the invention generates an executable program based on the ARM architecture by developing source codes and compiling the source codes on the ARM architecture, thereby completing data import, SQL statement execution and test result collection. The invention eliminates the original program which cannot be executed on the ARM architecture of the TPC-H, generates the executable program and can realize the TPC-H performance evaluation on the ARM architecture.

Features and advantages of the present invention will become apparent by reference to the following drawings and detailed description of embodiments of the invention.

Drawings

FIG. 1 is a flow chart of a TPC-H test method on ARM architecture equipment in one embodiment;

FIG. 2 is a block diagram of a TPC-H test apparatus on ARM architecture equipment in one embodiment;

FIG. 3 is an internal block diagram of a computer device in one embodiment.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

Example 1

FIG. 1 is a flow chart of a TPC-H test method on an ARM architecture processor. As shown in fig. 1, the present invention provides a TPC-H test method on an ARM architecture processor, the method comprising the steps of:

s1: decompressing the TPC-H tool package on ARM architecture equipment, and deleting the original test data generation program and query statement generation program in the tool package.

S2: and copying the pre-generated program construction main source code file, parameter configuration file, database definition, creation file and data query command definition file to the appointed file directory of the ARM architecture device.

Specifically, the program constructs a main source code file for: and the data query command definition file is associated with the parameter configuration file, the database definition and creation file and the data query command definition file, and defines the database type, the compiling language type, the operating system type and the program output format, so as to generate a test data generation file and a query statement generation file which can be executed on ARM architecture equipment.

The parameter configuration file is used for: configuration information used for TPC-H tests is defined, including one or more of TPC-H characters used, character type, character length, character format, output file type.

Database definition and creation file is used for: deleting the existing TPC-H database, creating a new TPC-H database, switching to the new TPC-H database, creating a data table, and setting the type and length of the table characters.

The data query command definition file is used for: and calling the newly created TPC-H database, deleting the original primary key, adding the database table and the primary key and the external key used by the database table.

S3: and constructing a main source code file and a parameter configuration file for the program, and performing source code compiling to generate a TPC-H executable test data generating program and a query statement generating program based on ARM architecture equipment.

S4: and running the test data generating program and the query statement generating program to generate test data and database query statements.

S5: and executing the creation command according to the database definition and the creation file, and creating the database and the data table.

S6: and executing the creation command according to the data query command definition file, and creating the primary key and the external key required by the database and the data table in the TPC-H test.

S7: and importing the generated test data, executing the database query statement, and completing TPC-H test on ARM architecture equipment.

In one embodiment, before the step S1, the method further includes:

acquiring a TPC-H tool package;

In one embodiment, before the step S2, the method further includes:

A specific implementation procedure is given below, which includes the following steps:

01 TPC-H toolkit, login http:// www.tpc.org/tpch/, download TPC-Htool-kit;

02 A Linux operating system is installed, and TPC-Htool-kit is copied to the operating system;

03 If the OS does not have GCC compiler, manually install the GCC toolkit;

04 Decompressing the TPC-H tool pack, deleting the original DBgen and Qgen programs in the tool pack, and applying the plurality of devices provided by the invention in the tool pack, wherein the plurality of devices comprise four devices, and files related to the four devices are makefile, tpcd.h, dss.ddl and dss.ri respectively;

file makefile associated with the first device (program build master source file): and the device is used for linking the relevant content of the tpc source data with other 3 devices to generate dbgen and qgen files which can be finally executed.

File tpcd.h associated with the second device (parameter profile): for defining configuration information such as the type, length, format, output file, etc. of the characters used by the tpch.

Third means (database definition and creation of file) associated files dss.ddl: for defining and creating databases, data tables.

Fourth means (data query command definition file) associated file dss.ri: the sql statement content is used to define the primary and foreign keys used in the database table.

05 Copying the four files to/tpah_kit/dbgen/directory;

06 Mysql database is adopted, mysql is correspondingly used in the device, and the device can be replaced by other databases according to the requirements of users.

07 Generating DBgen tools, executing under makefile peer directory: make (make)

08 Generating a test data table and a query sql statement, executing:

dbgen-s 1 (this is data size, units defaults to G);

1 is replaced by 2-22 respectively, and 22 times are executed to generate 22 query sql sentences;

09 Creating a database and a data table, and executing \dss.dll in the database;

10 Creating a primary key foreign key required by the tpch test, and executing \dss. Ri in a database;

after the four devices are operated, the testing is completed according to the operations of database importing, sql statement inquiring execution, time inquiring collection and the like in the TPC-H testing flow.

According to the embodiment, on the premise of conforming to the official data specification of TPC-H, the source code is developed, source code compiling is carried out on the ARM architecture, an executable program based on the ARM architecture is generated, and then data importing, SQL statement executing and test result collecting are completed. The embodiment deletes the original program which cannot be executed on the ARM architecture of the TPC-H, generates the executable program and can realize the TPC-H performance evaluation on the ARM architecture.

It should be understood that, although the steps in the flowchart of fig. 1 are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in fig. 1 may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, nor do the order in which the sub-steps or stages are performed necessarily performed in sequence, but may be performed alternately or alternately with at least a portion of other steps or sub-steps of other steps.

Example 2

Fig. 2 is a schematic diagram of a TPC-H test device on an ARM architecture device. The device comprises an initialization module, an operation module and a test module, wherein:

In one embodiment, the apparatus further comprises a preparation module for:

acquiring a TPC-H tool package;

For specific limitations of the TPC-H test means on the ARM architecture device, reference may be made to the above limitation of the TPC-H test method on the ARM architecture device, and no further description is given here. The modules in the TPC-H test device on the ARM architecture apparatus may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.

In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 3. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer device is used for storing TPC-H test data on ARM architecture devices. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program, when executed by a processor, implements a TPC-H test method on ARM architecture devices.

It will be appreciated by those skilled in the art that the structure shown in fig. 3 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.

In one embodiment, a computer device is provided comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the steps of when executing the computer program:

s1: decompressing the TPC-H tool package on ARM architecture equipment, and deleting an original test data generation program and an original query statement generation program in the tool package;

s2: copying a pre-generated program construction main source code file, a parameter configuration file, a database definition, a creation file and a data query command definition file to a designated file directory of ARM architecture equipment;

s3: performing source code compiling on the program construction main source code file and the parameter configuration file to generate a TPC-H executable test data generation program and a query statement generation program based on ARM architecture equipment;

s4: running the test data generating program and the query statement generating program to generate test data and database query statements;

s5: executing a creation command according to the database definition and the creation file, and creating a database and a data table;

s6: executing a creation command according to the data query command definition file, and creating a main key and an external key required by a database and a data table in TPC-H test;

In one embodiment, the processor when executing the computer program further performs the steps of:

acquiring a TPC-H tool package;

In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, performs the steps of:

In one embodiment, the computer program when executed by the processor further performs the steps of:

acquiring a TPC-H tool package;

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.

Claims

1. A TPC-H test method applied to ARM architecture equipment, said method comprising the steps of:

the program constructs a main source code file for: the method comprises the steps of associating with a parameter configuration file, a database definition and creation file and a data query command definition file, defining a database type, a compiling language type, an operating system type and a program output format, and generating a test data generation file and a query statement generation file which can be executed on ARM architecture equipment;

the parameter configuration file is used for: defining configuration information used by TPC-H test, wherein the configuration information comprises one or more of used TPC-H characters, character types, character lengths, character formats and output file types;

the database definition and creation file are used for: deleting the existing TPC-H database, creating a new TPC-H database, switching to the new TPC-H database, creating a data table, and setting the type and length of the table characters;

the data query command definition file is used for: calling a newly created TPC-H database, deleting the original primary key, adding a database table and the primary key and the external key used by the database table;

2. The TPC-H testing method according to claim 1, wherein before said decompressing TPC-H toolkit on ARM architecture device and deleting original test data generation program and query statement generation program in the toolkit, further comprising:

acquiring a TPC-H tool package;

3. The TPC-H testing method according to claim 1, further comprising, before copying said pre-generated program build main source code file, parameter configuration file, database definition and creation file, data query command definition file to a specified file directory of ARM architecture equipment:

4. The TPC-H testing device is applied to ARM architecture equipment and is characterized by comprising an initializing module, an operating module and a testing module, wherein:

5. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the following steps when executing the computer program:

6. A computer readable storage medium having stored thereon a computer program, characterized in that the computer program when executed by a processor realizes the steps of: