CN108345537A - The concurrently execution control method of TPC-C benchmark test tools - Google Patents

The concurrently execution control method of TPC-C benchmark test tools Download PDF

Info

Publication number
CN108345537A
CN108345537A CN201810076701.1A CN201810076701A CN108345537A CN 108345537 A CN108345537 A CN 108345537A CN 201810076701 A CN201810076701 A CN 201810076701A CN 108345537 A CN108345537 A CN 108345537A
Authority
CN
China
Prior art keywords
client
test
tpc
time
real
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810076701.1A
Other languages
Chinese (zh)
Inventor
孙大东
喻崇仁
唐勇
杨霁
邱桂苹
钟生海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Computer Technology and Applications
Original Assignee
Beijing Institute of Computer Technology and Applications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Computer Technology and Applications filed Critical Beijing Institute of Computer Technology and Applications
Priority to CN201810076701.1A priority Critical patent/CN108345537A/en
Publication of CN108345537A publication Critical patent/CN108345537A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3664Environments for testing or debugging software
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3692Test management for test results analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/80Database-specific techniques

Abstract

The present invention relates to a kind of concurrently execution control methods of TPC C benchmark test tools, are related to time and frequency measurement technical field.The present invention is using control technology is concurrently executed, to meet the performance test of big concurrent big data quantity.It can support to use multiple client simultaneously, the case where to meet big concurrent pressure, real-time exhibition can be carried out to the test process and result of each client and uniformly be summarized, can support distributed type assemblies database.

Description

The concurrently execution control method of TPC-C benchmark test tools
Technical field
The present invention relates to database pressure test technical fields, and in particular to a kind of TPC-C benchmark tests tool it is concurrent Execute control method.
Background technology
Traditional TPC-C reference pressures testing tool is primarily adapted for use on a small scale, small concurrent database pressure test, and Pressure test can only be carried out to carry out simulation multiple terminals using single client, but in large-scale data, big pressure test scene Under, since the system resources such as separate unit forcing press CPU, network limit, this kind of tool cannot be satisfied big concurrent test demand.
Specifically, traditional TPC-C reference pressures testing tool mainly uses C/S frameworks, pass through individual client Pressure test tool carries out the parameter settings such as corresponding database connection, number of concurrent, then directly applies to background data base and presses Power is tested, and finally shows test result.Specific framework is as shown in Figure 1.
Invention content
(1) technical problems to be solved
The technical problem to be solved by the present invention is to:How the performance test of big concurrent big data quantity is met.
(2) technical solution
Control is concurrently executed in order to solve the above technical problem, the present invention provides a kind of TPC-C benchmark tests tool Method includes the following steps:
Step 1: user is connected to multiple client pressure server, according to test request by browser page first And the configuration of client pressure server and current database cluster, after being calculated automatically, while in multiple client The test application of deployment carries out database connection, number of concurrent parametric programming, and is uploaded to the application configuration file of each client, It is automatically performed the parameter setting of each client application, to realize that allocation for test loads to each client pressure server, Support multi-client, big concurrent testing requirement;
Step 2: after parameter setting is completed, client pressure server load test application passes through browser page Real-time testing function, while the test application for starting multiple client carries out pressure test, simulates the multiple of TPC-C business scenarios User terminal submits user's request according to TPC-C service logics to data-base cluster;
Step 3: after pressure test starts execution, testing tool obtains each client by http protocol timing Real-time testing data, the real-time testing data include the average and maximum response time of five kinds of TPC-C typical transactions, and arrive TpmC and tpmTotal values until current time;
Step 4: when test is completed, testing tool summarizes to what the real-time testing data of each client were unified, closes The tpmC of unit interval is counted, tpmTotal values, test starts over time, total number of transactions, and outputs test result to browser The page.
Preferably, in step 1, the connection pool setting means that the database connection is carried using test application, or use The Database Connection Pool of WEB middlewares.
Preferably, the method is realized using B/S structures.
Preferably, the method is based on WEB Middleware implementations.
Preferably, five kinds of TPC-C typical transactions include new order affairs New-Order:Client input one it is new It orders goods and merchandises;Payment transaction Payment:Client account balance is updated to reflect its payment status;Affairs of delivering Delivery:Hair Goods, simulation batch processing transaction;Order status inquiries affairs Order-Status:Inquire the state of client's last sale;Inventory's water Flat inquiry transaction Stock-Level:Warehouse inventory situation is inquired, is replenished in time.
(3) advantageous effect
The present invention is using control technology is concurrently executed, to meet the performance test of big concurrent big data quantity.It can prop up simultaneously It holds and uses multiple client, the case where to meet big concurrent pressure, the test process and result of each client can be carried out Real-time exhibition and uniformly summarize, can support distributed type assemblies database.
Description of the drawings
Fig. 1 is existing TPC-C testing tools Organization Chart;
Fig. 2 is the testing tool Organization Chart of the present invention.
Specific implementation mode
To keep the purpose of the present invention, content and advantage clearer, with reference to the accompanying drawings and examples, to the present invention's Specific implementation mode is described in further detail.
Traditional TPC-C testing tools generally only connect a client pressure server, i.e., no matter rear end how many fortune Resource is calculated, front end can only be tested with the test application disposed on a pressure server, if using multi-client by force, Due to not doing rational parameter setting in terms of warehouse number and connection number, the conflict of test data can be caused, is led to not just Often tested.
As shown in Fig. 2, the measured TPC-C of concurrently execution control method of the TPC-C benchmark test tools of the present invention Data model, business model, execute model and measure, using B/S structures, be based on domestic WEB Middleware implementations, including Following steps:
Step 1: user is connected to multiple client pressure server, according to test request by browser page first And the configuration of client pressure server and current database cluster, after being calculated automatically, while in multiple client The test application of deployment carries out database connection, number of concurrent parametric programming, and is uploaded to the application configuration file of each client, It is automatically performed the parameter setting of each client application, to realize that allocation for test loads to each client pressure server, Support multi-client, big concurrent testing requirement;
The connection pool setting means that the database connection is carried using test application, or the data using WEB middlewares Library connection pool is realized.Make the connection of database using more rationally effectively in this way, database and client pressure server it Between data connection when, improve database connection taking, promote whole test performance.
Step 2: after parameter setting is completed, client pressure server load test application passes through browser page Real-time testing function, while the test application for starting multiple client carries out pressure test, simulates the multiple of TPC-C business scenarios User terminal submits user's request according to TPC-C service logics to data-base cluster;
Step 3: after pressure test starts execution, testing tool obtains each client by http protocol timing Real-time testing data, the real-time testing data include the average and maximum response time of following five kinds of TPC-C typical transactions:
New-Order (new order affairs):Client inputs a new order transaction;
Payment (payment transaction):Client account balance is updated to reflect its payment status;
Delivery (delivery affairs):Delivery (simulation batch processing transaction);
Order-Status (order status inquiries affairs):Inquire the state of client's last sale
Stock-Level (inventory level inquiry transaction):Warehouse inventory situation is inquired, is replenished in time.
And the tpmC and tpmTotal values until current time.
Step 4: when test is completed, testing tool summarizes to what the real-time testing data of each client were unified, closes The tpmC of unit interval is counted, tpmTotal values, test starts over time, total number of transactions, and outputs test result to browser The page.
The above is only a preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, without departing from the technical principles of the invention, several improvement and deformations can also be made, these improvement and deformations Also it should be regarded as protection scope of the present invention.

Claims (5)

1. a kind of concurrently execution control method of TPC-C benchmark tests tool, which is characterized in that include the following steps:
Step 1: user is connected to multiple client pressure server by browser page first, according to test request and The configuration of client pressure server and current database cluster, after being calculated automatically, while to being disposed in multiple client Test application carry out database connection, number of concurrent parametric programming, and be uploaded to the application configuration file of each client, automatically The parameter setting for completing each client application is supported to realize that allocation for test loads to each client pressure server Multi-client, big concurrent testing requirement;
Step 2: after parameter setting is completed, client pressure server load test application passes through the real-time of browser page Test function, while the test application for starting multiple client carries out pressure test, simulates multiple users of TPC-C business scenarios Terminal submits user's request according to TPC-C service logics to data-base cluster;
Step 3: after pressure test starts execution, testing tool obtains the real-time of each client by http protocol timing Test data, the real-time testing data include the average and maximum response time of five kinds of TPC-C typical transactions, and to currently TpmC and tpmTotal values until time;
Step 4: when test is completed, testing tool summarizes to what the real-time testing data of each client were unified, He Jidan The tpmC of position time, tpmTotal values, test starts over time, total number of transactions, and outputs test result to browser page.
2. the method as described in claim 1, which is characterized in that in step 1, the database connection uses test application certainly The connection pool setting means of band, or the Database Connection Pool using WEB middlewares.
3. the method as described in claim 1, which is characterized in that the method is realized using B/S structures.
4. the method as described in claim 1, which is characterized in that the method is based on WEB Middleware implementations.
5. method according to any one of claims 1 to 4, which is characterized in that five kinds of TPC-C typical transactions include new Order transaction New-Order:Client inputs a new order transaction;Payment transaction Payment:Update client account balance with Reflect its payment status;Affairs of delivering Delivery:Delivery, simulation batch processing transaction;Order status inquiries affairs Order- Status:Inquire the state of client's last sale;Inventory level inquiry transaction Stock-Level:Warehouse inventory situation is inquired, and When replenish.
CN201810076701.1A 2018-01-26 2018-01-26 The concurrently execution control method of TPC-C benchmark test tools Pending CN108345537A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810076701.1A CN108345537A (en) 2018-01-26 2018-01-26 The concurrently execution control method of TPC-C benchmark test tools

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810076701.1A CN108345537A (en) 2018-01-26 2018-01-26 The concurrently execution control method of TPC-C benchmark test tools

Publications (1)

Publication Number Publication Date
CN108345537A true CN108345537A (en) 2018-07-31

Family

ID=62961617

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810076701.1A Pending CN108345537A (en) 2018-01-26 2018-01-26 The concurrently execution control method of TPC-C benchmark test tools

Country Status (1)

Country Link
CN (1) CN108345537A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109359033A (en) * 2018-09-05 2019-02-19 广州神马移动信息科技有限公司 Method for testing pressure, testing service device, management server and system
CN109739745A (en) * 2018-12-10 2019-05-10 山东泰安烟草有限公司 Based on flow indicator to database hardware resource analysis method
CN109783391A (en) * 2019-01-28 2019-05-21 浪潮软件集团有限公司 A kind of distributed data library test method and system based on user's big data behavior feedback data
CN110471815A (en) * 2019-06-28 2019-11-19 武汉迎风聚智科技有限公司 Monitor method and actuator device based on Driver component
CN110704301A (en) * 2019-08-27 2020-01-17 武汉迎风聚智科技有限公司 TPC-E automatic test method and TPC-E test system
CN111159009A (en) * 2019-11-29 2020-05-15 深圳智链物联科技有限公司 Pressure testing method and device for log service system
CN113994274A (en) * 2019-04-10 2022-01-28 豪倍公司 Network pressure testing
CN115629953A (en) * 2022-12-22 2023-01-20 北京太极信息系统技术有限公司 Performance benchmark evaluation method suitable for domestic basic software and hardware environment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902769A (en) * 2012-09-26 2013-01-30 曙光信息产业(北京)有限公司 Database benchmark test system of cloud computing platform and method thereof
US20140136516A1 (en) * 2012-11-09 2014-05-15 International Business Machines Corporation Relative performance prediction of a replacement database management system (dbms)
CN106919498A (en) * 2017-02-20 2017-07-04 上海斐讯数据通信技术有限公司 The method for showing interface and system of the test index information of Benchmark test system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102902769A (en) * 2012-09-26 2013-01-30 曙光信息产业(北京)有限公司 Database benchmark test system of cloud computing platform and method thereof
US20140136516A1 (en) * 2012-11-09 2014-05-15 International Business Machines Corporation Relative performance prediction of a replacement database management system (dbms)
CN106919498A (en) * 2017-02-20 2017-07-04 上海斐讯数据通信技术有限公司 The method for showing interface and system of the test index information of Benchmark test system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
马跃: "基于TPC_C标准的数据库基准性能测试工具的研究和实现", 《中国优秀硕士学委论文全文数据库 信息科技辑》 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109359033A (en) * 2018-09-05 2019-02-19 广州神马移动信息科技有限公司 Method for testing pressure, testing service device, management server and system
CN109739745A (en) * 2018-12-10 2019-05-10 山东泰安烟草有限公司 Based on flow indicator to database hardware resource analysis method
CN109783391A (en) * 2019-01-28 2019-05-21 浪潮软件集团有限公司 A kind of distributed data library test method and system based on user's big data behavior feedback data
CN113994274A (en) * 2019-04-10 2022-01-28 豪倍公司 Network pressure testing
CN113994274B (en) * 2019-04-10 2024-03-29 豪倍公司 Network pressure testing
CN110471815A (en) * 2019-06-28 2019-11-19 武汉迎风聚智科技有限公司 Monitor method and actuator device based on Driver component
CN110704301A (en) * 2019-08-27 2020-01-17 武汉迎风聚智科技有限公司 TPC-E automatic test method and TPC-E test system
CN110704301B (en) * 2019-08-27 2020-12-29 武汉迎风聚智科技有限公司 TPC-E automatic test method and TPC-E test system
CN111159009A (en) * 2019-11-29 2020-05-15 深圳智链物联科技有限公司 Pressure testing method and device for log service system
CN111159009B (en) * 2019-11-29 2024-03-12 深圳智链物联科技有限公司 Pressure testing method and device for log service system
CN115629953A (en) * 2022-12-22 2023-01-20 北京太极信息系统技术有限公司 Performance benchmark evaluation method suitable for domestic basic software and hardware environment

Similar Documents

Publication Publication Date Title
CN108345537A (en) The concurrently execution control method of TPC-C benchmark test tools
CN110310034B (en) Service arrangement and business flow processing method and device applied to SaaS
CN107729139A (en) A kind of method and apparatus for concurrently obtaining resource
KR100551454B1 (en) Grid computing control method for testing application program capacity of server and service method there of
CN110689223B (en) Robot batch management system based on RPA control
CN103246546A (en) Open power system numerical simulation system and method based on cloud technology
CN106462461A (en) System, device and methods for billing user for their consumption of mobile broadband services and virtualized cloud resources
CN104346214B (en) Asynchronous task managing device and method for distributed environment
CN102841846A (en) Software testing method, device and system based on Hadoop
CN112954311B (en) Performance test method and system for live streaming media
CN105607994A (en) Mobile terminal software testing method and system
CN109636304B (en) Business system publishing method and device, storage medium and electronic device
WO2022179034A1 (en) Automatic testing method and apparatus, electronic device, and storage medium
WO2021244343A1 (en) Cloud computing power allocation method, user terminal, cloud computing power platform and system
CN112199353A (en) Data processing method and electric power customer service platform
CN111179075B (en) Settlement method, device, storage medium and settlement server for medium-and-long-term power transaction
CN104281584A (en) XML database performance testing system and method
CN115599438A (en) Method, device, equipment and medium for constructing application program publishing package
CN115033233A (en) Interface calling method and device, electronic equipment and storage medium
CN110737572B (en) Big data platform resource preemption test method, system, terminal and storage medium
CN110706051B (en) Order data aggregation method and device and server
CN114564213A (en) Pre-installed software deployment method, system, terminal and storage medium
CN111294250B (en) Pressure testing method, device and system
Eismann et al. Teastore: A micro-service reference application for cloud researchers
CN112579320A (en) Communication method and device between open system and ZOS system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180731

RJ01 Rejection of invention patent application after publication