CN105589928A - Simulation testing method for distributed data processing system - Google Patents

Simulation testing method for distributed data processing system Download PDF

Info

Publication number
CN105589928A
CN105589928A CN201510870132.4A CN201510870132A CN105589928A CN 105589928 A CN105589928 A CN 105589928A CN 201510870132 A CN201510870132 A CN 201510870132A CN 105589928 A CN105589928 A CN 105589928A
Authority
CN
China
Prior art keywords
test
database
data processing
processing system
distributed data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510870132.4A
Other languages
Chinese (zh)
Inventor
郝建明
陈文�
沈刚
张育新
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Unionpay Co Ltd
Original Assignee
China Unionpay Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Unionpay Co Ltd filed Critical China Unionpay Co Ltd
Priority to CN201510870132.4A priority Critical patent/CN105589928A/en
Publication of CN105589928A publication Critical patent/CN105589928A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases

Abstract

This invention provides a simulation testing method for a distributed data processing system. The method comprises the following steps: carrying out target updating on a distributed system to be tested; triggering testing scripts deployed on all the host computers of the distributed system to be tested to run so as to test host computer performance, database load performance and storage performance by a simulating method; at last, storing and showing the testing result. The simulation testing method for the distributed data processing system provided in the invention is high in accuracy and reliability.

Description

For the analog detection method of distributed data processing system
Technical field
The present invention relates to analog detection method, more specifically, relate to the analog detection method for distributed data processing system.
Background technology
At present, along with becoming increasingly abundant of the class of business of the increasingly extensive and different field of cyber-net application, for example, dispose front test for the upgrading of distributed data processing system and renewal (patch installing) and become more and more important.
In existing technical scheme, only for each function of distributed system test (for dissimilar single operation test macro function whether normal) conventionally, and carry out Load pressure test for part of module.
But, there are the following problems for above-mentioned existing technical scheme: due to the variation of and the mutual load pressure that produce interrelated owing to it of each resource in can not test distributed system and application, therefore be difficult to provide realistic working environment and have the high degree of accuracy and the test result of confidence level.
Therefore, there is following demand: provide the analog detection method for distributed data processing system with the high degree of accuracy and confidence level.
Summary of the invention
In order to solve the existing problem of above-mentioned prior art scheme, the present invention proposes the analog detection method for distributed data processing system with the high degree of accuracy and confidence level.
The object of the invention is to be achieved through the following technical solutions:
For an analog detection method for distributed data processing system, the described analog detection method for distributed data processing system comprises the following steps:
(A1) in distributed system to be measured, implementation goal upgrades;
(A2) trigger unit is deployed on test script on each main frame of described distributed system to be measured and moves with by mode Test Host performance, database loads and the memory property of simulation;
(A3) store and present test result.
In disclosed scheme, preferably, described step (A1) further comprises in the above: the mode by input username and password is logined each main frame, and obtains authority to trigger and to move corresponding test script thereupon.
In the above in disclosed scheme, preferably, described Test Host performance comprises the extreme load test for each main frame, and described extreme load test comprises CPU simulation test, disk simulation test, internal memory simulation test at full capacity at full capacity at full capacity, exchange area is simulation test at full capacity, file system is simulation test at full capacity, and network interface card bandwidth utilization rate at full capacity simulation test and file handle is used one or more in simulation test at full capacity.
In the above in disclosed scheme, preferably, described Test Host performance comprises the dynamic percentage load testing for the functional resources of each main frame, and carry out as follows described dynamic percentage load testing: determine the percentage load of the functional resources of each main frame according to the real load parameter in the certain hour cycle of statistics in advance, and the ruuning situation of each functional resources of percentage load simulation test based on determined each functional resources under the percentage load of determined each functional resources thereupon.
In the above in disclosed scheme, preferably, described dynamic percentage load testing comprises one or more in following: carry out CPU percentage load testing according to CPU quantity and load percentage and predetermined duration, the load percentage of the disk of selecting according to need and predetermined duration are carried out disk percentage load testing, select to need the memory size and the predetermined duration that consume to carry out internal memory percentage load testing according to memory size, carry out network traffics percentage load testing according to required network traffics size and predetermined duration.
In the above in disclosed scheme, preferably, described test database load comprises the full library backup simulation test of database, and carry out as follows the full library backup simulation test of described database: the full library backup operation of database is initiated in timing, and whether monitoring there is deadlock to produce and audit log has determined whether system upgrades and/or be updated successfully.
In the above in disclosed scheme, preferably, described test database load comprises database filing backup simulation test, and carry out as follows described database filing backup simulation test: clocked flip database filing backup operation, and monitoring whether occur to system upgrade and/or upgrade relevant extremely.
In the above in disclosed scheme, preferably, described test database load comprises that database leads table backup simulation test, and carry out as follows described database and lead table backup simulation test: clocked flip database is led table backup operation, and whether monitoring occurs to system upgrade and/or upgrade relevant lock conflict.
In the above in disclosed scheme, preferably, described test storage performance comprises the test of data read-write operation performance simulation, and carries out as follows described data read-write operation performance simulation test: clocked flip continues the end-to-end pressure of operation transfer of data from internal memory card to external memory with monitoring of reading and writing of files from the file system of external memory.
In disclosed scheme, preferably, described distributed system to be measured is the data handling system based on Unix operating system in the above.
Analog detection method for distributed data processing system disclosed in this invention has the following advantages: because each main frame that can simulate actual motion environmental testing distributed system is such as CPU, disk, internal memory, the performance of the aspects such as offered load, and can simulate occupation condition that the database timed task in actual motion environment carrys out simulated database (such as deadlock simultaneously, IO bandwidth contention etc.), and can simulate the upgrading that the load pressure of reading and writing data end to end from main frame to memory under actual motion environment causes because of the memory bandwidth contention in actual motion environment to avoid/upgrade unsuccessfully, therefore there is high test accuracy and confidence level.
Brief description of the drawings
By reference to the accompanying drawings, technical characterictic of the present invention and advantage will be understood better by those skilled in the art, wherein:
Fig. 1 is the flow chart for the analog detection method of distributed data processing system according to an embodiment of the invention.
Detailed description of the invention
Fig. 1 is the flow chart for the analog detection method of distributed data processing system according to an embodiment of the invention. As shown in Figure 1, the analog detection method for distributed data processing system disclosed in this invention comprises the following steps: that (A1) implementation goal in distributed system to be measured upgrades (for example patch); (A2) trigger unit is deployed on test script on each main frame of described distributed system to be measured and moves with by mode Test Host performance, database loads and the memory property of simulation; (A3) store and present test result.
Preferably, at the analog detection method for distributed data processing system disclosed in this invention, described step (A1) further comprises: the mode by input username and password is logined each main frame, and obtains authority to trigger and to move corresponding test script thereupon.
Preferably, at the analog detection method for distributed data processing system disclosed in this invention, described Test Host performance comprises the extreme load test for each main frame, and described extreme load test comprises CPU simulation test, disk simulation test, internal memory simulation test at full capacity at full capacity at full capacity, exchange area is simulation test at full capacity, file system is simulation test at full capacity, and network interface card bandwidth utilization rate at full capacity simulation test and file handle is used one or more in simulation test at full capacity.
Preferably, at the analog detection method for distributed data processing system disclosed in this invention, described Test Host performance comprises the dynamic percentage load testing for the functional resources of each main frame, and carry out as follows described dynamic percentage load testing: the percentage load of determining the functional resources of each main frame according to the real load parameter in the certain hour cycle of adding up in advance, and the ruuning situation of each functional resources of percentage load simulation test based on determined each functional resources under the percentage load of determined each functional resources thereupon.
Preferably, at the analog detection method for distributed data processing system disclosed in this invention, described dynamic percentage load testing comprises one or more in following: carry out CPU percentage load testing according to CPU quantity and load percentage and predetermined duration, the load percentage of the disk of selecting according to need and predetermined duration are carried out disk percentage load testing, select to need the memory size and the predetermined duration that consume to carry out internal memory percentage load testing according to memory size, carry out network traffics percentage load testing according to required network traffics size and predetermined duration.
Preferably, at the analog detection method for distributed data processing system disclosed in this invention, described test database load comprises the full library backup simulation test of database, and carry out as follows the full library backup simulation test of described database: the full library backup operation of database is initiated in timing, and whether monitoring there is deadlock to produce and audit log has determined whether system upgrades and/or be updated successfully.
Preferably, at the analog detection method for distributed data processing system disclosed in this invention, described test database load comprises database filing backup simulation test, and carry out as follows described database filing backup simulation test: clocked flip database filing backup operation, and monitoring whether occur to system upgrade and/or upgrade relevant extremely.
Preferably, at the analog detection method for distributed data processing system disclosed in this invention, described test database load comprises that database leads table backup simulation test, and carry out as follows described database and lead table backup simulation test: clocked flip database is led table backup operation, and whether monitoring occurs to system upgrade and/or upgrade relevant lock conflict.
Preferably, at the analog detection method for distributed data processing system disclosed in this invention, described test storage performance comprises the test of data read-write operation performance simulation, and carries out as follows described data read-write operation performance simulation test: clocked flip continues the end-to-end pressure of operation transfer of data from internal memory card to external memory with monitoring of reading and writing of files from the file system of external memory.
Preferably, at the analog detection method for distributed data processing system disclosed in this invention, described distributed system to be measured is the data handling system based on Unix operating system.
Therefore, analog detection method for distributed data processing system disclosed in this invention has following advantages: because each main frame that can simulate actual motion environmental testing distributed system is such as CPU, disk, internal memory, the performance of the aspects such as offered load, and can simulate occupation condition that the database timed task in actual motion environment carrys out simulated database (such as deadlock simultaneously, IO bandwidth contention etc.), and can simulate the upgrading that the load pressure of reading and writing data end to end from main frame to memory under actual motion environment causes because of the memory bandwidth contention in actual motion environment to avoid/upgrade unsuccessfully, therefore there is high test accuracy and confidence level.
Although the present invention is described by above-mentioned preferred embodiment, its way of realization is not limited to above-mentioned embodiment. Should be realized that: in the situation that not departing from purport of the present invention and scope, those skilled in the art can make different variations and amendment to the present invention.

Claims (10)

1. for an analog detection method for distributed data processing system, the described analog detection method for distributed data processing system comprises the following steps:
(A1) in distributed system to be measured, implementation goal upgrades;
(A2) trigger unit is deployed on test script on each main frame of described distributed system to be measured and moves with by mode Test Host performance, database loads and the memory property of simulation;
(A3) store and present test result.
2. the analog detection method for distributed data processing system according to claim 1, it is characterized in that, described step (A1) further comprises: the mode by input username and password is logined each main frame, and obtains authority to trigger and to move corresponding test script thereupon.
3. the analog detection method for distributed data processing system according to claim 2, it is characterized in that, described Test Host performance comprises the extreme load test for each main frame, and described extreme load test comprises CPU simulation test, disk simulation test, internal memory simulation test at full capacity at full capacity at full capacity, exchange area is simulation test at full capacity, file system is simulation test at full capacity, and network interface card bandwidth utilization rate at full capacity simulation test and file handle is used one or more in simulation test at full capacity.
4. the analog detection method for distributed data processing system according to claim 3, it is characterized in that, described Test Host performance comprises the dynamic percentage load testing for the functional resources of each main frame, and carry out as follows described dynamic percentage load testing: the percentage load of determining the functional resources of each main frame according to the real load parameter in the certain hour cycle of adding up in advance, and the ruuning situation of each functional resources of percentage load simulation test based on determined each functional resources under the percentage load of determined each functional resources thereupon.
5. the analog detection method for distributed data processing system according to claim 4, it is characterized in that, described dynamic percentage load testing comprises one or more in following: carry out CPU percentage load testing according to CPU quantity and load percentage and predetermined duration, the load percentage of the disk of selecting according to need and predetermined duration are carried out disk percentage load testing, select to need the memory size and the predetermined duration that consume to carry out internal memory percentage load testing according to memory size, carry out network traffics percentage load testing according to required network traffics size and predetermined duration.
6. the analog detection method for distributed data processing system according to claim 5, it is characterized in that, described test database load comprises the full library backup simulation test of database, and carry out as follows the full library backup simulation test of described database: the full library backup operation of database is initiated in timing, and whether monitoring there is deadlock to produce and audit log has determined whether system upgrades and/or be updated successfully.
7. the analog detection method for distributed data processing system according to claim 6, it is characterized in that, described test database load comprises database filing backup simulation test, and carry out as follows described database filing backup simulation test: clocked flip database filing backup operation, and monitoring whether occur to system upgrade and/or upgrade relevant extremely.
8. the analog detection method for distributed data processing system according to claim 7, it is characterized in that, described test database load comprises that database leads table backup simulation test, and carry out as follows described database and lead table backup simulation test: clocked flip database is led table backup operation, and whether monitoring occurs to system upgrade and/or upgrade relevant lock conflict.
9. the analog detection method for distributed data processing system according to claim 8, it is characterized in that, described test storage performance comprises the test of data read-write operation performance simulation, and carries out as follows described data read-write operation performance simulation test: clocked flip continues the end-to-end pressure of operation transfer of data from internal memory card to external memory with monitoring of reading and writing of files from the file system of external memory.
10. the analog detection method for distributed data processing system according to claim 9, is characterized in that, described distributed system to be measured is the data handling system based on Unix operating system.
CN201510870132.4A 2015-12-02 2015-12-02 Simulation testing method for distributed data processing system Pending CN105589928A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510870132.4A CN105589928A (en) 2015-12-02 2015-12-02 Simulation testing method for distributed data processing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510870132.4A CN105589928A (en) 2015-12-02 2015-12-02 Simulation testing method for distributed data processing system

Publications (1)

Publication Number Publication Date
CN105589928A true CN105589928A (en) 2016-05-18

Family

ID=55929507

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510870132.4A Pending CN105589928A (en) 2015-12-02 2015-12-02 Simulation testing method for distributed data processing system

Country Status (1)

Country Link
CN (1) CN105589928A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106941420A (en) * 2017-03-16 2017-07-11 北京深思数盾科技股份有限公司 A kind of cluster application environment upgrade method and device
CN107526673A (en) * 2017-08-25 2017-12-29 郑州云海信息技术有限公司 A kind of storage system Log backup internal storage testing method
CN108415835A (en) * 2018-02-22 2018-08-17 北京百度网讯科技有限公司 Distributed data library test method, device, equipment and computer-readable medium
CN108984358A (en) * 2018-07-18 2018-12-11 郑州云海信息技术有限公司 A kind of method and device of server CPU pressure test
CN110597531A (en) * 2019-08-05 2019-12-20 平安科技(深圳)有限公司 Distributed module upgrading method and device and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101727389A (en) * 2009-11-23 2010-06-09 中兴通讯股份有限公司 Automatic test system and method of distributed integrated service
CN103326902A (en) * 2013-06-28 2013-09-25 广东电网公司电力科学研究院 Configurable monitoring system and monitoring method for distributed type mainframe performance testing data
CN104391795A (en) * 2014-12-03 2015-03-04 北京京东尚科信息技术有限公司 Method and system for automatically testing coverage rate in distributed system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101727389A (en) * 2009-11-23 2010-06-09 中兴通讯股份有限公司 Automatic test system and method of distributed integrated service
CN103326902A (en) * 2013-06-28 2013-09-25 广东电网公司电力科学研究院 Configurable monitoring system and monitoring method for distributed type mainframe performance testing data
CN104391795A (en) * 2014-12-03 2015-03-04 北京京东尚科信息技术有限公司 Method and system for automatically testing coverage rate in distributed system

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106941420A (en) * 2017-03-16 2017-07-11 北京深思数盾科技股份有限公司 A kind of cluster application environment upgrade method and device
CN106941420B (en) * 2017-03-16 2019-12-13 北京深思数盾科技股份有限公司 cluster application environment upgrading method and device
CN107526673A (en) * 2017-08-25 2017-12-29 郑州云海信息技术有限公司 A kind of storage system Log backup internal storage testing method
CN107526673B (en) * 2017-08-25 2021-02-02 苏州浪潮智能科技有限公司 Method for testing log backup memory of storage system
CN108415835A (en) * 2018-02-22 2018-08-17 北京百度网讯科技有限公司 Distributed data library test method, device, equipment and computer-readable medium
CN108415835B (en) * 2018-02-22 2019-07-30 北京百度网讯科技有限公司 Distributed data library test method, device, equipment and computer-readable medium
CN108984358A (en) * 2018-07-18 2018-12-11 郑州云海信息技术有限公司 A kind of method and device of server CPU pressure test
CN110597531A (en) * 2019-08-05 2019-12-20 平安科技(深圳)有限公司 Distributed module upgrading method and device and storage medium

Similar Documents

Publication Publication Date Title
CN102736978B (en) A kind of method and device detecting the installment state of application program
CN105589928A (en) Simulation testing method for distributed data processing system
CN102567166B (en) Testing method and testing system of graphics card
US20150100296A1 (en) Method and system for automated test and result comparison
US8910294B1 (en) System and method for application failure testing in a cloud computing environment
CN104484273A (en) Test method for application program, device and system
US9792102B2 (en) Identifying issues prior to deploying software
CN107076797B (en) Testing semiconductor memory power consumption based on executed access commands
CN112068852B (en) Method, system, equipment and medium for installing open-source software based on domestic server
CN105426298A (en) ADB (Android debug bridge)-based software test method and system
CN107608609B (en) Event object sending method and device
US20090248390A1 (en) Trace debugging in a hardware emulation environment
JP6771413B2 (en) Software verification device and software verification program
US8756575B2 (en) Installing and testing an application on a highly utilized computer platform
CN116974874A (en) Database testing method and device, electronic equipment and readable storage medium
CN111026656A (en) Automatic testing system, method, equipment and storage medium for distributed storage
CN113535578B (en) CTS test method, CTS test device and CTS test equipment
CN115757099A (en) Automatic test method and device for platform firmware protection recovery function
CN113535580B (en) CTS test method, CTS test device and test equipment
CN110971478A (en) Pressure measurement method and device for cloud platform service performance and computing equipment
CN114153732A (en) Fault scene testing method and device, electronic equipment and storage medium
CN111966599A (en) Virtualization platform reliability testing method, system, terminal and storage medium
CN117806943A (en) Test method, test device and storage medium
US20220058109A1 (en) Method for debugging computer program, device employing method, and storage medium
CN114706715B (en) Control method, device, equipment and medium for distributed RAID based on BMC

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160518