CN113010369A - Performance test-oriented monitoring method and system - Google Patents
Performance test-oriented monitoring method and system Download PDFInfo
- Publication number
- CN113010369A CN113010369A CN202011352966.3A CN202011352966A CN113010369A CN 113010369 A CN113010369 A CN 113010369A CN 202011352966 A CN202011352966 A CN 202011352966A CN 113010369 A CN113010369 A CN 113010369A
- Authority
- CN
- China
- Prior art keywords
- monitoring
- performance test
- performance
- test
- index
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 180
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000011056 performance test Methods 0.000 claims abstract description 57
- 238000004364 calculation method Methods 0.000 claims abstract description 7
- 238000012545 processing Methods 0.000 claims description 14
- 238000007619 statistical method Methods 0.000 claims description 12
- 238000013500 data storage Methods 0.000 claims description 3
- 238000012360 testing method Methods 0.000 abstract description 34
- 230000026676 system process Effects 0.000 abstract 1
- 238000009530 blood pressure measurement Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000007547 defect Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
- G06F11/3093—Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/323—Visualisation of programs or trace data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3452—Performance evaluation by statistical analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
Abstract
The invention relates to a monitoring method and a monitoring system for performance testing. After the performance test scene is started, the monitoring of relevant indexes of a machine and a system process, a middleware and a database deployed in a tested system is started, the monitoring data is stored, and after the test scene is finished, the monitoring data is subjected to statistical calculation and analysis to generate an execution log and a monitoring data trend graph for performance test bottleneck analysis and performance test report data. Through the implementation of actual performance test, the workload of performance testing personnel can be reduced, and the performance test execution efficiency is improved.
Description
Technical Field
The invention belongs to the field of intelligent operation and maintenance, and particularly relates to a performance test-oriented monitoring method and system, which are mainly applied to the performance test industry and used for monitoring a system and application indexes in performance test implementation.
Background
Currently, existing monitoring tools are mainly performed separately for a single performance test scenario. The method mainly comprises the steps of test preparation, test scene execution, test result statistical analysis and the like, and because each step needs testers to execute each test scene respectively, the method has the problems of long time consumption, large workload of the testers and the like, and in addition, the method also has the following defects:
firstly, the readability of monitored index information is low;
secondly, the granularity cannot be adjusted according to requirements during monitoring;
the influence on the use of the monitored machine resources is higher;
fourthly, the method cannot be closely associated with a pressure measurement scene;
monitoring data can not generate test report and other data which can be directly used.
In view of the foregoing, there is a need for a monitoring tool with higher performance test execution efficiency.
Disclosure of Invention
In order to solve the above problems in the prior art, in one aspect, the present invention provides a monitoring method for performance testing, which can reduce the workload of performance testing personnel and improve the performance testing execution efficiency by performing parallel monitoring on predetermined indexes.
In order to achieve the purpose, the invention adopts the main technical scheme that:
a monitoring method oriented to performance test can comprise the following steps:
s1, starting monitoring;
s2, performing parallel monitoring on the preset indexes of a plurality of machines deployed by the tested system;
and S4, processing the preset index monitoring data.
By means of the scheme, the monitoring method facing the performance test can greatly reduce the workload of performance testing personnel and improve the performance test execution efficiency.
In the monitoring method for performance test according to an embodiment of the present invention, the predetermined index includes a system resource, a middleware, a database, and a process resource.
In the monitoring method for performance test according to an embodiment of the present invention, in step S4, the processing includes performing statistical analysis and calculation on the monitoring data of the predetermined index, and generating an execution log and a monitoring data trend graph.
In the monitoring method for performance test according to an embodiment of the present invention, before the step S1, the method further includes the steps of:
and S0, setting resource monitoring frequency and monitoring indexes according to scene requirements.
In the monitoring method for performance test according to an embodiment of the present invention, after step S2, the method further includes the steps of:
and S3, saving the obtained preset index monitoring data.
On the other hand, the invention also provides a monitoring system for performance test, which can reduce the workload of performance test personnel and improve the performance test execution efficiency by monitoring the preset indexes in parallel.
In order to achieve the purpose, the invention adopts the main technical scheme that:
a performance test oriented monitoring system, comprising:
the monitoring starting module is used for starting monitoring;
the index monitoring module is used for monitoring the preset indexes of a plurality of machines deployed in the tested system in parallel;
and the monitoring data processing module is used for processing the monitoring data of the preset index.
By means of the scheme, the monitoring system for the performance test can greatly reduce the workload of performance test personnel and improve the performance test execution efficiency.
The monitoring system for performance test of an embodiment of the present invention, wherein the index monitoring module includes:
the system resource monitoring submodule is used for monitoring system resource indexes;
the middleware monitoring submodule is used for monitoring the middleware indexes;
the database monitoring submodule is used for monitoring database indexes;
and the process resource monitoring submodule is used for monitoring the process resource indexes.
The monitoring system for performance test of one embodiment of the present invention, wherein the monitoring data processing module includes:
the statistical analysis submodule is used for performing statistical analysis calculation on the preset index monitoring data;
the log generation submodule is used for generating an execution log;
and the trend graph generation submodule is used for generating a monitoring data trend graph.
The monitoring system for performance test of one embodiment of the invention further comprises:
the monitoring frequency setting module is used for setting resource monitoring frequency according to scene requirements;
and the monitoring index setting module is used for setting a monitoring index according to the scene requirement.
The monitoring system for performance test of one embodiment of the invention further comprises:
and the monitoring data storage module is used for storing the obtained preset index monitoring data.
The monitoring method and the monitoring system for the performance test can monitor the resource of a machine deployed by the application to be tested, the resource use condition of the application process (CPU, memory, disk, network and the like), the associated application or database resource and the related index by monitoring the preset index in parallel, automatically generate the execution log of the monitoring data and improve the execution efficiency of the performance test.
Drawings
FIG. 1 is a schematic main flow chart of a monitoring method for performance testing according to an embodiment of the present invention;
FIG. 2 is a schematic main flow chart of a monitoring method for performance testing according to another embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a monitoring system for performance testing according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a monitoring system for performance testing according to another embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a monitoring system for performance testing according to another embodiment of the present invention;
FIG. 6 is a schematic structural diagram of a monitoring system for performance testing according to an application example of the present invention;
FIG. 7 is a schematic flow chart of a monitoring method for performance testing according to an application example of the present invention;
fig. 8 is a main flowchart of a monitoring method for performance testing according to an embodiment of the present invention.
Detailed Description
For the purpose of better explaining the present invention and to facilitate understanding, the present invention will be described in detail by way of specific embodiments with reference to the accompanying drawings.
Referring to fig. 1, the monitoring method for performance test according to an embodiment of the present invention includes the following steps:
s1, starting monitoring;
s2, performing parallel monitoring on the preset indexes of a plurality of machines deployed by the tested system;
and S4, processing the preset index monitoring data.
The predetermined indexes comprise system resources, middleware, a database and process resources.
By means of the scheme, the monitoring method facing the performance test can greatly reduce the workload of performance testing personnel and improve the performance test execution efficiency.
Referring to fig. 2, the monitoring method for performance test according to a preferred embodiment of the present invention includes the following steps:
and S0, setting resource monitoring frequency and monitoring indexes according to scene requirements.
S1, starting monitoring;
s2, performing parallel monitoring on the preset indexes of a plurality of machines deployed by the tested system;
and S3, saving the obtained preset index monitoring data.
And S4, performing statistical analysis calculation on the monitoring data of the preset indexes to generate an execution log and a monitoring data trend graph.
By means of the scheme, the monitoring method facing the performance test can greatly reduce the workload of performance testing personnel and improve the performance test execution efficiency.
Referring to fig. 3, the monitoring system for performance test according to one embodiment of the present invention includes
The monitoring starting module is used for starting monitoring;
the index monitoring module is used for monitoring the preset indexes of a plurality of machines deployed in the tested system in parallel;
and the monitoring data processing module is used for processing the monitoring data of the preset index.
By means of the scheme, the monitoring system for the performance test can greatly reduce the workload of performance test personnel and improve the performance test execution efficiency.
Referring to fig. 4, the monitoring system for performance test according to a preferred embodiment of the present invention, wherein the index monitoring module includes:
the system resource monitoring submodule is used for monitoring system resource indexes;
the middleware monitoring submodule is used for monitoring the middleware indexes;
the database monitoring submodule is used for monitoring database indexes;
and the process resource monitoring submodule is used for monitoring the process resource indexes.
Preferably, the system further comprises a monitoring index adding submodule for generating a new monitoring submodule according to the added monitoring index.
Referring to fig. 4, the monitoring system for performance test according to a preferred embodiment of the present invention, wherein the monitoring data processing module includes:
the statistical analysis submodule is used for performing statistical analysis calculation on the preset index monitoring data;
the log generation submodule is used for generating an execution log;
and the trend graph generation submodule is used for generating a monitoring data trend graph.
Referring to fig. 5, the monitoring system for performance test according to a preferred embodiment of the present invention further includes:
the monitoring frequency setting module is used for setting resource monitoring frequency according to scene requirements;
and the monitoring index setting module is used for setting a monitoring index according to the scene requirement.
Preferably, the system further comprises a monitoring index increasing module for increasing the monitoring index according to the scene requirement.
Referring to fig. 5, the monitoring system for performance test according to a preferred embodiment of the present invention further includes:
and the monitoring data storage module is used for storing the obtained preset index monitoring data.
In order to better explain the present invention and to facilitate understanding, the present invention is further explained below by referring to a specific application example (see fig. 6 and 7).
In specific implementation, a performance tester may install and deploy the foregoing embodiments as follows:
firstly, deploying the monitoring system of the invention to a jump machine;
executing step S0, setting resource monitoring frequency and monitoring index;
step S1 is executed to start monitoring, and the IP address of the machine required to be monitored in the test is obtained;
deploying the monitoring system of the invention to a monitored machine by one key through a jump machine;
step S1 is executed to start monitoring (when this step is applied, the system of the present invention may be associated with an existing pressure measurement tool, and the monitoring step is automatically started after the pressure measurement scenario of the existing pressure measurement tool is started);
after the pressure measurement scene of the existing pressure measurement tool is finished, the system can automatically execute the step S2 to collect and analyze the monitoring result data of each monitored machine;
step S4 is executed to process the monitoring result, for example, to generate an execution log for the tester to analyze the result of the current test scenario.
In the above application example, if performance test monitoring data is counted by using a single performance test scenario (test preparation time + test scenario execution time + test result statistical analysis time), assuming that the average performance test of each machine in each scenario is 5-10 minutes, the more the number of machines to be monitored is, the longer the performance test of the single scenario is, taking a single scenario of 30 minutes as an example, the test preparation time is 5 minutes, and a tested system deploys 10 machines, and the scenario test needs 85-135 minutes in the prior art.
Therefore, compared with the prior art, the performance test-oriented monitoring method and system can be preset according to scenes, can be deployed through one key of the jump machine, can be used for monitoring in parallel, can shorten the test preparation time, the test scene execution time and the test result statistical analysis time, reduce the workload of performance testers, shorten the test time and improve the performance test execution efficiency.
In the monitoring method for performance test according to the above embodiments, the parallel monitoring may be performed on n tested system machines respectively (see fig. 8), and then the data is analyzed to generate an execution log and a trend graph, so as to verify whether the test scenario passes or not.
In summary, the performance test-oriented monitoring method and system of the present invention can monitor the resources of the machine deployed by the application to be tested, the resource usage of the application process (CPU, memory, disk, network, etc.), the associated application or database resources, and the associated indexes, and automatically generate the execution log of the monitored data, thereby improving the performance test execution efficiency.
Claims (10)
1. A monitoring method for performance test comprises the following steps:
s1, starting monitoring;
s2, performing parallel monitoring on the preset indexes of a plurality of machines deployed by the tested system;
and S4, processing the preset index monitoring data.
2. The performance-test-oriented monitoring method of claim 1, wherein the predetermined metrics include system resources, middleware, databases, process resources.
3. The monitoring method oriented to the performance test as claimed in claim 1, wherein in step S4, the processing includes statistical analysis and calculation of the monitoring data of the predetermined index, and generation of the execution log and the trend graph of the monitoring data.
4. The monitoring method oriented to the performance test as claimed in claim 1, wherein the step S1 is preceded by the step of:
and S0, setting resource monitoring frequency and monitoring indexes according to scene requirements.
5. The monitoring method oriented to the performance test as claimed in claim 1, wherein the step S2 is followed by the further step of:
and S3, saving the obtained preset index monitoring data.
6. A performance test oriented monitoring system, comprising:
the monitoring starting module is used for starting monitoring;
an index monitoring module for performing preset indexes of multiple machines deployed in the system to be testedIn parallelMonitoring;
and the monitoring data processing module is used for processing the monitoring data of the preset index.
7. The performance-test-oriented monitoring system of claim 6, wherein the index monitoring module comprises:
the system resource monitoring submodule is used for monitoring system resource indexes;
the middleware monitoring submodule is used for monitoring the middleware indexes;
the database monitoring submodule is used for monitoring database indexes;
and the process resource monitoring submodule is used for monitoring the process resource indexes.
8. The performance-test-oriented monitoring system of claim 6, wherein the monitoring data processing module comprises:
the statistical analysis submodule is used for performing statistical analysis calculation on the preset index monitoring data;
the log generation submodule is used for generating an execution log;
and the trend graph generation submodule is used for generating a monitoring data trend graph.
9. The performance-test oriented monitoring system of claim 6, further comprising:
the monitoring frequency setting module is used for setting resource monitoring frequency according to scene requirements;
and the monitoring index setting module is used for setting a monitoring index according to the scene requirement.
10. The performance-test oriented monitoring system of claim 6, further comprising:
and the monitoring data storage module is used for storing the obtained preset index monitoring data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011352966.3A CN113010369A (en) | 2020-11-27 | 2020-11-27 | Performance test-oriented monitoring method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011352966.3A CN113010369A (en) | 2020-11-27 | 2020-11-27 | Performance test-oriented monitoring method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113010369A true CN113010369A (en) | 2021-06-22 |
Family
ID=76383123
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011352966.3A Pending CN113010369A (en) | 2020-11-27 | 2020-11-27 | Performance test-oriented monitoring method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113010369A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106445817A (en) * | 2016-09-09 | 2017-02-22 | 网易（杭州）网络有限公司 | Test data processing method, apparatus and system |
| CN110968467A (en) * | 2019-12-16 | 2020-04-07 | 冀方 | Remote automatic test method for GPU and algorithm |
-
2020
- 2020-11-27 CN CN202011352966.3A patent/CN113010369A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106445817A (en) * | 2016-09-09 | 2017-02-22 | 网易（杭州）网络有限公司 | Test data processing method, apparatus and system |
| CN110968467A (en) * | 2019-12-16 | 2020-04-07 | 冀方 | Remote automatic test method for GPU and algorithm |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101493793B (en) | ATM test method and device | |
| CN104572422A (en) | Memory monitoring achievement method based on startup and shutdown of Linux system | |
| CN107391373B (en) | AutoIT-based automatic performance testing method | |
| CN113553267A (en) | Application performance testing method, device, medium, and computer program product | |
| CN113010392B (en) | Big data platform testing method, device, equipment, storage medium and system | |
| CN112650676A (en) | Software testing method, device, equipment and storage medium | |
| CN107643964A (en) | A kind of method of automatic batch test whole machine cabinet server performance | |
| CN106055703B (en) | Log real-time analysis method and system | |
| CN112148616B (en) | Performance test management platform | |
| CN107911410B (en) | Distributed service process resource consumption statistical method and device | |
| CN106201810A (en) | A kind of method of testing, device | |
| CN113010369A (en) | Performance test-oriented monitoring method and system | |
| CN112269697A (en) | Equipment storage performance testing method, system and related device | |
| CN112612697A (en) | Software defect testing and positioning method and system based on byte code technology | |
| CN107656849B (en) | Method and device for positioning performance problem of software system | |
| CN111090553B (en) | Test system, test method and test device | |
| CN111639022A (en) | Transaction testing method and device, storage medium and electronic device | |
| CN110489286B (en) | BOX node machine power supply current sharing test method and system | |
| CN112231236A (en) | Method for testing database performance | |
| Chen et al. | Big data system testing method based on chaos engineering | |
| CN110046098B (en) | Real-time library testing method and system | |
| CN111324542B (en) | Web application regression test case selection system, method and equipment | |
| CN109656828B (en) | Automatic testing method for pressure of virtual machine in cluster, terminal and readable storage medium | |
| CN111967961B (en) | Data mining method and device | |
| CN115981937A (en) | Memory automatic testing method and system based on hybrid cloud |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |