CN104717236A - Equipment performance test method and device - Google Patents
Equipment performance test method and device Download PDFInfo
- Publication number
- CN104717236A CN104717236A CN201310676302.6A CN201310676302A CN104717236A CN 104717236 A CN104717236 A CN 104717236A CN 201310676302 A CN201310676302 A CN 201310676302A CN 104717236 A CN104717236 A CN 104717236A
- Authority
- CN
- China
- Prior art keywords
- test
- threads
- preset
- thread
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims description 12
- 238000011056 performance test Methods 0.000 title description 4
- 238000012360 testing method Methods 0.000 claims abstract description 191
- 238000004088 simulation Methods 0.000 claims abstract description 12
- 238000012544 monitoring process Methods 0.000 description 13
- 238000004422 calculation algorithm Methods 0.000 description 6
- 230000004044 response Effects 0.000 description 4
- 230000002159 abnormal effect Effects 0.000 description 3
- 230000005856 abnormality Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 238000009662 stress testing Methods 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
Landscapes
- Debugging And Monitoring (AREA)
Abstract
本发明公开了一种设备性能测试方法,通过定时采集的被测试设备在模拟测试线程中的各项性能数据确定当前可增加的并发线程数量的最大值,在最大值以及预设并发线程单步增加值之间选择较小的一方来增加被测试设备当前用于模拟的测试线程,并判断被测试设备的各项性能数据是否超过预设的性能阈值。从而在使被测试设备不发生崩溃的前提下,实时调整被测试设备达到最高性能,进而及时定位业务系统瓶颈,进行系统优化。
The invention discloses a device performance testing method. The maximum value of the number of concurrent threads that can be increased at present is determined by periodically collecting various performance data of the tested device in the simulated test thread, and the maximum value and the preset concurrent thread are single-step Select the smaller one among the increased values to increase the test thread currently used by the device under test for simulation, and judge whether the various performance data of the device under test exceed the preset performance threshold. Therefore, on the premise that the tested equipment does not crash, the tested equipment can be adjusted in real time to achieve the highest performance, and then the bottleneck of the business system can be located in time to optimize the system.
Description
技术领域technical field
本发明涉及通信技术领域,特别涉及一种设备性能测试方法。本发明同时还涉及一种设备性能测试装置The invention relates to the field of communication technology, in particular to a device performance testing method. The present invention also relates to an equipment performance testing device
背景技术Background technique
通常面向多用户的web应用系统在搭建完成并上线之前,需要获取到其所能够承载的访问量,响应速度、容错能力等性能指标。一般通过性能测试工具进行压力测试,从而获取web应用系统的运行状态和响应时间等性能指标。Usually, before a multi-user-oriented web application system is built and launched, it needs to obtain performance indicators such as the traffic it can carry, response speed, and fault tolerance. Generally, stress testing is carried out through performance testing tools to obtain performance indicators such as the running status and response time of the web application system.
性能测试工具的主要作用是通过模拟生产环境中的真实业务操作,对被测试系统实行压力负载测试,监视被测试系统在不同业务、不同压力性能下的性能表现,找出潜在的性能瓶颈进行分析、优化。The main function of the performance testing tool is to simulate the real business operation in the production environment, implement stress load testing on the tested system, monitor the performance of the tested system under different business and different stress performance, and find out potential performance bottlenecks for analysis ,optimization.
常用的系统性能测试工具,在模拟客户端行为的同时,记录了客户端并发请求数、响应时延等性能指标。但在现有的测试条件下,测试工具和业务系统的分布在不同主机上,业务系统的主机性能通过三方的监控,业务主机状态的变化不能直接反馈给测试客户端,常会出现因客户端请求过多,web应用主机的如cpu占用过高,连接数过多等有限资源不足而使系统过载崩溃,只能手工重启主机,此时三方监控也会受到影响,无法及时定位系统崩溃时导致异常的环境信息,运行期数据等,有些时候再现异常情况也显得比较困难。A commonly used system performance testing tool records performance indicators such as the number of concurrent client requests and response delay while simulating client behavior. However, under the existing test conditions, test tools and business systems are distributed on different hosts, and the host performance of the business system is monitored by three parties. Changes in the status of the business host cannot be directly fed back to the test client. Too many, the limited resources of the web application host, such as high cpu usage, too many connections, etc., cause the system to overload and crash, and the host can only be restarted manually. At this time, the three-party monitoring will also be affected, and it is impossible to locate the abnormality when the system crashes in time Environmental information, runtime data, etc., sometimes it is difficult to reproduce abnormal situations.
由此可见,常用的系统性能测试工具在模拟客户端行为的同时,记录了客户端并发请求数、响应时延等性能指标。但在通常的测试情况下,测试工具和业务系统的分布在不同主机上,业务系统的主机性能变化通过三方的监控,业务主机状态的变化不能直接反馈给测试客户端,常会出现以下的一些问题:It can be seen that the commonly used system performance testing tools record performance indicators such as the number of concurrent client requests and response delay while simulating the behavior of the client. However, in normal testing situations, test tools and business systems are distributed on different hosts, and the host performance changes of the business system are monitored by three parties. Changes in the status of the business host cannot be directly fed back to the test client, and the following problems often occur :
(1)因客户端请求过多,web应用主机的有限资源如cpu占用过高,连接数过多,而使web应用系统过载崩溃,只能手工重启主机。(1) Due to too many requests from the client, the limited resources of the web application host, such as cpu, are too high, and the number of connections is too high, so that the web application system is overloaded and crashes, and the host can only be restarted manually.
(2)系统的过载使三方监控也会受到影响,无法及时定位系统崩溃时导致异常的环境信息,运行期数据等,(2) The overload of the system will also affect the three-party monitoring, and it is impossible to locate the abnormal environmental information and runtime data when the system crashes in time.
(3)再现异常情况比较困难,且定位和捕捉异常的原因和系统瓶颈比较复杂。(3) It is difficult to reproduce the abnormal situation, and it is more complicated to locate and capture the cause of the abnormality and the bottleneck of the system.
由此可见,现有技术中的测试设备无法实时地根据压力情况对被测试设备的测试条件进行动态调整,进而获取到设备在满负荷状态下运转的测试数据。It can be seen that the test equipment in the prior art cannot dynamically adjust the test conditions of the tested equipment according to the pressure situation in real time, and then obtain the test data of the equipment operating at full load.
发明内容Contents of the invention
有鉴于现有技术中的不足,本发明提出了一种设备性能测试方法,其特征在于,包括:In view of the deficiencies in the prior art, the present invention proposes a method for testing equipment performance, which is characterized in that it includes:
测试设备定时采集被测试设备在模拟测试线程中的各项性能数据;The test equipment regularly collects various performance data of the tested equipment in the simulated test thread;
所述测试设备根据所述各项性能数据确定当前可增加的并发线程数量的最大值;The test device determines the maximum value of the number of concurrent threads that can be increased currently according to the various performance data;
所述测试设备在所述最大值以及预设并发线程单步增加值之间选择较小的一方作为并发线程增量值,并根据所述并发线程增量值增加所述被测试设备当前用于模拟的测试线程;The test device selects the smaller one between the maximum value and the preset concurrent thread incremental value as the concurrent thread incremental value, and increases the current value of the device under test according to the concurrent thread incremental value. simulated test thread;
所述测试设备采集所述被测试设备在模拟已增加的测试线程中的各项性能数据,并判断所述各项性能数据是否超过预设的性能阈值;The test device collects various performance data of the tested device in the simulated increased test thread, and judges whether the various performance data exceed a preset performance threshold;
若否,所述测试设备将测试线程的数量设置为预设初始值,并指示所述被测试设备对所述测试线程进行模拟。If not, the test device sets the number of test threads as a preset initial value, and instructs the device under test to simulate the test threads.
相应地,本发明还提出了一种设备性能测试装置,其特征在于,包括:Correspondingly, the present invention also proposes a device performance testing device, which is characterized in that it includes:
采集模块,用于定时采集被测试设备在模拟测试线程中的各项性能数据;The collection module is used to regularly collect various performance data of the tested equipment in the simulated test thread;
确定模块,用于根据所述各项性能数据确定当前可增加的并发线程数量的最大值;A determining module, configured to determine the maximum value of the number of concurrent threads that can be increased currently according to the various performance data;
选择模块,用于在所述最大值以及预设并发线程单步增加值之间选择较小的一方作为并发线程增量值,并根据所述并发线程增量值增加所述被测试设备当前用于模拟的测试线程;The selection module is used to select the smaller one between the maximum value and the preset concurrent thread incremental value as the concurrent thread incremental value, and increase the current usage rate of the device under test according to the concurrent thread incremental value. for simulated test threads;
判断模块,用于采集所述被测试设备在模拟已增加的测试线程中的各项性能数据,并判断所述各项性能数据是否超过预设的性能阈值;A judging module, configured to collect various performance data of the device under test in the simulated increased test thread, and judge whether the various performance data exceed a preset performance threshold;
若否,所述判断模块将测试线程的数量设置为预设初始值,并指示所述被测试设备对所述测试线程进行模拟。If not, the judging module sets the number of test threads as a preset initial value, and instructs the device under test to simulate the test threads.
由此可见,通过应用以上技术方案,通过定时采集的被测试设备在模拟测试线程中的各项性能数据确定当前可增加的并发线程数量的最大值,在最大值以及预设并发线程单步增加值之间选择较小的一方来增加被测试设备当前用于模拟的测试线程,并判断被测试设备的各项性能数据是否超过预设的性能阈值。从而在使被测试设备不发生崩溃的前提下,实时调整被测试设备达到最高性能,进而及时定位业务系统瓶颈,进行系统优化。It can be seen that by applying the above technical solutions, the maximum value of the number of concurrent threads that can be increased is determined by the performance data of the tested device in the simulated test thread collected regularly, and the maximum value and the preset concurrent threads are increased in a single step. Choose the smaller one among the values to increase the test thread currently used by the device under test for simulation, and judge whether the performance data of the device under test exceeds the preset performance threshold. Therefore, on the premise that the tested equipment does not crash, the tested equipment can be adjusted in real time to achieve the highest performance, and then the bottleneck of the business system can be located in time to optimize the system.
附图说明Description of drawings
图1为本发明提出的一种设备性能测试方法的流程示意图;Fig. 1 is the schematic flow sheet of a kind of equipment performance testing method that the present invention proposes;
图2为本发明具体实施例提出的测试系统的组成及结构示意图;Fig. 2 is the composition and structural representation of the testing system that the specific embodiment of the present invention proposes;
图3为本发明具体实施例提出的一种设备性能测试方法流程示意图;Fig. 3 is a schematic flow chart of a device performance testing method proposed by a specific embodiment of the present invention;
图4为本发明提出的一种设备性能测试装置的结构示意图。Fig. 4 is a schematic structural diagram of a device performance testing device proposed by the present invention.
具体实施方式Detailed ways
为解决现有技术中被测试设备无法获取到自身的测试压力情况并以此对测试条件进行动态调整的问题,本文提出了一种通过远程监控控制的web应用系统压力测试方法,在测试的同时,远程监控被测系统的各项有限资源的性能指标,并采集结果,动态调整压力测试客户端的策略和并发量,以让被测主机能够维持在有效的处理状态下,也可以记录到系统崩溃前后的并发数和业务系统环境数据,实现了业务系统的自动优化。In order to solve the problem in the prior art that the tested equipment cannot obtain its own test pressure and use it to dynamically adjust the test conditions, this paper proposes a web application system stress test method controlled by remote monitoring. , remotely monitor the performance indicators of various limited resources of the system under test, and collect the results, dynamically adjust the strategy and concurrency of the stress test client, so that the host under test can maintain an effective processing state, and system crashes can also be recorded The number of concurrency before and after and the business system environment data realize the automatic optimization of the business system.
如图1所示,为本发明提出的一种设备性能测试方法,包括以下步骤:As shown in Figure 1, for a kind of equipment performance testing method that the present invention proposes, comprises the following steps:
S101,测试设备定时采集被测试设备在模拟测试线程中的各项性能数据。S101. The testing device regularly collects various performance data of the tested device in a simulation test thread.
需要说明的是,在本步骤以及S104中,测试设备将根据预设的采集次数,连续采集所述被测试设备的各项性能数据并获取采集结果的均方根平均值,将所述均方根平均值作为所述各项性能数据。It should be noted that, in this step and in S104, the test device will continuously collect various performance data of the device under test according to the preset collection times and obtain the root mean square average value of the collection results, and convert the mean square The root average value is used as the performance data of each item.
S102,所述测试设备根据所述各项性能数据确定当前可增加的并发线程数量的最大值。S102. The test device determines the maximum value of the current number of concurrent threads that can be increased according to the various performance data.
具体地,本步骤中测试设备首先根据Tadd=T*(Pmax-Pnns)/Pnns确定与所述各项性能数对应的最大可增线程数估值Tadd,T为当前测试线程数量,Pmax为与所述各项性能数对应的最大值,Pnns为与所述各项性能数对应的均方根平均值;然后将与所述各项性能数对应的最大可增线程数估值中的最小值作为所述被测试设备当前可增加的并发线程数量的最大值。Specifically, in this step, the test device first determines the estimated maximum number of threads that can be increased Tadd corresponding to the performance numbers according to Tadd=T*(Pmax-Pnns)/Pnns, where T is the current number of test threads, and Pmax is equal to The maximum value corresponding to the various performance numbers, Pnns is the root mean square average value corresponding to the various performance numbers; then the minimum value in the estimation of the maximum number of threads that can be increased corresponding to the various performance numbers As the maximum number of concurrent threads that can be increased by the device under test.
S103,所述测试设备在所述最大值以及预设并发线程单步增加值之间选择较小的一方作为并发线程增量值,并根据所述并发线程增量值增加所述被测试设备当前用于模拟的测试线程,。S103. The test device selects the smaller one between the maximum value and the preset concurrent thread increment value as the concurrent thread increment value, and increases the current value of the device under test according to the concurrent thread increment value. The test thread used for simulation, .
S104,所述测试设备采集所述被测试设备在模拟已增加的测试线程中的各项性能数据,并判断所述各项性能数据是否超过预设的性能阈值。S104. The test device collects various performance data of the tested device in the simulated increased test thread, and judges whether the various performance data exceed a preset performance threshold.
S105,若否,所述测试设备将测试线程的数量设置为预设初始值,并指示所述被测试设备对所述测试线程进行模拟。S105. If not, the test device sets the number of test threads as a preset initial value, and instructs the device under test to simulate the test threads.
与本步骤相对应地,若所述测试设备判断所述被测试设备的各项性能数据超过预设的性能阈值,所述测试设备将测试线程的数量设置为预设最大值,并指示所述被测试设备对所述测试线程进行模拟。Corresponding to this step, if the testing device judges that the performance data of the tested device exceeds a preset performance threshold, the testing device sets the number of test threads to a preset maximum value, and instructs the The device under test simulates the test thread.
此外,在该步骤之后,测试设备每隔预设的时间增加所述被测试设备当前用于模拟的测试线程,每次增加的测试线程的数量为所述预设并发线程单步增加值。从而实现对被测试设备的循环增压测试。In addition, after this step, the test device increases the test thread currently used by the device under test for simulation every preset time, and the number of test threads added each time is a single-step increase value for the preset concurrent threads. In this way, the cyclic pressurization test of the equipment under test is realized.
为了进一步阐述本发明的技术思想,现结合具体的应用场景,对本发明的技术方案进行说明。如图2所示,为本发明具体实施例提出的测试系统,由性能测试客户端以及Web应用服务器代理组成,其中与各个组成对应的模块如下:In order to further illustrate the technical idea of the present invention, the technical solution of the present invention will now be described in conjunction with specific application scenarios. As shown in Figure 2, the test system proposed for the specific embodiment of the present invention is composed of a performance test client and a Web application server agent, wherein the modules corresponding to each composition are as follows:
性能测试客户端:Performance test client:
(1)测试用例:web应用系统的用户行为模拟用例实现。(1) Test cases: Realization of user behavior simulation use cases of the web application system.
(2)压力测试单元:模拟测试线程,调用测试用例发起请求。(2) Stress test unit: Simulate the test thread, call the test case to initiate the request.
(3)并发控制模块:根据配置和监控模块提供的策略,初始化测试单元,控制测试线程数,控制测试线程增压;(3) Concurrency control module: According to the strategy provided by the configuration and monitoring module, initialize the test unit, control the number of test threads, and control the pressure of the test thread;
(4)远程监控模块:发起远程性能指标监控请求,并实现压力策略算法;(4) Remote monitoring module: Initiate a remote performance index monitoring request and implement the pressure strategy algorithm;
(5)配置模块:配置测试流程,时长,单步增压线程数等,以及监控指标的阀值。(5) Configuration module: configure the test process, duration, number of single-step supercharging threads, etc., and the threshold of monitoring indicators.
(6)消息中间件:实现测试客户端与业务服务器之间的接口协议和通信功能。(6) Message middleware: realize the interface protocol and communication function between the test client and the business server.
web应用服务器代理(被测系统):Web application server proxy (system under test):
(1)性能监控代理;(1) performance monitoring agent;
(2)业务系统软件。(2) Business system software.
基于以上设置的性能测试流程如图3所示,包括:The performance test process based on the above settings is shown in Figure 3, including:
步骤1、根据配置初始化并启动压力测试单元,初始化远程监控模块和性能监控代理;Step 1. Initialize and start the stress test unit according to the configuration, initialize the remote monitoring module and the performance monitoring agent;
步骤2、并发控制模块从初始线程数开始,逐步增加,每次增加的间隔参见配置模块;Step 2. The concurrency control module starts from the initial number of threads and increases gradually. For the interval of each increase, refer to the configuration module;
步骤3、定时远程性能采集n次,根据采集指标计算各性能指标平均值(有限资源的性能指标归一化为占比,且为体现主机性能的压力情况,采用均方根平均值)。Step 3. Schedule remote performance collection n times, and calculate the average value of each performance index according to the collection index (the performance index of limited resources is normalized to the proportion, and in order to reflect the pressure of the host performance, the root mean square average is used).
步骤4、根据压力测试策略调整算法,计算一次增加的并发线程数。Step 4. Adjust the algorithm according to the stress test strategy, and calculate the number of concurrent threads increased at one time.
步骤5、并发控制模块增加并发线程,加大对web应用系统的压力;Step 5, the concurrency control module increases concurrent threads to increase the pressure on the web application system;
步骤6、再次远程性能采集监控,如果超过性能阀值,则根据策略计算需要终止的测试线程;Step 6, remote performance collection and monitoring again, if the performance threshold is exceeded, the test thread that needs to be terminated is calculated according to the strategy;
步骤7、重复步骤2-步骤6,不断调整性能压力,以找到系统压力负载最大值。并统计并发数、时延、成功率、远端主机各性能指标。Step 7. Repeat steps 2-6 to continuously adjust the performance pressure to find the maximum system pressure load. And count the number of concurrency, delay, success rate, and performance indicators of remote hosts.
步骤8、测试结束,整理客户端压力测试统计结果,包括并发、时延、成功率,以及远端性能监控数据。Step 8. After the test is over, sort out the statistical results of the client stress test, including concurrency, delay, success rate, and remote performance monitoring data.
其中,压力测试策略增压的详细算法如下:Among them, the detailed algorithm of stress test strategy supercharging is as follows:
首先,配置压力测试模拟用户的各项初始值:First, configure the initial values of the stress test simulated users:
初始测试线程数Tinit和最大值Tmax、当前测试线程数T、单步并发增长配置T0、单个testthread一次执行的case数Cn、testthread循环次数或持续时长、The initial number of test threads T init and the maximum value T max , the current number of test threads T, the single-step concurrent growth configuration T 0 , the number of cases C n executed by a single test thread at one time, the cycle times or duration of the test thread,
然后,配置远程性能监控指标阀值,有限资源的性能指标根据资源限制归一化为占比,例如:Then, configure the remote performance monitoring index threshold, and the performance index of limited resources is normalized to the proportion according to the resource limit, for example:
cpu最高占用率Pcpumax、业务线程数最高占比(web应用线程/系统用户线程最大值*100%)Pthreadmax、内存使用最大占比(used_mem/tatle_mem)Pmemmax、使用连接数占比(web应用端口连接数/用户进程文件数限制)Plinkmax、网络IO使用量占比Pniomax、磁盘IO使用量占比Pdiomax。The highest cpu occupancy rate P cpumax , the highest proportion of business threads (maximum value of web application threads/system user threads * 100%) P threadmax , the largest proportion of memory usage (used_mem/tatle_mem) P memmax , the proportion of used connections (web The number of application port connections/the number of user process files) P linkmax , the proportion of network IO usage P niomax , and the proportion of disk IO usage P diomax .
基于以上配置数值,具体算法如下:Based on the above configuration values, the specific algorithm is as follows:
各性能指标P的n次取值的均方根平均值计算方法为:The calculation method of the root mean square average value of the n times value of each performance index P is as follows:
各性能指标阀值限制的最大增加的并发请求数算法Rp为:The algorithm Rp of the maximum increase in the number of concurrent requests limited by the threshold value of each performance index is:
最大可增线程数估值(多个指标分别计算结果的最小值):Estimation of the maximum number of threads that can be increased (the minimum value of the results calculated by multiple indicators):
Tadd=Rp×T/Ravg T add =R p ×T/R avg
单步增压的最大测试线程数Tnext取值算法为The algorithm of the maximum number of test threads T next for single-step boosting is
Tnext=min(T0,Tadd)。T next = min(T 0 , T add ).
为达到以上技术目的,本发明同时还提出了一种设备性能测试装置,如图4所示,包括:In order to achieve the above technical objectives, the present invention also proposes a device performance testing device, as shown in Figure 4, including:
采集模块410,用于定时采集被测试设备在模拟测试线程中的各项性能数据;Acquisition module 410, is used for regularly collecting various performance data of the device under test in the simulated test thread;
确定模块420,用于根据所述各项性能数据确定当前可增加的并发线程数量的最大值;A determination module 420, configured to determine the maximum value of the current number of concurrent threads that can be increased according to the various performance data;
选择模块430,用于在所述最大值以及预设并发线程单步增加值之间选择较小的一方作为并发线程增量值,并根据所述并发线程增量值增加所述被测试设备当前用于模拟的测试线程;A selection module 430, configured to select the smaller one between the maximum value and the preset single-step increase value of concurrent threads as the incremental value of concurrent threads, and increase the current value of the device under test according to the incremental value of concurrent threads. Test thread for simulation;
判断模块440,用于采集所述被测试设备在模拟已增加的测试线程中的各项性能数据,并判断所述各项性能数据是否超过预设的性能阈值;A judging module 440, configured to collect various performance data of the device under test in the simulated increased test thread, and judge whether the various performance data exceed a preset performance threshold;
若否,所述判断模块440将测试线程的数量设置为预设初始值,并指示所述被测试设备对所述测试线程进行模拟。If not, the judging module 440 sets the number of test threads as a preset initial value, and instructs the device under test to simulate the test threads.
在具体的应用场景中,还包括:增量模块,用于在所述判断模块440将测试线程的数量设置为预设初始值并指示所述被测试设备对所述测试线程进行模拟之后,每隔预设的时间增加所述被测试设备当前用于模拟的测试线程,每次增加的测试线程的数量为所述预设并发线程单步增加值。In a specific application scenario, it also includes: an increment module, configured to, after the judging module 440 sets the number of test threads as a preset initial value and instructs the device under test to simulate the test threads, The test thread currently used by the device under test for simulation is increased at preset time intervals, and the number of test threads added each time is a single-step increase value of the preset concurrent thread.
在具体的应用场景中,所述判断模块440,还用于在判断所述被测试设备的各项性能数据超过预设的性能阈值时,将测试线程的数量设置为预设最大值,并指示所述被测试设备对所述测试线程进行模拟。In a specific application scenario, the judging module 440 is further configured to set the number of test threads to a preset maximum value and instruct The device under test simulates the test thread.
在具体的应用场景中,所述采集模块410或所述判断模块440具体用于:In a specific application scenario, the collection module 410 or the judgment module 440 is specifically used for:
根据预设的采集次数,连续采集所述被测试设备的各项性能数据并获取采集结果的均方根平均值,将所述均方根平均值作为所述各项性能数据。Continuously collect various performance data of the device under test according to preset collection times and obtain a root mean square average value of the collection results, and use the root mean square average value as the various performance data.
在具体的应用场景中,所述确定模块420,具体用于:In a specific application scenario, the determining module 420 is specifically used for:
根据Tadd=T*(Pmax-Pnns)/Pnns确定与所述各项性能数对应的最大可增线程数估值Tadd,T为当前测试线程数量,Pmax为与所述各项性能数对应的最大值,Pnns为与所述各项性能数对应的均方根平均值,并将与所述各项性能数对应的最大可增线程数估值中的最小值作为所述被测试设备当前可增加的并发线程数量的最大值。According to T add =T*(P max -P nns )/P nns determine the estimate T add of the maximum number of threads that can be increased corresponding to the various performance numbers, T is the current number of test threads, and P max is the The maximum value corresponding to the item performance number, P nns is the root mean square average value corresponding to the various performance numbers, and the minimum value in the estimation of the maximum number of threads that can be increased corresponding to the various performance numbers is used as the The current maximum number of concurrent threads that can be increased by the device under test.
通过应用以上技术方案,通过定时采集的被测试设备在模拟测试线程中的各项性能数据确定当前可增加的并发线程数量的最大值,在最大值以及预设并发线程单步增加值之间选择较小的一方来增加被测试设备当前用于模拟的测试线程,并判断被测试设备的各项性能数据是否超过预设的性能阈值。从而在使被测试设备不发生崩溃的前提下,实时调整被测试设备达到最高性能,进而及时定位业务系统瓶颈,进行系统优化。By applying the above technical solutions, the maximum value of the number of concurrent threads that can be increased is determined through the regularly collected performance data of the device under test in the simulated test thread, and the choice is made between the maximum value and the single-step increase value of the preset concurrent threads. The smaller one is to increase the test thread currently used by the device under test for simulation, and judge whether the performance data of the device under test exceeds the preset performance threshold. Therefore, on the premise that the tested equipment does not crash, the tested equipment can be adjusted in real time to achieve the highest performance, and then the bottleneck of the business system can be located in time to optimize the system.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到本发明可以通过硬件实现,也可以借助软件加必要的通用硬件平台的方式来实现。基于这样的理解,本发明的技术方案可以以软件产品的形式体现出来,该软件产品可以存储在一个非易失性存储介质(可以是CD-ROM,U盘,移动硬盘等)中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施场景所述的方法。Through the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be realized by hardware, or by software plus a necessary general hardware platform. Based on this understanding, the technical solution of the present invention can be embodied in the form of software products, which can be stored in a non-volatile storage medium (which can be CD-ROM, U disk, mobile hard disk, etc.), including several The instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute the methods described in various implementation scenarios of the present invention.
本领域技术人员可以理解附图只是一个优选实施场景的示意图,附图中的模块或流程并不一定是实施本发明所必须的。Those skilled in the art can understand that the accompanying drawing is only a schematic diagram of a preferred implementation scenario, and the modules or processes in the accompanying drawings are not necessarily necessary for implementing the present invention.
本领域技术人员可以理解实施场景中的装置中的模块可以按照实施场景描述进行分布于实施场景的装置中,也可以进行相应变化位于不同于本实施场景的一个或多个装置中。上述实施场景的模块可以合并为一个模块,也可以进一步拆分成多个子模块。Those skilled in the art can understand that the modules in the devices in the implementation scenario can be distributed among the devices in the implementation scenario according to the description of the implementation scenario, or can be located in one or more devices different from the implementation scenario according to corresponding changes. The modules of the above implementation scenarios can be combined into one module, or can be further split into multiple sub-modules.
上述本发明序号仅仅为了描述,不代表实施场景的优劣。The above serial numbers of the present invention are for description only, and do not represent the pros and cons of the implementation scenarios.
以上公开的仅为本发明的几个具体实施场景,但是,本发明并非局限于此,任何本领域的技术人员能思之的变化都应落入本发明的保护范围。The above disclosures are only some specific implementation scenarios of the present invention, however, the present invention is not limited thereto, and any changes conceivable by those skilled in the art shall fall within the protection scope of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310676302.6A CN104717236A (en) | 2013-12-11 | 2013-12-11 | Equipment performance test method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310676302.6A CN104717236A (en) | 2013-12-11 | 2013-12-11 | Equipment performance test method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN104717236A true CN104717236A (en) | 2015-06-17 |
Family
ID=53416196
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310676302.6A Pending CN104717236A (en) | 2013-12-11 | 2013-12-11 | Equipment performance test method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104717236A (en) |
Cited By (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104955082A (en) * | 2015-07-13 | 2015-09-30 | 北京博大光通国际半导体技术有限公司 | Graphical management method and system for communication quality of wireless sensor network |
CN105141591A (en) * | 2015-08-03 | 2015-12-09 | 汉柏科技有限公司 | Method and system for obtaining maximum concurrent connection number of firewall |
CN105262826A (en) * | 2015-10-29 | 2016-01-20 | 福建天晴数码有限公司 | Method and system for adjusting interface processing amount |
CN105490876A (en) * | 2015-11-26 | 2016-04-13 | 上海斐讯数据通信技术有限公司 | Method for automatic testing of server performance through packet sending linkage and concurrent monitoring |
CN106067043A (en) * | 2016-06-01 | 2016-11-02 | 重庆中科云丛科技有限公司 | A kind of performance test methods and system |
CN106502887A (en) * | 2016-10-13 | 2017-03-15 | 郑州云海信息技术有限公司 | A kind of stability test method, test controller and system |
CN106528426A (en) * | 2016-11-21 | 2017-03-22 | 北京蓝海讯通科技股份有限公司 | Distributed computing system of test indexes |
CN107066385A (en) * | 2017-03-31 | 2017-08-18 | 北京奇艺世纪科技有限公司 | A kind of method of testing, apparatus and system |
CN107807868A (en) * | 2017-10-13 | 2018-03-16 | 郑州云海信息技术有限公司 | A kind of dual control storage system disaster dump method of testing and system |
CN108521353A (en) * | 2018-04-02 | 2018-09-11 | 深圳前海微众银行股份有限公司 | Processing method, device, and readable storage medium for locating performance bottlenecks |
CN108566314A (en) * | 2018-03-06 | 2018-09-21 | 平安科技(深圳)有限公司 | The acquisition methods and storage medium of status information under electronic device, cluster environment |
CN109426593A (en) * | 2017-08-24 | 2019-03-05 | 北京京东尚科信息技术有限公司 | The method and apparatus of automatic evaluation system performance |
CN109614304A (en) * | 2018-12-07 | 2019-04-12 | 国家电网有限公司信息通信分公司 | A kind of calculation method and device for running baseline |
CN109684228A (en) * | 2019-01-07 | 2019-04-26 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of performance test methods, device, system and storage medium |
CN110780990A (en) * | 2019-09-12 | 2020-02-11 | 中移(杭州)信息技术有限公司 | Performance detection method, performance detection device, server and storage medium |
CN111026632A (en) * | 2018-10-10 | 2020-04-17 | 武汉斗鱼网络科技有限公司 | Performance test method, storage medium, electronic device and system |
CN112765019A (en) * | 2021-01-13 | 2021-05-07 | 北京鼎事兴教育咨询有限公司 | Pressure measurement method and device, storage medium and electronic equipment |
CN113238854A (en) * | 2021-07-07 | 2021-08-10 | 苏州浪潮智能科技有限公司 | Method, device and equipment for automatically adjusting thread number and readable medium |
CN113535407A (en) * | 2021-07-30 | 2021-10-22 | 济南浪潮数据技术有限公司 | Server optimization method, system, equipment and storage medium |
CN114500349A (en) * | 2021-12-27 | 2022-05-13 | 天翼云科技有限公司 | Cloud platform chaos testing method and device |
CN114697080A (en) * | 2022-02-28 | 2022-07-01 | 中国科学院信息工程研究所 | Test configuration adjustment method of network password equipment distributed performance test system |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7908382B2 (en) * | 2006-06-07 | 2011-03-15 | International Business Machines Corporation | System and method to optimally manage performance's virtual users and test cases |
CN102750211A (en) * | 2012-06-11 | 2012-10-24 | 苏州阔地网络科技有限公司 | Pressure test method and system |
CN102769674A (en) * | 2012-07-29 | 2012-11-07 | 西北工业大学 | Web application system load testing method based on value detection method |
-
2013
- 2013-12-11 CN CN201310676302.6A patent/CN104717236A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7908382B2 (en) * | 2006-06-07 | 2011-03-15 | International Business Machines Corporation | System and method to optimally manage performance's virtual users and test cases |
CN102750211A (en) * | 2012-06-11 | 2012-10-24 | 苏州阔地网络科技有限公司 | Pressure test method and system |
CN102769674A (en) * | 2012-07-29 | 2012-11-07 | 西北工业大学 | Web application system load testing method based on value detection method |
Non-Patent Citations (1)
Title |
---|
李克文等: "基于Web应用的快速压力测试研究", 《微计算机应用》 * |
Cited By (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104955082A (en) * | 2015-07-13 | 2015-09-30 | 北京博大光通国际半导体技术有限公司 | Graphical management method and system for communication quality of wireless sensor network |
CN104955082B (en) * | 2015-07-13 | 2018-09-11 | 北京博大光通国际半导体技术有限公司 | A kind of wireless sensor network communication quality graphically managing method and system |
CN105141591A (en) * | 2015-08-03 | 2015-12-09 | 汉柏科技有限公司 | Method and system for obtaining maximum concurrent connection number of firewall |
CN105262826A (en) * | 2015-10-29 | 2016-01-20 | 福建天晴数码有限公司 | Method and system for adjusting interface processing amount |
CN105490876A (en) * | 2015-11-26 | 2016-04-13 | 上海斐讯数据通信技术有限公司 | Method for automatic testing of server performance through packet sending linkage and concurrent monitoring |
CN106067043A (en) * | 2016-06-01 | 2016-11-02 | 重庆中科云丛科技有限公司 | A kind of performance test methods and system |
CN106502887A (en) * | 2016-10-13 | 2017-03-15 | 郑州云海信息技术有限公司 | A kind of stability test method, test controller and system |
CN106528426A (en) * | 2016-11-21 | 2017-03-22 | 北京蓝海讯通科技股份有限公司 | Distributed computing system of test indexes |
CN106528426B (en) * | 2016-11-21 | 2019-03-15 | 北京蓝海讯通科技股份有限公司 | A kind of distributed computing system of test index |
CN107066385A (en) * | 2017-03-31 | 2017-08-18 | 北京奇艺世纪科技有限公司 | A kind of method of testing, apparatus and system |
CN109426593A (en) * | 2017-08-24 | 2019-03-05 | 北京京东尚科信息技术有限公司 | The method and apparatus of automatic evaluation system performance |
CN107807868A (en) * | 2017-10-13 | 2018-03-16 | 郑州云海信息技术有限公司 | A kind of dual control storage system disaster dump method of testing and system |
CN108566314A (en) * | 2018-03-06 | 2018-09-21 | 平安科技(深圳)有限公司 | The acquisition methods and storage medium of status information under electronic device, cluster environment |
CN108521353A (en) * | 2018-04-02 | 2018-09-11 | 深圳前海微众银行股份有限公司 | Processing method, device, and readable storage medium for locating performance bottlenecks |
CN111026632A (en) * | 2018-10-10 | 2020-04-17 | 武汉斗鱼网络科技有限公司 | Performance test method, storage medium, electronic device and system |
CN109614304A (en) * | 2018-12-07 | 2019-04-12 | 国家电网有限公司信息通信分公司 | A kind of calculation method and device for running baseline |
CN109684228A (en) * | 2019-01-07 | 2019-04-26 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of performance test methods, device, system and storage medium |
CN110780990A (en) * | 2019-09-12 | 2020-02-11 | 中移(杭州)信息技术有限公司 | Performance detection method, performance detection device, server and storage medium |
CN112765019B (en) * | 2021-01-13 | 2024-01-19 | 北京鼎事兴教育咨询有限公司 | Pressure measurement method and device, storage medium and electronic equipment |
CN112765019A (en) * | 2021-01-13 | 2021-05-07 | 北京鼎事兴教育咨询有限公司 | Pressure measurement method and device, storage medium and electronic equipment |
CN113238854A (en) * | 2021-07-07 | 2021-08-10 | 苏州浪潮智能科技有限公司 | Method, device and equipment for automatically adjusting thread number and readable medium |
CN113238854B (en) * | 2021-07-07 | 2021-11-19 | 苏州浪潮智能科技有限公司 | Method, device and equipment for automatically adjusting thread number and readable medium |
CN113535407A (en) * | 2021-07-30 | 2021-10-22 | 济南浪潮数据技术有限公司 | Server optimization method, system, equipment and storage medium |
CN113535407B (en) * | 2021-07-30 | 2024-03-19 | 济南浪潮数据技术有限公司 | Optimization method, system, equipment and storage medium of server |
CN114500349A (en) * | 2021-12-27 | 2022-05-13 | 天翼云科技有限公司 | Cloud platform chaos testing method and device |
CN114500349B (en) * | 2021-12-27 | 2023-08-08 | 天翼云科技有限公司 | A cloud platform chaos testing method and device |
CN114697080A (en) * | 2022-02-28 | 2022-07-01 | 中国科学院信息工程研究所 | Test configuration adjustment method of network password equipment distributed performance test system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104717236A (en) | Equipment performance test method and device | |
CN102111337B (en) | Task scheduling method and system | |
CN108989136B (en) | Service end-to-end performance monitoring method and device | |
CN103617098B (en) | Intelligent backup method and intelligent backup system based on data variation | |
WO2017114152A1 (en) | Service dial testing method, apparatus and system | |
CN107078925B (en) | A kind of heartbeat cycle setting method and terminal | |
CN101945353B (en) | A method and system for remote adjustment of system resources | |
CN105553768B (en) | A kind of SDN controller failure detection methods based on adaptive time-out time | |
CN103970641A (en) | Equipment expansion method based on capacity prediction technology | |
CN106095682A (en) | Android application stability test method for simulating complex network | |
CN112134754A (en) | Pressure testing method and device, network equipment and storage medium | |
CN107070752B (en) | Testing method and testing system for long connection capacity | |
CN107094086A (en) | A kind of information acquisition method and device | |
CN104022895B (en) | Internet cascading failure diagnostic analysis system | |
CN112994972A (en) | Distributed probe monitoring platform | |
CN103442087B (en) | A kind of Web service system visit capacity based on response time trend analysis controls apparatus and method | |
WO2018036244A1 (en) | Data analysis method, apparatus and device, and storage medium | |
CN104320285A (en) | Website running status monitoring method and device | |
CN110730112A (en) | Method, system, equipment and storage medium for testing network running speed | |
CN111124310B (en) | Storage system scheduling optimization method and related components | |
CN105159815B (en) | High Performance Computing Cluster system failure Forecasting Methodology and device | |
CN113541979B (en) | Fault dynamic prediction method and device based on time sequence data and computing equipment | |
CN117251373A (en) | Pressure testing methods, devices, equipment and storage media | |
CN112612578A (en) | Virtual machine monitoring method and device | |
CN115494405A (en) | Battery monitoring system and its exception handling method, electronic equipment, storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150617 |
|
RJ01 | Rejection of invention patent application after publication |