CN103150253B - A kind of method and system for duration performance test - Google Patents
A kind of method and system for duration performance test Download PDFInfo
- Publication number
- CN103150253B CN103150253B CN201310083681.8A CN201310083681A CN103150253B CN 103150253 B CN103150253 B CN 103150253B CN 201310083681 A CN201310083681 A CN 201310083681A CN 103150253 B CN103150253 B CN 103150253B
- Authority
- CN
- China
- Prior art keywords
- performance
- performance data
- test
- module
- duration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention discloses a kind of method and system for duration performance test, it is for the performance optimization stage of computer software product, continuous surveillance and Continual Improvement are carried out to the performance of software product, method wherein for duration performance test comprises: response product is submitted to, built running environment, execution and record performance data, performance preferentially, to user report performance data, manually sets performance data.Thus achieve the performance test robotization in software product testing process, and solve software product performance be difficult to assess problem.
Description
Technical field
The present invention relates to a kind of method and system for duration performance test, it carries out continuous surveillance and Continual Improvement to the performance of computer software product.
Background technology
In the performance optimization stage of product, need to test properties of product.In existing test process, generally the performance index setting this product according to product demand, industry standard, experience, such as service operation duration, EMS memory occupation etc., then by manual operation, each index to be measured is measured, and record every test result, with the data that provide support to the further optimization of product.And in fact, even the difference slightly of different test environments, the potential impact being difficult to quantize on test result all can be brought, even same test environment, along with the change of time, also unpredicted drift can be there is in the test condition of itself, and manual operation and the easy mistakes and omissions of record and very consuming time, that is, in practical operation, same test environment is more difficult existing, and manual operation efficiency is low and easily make mistakes, and is difficult to objective, to assess product accurately and efficiently performance.
Summary of the invention
The object of this invention is to provide a kind of method and system for duration performance test, it is for the performance optimization stage of computer software product, continuous surveillance and Continual Improvement are carried out to the performance of software product, the benefit that the present invention brings is, achieve the performance test robotization in software product testing process, and solve software product performance be difficult to assess problem.
According to the present invention, provide a kind of method for duration performance test, it is characterized in that, said method comprising the steps of:
Step S100, waits pending request;
Step S101, receives the request of execution, and executive operating system is recovered, to return to the init state of device operating system;
Step S102, is linked to specified network website and downloads tested software product, and start up system performance monitoring;
Step S103, performs the business function of test product;
Step S104, shutdown system performance monitoring, and the current performance data of the test product produced by monitoring record is preserved;
Step S105, judges whether current performance data exceedes default performance threshold values, if exceeded, then jumps to next step, otherwise jumps to step S107;
Step S106, record judged result, forwards step e nd to;
Step S107, in the performance data of having preserved, searches and is set as optimum performance data, if do not found, then current performance data is set as optimum, and forwards step e nd to, otherwise continue next step;
The optimal performance data found and current performance data are compared, if current performance data is more excellent, then current performance data are set as optimum, and forward step e nd to by step S108, otherwise continue next step;
Step S109, is reported to user's process, and waits for user feedback;
Step S110, according to user feedback, determines whether current performance data is set as optimum, and the reason of record setting;
Step e nd, reports the result, and forwards step S100 to.
As a kind of preferred version, according to the method for duration performance test of the present invention, it also comprises an initialization procedure.
As a kind of preferred version, according to the method for duration performance test of the present invention, described initialization procedure comprises: prepare a clean equipment, preserve the original state of the operating system of described equipment, uses same test environment to make each execution; According to product demand, industry standard and experience, the performance threshold values of setting test product.
As a kind of preferred version, according to the method for duration performance test of the present invention, described operating system is the system image of a clone.
As a kind of preferred version, according to the method for duration performance test of the present invention, described performance threshold values comprises service operation duration, the average occupancy of CPU, EMS memory occupation maximal value, the average occupancy of internal memory.
According to the present invention, additionally provide a kind of system for duration performance test, it is for the continuous surveillance of software product performance and improvement, and it is characterized in that, described system comprises automatic performance test module, Performance comparision module, user interactive module, wherein,
Described automatic performance test module being submitted to for responding product, being built running environment, execution and record performance data; Described Performance comparision module is used for performance preferentially and include performance threshold values, and described user interactive module is used for user report performance data, manually sets performance data, wherein,
Described automatic performance test module performs following functions in succession: wait pending request; Receive the request of execution, executive system is recovered, to return to the init state of device systems; Be linked to specified network website and download tested software product, and start up system performance monitoring; Perform the business function of test product; Shutdown system performance monitoring, and the current performance data of the test product produced by monitoring record is preserved;
Described Performance comparision module receives the current performance data from described automatic performance test module, and perform following judgement and turn function: judge whether current performance data exceedes default performance threshold values, if exceeded, record judged result is also reported, then described automatic performance test module is turned back to, otherwise in the performance data of having preserved, search and be set as optimum performance data, if do not found, then current performance data is set as optimum, and report the result, then described automatic performance test module is turned back to, otherwise the optimal performance data found and current performance data are compared, if current performance data is more excellent, then current performance data is set as optimum, and report the result, then described automatic performance test module is turned back to, otherwise forward described user interactive module to, be reported to user by described user interactive module to process, and wait for user feedback, according to user feedback, determine whether current performance data is set as optimum, and the reason of record setting, then report the result, then described automatic performance test module is turned back to.
As a kind of preferred version, according to the system for duration performance test of the present invention, also comprise a function of initializing module.
As a kind of preferred version, according to the system for duration performance test of the present invention, described function of initializing module performs following functions: prepare a clean equipment, preserve the original state of the operating system of described equipment, uses same test environment to make each execution; According to product demand, industry standard and experience, the performance threshold values of setting test product.
As a kind of preferred version, according to the system for duration performance test of the present invention, described operating system is the system image of a clone.
As a kind of preferred version, according to the system for duration performance test of the present invention, described performance threshold values comprises service operation duration, the average occupancy of CPU, EMS memory occupation maximal value, the average occupancy of internal memory.
Accompanying drawing explanation
Below in conjunction with accompanying drawing, embodiments of the invention are described in detail.
Figure 1 shows that the process flow diagram according to the method for duration performance test of the present invention.
Embodiment
With reference to Fig. 1, it is depicted as the process flow diagram according to the method for duration performance test of the present invention, and the system that the function performed by each step of this flow process can be tested for duration performance by realizes.Preferably, when running first, first can carry out an initialization procedure, being performed by the function of initializing module of the system of testing for duration performance:
The clean equipment of preparation, preserves the original state of the operating system of described equipment, and to ensure that each execution uses same test environment, preferably, described operating system is the system image of a clone; According to product demand, industry standard and experience, the performance threshold values of setting test product, preferably, described performance threshold values comprises service operation duration, the average occupancy of CPU, EMS memory occupation maximal value, the average occupancy of internal memory etc.
Operating procedure for the method for duration performance test is as follows:
Step S100, waits pending request;
Step S101, receives the request of execution, and executive operating system is recovered, to return to the init state of device operating system;
Step S102, is linked to specified network website and downloads tested software product, and start up system performance monitoring;
Step S103, performs the business function of test product;
Step S104, shutdown system performance monitoring, and the current performance data of the test product produced by monitoring record is preserved;
Step S105, judges whether current performance data exceedes default performance threshold values, if exceeded, then jumps to next step, otherwise jumps to step S107;
Step S106, record judged result, forwards step e nd to;
Step S107, in the performance data of having preserved, searches and is set as optimum performance data, if do not found, then current performance data is set as optimum, and forwards step e nd to, otherwise continue next step;
The optimal performance data found and current performance data are compared, if current performance data is more excellent, then current performance data are set as optimum, and forward step e nd to by step S108, otherwise continue next step;
Step S109, is reported to user's process, and waits for user feedback;
Step S110, according to user feedback, determines whether current performance data is set as optimum, and the reason of record setting;
Step e nd, reports the result, and forwards step S100 to.
According to the system for duration performance test of the present invention, it is for the continuous surveillance of software product performance and improvement, described system comprises automatic performance test module, Performance comparision module, user interactive module, wherein, described automatic performance test module being submitted to for responding product, being built running environment, execution and record performance data; Described Performance comparision module is used for performance preferentially and include performance threshold values, and described user interactive module is used for user report performance data, manually sets performance data.
Particularly, described automatic performance test module performs the function of the step S100 to step S104 according to method of the present invention in succession:
Step S100, waits pending request;
Step S101, receives the request of execution, and executive operating system is recovered, to return to the init state of device operating system;
Step S102, is linked to specified network website and downloads tested software product, and start up system performance monitoring;
Step S103, performs the business function of test product;
Step S104, shutdown system performance monitoring, and the current performance data of the test product produced by monitoring record is preserved;
Described Performance comparision module receives the current performance data from described automatic performance test module, perform step S105 to step S108, and the function of step e nd, wherein according to the judged result of a certain concrete steps, can jump to and this judged result corresponding step:
Step S105, judges whether current performance data exceedes default performance threshold values, if exceeded, then jumps to next step, otherwise jumps to step S107;
Step S106, record judged result, forwards step e nd to;
Step S107, in the performance data of having preserved, searches and is set as optimum performance data, if do not found, then current performance data is set as optimum, and forwards step e nd to, otherwise continue next step;
The optimal performance data found and current performance data are compared, if current performance data is more excellent, then current performance data are set as optimum, and forward step e nd to by step S108;
Wherein, in step S108, if current performance data is not more excellent, then performed the function of step S109 to step S110 by described user interactive module:
Step S109, is reported to user's process, and waits for user feedback;
Step S110, according to user feedback, determines whether current performance data is set as optimum, and the reason of record setting;
Finally forward step e nd to, report the result.Then turn back to described automatic performance test module, re-execute step S100.
Claims (6)
1., for a method for duration performance test, it is for the continuous surveillance of software product performance and improvement, and described method is implemented in a computer system, it is characterized in that, said method comprising the steps of:
Step (S100): the execution request waiting for performance test;
Step (S101): the execution request receiving performance test, executive operating system is recovered, to return to the init state of device operating system;
Step (S102): be linked to specified network website and download tested software product, and start up system performance monitoring;
Step (S103): the business function performing test product;
Step (S104): shutdown system performance monitoring, and the current performance data of the test product produced by monitoring record is preserved;
Step (S105): judge whether current performance data exceedes default performance threshold, if exceeded, then jump to next step, otherwise jump to step (S107);
Step (S106): record judged result, forwards step e nd to;
Step (S107): in the performance data of having preserved, searches and is set as optimum performance data, if do not found, then current performance data is set as optimum, and forwards step e nd to, otherwise continues next step;
Step (S108): the optimal performance data found and current performance data are compared, if current performance data is more excellent, then current performance data is set as optimum, and forwards step e nd to, otherwise continue next step;
Step (S109): be reported to user's process, and wait for user feedback;
Step (S110): according to user feedback, determines whether current performance data is set as optimum, and the reason of record setting;
Step e nd: report the result, forwards step (S100) to;
Wherein, also comprise an initialization procedure, described initialization procedure comprises: prepare a clean equipment, preserve the original state of the operating system of described equipment, uses same test environment to make each execution; According to product demand, industry standard and experience, the performance threshold of setting test product.
2. the method for duration performance test according to claim 1, it is characterized in that, described operating system is the system image of a clone.
3. the method for duration performance test according to claim 1, it is characterized in that, described performance threshold comprises service operation duration, the average occupancy of CPU, EMS memory occupation maximal value, the average occupancy of internal memory.
4., for a system for duration performance test, it is for the continuous surveillance of software product performance and improvement, and it is characterized in that, described system comprises automatic performance test module, Performance comparision module, user interactive module, wherein,
Described automatic performance test module being submitted to for responding product, being built running environment, execution and record performance data; Described Performance comparision module is used for performance preferentially and include performance threshold, and described user interactive module is used for user report performance data, manually sets performance data, wherein,
Described automatic performance test module performs following functions in succession: wait pending request; Receive the request of execution, executive system is recovered, to return to the init state of device systems; Be linked to specified network website and download tested software product, and start up system performance monitoring; Perform the business function of test product; Shutdown system performance monitoring, and the current performance data of the test product produced by monitoring record is preserved;
Described Performance comparision module receives the current performance data from described automatic performance test module, and perform following judgement and turn function: judge whether current performance data exceedes default performance threshold, if exceeded, record judged result is also reported, then described automatic performance test module is turned back to, otherwise in the performance data of having preserved, search and be set as optimum performance data, if do not found, then current performance data is set as optimum, and report the result, then described automatic performance test module is turned back to, otherwise the optimal performance data found and current performance data are compared, if current performance data is more excellent, then current performance data is set as optimum, and report the result, then described automatic performance test module is turned back to, otherwise forward described user interactive module to, be reported to user by described user interactive module to process, and wait for user feedback, according to user feedback, determine whether current performance data is set as optimum, and the reason of record setting, then report the result, then described automatic performance test module is turned back to,
Wherein, also comprise a function of initializing module, described function of initializing module performs following functions: prepare a clean equipment, preserve the original state of the operating system of described equipment, uses same test environment to make each execution; According to product demand, industry standard and experience, the performance threshold of setting test product.
5. the system for duration performance test according to claim 4, it is characterized in that, described operating system is the system image of a clone.
6. the system for duration performance test according to claim 4, it is characterized in that, described performance threshold comprises service operation duration, the average occupancy of CPU, EMS memory occupation maximal value, the average occupancy of internal memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310083681.8A CN103150253B (en) | 2013-03-15 | 2013-03-15 | A kind of method and system for duration performance test |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310083681.8A CN103150253B (en) | 2013-03-15 | 2013-03-15 | A kind of method and system for duration performance test |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103150253A CN103150253A (en) | 2013-06-12 |
| CN103150253B true CN103150253B (en) | 2016-01-20 |
Family
ID=48548348
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310083681.8A Active CN103150253B (en) | 2013-03-15 | 2013-03-15 | A kind of method and system for duration performance test |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103150253B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103514086A (en) * | 2013-09-22 | 2014-01-15 | 广东威创视讯科技股份有限公司 | Extraction method and device for software error report |
| CN103577328B (en) * | 2013-11-20 | 2016-08-17 | 北京奇虎科技有限公司 | The method for analyzing performance of a kind of application and device |
| CN105786682A (en) * | 2016-02-29 | 2016-07-20 | 上海新炬网络信息技术有限公司 | Implementation system and method for avoiding software performance failure |
| CN107957945B (en) * | 2017-11-29 | 2019-06-25 | 平安科技（深圳）有限公司 | Monetary fund system automatic performance test method, device, equipment and storage medium |
| CN108345541A (en) * | 2018-02-11 | 2018-07-31 | 北京量子智慧科技有限公司 | A kind of program detecting method and system |
| CN113553249B (en) * | 2021-09-18 | 2022-01-18 | 统信软件技术有限公司 | Operating system performance tuning method, computing device and readable storage medium |
| CN117009250A (en) * | 2023-09-25 | 2023-11-07 | 麒麟软件有限公司 | Automatic GRUB test method and system for Linux operating system |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101576844A (en) * | 2008-05-09 | 2009-11-11 | 北京世纪拓远软件科技发展有限公司 | Method and system for testing software system performances |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011047918A1 (en) * | 2009-10-21 | 2011-04-28 | International Business Machines Corporation | Method and system for improving software execution time by optimizing a performance model |
-
2013
- 2013-03-15 CN CN201310083681.8A patent/CN103150253B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101576844A (en) * | 2008-05-09 | 2009-11-11 | 北京世纪拓远软件科技发展有限公司 | Method and system for testing software system performances |
Non-Patent Citations (1)
| Title |
|---|
| WEB性能测试技术的研究;桑圣洪;《中国优秀硕士学位论文全文数据库》;20070615;第22页第3.1节-第42页第3.7节 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103150253A (en) | 2013-06-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103150253B (en) | A kind of method and system for duration performance test | |
| CN108055264A (en) | Dispatching device, method and the computer readable storage medium of stream pushing server | |
| CN104185840A (en) | Prioritization of continuous deployment pipeline tests | |
| CN105260273B (en) | A kind of test method and device of intelligent electronic device | |
| CN103973858B (en) | The Auto-Test System of mobile terminal | |
| US20140289719A1 (en) | Automatic version management | |
| EP2985730A1 (en) | Method and device for partially-upgrading | |
| CN111104324B (en) | Method and device for generating test cases and computer readable storage medium | |
| CN111666217B (en) | Method and apparatus for testing code | |
| CN111026572A (en) | Fault processing method and device of distributed system and electronic equipment | |
| CN105472083A (en) | Testing method and system for wireless terminals | |
| US20150019722A1 (en) | Determining, managing and deploying an application topology in a virtual environment | |
| CN104267980A (en) | Software score display method, terminal, data server and system | |
| CN104793982A (en) | Method and device for establishing virtual machine | |
| CN104468288A (en) | Terminal network data testing method and device | |
| CN112181522A (en) | Data processing method and device and electronic equipment | |
| CN108023905B (en) | Internet of things application system and method | |
| CN105426544B (en) | Method and device for monitoring database state | |
| CN105323748A (en) | Testing error uploading method and device | |
| CN104216820A (en) | Browser performance testing method and device and server | |
| CN105516745A (en) | Terminal upgrading method and device | |
| CN108881345A (en) | Information push method and routing device | |
| CN107704201B (en) | Data storage processing method and device | |
| CN105487925A (en) | Data scanning method and device | |
| CN113535020B (en) | Method, apparatus, device, medium and product for generating application icons |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20191204 Address after: 100085 Beijing City, Haidian District Road 33, two floor East Xiaoying Patentee after: BEIJING KINGSOFT INTERNET SECURITY SOFTWARE Co.,Ltd. Address before: 519000, No. 10, main building, No. 6, science Road, Harbour Road, Tang Wan Town, Guangdong, Zhuhai, 601F Patentee before: Zhuhai Juntian Electronic Technology Co.,Ltd. |
|
| TR01 | Transfer of patent right |