CN104375937A - Continuous integration method and system of automated testing results - Google Patents
Continuous integration method and system of automated testing results Download PDFInfo
- Publication number
- CN104375937A CN104375937A CN201410664985.8A CN201410664985A CN104375937A CN 104375937 A CN104375937 A CN 104375937A CN 201410664985 A CN201410664985 A CN 201410664985A CN 104375937 A CN104375937 A CN 104375937A
- Authority
- CN
- China
- Prior art keywords
- test
- test result
- project
- jmeter
- jenkins
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention provides a continuous integration method of automated testing results. The method includes the steps that automated testing script is compiled, a project is tested, and testing results are generated; after testing, all the testing results are collected and stored under a specified path; loading testing is performed from the specified path, and a testing report is generated. The invention further provides a continuous integration system of the automated testing results. The automated testing results are stored in a continuous integration, continuous display of the testing results is performed, so the testing results can be analyzed more easily, and the robustness of a program is improved.
Description
Technical field
The present invention relates to a kind of automatic test result continuous integrating integration method and system.
Background technology
Automatic test is a kind of process being converted into machine execution with the behavioral test artificially driven.Perform test by tester step by step according to the code described in test case, obtain comparing of actual result and expected result.In the process, in order to save manpower, time or hardware resource, improving testing efficiency, just introducing the concept of automatic test.
Along with the develop rapidly of infotech, the scale of software product is also more and more huger, to the needs of traditional-handwork test process more and more inadaptable development.Introduce improving one's methods of software test one automatically to test, along with automatic test progressively develops, the result of automatic test is preserved and automatic test result can continuous presentation, developer is allowed to find out performance bottleneck from test result, become the emphasis of guarantee procedure robustness, as follows for existing patent analyses:
1, automatic test does not continue to integrate, and as patent 201010579450.2, uses automatic test script, Measurement results, but does not store automatic test result, bring inconvenience to later stage continual analysis test result
2, adopt database purchase test log or test script, as patent 200910084360.3, usage log database preserves test log, user can only search in database, unfavorable extraction test result, compares test result before, can not intuitively embody lasting test result.
3, conventional persistence integration tool, possesses integration testing result function, as patent 200810065388.8, use continuous integrating and automatic test software, can keep test result, this flow process is initiated by continuous integrating software, notice automatic test software performs automatic test saving result, but initiate automatic test for by automatic test software, preserve test result and analyze to continuous integrating software, there is no improving method.
Summary of the invention
The technical problem to be solved in the present invention, be to provide a kind of automatic test result continuous integrating integration method and system, automatic test result is saved in continuous integrating, and the continuous presentation of test result is provided, make easier analytical test result improve Procedure Haleness.
The present invention is achieved in that a kind of automatic test result continuous integrating integration method, comprises the steps:
Step 1, write automatic test script, project is tested, and generates test result;
Step 2, to be tested after, all test results to be gathered, and stored under specified path;
Step 3, loading test from specified path, and generate test report.
Further, described step 1 is specially further:
Jenkins sets up a project, and entry item information and Jmeter plug-in unit need the test result path loaded in engineering installation, write automatic test script, call Jmeter testing tool and test project, and generate test result.
Further, describedly test is carried out to project at least one testing server, project is tested.
Further, described step 2 is specially further:
After to be tested, Jmeter collects all test results and gathers, under the test result after gathering is deposited into specified path.
Further, described step 3 is specially further:
The api provided with Jenkins notifies that Jenkins compiles engineering, and Jenkins can go to the path of specifying to load test result by triggering Jmeter plug-in unit automatically, and display generates test report.
The present invention's two is achieved in that and it is characterized in that the system that a kind of automatic test result continuous integrating is integrated: comprise as lower module:
Test module, writes automatic test script, tests project, and generates test result;
Summarizing module, after to be tested, gathers all test results, and stored under specified path;
Generate test report module, from specified path, load test, and generate test report.
Further, described test module is specially further:
Jenkins sets up a project, and entry item information and Jmeter plug-in unit need the test result path loaded in engineering installation, write automatic test script, call Jmeter testing tool and test project, and generate test result.
Further, describedly test is carried out to project at least one testing server, project is tested.
Further, described summarizing module is specially further:
After to be tested, Jmeter collects all test results and gathers, under the test result after gathering is deposited into specified path.
Further, described generation test report module is specially further:
The api provided with Jenkins notifies that Jenkins compiles engineering, and Jenkins can go to the path of specifying to load test result by triggering Jmeter plug-in unit automatically, and display generates test report.
Tool of the present invention has the following advantages: a kind of automatic test result continuous integrating integration method of the present invention and system, use Jmeter automated test tool and Jenkins continuous integrating software, automatic test result can be solved preferably preserve and continuous integrating energy continuous presentation automatic test result, realize can facilitating contrast test result at any time, from test result contrast, find out the defect of program and improve Procedure Haleness.
Accompanying drawing explanation
The present invention is further illustrated in conjunction with the embodiments with reference to the accompanying drawings.
Fig. 1 is flowchart of the present invention.
Embodiment
Automatic test result continuous integrating integration method, comprises the steps:
Step 1, on Jenkins, set up a project, and entry item information and Jmeter plug-in unit need the test result path loaded in engineering installation, write automatic test script, call Jmeter testing tool to test project, and generate test result, describedly test is carried out to project at least one testing server, project is tested;
Step 2, to be tested after, Jmeter collects all test results and gathers, under the test result after gathering is deposited into specified path;
Step 3, the api notice Jenkins compiling engineering provided with Jenkins, Jenkins meeting triggers the path loading test result that Jmeter plug-in unit go to specify automatically, and shows generation test report.
The system that automatic test result continuous integrating of the present invention is integrated, comprises as lower module:
Test module, Jenkins sets up a project, and entry item information and Jmeter plug-in unit need the test result path loaded in engineering installation, write automatic test script, call Jmeter testing tool to test project, and generate test result, describedly test is carried out to project at least one testing server, project is tested;
Summarizing module, after to be tested, Jmeter collects all test results and gathers, under the test result after gathering is deposited into specified path;
Generate test report module, the api provided with Jenkins notifies that Jenkins compiles engineering, and Jenkins can go to the path of specifying to load test result by the automatic Jmeter of triggering plug-in unit, and display generates test report.
Wherein, Jmeter is a kind of pressure test instrument, Jenkins is a kind of continuous integrating software, Jemter is mainly used in for doing pressure test to software, it is designed to Web application testing at first but expanded to other field tests afterwards, the foundation stone that Jenkins continuous integrating (Continuous integration) is programmed as agility is extensively adopted by industry now, and Jenkins Jmeter plug-in unit can show Jmeter pressure testing results.
Specific embodiment one:
As shown in Figure 1, Jenkins sets up a project, in engineering installation, entry item information and Jmeter plug-in unit need the test result path loaded;
User writes automatic test script, calls automatic test engine (i.e. Jmeter pressure test instrument) and does pressure test to program feature;
Jmeter can perform pressure tests of some row and collect the test result that each testing server (as: testing server A, testing server B) produces, gather, can concurrent multiple stage testing server, be completed, Jmeter can automatically collect the result of test and gather, and test result is copied to specified path;
Call the api that Jenkins provides, notice Jenkins compiles engineering, and Jenkins can go to the path of specifying load test result and generate test report by triggering Jmeter plug-in unit automatically.
Tool of the present invention has the following advantages: a kind of automatic test result continuous integrating integration method of the present invention and system, use Jmeter automated test tool and Jenkins continuous integrating software, automatic test result can be solved preferably preserve and continuous integrating energy continuous presentation automatic test result (namely all test results obtained of testing all can be displayed), realize can facilitating contrast test result at any time, from test result contrast, find out the defect of program and improve Procedure Haleness.
Although the foregoing describe the specific embodiment of the present invention; but be familiar with those skilled in the art to be to be understood that; specific embodiment described by us is illustrative; instead of for the restriction to scope of the present invention; those of ordinary skill in the art, in the modification of the equivalence done according to spirit of the present invention and change, should be encompassed in scope that claim of the present invention protects.
Claims (10)
1. an automatic test result continuous integrating integration method, is characterized in that: comprise the steps:
Step 1, write automatic test script, project is tested, and generates test result;
Step 2, to be tested after, all test results to be gathered, and stored under specified path;
Step 3, loading test from specified path, and generate test report.
2. a kind of automatic test result continuous integrating integration method according to claim 1, is characterized in that: described step 1 is specially further:
Jenkins sets up a project, and entry item information and Jmeter plug-in unit need the test result path loaded in engineering installation; Write automatic test script, call Jmeter testing tool and project is tested, and generate test result.
3. a kind of automatic test result continuous integrating integration method according to claim 1 and 2, is characterized in that: describedly carry out test to project and test project at least one testing server.
4. a kind of automatic test result continuous integrating integration method according to claim 2, is characterized in that: described step 2 is specially further:
After to be tested, Jmeter collects all test results and gathers, under the test result after gathering is deposited into specified path.
5. a kind of automatic test result continuous integrating integration method according to claim 4, is characterized in that: described step 3 is specially further:
The api provided with Jenkins notifies that Jenkins compiles engineering, and Jenkins can go to the path of specifying to load test result by triggering Jmeter plug-in unit automatically, and the test report that display generates.
6. an automatic test result continuous integrating integration system, is characterized in that: comprise as lower module:
Test module, writes automatic test script, tests project, and generates test result;
Summarizing module, after to be tested, gathers all test results, and stored under specified path;
Generate test report module, from specified path, load test, and generate test report.
7. a kind of automatic test result continuous integrating integration system according to claim 6, is characterized in that: described test module is specially further:
Jenkins sets up a project, and entry item information and Jmeter plug-in unit need the test result path loaded in engineering installation; Write automatic test script, call Jmeter testing tool and project is tested, and generate test result.
8. a kind of automatic test result continuous integrating integration system according to claim 6 or 7, is characterized in that: describedly carry out test to project and test project at least one testing server.
9. a kind of automatic test result continuous integrating integration system according to claim 7, is characterized in that: described summarizing module is specially further:
After to be tested, Jmeter collects all test results and gathers, under the test result after gathering is deposited into specified path.
10. a kind of automatic test result continuous integrating integration system according to claim 9, is characterized in that: described generation test report module is specially further:
The api provided with Jenkins notifies that Jenkins compiles engineering, and Jenkins can go to the path of specifying to load test result by triggering Jmeter plug-in unit automatically, and the test report that display generates.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410664985.8A CN104375937A (en) | 2014-11-19 | 2014-11-19 | Continuous integration method and system of automated testing results |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410664985.8A CN104375937A (en) | 2014-11-19 | 2014-11-19 | Continuous integration method and system of automated testing results |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104375937A true CN104375937A (en) | 2015-02-25 |
Family
ID=52554872
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410664985.8A Pending CN104375937A (en) | 2014-11-19 | 2014-11-19 | Continuous integration method and system of automated testing results |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104375937A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106357466A (en) * | 2016-11-10 | 2017-01-25 | 福州智永信息科技有限公司 | Monitoring method for internet products and monitoring system |
| CN106383786A (en) * | 2016-09-27 | 2017-02-08 | 北京金山安全软件有限公司 | Interface pressure performance testing method and device and electronic equipment |
| CN106603260A (en) * | 2015-10-19 | 2017-04-26 | 北京京东尚科信息技术有限公司 | WCF service test method |
| CN107038120A (en) * | 2017-05-25 | 2017-08-11 | 北京云测信息技术有限公司 | A kind of method for testing software and equipment |
| CN107092559A (en) * | 2017-04-18 | 2017-08-25 | 携程旅游信息技术（上海）有限公司 | Test platform middleware, test system and method based on Jmeter |
| CN107832212A (en) * | 2017-11-02 | 2018-03-23 | 浪潮软件集团有限公司 | Automatic testing method and device, readable medium and storage controller |
| CN108415847A (en) * | 2018-05-08 | 2018-08-17 | 平安普惠企业管理有限公司 | Performance test methods, device, computer equipment and storage medium |
| CN109344076A (en) * | 2018-10-22 | 2019-02-15 | 浙江执御信息技术有限公司 | A kind of automatic interface testing method and its device based on JMeter and Jenkins |
| CN109960649A (en) * | 2017-12-26 | 2019-07-02 | 航天信息股份有限公司 | Automatization test system |
| CN111090436A (en) * | 2019-12-22 | 2020-05-01 | 苏州浪潮智能科技有限公司 | Jenkins compiling result summarizing method, device and equipment |
| CN111639036A (en) * | 2020-06-08 | 2020-09-08 | 成都信息工程大学 | Continuous integration test development method and system based on AI test |
| CN114995897A (en) * | 2022-05-07 | 2022-09-02 | 远光软件股份有限公司 | Method, device, storage medium and computer equipment for acquiring running result of continuous integration tool |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| RU2004120020A (en) * | 2004-06-30 | 2006-01-10 | Борис Дмитриевич Жидких (RU) | METHOD FOR DIAGNOSIS OF THE CORONARY TYPE OF PERSONALITY |
| CN102567186A (en) * | 2010-12-08 | 2012-07-11 | 上海杉达学院 | Automated software testing method |
| CN103023967A (en) * | 2012-11-15 | 2013-04-03 | 武汉邮电科学研究院 | Cloud computing simulation system and method based on simics system simulator |
| CN103412816A (en) * | 2013-08-12 | 2013-11-27 | 浪潮电子信息产业股份有限公司 | Linux-based continuous integration test platform building method |
| CN103577907A (en) * | 2012-07-24 | 2014-02-12 | 阿里巴巴集团控股有限公司 | Continuous integration testing method and system |
| CN104035938A (en) * | 2013-03-07 | 2014-09-10 | 阿里巴巴集团控股有限公司 | Performance continuous integration data processing method and device |
-
2014
- 2014-11-19 CN CN201410664985.8A patent/CN104375937A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| RU2004120020A (en) * | 2004-06-30 | 2006-01-10 | Борис Дмитриевич Жидких (RU) | METHOD FOR DIAGNOSIS OF THE CORONARY TYPE OF PERSONALITY |
| CN102567186A (en) * | 2010-12-08 | 2012-07-11 | 上海杉达学院 | Automated software testing method |
| CN103577907A (en) * | 2012-07-24 | 2014-02-12 | 阿里巴巴集团控股有限公司 | Continuous integration testing method and system |
| CN103023967A (en) * | 2012-11-15 | 2013-04-03 | 武汉邮电科学研究院 | Cloud computing simulation system and method based on simics system simulator |
| CN104035938A (en) * | 2013-03-07 | 2014-09-10 | 阿里巴巴集团控股有限公司 | Performance continuous integration data processing method and device |
| CN103412816A (en) * | 2013-08-12 | 2013-11-27 | 浪潮电子信息产业股份有限公司 | Linux-based continuous integration test platform building method |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106603260A (en) * | 2015-10-19 | 2017-04-26 | 北京京东尚科信息技术有限公司 | WCF service test method |
| CN106383786B (en) * | 2016-09-27 | 2019-05-17 | 北京金山安全软件有限公司 | Interface pressure performance testing method and device and electronic equipment |
| CN106383786A (en) * | 2016-09-27 | 2017-02-08 | 北京金山安全软件有限公司 | Interface pressure performance testing method and device and electronic equipment |
| CN106357466A (en) * | 2016-11-10 | 2017-01-25 | 福州智永信息科技有限公司 | Monitoring method for internet products and monitoring system |
| CN106357466B (en) * | 2016-11-10 | 2019-06-21 | 福州智永信息科技有限公司 | A kind of internet product monitoring method and monitoring system |
| CN107092559A (en) * | 2017-04-18 | 2017-08-25 | 携程旅游信息技术（上海）有限公司 | Test platform middleware, test system and method based on Jmeter |
| CN107038120A (en) * | 2017-05-25 | 2017-08-11 | 北京云测信息技术有限公司 | A kind of method for testing software and equipment |
| CN107038120B (en) * | 2017-05-25 | 2020-05-29 | 北京云测信息技术有限公司 | Software testing method and device |
| CN107832212A (en) * | 2017-11-02 | 2018-03-23 | 浪潮软件集团有限公司 | Automatic testing method and device, readable medium and storage controller |
| CN109960649A (en) * | 2017-12-26 | 2019-07-02 | 航天信息股份有限公司 | Automatization test system |
| CN108415847A (en) * | 2018-05-08 | 2018-08-17 | 平安普惠企业管理有限公司 | Performance test methods, device, computer equipment and storage medium |
| CN109344076A (en) * | 2018-10-22 | 2019-02-15 | 浙江执御信息技术有限公司 | A kind of automatic interface testing method and its device based on JMeter and Jenkins |
| CN111090436A (en) * | 2019-12-22 | 2020-05-01 | 苏州浪潮智能科技有限公司 | Jenkins compiling result summarizing method, device and equipment |
| CN111639036A (en) * | 2020-06-08 | 2020-09-08 | 成都信息工程大学 | Continuous integration test development method and system based on AI test |
| CN114995897A (en) * | 2022-05-07 | 2022-09-02 | 远光软件股份有限公司 | Method, device, storage medium and computer equipment for acquiring running result of continuous integration tool |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104375937A (en) | Continuous integration method and system of automated testing results | |
| Li et al. | ATOM: Automatic maintenance of GUI test scripts for evolving mobile applications | |
| US9183123B2 (en) | Performance tests in a continuous deployment pipeline | |
| US20100138811A1 (en) | Dynamic Performance Profiling | |
| CN106708718B (en) | Service framework interface test method and device | |
| CN103425574A (en) | Method and device for testing applications | |
| KR20120121950A (en) | Application Graphic User Interface Test Automation System and Method Thereof | |
| CN106326067A (en) | Method and device for monitoring CPU (central processing unit) performance under pressure test | |
| CN108415830A (en) | A kind of generation method and device of software test case | |
| CN105068921A (en) | App comparative analysis based Android application store credibility evaluation method | |
| US20130179867A1 (en) | Program Code Analysis System | |
| CN103186463B (en) | Determine the method and system of the test specification of software | |
| CN104133771A (en) | Testing method and device | |
| CN103019942A (en) | Method and system for automatically testing applications to be tested based on android system | |
| CN113342685A (en) | Precise test method and device, computer equipment and storage medium | |
| CN105183658A (en) | Software code testing method and device | |
| US9734042B1 (en) | System, method, and computer program for automated parameterized software testing | |
| Li et al. | Androct: ten years of app call traces in android | |
| CN105279092A (en) | Software testing method and apparatus | |
| US20190354468A1 (en) | Code coverage module with testing function identifier | |
| US10073764B1 (en) | Method for instruction sequence execution analysis and visualization | |
| CN103064780B (en) | A kind of method of software test and device | |
| CN106528429A (en) | UI testing method and device | |
| CN104123397A (en) | Automatic test device and method for Web page | |
| Peters et al. | How does migrating to kotlin impact the run-time efficiency of android apps? |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150225 |