CN103246600B - Software test and appraisal fast calibration method - Google Patents
Software test and appraisal fast calibration method Download PDFInfo
- Publication number
- CN103246600B CN103246600B CN201210029420.3A CN201210029420A CN103246600B CN 103246600 B CN103246600 B CN 103246600B CN 201210029420 A CN201210029420 A CN 201210029420A CN 103246600 B CN103246600 B CN 103246600B
- Authority
- CN
- China
- Prior art keywords
- test
- code
- sut
- coverage rate
- differentiation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention discloses a kind of software test and appraisal fast calibration method, comprising: during regression test, collect the coverage rate information of test code in system under test (SUT), statistics generates test coverage form; Differentiation in system under test (SUT) described in comparison between last version and a rear version, generates differentiation result; Test coverage form described in comparison and differentiation result, judge whether described regression test covers difference section.Adopt the present invention, the test coverage of system under test (SUT) can be checked rapidly, facilitate test man to supplement test case targetedly, guarantee the covering completely of code.
Description
Technical field
The present invention relates to field of computer technology, particularly relate to a kind of software test and appraisal fast calibration method.
Background technology
At present, the paces of informatization are accelerated gradually, information-based also more and more extensive in the application of industry, the business support system relevant to industry and platform are scale, complicated development trend, this is also more and more higher to the quality requirements of corresponding software, therefore require also more and more higher to the ways and means of software quality assurance, enterprise is expanding gradually along with the scope of security information construction and the degree of depth, in succession set up software test and appraisal laboratory, perform the test job of each application software, become the information-based determination and evaluation center of authority in system, informationalized high speed development is played to the effect escort.
Wherein, fast test be one comprehensively, the programme area of system, be also key one ring performing test job, test man can realize the test of " getting twice the result with half the effort " by multiple technologies and automatic test means simultaneously.In quick test process, carry out distributed automatically performing by quick generating test use case, thus can the process of accelerated test, promote test speed, complete test assignment fast, efficiently to assist client.
But when system requirements change, the association test macro function affected by it need be verified again; When newly-increased system requirements, the association test macro function affected by it need be verified again; When the beta version again sending out new after defect correction is verified, again need verify defective effect correlation function; When testing requirement changes (increase, change), again need verify having the function of business association; When test case changes (increase, change), again need verify having the function of business association.The test that this various reasons result in part needs to re-start, but after the part needing to retest completes, test man but cannot check the test coverage of system under test (SUT) rapidly, be difficult to supplement test case targetedly, the covering completely of code cannot be guaranteed, result in the generation of defect.
Summary of the invention
Technical matters to be solved by this invention is, provides a kind of software test and appraisal fast calibration method, can check the test coverage of system under test (SUT) rapidly, facilitate test man to supplement test case targetedly, guarantee the covering completely of code.
In order to solve the problems of the technologies described above, the invention provides a kind of software test and appraisal fast calibration method, comprising: during regression test, collect the coverage rate information of test code in system under test (SUT), statistics generates test coverage form; Differentiation in system under test (SUT) described in comparison between last version and a rear version, generates differentiation result; Test coverage form described in comparison and differentiation result, judge whether described regression test covers difference section.
As the improvement of such scheme, the method of the differentiation in system under test (SUT) described in described comparison between last version and a rear version comprises: judge described system under test (SUT) whether source code, when being judged as YES, last version source code and a rear version source code are contrasted, find out the differentiation between described last version and a rear version, when being judged as NO, collect the differentiation in described system under test (SUT) between last version and a rear version by code differentiation compare tool.
As the improvement of such scheme, in described collection system under test (SUT), the method for the coverage rate information of test code comprises: set up test code coverage rate task, and described test code coverage rate task comprises task names, binary file URL, Starting Executing Time, remark information; Set up described test code coverage rate task and regression tested incidence relation; Starting Executing Time according to described test code coverage rate task performs described regression test; The coverage rate information of test code in regression test process described in Real-time Obtaining.
As the improvement of such scheme, in described collection system under test (SUT), the method for the coverage rate information of test code also comprises: generate reports on the implementation according to the coverage rate information of test code in described regression test process, and described reports on the implementation comprise the report of whole project level, package level report, class hierarchy report.
Implement beneficial effect of the present invention to be: when performing regression test, collect test code coverage rate information, statistics generates test coverage form.Reported by coverage rate, test man therefrom finds and repairs some defects hidden.In addition, by the comparison between two versions, find out the differentiation of last version and a rear version, the result of statistical difference alienation, show the part of differentiation.Then, go to verify whether this regression test covers the part of this edition difference by test coverage form, thus express-analysis code is to the coverage of test case, supplements test case targetedly and ensure test code coverage rate.
Accompanying drawing explanation
Fig. 1 is the first embodiment schematic flow sheet of software of the present invention test and appraisal fast calibration method;
Fig. 2 is the second embodiment schematic flow sheet of software of the present invention test and appraisal fast calibration method;
Fig. 3 is the 3rd embodiment schematic flow sheet of software of the present invention test and appraisal fast calibration method.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with accompanying drawing, the present invention is described in further detail.
Fig. 1 is the first embodiment schematic flow sheet of software of the present invention test and appraisal fast calibration method, comprising:
S100, collects the coverage rate information of test code in system under test (SUT), and statistics generates test coverage form.
It should be noted that, namely test code coverage rate carrys out the level of coverage of constant code by test.
When performing regression test, test man uses test coverage instrument of increasing income automatically to collect test code coverage rate information, and statistics generates test coverage form, is reported by coverage rate, finds and repairs some defects hidden.
S101, the differentiation in system under test (SUT) described in comparison between last version and a rear version, generates differentiation result.
By the differentiation of last version and a rear version can be found out to the comparison between two versions, the result of statistical difference alienation, show the part of differentiation.
S102, test coverage form described in comparison and differentiation result, judge whether described regression test covers difference section.
Rapid verification result is that the result by adding up test code coverage rate goes to verify whether this regression test covers the difference section of this version, thus makes test man supplement test case guarantee test code coverage rate targetedly.
When performing regression test, the test coverage form that statistics generates by test man and differentiation result compare, and judge whether described regression test covers difference section.When comparison go out described regression test completely cover difference section time, test man for for be capped difference section supplement test case, guarantee the covering completely of code.
Fig. 2 is the second embodiment schematic flow sheet of software of the present invention test and appraisal fast calibration method, comprising:
S200, collects the coverage rate information of test code in system under test (SUT), and statistics generates test coverage form.
It should be noted that, namely test code coverage rate carrys out the level of coverage of constant code by test.
When performing regression test, test man uses test coverage instrument of increasing income automatically to collect test code coverage rate information, and statistics generates test coverage form, is reported by coverage rate, finds and repairs some defects hidden.
S201, judges described system under test (SUT) whether source code.
It should be noted that, rapid verification is divided into system under test (SUT) source code and system under test (SUT) not to have source code two kinds of scenes.
When judging described system under test (SUT) source code, last version source code and a rear version source code being contrasted, finds out the differentiation between described last version and a rear version.
When judging that described system under test (SUT) does not have source code, collect the differentiation in described system under test (SUT) between last version and a rear version by code differentiation compare tool.
S202, generates differentiation result.
Differentiation between described last version and a rear version is added up into the result of differentiation, show the part of differentiation.
S203, test coverage form described in comparison and differentiation result, judge whether described regression test covers difference section.
Rapid verification result is that the result by adding up test code coverage rate goes to verify whether this regression test covers the difference section of this version, thus makes test man supplement test case guarantee test code coverage rate targetedly.
As from the foregoing, when system under test (SUT) source code, undertaken contrasting the differentiation found out between them by the source code of last version source code and current version, based on the coverage rate analysis of code, automatically collect the coverage rate of code when performing regression test, whether the coverage rate of this regression test code of comparison comprises difference section, supplements test case targetedly according to comparison result, guarantee the covering completely of code, and then guarantee test coverage.When system under test (SUT) does not have source code, collect test coverage by performing regression test, collected the result of differentiation by code differentiation compare tool, test man supplements test case targetedly according to comparison result, guarantee the covering completely of code, and then guarantee test coverage.
Fig. 3 is the 3rd embodiment schematic flow sheet of software of the present invention test and appraisal fast calibration method, comprising:
S300, sets up test code coverage rate task.
Described test code coverage rate task comprises task names, binary file URL, Starting Executing Time, remark information.
S301, sets up described test code coverage rate task and regression tested incidence relation.
S302, the Starting Executing Time according to described test code coverage rate task performs described regression test.
S303, the coverage rate information of test code in regression test process described in Real-time Obtaining.
It should be noted that, when performing regression test, test man uses test coverage instrument of increasing income automatically to collect test code coverage rate information.
S304, statistics generates test coverage form.
Test man is reported by coverage rate, can find and the defect that in repair system, some are hidden, further ensure the quality of system under test (SUT).
More preferably, also can generate reports on the implementation according to the coverage rate information of test code in described regression test process, described reports on the implementation comprise the report of whole project level, package level report, class hierarchy report, so that test man carries out test tracking.
S305, judges described system under test (SUT) whether source code.
It should be noted that, rapid verification is divided into system under test (SUT) source code and system under test (SUT) not to have source code two kinds of scenes.
When judging described system under test (SUT) source code, last version source code and a rear version source code being contrasted, finds out the differentiation between described last version and a rear version.In comparison process, test man needs selection two to need the source code version of comparison, and sets up the incidence relation between comparison and regression test.
When judging that described system under test (SUT) does not have source code, collect the differentiation in described system under test (SUT) between last version and a rear version by code differentiation compare tool.
S306, generates differentiation result.
Differentiation between described last version and a rear version is added up into differentiation result, shows the part of differentiation.
It should be noted that, when system under test (SUT) source code, differentiation result can trace back to concrete source code, can show the otherness between source code.
S307, test coverage form described in comparison and differentiation result, judge whether described regression test covers difference section.
Rapid verification result is that the result by adding up test code coverage rate goes to verify whether this regression test covers the difference section of this version, thus makes test man supplement test case guarantee test code coverage rate targetedly.
As from the foregoing, test man sets up test code coverage rate task according to the actual requirements, and builds described test code coverage rate task and regression tested incidence relation.When performing regression test, test man uses test coverage instrument of increasing income automatically to collect test code coverage rate information and statistics generates test coverage form, test man is reported by coverage rate, can find and the defect that in repair system, some are hidden, further ensure the quality of system under test (SUT).When system under test (SUT) source code, undertaken contrasting the differentiation found out between them by the source code of last version source code and current version, whether the coverage rate of this regression test code of comparison comprises difference section, test case is supplemented targetedly according to comparison result, guarantee the covering completely of code, and then guarantee test coverage.When system under test (SUT) does not have source code, collected the result of differentiation by code differentiation compare tool, test man supplements test case targetedly according to comparison result, guarantees the covering completely of code, and then guarantees test coverage.
The above is the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications are also considered as protection scope of the present invention.
Claims (2)
1. a software test and appraisal fast calibration method, is characterized in that, comprising:
During regression test, collect the coverage rate information of test code in system under test (SUT), statistics generates test coverage form;
Differentiation in system under test (SUT) described in comparison between last version and a rear version, generates differentiation result;
Test coverage form described in comparison and differentiation result, judge whether described regression test covers difference section;
In described collection system under test (SUT), the method for the coverage rate information of test code comprises:
Set up test code coverage rate task, described test code coverage rate task comprises task names, binary file URL, Starting Executing Time, remark information;
Set up described test code coverage rate task and regression tested incidence relation;
Starting Executing Time according to described test code coverage rate task performs described regression test;
The coverage rate information of test code in regression test process described in Real-time Obtaining;
In described collection system under test (SUT), the method for the coverage rate information of test code also comprises: generate reports on the implementation according to the coverage rate information of test code in described regression test process, and described reports on the implementation comprise the report of whole project level, package level report, class hierarchy report.
2. software test and appraisal fast calibration method as claimed in claim 1, it is characterized in that, the method for the differentiation in system under test (SUT) described in described comparison between last version and a rear version comprises:
Judge described system under test (SUT) whether source code,
When being judged as YES, last version source code and a rear version source code being contrasted, find out the differentiation between described last version and a rear version,
When being judged as NO, collect the differentiation in described system under test (SUT) between last version and a rear version by code differentiation compare tool.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210029420.3A CN103246600B (en) | 2012-02-10 | 2012-02-10 | Software test and appraisal fast calibration method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210029420.3A CN103246600B (en) | 2012-02-10 | 2012-02-10 | Software test and appraisal fast calibration method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103246600A CN103246600A (en) | 2013-08-14 |
| CN103246600B true CN103246600B (en) | 2016-04-06 |
Family
ID=48926130
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210029420.3A Active CN103246600B (en) | 2012-02-10 | 2012-02-10 | Software test and appraisal fast calibration method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103246600B (en) |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103605603B (en) * | 2013-10-12 | 2016-03-02 | 南京大学 | Cover the method and system of table yojan |
| CN104572433B (en) * | 2013-10-29 | 2017-09-29 | 中国银联股份有限公司 | A kind of financial information system method of testing and device |
| CN104714882B (en) * | 2013-12-17 | 2018-11-23 | 腾讯科技（深圳）有限公司 | The method and device of code information processing |
| US9405662B2 (en) * | 2013-12-18 | 2016-08-02 | Google Inc. | Process for displaying test coverage data during code reviews |
| CN104077227B (en) * | 2014-07-08 | 2017-01-04 | 大连海事大学 | The evaluation system of a kind of program source code based on B/S framework and method |
| CN105988926B (en) * | 2015-02-13 | 2019-06-07 | 腾讯科技（深圳）有限公司 | The treating method and apparatus of multi version test data |
| CN106155890A (en) * | 2015-04-02 | 2016-11-23 | 深圳市腾讯计算机系统有限公司 | platform test method and system |
| CN105959678B (en) * | 2016-04-20 | 2018-04-10 | 杭州当虹科技有限公司 | A kind of efficient regression testing method based on the detection of audio/video decoder hash characteristic values |
| CN105975924A (en) * | 2016-04-29 | 2016-09-28 | 杭州当虹科技有限公司 | Regression testing method for precisely recognizing ad content based on video frame statistics |
| CN106326120B (en) * | 2016-08-22 | 2019-07-05 | 北京金山安全软件有限公司 | Regression testing method and device for application software and electronic equipment |
| CN106886492A (en) * | 2017-02-13 | 2017-06-23 | 北京趣拿软件科技有限公司 | Method of testing and test device based on data readback |
| CN106897217A (en) * | 2017-02-13 | 2017-06-27 | 北京趣拿软件科技有限公司 | Method of testing and test device |
| CN109426604A (en) * | 2017-08-22 | 2019-03-05 | 阿里巴巴集团控股有限公司 | The monitoring method and equipment of code development |
| CN108415825B (en) * | 2017-10-27 | 2021-01-19 | 平安科技（深圳）有限公司 | Electronic device, test method, and storage medium |
| CN109254918A (en) * | 2018-08-31 | 2019-01-22 | 重庆富民银行股份有限公司 | Code tester system based on path difference |
| CN109144878A (en) * | 2018-08-31 | 2019-01-04 | 重庆富民银行股份有限公司 | Code test method based on path difference |
| CN109542761B (en) * | 2018-10-11 | 2022-03-11 | 平安科技（深圳）有限公司 | Software quality evaluation method, device and storage medium |
| CN111026665B (en) * | 2019-12-09 | 2023-02-28 | 建信金融科技有限责任公司 | Test range analysis method, device and equipment |
| CN111209206A (en) * | 2020-01-13 | 2020-05-29 | 卡斯柯信号(北京)有限公司 | Automatic test method and system for software product |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1873625A (en) * | 2005-08-19 | 2006-12-06 | 华为技术有限公司 | Method for automatic generating random excitation based on percentage of function coverage |
| CN102063374A (en) * | 2011-01-07 | 2011-05-18 | 南京大学 | Method for selecting regression test case for clustering with semi-supervised information |
| CN102521700A (en) * | 2011-12-13 | 2012-06-27 | 广东电网公司信息中心 | Electrical network informatization evaluation rapid test system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101019210B1 (en) * | 2007-04-25 | 2011-03-04 | 이화여자대학교 산학협력단 | Test Device of Embedded Software using the emulator and Method thereof |
-
2012
- 2012-02-10 CN CN201210029420.3A patent/CN103246600B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1873625A (en) * | 2005-08-19 | 2006-12-06 | 华为技术有限公司 | Method for automatic generating random excitation based on percentage of function coverage |
| CN102063374A (en) * | 2011-01-07 | 2011-05-18 | 南京大学 | Method for selecting regression test case for clustering with semi-supervised information |
| CN102521700A (en) * | 2011-12-13 | 2012-06-27 | 广东电网公司信息中心 | Electrical network informatization evaluation rapid test system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103246600A (en) | 2013-08-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103246600B (en) | Software test and appraisal fast calibration method | |
| Krishnamoorthi et al. | Factor oriented requirement coverage based system test case prioritization of new and regression test cases | |
| US20090070734A1 (en) | Systems and methods for monitoring software application quality | |
| CN102521700A (en) | Electrical network informatization evaluation rapid test system | |
| Gao et al. | A component testability model for verification and measurement | |
| CN103257917A (en) | Management method for software evaluation system | |
| CN103257918A (en) | Project test procedure management method based on software testing and evaluation platform | |
| CN101944059A (en) | Automatic analysis method and device of crash information of computer software | |
| CN102346709A (en) | Software development assisting method and system | |
| CN106776338B (en) | Test method, test device and server | |
| CN104424093A (en) | Compatibility testing method and system | |
| CN104077217A (en) | Method and system for compiling and issuing code file | |
| CN103699385A (en) | Continuous code integration method | |
| CN104268310A (en) | Method for calling UVM verification environment through special graphical interface | |
| Le et al. | Architectural-based speculative analysis to predict bugs in a software system | |
| CN112346987A (en) | Test case generation and conversion method and system based on Xmind | |
| CN110908915B (en) | Test coverage rate display method and device and computer system | |
| CN103324572B (en) | The operating system performance method of testing of electric power secondary system and device | |
| CN106874290B (en) | Data cleaning method and equipment | |
| CN109508204B (en) | Front-end code quality detection method and device | |
| CN110888809B (en) | Risk prediction method and device for test task | |
| Zimmerman et al. | Toward instant gradeification | |
| CN114331165A (en) | Automatic generation and analysis method and system for urban safety performance evaluation report | |
| Mamatha et al. | A literature review on automated code repair | |
| CN112445518A (en) | Management method, device and equipment of version release platform and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |