CN103246600A - Fast verification method for software testing and evaluation - Google Patents

Fast verification method for software testing and evaluation Download PDF

Info

Publication number
CN103246600A
CN103246600A CN2012100294203A CN201210029420A CN103246600A CN 103246600 A CN103246600 A CN 103246600A CN 2012100294203 A CN2012100294203 A CN 2012100294203A CN 201210029420 A CN201210029420 A CN 201210029420A CN 103246600 A CN103246600 A CN 103246600A
Authority
CN
China
Prior art keywords
test
code
coverage rate
version
differentiation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012100294203A
Other languages
Chinese (zh)
Other versions
CN103246600B (en
Inventor
黄威
瞿洪彪
邓竹青
张�林
黄颖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BN Co
Original Assignee
BN Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BN Co filed Critical BN Co
Priority to CN201210029420.3A priority Critical patent/CN103246600B/en
Publication of CN103246600A publication Critical patent/CN103246600A/en
Application granted granted Critical
Publication of CN103246600B publication Critical patent/CN103246600B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Debugging And Monitoring (AREA)
  • Stored Programmes (AREA)

Abstract

The invention discloses a fast verification method for software testing and evaluation. The method comprises during the regression test, collecting information of the coverage rate of test codes in a tested system, and calculating to generate a test coverage rate report; comparing differentiation between a prior version and a later version to generate a differentiation result; and comparing the test coverage rate report with the differentiation result and determining whether the regression test covers the differentiation result. By means of the fast verification method, the test coverage rate report of the tested system can be verified fast, targeted supplement of test cases is facilitated for testers, and complete coverage of codes is guaranteed.

Description

The software quick method of calibration of testing and assessing
Technical field
The present invention relates to field of computer technology, relate in particular to a kind of software quick method of calibration of testing and assessing.
Background technology
At present; the paces of informatization are accelerated gradually; information-based application in industry also more and more widely; business support system and the platform relevant with industry are scale; complicated development trend; this quality requirements to corresponding software is also more and more higher; therefore the ways and means to software quality assurance requires also more and more higher; enterprise is along with scope and the degree of depth of security information construction are being expanded gradually; set up software test and appraisal laboratory in succession; carry out the test job of each application software; become informationization detection and the assessment centers of authority in the system, informationalized high speed development is played the effect that escorts.
Wherein, fast test be one comprehensively, the programme area of system, also be simultaneously key one ring of carrying out test job, the test man can realize the test of " getting twice the result with half the effort " by multiple technologies and automatic test means.Fast in the test process, by quick generation test case and carry out distributed automatically performing, thereby process that can accelerated test promotes test speed, finishes test assignment fast, efficiently to assist the client.
But, when system requirements change, need verify again by its related test macro function that influences; When increasing system requirements newly, need verify again by its related test macro function that influences; When the beta version of sending out new again after the defect correction is verified, need the defective effect correlation function is verified again; When testing requirement change (increase, change), need the function that business association is arranged is verified again; When test case change (increase, change), need the function that business association is arranged is verified again.This all reason has caused the test of part to carry out again, yet after treating that the part that need test is again finished, the test man but can't check the test coverage of system under test (SUT) rapidly, be difficult to replenish targetedly test case, can't guarantee the covering fully of code, cause generation of defects.
Summary of the invention
Technical matters to be solved by this invention is, a kind of software quick method of calibration of testing and assessing is provided, and can check the test coverage of system under test (SUT) rapidly, makes things convenient for the test man to replenish test case targetedly, guarantees the covering fully of code.
In order to solve the problems of the technologies described above, the invention provides a kind of software quick method of calibration of testing and assessing, comprising: during regression test, collect the coverage rate information of test code in the system under test (SUT), statistics generates the test coverage form; Compare the differentiation between last version in the described system under test (SUT) and back one version, generate the differentiation result; Compare described test coverage form and differentiation result, judge whether described regression test has covered the difference part.
Improvement as such scheme, the method of the differentiation in the described system under test (SUT) of described comparison between last version and back one version comprises: judge whether described system under test (SUT) has source code, be judged as when being, last version source code and back one version source code are compared, find out the differentiation between described last version and back one version, when not being judged as not, collect the differentiation between the last version and back one version in the described system under test (SUT) by code differentiation compare tool.
Improvement as such scheme, the method of the coverage rate information of test code comprises in the described collection system under test (SUT): set up test code coverage rate task, described test code coverage rate task comprises task names, binary file URL, beginning execution time, remark information; Set up described test code coverage rate task and regression tested incidence relation; The beginning execution time according to described test code coverage rate task is carried out described regression test; Obtain the coverage rate information of test code in the described regression test process in real time.
Improvement as such scheme, the method of the coverage rate information of test code also comprises in the described collection system under test (SUT): the coverage rate information according to test code in the described regression test process generates reports on the implementation, and described reports on the implementation comprise report, package level report, the class hierarchy report of whole project level.
Implementing beneficial effect of the present invention is: when carrying out regression test, collect test code coverage rate information, statistics generates the test coverage form.By the coverage rate report, the test man therefrom finds and repairs some defectives of hiding.In addition, by the comparison between two versions, find out the differentiation of last version and back one version, the result of statistical difference alienation, the part of displaying differentiation.Then, go to verify by the test coverage form whether this regression test has covered the part of difference in versionization this time, thereby the express-analysis code replenishes test case targetedly and guarantees the test code coverage rate to the coverage of test case.
Description of drawings
Fig. 1 is the test and assess first embodiment schematic flow sheet of quick method of calibration of software of the present invention;
Fig. 2 is the test and assess second embodiment schematic flow sheet of quick method of calibration of software of the present invention;
Fig. 3 is test and assess the 3rd embodiment schematic flow sheet of quick method of calibration of software of the present invention.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, the present invention is described in further detail below in conjunction with accompanying drawing.
Fig. 1 is the test and assess first embodiment schematic flow sheet of quick method of calibration of software of the present invention, comprising:
S100, the coverage rate information of collecting test code in the system under test (SUT), statistics generates the test coverage form.
Need to prove that the test code coverage rate is namely come the level of coverage of constant code by test.
When carrying out regression test, the test man uses the test coverage instrument of increasing income to collect test code coverage rate information automatically, and statistics generates the test coverage form, by the coverage rate report, finds and repair the defective that some are hidden.
S101 compares the differentiation between last version in the described system under test (SUT) and back one version, generates the differentiation result.
By can find out the differentiation of last version and back one version, the result of statistical difference alienation, the part of displaying differentiation to the comparison between two versions.
S102 compares described test coverage form and differentiation result, judges whether described regression test has covered the difference part.
Check results is to go to verify by the result to test code coverage rate statistics whether this regression test has covered the difference part of version this time fast, guarantees the test code coverage rate thereby make the test man replenish test case targetedly.
When carrying out regression test, the test man will add up the test coverage form and the differentiation result that generate and compare, and judge whether described regression test has covered the difference part.When comparing out described regression test and do not cover the difference part fully, the test man guarantees the covering fully of code at partly replenishing test case for capped difference.
Fig. 2 is the test and assess second embodiment schematic flow sheet of quick method of calibration of software of the present invention, comprising:
S200, the coverage rate information of collecting test code in the system under test (SUT), statistics generates the test coverage form.
Need to prove that the test code coverage rate is namely come the level of coverage of constant code by test.
When carrying out regression test, the test man uses the test coverage instrument of increasing income to collect test code coverage rate information automatically, and statistics generates the test coverage form, by the coverage rate report, finds and repair the defective that some are hidden.
S201 judges whether described system under test (SUT) has source code.
Need to prove that verification is divided into system under test (SUT) fast has source code and system under test (SUT) not to have two kinds of scenes of source code.
When judging described system under test (SUT) source code arranged, last version source code and back one version source code are compared, find out the differentiation between described last version and back one version.
When judging described system under test (SUT) and do not have source code, collect the differentiation between the last version and back one version in the described system under test (SUT) by code differentiation compare tool.
S202 generates the differentiation result.
Differentiation between described last version and back one version is added up into the result of differentiation, show the part of differentiation.
S203 compares described test coverage form and differentiation result, judges whether described regression test has covered the difference part.
Check results is to go to verify by the result to test code coverage rate statistics whether this regression test has covered the difference part of version this time fast, guarantees the test code coverage rate thereby make the test man replenish test case targetedly.
As from the foregoing, when system under test (SUT) has source code, source code by last version source code and current version compares the differentiation of finding out between them, coverage rate analysis based on code, automatically collect the coverage rate of code when carrying out regression test, whether the coverage rate of comparing this regression test code comprises the difference part, replenishes test case targetedly according to comparison result, guarantee the covering fully of code, and then guarantee test coverage.When system under test (SUT) does not have source code, collect test coverage by carrying out regression test, by the result of code differentiation compare tool collection differentiation, the test man replenishes test case targetedly according to comparison result, guarantee the covering fully of code, and then guarantee test coverage.
Fig. 3 is test and assess the 3rd embodiment schematic flow sheet of quick method of calibration of software of the present invention, comprising:
S300 sets up test code coverage rate task.
Described test code coverage rate task comprises task names, binary file URL, beginning execution time, remark information.
S301 sets up described test code coverage rate task and regression tested incidence relation.
S302 carries out described regression test according to the beginning execution time of described test code coverage rate task.
S303 obtains the coverage rate information of test code in the described regression test process in real time.
Need to prove that when carrying out regression test, the test man uses the test coverage instrument of increasing income to collect test code coverage rate information automatically.
S304, statistics generates the test coverage form.
The test man reports by coverage rate, can find and repair system in some defectives of hiding, further guaranteed the quality of system under test (SUT).
More preferably, also can generate reports on the implementation according to the coverage rate information of test code in the described regression test process, described reports on the implementation comprise report, package level report, the class hierarchy report of whole project level, so that the test man tests tracking.
S305 judges whether described system under test (SUT) has source code.
Need to prove that verification is divided into system under test (SUT) fast has source code and system under test (SUT) not to have two kinds of scenes of source code.
When judging described system under test (SUT) source code arranged, last version source code and back one version source code are compared, find out the differentiation between described last version and back one version.In comparison process, the test man need select the source code version of two needs comparisons, and sets up the incidence relation between comparison and the regression test.
When judging described system under test (SUT) and do not have source code, collect the differentiation between the last version and back one version in the described system under test (SUT) by code differentiation compare tool.
S306 generates the differentiation result.
Differentiation between described last version and back one version is added up into the differentiation result, show the part of differentiation.
Need to prove that when system under test (SUT) had source code, differentiation result can trace back to concrete source code, can show the otherness between the source code.
S307 compares described test coverage form and differentiation result, judges whether described regression test has covered the difference part.
Check results is to go to verify by the result to test code coverage rate statistics whether this regression test has covered the difference part of version this time fast, guarantees the test code coverage rate thereby make the test man replenish test case targetedly.
As from the foregoing, the test man sets up test code coverage rate task according to the actual requirements, and makes up described test code coverage rate task and regression tested incidence relation.When carrying out regression test, the test man uses the test coverage instrument of increasing income to collect test code coverage rate information automatically and statistics generates the test coverage form, the test man reports by coverage rate, can find and repair system in some defectives of hiding, further guaranteed the quality of system under test (SUT).When system under test (SUT) has source code, source code by last version source code and current version compares the differentiation of finding out between them, whether the coverage rate of comparing this regression test code comprises the difference part, replenish test case targetedly according to comparison result, guarantee the covering fully of code, and then guarantee test coverage.When system under test (SUT) did not have source code, by the result of code differentiation compare tool collection differentiation, the test man replenished test case targetedly according to comparison result, guarantees the covering fully of code, and then guarantees test coverage.
The above is preferred implementation of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from the principle of the invention; can also make some improvements and modifications, these improvements and modifications also are considered as protection scope of the present invention.

Claims (4)

1. a software quick method of calibration of testing and assessing is characterized in that, comprising:
During regression test, collect the coverage rate information of test code in the system under test (SUT), statistics generates the test coverage form;
Compare the differentiation between last version in the described system under test (SUT) and back one version, generate the differentiation result;
Compare described test coverage form and differentiation result, judge whether described regression test has covered the difference part.
2. the software as claimed in claim 1 quick method of calibration of testing and assessing is characterized in that, the method for the differentiation in the described system under test (SUT) of described comparison between last version and back one version comprises:
Judge whether described system under test (SUT) has source code,
Be judged as when being, last version source code and back one version source code compared, find out the differentiation between described last version and back one version,
When not being judged as not, collect the differentiation between the last version and back one version in the described system under test (SUT) by code differentiation compare tool.
3. the software as claimed in claim 1 quick method of calibration of testing and assessing is characterized in that the method for the coverage rate information of test code comprises in the described collection system under test (SUT):
Set up test code coverage rate task, described test code coverage rate task comprises task names, binary file URL, beginning execution time, remark information;
Set up described test code coverage rate task and regression tested incidence relation;
The beginning execution time according to described test code coverage rate task is carried out described regression test;
Obtain the coverage rate information of test code in the described regression test process in real time.
4. the software as claimed in claim 3 quick method of calibration of testing and assessing is characterized in that the method for the coverage rate information of test code also comprises in the described collection system under test (SUT):
Coverage rate information according to test code in the described regression test process generates reports on the implementation, and described reports on the implementation comprise report, package level report, the class hierarchy report of whole project level.
CN201210029420.3A 2012-02-10 2012-02-10 Software test and appraisal fast calibration method Active CN103246600B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210029420.3A CN103246600B (en) 2012-02-10 2012-02-10 Software test and appraisal fast calibration method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210029420.3A CN103246600B (en) 2012-02-10 2012-02-10 Software test and appraisal fast calibration method

Publications (2)

Publication Number Publication Date
CN103246600A true CN103246600A (en) 2013-08-14
CN103246600B CN103246600B (en) 2016-04-06

Family

ID=48926130

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210029420.3A Active CN103246600B (en) 2012-02-10 2012-02-10 Software test and appraisal fast calibration method

Country Status (1)

Country Link
CN (1) CN103246600B (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103605603A (en) * 2013-10-12 2014-02-26 南京大学 Covering table reduction method and system
CN104077227A (en) * 2014-07-08 2014-10-01 大连海事大学 Program source code judgment system and method based on B/S framework
CN104572433A (en) * 2013-10-29 2015-04-29 中国银联股份有限公司 Method and device for testing financial information system
CN104714882A (en) * 2013-12-17 2015-06-17 腾讯科技(深圳)有限公司 Code information processing method and device
CN105830037A (en) * 2013-12-18 2016-08-03 谷歌公司 Process for displaying test coverage data during code reviews
CN105959678A (en) * 2016-04-20 2016-09-21 杭州当虹科技有限公司 Efficient regression test method based on hash eigen value detection of audio video decoder
CN105975924A (en) * 2016-04-29 2016-09-28 杭州当虹科技有限公司 Regression testing method for precisely recognizing ad content based on video frame statistics
CN105988926A (en) * 2015-02-13 2016-10-05 腾讯科技(深圳)有限公司 Method and device for processing multi-version test data
CN106155890A (en) * 2015-04-02 2016-11-23 深圳市腾讯计算机系统有限公司 platform test method and system
CN106326120A (en) * 2016-08-22 2017-01-11 北京金山安全软件有限公司 Regression testing method and device for application software and electronic equipment
CN106886492A (en) * 2017-02-13 2017-06-23 北京趣拿软件科技有限公司 Method of testing and test device based on data readback
CN106897217A (en) * 2017-02-13 2017-06-27 北京趣拿软件科技有限公司 Method of testing and test device
CN108415825A (en) * 2017-10-27 2018-08-17 平安科技(深圳)有限公司 electronic device, test method and storage medium
CN109144878A (en) * 2018-08-31 2019-01-04 重庆富民银行股份有限公司 Code test method based on path difference
CN109254918A (en) * 2018-08-31 2019-01-22 重庆富民银行股份有限公司 Code tester system based on path difference
CN109426604A (en) * 2017-08-22 2019-03-05 阿里巴巴集团控股有限公司 The monitoring method and equipment of code development
CN109542761A (en) * 2018-10-11 2019-03-29 平安科技(深圳)有限公司 Evaluation of Software Quality, device and storage medium
CN111026665A (en) * 2019-12-09 2020-04-17 中国建设银行股份有限公司 Test range analysis method, device and equipment
CN111209206A (en) * 2020-01-13 2020-05-29 卡斯柯信号(北京)有限公司 Automatic test method and system for software product
CN111209206B (en) * 2020-01-13 2024-05-24 卡斯柯信号(北京)有限公司 Automatic test method and system for software products

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1873625A (en) * 2005-08-19 2006-12-06 华为技术有限公司 Method for automatic generating random excitation based on percentage of function coverage
US20080270840A1 (en) * 2007-04-25 2008-10-30 Samsung Electronics Co., Ltd. Device and method for testing embedded software using emulator
CN102063374A (en) * 2011-01-07 2011-05-18 南京大学 Method for selecting regression test case for clustering with semi-supervised information
CN102521700A (en) * 2011-12-13 2012-06-27 广东电网公司信息中心 Electrical network informatization evaluation rapid test system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1873625A (en) * 2005-08-19 2006-12-06 华为技术有限公司 Method for automatic generating random excitation based on percentage of function coverage
US20080270840A1 (en) * 2007-04-25 2008-10-30 Samsung Electronics Co., Ltd. Device and method for testing embedded software using emulator
CN102063374A (en) * 2011-01-07 2011-05-18 南京大学 Method for selecting regression test case for clustering with semi-supervised information
CN102521700A (en) * 2011-12-13 2012-06-27 广东电网公司信息中心 Electrical network informatization evaluation rapid test system

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103605603B (en) * 2013-10-12 2016-03-02 南京大学 Cover the method and system of table yojan
CN103605603A (en) * 2013-10-12 2014-02-26 南京大学 Covering table reduction method and system
CN104572433A (en) * 2013-10-29 2015-04-29 中国银联股份有限公司 Method and device for testing financial information system
CN104572433B (en) * 2013-10-29 2017-09-29 中国银联股份有限公司 A kind of financial information system method of testing and device
CN104714882A (en) * 2013-12-17 2015-06-17 腾讯科技(深圳)有限公司 Code information processing method and device
CN104714882B (en) * 2013-12-17 2018-11-23 腾讯科技(深圳)有限公司 The method and device of code information processing
CN105830037A (en) * 2013-12-18 2016-08-03 谷歌公司 Process for displaying test coverage data during code reviews
CN104077227B (en) * 2014-07-08 2017-01-04 大连海事大学 The evaluation system of a kind of program source code based on B/S framework and method
CN104077227A (en) * 2014-07-08 2014-10-01 大连海事大学 Program source code judgment system and method based on B/S framework
CN105988926B (en) * 2015-02-13 2019-06-07 腾讯科技(深圳)有限公司 The treating method and apparatus of multi version test data
CN105988926A (en) * 2015-02-13 2016-10-05 腾讯科技(深圳)有限公司 Method and device for processing multi-version test data
CN106155890A (en) * 2015-04-02 2016-11-23 深圳市腾讯计算机系统有限公司 platform test method and system
CN105959678A (en) * 2016-04-20 2016-09-21 杭州当虹科技有限公司 Efficient regression test method based on hash eigen value detection of audio video decoder
CN105975924A (en) * 2016-04-29 2016-09-28 杭州当虹科技有限公司 Regression testing method for precisely recognizing ad content based on video frame statistics
CN106326120B (en) * 2016-08-22 2019-07-05 北京金山安全软件有限公司 Regression testing method and device for application software and electronic equipment
CN106326120A (en) * 2016-08-22 2017-01-11 北京金山安全软件有限公司 Regression testing method and device for application software and electronic equipment
CN106886492A (en) * 2017-02-13 2017-06-23 北京趣拿软件科技有限公司 Method of testing and test device based on data readback
CN106897217A (en) * 2017-02-13 2017-06-27 北京趣拿软件科技有限公司 Method of testing and test device
CN109426604A (en) * 2017-08-22 2019-03-05 阿里巴巴集团控股有限公司 The monitoring method and equipment of code development
CN108415825B (en) * 2017-10-27 2021-01-19 平安科技(深圳)有限公司 Electronic device, test method, and storage medium
CN108415825A (en) * 2017-10-27 2018-08-17 平安科技(深圳)有限公司 electronic device, test method and storage medium
CN109254918A (en) * 2018-08-31 2019-01-22 重庆富民银行股份有限公司 Code tester system based on path difference
CN109144878A (en) * 2018-08-31 2019-01-04 重庆富民银行股份有限公司 Code test method based on path difference
CN109542761A (en) * 2018-10-11 2019-03-29 平安科技(深圳)有限公司 Evaluation of Software Quality, device and storage medium
CN109542761B (en) * 2018-10-11 2022-03-11 平安科技(深圳)有限公司 Software quality evaluation method, device and storage medium
CN111026665A (en) * 2019-12-09 2020-04-17 中国建设银行股份有限公司 Test range analysis method, device and equipment
CN111026665B (en) * 2019-12-09 2023-02-28 建信金融科技有限责任公司 Test range analysis method, device and equipment
CN111209206A (en) * 2020-01-13 2020-05-29 卡斯柯信号(北京)有限公司 Automatic test method and system for software product
CN111209206B (en) * 2020-01-13 2024-05-24 卡斯柯信号(北京)有限公司 Automatic test method and system for software products

Also Published As

Publication number Publication date
CN103246600B (en) 2016-04-06

Similar Documents

Publication Publication Date Title
CN103246600A (en) Fast verification method for software testing and evaluation
US8423960B2 (en) Evaluation of software based on review history
US20140033174A1 (en) Software bug predicting
CN102521700A (en) Electrical network informatization evaluation rapid test system
CN104077217A (en) Method and system for compiling and issuing code file
Nugroho et al. Assessing uml design metrics for predicting fault-prone classes in a java system
CN107506294A (en) Visualize automated testing method, device, storage medium and computer equipment
CN111752833B (en) Software quality system approval method, device, server and storage medium
CN110119348B (en) Software upgrading test method and terminal
CN111611154A (en) Regression testing method, device and equipment
CN113626326A (en) Dragging type zero code front end automatic test system based on image recognition
CN110941830B (en) Vulnerability data processing method and device
CN110888809B (en) Risk prediction method and device for test task
CN113127324B (en) Automatic test report generation method and device, computer equipment and storage medium
CN110059012B (en) Program test control method, device, storage medium and platform
CN113282496A (en) Automatic interface test method, device, equipment and storage medium
US10586014B1 (en) Method and system for verification using combined verification data
CN109815129A (en) Test method, device, terminal and the storage medium of securities finance application software
CN106598857A (en) Method and device for testing electronic equipment based on automatic testing tool
CN110633215B (en) Method and system for managing automatic test scripts
CN111209206B (en) Automatic test method and system for software products
CN113094095B (en) Agile development progress determining method and device
Nautiyal et al. A Novel Approach to Component-Based Software Testing
CN106227669A (en) Code testing method and device and electronic equipment
CN109144866B (en) Software testing method and software testing device based on household appliances

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant