CN109408359A - A kind of software test procedure quality metric method and system - Google Patents
A kind of software test procedure quality metric method and system Download PDFInfo
- Publication number
- CN109408359A CN109408359A CN201810876701.XA CN201810876701A CN109408359A CN 109408359 A CN109408359 A CN 109408359A CN 201810876701 A CN201810876701 A CN 201810876701A CN 109408359 A CN109408359 A CN 109408359A
- Authority
- CN
- China
- Prior art keywords
- test
- software
- software test
- stage
- degree
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 298
- 238000013442 quality metrics Methods 0.000 title claims abstract description 97
- 238000011156 evaluation Methods 0.000 claims abstract description 149
- 238000005259 measurement Methods 0.000 claims abstract description 106
- 238000001303 quality assessment method Methods 0.000 claims abstract description 15
- 238000012360 testing method Methods 0.000 claims description 467
- 230000008569 process Effects 0.000 claims description 257
- 238000013522 software testing Methods 0.000 claims description 76
- 238000004519 manufacturing process Methods 0.000 claims description 56
- 238000013461 design Methods 0.000 claims description 53
- 230000008859 change Effects 0.000 claims description 52
- 239000011159 matrix material Substances 0.000 claims description 30
- 238000012790 confirmation Methods 0.000 claims description 27
- 238000012827 research and development Methods 0.000 claims description 27
- 230000007547 defect Effects 0.000 claims description 26
- 238000004364 calculation method Methods 0.000 claims description 25
- 238000001514 detection method Methods 0.000 claims description 22
- 238000004458 analytical method Methods 0.000 claims description 14
- 239000002131 composite material Substances 0.000 claims description 11
- 238000007689 inspection Methods 0.000 claims description 4
- 230000007246 mechanism Effects 0.000 abstract description 12
- 238000003326 Quality management system Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 14
- 238000004590 computer program Methods 0.000 description 7
- 238000012552 review Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000003786 synthesis reaction Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 238000011990 functional testing Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000011056 performance test Methods 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 239000000700 radioactive tracer Substances 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- OVBPIULPVIDEAO-LBPRGKRZSA-N folic acid Chemical compound C=1N=C2NC(N)=NC(=O)C2=NC=1CNC1=CC=C(C(=O)N[C@@H](CCC(O)=O)C(O)=O)C=C1 OVBPIULPVIDEAO-LBPRGKRZSA-N 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001314 paroxysmal effect Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000013441 quality evaluation Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000011076 safety test Methods 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000013097 stability assessment Methods 0.000 description 1
- 238000013112 stability test Methods 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3676—Test management for coverage analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
Abstract
The present invention provides a kind of software test procedure quality metric method and systems, comprising: in each stage of software test, the software test data which generates is brought into software test procedure quality measurement model, obtains each quality metric index value；Refer to target value according to each quality metric, carries out comprehensive assessment calculating, obtain software test procedure quality assessment result；Wherein, software test procedure quality measurement model includes: the multiple quality metric indexs for reflecting the mass property in complete procedure each stage of software test.This method and system obtain software test procedure quality assessment result, it is able to reflect the mass property in complete procedure each stage of software test, with preferable comprehensive, the appraisal procedure of each evaluation index and software test procedure are closely related simultaneously, little with the quality management system correlation of assessment mechanism, assessment result has better objectivity and fairness.
Description
Technical field
The invention belongs to information technology fields, and in particular to a kind of software test procedure quality metric method and system.
Background technique
Software test is correctness, integrality, the process for safety and quality for being used to promote to identify software.Software
Test process is made of demand analysis and test planning, test design and implementation, test execution, summary and evaluation four-stage.
The quality of software test procedure be influence software testing quality, software assessment mechanism power of test an important factor for.In general, real
The assessment mechanism for applying software test has the quality management system of oneself, it is specified that plan, implementing, monitoring and the multiple mistakes such as improving
Journey.The quality of software assessment process is usually to be embodied by the accordance of the quality system for the mechanism that tests and assesses.Meet mass body
System requires, and provides corresponding technical data support, then it is assumed that the management of software test procedure is effective.This mode causes pair
It is insufficient to there is both sides in the assessment of test process quality.First is that since document of Quality System is formulated by each assessment mechanism oneself
, cause the assessment of test process quality to lack objectivity, consistency；Second is that different assessment mechanisms meet quality requirement
Degree is different, and the measurement results of the test process quality of different assessment mechanisms is caused to lack comparativity, can not be to assessment mechanism
Managerial ability carries out objective effective assessment.
Summary of the invention
To overcome above-mentioned the deficiencies in the prior art, the present invention is summarized by the software test procedure of analysis assessment mechanism
The quality of software test procedure can usually show as procedural compliance, process stability, validity, adequacy, traceability, complete
Seven aspects such as whole property and timeliness.According to the mass property of this seven software test procedures, 7 level metric indexs are formed,
Level metric index is refined simultaneously, forms 16 second level Measure Indexes to describe each mass property, and propose each
The measure of Measure Indexes establishes a kind of software test procedure quality metric method and system.
Realize solution used by above-mentioned purpose are as follows:
A kind of software test procedure quality metric method, thes improvement is that:
In each stage of software test, the software test data that the stage generates is brought into software test procedure quality degree
It measures in model, obtains each quality metric index value；
Refer to target value according to each quality metric, carries out comprehensive assessment calculating, obtain software test procedure quality evaluation
As a result；
The software test procedure quality measurement model includes: the quality for reflecting complete procedure each stage of software test
Multiple quality metric indexs of characteristic.
First optimal technical scheme provided by the invention, it is improved in that each stage in software test, it will
Software test data is brought into software test procedure quality measurement model, and each quality metric index value is obtained, comprising:
It will be obtained with the actual test process in software test each stage and default testing process and software test each stage
Experience of Software Testing Work product and the default Experience of Software Testing Work product Input Software test process quality measurement model needed in,
For process conformity and work product degree of conformity, procedural compliance Measure Indexes value is obtained；
Preferably, each stage in software test, software test data is brought into software test procedure quality metric
In model, each quality metric index value is obtained, further includes:
By the demand number of the demand number and each stage of each stage change of software test before changing, software test each stage
Actual duration and proposed duration, the tester's number changed in software test procedure and total tester's number
The day of mesh, software test each stage and software test each stage practical evaluation number, estimated evaluation number and comments production efficiency
It examines in disqualification rate Input Software test process quality measurement model, for demand change degree, time schedule stability, Ren Yuanwen
Fixed degree, production stability and specification degree of conformity, obtain process stability metric index value；
Preferably, each stage in software test, software test data is brought into software test procedure quality metric
In model, each quality metric index value is obtained, further includes:
By the number of the software issue found daily in software test procedure, the test that can be performed in software test procedure is used
The test problem number and test of research and development institution's confirmation are obtained in number of cases and the test case number and software test procedure of design
In Issue Totals Input Software test process quality measurement model, examined for the defect degree of convergence, case designing availability and problem
Error rate obtains measure of effectiveness index value；
Preferably, each stage in software test, software test data is brought into software test procedure quality metric
In model, each quality metric index value is obtained, further includes:
The demand number and software whole demand number of use-case covering, software test procedure will be tested in software test procedure
The problem of being found in the lines of code of middle Test coverage and whole lines of code and software test procedure number and whole issue
In number Input Software test process quality measurement model, for demand coverage rate, code coverage and use-case adequacy, obtain
Sufficiency measurement index value；
Preferably, each stage in software test, software test data is brought into software test procedure quality metric
In model, each quality metric index value is obtained, further includes:
By in the entry Input Software test process quality measurement model of the document in software test each stage and each document,
For positive reversely tracing degree, traceability Measure Indexes value is obtained；
Preferably, each stage in software test, software test data is brought into software test procedure quality metric
In model, each quality metric index value is obtained, further includes:
By need default in software test procedure test-types to be tested, actually the test-types and each test-types carried out
Weight Input Software test process quality measurement model in, for integrity degree, obtain integrity measurement index value；
Preferably, each stage in software test, software test data is brought into software test procedure quality metric
In model, each quality metric index value is obtained, further includes:
Software issue in software test procedure is introduced into stage and software issue discovery phase Input Software test process matter
In metric model, for timely degree, timeliness Measure Indexes value is obtained.
Second optimal technical scheme provided by the invention, it is improved in that software test procedure quality measurement model
Foundation, comprising:
According to the actual test process in software test each stage and default testing process, calculation process degree of conformity；
The actual measurement Experience of Software Testing Work product and the default Experience of Software Testing Work needed obtained according to software test each stage
Product calculates work product degree of conformity；
According to the demand number of the demand number and each stage of each stage change of software test before changing, demand change is calculated
Degree；
According to the actual duration and proposed duration in software test each stage, time schedule stability is calculated；
According to the tester's number and total tester's number changed in software test procedure, computing staff stablizes
Degree；
According to the day production efficiency in software test each stage, production stability is calculated；
According to software test each stage practical evaluation number, estimated evaluation number and evaluation disqualification rate, specification symbol is calculated
It is right；
Whether restrained according to the number of the software issue found daily in software test procedure, calculates the defect degree of convergence；
According to the test case number of the test case number and design that can be performed in software test procedure, calculating case designing has
Validity；
It is asked according to the test problem number and test problem sum, calculating that obtain research and development institution's confirmation in software test procedure
Inscribe error detection rate；
The number of the demand number and whole demands that are covered according to test case in software test procedure, calculates demand covering
Rate；
According to the lines of code of Test coverage in software test procedure and whole lines of code, calculation code coverage rate；
According to the test problem sum and whole issue number found in software test procedure, use-case adequacy is calculated；
Whether can be corresponding according to the entry in phase software test job product documentation each in software test procedure
Whether the entry found in source and each phase software test job product documentation in previous stage document can be corresponding
Explanation is found in the latter half document, calculates positive reversely tracing degree；
According to need default in software test procedure test-types to be tested, actually the test-types carried out and each test class
The weight of type calculates integrity degree；
Stage and software issue discovery phase are introduced according to software issue in software test procedure, calculates degree in time；
Preferably, the actual test process according to software test each stage and default testing process, calculation process symbol
It is right, such as following formula:
Wherein, Process is process conformity, and n indicates that the number of stages of software test, γ indicate software test two stages
Between checkpoint, checkpointγFor the value of checkpoint γ, two stage actual test process meets before and after the γ of checkpoint
When meeting default testing process, checkpointγValue is 1, is otherwise 0；
Preferably, the actual measurement Experience of Software Testing Work product obtained according to software test each stage and default needs is soft
Part test job product calculates work product degree of conformity, such as following formula:
Wherein WorkProducts indicates work product degree of conformity, and β indicates that the default Experience of Software Testing Work product needed is total
Number, the actual measurement Experience of Software Testing Work product that the default Experience of Software Testing Work product needed of jth obtains in software test each stage
In in the presence of, ProductjValue is 1, is otherwise 0；
Preferably, the demand number of the demand number and each stage according to each stage change of software test before changing,
Calculating demand change degree, such as following formula:
Wherein, Modify indicates that demand change degree, intermediate variable m such as following formula calculate:
Wherein, n indicates the number of stages of software test, ModifyReqiIndicate that generating test in test process stage i needs
Seek change OriReqiIndicate the aggregate demand number before test process stage i change occurs；
Preferably, the actual duration and proposed duration according to software test each stage, calculate the time into
Stability is spent, such as following formula:
Wherein, Schedule indicates time schedule stability, and n indicates the number of stages of software test, SiIndicate that software is surveyed
The time stability of examination stage i, SiAs following formula calculates:
TimeiIndicate the actual duration of software test stage i, PlantimeiIndicate the plan of software test stage i
Duration, k are preset time judgment threshold；
Preferably, described according to the tester's number changed in software test procedure and total tester's number, meter
Calculation personnel's stability, such as following formula:
Wherein, Staff indicates personnel's stability, and C indicates total tester's number, and A indicates to become in software test procedure
Dynamic tester's number；
Preferably, the day production efficiency according to software test each stage calculates production stability, such as following formula:
Wherein, productivity indicates production stability；
Preferably, it is described according to software test each stage practical evaluation number, estimated evaluation number and evaluation disqualification rate,
Specification degree of conformity is calculated, such as following formula:
Wherein, Standard indicates the specification degree of conformity of entire software test procedure, and n indicates the number of stages of software test
Mesh, StandardiIndicate the specification degree of conformity in i-th of software test stage, StandardiAs following formula calculates:
Wherein, N0Indicating preset evaluation frequency threshold value, N indicates i-th of software test stage estimated evaluation number,
N ' indicates that reality evaluation number, r indicate in the multiple evaluation in i-th of software test stage that evaluation disqualification rate is relatively rear primary
Low number；
Preferably, whether the number according to the software issue found daily in software test procedure restrains, and calculates and lacks
The degree of convergence is fallen into, such as following formula:
Wherein, BugStypticity indicates the defect degree of convergence, and the convergence indicates the software number found daily with the date
Increase and reduces；
Preferably, the test case number according to the test case number and design that can be performed in software test procedure, meter
Case designing availability is calculated, such as following formula:
CaseEffectiveness=Testcaseexec/Testcasedesign
Wherein, CaseEffectiveness indicates case designing availability, TestcaseexecIndicate executable use-case
Number, TestcasedesignIndicate design uses number of cases；
Preferably, described according to the test problem number and test problem that obtain research and development institution's confirmation in software test procedure
Sum, computational problem error detection rate, such as following formula:
BugExplore=Bugscomfirm/Bugstester
Wherein, BugExplore indicates problem error detection rate, BugscomfirmIt indicates to obtain research and development institution in software test procedure
The test problem number of confirmation, BugstesterIndicate test problem sum；
Preferably, the number of the demand number covered according to test case in software test procedure and whole demands, meter
Calculation demand coverage rate, such as following formula:
ReqCoverage=Reqcovered/Reqall
Wherein, ReqCoverage indicates demand coverage rate, and Reqcovered indicates that test case is covered in software test procedure
The demand number of lid, Reqall indicate whole demand numbers；
Preferably, the lines of code and whole lines of code according to Test coverage in software test procedure, calculates generation
Code coverage rate, such as following formula:
CodeCoverage=Codecovered/Codeall
Wherein, CodeCoverage indicates code coverage, CodecoveredIndicate the lines of code of tested covering,
CodeallIndicate whole lines of code；
Preferably, described according to the test problem found in software test procedure sum and whole issue number, it calculates and uses
Example adequacy, such as following formula:
CaseCoverage=Bugstester/Bugsall
Wherein, CaseCoverage indicates use-case adequacy, BugstesterIndicate the problem of finding in software test procedure
Number, BugsallIndicate whole issue number；
Preferably, whether the entry according in phase software test job product documentation each in software test procedure can
Whether enough entries found in source and each phase software test job product documentation in corresponding previous stage document can
It is enough to find explanation in corresponding the latter half document, positive reversely tracing degree is calculated, such as following formula:
Wherein, Trace indicates that positive reversely tracing degree, α indicate each phase software test job product in software test procedure
The number of document, DucFδThe reverse traceability for indicating the δ Experience of Software Testing Work product documentation except the first, when
DucF when entry in the δ Experience of Software Testing Work product documentation can find source in corresponding previous stage documentδValue
It is 1, is otherwise 0；DucRδIndicate the positive traceability of the δ Experience of Software Testing Work product documentation other than the last one,
The DucR when the entry in the δ Experience of Software Testing Work product documentation can be found in corresponding the latter half document to be illustratedδIt takes
Value is 1, is otherwise 0；
Preferably, which is characterized in that it is described according to preset in software test procedure need test-types to be tested, it is practical into
The weight of capable test-types and each test-types calculates integrity degree, such as following formula:
Complete=1- ∑ Absencej*ωj
Wherein, Complete indicates integrity degree, AbsencejIndicating that comparison is default needs test-types to be tested and reality
The test-types for the missing that the test-types of progress obtain, when test-types j is lacked, AbsencejIt is 1, is otherwise 0；ωjIt indicates
The weight of test-types j；
Preferably, described that stage and software issue discovery phase are introduced according to software issue in software test procedure, it calculates
Degree in time, such as following formula:
Wherein Intime indicates that degree in time, s indicate that test process finds software issue number, IntimeiIt indicates to ask for i-th
The timely degree of topic；IntimeiAs following formula calculates:
Wherein, PhaseembeddedIndicate that software issue introduces the assignment in stage, PhaseactIndicate software issue discovery phase
Assignment.
Third optimal technical scheme provided by the invention, it is improved in that described refer to according to each quality metric
Target value carries out comprehensive assessment calculating, obtains software test procedure quality assessment result, comprising:
Refer to target value according to each quality metric, establishes fuzzy relation matrix；
The weight of each quality metric index is calculated using analytic hierarchy process (AHP)；
Composite calulation is carried out to the fuzzy relation matrix and weight, obtains software test procedure quality assessment result.
4th optimal technical scheme provided by the invention, it is improved in that the stage of the software test, comprising:
Demand analysis, test planning, test plan evaluation, tests design and realizes, test specification evaluation, tests testing requirement evaluation
Ready evaluation, test execution, test is summarized and test report evaluation.
5th optimal technical scheme provided by the invention, it is improved in that each stage in software test, it will
Software test data is brought into software test procedure quality measurement model, and each quality metric index is obtained, comprising:
In demand analysis stage, by actual test process and default testing process, Experience of Software Testing Work product, change need
Seek tester's number of number and demand number, actual duration and proposed duration, variation before changing and total
The survey of tester's number, day production efficiency, the number of the software issue found daily, executable test case number and design
On probation number of cases, the test problem number for obtaining research and development institution's confirmation and test problem sum, test case covering demand number and
The problem of number of whole demands, the lines of code of Test coverage and whole lines of code, discovery number, test job product text
The weight and introducing of entry, default need test-types to be tested, the test-types and each test-types that actually carry out in shelves
Software issue and the software issue of discovery bring into software test procedure quality measurement model, obtain each quality metric index；
The stage is evaluated in testing requirement, by actual test process and default testing process, Experience of Software Testing Work product, reality
Tester's number of duration and proposed duration, tester's number of variation and total tester's number, variation
Mesh and total tester's number, day production efficiency, practical evaluation number, estimated evaluation number and evaluation disqualification rate and test
Entry in work product document is brought into software test procedure quality measurement model, and each quality metric index is obtained；
In test programming phase, by actual test process and default testing process, Experience of Software Testing Work product, change need
Seek tester's number of number and demand number, actual duration and proposed duration, variation before changing and total
The survey of tester's number, day production efficiency, the number of the software issue found daily, executable test case number and design
On probation number of cases, the test problem number for obtaining research and development institution's confirmation and test problem sum, test case covering demand number and
The problem of number of whole demands, the lines of code of Test coverage and whole lines of code, discovery number, test job product text
The weight and introducing of entry, default need test-types to be tested, the test-types and each test-types that actually carry out in shelves
Software issue and the software issue of discovery bring into software test procedure quality measurement model, obtain each quality metric index；
The stage is evaluated in test plan, by actual test process and default testing process, Experience of Software Testing Work product, reality
Tester's number of duration and proposed duration, tester's number of variation and total tester's number, variation
Mesh and total tester's number, day production efficiency, practical evaluation number, estimated evaluation number and evaluation disqualification rate and test
Entry in work product document is brought into software test procedure quality measurement model, and each quality metric index is obtained；
In test design and implementation phase, by actual test process and default testing process, Experience of Software Testing Work product, become
Tester's number of demand number more and demand number, actual duration and proposed duration, variation before changing
And it total tester's number, day production efficiency, the number of the software issue found daily, executable test case number and sets
The need of the test case number of meter, the test problem number for obtaining research and development institution's confirmation and test problem sum, test case covering
The problem of asking the number of several and whole demands, the lines of code of Test coverage and whole lines of code, discovery number, test job
The weight of entry, default need test-types to be tested, the test-types and each test-types that actually carry out in product documentation
It is brought into software test procedure quality measurement model with the software issue of the software issue and discovery that are introduced into, obtains each quality metric
Index；
The stage is evaluated in test specification, by actual test process and default testing process, Experience of Software Testing Work product, reality
Tester's number of duration and proposed duration, tester's number of variation and total tester's number, variation
Mesh and total tester's number, day production efficiency, practical evaluation number, estimated evaluation number and evaluation disqualification rate and test
Entry in work product document is brought into software test procedure quality measurement model, and each quality metric index is obtained；
The ready evaluation stage is being tested, by actual test process and default testing process, Experience of Software Testing Work product, reality
Tester's number of duration and proposed duration, tester's number of variation and total tester's number, variation
Mesh and total tester's number, day production efficiency, practical evaluation number, estimated evaluation number and evaluation disqualification rate and test
Entry in work product document is brought into software test procedure quality measurement model, and each quality metric index is obtained；
In the test execution stage, by actual test process and default testing process, Experience of Software Testing Work product, change need
Seek tester's number of number and demand number, actual duration and proposed duration, variation before changing and total
The survey of tester's number, day production efficiency, the number of the software issue found daily, executable test case number and design
On probation number of cases, the test problem number for obtaining research and development institution's confirmation and test problem sum, test case covering demand number and
The problem of number of whole demands, the lines of code of Test coverage and whole lines of code, discovery number, test job product text
The weight and introducing of entry, default need test-types to be tested, the test-types and each test-types that actually carry out in shelves
Software issue and the software issue of discovery bring into software test procedure quality measurement model, obtain each quality metric index；
Test feedback and evaluation by actual test process and default testing process, Experience of Software Testing Work product, change need
Seek tester's number of number and demand number, actual duration and proposed duration, variation before changing and total
The survey of tester's number, day production efficiency, the number of the software issue found daily, executable test case number and design
On probation number of cases, the test problem number for obtaining research and development institution's confirmation and test problem sum, test case covering demand number and
The problem of number of whole demands, the lines of code of Test coverage and whole lines of code, discovery number, test job product text
The weight and introducing of entry, default need test-types to be tested, the test-types and each test-types that actually carry out in shelves
Software issue and the software issue of discovery bring into software test procedure quality measurement model, obtain each quality metric index；
The stage is evaluated in test report, by actual test process and default testing process, Experience of Software Testing Work product, reality
Tester's number of duration and proposed duration, tester's number of variation and total tester's number, variation
Mesh and total tester's number, day production efficiency, practical evaluation number, estimated evaluation number and evaluation disqualification rate and test
Entry in work product document is brought into software test procedure quality measurement model, and each quality metric index is obtained.
A kind of software test procedure quality metric system, it is improved in that including: that index value obtains module and synthesis
Evaluation module；
The index value obtains module, for each stage in software test, the software test number that the stage is generated
According to bringing into software test procedure quality measurement model, each quality metric index value is obtained；
The comprehensive assessment module carries out comprehensive assessment calculating, obtains for referring to target value according to each quality metric
Software test procedure quality assessment result；
The software test procedure quality measurement model includes: the quality for reflecting complete procedure each stage of software test
Multiple quality metric indexs of characteristic.
6th optimal technical scheme provided by the invention, it is improved in that index value acquisition module included
Journey accordance unit, process stability unit, validity unit, adequacy unit, traceability unit, integrality unit and in time
Property unit；
The procedural compliance unit, for will be flowed with the actual test process in software test each stage and default test
The Experience of Software Testing Work product that journey and software test each stage obtain and the default Experience of Software Testing Work product input needed are soft
In part test process quality measurement model, for process conformity and work product degree of conformity, obtains procedural compliance measurement and refer to
Scale value；
The process stability unit, for by the demand number of software test each stage change and each stage before changing
Demand number, the actual duration and proposed duration in software test each stage, the test changed in software test procedure
Personnel's number and total tester's number, software test each stage day production efficiency and software test each stage it is practical
It evaluates in number, estimated evaluation number and evaluation disqualification rate Input Software test process quality measurement model, becomes for demand
More degree, time schedule stability, personnel's stability, production stability and specification degree of conformity, obtain process stability metric index
Value；
The validity unit, for by the number of the software issue found daily in software test procedure, software test
Research and development institution's confirmation is obtained in executable test case number and the test case number and software test procedure of design in the process
Test problem number and test problem sum Input Software test process quality measurement model in, for the defect degree of convergence, use
Example design availability and problem error detection rate, obtain measure of effectiveness index value；
The adequacy unit, for the demand number and software that are tested use-case covering in software test procedure all need to
Number is sought, is found in the lines of code of Test coverage and whole lines of code and software test procedure in software test procedure
The problem of number and whole issue number Input Software test process quality measurement model in, covered for demand coverage rate, code
Lid rate and use-case adequacy, obtain sufficiency measurement index value；
The traceability unit, for testing the entry Input Software of the document in software test each stage and each document
In Metric of Process Quality model, for positive reversely tracing degree, traceability Measure Indexes value is obtained；
The integrality unit, for what is by need default in software test procedure test-types to be tested, actually carried out
In the weight Input Software test process quality measurement model of test-types and each test-types, for integrity degree, obtain complete
Property Measure Indexes value；
The timeliness unit, for software issue in software test procedure to be introduced stage and software issue discovery phase
In Input Software test process quality measurement model, for timely degree, timeliness Measure Indexes value is obtained.
7th optimal technical scheme provided by the invention, it is improved in that further including modeling module；
The modeling module, for calculating according to the actual test process in software test each stage and default testing process
Process conformity；
The modeling module is also used to the actual measurement Experience of Software Testing Work product according to each stage acquisition of software test and presets
The Experience of Software Testing Work product needed calculates work product degree of conformity；
The modeling module, the need of the demand number and each stage for being also used to be changed according to software test each stage before changing
Number is sought, demand change degree is calculated；
The modeling module is also used to actual duration and proposed duration according to software test each stage, meter
Evaluation time progress stability；
The modeling module is also used to according to the tester's number and total tester changed in software test procedure
Number, computing staff's stability；
The modeling module is also used to the day production efficiency according to software test each stage, calculates production stability；
The modeling module is also used to according to software test each stage practical evaluation number, estimated evaluation number and evaluation
Disqualification rate calculates specification degree of conformity；
Whether the modeling module is also used to be received according to the number of the software issue found daily in software test procedure
It holds back, calculates the defect degree of convergence；
The modeling module is also used to be used according to the test of the test case number and design that can be performed in software test procedure
Number of cases calculates case designing availability；
The modeling module, be also used to according to obtained in software test procedure research and development institution confirmation test problem number and
Test problem sum, computational problem error detection rate；
The modeling module, the demand number for being also used to be covered according to test case in software test procedure and whole demands
Number calculates demand coverage rate；
The modeling module is also used to lines of code and whole code lines according to Test coverage in software test procedure
Number, calculation code coverage rate；
The modeling module is also used to according to the test problem sum and whole issue number found in software test procedure
Mesh calculates use-case adequacy；
The modeling module is also used to according to the item in phase software test job product documentation each in software test procedure
Whether mesh can find the item in source and each phase software test job product documentation in corresponding previous stage document
Whether mesh can find explanation in corresponding the latter half document, calculate positive reversely tracing degree；
The modeling module is also used to according to need default in software test procedure test-types to be tested, practical progress
Test-types and each test-types weight, calculate integrity degree；
The modeling module is also used to introduce stage and software issue discovery rank according to software issue in software test procedure
Section calculates degree in time.
8th optimal technical scheme provided by the invention, it is improved in that the comprehensive assessment module includes: fuzzy
Matrix unit, weight unit and composite calulation unit；
The fuzzy matrix unit establishes fuzzy relation matrix for referring to target value according to each quality metric；
The weight unit, for calculating the weight of each quality metric index using analytic hierarchy process (AHP)；
The composite calulation unit obtains software survey for carrying out composite calulation to the fuzzy relation matrix and weight
Try procedure quality assessment result.
Compared with the immediate prior art, the device have the advantages that as follows:
The present invention brings software test by each stage in software test, by the software test data that the stage generates
In journey quality measurement model, each quality metric index value is obtained, and target value is referred to according to each quality metric, carry out comprehensive assessment meter
It calculates, obtains software test procedure quality assessment result, be able to reflect the mass property in complete procedure each stage of software test,
With preferable comprehensive, while the appraisal procedure of each evaluation index and software test procedure are closely related, with the mechanism that tests and assesses
Quality management system correlation is little, and assessment result has better objectivity and fairness.
Detailed description of the invention
Fig. 1 is a kind of software test procedure quality metric method flow schematic diagram provided by the invention；
Fig. 2 is software test procedure quality measurement model schematic diagram provided by the invention；
Fig. 3 is that a kind of power grid continuous operation provided by the invention emulates in the generation method of section and adjusts flow diagram；
Fig. 4 is the default flow diagram of preset software test procedure quality metric；
Fig. 5 is a kind of software test procedure quality metric system basic structure schematic diagram provided by the invention；
Fig. 6 is a kind of software test procedure quality metric system detailed construction schematic diagram provided by the invention.
Specific embodiment
A specific embodiment of the invention is described in further detail with reference to the accompanying drawing.
A kind of software test procedure quality metric method flow schematic diagram provided by the invention is as shown in Figure 1, comprising:
Step 1: in each stage of software test, bringing the software test data that the stage generates into software test procedure matter
In metric model, each quality metric index value is obtained；
Step 2: target value being referred to according to each quality metric, comprehensive assessment calculating is carried out, obtains software test procedure quality and comment
Estimate result；
Wherein, software test procedure quality measurement model includes: the matter for reflecting complete procedure each stage of software test
Multiple quality metric indexs of flow characteristic.
Specifically, the software test procedure quality measurement model that the present invention establishes is as shown in Fig. 2, include 7 level metrics
Index and 16 second level Measure Indexes.First class index includes: procedural compliance, process stability, validity, adequacy, tracking
Property, integrality and timeliness.Wherein, procedural compliance includes process conformity and work product degree of conformity；Process stability packet
It includes: demand change degree, time schedule stability, personnel's stability, production stability and specification degree of conformity；Validity includes: scarce
Fall into the degree of convergence, case designing availability and problem error detection rate；Adequacy includes: that demand coverage rate, code coverage, use-case are abundant
Property；Traceability includes: positive reversely tracing degree；Integrality includes: integrity degree；Timeliness includes: timely degree.
During software test procedure quality metric, Measure Indexes at different levels are measured first, are then tied according to measurement
Fruit carries out test process quality synthesis evaluation.Analytic hierarchy process (AHP) be comprehensive assessment pass through frequently with method.
Step 101: procedural compliance metric calculation.
The measurement of any pair of process is all built upon clearly process and defines on basis.According to GJB 2725A-2001
" test laboratory and calibration laboratory General Requirement ", software assessment laboratory should establish the quality pipe of suitable software assessment work
Reason system is, it is specified that the main-process stream of assessment process, the working procedure in each stage, requirement and the responsibility of all kinds of personnel.In general, soft
Part testing process includes demand analysis, and planning is tested in testing requirement evaluation, and test plan evaluation is tested design and realized, test
Illustrate to evaluate, tests ready evaluation, test execution, test is summarized and test report evaluates totally 10 parts.It is generated in process
Work product is as shown in table 1.Since actual software test procedure more or less has a certain difference with process model, need
A certain amount standard is taken to be measured, to judge the departure degree of actual test process and process model.Process meets
Property Measure Indexes of the measurement in terms of testing process degree of conformity and work product degree of conformity two as procedural compliance.
Each stage work product of 1 software testing flow of table
| The software testing flow stage | Work product |
| Demand analysis | Software test requirement specification |
| Test planning | Software testing plan |
| Test design and realization | Software test explanation |
| Test execution | Test record, software problem reporting list |
| Test is summarized | Software test report, software test final report |
| The evaluation of each test phase | Evaluate application form, review report |
Step 101-1: process conformity calculates.
Consider from testing process degree of conformity, according to the requirement of laboratory software testing flow, removes testing requirement analysis process
(evaluating comprising testing requirement analysis and demand analysis) can with test course of planning (evaluating comprising test planning and test plan)
Except parallel, other processes successively must be executed serially, as shown in Figure 3.Therefore, inspection test procedure each stage can be passed through
Whether sequence as requested carries out to judge, the measure formulas of process conformity Process are as follows:
Wherein, Process is process conformity, and n indicates that the number of stages of software test, γ indicate software test two stages
Between checkpoint, checkpointγFor the value of checkpoint γ, two stage actual test process meets before and after the γ of checkpoint
When meeting default testing process, checkpointγValue is 1, is otherwise 0.
Specific in the present embodiment, can obtain:
Wherein, checkpoint, that is, checkpoint is to check whether two stages press the procedural order execution of schedule requirement.Symbol
When conjunction requires, checkpointγValue is 1, is otherwise 0, i.e., two stage actual test process meets before and after the γ of checkpoint
When meeting default testing process, checkpointkValue is 1, is otherwise 0.
For the value of Process between 0.0 to 1.0, value indicates that testing process degree of conformity is higher closer to 1.0.
Step 101-2: work product degree of conformity.
Consider from work product degree of conformity, for work product shown in table 1, checks that work product whether there is.Work
Product includes software test requirement specification ReqT, and demand evaluates application form ReqEvaA, demand review report ReqEvaR, soft
Part test plan PlanT, test plan evaluate application form PlanEvaA, test plan review report PlanEvaR, software test
Illustrate that TestcaseT, test specification evaluate application form TestcaseEvaA, test specification review report TestcaseEvaR, surveys
Ready evaluation application form IfreadyEvaA is tried, ready review report IfreadyEvaR is tested, software test records RecT, software
Issue Report BugT, software test report RepT, software test final report SumT, test report evaluate application form
17 class document of SumEvaA, test report review report SumEvaR etc..If certain class work product exists, remembers that its value is 1, otherwise remember
It is 0.The then Measure Indexes of work product degree of conformity WorkProducts are as follows:
Wherein, β indicates the default Experience of Software Testing Work product total number needed, ProductjIndicate whether work product is deposited
, in the presence of value be 1, be otherwise 0.Specifically in the present embodiment, WorkProducts calculates such as following formula:
WorkProducts=(ReqT+ReqEvaA+ReqEvaR+PlanT+PlanEvaA+PlanEvaR+TestcaseT
+TestcaseEvaA+TestcaseEvaR+IfreadyEvaA+IfreadyEvaR+RecT+BugT+RepT+SumT+
SumEvaA+SumEvaR)/17(2)
The value of WorkProducts is between 0.0 to 1.0, and value is closer to 1.0, then it represents that work product degree of conformity is got over
It is high.
Step 102: process stability metric calculation.
Before the stability that test process is discussed, a core focus of software test procedure measurement is introduced first:
Process performance.Process performance expression follow a process actual result achieved, for evaluate a process meet client and
The ability of each critical aspects of tissue.Process performance usually can reflect the attribute or test process sheet in test process product
On the attribute of body, such as number, the number of software issue, the fund and manpower consumption in project of creation use-case.If software
The irregular variation for a long time of test process performance number, value is unpredictable, then illustrates that the test process is unstable, explanation
There are some factors in the execution of influence process.These factors are found and eliminated, process stability is not only can guarantee, also can be improved
Process performance, while promoting the quality of entire test process.Process stability include demand change degree, time schedule stability,
Personnel's stability, production five second level Measure Indexes such as stability and specification degree of conformity.
Step 102-1: demand change degree calculates.
The n stage of software test procedure is indicated with i, i.e. i=0,1,2,3,4 respectively indicates testing requirement analysis, surveys
Try planning, test design and realization, test execution and test feedback and evaluation.Testing requirement is generated in test process stage i to become
More, the demand number of change is ModifyReqi, aggregate demand number is OriReq before change occursi, there is intermediate variableLead to <=0 m when testing requirement changes number or excessive number, thinks that test needs at this time
It asks change excessively frequent, can be sayed without stability.The measure formulas for obtaining Measure Indexes demand change degree Modify is as follows:
The value of Modify illustrates to influence fewer, test process caused by demand change closer to 1.0 between 0.0 to 1.0
It is more stable.
Step 102-2: time schedule stability calculates.
Time schedule is measured using the concept of matching degree.It the n stage that software test procedure is indicated with i, that is, surveys
It tries demand analysis, test planning, test design and realization, test execution and test feedback and evaluation.From the angle of time and progress,
Utilize the actual duration Time of stage i each in test processiWith proposed duration PlantimeiMatching degree say
Whether whether bright test process deviates target advance, can steady in terms of time schedule from one side reflection software test procedure
It is fixed.Wherein, preset time judgment threshold k is determined according to the actual situation.WhenWhen greater than k value, it is believed that
Time fluctuation is excessive, stability 0, the time stability S of stage iiShown in calculation formula such as formula (4).
So for entire test process, the measure formulas of Measure Indexes time schedule stability Schedule are as follows:
For the value of Schedule between 0.0 to 1.0, value illustrates the time schedule of test process and plan closer to 1.0
Matching degree is better, and test process is more stable.
Step 102-3: personnel's stability calculates.
During the actual test of assessment project, there is tester's alteration often, to influence test process.
The whether stable stability for directly affecting assessment process of personnel.If the total number of persons C that personnel change is more than to work in test process
Total number of persons A, it is believed that personnel change excessively frequent, coefficient of stabilization 0.Personnel's stability Staff's specific formula is as follows:
The value of Staff between 0.0 to 1.0, get over by the influence that value illustrates that personnel change to test process closer to 1.0
Small, test process is more stable.
Step 102-4: production stability calculates.
Whithin a period of time in the daily work load of continued smooth, if day production efficiency has paroxysmal growth or drop
It is low, if there is be more than setting efficiency threshold day production efficiency change (including increment or decrement), then very possible indication
Software test procedure it is unstable, by Measure Indexes production stability productivity be set to 0, otherwise productivity is
1.The efficiency threshold can be set as 30%.
Step 102-5: specification degree of conformity calculates.
Suitable for the software test procedure for testing and assessing laboratory, evaluation is the important stage of reaction process stability.I
Indicate different evaluation stages of software test procedure with i, i.e., testing requirement evaluation, test plan evaluation, test specification evaluation,
Test ready evaluation, test report evaluation stage.For a certain Review Workflow i, go out from the practical evaluation situation in assessment laboratory
Hair chooses two aspects of evaluation number and evaluation disqualification rate to consider the Measure Indexes.On the one hand, it is contemplated that evaluation n times are practical
Evaluation number is N '.If it is expected that evaluation number and practical evaluation number differ by more than preset evaluation frequency threshold value N0(N0Value can
It is set according to actual conditions), then it is assumed that specification degree of conformity is 0.Otherwise, it usesIndicate evaluation number to specification accordance
Influence；On the other hand, if the disqualification rate Unqualified that jth time is evaluated in evaluation stage ij=nonconformance number/quilt
Check a number.Ideally, the disqualification rate of evaluation should be gradually decreased with the increase of evaluation number.In practical N '
In secondary evaluation, Unqualified is indicated with rj< Unqualifiedj+1Number evaluate disqualification rate relatively after it is primary low
Number；, then influence of the evaluation disqualification rate to specification accordance can be usedIt indicates.Comprehensive both the above influence because
Element obtains the specification degree of conformity Standard of evaluation stage iiCalculation formula:
So, for all evaluation stages of entire software test procedure, specification degree of conformity Standard calculation formula is such as
Under:
The value of Standard is between 0.0 to 1.0, and value is closer to 1.0, and implementation degree of conformity is higher, test process
It is more stable.
Step 103: measure of effectiveness calculates.
In general, validity refers to: under specified use environment, whether user can be correct and complete when executing corresponding task
Complete reaches defined target.In software test procedure, validity refer to software test procedure completed and with test
The matching degree of expected results is higher, the problem of having found software as much as possible and defect.The measurement of validity refers to
Mark includes 3 the defect degree of convergence, case designing availability and problem error detection rate two-level index.
Step 103-1: the defect degree of convergence calculates.
In software test procedure, the discovery number of software issue can gradually decrease over time, software defect number
Gradually convergence state is presented in mesh in entire test process.If software defect number restrains, reflect that test process is effective.
If in the case where not newly-increased testing requirement, the bug number found daily is at convergent tendency, then within one section of testing time
Defect degree of convergence BugStypticity=1, test process validity are good；Otherwise BugStypticity=0, test process are effective
Property is poor.
Step 103-2: case designing availability calculates.
During the test, some test cases may be not up to expected test target, then the test case is invalid
, to influence the quality of test process.Case designing availability CaseEffectiveness then passes through executable test
Reflected with the ratio of the test case number of number of cases and design.CaseEffectiveness such as following formula calculates:
CaseEffectiveness=Testcaseexec/Testcasedesign (10)
Wherein TestcaseexecIndicate executable use-case number；TestcasedesignIndicate the use-case number of design.
The value of CaseEffectiveness is between 0.0 to 1.0, and value is closer to 1.0, then it represents that Test Sample Design
More effective, test process validity is better.
Step 103-3: problem error detection rate calculates.
The test problem that problem error detection rate BugExplore refers to obtain research and development institution's confirmation accounts for assessment mechanism and was testing
The ratio of the total problem found in journey.Problem error detection rate is higher, then illustrates that the significant problem found in test process is more, test
Quality is higher.The measure formulas of problem error detection rate is as follows:
BugExplore=Bugscomfirm/Bugstester (11)
Wherein, BugscomfirmIndicate the bug number that tester has found and confirmed by developer in test process；
BugstesterIndicate bug number, that is, test problem sum of tester's discovery in test process.
The value of BugExplore is between 0.0 to 1.0, and value is closer to 1.0, then it represents that problem error detection rate is higher, test
Process validity is better.
Step 104: sufficiency measurement calculates.
One is successfully tested the adequacy for be unableing to do without test.Performance of the software in test case can adequately react
The aggregate performance of software.The adequacy of software test is to judge software in institute from behavior of the software in limited multiple test cases
There are the logical foundations of the behavior in input data.
Any software test procedure can only all have limited test set, because test all must be in limited test
Interior completion.Meanwhile even if all having carried out sufficient test to all modules of software, it is also not meant to the test of entire software
It is abundant, it is necessary to guarantee that test is sufficient under limited time and limited test set as far as possible.Software test
Adequacy should to the demand of software and realize it is all related.It, on the one hand can be by soft to the measurement of software test adequacy
The data being collected into part test process are judged.On the other hand, it can also be tried by tested software product by user
With or use after, the judgement of the information that feeds back.Sufficiency measurement index includes demand coverage rate, code coverage and use-case
Three Measure Indexes such as adequacy.
Step 104-1: demand coverage rate calculates.
Demand coverage rate refer to test case covering software requirement degree, by be tested use-case covering demand number with
The ratio of software whole demand number indicates.The measure formulas of demand coverage rate ReqCoverage is as follows:
ReqCoverage=Reqcovered/Reqall (12)
Wherein, Reqcovered indicates the demand number of test case covering；Reqall indicates whole demand numbers.
The value of ReqCoverage is between 0.0 to 1.0, and value is closer to 1.0, then it represents that demand coverage rate is higher, sufficiently
Property is higher.
Step 104-2: code coverage calculates.
Code coverage refers to that the lines of code of Test coverage accounts for the ratio of whole lines of code.Code coverage is higher,
Illustrate that the test to code is more abundant.The measure formulas of code coverage CodeCoverage is as follows:
CodeCoverage=Codecovered/Codeall (13)
Wherein, CodecoveredIndicate the lines of code of tested covering；CodeallIndicate whole lines of code.
For the value of CodeCoverage between 0.0 to 1.0, value illustrates that code coverage is higher closer to 1.0, test
Adequacy is higher.
Step 104-3: use-case adequacy calculates.
Use-case adequacy is whether the ability of verification test use-case discovery test problem is abundant, which is to pass through survey
The software issue detected during examination accounts for the ratio for the software issue being all found to measure.If after product publication, visitor
Family has found the defect for not having discovery in test process, then illustrates that testing example design is insufficient.Use-case adequacy
The measure formulas of CaseCoverage is as follows:
CaseCoverage=Bugstester/Bugsall=Bugstester/(Bugstester+Bugscustomer) (14)
Wherein, BugstesterIt is found in bug number, that is, software test procedure of tester's discovery in expression test process
Test problem sum；BugscustomerIndicate the bug number found in user's use process, Bugstester+BugscustomerIt is as complete
Portion number of questions Bugsall。
For the value of use-case adequacy CaseCoverage between 0.0 to 1.0, value illustrates use-case adequacy closer to 1.0
Better, testing adequacy is higher.
Step 105: traceability metric calculation.
Junior's index of traceability includes positive reversely tracing degree.Document is the movable important component of software test.With
The deepening continuously, upgrade of software development and test process, the continuous generation and discovery of new problem and defect, be necessarily required to document
Entire test process is recorded, arranged and summarized, guarantees the progress of software test activity according to schedule without any confusion.It surveys
Movable traceability is tried, is the important guarantee of each being consistent property of document and the important guarantee of test process quality.?
In metrics process, the present embodiment Selection Software statement of requirements SReq, testing requirement specification ReqT, software testing plan
PlanT, software test illustrate six documents such as TestcaseT, software test record RecT, software test report RepT, these
Should all there be tracking relationship between document is adjacent two every:
1. reverse traceability.In addition to first software test job product documentation, that is, software requirement explanation, for other
Entry in each document can clearly find out its source in early stage document.
2. positive traceability.In addition to the last one Experience of Software Testing Work product documentation, that is, software problem reporting, for it
Entry in his each document can clearly find its corresponding detailed content in later period document.
Correspondence of this traceability dependent on index and unique number in document.It can thus be concluded that:
Wherein, Trace indicates that positive reversely tracing degree, α indicate each phase software test job product in software test procedure
The number of document, DucFδThe reverse traceability for indicating the δ Experience of Software Testing Work product documentation except the first, when
DucF when entry in the δ Experience of Software Testing Work product documentation can find source in corresponding previous stage documentδValue
It is 1, is otherwise 0；DucRδIndicate the positive traceability of the δ Experience of Software Testing Work product documentation other than the last one,
The DucR when the entry in the δ Experience of Software Testing Work product documentation can be found in corresponding the latter half document to be illustratedδIt takes
Value is 1, is otherwise 0；
Specifically in the present embodiment, reverse traceability is indicated with document name+F, and positive traceability is with document name+R table
Show, such as testing requirement specification document ReqT, is indicated in reverse traceability with ReqTF, in positive traceability
It is indicated with ReqTR.If the document exists, value 1；If document is not present, value 0.
If reverse traceability is indicated with R, positive traceability is indicated with F, and the numerical value of each single item is with traceable hundred
Divide than indicating, then reverse traceability TraceR and positive traceability TraceF are as follows:
TraceR=(ReqTR+PlanTR+TestcaseTR+RecT+RepTR)/5
TraceF=(SReqF+ReqTF+PlanTF+TestcaseTF+RecTF)/5
Since positive and reverse traceability has a reciprocal relation, the positive reversely tracing degree of two-level index of traceability measurement with
Trace mark, measure formulas are as follows:
Trace=(SReqF+ReqTR+ReqTF+PlanTR+PlanTF+TestcaseTR+TestcaseTF+Re cTR+
RecTF+RepTR)/10 (15)
For the value of positive reversely tracing degree Trace between 0.0 and 1.0, value illustrates software test procedure closer to 1.0
Traceability it is stronger.
Step 106: integrity measurement calculates.
Junior's index of integrality includes integrity degree.Meeting speed measuring with software model is wanted to the standard of software product
It asks, test is judgement and the important means for guaranteeing this requirement realization.In recent years, using being more widely ISO/IEC 9126
25010 software quality models of ISO/IEC of software quality models and its on its basis modification and perfection.25010 matter of ISO/IEC
Propose 8 qualitative characters in amount model: functional, safety, interoperability, reliability, availability, efficiency, it is maintainable and
It is portable.Software test type includes: functional test, safety test, ease for use test, pressure test, emphasizes test, is available
Property test, performance test, stability test, installation test and transplanting test.It is whether full in order to test software product as far as possible
Sufficient quality model is required, and software test type is carried out corresponding point with the qualitative character of speed measuring with software model by us
Class, as shown in Figure 4.It therefore, can be by the quality requirement of tested software, to judge whether test-types are complete.Test-types
More abundant perfect, the quality of software test procedure can also be promoted therewith.In test process, the significance level of test-types often by
High, medium and low expression assigns weight to significance level respectively according to actual test demand, then the calculating of integrity degree Complete is public
Formula is as follows:
Complete=1- ∑ Absencej*ωj (16)
Wherein AbsencejThe test-types for indicating some missing need to test by being arranged in comparison software test process
Test-types and the test-types that actually carry out obtain.If some test-types j lacks, corresponding AbsencejIt is 1, it is no
It is then 0.ωjIndicate the corresponding weight of the test-types.0.0 <=Complete <=1.0, Complete value is closer
1.0 tests are more complete.
Step 107: timeliness metric calculation.
Junior's index of timeliness includes spending in time.Timeliness requires software issue or the hair of defect in software test procedure
It now should be timely and effective.For example, if certain software issue originally can find that practical discovery time is but in the code inspection stage
It has been delayed the System Integration Test stage.Although this software issue is not hidden, increase to a certain extent
The cost of problem reparation, affects testing progress and quality.In order to measure and solve this problem, we can be in discovery software
Co-development personnel analyze " software issue introduces the stage " when problem.Software issue introducing stage and software issue is being determined
After discovery phase, the table of comparisons 2 and table 3 obtain software issue and introduce stage PhaseembeddedWith software issue discovery phase
PhaseactValue.
Table 2 introduces the assignment in stage to software issue
| Software issue introduces the stage | Demand analysis stage | Design phase | Coding stage | Test phase |
| PhaseembeddedValue | 0 | 1 | 2 | 3 |
Assignment of the table 3 to software issue discovery phase
For the timely degree Intime of single software issue ii, have:
So test process find the problem number be s in the case where, in time spend Intime calculation formula it is as follows:
0.0 <=Intime <=1.0, Intime value describes the problem closer to 1.0 and finds more timely, software test
Cheng Zhiliang is higher.
Step 108: according to each finger target value, carrying out comprehensive assessment calculating, obtain software test procedure quality assessment result.
I.e. according to each finger target value, fuzzy relation matrix is established；
The weight of each quality metric index is calculated using analytic hierarchy process (AHP)；
Fuzzy composition calculating is carried out to fuzzy relation matrix and weight, obtains software test procedure quality assessment result.
Embodiment 2:
An a specific embodiment of the invention is given below.
Assess preparation:
Fuzzy overall evaluation is that the fuzzy indicator for reflecting object of being appraised things through discussion is quantified by construction class fuzzy subset, so
Each index is integrated using blurring mapping principle afterwards.Due to including that 7 first class index and 16 second levels refer in measurement model
Mark, can successively carry out fuzzy evaluation.Now illustrate the establishment process of assessment models by taking first class index as an example.
Determine the set of factors U={ u1, u2, u3, u4, u5, u6, u7 } of evaluation object, i.e. { procedural compliance, process are steady by U=
Qualitative, validity, adequacy, traceability, integrality, timeliness }, the weight of each factor be W=w1, w2, w3, w4, w5,
W6, w7 }.
Determine Comment gathers V={ v1, v2, v3, v4 }, i.e. class set.Wherein v1 indicate quality it is outstanding, v2 indicate quality compared with
Height, v3 indicate that quality is general, and v4 indicates second-rate.Each grade can correspond to a fuzzy subset.Whole Measure Indexes
Value range is all controlled in the range of [0.0,1.0], and indicates that quality is higher closer to 1.0.It evaluates for ease of calculation,
We quantify subjective assessment, are shown in Table 4.
4 subjective assessment quantitative criteria of table
| Comment | Evaluation of estimate |
| V1/ mass is outstanding | 0.875~1 |
| V2/ mass is higher | 0.625~0.875 |
| V3/ mass is general | 0.375~0.625 |
| V4/ is second-rate | 0~0.375 |
Establish fuzzy relationship matrix r.It, be by Measure Indexes one by one to software test after constructing grade fuzzy subset
Procedure quality is quantified from each factor U, that is, determines the fuzzy son of software test procedure quality In Grade from the point of view of single factor test
The degree of membership (R | ui) of collection.The single factor evaluation vector of procedural compliance u1 is that similarly other can be obtained in R1=(r11, r12)
The evaluation vector R2, R3 ..., R7 of single factor test.R1 to R7 is combined into fuzzy relationship matrix r.
Make blurring mapping using suitable operator, and result is normalized.Here we use Fuzzy Arithmetic Operators, its table
Show that software test procedure quality sees the subjection degree to V grade fuzzy subset on the whole.According to as a result, to fuzzy overall evaluation
Result vector is analyzed, and the assessment result of software test procedure quality is obtained.The calculation method of Fuzzy Arithmetic Operators is as follows.Square
Element in battle array B, W, R uses bk respectively, and wj, rjk are indicated.
Weight of Coefficient through Analytic Hierarchy Process:
By the establishment process of above-mentioned assessment models it is found that seeking weight is the key that overall merit.Analytic hierarchy process (AHP) is a kind of
The method of effective determining weight coefficient, each factor in challenge is divided into the orderly layer interknited and is allowed to item by it
Physics and chemistry recycles mathematics with regard to the expression of the relative importance quantitative of each level according to extension fuzzy Judgment
Method determines the weight coefficient of whole element relative importance order.
For 7 factor of evaluation U={ u1, u2, u3, u4, u5, u6, u7 } described above, Judgement Matricies.According to
Influence situation of each factor to software test procedure quality indicates ui pairs with uij using the method for 1-9 and its mark of inverse
The relative importance numerical value of uj obtains judgment matrix S=(uij) 7*7.
According to judgment matrix S, feature vector ω corresponding to its Maximum characteristic root is found out.The feature vector ω acquired is returned
One changes, the weight of as each factor of evaluation.
It needs to carry out consistency check to judgment matrix to judge whether weight distribution derived above is reasonable.It examines using public
Formula CR=CI/RI, wherein CR is the random consistency ratio of judgment matrix；CI is the general coincident indicator of judgment matrix, RI
Value for the Aver-age Random Consistency Index of judgment matrix, RI is related with order of matrix number, as shown in table 5.When judgment matrix S's
When CR < 0.1 or when λ=n, CI=0, it is believed that S has satisfied consistency, and above-mentioned calculated weight is effective.Otherwise it needs to adjust
Element in S is to reach coherence request.
The corresponding R work value of 51~9 rank matrix of table
| N | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 |
| RI | 0 | 0 | 0.58 | 0.90 | 1.12 | 1.24 | 1.32 | 1.41 | 1.45 |
The actual conditions for carrying out certain test assignment in 2014 according to certain assessment mechanism, are surveyed in conjunction with software provided by the invention
Metric of Process Quality model is tried, the quality of the software test procedure of the project is measured.Its process is as described below.
Step 201: procedural compliance assessment calculates.
Entire test process requires to execute fully according to testing process, and the work product of each process requirements is all complete.
According to formula (1) and (2), Process=1.0, WorkProducts=1.0 can be calculated.
Step 202: process stability assessment assessment calculates.
The data of reaction process stability are as shown in the table:
The data of 6 reaction process stability of table
| Title | Description |
| Demand changes number (a) | 0 |
| Proposed duration | 2015-03-05~2015-05-01, working day totally 42 days |
| Actual duration | 2015-03-05~2015-04-18, working day totally 33 days |
| Personnel's stability | 1 |
According to formula (3)~(5), Modify=1.0, Schedule=0.79 can be calculated.
Step 203: efficiency assessment calculates.
The data of design and implementation situation in test process are as shown in table 7.Test defect with the testing time progress,
It is gradually reduced, therefore defect degree of convergence BugStypticity is 1.
Design and implementation data in 7 test process of table
It can be calculated, test case validity CaseEffectiveness=1, problem error detection rate BugExplore=1.
Step 204: adequacy assessment calculates.
Since this test case is Acceptance Test, code inspection or unit testing are not carried out.Outline is tested to pass through
Evaluation, therefore use-case adequacy CaseCoverage is 1.As shown in Table 7, demand coverage rate ReqCoverage=1.
Step 205: traceability assessment calculates.
The achievement data of reactive tracing is as shown in the table
Traceability achievement data between 8 document of table
| Document | Reversely tracing | Forward direction tracking |
| Software requirement explanation | --- | 1 |
| Testing requirement specification | 0.98 | 1 |
| Software testing plan | 1 | 1 |
| Software test explanation | 0.90 | 1 |
| Software test record | 1 | 1 |
| Software test report | 1 | --- |
By formula (15), positive reversely tracing degree Trace=0.988 can be calculated.
Step 206: integrity assessment calculates.
The data that whole property assessment needs are as shown in the table, and the test-types wherein having in test process are indicated with √, no
Then with × expression.
9 integrity assessment initial data of table
| The attribute that tested software requires | Test-types |
| Functional (significance level: high) | Functional test (√) |
| Safety (significance level: high) | Security test (×) |
| Reliability (significance level: in) | Pressure test (×), strength test (√) |
| Efficiency (significance level: high) | Performance test (√) |
| Portable (significance level: in) | Installation test (√), transplanting test (×) |
The high, medium and low quantization respectively of significance level is indicated with 3,2,1, the weight that above-mentioned test-types can be obtained is
(0.176,0.176,0.118,0.118,0.176,0.118,0.118), then according to formula (16), Complete=0.588.
Step 207: timeliness assessment calculates.
During the test, altogether the problem of two interface discovery interface functions fail.Through confirming with developer
And communication finds the problem in system testing during the test the problem of belonging to the design phase and introduce.Therefore by formula (18)
It is found that spending Intime=1 in time.
Step 208: software test procedure quality synthesis evaluation calculates.
{ procedural compliance, process stability, validity, adequacy, traceability are complete by the set of factors U=of setting evaluation object
Whole property, timeliness }, the weight of each factor is W={ w1, w2, w3, w4, w5, w6, w7}.By the calculating of aforementioned evaluations preparation
Fuzzy relationship matrix r can be obtained.To simplify explanation, it is 0.5 He that 2 Measure Indexes in process stability are assigned weight respectively
0.5.It should continue the weight that the two Measure Indexes are calculated with analytic hierarchy process (AHP) during actual assessment.
The weight vector W of evaluation object set of factors is determined with analytic hierarchy process (AHP) again.Firstly, according to this software test in practice
It is required that carrying out importance analysis, Judgement Matricies S to 7 factors by expert.
Maximum characteristic root λ is calculatedmax=7.130, corresponding feature vector be 2.529,1.549,9.104,6.119,
1.549,3.988,1.000 }.Consistency check is carried out to the result,CR=
CI/RI=0.0164 < 0.1, therefore the feature vector being calculated is effective.Normalizing obtain weight W=0.09,0.06,0.35,
0.24,0.06,0.15,0.05 }.
Finally, W is synthesized to obtain fuzzy overall evaluation result vector B with R using M (, ∨) Fuzzy Arithmetic Operators.According to
B=(0.805,0.03,0.15,0.00) can be obtained in formula (19).By maximum membership grade principle, illustrate this software test
Cheng Zhiliang belongs to V1 grades, is " quality is outstanding ".The result and opinion, the test and evaluation report experts' evaluation result of assessment consigner etc. pair
The judgement of the actual conditions of the software test is consistent.
Embodiment 3:
Based on the same inventive concept, the present invention also provides a kind of software test procedure quality metric systems, due to these
The principle that equipment solves technical problem is similar to software test procedure quality metric method, and overlaps will not be repeated.
The system basic structure is as shown in Figure 5, comprising: index value obtains module and comprehensive assessment module；
Wherein, index value obtains module, for each stage in software test, the software test data which is generated
It brings into software test procedure quality measurement model, obtains each quality metric index value；
Comprehensive assessment module carries out comprehensive assessment calculating, obtains software test for referring to target value according to each quality metric
Procedure quality assessment result；
Wherein, software test procedure quality measurement model includes: the matter for reflecting complete procedure each stage of software test
Multiple quality metric indexs of flow characteristic.
Software test procedure quality metric system detailed construction schematic diagram is as shown in Figure 6.Wherein, index value obtains module packet
Include procedural compliance unit, process stability unit, validity unit, adequacy unit, traceability unit, integrality unit and
Timeliness unit；
Procedural compliance unit, for by with the actual test process in software test each stage and default testing process, with
And the Experience of Software Testing Work product that software test each stage obtains is surveyed with the default Experience of Software Testing Work product Input Software needed
It tries, for process conformity and work product degree of conformity, to obtain procedural compliance Measure Indexes value in Metric of Process Quality model；
Process stability unit, for the demand by the demand number and each stage of each stage change of software test before changing
Number, the actual duration and proposed duration in software test each stage, the tester changed in software test procedure
Number and total tester's number, the day production efficiency and software test each stage practical evaluation in software test each stage
In number, estimated evaluation number and evaluation disqualification rate Input Software test process quality measurement model, for demand change degree,
Time schedule stability, personnel's stability, production stability and specification degree of conformity, obtain process stability metric index value；
Validity unit, for by the number of the software issue found daily in software test procedure, software test procedure
In can be performed test case number and design test case number and software test procedure in obtain research and development institution confirmation survey
It tries to set in number of questions and test problem sum Input Software test process quality measurement model for the defect degree of convergence, use-case
In respect of validity and problem error detection rate, measure of effectiveness index value is obtained；
Adequacy unit, for the demand number and software whole demand number of use-case covering will to be tested in software test procedure
Mesh, what is found in software test procedure in the lines of code of Test coverage and whole lines of code and software test procedure asks
It inscribes in number and whole issue number Input Software test process quality measurement model, for demand coverage rate, code coverage
With use-case adequacy, sufficiency measurement index value is obtained；
Traceability unit, for by the entry Input Software test process of the document in software test each stage and each document
In quality measurement model, for positive reversely tracing degree, traceability Measure Indexes value is obtained；
Integrality unit, the test for by need default in software test procedure test-types to be tested, actually carrying out
In the weight Input Software test process quality measurement model of type and each test-types, for integrity degree, integrality degree is obtained
Figureofmerit value；
Timeliness unit, for software issue in software test procedure to be introduced stage and the input of software issue discovery phase
In software test procedure quality measurement model, for timely degree, timeliness Measure Indexes value is obtained.
Wherein, software test procedure quality metric system further includes modeling module；
Modeling module, for according to the actual test process in software test each stage and default testing process, calculation process
Degree of conformity；
Modeling module is also used to the actual measurement Experience of Software Testing Work product and default needs obtained according to software test each stage
Experience of Software Testing Work product, calculate work product degree of conformity；
Modeling module, the demand number of the demand number and each stage for being also used to be changed according to software test each stage before changing
Mesh calculates demand change degree；
Modeling module, is also used to actual duration and proposed duration according to software test each stage, when calculating
Between progress stability；
Modeling module is also used to according to the tester's number and total tester's number changed in software test procedure
Mesh, computing staff's stability；
Modeling module is also used to the day production efficiency according to software test each stage, calculates production stability；
Modeling module is also used to not conformed to according to software test each stage practical evaluation number, estimated evaluation number and evaluation
Lattice rate calculates specification degree of conformity；
Whether modeling module is also used to be restrained according to the number of the software issue found daily in software test procedure, meter
Calculate the defect degree of convergence；
Modeling module is also used to the test case according to the test case number and design that can be performed in software test procedure
Number calculates case designing availability；
Modeling module is also used to according to the test problem number and test for obtaining research and development institution's confirmation in software test procedure
Issue Totals, computational problem error detection rate；
Modeling module, the number of the demand number for being also used to be covered according to test case in software test procedure and whole demands
Mesh calculates demand coverage rate；
Modeling module is also used to lines of code and whole lines of code according to Test coverage in software test procedure, meter
Calculate code coverage；
Modeling module is also used to according to the test problem sum and whole issue number found in software test procedure, meter
Calculate use-case adequacy；
Modeling module, be also used to be according to the entry in phase software test job product documentation each in software test procedure
The no entry that can be found in corresponding previous stage document in source and each phase software test job product documentation is
It is no to find explanation in corresponding the latter half document, calculate positive reversely tracing degree；
Modeling module is also used to the survey according to need default in software test procedure test-types to be tested, actually carried out
The weight of type and each test-types is tried, integrity degree is calculated；
Modeling module is also used to introduce stage and software issue discovery phase according to software issue in software test procedure,
Calculate degree in time.
Wherein, comprehensive assessment module includes: fuzzy matrix unit, weight unit and composite calulation unit；
Fuzzy matrix unit establishes fuzzy relation matrix for referring to target value according to each quality metric；
Weight unit, for calculating the weight of each quality metric index using analytic hierarchy process (AHP)；
Composite calulation unit obtains software test procedure matter for carrying out composite calulation to fuzzy relation matrix and weight
Measure assessment result.
Preferably, according to the actual test process in software test each stage and default testing process, calculation process degree of conformity,
Such as following formula:
Wherein, Process is process conformity, and n indicates that the number of stages of software test, γ indicate software test two stages
Between checkpoint, checkpointγFor the value of checkpoint γ, two stage actual test process meets before and after the γ of checkpoint
When meeting default testing process, checkpointγValue is 1, is otherwise 0；
Preferably, the actual measurement Experience of Software Testing Work product and the default software needed obtained according to software test each stage is surveyed
Work product is tried, calculates work product degree of conformity, such as following formula:
Wherein WorkProducts indicates work product degree of conformity, and β indicates that the default Experience of Software Testing Work product needed is total
Number, the actual measurement Experience of Software Testing Work product that the default Experience of Software Testing Work product needed of jth obtains in software test each stage
In in the presence of, ProductjValue is 1, is otherwise 0；
Preferably, the demand number according to the demand number and each stage of each stage change of software test before changing, calculates
Demand change degree, such as following formula:
Wherein, Modify indicates that demand change degree, intermediate variable m such as following formula calculate:
Wherein, n indicates the number of stages of software test, ModifyReqiIndicate that generating test in test process stage i needs
Seek change OriReqiIndicate the aggregate demand number before test process stage i change occurs；
Preferably, according to the actual duration and proposed duration in software test each stage, it is steady to calculate time schedule
Fixed degree, such as following formula:
Wherein, Schedule indicates time schedule stability, and n indicates the number of stages of software test, SiIndicate that software is surveyed
The time stability of examination stage i, SiAs following formula calculates:
TimeiIndicate the actual duration of software test stage i, PlantimeiIndicate the plan of software test stage i
Duration, k are preset time judgment threshold；
Preferably, according to the tester's number and total tester's number changed in software test procedure, people is calculated
Member's stability, such as following formula:
Wherein, Staff indicates personnel's stability, and C indicates total tester's number, and A indicates to become in software test procedure
Dynamic tester's number；
Preferably, according to the day production efficiency in software test each stage, production stability is calculated, such as following formula:
Wherein, productivity indicates production stability；
Preferably, it according to software test each stage practical evaluation number, estimated evaluation number and evaluation disqualification rate, calculates
Specification degree of conformity, such as following formula:
Wherein, Standard indicates the specification degree of conformity of entire software test procedure, and n indicates the number of stages of software test
Mesh, StandardiIndicate the specification degree of conformity in i-th of software test stage, StandardiAs following formula calculates:
Wherein, N0Indicating preset evaluation frequency threshold value, N indicates i-th of software test stage estimated evaluation number,
N ' indicates that reality evaluation number, r indicate in the multiple evaluation in i-th of software test stage that evaluation disqualification rate is relatively rear primary
Low number；
Preferably, whether restrained according to the number of the software issue found daily in software test procedure, calculate defect and receive
Degree of holding back, such as following formula:
Wherein, BugStypticity indicates the defect degree of convergence, and convergence indicates that the software number found daily increases with the date
And it reduces；
Preferably, it according to the test case number of the test case number and design that can be performed in software test procedure, calculates and uses
Example design availability, such as following formula:
CaseEffectiveness=Testcaseexec/Testcasedesign
Wherein, CaseEffectiveness indicates case designing availability, TestcaseexecIndicate executable use-case
Number, TestcasedesignIndicate design uses number of cases；
Preferably, total according to the test problem number and test problem that obtain research and development institution's confirmation in software test procedure
Number, computational problem error detection rate, such as following formula:
BugExplore=Bugscomfirm/Bugstester
Wherein, BugExplore indicates problem error detection rate, BugscomfirmIt indicates to obtain research and development institution in software test procedure
The test problem number of confirmation, BugstesterIndicate test problem sum；
Preferably, according to the demand number covered of test case in software test procedure and the number of whole demands, calculating is needed
Ask coverage rate, such as following formula:
ReqCoverage=Reqcovered/Reqall
Wherein, ReqCoverage indicates demand coverage rate, and Reqcovered indicates that test case is covered in software test procedure
The demand number of lid, Reqall indicate whole demand numbers；
Preferably, it is covered according to the lines of code of Test coverage in software test procedure and whole lines of code, calculation code
Lid rate, such as following formula:
CodeCoverage=Codecovered/Codeall
Wherein, CodeCoverage indicates code coverage, CodecoveredIndicate the lines of code of tested covering,
CodeallIndicate whole lines of code；
Preferably, it according to the test problem sum and whole issue number found in software test procedure, calculates use-case and fills
Divide property, such as following formula:
CaseCoverage=Bugstester/Bugsall
Wherein, CaseCoverage indicates use-case adequacy, BugstesterIndicate the problem of finding in software test procedure
Number, BugsallIndicate whole issue number；
Preferably, whether can be according to the entry in phase software test job product documentation each in software test procedure
Whether entry in source and each phase software test job product documentation is found in corresponding previous stage document can be
Explanation is found in corresponding the latter half document, calculates positive reversely tracing degree, such as following formula:
Wherein, Trace indicates that positive reversely tracing degree, α indicate each phase software test job product in software test procedure
The number of document, DucFδThe reverse traceability for indicating the δ Experience of Software Testing Work product documentation except the first, when
DucF when entry in the δ Experience of Software Testing Work product documentation can find source in corresponding previous stage documentδValue
It is 1, is otherwise 0；DucRδIndicate the positive traceability of the δ Experience of Software Testing Work product documentation other than the last one,
The DucR when the entry in the δ Experience of Software Testing Work product documentation can be found in corresponding the latter half document to be illustratedδIt takes
Value is 1, is otherwise 0；
Preferably, which is characterized in that according to need default in software test procedure test-types to be tested, actually carry out
The weight of test-types and each test-types calculates integrity degree, such as following formula:
Complete=1- ∑ Absencej*ωj
Wherein, Complete indicates integrity degree, AbsencejIndicating that comparison is default needs test-types to be tested and reality
The test-types for the missing that the test-types of progress obtain, when test-types j is lacked, AbsencejIt is 1, is otherwise 0；ωjIt indicates
The weight of test-types j；
Preferably, stage and software issue discovery phase are introduced according to software issue in software test procedure, calculated timely
Degree, such as following formula:
Wherein Intime indicates that degree in time, s indicate that test process finds software issue number, IhtimeiIt indicates to ask for i-th
The timely degree of topic；IntimeiAs following formula calculates:
Wherein, PhaseembeddedIndicate that software issue introduces the assignment in stage, PhaseactIndicate software issue discovery phase
Assignment
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Finally it should be noted that: above embodiments are merely to illustrate the technical solution of the application rather than to its protection scopes
Limitation, although the application is described in detail referring to above-described embodiment, those of ordinary skill in the art should
Understand: those skilled in the art read the specific embodiment of application can still be carried out after the application various changes, modification or
Person's equivalent replacement, but these changes, modification or equivalent replacement, are applying within pending claims.
Claims (10)
1. a kind of software test procedure quality metric method, it is characterised in that:
In each stage of software test, the software test data that the stage generates is brought into software test procedure quality metric mould
In type, each quality metric index value is obtained；
Refer to target value according to each quality metric, carries out comprehensive assessment calculating, obtain software test procedure quality assessment result；
The software test procedure quality measurement model includes: the mass property for reflecting complete procedure each stage of software test
Multiple quality metric indexs.
2. the method as described in claim 1, which is characterized in that each stage in software test, by software test data
It brings into software test procedure quality measurement model, obtains each quality metric index value, comprising:
It is soft by being obtained with the actual test process in software test each stage and default testing process and software test each stage
In part test job product and the default Experience of Software Testing Work product Input Software test process quality measurement model needed, for
Process conformity and work product degree of conformity obtain procedural compliance Measure Indexes value；
Preferably, each stage in software test, software test data is brought into software test procedure quality measurement model
In, obtain each quality metric index value, further includes:
By the demand number of the demand number and each stage of each stage change of software test before changing, the reality in software test each stage
Border duration and proposed duration, the tester's number and total tester's number changed in software test procedure,
The day production efficiency and software test each stage practical evaluation number, estimated evaluation number and evaluation in software test each stage
In disqualification rate Input Software test process quality measurement model, stablize for demand change degree, time schedule stability, personnel
Degree, production stability and specification degree of conformity, obtain process stability metric index value；
Preferably, each stage in software test, software test data is brought into software test procedure quality measurement model
In, obtain each quality metric index value, further includes:
By the number of the software issue found daily in software test procedure, the test case number that can be performed in software test procedure
With the test problem number and test problem for obtaining research and development institution's confirmation in the test case number and software test procedure of design
In total Input Software test process quality measurement model, for the defect degree of convergence, case designing availability and problem error detection rate,
Obtain measure of effectiveness index value；
Preferably, each stage in software test, software test data is brought into software test procedure quality measurement model
In, obtain each quality metric index value, further includes:
It will be tested the demand number and software whole demand number of use-case covering in software test procedure, surveyed in software test procedure
Try the problem of finding in the lines of code and whole lines of code and software test procedure of covering number and whole issue number
In Input Software test process quality measurement model, for demand coverage rate, code coverage and use-case adequacy, obtain sufficiently
Property Measure Indexes value；
Preferably, each stage in software test, software test data is brought into software test procedure quality measurement model
In, obtain each quality metric index value, further includes:
By in the entry Input Software test process quality measurement model of the document in software test each stage and each document, for
Positive reversely tracing degree, obtains traceability Measure Indexes value；
Preferably, each stage in software test, software test data is brought into software test procedure quality measurement model
In, obtain each quality metric index value, further includes:
By need default in software test procedure test-types to be tested, actually the power of the test-types and each test-types that carry out
In weight Input Software test process quality measurement model, for integrity degree, integrity measurement index value is obtained；
Preferably, each stage in software test, software test data is brought into software test procedure quality measurement model
In, obtain each quality metric index value, further includes:
Software issue in software test procedure is introduced into stage and software issue discovery phase Input Software test process quality degree
It measures in model, for timely degree, obtains timeliness Measure Indexes value.
3. the method as described in claim 1, which is characterized in that the foundation of software test procedure quality measurement model, comprising:
According to the actual test process in software test each stage and default testing process, calculation process degree of conformity；
The actual measurement Experience of Software Testing Work product and the default Experience of Software Testing Work product needed obtained according to software test each stage,
Calculate work product degree of conformity；
According to the demand number of the demand number and each stage of each stage change of software test before changing, demand change degree is calculated；
According to the actual duration and proposed duration in software test each stage, time schedule stability is calculated；
According to the tester's number and total tester's number changed in software test procedure, computing staff's stability；
According to the day production efficiency in software test each stage, production stability is calculated；
According to software test each stage practical evaluation number, estimated evaluation number and evaluation disqualification rate, specification degree of conformity is calculated；
Whether restrained according to the number of the software issue found daily in software test procedure, calculates the defect degree of convergence；
According to the test case number of the test case number and design that can be performed in software test procedure, it is effective to calculate case designing
Degree；
According to the test problem number and test problem sum for obtaining research and development institution's confirmation in software test procedure, computational problem inspection
Error rate；
The number of the demand number and whole demands that are covered according to test case in software test procedure, calculates demand coverage rate；
According to the lines of code of Test coverage in software test procedure and whole lines of code, calculation code coverage rate；
According to the test problem sum and whole issue number found in software test procedure, use-case adequacy is calculated；
Whether can be corresponding previous according to the entry in phase software test job product documentation each in software test procedure
Whether the entry found in source and each phase software test job product documentation in stage document can be corresponding latter
Explanation is found in stage document, calculates positive reversely tracing degree；
Test-types to be tested, the actually test-types that carry out and each test-types are needed according to presetting in software test procedure
Weight calculates integrity degree；
Stage and software issue discovery phase are introduced according to software issue in software test procedure, calculates degree in time；
Preferably, the actual test process according to software test each stage and default testing process, calculation process degree of conformity,
Such as following formula:
Wherein, Process is process conformity, and n indicates that the number of stages of software test, γ indicated between software test two stages
Checkpoint, checkpointγFor the value of checkpoint γ, two stage actual test process meets before and after the γ of checkpoint
When default testing process, checkpointγValue is 1, is otherwise 0；
Preferably, the actual measurement Experience of Software Testing Work product obtained according to software test each stage and the default software needed are surveyed
Work product is tried, calculates work product degree of conformity, such as following formula:
Wherein WorkProducts indicates work product degree of conformity, and β indicates the default Experience of Software Testing Work product total number needed,
The default Experience of Software Testing Work product needed of jth exists in the actual measurement Experience of Software Testing Work product that software test each stage obtains
When, ProductjValue is 1, is otherwise 0；
Preferably, the demand number of the demand number and each stage according to each stage change of software test before changing, calculates
Demand change degree, such as following formula:
Wherein, Modify indicates that demand change degree, intermediate variable m such as following formula calculate:
Wherein, n indicates the number of stages of software test, ModifyReqiIt indicates to generate testing requirement change in test process stage i
OriReqiIndicate the aggregate demand number before test process stage i change occurs；
Preferably, it is steady to calculate time schedule for the actual duration and proposed duration according to software test each stage
Fixed degree, such as following formula:
Wherein, Schedule indicates time schedule stability, and n indicates the number of stages of software test, SiIndicate the software test stage
The time stability of i, SiAs following formula calculates:
TimeiIndicate the actual duration of software test stage i, PlantimeiIndicate that the plan of software test stage i continues
Time, k are preset time judgment threshold；
Preferably, described according to the tester's number changed in software test procedure and total tester's number, calculate people
Member's stability, such as following formula:
Wherein, Staff indicates personnel's stability, and C indicates total tester's number, changes in A expression software test procedure
Tester's number；
Preferably, the day production efficiency according to software test each stage calculates production stability, such as following formula:
Wherein, productivity indicates production stability；
Preferably, described according to software test each stage practical evaluation number, estimated evaluation number and evaluation disqualification rate, it calculates
Specification degree of conformity, such as following formula:
Wherein, Standard indicates the specification degree of conformity of entire software test procedure, and n indicates the number of stages of software test,
StandardiIndicate the specification degree of conformity in i-th of software test stage, StandardiAs following formula calculates:
Wherein, N0Indicate preset evaluation frequency threshold value, N indicates i-th of software test stage estimated evaluation number, N ' table
Show that practical evaluation number, r indicate in the multiple evaluation in i-th of software test stage that evaluation disqualification rate is relatively rear primary low
Number；
Preferably, whether the number according to the software issue found daily in software test procedure restrains, and calculates defect and receives
Degree of holding back, such as following formula:
Wherein, BugStypticity indicates the defect degree of convergence, and the convergence indicates that the software number found daily increases with the date
And it reduces；
Preferably, the test case number according to the test case number and design that can be performed in software test procedure, calculates and uses
Example design availability, such as following formula:
CaseEffectiveness=Testcaseexec/Testcasedesign
Wherein, CaseEffectiveness indicates case designing availability, TestcaseexecIndicate executable use-case number,
TestcasedesignIndicate design uses number of cases；
Preferably, described total according to the test problem number and test problem that obtain research and development institution's confirmation in software test procedure
Number, computational problem error detection rate, such as following formula:
BugExplore=Bugscomfirm/Bugstester
Wherein, BugExplore indicates problem error detection rate, BugscomfirmIt indicates to obtain research and development institution's confirmation in software test procedure
Test problem number, BugstesterIndicate test problem sum；
Preferably, the number of the demand number covered according to test case in software test procedure and whole demands, calculating needs
Ask coverage rate, such as following formula:
ReqCoverage=Reqcovered/Reqall
Wherein, ReqCoverage indicates demand coverage rate, and Reqcovered indicates test case covering in software test procedure
Demand number, Reqall indicate whole demand numbers；
Preferably, described to be covered according to the lines of code and whole lines of code, calculation code of Test coverage in software test procedure
Lid rate, such as following formula:
CodeCoverage=Codecovered/Codeall
Wherein, CodeCoverage indicates code coverage, CodecoveredIndicate the lines of code of tested covering, CodeallTable
Show whole lines of code；
Preferably, described according to the test problem found in software test procedure sum and whole issue number, it calculates use-case and fills
Divide property, such as following formula:
CaseCoverage=Bugstester/Bugsall
Wherein, CaseCoverage indicates use-case adequacy, BugstesterIndicate the problem of finding in software test procedure number,
BugsallIndicate whole issue number；
Preferably, whether the entry according in phase software test job product documentation each in software test procedure can be
Whether entry in source and each phase software test job product documentation is found in corresponding previous stage document can be
Explanation is found in corresponding the latter half document, calculates positive reversely tracing degree, such as following formula:
Wherein, Trace indicates that positive reversely tracing degree, α indicate each phase software test job product documentation in software test procedure
Number, DucFδThe reverse traceability for indicating the δ Experience of Software Testing Work product documentation except the first, when δ
DucF when entry in Experience of Software Testing Work product documentation can find source in corresponding previous stage documentδValue is 1, no
It is then 0；DucRδThe positive traceability for indicating the δ Experience of Software Testing Work product documentation other than the last one, as δ
Entry in a Experience of Software Testing Work product documentation can find DucR when illustrating in corresponding the latter half documentδValue is 1,
It otherwise is 0；
Preferably, which is characterized in that described to need test-types to be tested, actually carry out according to presetting in software test procedure
The weight of test-types and each test-types calculates integrity degree, such as following formula:
Complete=1- ∑ Absencej*ωj
Wherein, Complete indicates integrity degree, AbsencejIndicating that comparison is default needs test-types to be tested and actually carries out
The test-types for the missing that test-types obtain, when test-types j is lacked, AbsencejIt is 1, is otherwise 0；ωjIndicate test class
The weight of type j；
Preferably, described that stage and software issue discovery phase are introduced according to software issue in software test procedure, it calculates timely
Degree, such as following formula:
Wherein Intime indicates that degree in time, s indicate that test process finds software issue number, IntimeiIndicate i-th of problem
Degree in time；IntimeiAs following formula calculates:
Wherein, PhaseembeddedIndicate that software issue introduces the assignment in stage, PhaseactIndicate the tax of software issue discovery phase
Value.
4. the method as described in claim 1, which is characterized in that it is described that target value is referred to according to each quality metric, it carries out comprehensive
It closes assessment to calculate, obtains software test procedure quality assessment result, comprising:
Refer to target value according to each quality metric, establishes fuzzy relation matrix；
The weight of each quality metric index is calculated using analytic hierarchy process (AHP)；
Composite calulation is carried out to the fuzzy relation matrix and weight, obtains software test procedure quality assessment result.
5. method according to claim 2, which is characterized in that the stage of the software test, comprising: demand analysis, test
Demand evaluation test planning, test plan evaluation, tests design and realizes, test specification evaluation, tests ready evaluation, test
It executes, test is summarized and test report evaluation.
6. method as claimed in claim 5, which is characterized in that each stage in software test, by software test data
It brings into software test procedure quality measurement model, obtains each quality metric index, comprising:
In demand analysis stage, by actual test process and default testing process, Experience of Software Testing Work product, change demand number
The tester's number and total test of mesh and demand number, actual duration and proposed duration, variation before changing
Personnel's number, day production efficiency, the number of the software issue found daily, executable test case number and design test use
The demand number and whole of number of cases, the test problem number for obtaining research and development institution's confirmation and test problem sum, test case covering
The problem of number of demand, the lines of code of Test coverage and whole lines of code, discovery number, in test job product documentation
Entry, default need the soft of test-types to be tested, the weight of the test-types and each test-types that actually carry out and introducing
Part problem and the software issue of discovery are brought into software test procedure quality measurement model, and each quality metric index is obtained；
The stage is evaluated in testing requirement, actual test process and default testing process, Experience of Software Testing Work product, reality are continued
Time and proposed duration, tester's number of variation and total tester's number, tester's number of variation and
Total tester's number, day production efficiency, practical evaluation number, estimated evaluation number and evaluation disqualification rate and test job
Entry in product documentation is brought into software test procedure quality measurement model, and each quality metric index is obtained；
In test programming phase, by actual test process and default testing process, Experience of Software Testing Work product, change demand number
The tester's number and total test of mesh and demand number, actual duration and proposed duration, variation before changing
Personnel's number, day production efficiency, the number of the software issue found daily, executable test case number and design test use
The demand number and whole of number of cases, the test problem number for obtaining research and development institution's confirmation and test problem sum, test case covering
The problem of number of demand, the lines of code of Test coverage and whole lines of code, discovery number, in test job product documentation
Entry, default need the soft of test-types to be tested, the weight of the test-types and each test-types that actually carry out and introducing
Part problem and the software issue of discovery are brought into software test procedure quality measurement model, and each quality metric index is obtained；
The stage is evaluated in test plan, actual test process and default testing process, Experience of Software Testing Work product, reality are continued
Time and proposed duration, tester's number of variation and total tester's number, tester's number of variation and
Total tester's number, day production efficiency, practical evaluation number, estimated evaluation number and evaluation disqualification rate and test job
Entry in product documentation is brought into software test procedure quality measurement model, and each quality metric index is obtained；
In test design and implementation phase, by actual test process and default testing process, Experience of Software Testing Work product, change
Tester's number of demand number and demand number, actual duration and proposed duration, variation before changing and total
Tester's number, day production efficiency, the number of the software issue found daily, executable test case number and design
The demand number of test case number, the test problem number for obtaining research and development institution's confirmation and test problem sum, test case covering
And the numbers of whole demands, Test coverage lines of code and whole lines of code, discovery the problem of number, test job product
Entry in document, it is default need test-types to be tested, the test-types and each test-types that actually carry out weight and draw
The software issue of the software issue and discovery that enter is brought into software test procedure quality measurement model, is obtained each quality metric and is referred to
Mark；
The stage is evaluated in test specification, actual test process and default testing process, Experience of Software Testing Work product, reality are continued
Time and proposed duration, tester's number of variation and total tester's number, tester's number of variation and
Total tester's number, day production efficiency, practical evaluation number, estimated evaluation number and evaluation disqualification rate and test job
Entry in product documentation is brought into software test procedure quality measurement model, and each quality metric index is obtained；
The ready evaluation stage is being tested, actual test process and default testing process, Experience of Software Testing Work product, reality are being continued
Time and proposed duration, tester's number of variation and total tester's number, tester's number of variation and
Total tester's number, day production efficiency, practical evaluation number, estimated evaluation number and evaluation disqualification rate and test job
Entry in product documentation is brought into software test procedure quality measurement model, and each quality metric index is obtained；
In the test execution stage, by actual test process and default testing process, Experience of Software Testing Work product, change demand number
The tester's number and total test of mesh and demand number, actual duration and proposed duration, variation before changing
Personnel's number, day production efficiency, the number of the software issue found daily, executable test case number and design test use
The demand number and whole of number of cases, the test problem number for obtaining research and development institution's confirmation and test problem sum, test case covering
The problem of number of demand, the lines of code of Test coverage and whole lines of code, discovery number, in test job product documentation
Entry, default need the soft of test-types to be tested, the weight of the test-types and each test-types that actually carry out and introducing
Part problem and the software issue of discovery are brought into software test procedure quality measurement model, and each quality metric index is obtained；
Test feedback and evaluation by actual test process and default testing process, Experience of Software Testing Work product, change demand number
The tester's number and total test of mesh and demand number, actual duration and proposed duration, variation before changing
Personnel's number, day production efficiency, the number of the software issue found daily, executable test case number and design test use
The demand number and whole of number of cases, the test problem number for obtaining research and development institution's confirmation and test problem sum, test case covering
The problem of number of demand, the lines of code of Test coverage and whole lines of code, discovery number, in test job product documentation
Entry, default need the soft of test-types to be tested, the weight of the test-types and each test-types that actually carry out and introducing
Part problem and the software issue of discovery are brought into software test procedure quality measurement model, and each quality metric index is obtained；
The stage is evaluated in test report, actual test process and default testing process, Experience of Software Testing Work product, reality are continued
Time and proposed duration, tester's number of variation and total tester's number, tester's number of variation and
Total tester's number, day production efficiency, practical evaluation number, estimated evaluation number and evaluation disqualification rate and test job
Entry in product documentation is brought into software test procedure quality measurement model, and each quality metric index is obtained.
7. a kind of software test procedure quality metric system characterized by comprising index value obtains module and comprehensive assessment mould
Block；
The index value obtains module, for each stage in software test, the software test data band that the stage is generated
Enter in software test procedure quality measurement model, obtains each quality metric index value；
The comprehensive assessment module carries out comprehensive assessment calculating, obtains software for referring to target value according to each quality metric
Test process quality assessment result；
The software test procedure quality measurement model includes: the mass property for reflecting complete procedure each stage of software test
Multiple quality metric indexs.
8. system as claimed in claim 7, which is characterized in that the index value obtain module include procedural compliance unit,
Process stability unit, validity unit, adequacy unit, traceability unit, integrality unit and timeliness unit；
The procedural compliance unit, for by with the actual test process in software test each stage and default testing process, with
And the Experience of Software Testing Work product that software test each stage obtains is surveyed with the default Experience of Software Testing Work product Input Software needed
It tries, for process conformity and work product degree of conformity, to obtain procedural compliance Measure Indexes value in Metric of Process Quality model；
The process stability unit, for the demand by the demand number and each stage of each stage change of software test before changing
Number, the actual duration and proposed duration in software test each stage, the tester changed in software test procedure
Number and total tester's number, the day production efficiency and software test each stage practical evaluation in software test each stage
In number, estimated evaluation number and evaluation disqualification rate Input Software test process quality measurement model, for demand change degree,
Time schedule stability, personnel's stability, production stability and specification degree of conformity, obtain process stability metric index value；
The validity unit, for by the number of the software issue found daily in software test procedure, software test procedure
In can be performed test case number and design test case number and software test procedure in obtain research and development institution confirmation survey
It tries to set in number of questions and test problem sum Input Software test process quality measurement model for the defect degree of convergence, use-case
In respect of validity and problem error detection rate, measure of effectiveness index value is obtained；
The adequacy unit, for the demand number and software whole demand number of use-case covering will to be tested in software test procedure
Mesh, what is found in software test procedure in the lines of code of Test coverage and whole lines of code and software test procedure asks
It inscribes in number and whole issue number Input Software test process quality measurement model, for demand coverage rate, code coverage
With use-case adequacy, sufficiency measurement index value is obtained；
The traceability unit, for by the entry Input Software test process of the document in software test each stage and each document
In quality measurement model, for positive reversely tracing degree, traceability Measure Indexes value is obtained；
The integrality unit, the test for by need default in software test procedure test-types to be tested, actually carrying out
In the weight Input Software test process quality measurement model of type and each test-types, for integrity degree, integrality degree is obtained
Figureofmerit value；
The timeliness unit, for software issue in software test procedure to be introduced stage and the input of software issue discovery phase
In software test procedure quality measurement model, for timely degree, timeliness Measure Indexes value is obtained.
9. system as claimed in claim 7, which is characterized in that further include modeling module；
The modeling module, for according to the actual test process in software test each stage and default testing process, calculation process
Degree of conformity；
The modeling module is also used to the actual measurement Experience of Software Testing Work product and default needs obtained according to software test each stage
Experience of Software Testing Work product, calculate work product degree of conformity；
The modeling module, the demand number of the demand number and each stage for being also used to be changed according to software test each stage before changing
Mesh calculates demand change degree；
The modeling module, is also used to actual duration and proposed duration according to software test each stage, when calculating
Between progress stability；
The modeling module is also used to according to the tester's number and total tester's number changed in software test procedure
Mesh, computing staff's stability；
The modeling module is also used to the day production efficiency according to software test each stage, calculates production stability；
The modeling module is also used to not conformed to according to software test each stage practical evaluation number, estimated evaluation number and evaluation
Lattice rate calculates specification degree of conformity；
Whether the modeling module is also used to be restrained according to the number of the software issue found daily in software test procedure, meter
Calculate the defect degree of convergence；
The modeling module is also used to the test case according to the test case number and design that can be performed in software test procedure
Number calculates case designing availability；
The modeling module is also used to according to the test problem number and test for obtaining research and development institution's confirmation in software test procedure
Issue Totals, computational problem error detection rate；
The modeling module, the number of the demand number for being also used to be covered according to test case in software test procedure and whole demands
Mesh calculates demand coverage rate；
The modeling module is also used to lines of code and whole lines of code according to Test coverage in software test procedure, meter
Calculate code coverage；
The modeling module is also used to according to the test problem sum and whole issue number found in software test procedure, meter
Calculate use-case adequacy；
The modeling module, be also used to be according to the entry in phase software test job product documentation each in software test procedure
The no entry that can be found in corresponding previous stage document in source and each phase software test job product documentation is
It is no to find explanation in corresponding the latter half document, calculate positive reversely tracing degree；
The modeling module is also used to the survey according to need default in software test procedure test-types to be tested, actually carried out
The weight of type and each test-types is tried, integrity degree is calculated；
The modeling module is also used to introduce stage and software issue discovery phase according to software issue in software test procedure,
Calculate degree in time.
10. system as claimed in claim 7, which is characterized in that the comprehensive assessment module includes: fuzzy matrix unit, power
Weight unit and composite calulation unit；
The fuzzy matrix unit establishes fuzzy relation matrix for referring to target value according to each quality metric；
The weight unit, for calculating the weight of each quality metric index using analytic hierarchy process (AHP)；
The composite calulation unit obtains software test for carrying out composite calulation to the fuzzy relation matrix and weight
Journey quality assessment result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810876701.XA CN109408359A (en) | 2018-08-03 | 2018-08-03 | A kind of software test procedure quality metric method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810876701.XA CN109408359A (en) | 2018-08-03 | 2018-08-03 | A kind of software test procedure quality metric method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109408359A true CN109408359A (en) | 2019-03-01 |
Family
ID=65463516
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810876701.XA Pending CN109408359A (en) | 2018-08-03 | 2018-08-03 | A kind of software test procedure quality metric method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109408359A (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110083514A (en) * | 2019-03-19 | 2019-08-02 | 深圳壹账通智能科技有限公司 | Software test defect estimation method, apparatus, computer equipment and storage medium |
| CN110490413A (en) * | 2019-07-12 | 2019-11-22 | 中国人民解放军63961部队 | Software assessment project quantitative management method, apparatus, equipment and readable storage medium storing program for executing |
| CN110989974A (en) * | 2019-11-27 | 2020-04-10 | 北京国舜科技股份有限公司 | Software security development life cycle implementation quality evaluation method and device |
| CN111177004A (en) * | 2019-12-30 | 2020-05-19 | 中信百信银行股份有限公司 | Software test comprehensive evaluation method and device, electronic equipment and storage medium |
| CN111274146A (en) * | 2020-01-20 | 2020-06-12 | 北京百度网讯科技有限公司 | Code measurement method and device, electronic equipment and medium |
| CN111666217A (en) * | 2020-06-05 | 2020-09-15 | 百度在线网络技术（北京）有限公司 | Method and apparatus for testing code |
| CN112488534A (en) * | 2020-12-03 | 2021-03-12 | 福建省农村信用社联合社 | Risk early warning method, system, equipment and medium before bank software is online |
| CN112506784A (en) * | 2020-12-16 | 2021-03-16 | 上海嗨酷强供应链信息技术有限公司 | System and method for evaluating product performance with autonomous learning capability |
| CN112561245A (en) * | 2020-11-27 | 2021-03-26 | 中广核工程有限公司 | Collaborative management method and device, computer equipment and storage medium |
| CN112667504A (en) * | 2020-12-25 | 2021-04-16 | 厦门极致互动网络技术股份有限公司 | Visual system for evaluating software and game development quality |
| CN112882958A (en) * | 2021-03-30 | 2021-06-01 | 中信银行股份有限公司 | Demand quality evaluation method, device, equipment and storage medium based on system credit system |
| CN112882934A (en) * | 2021-02-24 | 2021-06-01 | 中国工商银行股份有限公司 | Test analysis method and system based on defect growth |
| CN113254346A (en) * | 2021-06-10 | 2021-08-13 | 平安普惠企业管理有限公司 | Code quality evaluation method, device, equipment and storage medium |
| CN113377642A (en) * | 2021-06-28 | 2021-09-10 | 中国西安卫星测控中心 | Software quality evaluation method based on product line development |
| CN114546845A (en) * | 2022-02-14 | 2022-05-27 | 重庆长安汽车股份有限公司 | Method for identifying functional safety software tool chain |
| WO2022134348A1 (en) * | 2020-12-25 | 2022-06-30 | 平安科技（深圳）有限公司 | Method and apparatus for monitoring software development process, terminal, and storage medium |
| CN116257220A (en) * | 2023-05-16 | 2023-06-13 | 长春慧程科技有限公司 | Cloud edge collaboration-based software development data management method and system |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002342118A (en) * | 2001-05-21 | 2002-11-29 | Canon Inc | System for evaluating software test process and method for evaluating test process |
| CN101551776A (en) * | 2009-04-24 | 2009-10-07 | 北京航空航天大学 | A measuring and assessment method for software credibility during the testing process |
| CN101710304A (en) * | 2009-11-27 | 2010-05-19 | 中国科学院软件研究所 | Method for evaluating implementation quality of software process |
| CN103279831A (en) * | 2013-06-27 | 2013-09-04 | 李岩 | Method for achieving management system for evaluating software test quality and development capacity |
| US20140303765A1 (en) * | 2010-07-19 | 2014-10-09 | Taiwan Semiconductor Manufacturing Company, Ltd. | Semiconductor Processing Dispatch Control |
| CN105468512A (en) * | 2014-09-05 | 2016-04-06 | 北京畅游天下网络技术有限公司 | Method and system for evaluating software quality |
| CN106651624A (en) * | 2015-07-14 | 2017-05-10 | 国网辽宁省电力有限公司阜新供电公司 | Integrated service access network operation quality evaluation method and test platform thereof |
| CN107122302A (en) * | 2017-04-28 | 2017-09-01 | 郑州云海信息技术有限公司 | A kind of software test measure of effectiveness and appraisal procedure |
| CN107544253A (en) * | 2017-03-17 | 2018-01-05 | 中国人民解放军91049部队 | Based on the retired method of controlling security of large-scale missile equipment for improving Based on Entropy method |
| CN107766254A (en) * | 2017-11-13 | 2018-03-06 | 长春长光精密仪器集团有限公司 | A kind of Evaluation of Software Quality and system based on step analysis |
-
2018
- 2018-08-03 CN CN201810876701.XA patent/CN109408359A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002342118A (en) * | 2001-05-21 | 2002-11-29 | Canon Inc | System for evaluating software test process and method for evaluating test process |
| CN101551776A (en) * | 2009-04-24 | 2009-10-07 | 北京航空航天大学 | A measuring and assessment method for software credibility during the testing process |
| CN101710304A (en) * | 2009-11-27 | 2010-05-19 | 中国科学院软件研究所 | Method for evaluating implementation quality of software process |
| US20140303765A1 (en) * | 2010-07-19 | 2014-10-09 | Taiwan Semiconductor Manufacturing Company, Ltd. | Semiconductor Processing Dispatch Control |
| CN103279831A (en) * | 2013-06-27 | 2013-09-04 | 李岩 | Method for achieving management system for evaluating software test quality and development capacity |
| CN105468512A (en) * | 2014-09-05 | 2016-04-06 | 北京畅游天下网络技术有限公司 | Method and system for evaluating software quality |
| CN106651624A (en) * | 2015-07-14 | 2017-05-10 | 国网辽宁省电力有限公司阜新供电公司 | Integrated service access network operation quality evaluation method and test platform thereof |
| CN107544253A (en) * | 2017-03-17 | 2018-01-05 | 中国人民解放军91049部队 | Based on the retired method of controlling security of large-scale missile equipment for improving Based on Entropy method |
| CN107122302A (en) * | 2017-04-28 | 2017-09-01 | 郑州云海信息技术有限公司 | A kind of software test measure of effectiveness and appraisal procedure |
| CN107766254A (en) * | 2017-11-13 | 2018-03-06 | 长春长光精密仪器集团有限公司 | A kind of Evaluation of Software Quality and system based on step analysis |
Non-Patent Citations (5)
| Title |
|---|
| DIJANA DAMLJANOVIC ET AL.: "Wind tunnel measurement quality in testing of a standard model", SCIENCEDIRECT, vol. 4, no. 5 * |
| 周晓莹: "基于软件过程的度量方法设计与研究", 《中国优秀硕士学位论文全文数据库信息科技辑》, no. 01 * |
| 施寅生等: "软件安全性测试方法与工具", 《计算机工程与设计》, vol. 29, no. 1 * |
| 杨玲萍等: "军用软件测试过程质量因素与度量指标", 《指挥信息系统与技术》, vol. 05, no. 03, pages 1 - 6 * |
| 郭英君: "基于CMMI的软件过程质量度量的研究", 《中国优秀硕士学位论文全文数据库信息科技辑》, no. 12, pages 10 - 60 * |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110083514A (en) * | 2019-03-19 | 2019-08-02 | 深圳壹账通智能科技有限公司 | Software test defect estimation method, apparatus, computer equipment and storage medium |
| CN110083514B (en) * | 2019-03-19 | 2023-03-10 | 深圳壹账通智能科技有限公司 | Software test defect evaluation method and device, computer equipment and storage medium |
| CN110490413A (en) * | 2019-07-12 | 2019-11-22 | 中国人民解放军63961部队 | Software assessment project quantitative management method, apparatus, equipment and readable storage medium storing program for executing |
| CN110989974A (en) * | 2019-11-27 | 2020-04-10 | 北京国舜科技股份有限公司 | Software security development life cycle implementation quality evaluation method and device |
| CN111177004A (en) * | 2019-12-30 | 2020-05-19 | 中信百信银行股份有限公司 | Software test comprehensive evaluation method and device, electronic equipment and storage medium |
| CN111274146A (en) * | 2020-01-20 | 2020-06-12 | 北京百度网讯科技有限公司 | Code measurement method and device, electronic equipment and medium |
| CN111666217A (en) * | 2020-06-05 | 2020-09-15 | 百度在线网络技术（北京）有限公司 | Method and apparatus for testing code |
| CN111666217B (en) * | 2020-06-05 | 2023-06-20 | 百度在线网络技术（北京）有限公司 | Method and apparatus for testing code |
| CN112561245A (en) * | 2020-11-27 | 2021-03-26 | 中广核工程有限公司 | Collaborative management method and device, computer equipment and storage medium |
| CN112488534A (en) * | 2020-12-03 | 2021-03-12 | 福建省农村信用社联合社 | Risk early warning method, system, equipment and medium before bank software is online |
| CN112506784A (en) * | 2020-12-16 | 2021-03-16 | 上海嗨酷强供应链信息技术有限公司 | System and method for evaluating product performance with autonomous learning capability |
| CN112667504A (en) * | 2020-12-25 | 2021-04-16 | 厦门极致互动网络技术股份有限公司 | Visual system for evaluating software and game development quality |
| WO2022134348A1 (en) * | 2020-12-25 | 2022-06-30 | 平安科技（深圳）有限公司 | Method and apparatus for monitoring software development process, terminal, and storage medium |
| CN112882934A (en) * | 2021-02-24 | 2021-06-01 | 中国工商银行股份有限公司 | Test analysis method and system based on defect growth |
| CN112882934B (en) * | 2021-02-24 | 2024-02-13 | 中国工商银行股份有限公司 | Test analysis method and system based on defect growth |
| CN112882958A (en) * | 2021-03-30 | 2021-06-01 | 中信银行股份有限公司 | Demand quality evaluation method, device, equipment and storage medium based on system credit system |
| CN113254346B (en) * | 2021-06-10 | 2021-10-22 | 平安普惠企业管理有限公司 | Code quality evaluation method, device, equipment and storage medium |
| CN113254346A (en) * | 2021-06-10 | 2021-08-13 | 平安普惠企业管理有限公司 | Code quality evaluation method, device, equipment and storage medium |
| CN113377642A (en) * | 2021-06-28 | 2021-09-10 | 中国西安卫星测控中心 | Software quality evaluation method based on product line development |
| CN114546845A (en) * | 2022-02-14 | 2022-05-27 | 重庆长安汽车股份有限公司 | Method for identifying functional safety software tool chain |
| CN114546845B (en) * | 2022-02-14 | 2024-05-24 | 重庆长安汽车股份有限公司 | Authentication method of functional safety software tool chain |
| CN116257220A (en) * | 2023-05-16 | 2023-06-13 | 长春慧程科技有限公司 | Cloud edge collaboration-based software development data management method and system |
| CN116257220B (en) * | 2023-05-16 | 2023-08-08 | 长春慧程科技有限公司 | Cloud edge collaboration-based software development data management method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109408359A (en) | A kind of software test procedure quality metric method and system | |
| CN103257921B (en) | Improved random forest algorithm based system and method for software fault prediction | |
| Li et al. | Architectural technical debt identification based on architecture decisions and change scenarios | |
| CN104008143B (en) | Vocational ability index system establishment method based on data mining | |
| CN109409628A (en) | Acquisition terminal production firm evaluation method based on metering big data Clustering Model | |
| CN102467684A (en) | System and method for evaluating comprehensive performance based on improved radar chart | |
| CN107665172A (en) | A kind of Software Defects Predict Methods based on complicated weighting software network | |
| Pfleeger et al. | Software metrics in the process maturity framework | |
| Chao et al. | Estimating project S-curves using polynomial function and neural networks | |
| CN104809066A (en) | Method for evaluating and predicting maintenance work load of open source software (OSS) based on code quality | |
| Abusafiya et al. | Causes and effects of cost overrun on construction project in Bahrain: part 2 (PLS-SEM path modelling) | |
| CN106384256A (en) | Power supplying service satisfaction dynamic testing system based on index system dynamic change | |
| Misra et al. | Survey on agile metrics and their inter-relationship with other traditional development metrics | |
| Lenhard et al. | Measuring the portability of executable service-oriented processes | |
| Ordonez et al. | The state of metrics in software industry | |
| CN112380123A (en) | Design method of automatic quality evaluation system for C/C + + mixed source software | |
| CN102156641A (en) | Prediction method and system for confidence interval of software cost | |
| Christensen et al. | Lightweight and continuous architectural software quality assurance using the asqa technique | |
| White | A control model of the software requirements process | |
| CN106257506A (en) | Three layers of associating of big data quantity prediction dynamically select optimal models method | |
| CN116823008A (en) | Park energy utilization efficiency evaluation method, system, equipment and storage medium | |
| Azimian et al. | Sensitivity analysis of projects efficiency in a multi-project environtment based on data envelopment analysis | |
| CN110717244B (en) | Data trust analysis computer simulation method based on average deviation algorithm | |
| Sun et al. | Evaluation and Measurement of Software Testing Process Quality Applicable to Software Testing Laboratory | |
| Zhang et al. | Evaluation of project quality: a DEA-based approach |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |