CN110490413A - Software assessment project quantitative management method, apparatus, equipment and readable storage medium storing program for executing - Google Patents
Software assessment project quantitative management method, apparatus, equipment and readable storage medium storing program for executing Download PDFInfo
- Publication number
- CN110490413A CN110490413A CN201910630507.8A CN201910630507A CN110490413A CN 110490413 A CN110490413 A CN 110490413A CN 201910630507 A CN201910630507 A CN 201910630507A CN 110490413 A CN110490413 A CN 110490413A
- Authority
- CN
- China
- Prior art keywords
- measurement
- quantitative
- target
- software
- metric
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06393—Score-carding, benchmarking or key performance indicator [KPI] analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06395—Quality analysis or management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
Landscapes
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Economics (AREA)
- Educational Administration (AREA)
- Development Economics (AREA)
- General Business, Economics & Management (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- Operations Research (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Marketing (AREA)
- Game Theory and Decision Science (AREA)
- Data Mining & Analysis (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a kind of software assessment project quantitative management method, apparatus, equipment and readable storage medium storing program for executing, it is related to software evaluation technology field, measurement model can be used, the metric data of target software assessment project is assessed, concrete knowledge and method based on each key process area of metric data hard objectives software assessment process, the Process Character of measurement is fully demonstrated, the actual operation of the display software assessment project evaluation ensure that the comprehensive of the software assessment project evaluation.The described method includes: determining quantitative composite metric in process measurement and product measurement, measurement model is established；The metric data for acquiring target software assessment project, is input to measurement model for metric data；Based on measurement model, metric data is normalized, generates the integrated index value of metric data；Evaluation criteria is obtained, determines the target scale that integrated index value maps in evaluation criteria, using target scale as the assessment result of target software assessment project.
Description
Technical field
The present invention relates to software evaluation technology fields, more particularly to a kind of software assessment project quantitative management method, dress
It sets, equipment and readable storage medium storing program for executing.
Background technique
In the entire development process of software, software assessment work and software development work are relatively independent soft projects
Process, in order to guarantee the quality of software assessment work, it will usually which the project being related to software assessment is managed.Software assessment item
Purpose management includes project planning, measurement and monitoring, configuration management and quality assurance etc..In the management of software assessment project,
In general three dimensions of quality, progress, cost of the implementation procedure of high spot reviews software assessment project are needed, final goal is
Exchange the quality assurance of delivered product for procedure quality.Currently, the management measurement mould of the management for carrying out software assessment project
Type is divided into product measurement and process measurement, from the characteristic of the different dimensions reflection entire assessment process of soft project, passes through quantitative prison
The implementation process and process product quality for controlling assessment work reach the target of software assessment project management.
In the related technology, product measures the influence factor of weight analysis software quality attribute, and research object is software product,
Relationship maps are established between software quality attribute and software design, the characteristic of programming.Process measurement be to software process into
The definition of row measurement, method, the set of activity and result are provided by measurement to software process objective appraisal.
In the implementation of the present invention, inventor find the relevant technologies the prior art has at least the following problems:
The metrics management of software assessment project mainly realizes the quality to software, assessment progress etc. and predicts, it is indicated that
The trend of software attributes, its purpose is to pointedly improve to software, but for every in software assessment project
The concrete knowledge and method of a key process area do not refer to, cannot fully demonstrate the Process Character of assessment measurement, lack practical
Operability is more unilateral.
Summary of the invention
In view of this, the present invention provides a kind of software assessment project quantitative management method, apparatus, equipment and readable storages
Medium, main purpose are to solve at present that the concrete knowledge for each key process area in software assessment project and method be not
It refers to, the Process Character of assessment measurement cannot be fully demonstrated, lack actual operation, more unilateral problem.
According to the present invention in a first aspect, providing a kind of software assessment project quantitative management method, this method comprises:
Quantitative composite metric is determined in the process measurement of target software assessment project and product measurement, based on described fixed
The composite metric of amount, establishes measurement model, and the quantitative composite metric is based in the process measurement and product measurement
Quantitative information requirement generates, and the quantitative information requirement includes the rule for understanding Software Testing Project changes in demand, ensures
The quality of delivered product meets the requirements, provides scale reference for similar projects estimation and decision, is similar projects estimation and decision
The reference of offer progress provides workload reference, technical capability monitoring for similar projects estimation and decision；
The metric data for acquiring the target software assessment project, is input to the measurement model for the metric data,
The metric data and the quantitative composite metric correspond；
Based on the measurement model, the metric data is normalized, generates the integrated of the metric data
Change index value；
Evaluation criteria is obtained, the target scale that the integrated index value maps in the evaluation criteria is determined, by institute
State assessment result of the target scale as target software assessment project.
In another embodiment, described to be determined quantitatively in the process measurement of target software assessment project and product measurement
Composite metric measurement model is established based on the quantitative composite metric, comprising:
The quantitative composite metric, base are determined in the process measurement of target software assessment project and product measurement
In the quantitative composite metric, measurement system is constructed；
The measurement system is normalized, the measurement model is established.
In another embodiment, described to be determined in the process measurement of target software assessment project and product measurement
The quantitative composite metric constructs measurement system based on the quantitative composite metric, comprising:
The quantitative information requirement is extracted in the process measurement and product measurement, determines that the quantitative information needs
The measurement target asked, it is described measurement target include monitoring demand variation, assessment Test coverage degree, the first evaluation item scale,
Second evaluation item scale, the first monitoring software testing progress, the second monitoring software testing progress, monitoring software test job
Amount, the defect of the first monitoring evaluation course and closing situation, second monitor the defect of evaluation course and close situation, assessment use-case
Validity；
It is right according to the measurement index of the information requirement for each information requirement in the quantitative information requirement
The measurement target of the information requirement is measured, and the composite metric of the information requirement is obtained；
The calculation formula for determining the composite metric of the information requirement arranges the information requirement, the measurement index, institute
State the mapping relations between measurement target, the composite metric of the information requirement and the calculation formula；
The process for repeating the above-mentioned generation mapping relations, the Quantitatively mapping for obtaining the quantitative information requirement close
System；
Using the Quantitatively mapping relationship as the measurement system.
In another embodiment, described that the measurement system is normalized, the measurement model is established, is wrapped
It includes:
The quantitative weighted value and quantitative parameter value of Quantitatively mapping relationship in the measurement system are obtained respectively；
Based on the sum of products of the quantitative weighted value and the quantitative parameter value, index value formula is constructed, by the finger
Scale value formula is as the measurement model.
In another embodiment, the acquisition evaluation criteria determines the integrated index value in the evaluation criteria
The target scale of middle mapping, comprising:
The evaluation criteria is obtained, the evaluation criteria includes at least multiple scales, each scale in the multiple scale
Including at least value interval and evaluation grade；
The target value interval where the integrated index is inquired, determines the corresponding target mark of the target value interval
Degree.
Second aspect according to the present invention, provides a kind of software assessment project quantitative management device, which includes:
Module is established, for determining quantitative multiplicity in the process measurement of target software assessment project and product measurement
Amount establishes measurement model based on the quantitative composite metric, and the quantitative composite metric is based on the process measurement and institute
It states information requirement quantitative in product measurement to generate, the quantitative information requirement includes understanding Software Testing Project changes in demand
Rule, ensure the quality of delivered product meet the requirements, for similar projects estimation and decision provide scale reference, be similar projects
Estimation and decision provide progress reference, provide workload reference, technical capability monitoring for similar projects estimation and decision；
The metric data is input to by acquisition module for acquiring the metric data of the target software assessment project
The measurement model, the metric data and the quantitative composite metric correspond；
Processing module is normalized the metric data, generates the degree for being based on the measurement model
Measure the integrated index value of data；
Determining module determines what the integrated index value mapped in the evaluation criteria for obtaining evaluation criteria
Target scale, using the target scale as the assessment result of target software assessment project.
In another embodiment, the module of establishing includes:
Construction unit, for determining described quantitative in the process measurement of target software assessment project and product measurement
Composite metric measurement system is constructed based on the quantitative composite metric；
Unit is established, for the measurement system to be normalized, establishes the measurement model.
In another embodiment, the construction unit, described in being extracted in the process measurement and product measurement
Quantitative information requirement determines that the measurement target of the quantitative information requirement, the measurement target include the change of monitoring demand
Change, assessment Test coverage degree, the first evaluation item scale, the second evaluation item scale, the first monitoring software testing progress, second
Monitoring software testing progress, monitoring software test job amount, the defect of the first monitoring evaluation course and closing situation, the second monitoring
The defect of evaluation course and the validity closed situation, assess use-case；For each information in the quantitative information requirement
Demand measures the measurement target of the information requirement, obtains the information according to the measurement index of the information requirement
The composite metric of demand；The calculation formula for determining the composite metric of the information requirement arranges the information requirement, the measurement
Mapping relations between index, the measurement target, the composite metric of the information requirement and the calculation formula；It repeats
The process of the above-mentioned generation mapping relations, obtains the Quantitatively mapping relationship of the quantitative information requirement；It is quantitatively reflected described
Relationship is penetrated as the measurement system.
In another embodiment, described to establish unit, for obtaining Quantitatively mapping relationship in the measurement system respectively
Quantitative weighted value and quantitative parameter value；Based on the sum of products of the quantitative weighted value and the quantitative parameter value, building
Index value formula, using the index value formula as the measurement model.
In another embodiment, the determining module, comprising:
Acquiring unit, for obtaining the evaluation criteria, the evaluation criteria includes at least multiple scales, the multiple mark
Each scale includes at least value interval and evaluation grade in degree；
Query unit determines target value area for inquiring the target value interval where the integrated index
Between corresponding target scale.
The third aspect according to the present invention, provides a kind of equipment, including memory and processor, and the memory is stored with
The step of computer program, the processor realizes above-mentioned first aspect the method when executing the computer program.
Fourth aspect according to the present invention provides a kind of readable storage medium storing program for executing, is stored thereon with computer program, the meter
The step of calculation machine program realizes method described in above-mentioned first aspect when being executed by processor.
By above-mentioned technical proposal, a kind of software assessment project quantitative management method, apparatus provided by the invention, equipment and
Computer readable storage medium, with the mode phase for carrying out product measurement and process measurement to target software assessment project respectively at present
Than the present invention acquires the metric data of target software assessment project, and metric data is input to according to process measurement and product degree
The measurement model that multiple composite metrics of amount generate is based on measurement model, metric data is normalized, and generates integrated
Change index value, and determine the assessment result of target software assessment project according to integrated index value in evaluation criteria, so that adopting
With measurement model, tests and assesses to the metric data of target software assessment project, tested and assessed based on metric data hard objectives software
The concrete knowledge and method of each key process area of project have fully demonstrated the Process Character of assessment measurement, it is shown that practical operation
Property, it ensure that the comprehensive of software assessment project measurement.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field
Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention
Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows a kind of software assessment project quantitative management method flow schematic diagram provided in an embodiment of the present invention；
Fig. 2A shows a kind of software assessment project quantitative management method flow schematic diagram provided in an embodiment of the present invention；
Fig. 2 B shows a kind of schematic diagram of software assessment project quantitative management method provided in an embodiment of the present invention；
Fig. 3 A shows a kind of structural schematic diagram of software assessment project quantitative management device provided in an embodiment of the present invention；
Fig. 3 B shows a kind of structural schematic diagram of software assessment project quantitative management device provided in an embodiment of the present invention；
Fig. 3 C shows a kind of structural schematic diagram of software assessment project quantitative management device provided in an embodiment of the present invention；
Fig. 4 shows a kind of apparatus structure schematic diagram of equipment provided in an embodiment of the present invention.
Specific embodiment
The exemplary embodiment that the present invention will be described in more detail below with reference to accompanying drawings.Although showing the present invention in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the present invention without should be by embodiments set forth here
It is limited.It is to be able to thoroughly understand the present invention on the contrary, providing these embodiments, and can be by the scope of the present invention
It is fully disclosed to those skilled in the art.
The embodiment of the invention provides a kind of software assessment project quantitative management methods, as shown in Figure 1, this method comprises:
101, quantitative composite metric is determined in the process measurement of target software assessment project and product measurement, based on fixed
The composite metric of amount, establishes measurement model, and quantitative composite metric Kernel-based methods measurement is needed with information quantitative in product measurement
It seeks survival into, quantitative information requirement includes the rule for understanding Software Testing Project changes in demand, ensures that the quality of delivered product is full
Foot require, be similar projects estimation and decision provide scale reference, for similar projects estimation and decision provide progress refer to, be same
Intermediate item estimation and decision provide workload reference, technical capability monitoring.
102, the metric data of acquisition target software assessment project, is input to measurement model, metric data for metric data
It is corresponded with quantitative composite metric.
103, it is based on measurement model, metric data is normalized, the integrated index value of metric data is generated.
104, evaluation criteria is obtained, the target scale that integrated index value maps in evaluation criteria is determined, by target mark
Spend the assessment result as target software assessment project.
Method provided in an embodiment of the present invention can acquire the metric data of target software assessment project, by metric data
It is input to the measurement model generated according to multiple composite metrics of process measurement and product measurement, measurement model is based on, to measurement
Data are normalized, and generate integrated index value, and determine that target is soft according to integrated index value in evaluation criteria
The assessment result of part assessment project, so that tested and assessed using measurement model to the metric data of target software assessment project, base
In the concrete knowledge and method of the metric data hard objectives software assessment each key process area of project, assessment degree has been fully demonstrated
The Process Character of amount, it is shown that actual operation ensure that the comprehensive of software assessment project measurement.
The embodiment of the invention provides a kind of software assessment project quantitative management methods, as shown in Figure 2 A, this method comprises:
201, measurement model is established.
It was recognized by the inventor that the measurement model that the project currently used for being related to software assessment process is measured includes producing
Performance number amount and process measurement.Existing product measures the influence factor of weight analysis software quality attribute, and research object is that software produces
Product establish relationship maps between software quality attribute and software design, the characteristic of programming.These measurements can help to recognize
The mass property of software product, although its be in itself to the measurement of qualitative character and product characteristic it is useful, in software process
It is not available in quality metric；And the relationship between the quality factor in measurement model and criterion (sub-feature) is by non-form
Change and establish, not can determine that the model is one of quality complete or consistent definition, for evaluation bring into subjectivity because
Element.There are one-sidedness for measurement of the existing process measurement to software assessment process, cannot fully demonstrate the Process Character of measurement.CMMI
(Capability Maturity Model Integration, Capability Maturity Model are integrated) is although technology is software process
Improve and Software Process Assessment provides one and effectively instructs frame, in this process, quality, progress of software etc. are all
It is foreseeable, but concrete knowledge and method without proposing each key process area of realization, lack actual operation.Therefore,
The present invention tests and assesses the Elementary Measures of process needed for each process domain and product by extracting software and export is measured, and forms software
Composite metric of assessment project, including scale, workload, personnel, progress, productivity, defect concentration etc., by these composite metrics
Classified and be layered according to process measurement and product measurement, the measurement mould of establishment process and product uniformity measurement and evaluation
Type forms the hierarchical structure of uniformity.It wherein, can be by executing following step 2011 to step when establishing measurement model
2012 realize.
2011, the quantitative multiplicity is determined in the process measurement of target software assessment project and product measurement
Amount constructs measurement system based on the quantitative composite metric.
It include the mapping relations of quantitative information demand in measurement system.In order to be based on unifying in development project measurement
Degree amount thought designs measurement model of the invention, therefore, proposes from the angle of test item process and test product quality multiple
Right amount, clearly measurement hierarchical relationship, generate measurement system, and then establish measurement model.When generating measurement system, specifically
Ground, firstly, process measurement and product measurement in Extraction and determination information requirement, for each letter in quantitative information requirement
Breath demand measures the measurement target of information requirement, obtains quantitative multiplicity according to the measurement index of information requirement
Amount；It is then determined that the calculation formula of quantitative composite metric, arranges information requirement, measurement index, measurement target, quantitative multiplicity
Mapping relations between amount and calculation formula.The process for repeating above-mentioned generation mapping relations, obtains quantitative information demand
Quantitatively mapping relationship, and using Quantitatively mapping relationship as measurement system.
In the specific implementation process, comprehensively consider and process measurement and the product measurement of Software Testing Project are covered entirely
Lid proposes the measurement system generated based on quantitative information requirement, wherein quantitative information requirement specifically includes: understanding software
The rule of test item changes in demand ensures that the quality of delivered product meets the requirements, provides rule for similar projects estimation and decision
Mould reference, be similar projects estimation and decision provide progress reference, for similar projects estimation and decision provide workload refer to, skill
The monitoring of art ability.In this way, can be to determine 10 measurement targets for quantitative information requirement, and then according to this 10 measurement targets
To generate measurement system.
It should be noted that due to the measurement target of information requirement " providing scale reference for similar projects estimation and decision "
" evaluation item scale " corresponding measurement index be it is variable, test case scale deviation can be divided into and testing requirement scale is inclined
Difference, therefore, information requirement " providing scale reference with decision for similar projects estimation " can provide 2 kinds of different measurement targets,
That is the first evaluation item scale, the second evaluation item scale；And information requirement " provides progress ginseng for similar projects estimation and decision
Examine " the corresponding measurement index of measurement target " monitoring software testing progress " be also it is variable, milestone schedule variance can be divided into
Rate and schedule deviation rate, therefore, information requirement " providing progress reference with decision for similar projects estimation " can provide 2 kinds it is different
Measure target namely the first monitoring software testing progress, the second monitoring software testing progress；And information requirement " ensures to deliver and produce
The quality of product is met the requirements " measurement target " defect of monitoring evaluation course with closing situation " corresponding measurement index is also can
Become, process evaluation defect concentration can be divided into and evaluation defect averagely closes number of days, therefore, information requirement " ensures delivered product
Quality meet the requirements " can provide 2 kinds of different measurement targets namely first monitoring evaluation course defect and close situation,
The defect and closing situation of second monitoring evaluation course.Wherein it is possible to indicate that information requirement, measurement refer in the form of table
Mapping relations between mark, measurement target, multiple composite metrics and calculation formula, in conclusion based on quantitative information requirement
The measurement system of generation is as shown in table 1.
Table 1
2012, measurement system is normalized, obtains measurement model.
The case where due to each composite metric in measurement system, is different, and lays particular emphasis on different software metrics dimensions, can
Poorer than property, some composite metric dimensionless (such as workload uses deviation ratio), some composite metrics have dimension (such as defect concentration
Dimension is a defect/KLOC), without comparativity.In order to be integrated into a Xiang Zhibiao, it is necessary to be included in the compound of index for all
Measurement goes dimension, the normalization numerical value for each composite metric being comparable, and then can just apply in calculating.Separately
Outside, the order of magnitude of the dimensionless number of each composite metric is identical, at most differs 1 order of magnitude.If each composite metric number
Value differs greatly, it may occur that big data " floods " the case where small data (i.e. small data, which is ignored, disregards), obtained normalization number
Value can not just reflect the contribution of the composite metric of " being flooded ".In conclusion the physics of the dimensionless number of each composite metric
Meaning is obvious, meets the cognitive law and visual sense of people, therefore, by the way that measurement system is normalized, obtains
Measurement model.
In this way, measurement system to be integrated into the index value formula of a reflection project entirety state of progress, thus subsequent
The integrated index that the assessment project of target software is calculated based on the index value formula is realized by the assessment to integrated index
Assessment to assessment project.Specifically, firstly, obtaining the quantitative weighted value of Quantitatively mapping relationship in measurement system respectively and quantifying
Parameter value, namely according to the attention rate and importance of composite metric in measurement system, to multiplicity different in measurement system
Amount assigns different weights.Subsequently, based on the sum of products of quantitative weighted value and quantitative composite metric value, building index value is public
Formula, using index value formula as measurement model.Wherein, the integrated index value being calculated according to index value formula is absolute number
Value, dimensionless.During practical application, being expressed as follows for index value formula is stated shown in formula 1 in the measurement model of foundation.
Formula 1:
Wherein, V is integrated index value, value range [0,1]；αiFor the weighted value of each composite metric, value range
[0,1]；βiFor the parameter value of each composite metric, value range [0,1]；N is to be included in integrated composite metric item number, N >=
1；Which composite metric i indicates, and value is from 1 to N.
It should be noted that the β in formula (1)iFollowing four situation can be further divided into:
I class: the parameter value of composite metric inherently positive rate, as a percentage, composite metric are a kind of forward directions
It measures (i.e. metric is the bigger the better).Such as testing requirement coverage rate, value range [0,1].Such situation is most simple, directly takes multiple
The parameter value of right amount itself.
II class: the parameter value of composite metric inherently deviation ratio, as a percentage.Whether it overgauge or bears
Deviation is all above the expection of project, can all affect to project, therefore will consider.Solution takes deviation ratio
Absolute value.In order to guarantee value range [0,1], it is also necessary to the minimum value to take absolute value with 1.It is a kind of anti-in view of deviation rate metric
It is negative effect to project bring to measurement (i.e. the absolute value of metric is the smaller the better), it is therefore desirable to it is influenced to deduct,
Solution is that minimum value is subtracted from 1.It is noted that user demand volatility can also be included into II class.
III class: the parameter value band dimension of composite metric is indicated, composite metric is a kind of reverse metrics with specific value
(i.e. metric is the smaller the better).If the defect concentration of project is 10 defect/KLOC, the smaller quality of defect concentration is better.To this
A little composite metrics must go dimension.Solution is to set its target value as benchmark (Benchmark) value, takes composite metric
Parameter value and a reference value ratio.In order to guarantee value range [0,1], it is also necessary to take the minimum value of ratio and 1.In view of multiple
Right amount is a kind of reverse metrics, it is therefore desirable to be negatively affected deduction, solution is that minimum value is subtracted from 1.
IV class: the parameter value band dimension of composite metric indicates that composite metric is a kind of positive measurement with specific value
(i.e. metric is the bigger the better).As project productivity be 10LOC/ people when, productivity is bigger, and efficiency is higher.To these multiplicities
Amount must go dimension.Solution is to set its target value as a reference value, takes the ratio of parameter values and a reference value.In order to
Guarantee positive result, needs to subtract 1 from ratio.In order to guarantee that value is positive value, need to take its maximum value with 0.In order to protect
Demonstrate,prove the value range [0,1] of final result, it is also necessary to be maximized the minimum value with 1.
Therefore, after comprehensively considering above-mentioned four kinds of situations, being expressed as follows for index value formula states public affairs in the measurement model of foundation
Shown in formula 2.
Formula 2:
β1i=Ri, i=1 ..., N1
β2i=1-M in 1, | D Ri|, i=1 ..., N2
0≤αji≤ 1, i=1 ..., Nj；J=1 ..., 4
0≤βji≤ 1, i=1 ..., Nj；J=1 ..., 4
Wherein, V is integrated index value, value range [0,1]；α1iFor the weighted value of I class composite metric, value range
[0,1]；α2iFor the weighted value of II class composite metric, value range [0,1]；α3iFor the weighted value of III class composite metric, value model
Enclose [0,1]；α4iFor the weighted value of IV class composite metric, value range [0,1]；β1iFor the parameter value of I class composite metric, take
It is worth range [0,1]；β2iFor the parameter value of II class composite metric, value range [0,1]；β3iFor the parameter of III class composite metric
Value, value range [0,1]；β4iFor the parameter value of IV class composite metric, value range [0,1]；N1It is I class multiplicity quantifier
Number, N1≥1(N1When being 0, it is not included in formula, the same below)；N2It is II class composite metric item number, N2≥1；N3It is III class composite metric
Item number, N3≥1；N4It is IV class composite metric item number, N4≥1；RiIt is the positive rate of I class composite metric；DRiIt is II class composite metric
Deviation ratio；NQiIt is the reverse metrics value of III class composite metric；It is the reverse metrics a reference value of III class composite metric
(target value)；PQiIt is the positive measurement value of IV class composite metric；It is the positive measuring standard value of IV class composite metric
(target value).
It should be noted that in β3iAnd β4iIn, when parameter values are identical as a reference value, there is singular point: β3iAnd β4i
Value is 0, i.e., parameter contributes index zero.In charter, index is usually to assign index in the form of " >=" or "≤", when
When parameter values are exactly equal to a reference value, target is also had been carried out, pays attention to such situation in assessment.
Respectively as an example to above-mentioned four kinds of situations, as shown in table 2:
Table 2
Pass through above-mentioned algorithm, the product of the α value that the data of four kinds of situations in table 2 are calculated, β value and α value and β value
As shown in table 3:
Table 3
The measurement model that the formula 2 obtained according to above content is established is more comprehensively, more completely than any single dimension index
Ground reflects development of projects state, and measurement is measured and be segmented better than binary, and measurement results are finer, more objective, can be used as uniformly referring to
Mark comes evaluation item performance (as long as setting evaluation criteria and criterion in advance), has open and scalability, can be at any time according to institute
The additional parameter measurement of the composite metric needed.
202, the metric data of acquisition target software assessment project, is input to measurement model for metric data.
In embodiments of the present invention, after generating measurement model, the measurement of target software assessment project can be acquired
Metric data is input to measurement model, realizes the assessment to target software by data.It wherein, can be with when acquiring metric data
The assessment process of target software is monitored, the data conduct for the project assessed is extracted in entire assessment process
Metric data.Since measurement model is generated based on quantitative information requirement, metric data needs and quantitative information
The quantitative composite metric that demand generates corresponds, to guarantee that measurement model can carry out normalizing to the metric data of input
Change processing.
203, it is based on measurement model, metric data is normalized, the integrated index value of metric data is generated.
In the present invention, since measurement model is generated based on index value formula, by metric data degree of being input to
After measuring model, it is based on the index value formula, can realize and metric data is normalized, to generate the measurement number
According to integrated index value.Specifically, between the position and parameters due to defining parameters in index value formula
Calculated relationship therefore by metric data according to the instruction of measurement model, successively fill in the index value formula of measurement model,
And the value of the index value formula after filling metric data is calculated, thus using value as integrated index value.Continue with above-mentioned
It is illustrated for the example of table 3 in step 201, is α value, β value and the α value and β value of metric data as shown in table 3
Product, in this way, calculating the product of α value, β value and α value and β value, available integrated index value V=0.68.
204, evaluation criteria is obtained, the target scale that integrated index value maps in evaluation criteria is determined, by target mark
Spend the assessment result as target software assessment project.
In embodiments of the present invention, it after generating integrated index, can be realized based on the integrated index to mesh
Mark the assessment of software assessment project.According to above defining V it is found that V value is bigger, project status is better, and therefore, user needs
One evaluation criteria of predefined, integrated index is mapped in some scale in evaluation criteria, to realize to mesh
Mark the assessment of software assessment project.Wherein, referring to table 4, the scale being usually arranged can be outstanding, good, qualified, unqualified 4 kinds
Scale.
Table 4
| Serial number | Scale | Value range |
| 1 | It is outstanding | [0.9,1] |
| 2 | Well | [0.8,0.9) |
| 3 | It is qualified | [0.6,0.8) |
| 4 | It is unqualified | [0,0.6) |
In this way, the evaluation criteria including multiple scales can be obtained, each scale includes at least value in multiple scales
The evaluation criteria in section and assessment grade, inquires the target value interval where integrated index, determines target value interval pair
The target scale answered, and then using target scale as the assessment result of target software assessment project.
In addition, the assessment project of some softwares may mesh since the standard of the different software assessment project evaluation is different
Mark scale be well be only it is up to standard and qualified, as long as and the corresponding target scale of assessment project of some softwares be higher than it is unqualified
It is regarded as up to standard and qualified, therefore, other than defining evaluation criteria, user can also need to define assessment level, it is specified that collection
The level that should reach at index value is changed.For example, assessment level shown in Fig. 2 B can be set, it is assumed that target software assessment project
Target scale be " good ", i.e., on " present level " line, then assessment level may be defined as work as integrated index value be greater than
When equal to " present level ", the software to be evaluated is up to standard；Otherwise target software assessment project is not up to standard.But due to only syllabus
Mark scale, which is more than or equal to " worst situation horizontal ", still can be identified as satisfaction, therefore, even if integrated index value greater than etc.
In " worst situation horizontal ", software to be evaluated or qualified at this time.
Continuation is illustrated with the example in above-mentioned steps 203, it is assumed that evaluation criteria is then to know integrated shown in table 4
Target scale belonging to index value V=0.68 is " qualification ".
During practical application, the activity assessed software assessment project can be summarized are as follows: determine that information needs
It asks, establishes metric objective, select composite metric, reference or definition Measurement criterion, formulate measure plan, it will measurement and analytic activity
It is integrated into project development process.Wherein, measurement and analytic activity include: measure plan acquisition metric data, check measurement number
According to quality, store metric data, calculate the value of indicator, assay measures data explain the state of progress of current project, mark
The abnormal conditions that project occurs, and the reason of problem analysis.The result of data analysis is logical to project administrator and related side in time
Report, provides the foundation of project administrator decision and corrective action.In this way, can be by based on understanding Software Testing Project demand
The rule of variation, ensure the quality of delivered product meet the requirements, for similar projects estimation and decision provide scale reference, be similar
Program estimation and decision provide progress reference, workload reference provided for similar projects estimation and decision, technical capability monitoring
The measurement model that quantitative information requirement is established, obtains valid metric member using method for normalizing, surveys from multiple dimensions to software
Examination process is measured.Software evaluation model of the present invention can objective mark test item state of progress, improve software
The validity and efficiency of assessment project quantification project management.
During practical application, in order to realize above-mentioned steps 201 to evaluation process, this hair shown in step 204
It is bright to develop a management software, the foundation of extraction, measurement model based on the software realization metric data and measurement number
According to assessment whole process monitoring and assessment to software assessment project are realized, thus degree of fully demonstrating by running the software
The Process Character of amount, it is shown that the actual operation of software assessment ensure that the comprehensive of the software assessment project evaluation.
Method provided in an embodiment of the present invention, the metric data of acquisition target software assessment project, metric data is inputted
The measurement model generated to the multiple composite metrics measured according to process measurement and product, is based on measurement model, to metric data
It is normalized, generates integrated index value, and determine that target software is surveyed according to integrated index value in evaluation criteria
The assessment result of project is commented, so that testing and assessing to the metric data of target software assessment project, using measurement model based on degree
The concrete knowledge and method for measuring the data hard objectives software assessment each key process area of project have fully demonstrated assessment measurement
Process Character, it is shown that actual operation ensure that the comprehensive of software assessment project measurement.
Further, the specific implementation as Fig. 1 the method, the embodiment of the invention provides a kind of software assessment projects
Quantitative management device, as shown in Figure 3A, described device include: to establish module 301, acquisition module 302, processing module 303 and really
Cover half block 304.
This establishes module 301, for determining quantitative in the process measurement of target software assessment project and product measurement
Composite metric establishes measurement model based on the quantitative composite metric, and the quantitative composite metric crosses degree based on described
Quantitative information requirement generates in amount and product measurement, and the quantitative information requirement includes understanding Software Testing Project to need
The rule for asking variation, the quality for ensuring delivered product meet the requirements, provide scale reference for similar projects estimation and decision, is same
Intermediate item estimation and decision provide progress reference, provide workload reference, technical capability monitoring for similar projects estimation and decision；
The acquisition module 302, it is for acquiring the metric data of the target software assessment project, the metric data is defeated
Enter to the measurement model, the metric data and the quantitative composite metric correspond；
The processing module 303 is normalized the metric data, generates for being based on the measurement model
The integrated index value of the metric data；
The determining module 304 determines that the integrated index value is reflected in the evaluation criteria for obtaining evaluation criteria
The target scale penetrated, using the target scale as the assessment result of target software assessment project.
In specific application scenarios, as shown in Figure 3B, this establishes module 301, comprising: construction unit 3011 and foundation are single
Member 3012.
The construction unit 3011, for determining institute in the process measurement of target software assessment project and product measurement
Quantitative composite metric is stated, based on the quantitative composite metric, constructs measurement system；
This establishes unit 3012, for the measurement system to be normalized, establishes the measurement model.
In specific application scenarios, the construction unit 3011, for being extracted in the process measurement and product measurement
The quantitative information requirement determines the measurement target of the quantitative information requirement, and the measurement target includes monitoring demand
Variation, assessment Test coverage degree, the first evaluation item scale, the second evaluation item scale, the first monitoring software testing progress,
Second monitoring software testing progress, monitoring software test job amount, the defect and closing situation, second of the first monitoring evaluation course
The validity for monitoring the defect of evaluation course and closing situation, assessing use-case；For quantitative each of the information requirement
Information requirement measures the measurement target of the information requirement according to the measurement index of the information requirement, obtains described
The composite metric of information requirement；The calculation formula for determining the composite metric of the information requirement arranges the information requirement, described
Mapping relations between measurement index, the measurement target, the composite metric of the information requirement and the calculation formula；It repeats
The process for executing the above-mentioned generation mapping relations obtains the Quantitatively mapping relationship of the quantitative information requirement；It will be described fixed
Mapping relations are measured as the measurement system.
In specific application scenarios, this establishes unit 3012, for obtaining Quantitatively mapping in the measurement system respectively
The quantitative weighted value and quantitative parameter value of relationship；Based on the sum of products of the quantitative weighted value and the quantitative parameter value,
Index value formula is constructed, using the index value formula as the measurement model.
In specific application scenarios, as shown in Figure 3 C, the determining module 304, comprising: acquiring unit 3041 and cargo tracer
Member 3042.
The acquiring unit 3041, for obtaining the evaluation criteria, the evaluation criteria includes at least multiple scales, described
Each scale includes at least value interval and evaluation grade in multiple scales；
The query unit 3042 determines the target for inquiring the target value interval where the integrated index
The corresponding target scale of value interval.
Device provided in an embodiment of the present invention, the metric data of acquisition target software assessment project, metric data is inputted
The measurement model generated to the multiple composite metrics measured according to process measurement and product, is based on measurement model, to metric data
It is normalized, generates integrated index value, and determine that target software is surveyed according to integrated index value in evaluation criteria
The assessment result of project is commented, so that testing and assessing to the metric data of target software assessment project, using measurement model based on degree
The concrete knowledge and method for measuring the data hard objectives software assessment each key process area of project have fully demonstrated assessment measurement
Process Character, it is shown that actual operation ensure that the comprehensive of software assessment project measurement.
It should be noted that each function involved by a kind of software assessment project quantitative management device provided in an embodiment of the present invention
Other corresponding descriptions of energy unit, can describe, details are not described herein with reference to corresponding in Fig. 1 and Fig. 2A to Fig. 2 B.
In the exemplary embodiment, referring to fig. 4, a kind of equipment is additionally provided, which includes communication bus, processing
Device, memory and communication interface, can also include, input/output interface and display equipment, wherein can between each functional unit
To complete mutual communication by bus.The memory is stored with computer program, processor, for executing institute on memory
The program of storage executes the software assessment project quantitative management method in above-described embodiment.
A kind of readable storage medium storing program for executing is stored thereon with computer program, real when the computer program is executed by processor
Now the step of software assessment project quantitative management method.
Through the above description of the embodiments, those skilled in the art can be understood that the application can lead to
Hardware realization is crossed, the mode of necessary general hardware platform can also be added to realize by software.Based on this understanding, this Shen
Technical solution please can be embodied in the form of software products, which can store in a non-volatile memories
In medium (can be CD-ROM, USB flash disk, mobile hard disk etc.), including some instructions are used so that a computer equipment (can be
Personal computer, server or network equipment etc.) execute method described in each implement scene of the application.
It will be appreciated by those skilled in the art that the accompanying drawings are only schematic diagrams of a preferred implementation scenario, module in attached drawing or
Process is not necessarily implemented necessary to the application.
It will be appreciated by those skilled in the art that the module in device in implement scene can be described according to implement scene into
Row is distributed in the device of implement scene, can also be carried out corresponding change and is located at the one or more dresses for being different from this implement scene
In setting.The module of above-mentioned implement scene can be merged into a module, can also be further split into multiple submodule.
Above-mentioned the application serial number is for illustration only, does not represent the superiority and inferiority of implement scene.
Disclosed above is only several specific implementation scenes of the application, and still, the application is not limited to this, Ren Heben
What the technical staff in field can think variation should all fall into the protection scope of the application.
Claims (10)
- A kind of project quantitative management method 1. software is tested and assessed characterized by comprisingQuantitative composite metric is determined in the process measurement of target software assessment project and product measurement, based on described quantitative Composite metric, establishes measurement model, and the quantitative composite metric is based on quantitative in the process measurement and product measurement Information requirement generate, the quantitative information requirement include understand Software Testing Project changes in demand rule, ensure to deliver The quality of product meets the requirements, provides scale reference for similar projects estimation and decision, provides for similar projects estimation and decision Progress reference provides workload reference, technical capability monitoring for similar projects estimation and decision；The metric data for acquiring the target software assessment project, is input to the measurement model for the metric data, described Metric data and the quantitative composite metric correspond；Based on the measurement model, the metric data is normalized, generates the integrated finger of the metric data Scale value；Evaluation criteria is obtained, the target scale that the integrated index value maps in the evaluation criteria is determined, by the mesh Mark assessment result of the scale as target software assessment project.
- 2. the method according to claim 1, wherein the process measurement and production in target software assessment project Determine that quantitative composite metric establishes measurement model based on the quantitative composite metric in performance number amount, comprising:The quantitative composite metric is determined in the process measurement of target software assessment project and product measurement, is based on institute Quantitative composite metric is stated, measurement system is constructed；The measurement system is normalized, the measurement model is established.
- 3. according to the method described in claim 2, it is characterized in that, the process measurement in target software assessment project The quantitative composite metric is determined in product measurement, based on the quantitative composite metric, constructs measurement system, comprising:The quantitative information requirement is extracted in the process measurement and product measurement, determines the quantitative information requirement Target is measured, the measurement target includes the variation of monitoring demand, assessment Test coverage degree, the first evaluation item scale, second Evaluation item scale, the first monitoring software testing progress, the second monitoring software testing progress, monitoring software test job amount, The defect of one monitoring evaluation course monitors the defect of evaluation course with closing situation, second and closes situation, assesses having for use-case Effect property；For each information requirement in the quantitative information requirement, according to the measurement index of the information requirement, to described The measurement target of information requirement is measured, and the composite metric of the information requirement is obtained；The calculation formula for determining the composite metric of the information requirement arranges the information requirement, the measurement index, the survey Measure the mapping relations between target, the composite metric of the information requirement and the calculation formula；The process for repeating the above-mentioned generation mapping relations obtains the Quantitatively mapping relationship of the quantitative information requirement；Using the Quantitatively mapping relationship as the measurement system.
- 4. according to the method described in claim 2, building it is characterized in that, described be normalized the measurement system Found the measurement model, comprising:The quantitative weighted value and quantitative parameter value of Quantitatively mapping relationship in the measurement system are obtained respectively；Based on the sum of products of the quantitative weighted value and the quantitative parameter value, index value formula is constructed, by the index value Formula is as the measurement model.
- 5. the method according to claim 1, wherein the acquisition evaluation criteria, determines the integrated index The target scale that value maps in the evaluation criteria, comprising:Obtain the evaluation criteria, the evaluation criteria includes at least multiple scales, and each scale is at least in the multiple scale Including value interval and evaluation grade；The target value interval where the integrated index is inquired, determines the corresponding target scale of the target value interval.
- The project quantitative management device 6. a kind of software is tested and assessed characterized by comprisingModule is established, quantitative composite metric is determined in the process measurement of target software assessment project and product measurement, is based on The quantitative composite metric, establishes measurement model, and the quantitative composite metric is based on the process measurement and the product Quantitative information requirement generates in measurement, and the quantitative information requirement includes the rule for understanding Software Testing Project changes in demand The quality for restraining, ensuring delivered product meets the requirements, provides scale reference for similar projects estimation and decision, is similar projects estimation Progress reference is provided with decision, provides workload reference, technical capability monitoring for similar projects estimation and decision；The metric data is input to described by acquisition module for acquiring the metric data of the target software assessment project Measurement model, the metric data and the quantitative composite metric correspond；Processing module is normalized the metric data, generates the measurement number for being based on the measurement model According to integrated index value；Determining module determines the target that the integrated index value maps in the evaluation criteria for obtaining evaluation criteria Scale, using the target scale as the assessment result of target software assessment project.
- 7. device according to claim 6, which is characterized in that described to establish module, comprising:Construction unit, for determining described quantitative answer in the process measurement of target software assessment project and product measurement Right amount constructs measurement system based on the quantitative composite metric；Unit is established, for the measurement system to be normalized, establishes the measurement model.
- 8. device according to claim 7, which is characterized in that the construction unit, in the process measurement and production The quantitative information requirement is extracted in performance number amount, determines the measurement target of the quantitative information requirement, the measurement target Variation, assessment Test coverage degree, the first evaluation item scale, the second evaluation item scale, the first monitoring including monitoring demand Software test progress, the second monitoring software testing progress, monitoring software test job amount, first monitoring evaluation course defect with Close situation, the defect of the second monitoring evaluation course and the validity closed situation, assess use-case；For the quantitative information Each information requirement in demand carries out the measurement target of the information requirement according to the measurement index of the information requirement Measurement, obtains the composite metric of the information requirement；The calculation formula of the composite metric of the information requirement is determined, described in arrangement Information requirement, the measurement index, between measurement target, the composite metric of the information requirement and the calculation formula Mapping relations；The process for repeating the above-mentioned generation mapping relations obtains the Quantitatively mapping of the quantitative information requirement Relationship；Using the Quantitatively mapping relationship as the measurement system.
- 9. a kind of equipment, including memory and processor, the memory are stored with computer program, which is characterized in that described The step of processor realizes any one of claims 1 to 5 the method when executing the computer program.
- 10. a kind of readable storage medium storing program for executing, is stored thereon with computer program, which is characterized in that the computer program is processed The step of device realizes method described in any one of claims 1 to 5 when executing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910630507.8A CN110490413A (en) | 2019-07-12 | 2019-07-12 | Software assessment project quantitative management method, apparatus, equipment and readable storage medium storing program for executing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910630507.8A CN110490413A (en) | 2019-07-12 | 2019-07-12 | Software assessment project quantitative management method, apparatus, equipment and readable storage medium storing program for executing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110490413A true CN110490413A (en) | 2019-11-22 |
Family
ID=68547120
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910630507.8A Pending CN110490413A (en) | 2019-07-12 | 2019-07-12 | Software assessment project quantitative management method, apparatus, equipment and readable storage medium storing program for executing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110490413A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111444093A (en) * | 2020-03-25 | 2020-07-24 | 世纪龙信息网络有限责任公司 | Method and device for determining quality of project development process and computer equipment |
| CN111679808A (en) * | 2020-06-09 | 2020-09-18 | 中国建设银行股份有限公司 | RPA robot application requirement evaluation method and device |
| CN111738605A (en) * | 2020-06-28 | 2020-10-02 | 中国标准化研究院 | Quality infrastructure capability index evaluation method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007057296A2 (en) * | 2005-11-18 | 2007-05-24 | International Business Machines Corporation | Test effort estimator |
| CN105868888A (en) * | 2016-03-23 | 2016-08-17 | 中国电子科技集团公司第十研究所 | Software testing quality evaluation method |
| CN108537503A (en) * | 2018-03-26 | 2018-09-14 | 西南电子技术研究所（中国电子科技集团公司第十研究所） | software development management system |
| CN109408359A (en) * | 2018-08-03 | 2019-03-01 | 中国人民解放军63928部队 | A kind of software test procedure quality metric method and system |
-
2019
- 2019-07-12 CN CN201910630507.8A patent/CN110490413A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007057296A2 (en) * | 2005-11-18 | 2007-05-24 | International Business Machines Corporation | Test effort estimator |
| CN105868888A (en) * | 2016-03-23 | 2016-08-17 | 中国电子科技集团公司第十研究所 | Software testing quality evaluation method |
| CN108537503A (en) * | 2018-03-26 | 2018-09-14 | 西南电子技术研究所（中国电子科技集团公司第十研究所） | software development management system |
| CN109408359A (en) * | 2018-08-03 | 2019-03-01 | 中国人民解放军63928部队 | A kind of software test procedure quality metric method and system |
Non-Patent Citations (2)
| Title |
|---|
| 奚小溪: "软件度量技术研究及应用分析", 《安徽建筑工业学院学报(自然科学版)》 * |
| 陈颖洁: "军用软件质量评价工具的开发与设计", 《中国优秀博硕士学位论文全文数据库 (硕士) 信息科技辑》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111444093A (en) * | 2020-03-25 | 2020-07-24 | 世纪龙信息网络有限责任公司 | Method and device for determining quality of project development process and computer equipment |
| CN111444093B (en) * | 2020-03-25 | 2024-04-02 | 天翼数字生活科技有限公司 | Method and device for determining quality of project development process and computer equipment |
| CN111679808A (en) * | 2020-06-09 | 2020-09-18 | 中国建设银行股份有限公司 | RPA robot application requirement evaluation method and device |
| CN111679808B (en) * | 2020-06-09 | 2023-05-16 | 中国建设银行股份有限公司 | RPA robot application demand evaluation method and device |
| CN111738605A (en) * | 2020-06-28 | 2020-10-02 | 中国标准化研究院 | Quality infrastructure capability index evaluation method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7243049B1 (en) | Method for modeling system performance | |
| Alves et al. | Deriving metric thresholds from benchmark data | |
| CN110490413A (en) | Software assessment project quantitative management method, apparatus, equipment and readable storage medium storing program for executing | |
| CN109542712B (en) | Server pressure testing method and device, computer equipment and storage medium | |
| US10839334B2 (en) | Evaluating performance of organizational units using human capital values | |
| US20140201714A1 (en) | Evaluating performance maturity level of an application | |
| Nikolakopoulou et al. | Using conditional power of network meta‐analysis (NMA) to inform the design of future clinical trials | |
| Ghaith et al. | Profile-based, load-independent anomaly detection and analysis in performance regression testing of software systems | |
| AU2018243292A1 (en) | Devices, methods, and systems for determining environmental standard compliance | |
| CN106294174B (en) | The various dimensions measure and device of testing adequacy | |
| CN110032504A (en) | Software quality determines that equipment, software quality determine that method and software quality determine program | |
| CN109272215A (en) | Project development quality control method, device, computer equipment and storage medium | |
| Rosopa et al. | Robustness of statistical inferences using linear models with meta-analytic correlation matrices | |
| CN114741284B (en) | Task reliability evaluation method and device, computer equipment and storage medium | |
| US20080127083A1 (en) | Method and system for combining multiple benchmarks | |
| Shi et al. | A Grey Model for Evaluation of Information Systems Security. | |
| Carnero | Fuzzy multicriteria model for selection of vibration technology | |
| Chandra et al. | Measuring operational management information technology: COBIT 5.0 and capability level | |
| KR20130086083A (en) | Risk-profile generation device | |
| CN113159537A (en) | Evaluation method and device for new technical project of power grid and computer equipment | |
| US20240338294A1 (en) | Integrated system for assessing application fitness | |
| Zaman et al. | A Large Scale Empirical Study on User-Centric Performance Analysis | |
| CN111242433B (en) | Power data identification method and device, computer equipment and storage medium | |
| Riaz et al. | Maintainability Predictors for Relational Database-Driven Software Applications: Results from a Survey. | |
| Skatkov et al. | Visual quality estimation technique for services in cloud environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191122 |
|
| RJ01 | Rejection of invention patent application after publication |