CN103391317A - Evaluation method and device for system technology maturity - Google Patents

Abstract

A method and device for assessing system technology maturity, comprising the following steps: 1) The administrator pre-sets and stores the following content in a database: including system technology maturity evaluation level and level details, system work breakdown structure and key technical items; 2) Experts evaluate the technical maturity of the key technical items of the system and store them in the database; 3) The evaluation data of all experts is comprehensively processed based on the weighted and short-board threshold algorithm to obtain the evaluation result of the technical maturity of the system. The present invention adopts the method of storing only one piece of technical maturity evaluation level detailed data, solves the technical problem of repeated storage of a large amount of data by using the method of multi-dimensional expansion data storage and processing, and realizes the evaluation and automatic evaluation of multiple technical items of major complex systems by multiple experts. Statistical analysis of data has the advantages of improving data storage and processing efficiency, making evaluation organization work convenient and flexible, and reducing evaluation costs.

Description

A system technology maturity assessment method and device

technical field

The invention relates to a system technology maturity assessment method and device.

Background technique

The U.S. National Audit Office once pointed out that the technical maturity of the project start-up period is a measure of the risk of the acquisition project and a predictor of the success of the project, which requires the Department of Defense to conduct an assessment before purchasing. The system technology maturity level assessment is composed of multiple technical items according to the specific situation. The assessment of each technical item involves nine levels, and each level has a dozen to dozens of specific levels of detail.

The calculation tools used in the assessment of Technology Maturity Level (TRL) are the first TRL calculation tool (Technology Readiness Level Calculator) developed by William Nolte of AirForce Research Laboratory (AFRL) in 2003, with nine levels There are a total of 274 detailed level evaluation items. By answering the detailed items, it is determined whether the necessary documents for evaluating each level of TRL are complete, so as to determine whether the technology has reached a specific TRL level. In 2007, William Nolte improved the original TRL calculation tool and developed the TRL Calculator Version 2.2 (TRL Calculator Version 2.2), which divides the technology to be evaluated into hardware or software, or a comprehensive technology, and the evaluation results are intuitive Stronger.

In February 2009, J.W.Bilbro developed the Technology Assessment Calculator Ver1.2 beta, which integrates the calculation of Technology Readiness Level (TRL) and Advancement Degree of Difficulty (AD2) into one calculation tool , not only can determine the maturity level of the current technology, but also can determine the cost, progress and risk issues faced by the technology to achieve a specific maturity level.

In November 2009, David McGarvey and others from the Science and Technology Directorate of the US Department of Homeland Security developed the Technology Readiness Level Calculator Ver1.1 based on AFRL's TRL calculation tool version 2.2.

These three calculation tools are all based on Office Excel, and the calculation performance is effective and excellent for a single expert to evaluate a single technical item level. However, a calculation tool Excel file (TRLCalculator Version 2.2, occupying 580KB of storage space) can only store the evaluation data of one technical item by one expert, and the actual evaluation process is to evaluate multiple key technical items of the system by multiple experts concentrated in various places , so one approach is for experts to evaluate a technical item and then print out the evaluation results, which will generate a large amount of paper materials, which are all the same except for the evaluation data value and have level details. Another approach is to print out the evaluation results for each Experts copy multiple Excel calculation tool files for multiple TRL evaluations. This method generates a large amount of repetitive electronic data.

There is a serious problem of repeated storage of a large number of detailed paper materials or computer electronic materials in the use of these three computing tools. Referring to Figure 1, for computer storage data, the storage capacity required to store an evaluation score of a detailed evaluation level generally only accounts for 3-10% of the entire record, so a large amount of duplicate data must be stored: a system consists of i technical items Each technical item consists of j levels of detail, and k experts (expert 1 to expert k) evaluate, then there are i*j*k level details, for example: i=5, j=274, k=5 , i*j*k=6850, if each Excel file occupies 580KB, it needs to store 3879MB or 3.8GB of storage space, and the data is scattered, making management difficult and inefficient.

Moreover, it is not easy to gather experts before the evaluation, and the travel and time consumption of experts is large. A system evaluation of a project requires two to three evaluations. Each evaluation costs more than two to three hundred thousand yuan, and the total evaluation cost reaches the order of one million yuan; The workload of data processing is huge, the efficiency is low, and it is inconvenient to consult statistical analysis, etc., and these data are difficult to use as a reference or comparison for other system evaluations.

Contents of the invention

The main purpose of the present invention is to overcome the above-mentioned shortcomings in the prior art, and propose a system technology evaluation method and device that reduces data storage capacity, improves data processing efficiency, facilitates rapid organization of evaluation work, and reduces total evaluation costs.

The present invention adopts following technical scheme:

A system technology maturity evaluation method, characterized in that: the steps are as follows, 1) the administrator pre-sets and stores the following content in the database: system technology maturity evaluation level and level details, system work breakdown structure and key technical items; 2 ) The experts evaluate the technical maturity of the key technical items of the system and store them in the database; 3) The evaluation data of all experts are comprehensively processed based on the weighted and short-board threshold algorithm to obtain the evaluation result of the technical maturity of the system.

Further, before step 1), the administrator sets the role permissions in the database.

Further, in step 1), the administrator sets the detailed weight of each level of system technology maturity evaluation in the database, and sets the threshold value of each level of system technology maturity evaluation.

Further, before step 2), the administrator sets the weight and authority of experts in the database.

Further, in step 2), experts can perform evaluation query, modify and save evaluation data.

Further, it also includes: Step 4) The administrator can view and output the evaluation results in the database, and lock the system after the evaluation is completed.

Further, the database is a database of a multi-dimensional extended data architecture, specifically including: a technical maturity level schedule, a system work breakdown structure and a database of key technical items, and a multi-expert evaluation of the maturity of multiple technical items of the system Multidimensional data, the result information base of automatic analysis and processing by the system, and the system management database.

Further, in step 1), the system work breakdown structure and key technical items are to decompose the system technology into multiple hierarchies, each level is composed of multiple sub-items, and finally set multiple important sub-item nodes as a key technical item.

Further, in step 3), based on the weighted algorithm and the short-board threshold algorithm, the evaluation data of all experts are comprehensively processed to obtain the evaluation steps of the technical maturity of the system include: firstly, the weighted algorithm is used to obtain the scores of each level of the sub-project , and then compare the scores of each level with the preset thresholds of each level to obtain the technical maturity level of the sub-project, and finally obtain the evaluation results of the level of each node and the technical maturity of the system according to the short board algorithm.

Further, the weighting algorithm is specifically as follows: for a certain sub-item, first, an expert grades each level in detail, and performs weighted calculation with the preset weights of each level of detail, to obtain the expert's grades for the sub-item at each level ; Then, according to the preset weight of the experts, the weighted calculation of the scoring results of each level of each expert is carried out to obtain the scores of each level of the sub-item.

Further, the weighting algorithm is specifically as follows: for a certain sub-item, first, according to the preset expert weights, all experts perform weighted calculations on the scores of a detail level to obtain the score of the detail; The detailed weights are weighted and calculated to obtain the scores of each level of the sub-item.

Further, the short board threshold algorithm is specifically: compare the scores of each level of the sub-item with the preset thresholds of each level, if the level score is greater than or equal to the threshold, then the level is reached, and the maximum achieved The level is the technical maturity level of the sub-item; then the minimum level value of all subordinate sub-items of each layer node is used as the level of the node, and the levels of each node are summed up in turn, and finally the system technical maturity level is obtained.

A system technology maturity evaluation device is characterized in that: it includes a Web server, an Internet communication network and a Web client, the Web client is connected and communicated with the Web server through the Internet communication network; the Web server is used to control the maturity of the system technology The operation of degree assessment, which includes: the database of the multi-dimensional extended data architecture and the control and automatic analysis module, the database of the multi-dimensional extended data architecture is used to store the data required for the assessment of system technology maturity, the control and automatic analysis The module is used to control the operation of the technology maturity assessment of the control system and to automatically analyze and process the relevant data of the assessment.

Further, the control and automatic analysis module includes:

The system work breakdown structure and key technology analysis unit are used to establish the work breakdown structure and analyze and set the corresponding key technology items;

The multi-dimensional extended data processing unit is used to realize that multiple experts evaluate multiple technical items of the system technology and process the multi-dimensional extended data of the evaluation results;

The data automatic analysis and processing unit based on weighting and short board threshold control is used for automatic analysis and processing of multi-dimensional extended evaluation data to obtain the evaluation results of system technology maturity;

The system management unit is used for role authority setting and assignment, user and expert setting, and setting technology maturity evaluation level and level details.

Further, the database of the multi-dimensional extended data architecture includes: technical maturity level schedule, system work breakdown structure and database of key technical items, multi-dimensional data of multi-expert evaluation of the maturity of multiple technical items of the system, system automatic Analysis and processing results information base and system management database.

Further, the web client is a computer installed with a web browser for use by experts or administrators.

Further, the system work breakdown structure and key technical units decompose the system technology into multiple hierarchical structures, each level is composed of multiple sub-projects, and finally set multiple important sub-project nodes as key technical items; The data automatic analysis and processing unit based on weighted and short-board threshold expansion first calculates the scores of each level of the sub-item through a weighted algorithm, and then compares the scores of each level with the preset thresholds of each level to obtain the technical maturity of the sub-item Finally, the evaluation result of the system technology maturity is obtained according to the short board threshold algorithm.

As can be seen from the above description of the present invention, compared with the prior art, the present invention has the following beneficial effects:

1. In the web server, the present invention adopts the method of storing only one piece of technical maturity evaluation level detailed data, and solves the technical problem of repeated storage of a large amount of data by using the method of multi-dimensional expansion data storage and processing, and realizes multi-expert analysis of major complex systems. Evaluation of multiple technical items and automatic data statistical analysis greatly reduce the amount of data storage, which is only one-thousandth of the traditional storage capacity;

2. The automatic analysis and processing unit based on weighting and short board threshold control is used to automatically comprehensively process the expert evaluation data to obtain the evaluation result of the system technology maturity, reduce the manual processing of data in the later stage of evaluation, and overcome the fact that the existing calculation tools can only be used for ordinary The weakness of two-dimensional data processing improves the efficiency of data processing;

3. Using the Internet communication network, experts can conduct evaluations without going out, reducing travel expenses and time and effort of experts, and reducing the total cost of evaluation; avoiding mutual influence evaluation or herd effect when experts gather, and improving the objectivity of evaluation;

4. The present invention is also fully suitable for centralized experts to evaluate, so it can be convenient and flexible to carry out evaluation work in different places or in a centralized manner; it can quickly consult the original evaluation data and evaluation result information according to various reference conditions, provide services for decision-making, and provide services for the same or Similar project evaluation provides reference.

Description of drawings

Figure 1 is a schematic structural diagram of a traditional technology maturity assessment system;

Fig. 2 is the functional block diagram of the system technical maturity evaluation of the embodiment of the present invention;

Fig. 3 is the composition block diagram of the database of the multi-dimensional extended data architecture of the present invention;

Fig. 4 is a block diagram of the unit structure of the control and automatic analysis module of the present invention.

Detailed ways

The present invention will be further described below through specific embodiments.

Referring to FIG. 2 , a system technology evaluation device of the present invention includes a Web server 200 , an Internet communication network 300 and a Web client 400 . The Web server 200 includes a database 210 of a multi-dimensional extended data architecture and a control and automatic analysis module 220 . The Internet communication network 300 is a wide area network for public services provided by the Web. The Web client 400 is a computer equipped with a Web browser, including an expert module 410 and an administrator module 420 for any expert i to use the browser to evaluate and consult online. The administrator module 420 can set and assign role permissions, set users and experts, and set technical maturity evaluation levels, etc.

FIG. 3 shows a detailed diagram of the database 210 architecture of the multi-dimensional extended data architecture, including a detailed list of technical maturity levels 211, a complex system work breakdown structure and a database 212 of key technical items, and multi-experts on the maturity of multiple technical items of the system. The multi-dimensional data 213 of degree evaluation (including the evaluation data of experts 1 to expert k), the result information library 214 of automatic analysis and processing by the system, and the system management database 215.

FIG. 4 shows a block diagram of the control and automatic analysis module 220 . The control and automatic analysis module 220 includes: the work breakdown structure and key technology analysis unit 224 of the system, which is used to establish the work breakdown structure and analyze and set corresponding key technical items; Evaluate multiple technical items of the technology and process the multi-dimensional extended data of the evaluation results; the data automatic analysis and processing unit 222 based on weighting and short board threshold control is used to automatically analyze and process the multi-dimensional extended evaluation data to obtain a system Technology maturity evaluation result; system management unit 221, used for role authority setting and assignment, user and expert setting, and setting technology maturity evaluation level and level details.

Referring to Fig. 2, Fig. 3 and Fig. 4, the present invention also proposes a system technology maturity assessment method, comprising the following steps:

1) The administrator connects to the control and automatic analysis module 220 through the administrator module 420 of the Web client via the Internet communication network 300, and uses the control system management unit 221 to set the system technology maturity evaluation level, level details, thresholds of each level, and each level. The weight of the detailed level is stored in the technical maturity level detailed table 211; the administrator connects to the control and automatic analysis module 220 through the administrator module 420 of the Web client via the Internet communication network 300, and uses the work breakdown structure and key of the control system The technical analysis unit 224 performs work breakdown and determines key technical items, and stores them in the database 212 of the system work breakdown structure and key technical items.

2) Experts connect to the control and automatic analysis module 220 via the Internet communication network 300 through the expert module 410 of the Web client, and use multi-experts to evaluate the multi-dimensional extended data processing unit 223 for multi-technical evaluation of the system. The results are stored in multiple In the multi-dimensional data 213 (that is, the evaluation data of multiple experts) on the maturity evaluation of multiple technical items of the system by experts. Experts can also conduct evaluation query, modify and save evaluation data through the multi-dimensional extended data processing unit 223 for evaluation of multiple technical items of the system. In addition, before this step, the administrator connects to the system management unit 221 of the Web server 200 through the administrator module 420 of the Web client via the Internet communication network 300 to set the expert's weight and expert authority, and store them in the system management database 215.

3) The automatic data analysis and processing unit 222 of the system technology maturity evaluation device based on weighting and short board threshold control automatically analyzes and counts the evaluation data of experts, and the obtained evaluation results are stored in the result information database 214 of the system automatic analysis control middle.

4) The administrator uses the administrator module 420 of the Web client to view and output the evaluation results in the result information library 214 of the system automatically analyzed and processed by the Web server 200 through the Internet communication network 300, and locks the system after the expert evaluation is completed, After the system is locked, only the evaluation result information of the system technology maturity can be viewed, and the evaluation data cannot be modified.

Furthermore, in step 1), the system work breakdown structure and key technology analysis unit 224 first decomposes the system technology into multiple hierarchies, each level is composed of multiple sub-items, and finally the multiple important sub-item nodes Set as a key technical item.

In step 3), the data automatic analysis and processing unit 222 based on weighting and short-board threshold control comprehensively processes the evaluation data of all experts to obtain the evaluation result of the technical maturity of the system, including: The scores of each level of the project, and then compare the scores of each level with the thresholds of each level to obtain the technical maturity level of the sub-project, and finally obtain the assessment results of the level of each node and the technical maturity of the system according to the short board algorithm. Assuming that the system technology maturity level includes 1-9 levels, the algorithm of the data automatic analysis and processing unit based on weighting and short-board threshold control is composed of the system layer of the multi-level work breakdown structure and the lowest layer of multi-level algorithms. Specifically, it includes the following two steps:

1. Use the weighted algorithm to calculate the scores of each level of the sub-item, including the following two operating algorithms:

(1) For a certain sub-item, first obtain two-dimensional data according to an expert’s detailed rating of each level, and carry out weighted calculation with the weight of the detailed level, and obtain the expert’s 9-level rating for the sub-item, and then calculate the 9-level rating of each expert. The three-dimensional data of the scoring results of each level is weighted and calculated with the weight of experts to obtain the 9 levels of scores for this sub-item. The algorithm is as follows:

Among them: the level is i (i=1,2,3,...), the expert is j (j=1,2,3,...); the expert j is on the i-th level of the m-th sub-item of the p-th layer The score is zj(i, j, m, p), and the evaluation level of the i-th level of the m-th sub-item of the p-th layer is TRL (i, m, p).

(2) For a certain sub-item, firstly calculate the weighted calculation of the two-dimensional data scores of a detail level by all experts according to the weight of the experts to obtain the score of the detail, and then carry out weighted calculation on the three-dimensional evaluation data according to the weight of each detail level, Get 9 levels of points for this sub-item. The algorithm is as follows:

Among them: the level is i (i=1,2,3,...), the details are k (k=1,2,3,...); the i-th level K details of the m-th sub-item of the p-th layer The score is mx(i,k,m,p), and the evaluation level of the i-th level of the m-th sub-item of the p-th layer is TRL(i,m,p).

2. Use the threshold short board algorithm to obtain the evaluation results of the level of each node and the technical maturity of the system

(1) Evaluate the level of sub-items:

The 1-9 level evaluation score of each sub-item is obtained through the above-mentioned one, and then the level of the sub-item is determined: the score value that should be achieved according to the set level is the threshold value. If the score value of a certain level reaches or exceeds the threshold value, Then the level is reached, and the maximum value of the level obtained is the evaluation level Level(m,p) of the sub-item k, and the evaluation level of the evaluation sub-item is determined:

Evaluate the sub-item's scale value from 1-9 $\mathrm{Level}(i,m,p)=\left\{\begin{array}{ccc}i& \mathrm{if}& \mathrm{TRL}(i,m,p)\&Greater\; Equal;V\left(i\right)\\ 0& \mathrm{if}& \mathrm{TRL}\left(i\right)<V\left(i\right)\end{array}\right.$

Evaluate the level of sub-items $\mathrm{Level}(m,p)=\underset{i=1}{\overset{\mathrm{no}}{\max }}\left(\mathrm{Level}(i,m,p)\right)$

Among them, Level(i,m,p) is the evaluation level of the i-th level of the m-th sub-item of the p-th layer, and TRL(i,m,p) is the weighted evaluation score of the i-th level of the m-th item of the p-th layer, V(i) is the threshold required by level i, and Level(m,p) is the evaluation level of the mth sub-item of the pth layer.

(2) Evaluation results at the whole project level:

The level of the entire project: the level of a key technical analysis node, using the short-board method to gradually obtain the evaluation level of each layer of nodes from the bottom layer, that is, take the minimum level value of all its subordinate sub-items, and then summarize the value of each node upwards Level, and finally get the total item level, the algorithm is as follows:

(该节点下一层各节点的级别Level(i,p+1))；The level of k-nodes in layer p

(Level(i,p+1) of each node in the next layer of the node);

Finally, the evaluation results of the entire project level are obtained:

level of the entire project (Level(i,1) of each node in the first layer).

The above is only a specific embodiment of the present invention, but the design concept of the present invention is not limited thereto, and any insubstantial changes made to the present invention by using this concept should be an act of violating the protection scope of the present invention.

Claims (17)

1. a systems technology maturity appraisal procedure, is characterized in that comprising the steps: 1) keeper arranges and stores following content in advance in database: systems technology maturity assessment rank and rank detailed and system works decomposition texture and key technology item; 2) expert carries out the technology maturity evaluation and is stored to database the key technology item of system; 3) based on weighting algorithm and short slab threshold values algorithm, all experts' evaluating data is carried out integrated treatment and obtain the assessment result of this systems technology maturity.

2. a kind of systems technology maturity appraisal procedure as claimed in claim 1, it is characterized in that: before step 1), the keeper arranges role-security in database.

3. a kind of systems technology maturity appraisal procedure as claimed in claim 1, it is characterized in that: also comprise in described step 1): the keeper arranges the weight of each rank detail of systems technology maturity assessment in database, and each other threshold value of level of systems technology maturity assessment is set.

4. a kind of systems technology maturity appraisal procedure as claimed in claim 1, is characterized in that: in step 2) before, the keeper arranges expert's weight and expert's authority in database.

5. a kind of systems technology maturity appraisal procedure as claimed in claim 1, is characterized in that: in step 2) in, the expert can estimate inquiry, revises and preserve evaluating data.

6. a kind of systems technology maturity appraisal procedure as claimed in claim 1, it is characterized in that: also comprise: step 4) keeper can check and export assessment result in database, this system of locking after completing assessment.

7. a kind of systems technology maturity appraisal procedure as claimed in claim 1, it is characterized in that: described database is the database of Multi-Dimensional Extension data system framework, specifically comprises: the database of technology maturity rank detail list, system works decomposition texture and key technology item, multi-expert object information storehouse and the systems management data storehouse to multidimensional data, system automatic analysis and the processing of a plurality of technology item maturity assessment of system.

8. a kind of systems technology maturity appraisal procedure as claimed in claim 1, it is characterized in that: in step 1), the forming process of described system works decomposition texture and key technology item is: the keeper first is decomposed into systems technology the many levels structure, each level consists of a plurality of sub-projects, is the key technology item with a plurality of important sub-project Node configurations finally.

9. a kind of systems technology maturity appraisal procedure as claimed in claim 8, it is characterized in that: in step 3), based on weighting algorithm and short slab threshold values algorithm, all experts' evaluating data being carried out the appraisal procedure that integrated treatment obtains this systems technology maturity comprises: each rank mark of first by weighting algorithm, obtaining sub-project, again each rank mark is obtained respectively the technology maturity rank of this sub-project with each default rank threshold comparison, obtain the rank of each node and the assessment result of systems technology maturity according to the short slab algorithm finally.

10. a kind of systems technology maturity appraisal procedure as claimed in claim 9, it is characterized in that: described weighting algorithm is specially: for certain sub-project, first by an expert, to each rank is detailed, mark, weight with each default rank detail is weighted calculating, obtains this expert each rank scoring to this sub-project; The weight of pressing default expert again, each rank appraisal result weighted calculation of each expert, obtains each rank mark of this sub-project.

11. a kind of systems technology maturity appraisal procedure as claimed in claim 9, it is characterized in that: described weighting algorithm is specially: for certain sub-project, first the weight by default expert is weighted calculating with all experts to detailed grade other scoring, obtains the scoring of this detail; Weight by each default rank detail is weighted calculating again, obtains each rank mark of this sub-project.

12. a kind of systems technology maturity appraisal procedure as claimed in claim 9, it is characterized in that: described short slab threshold values algorithm is specially: with each rank mark of sub-project respectively with default threshold comparison at different levels, if the rank mark is more than or equal to this threshold value, reach this rank, the maximum level that reaches is the technology maturity rank of this sub-project; Use the class value of minimum of all subordinate's sub-projects of each node layer as the rank of this node again, upwards gather successively the rank of each node, finally obtain the systems technology maturity levels.

13. a systems technology maturity apparatus for evaluating is characterized in that: comprise Web server, internet communications network and Web client, described Web client is connected communication with Web server by internet communications network; Described Web server is used for the operation of control system technology maturity assessment, it comprises: the database of Multi-Dimensional Extension data system framework and control and automatic analysis module, the database of described Multi-Dimensional Extension data system framework is used for the required data of memory system technologies maturity assessment, and described control and automatic analysis module are used for the operation of control system technology maturity assessment and the related data of assessment is carried out automatic analysis and processing.

14. a kind of systems technology maturity apparatus for evaluating as claimed in claim 13, it is characterized in that: described control and automatic analysis module comprise:

System works decomposition texture and Analysis on Key Technologies unit, be used for setting up work breakdown structure (WBS) and analysis and corresponding key technology item being set;

The Multi-Dimensional Extension data processing unit, be used for realizing that a plurality of experts estimate and the Multi-Dimensional Extension data of evaluation result are processed a plurality of technology items of systems technology;

Based on data analysis and the processing unit that weighted sum short slab threshold value is controlled, be used for the Multi-Dimensional Extension evaluating data is carried out automatic analysis and processing, obtain systems technology maturity assessment result;

System Management Unit, be used for arranging and distribute role-security, user and expert are set and the technology maturity assessment grade is set and the rank detail.

15. a kind of systems technology maturity apparatus for evaluating as claimed in claim 13, it is characterized in that: the database of described Multi-Dimensional Extension data system framework comprises: the database of technology maturity rank detail list, system works decomposition texture and key technology item, multi-expert object information storehouse and the systems management data storehouse to multidimensional data, system automatic analysis and the processing of a plurality of technology item maturity assessment of system.

16. a kind of systems technology maturity apparatus for evaluating as claimed in claim 13, it is characterized in that: described Web client is the computer that Web browser is installed, and is used for for expert or keeper.

17. a kind of systems technology maturity apparatus for evaluating as claimed in claim 14, it is characterized in that: described system works decomposition texture and key technology unit are that systems technology is decomposed into the many levels structure, each level consists of a plurality of sub-projects, is the key technology item with a plurality of important sub-project Node configurations finally; Described data analysis based on weighted sum short slab threshold spread and processing unit first calculate each rank mark of sub-project by weighting algorithm, again each rank mark is obtained respectively the technology maturity rank of this sub-project with each default rank threshold comparison, obtain finally the assessment result of systems technology maturity according to short slab threshold values algorithm.

Images