CN111291375B

CN111291375B - Application program evaluation method and device, computer equipment and storage medium

Info

Publication number: CN111291375B
Application number: CN202010115989.6A
Authority: CN
Inventors: 杨晓明; 刘梦玥; 刘畅; 刘奕宏
Original assignee: China Electronic Product Reliability and Environmental Testing Research Institute
Current assignee: China Electronic Product Reliability and Environmental Testing Research Institute; Maintenance and Test Branch of Peaking FM Power Generation of Southern Power Grid Co Ltd
Priority date: 2020-02-25
Filing date: 2020-02-25
Publication date: 2022-04-26
Anticipated expiration: 2040-02-25
Also published as: CN111291375A

Abstract

The application relates to an application program evaluation method, an application program evaluation device, computer equipment and a storage medium. The method comprises the following steps: determining a first research and development guarantee level of each top-level function module of the application program according to the danger level of the application program, and then establishing a dependency relationship tree corresponding to each top-level function module, wherein the dependency relationship tree comprises the dependency relationship between the top-level function module and each sub-function module corresponding to the top-level function module; and finally, for each top-level function module, determining a second research and development guarantee level of each sub-function module corresponding to the top-level function module according to the first research and development guarantee level and the dependency relationship tree. By adopting the method, the research and development guarantee level of the application program can be accurately evaluated.

Description

Application program evaluation method and device, computer equipment and storage medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for evaluating an application program, a computer device, and a storage medium.

Background

With the development of computer technology, the development of application programs becomes common, and when an application program is developed, it is necessary to evaluate the security level of the application program so as to determine the research and development guarantee level of the application program, where the security level of the application program is used to characterize the degree of influence of the application program failure on system operation security or task completion, and generally, the higher the security level of the application program is, the higher the research and development guarantee level is, which means that the human and material resources invested in the research and development of the application program are, and conversely, the lower the security level of the application program is, the lower the research and development guarantee level of the application program is.

Conventionally, a safety level can be artificially determined for an application program according to the degree of influence on the whole system and personnel when the application program fails, and then a research and development guarantee level of the application program is obtained according to the safety level of the application program.

However, the related art considers the factors in determining the security level of the application program simply, and thus the obtained security level is inaccurate, which in turn causes a problem that the development assurance level of the finally obtained application program is inaccurate.

Disclosure of Invention

In view of the above, it is necessary to provide an accurate application evaluation method, apparatus, computer device and storage medium for solving the above technical problems.

In a first aspect, an application evaluation method is provided, which includes:

determining a first research and development guarantee level of each top-level functional module of an application program according to a danger level of the application program, wherein the danger level comprises at least one of a severity level of dangerous consequences caused after the application program fails, a frequency level of the application program contacting external dangerous events and a probability level of the external dangerous events, in the application program, each top-level functional module corresponds to at least one sub-functional module, and each top-level functional module depends on each sub-functional module corresponding to the top-level functional module;

for each top-level function module, establishing a dependency relationship tree corresponding to the top-level function module, wherein the dependency relationship tree comprises the dependency relationship between the top-level function module and each sub-function module corresponding to the top-level function module;

and for each top-level functional module, determining a second research and development guarantee level of each sub-functional module corresponding to the top-level functional module according to the first research and development guarantee level and the dependency relationship tree.

In one embodiment, the determining a first level of development assurance for each top-level functional module of an application based on a risk level of the application comprises:

acquiring a risk level matrix table;

determining the danger level of the application program by inquiring the danger level matrix table;

the first level of development assurance for each top-level function module of the application is determined based on the risk level of the application.

In one embodiment, the determining the second development guarantee level of each sub-function module corresponding to the top-level function module according to the first development guarantee level and the dependency tree includes:

and taking the first research and development guarantee level as a second research and development guarantee level of each sub-function module corresponding to the top-layer function module.

taking the first research and development guarantee level as a second research and development guarantee level of at least one sub-function module in each sub-function module corresponding to the top-layer function module; or,

and taking a third research and development guarantee level as a second research and development guarantee level of at least two sub-function modules in each sub-function module corresponding to the top-layer function module, wherein the third research and development guarantee level is lower than the first research and development guarantee level.

taking the first research and development guarantee level of the top-layer function module as a second research and development guarantee level of at least one sub-function module in the sub-function modules in parallel relation in each sub-function module corresponding to the top-layer function module, or taking a third research and development guarantee level as a second research and development guarantee level of at least two sub-function modules in the sub-function modules in parallel relation in each sub-function module corresponding to the top-layer function module, wherein the third research and development guarantee level is lower than the first research and development guarantee level;

and taking the first research and development guarantee level as a second research and development guarantee level of the sub-function module in the series relation in each sub-function module corresponding to the top-layer function module, or taking a fourth research and development guarantee level as a second research and development guarantee level of at least one sub-function module in the series relation in the parallel relation in the sub-function module corresponding to the top-layer function module, wherein the fourth research and development guarantee level is the highest research and development guarantee level in the sub-function module in the parallel relation in the sub-function module corresponding to the top-layer function module.

In one embodiment, the determining the second development guarantee level of each sub-function module corresponding to the top-level function module according to the first development guarantee level and the dependency relationship tree includes:

taking the first research and development guarantee level of the top-layer function module as a second research and development guarantee level of a sub-function module at the position of the voter in each sub-function module corresponding to the top-layer function module;

and taking the first research and development guarantee level of the top-layer function module as a second research and development guarantee level of at least one sub-function module which is not at the position of the voter in each sub-function module corresponding to the top-layer function module, or taking a third research and development guarantee level as the second research and development guarantee level of at least two sub-function modules which are not at the position of the voter in the sub-function module corresponding to the top-layer function module, wherein the third research and development guarantee level is lower than the first research and development guarantee level.

In one embodiment, after determining the second development guarantee level of each sub-function module corresponding to the top-level function module according to the first development guarantee level and the dependency tree, the method further includes:

determining a probability level that the application fails to avoid the hazardous event;

the second level of development assurance is adjusted according to a level of probability that the application fails to avoid the hazardous event.

In one embodiment, the adjusting the second level of development assurance according to the level of probability that the application fails to avoid the risky event comprises:

and when the probability level of the application program which cannot avoid the dangerous event belongs to the preset level range, increasing the level of the second research and development guarantee level.

In a second aspect, an application evaluation apparatus is provided, the apparatus comprising:

the system comprises a first determining module, a first judging module and a second determining module, wherein the first determining module is used for determining a first research and development guarantee level of each top-level functional module of an application program according to a danger level of the application program, the danger level comprises at least one of a severity level of dangerous consequences caused after the application program fails, a frequency level of the application program contacting external dangerous events and a probability level of the external dangerous events, in the application program, each top-level functional module corresponds to at least one sub-functional module, and each top-level functional module depends on each sub-functional module corresponding to the top-level functional module;

the establishing module is used for establishing a dependency relationship tree corresponding to each top-level function module, wherein the dependency relationship tree comprises the dependency relationship between the top-level function module and each sub-function module corresponding to the top-level function module;

and the second determining module is used for determining a second research and development guarantee level of each sub-function module corresponding to the top-level function module according to the first research and development guarantee level and the dependency relationship tree for each top-level function module.

In one embodiment, the first determining module is specifically configured to obtain a risk level matrix table; determining the danger level of the application program by inquiring the danger level matrix table; the first level of development assurance for each top-level function module of the application is determined based on the risk level of the application.

In one embodiment, the dependency relationship includes a serial dependency relationship, the premise that the serial dependency relationship is used for representing and ensuring that the top-level function module normally operates is that all sub-function modules corresponding to the top-level function module normally operate, and the second determining module is specifically configured to use the first development guarantee level as a second development guarantee level of each sub-function module corresponding to the top-level function module.

In one embodiment, the dependency relationship includes a parallel dependency relationship, the parallel dependency relationship is used for representing that it is guaranteed that any one of the sub-function modules corresponding to the top-level function module is normal on the premise that the top-level function module is guaranteed to operate normally, and the second determining module is specifically configured to use the first research and development guarantee level as a second research and development guarantee level of at least one of the sub-function modules corresponding to the top-level function module; or, taking a third research and development guarantee level as a second research and development guarantee level of at least two sub-function modules in each sub-function module corresponding to the top-layer function module, where the third research and development guarantee level is lower than the first research and development guarantee level.

In one embodiment, the dependency relationship includes a series-parallel dependency relationship and a parallel-series dependency relationship, where the series-parallel dependency relationship and the parallel-series dependency relationship are used for characterizing that it is guaranteed that all sub-function modules in the series relation in the sub-function modules corresponding to the top-level function module normally operate and any one of the sub-function modules in the parallel relation normally operate, and the second determining module is specifically configured to use the first development guarantee level of the top-level function module as a second development guarantee level of at least one of the sub-function modules in the parallel relation in the sub-function modules corresponding to the top-level function module, or use a third development guarantee level as a second development guarantee level of at least two of the sub-function modules in the parallel relation in the sub-function modules corresponding to the top-level function module, the third development assurance level is lower than the first development assurance level; and taking the first research and development guarantee level as a second research and development guarantee level of the sub-function module in the series relation in each sub-function module corresponding to the top-layer function module, or taking a fourth research and development guarantee level as a second research and development guarantee level of at least one sub-function module in the series relation in the parallel relation in the sub-function module corresponding to the top-layer function module, wherein the fourth research and development guarantee level is the highest research and development guarantee level in the sub-function module in the parallel relation in the sub-function module corresponding to the top-layer function module.

In one embodiment, the dependency relationship includes a voting relationship, where the voting relationship is used to represent that the top-level function module is guaranteed to be normal on the premise that a preset number of sub-function modules in each sub-function module corresponding to the top-level function module are guaranteed to be normal, and the second determining module is specifically configured to use a first development guarantee level of the top-level function module as a second development guarantee level of a sub-function module at a position of a voter in each sub-function module corresponding to the top-level function module; and taking the first research and development guarantee level of the top-layer function module as a second research and development guarantee level of at least one sub-function module which is not at the position of the voter in each sub-function module corresponding to the top-layer function module, or taking a third research and development guarantee level as the second research and development guarantee level of at least two sub-function modules which are not at the position of the voter in the sub-function module corresponding to the top-layer function module, wherein the third research and development guarantee level is lower than the first research and development guarantee level.

In one embodiment, the apparatus further comprises an adjustment module configured to determine a probability level that the application fails to avoid the hazardous event; the second level of development assurance is adjusted according to a level of probability that the application fails to avoid the hazardous event.

In one embodiment, the adjusting module is specifically configured to increase the level of the second development assurance level when the probability level that the application fails to avoid the dangerous event falls within a preset level range.

In a third aspect, a computer device is provided, which comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the application program evaluation method according to any one of the first aspect when executing the computer program.

In a fourth aspect, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the application evaluation method of any of the first aspects described above.

According to the application program evaluation method, the application program evaluation device, the computer equipment and the storage medium, a first research and development guarantee level of each top-level function module of an application program is determined according to a danger level of the application program, wherein the danger level comprises at least one of a severity level of a dangerous result caused after the application program fails, a frequency level of the application program contacting an external dangerous event and a probability level of the external dangerous event, in the application program, each top-level function module corresponds to at least one sub-function module, and each top-level function module depends on each sub-function module corresponding to the top-level function module; then for each top-level function module, establishing a dependency relationship tree corresponding to the top-level function module, wherein the dependency relationship tree comprises the dependency relationship between the top-level function module and each sub-function module corresponding to the top-level function module; and finally, for each top-level function module, determining a second research and development guarantee level of each sub-function module corresponding to the top-level function module according to the first research and development guarantee level and the dependency relationship tree. According to the application program evaluation method, when the research and development guarantee level of the application program is evaluated, various influence factors influencing the danger level of the application program are fully considered, and the research and development guarantee level of each functional module is determined according to the dependency relationship among the functional modules in the application program, so that the evaluation on the research and development guarantee level of the application program is more accurate finally.

Drawings

FIG. 1 is a diagram of an application environment for an application evaluation method in one embodiment;

FIG. 2 is a flow diagram that illustrates a method for evaluating an application, according to one embodiment;

FIG. 3 is a flow diagram that illustrates a method for determining a first level of development assurance for each top-level function module of an application in the application evaluation method, under an embodiment;

FIG. 4 is a dependency tree diagram of the series dependencies in one embodiment;

FIG. 5 is a dependency tree diagram of parallel dependencies in one embodiment;

FIG. 6 is a dependency tree diagram of series-parallel dependencies in one embodiment;

FIG. 7 is a dependency tree diagram of parallel-to-serial dependencies, in one embodiment;

FIG. 8 is a dependency tree diagram of voting relationships in one embodiment;

FIG. 9 is a flow diagram that illustrates a methodology for adjusting a second development assurance level in the application evaluation methodology, in accordance with one embodiment;

FIG. 10 is a block diagram showing the structure of an application evaluation apparatus according to one embodiment;

FIG. 11 is a block diagram showing the construction of an application evaluation apparatus in another embodiment;

FIG. 12 is a diagram illustrating an internal structure of a computer device according to an embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

As computer technology has evolved, the development of applications has become commonplace. For example, in the development of an onboard system, a new generation of onboard system has become a typical application-intensive system, and an onboard application assumes core functions of flight control, power control, avionics integration, mission planning, safety warning, and the like, and has an important influence on flight safety and mission completion. Meanwhile, the system safety problem caused by the failure of the onboard application system is increased day by day, and the faults caused by software account for more than 70% of the total faults in modern onboard equipment. Once a critical application program fails or fails, the task fails, and equipment damage or even casualties occur. Therefore, in the development process of airborne application programs in China, the security level of the application programs is taken as a key concern.

When an application is developed, it is necessary to evaluate the security level of the application in order to determine the development assurance level of the application. The security level of the application program is used for representing the degree of influence of the occurrence of failure of the application program on system operation security or task completion, and in general, the higher the security level of the application program is, the higher the research and development guarantee level is, which means that the higher the manpower and material resources input into the research and development of the application program are, and conversely, the lower the security level of the application program is, the lower the research and development guarantee level of the application program is.

The application program evaluation method provided by the application program evaluation method can be applied to the application environment shown in FIG. 1. Among them, the terminal 101 may be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices.

In one embodiment, as shown in fig. 2, an application evaluation method is provided, which is described by taking the application of the method to the terminal 101 in fig. 1 as an example, and includes the following steps:

step 201, the terminal determines a first research and development guarantee level of each top-level function module of the application program according to a risk level of the application program, where the risk level includes at least one of a severity level of a dangerous consequence caused after the application program fails, a frequency level of the application program contacting an external dangerous event, and a probability level of the external dangerous event, in the application program, each top-level function module corresponds to at least one sub-function module, and each top-level function module depends on each sub-function module corresponding to the top-level function module.

In this step, in order to accurately evaluate the risk level of the application program, three factors need to be considered in combination. Respectively, a severity level (denoted by C in this application) of the dangerous consequences caused by the application program failing, a frequency level (denoted by F in this application) of the application program contacting the external dangerous event, and a probability level (denoted by W in this application) of the external dangerous event. The above three levels will now be described in detail.

First, severity level C of dangerous consequences caused by application program failure

1) Functional risk assessment (english: FHA) method, analyzing system risk events (english: FC). Analyzing the effect of FC on the system according to the system function and the task stage;

2) the severity level C (five levels A, B, C, D and E) of the consequences of the risk event triggered by the application program was quantitatively evaluated according to the consequences of the risk event and is shown in Table 1.

Second, frequency level F of application program contacting external dangerous event

1) The probabilistic risk assessment method (english: PRA) and regional security analysis (english: ZSA), the category of external dangerous events that the application may be exposed to is analyzed. Determining the possibility of interaction between the application program and an external dangerous event during the operation process, namely a frequency value, by combining the operation characteristics and the system structure of the application program;

2) and quantitatively evaluating the frequency level F (divided into H, M, O and L) of the application program contacting the external dangerous event according to the frequency value of the interaction between the application program and the external dangerous source during the operation of the application program and by combining the table 2.

Third, probability level W of occurrence of external dangerous event

1) Obtaining an approximate evaluation value W of the occurrence probability of the external dangerous event through empirical data statistical analysis, expert experience or abnormal excitation occurrence condition simulation and other modes;

2) based on the approximate evaluation value W of the occurrence probability of the external dangerous event, in conjunction with table 3, the "occurrence probability of dangerous event W" is determined (classified into five levels of 1, 2, 3, 4, and 5).

TABLE 1

TABLE 2

TABLE 3

After obtaining the severity level C of dangerous consequences caused by the failure of the application program, the frequency level F of the application program contacting the external dangerous events and the probability level W of the external dangerous events. A first level of development assurance for each top-level functional module of the application may be determined based on at least one of the levels. Generally, the higher the risk level, the higher the corresponding level of development assurance.

Step 202, the terminal establishes a dependency relationship tree corresponding to each top-level function module, where the dependency relationship tree includes the dependency relationship between the top-level function module and each sub-function module corresponding to the top-level function module.

In an application program, there are generally a plurality of function modules, some of which are top-level function modules, and the functions implemented by the top-level function modules need to depend on sub-function modules. It will be appreciated that the implementation of some of the basic functions of an application program may be premised on the implementation of other functions. Therefore, the dependency relationship tree among the functional modules can be established according to the functional division of the application program.

And 203, for each top-level function module, the terminal determines a second research and development guarantee level of each sub-function module corresponding to the top-level function module according to the first research and development guarantee level and the dependency relationship tree.

In this step, after the research and development guarantee level of the top-level function module is determined, corresponding research and development guarantee levels are allocated to the sub-function modules corresponding to the top-level function module according to the predetermined dependency relationship tree. Generally, in a dependency tree, the development guarantee level of the top-level function module is the highest, and the development guarantee level of the corresponding sub-function module should be equal to or appropriately lower than the first development guarantee level of the top-level function module.

In the application program evaluation method, a first research and development guarantee level of each top-level function module of the application program is determined according to a danger level of the application program, wherein the danger level comprises at least one of a severity level of a dangerous consequence caused after the application program fails, a frequency level of the application program contacting an external dangerous event and a probability level of the external dangerous event, in the application program, each top-level function module corresponds to at least one sub-function module, and each top-level function module depends on each sub-function module corresponding to the top-level function module; then for each top-level function module, establishing a dependency relationship tree corresponding to the top-level function module, wherein the dependency relationship tree comprises the dependency relationship between the top-level function module and each sub-function module corresponding to the top-level function module; and finally, for each top-level function module, determining a second research and development guarantee level of each sub-function module corresponding to the top-level function module according to the first research and development guarantee level and the dependency relationship tree. According to the application program evaluation method, when the research and development guarantee level of the application program is evaluated, various influence factors influencing the danger level of the application program are fully considered, and the research and development guarantee level of each functional module is determined according to the dependency relationship among the functional modules in the application program, so that the evaluation on the research and development guarantee level of the application program is more accurate finally.

In an embodiment of the present application, please refer to fig. 3, which provides a method for determining a first development guarantee level of each top-level function module of an application in an application evaluation method, where the method includes:

step 301, the terminal obtains a risk level matrix table.

In this step, a risk level matrix table (as shown in table 4) may be established according to the three tables provided in step 201. In table 4, the risk levels are classified into five levels, which are represented by lower case a, b, c, d, and e, respectively. The smaller the letter, the higher the risk level; the core factor determining the risk level is "severity level of dangerous consequences caused after application failure" C "; in addition, the "frequency level F of the application program contacting the external dangerous event" and the "probability level W of the external dangerous event occurrence" play a role in adjusting the dangerous level.

TABLE 4

Step 302, the terminal determines the risk level of the application program by querying the risk level matrix table.

In step 303, the terminal determines the first research and development guarantee level of each top-level function module of the application program according to the risk level of the application program.

In this step, the corresponding relationship between the risk level and the research and development guarantee level given in table 5 may be referred to match each top-level function to a corresponding first research and development guarantee level.

TABLE 5

Hazard class	Corresponding research and development assurance level
		Catastrophic a	A
Danger b	B
		Significant c	C
Slight d	D
		Without safety influence e	E

In the embodiment of the application, five dependency relationships between the top-level functional module and the sub-functional module are provided. The method specifically comprises the following steps: a series dependency, a parallel dependency, a series-parallel dependency, a parallel-series dependency and a voting relationship. These five dependencies will be described in detail below.

One, series dependency (FIG. 4 provides a dependency tree diagram of series dependency, three subfunction modules are given in FIG. 4 by way of example only)

The serial dependency relationship is used for representing and ensuring that all the sub-function modules corresponding to the top-level function module work normally on the premise that the top-level function module works normally. In short, the failure of any sub-function module under the top-level function module will cause the failure of the top-level function module, and the dependency tree corresponding to the series dependency relationship is an or gate. When the top-level functional module and the sub-functional modules of the application satisfy the series dependency relationship, the second research and development guarantee level of each sub-functional module corresponding to the top-level functional module is determined as follows:

and the terminal takes the first research and development guarantee level as a second research and development guarantee level of each sub-function module corresponding to the top-layer function module.

Two, parallel dependency (FIG. 5 provides a dependency tree diagram of parallel dependency, and FIG. 5 only shows three sub-functional modules by way of example)

The parallel dependency relationship is used for representing and ensuring that the top-layer function module works normally on the premise that any sub-function module corresponding to the top-layer function module is ensured to be normal, in short, all sub-function modules under the top-layer function module fail to cause the top-layer function module to fail, and the dependency tree corresponding to the parallel dependency relationship is an and gate. When the top-level functional module and the sub-functional modules of the application satisfy the parallel dependency relationship, the second research and development guarantee level of each sub-functional module corresponding to the top-level functional module is determined as follows:

the terminal takes the first research and development guarantee level as a second research and development guarantee level of at least one sub-function module in each sub-function module corresponding to the top-layer function module; or,

and the terminal takes a third research and development guarantee level as a second research and development guarantee level of at least two sub-function modules in each sub-function module corresponding to the top-layer function module, wherein the third research and development guarantee level is lower than the first research and development guarantee level.

Three, series-parallel dependency and parallel-series dependency (FIG. 6 provides a dependency tree diagram of series-parallel dependency, only five sub-function modules are shown in FIG. 6 by way of example; FIG. 7 provides a dependency tree diagram of parallel-series dependency, only four sub-function modules are shown in FIG. 7 by way of example)

The parallel-serial dependency relationship and the serial-parallel dependency relationship are used for representing and ensuring that all the sub-function modules in the serial relationship in the sub-function modules corresponding to the top-level function module normally work, and any one of the sub-function modules in the parallel relationship normally works. In short, the series-parallel relationship is characterized in that the sub-functions under the top-layer functional module are wholly expressed as a series relationship, but on a certain series node, a plurality of sub-functional modules form a parallel relationship. Obviously, the contribution degree of the failure of the sub-function modules participating in parallel connection to the failure of the top-layer function module is smaller than that of the sub-function modules participating in series connection, and the dependency tree corresponding to the series-parallel connection dependency relationship is an OR gate; the parallel-serial dependency relationship is characterized in that under the top-layer functional module, the sub-functional modules are integrally represented in a parallel relationship, but on a certain serial node, a plurality of sub-functional modules form a serial relationship. Obviously, the contribution degree of the sub-function module failure participating in parallel connection to the failure of the top-layer function module is the same as that of the sub-function module participating in series connection, and the dependency tree corresponding to the series connection relationship is an and or gate. When the top-level functional module and the sub-functional modules of the application program satisfy the series-parallel dependency relationship or the parallel-series dependency relationship, the method for determining the second research and development guarantee level of each sub-functional module corresponding to the top-level functional module is specifically as follows:

the terminal takes the first research and development guarantee level of the top-layer function module as a second research and development guarantee level of at least one sub-function module in the sub-function modules in parallel relation in each sub-function module corresponding to the top-layer function module, or takes a third research and development guarantee level as a second research and development guarantee level of at least two sub-function modules in the sub-function modules in parallel relation in each sub-function module corresponding to the top-layer function module, wherein the third research and development guarantee level is lower than the first research and development guarantee level;

the terminal takes the first research and development guarantee level as a second research and development guarantee level of the sub-function module in the series relation in each sub-function module corresponding to the top-layer function module, or takes a fourth research and development guarantee level as a second research and development guarantee level of at least one sub-function module in the series relation in the parallel relation in the sub-function module corresponding to the top-layer function module, wherein the fourth research and development guarantee level is the highest research and development guarantee level in the sub-function module in the parallel relation in the sub-function module corresponding to the top-layer function module.

Voting relationships (FIG. 8 provides a dependency tree diagram of voting relationships, and FIG. 8 shows three sub-functional modules by way of example only)

The voting relationship is used for representing that the top-layer function module is normal, and is based on the premise that a preset number of sub-function modules in each sub-function module corresponding to the top-layer function module are normal, which is simply referred to as a voting system composed of n sub-function modules and 1 voter unit (a certain sub-function module). When the voter unit is normal, the number of the sub-functional modules which normally run is not less than r (r is not less than 1 and not more than n), the failure of the top functional module can not occur, and the dependency tree corresponding to the voting relation is a 'voting' door. When the voting relationship between the top-level function module and the sub-function modules of the application program is satisfied, the second research and development guarantee level of each sub-function module corresponding to the top-level function module is determined as follows:

the terminal takes the first research and development guarantee level of the top-layer functional module as a second research and development guarantee level of a sub-functional module at the position of the voter in each sub-functional module corresponding to the top-layer functional module;

the terminal takes the first research and development guarantee level of the top-layer function module as a second research and development guarantee level of at least one sub-function module which is not at the position of the voter in each sub-function module corresponding to the top-layer function module, or takes a third research and development guarantee level as the second research and development guarantee level of at least two sub-function modules which are not at the position of the voter in the sub-function module corresponding to the top-layer function module, wherein the third research and development guarantee level is lower than the first research and development guarantee level.

In the embodiment of the application, after the dependency tree between the top-level function module and the corresponding sub-function module in the application program is determined, the related sub-function module can be gradually researched and developed from top to bottom to ensure the level distribution. The specific method for determining the second development assurance level of each sub-function module corresponding to the top-level function module satisfies the principle 1 or the principle 2 in table 6.

TABLE 6

In an embodiment of the present application, please refer to fig. 9, which provides a method for adjusting a second research and development guarantee level in an application evaluation method, the method further includes:

in step 401, the terminal determines the probability level that the application fails to avoid the dangerous event.

In this step, a sensitivity analysis method is used to determine a "probability level of failing to avoid a dangerous event (denoted by P in the present application)", and an application program is subjected to the sensitivity analysis methodAnd evaluating the influence sensitivity of the failure probability on the occurrence probability of the dangerous event, namely evaluating the control or influence degree of the change of the failure probability of the application program item on the occurrence probability of the dangerous event. The main idea is as follows: considering the occurrence probability g (Q) of dangerous event as the failure probability Q of application program_iAnd (4) respectively solving partial derivatives of the occurrence probability of the dangerous events to the failure occurrence probability of the application program at the state point O to obtain an influence sensitivity value of the failure probability of the application program at the state point O. The larger the absolute value of the numerical value is, the more the probability Q of occurrence of failure of the application program is proved_iThe greater the impact on the probability of occurrence of a dangerous event g (Q), the probability of occurrence of a dangerous event g (Q) for an application failure Q_iAnd is more sensitive.

Different thresholds can be set for the influence sensitivity, corresponding to four probability levels, namely 'very high', 'normal' and 'very low', corresponding to I, II, III and IV. And then calculating the influence sensitivity of the failure of the application program on the dangerous event, and evaluating which threshold interval the influence sensitivity evaluation value falls in by an expert so as to obtain an evaluation value of the probability P that the application program cannot avoid the dangerous event.

Step 402, the terminal adjusts the second research and development guarantee level according to the probability level that the application program cannot avoid the dangerous event.

In this step, the basic principle of adjusting the second research and development level is to increase the level of the second research and development guarantee level when the probability level that the application program cannot avoid the dangerous event belongs to the preset level range.

Now, a specific description is given of how to adjust the second research and development level according to the "probability P that the application fails to avoid the dangerous event" in the series dependency relationship, the parallel dependency relationship, the series-parallel dependency relationship, the parallel-series dependency relationship, and the voting relationship:

one, series dependency relationship

The second research and development level of each sub-function module is the same as the first research and development guarantee level of the top-level function module, and is not influenced by the probability P that the application program cannot avoid the dangerous event.

Two, parallel dependency relationship

1) If the evaluation value of the probability P that the application program cannot avoid the dangerous event is high, the second research and development guarantee level of the sub-function module is consistent with the first research and development guarantee level of the top-layer function module, or the second research and development guarantee level of the sub-function module is the next level of the first research and development guarantee level of the top-layer function module;

2) if the evaluation value of the probability P that the application program cannot avoid the dangerous event is higher, the second research and development guarantee level of the sub-function module is the next level of the first research and development guarantee level of the top-layer function module;

3) if the "probability of the application failing to avoid the dangerous event P" is evaluated as "general" or "very low", the second development guarantee level of each sub-function module can be appropriately ranked according to its most serious danger level, but the allocation principle specified in table 6 must be satisfied.

Three, series-parallel dependency relationship

1) If the sub-function module is an item in a series relation, the corresponding second research and development guarantee level is consistent with the first research and development guarantee level of the top-layer function module;

2) for items in a parallel relationship to the sub-functional modules. If the evaluation value of the probability P that the application program cannot avoid the dangerous event is high, the second research and development guarantee level of the sub-function module is consistent with the first research and development guarantee level of the top-layer function module or is the next level of the first research and development guarantee level of the top-layer function module; if the evaluation value of the probability P that the application program cannot avoid the dangerous event is higher, the second research and development guarantee level of the sub-function module is the next level of the first research and development guarantee level of the top-layer function module;

3) if the "probability of the application failing to avoid the dangerous event P" is evaluated as "general" or "very low", the sub-function modules may be appropriately ranked according to their most serious danger levels, but must satisfy the assignment rule specified in table 6.

Four, series-parallel dependency relationship

1) For sub-functional modules are items in a parallel relationship. If the evaluation value of the probability P that the application program cannot avoid the dangerous event is high, the second research and development guarantee level of the sub-function module is consistent with the first research and development guarantee level of the top-layer function module or is the next level of the first research and development guarantee level of the top-layer function module; if the evaluation value of the probability P that the application program cannot avoid the dangerous event is higher, the second research and development guarantee level of the sub-function module is the next level of the first research and development guarantee level of the top-layer function module; if the "probability of the application failing to avoid the dangerous event P" evaluation value is "general" or "very low", the second development guarantee level of the sub-function module can be appropriately ranked according to its most serious danger level, but must satisfy the allocation principle specified in table 6;

2) for sub-functional modules are items in a serial relationship. If the evaluation value of the probability P that the application program cannot avoid the dangerous event is high, the second research and development guarantee level of the sub-function module is consistent with the highest research and development guarantee level of the sub-function module in the parallel relation;

3) if the "probability of the application failing to avoid the dangerous event P" is evaluated as "high", "normal", or "very low", the sub-function modules may be appropriately ranked according to their most serious danger levels, but must satisfy the assignment rule specified in table 6.

Five, voting relation

1) If the sub-function module is at the position of the voter, the corresponding second research and development guarantee level is consistent with the first research and development guarantee level of the top-layer function module;

2) for the sub-function modules are in the rest positions. If the evaluation value of the probability P that the application program cannot avoid the dangerous event is high, the second research and development guarantee level of the sub-function module is consistent with the first research and development guarantee level of the top-layer function module or is the next level of the first research and development guarantee level of the top-layer function module; if the evaluation value of the probability P that the application program cannot avoid the dangerous event is higher, the second research and development guarantee level of the sub-function module is the next level of the first research and development guarantee level of the top-layer function module; if the "probability of application failing to avoid a dangerous event P" is evaluated as "general" or "very low", the second development assurance level of the sub-function module can be appropriately ranked according to its most serious danger level, but must satisfy the allocation principle specified in table 6.

It should be understood that, although the steps in the flowcharts of fig. 2 to 9 are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-9 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

In an embodiment of the present application, as shown in fig. 10, there is provided an application evaluation apparatus 500 including: a first determining module 501, a establishing module 502 and a second determining module 503, wherein:

a first determining module 501, configured to determine a first research and development guarantee level of each top-level function module of an application according to a risk level of the application, where the risk level includes at least one of a severity level of a dangerous consequence caused after the application fails, a frequency level of the application contacting an external dangerous event, and a probability level of the external dangerous event, in the application, each top-level function module corresponds to at least one sub-function module, and each top-level function module depends on each sub-function module corresponding to the top-level function module;

an establishing module 502, configured to establish, for each top-level function module, a dependency tree corresponding to the top-level function module, where the dependency tree includes a dependency between the top-level function module and each sub-function module corresponding to the top-level function module;

a second determining module 503, configured to determine, for each top-level function module, a second development guarantee level of each sub-function module corresponding to the top-level function module according to the first development guarantee level and the dependency relationship tree.

In this embodiment of the present application, the first determining module 501 is specifically configured to obtain a risk level matrix table; determining the danger level of the application program by inquiring the danger level matrix table; the first level of development assurance for each top-level function module of the application is determined based on the risk level of the application.

In this embodiment of the application, the dependency relationship includes a serial dependency relationship, the premise that the serial dependency relationship is used for representing and ensuring that the top-level function module normally operates is that all sub-function modules corresponding to the top-level function module normally operate, and the second determining module 503 is specifically configured to use the first research and development guarantee level as a second research and development guarantee level of each sub-function module corresponding to the top-level function module.

In this embodiment of the application, the dependency relationship includes a parallel dependency relationship, the parallel dependency relationship is used for representing that it is guaranteed that any one of the sub-function modules corresponding to the top-level function module is normal on the premise that the top-level function module is guaranteed to operate normally, and the second determining module 503 is specifically configured to use the first research and development guarantee level as a second research and development guarantee level of at least one sub-function module in each of the sub-function modules corresponding to the top-level function module; or, taking a third research and development guarantee level as a second research and development guarantee level of at least two sub-function modules in each sub-function module corresponding to the top-layer function module, where the third research and development guarantee level is lower than the first research and development guarantee level.

In this embodiment, the dependency relationship includes a series-parallel dependency relationship and a parallel-series dependency relationship, where the series-parallel dependency relationship and the parallel-series dependency relationship are used for characterizing that it is ensured that all sub-function modules in the series relationship in each sub-function module corresponding to the top-level function module normally operate, and any sub-function module in the parallel relationship normally operates, and the second determining module 503 is specifically configured to use the first development guarantee level of the top-level function module as the second development guarantee level of at least one sub-function module in the sub-function modules in the parallel relationship in each sub-function module corresponding to the top-level function module, or use the third development guarantee level as the second development guarantee level of at least two sub-function modules in the parallel relationship in each sub-function module corresponding to the top-level function module, the third development assurance level is lower than the first development assurance level; and taking the first research and development guarantee level as a second research and development guarantee level of the sub-function module in the series relation in each sub-function module corresponding to the top-layer function module, or taking a fourth research and development guarantee level as a second research and development guarantee level of at least one sub-function module in the series relation in the parallel relation in the sub-function module corresponding to the top-layer function module, wherein the fourth research and development guarantee level is the highest research and development guarantee level in the sub-function module in the parallel relation in the sub-function module corresponding to the top-layer function module.

In this embodiment of the application, the dependency relationship includes a voting relationship, where the voting relationship is used to represent that the top-level function module is guaranteed to be normal on the premise that a preset number of sub-function modules in each sub-function module corresponding to the top-level function module are guaranteed to be normal, and the second determining module 503 is specifically configured to use the first development guarantee level of the top-level function module as a second development guarantee level of a sub-function module at a position of a voter in each sub-function module corresponding to the top-level function module; and taking the first research and development guarantee level of the top-layer function module as a second research and development guarantee level of at least one sub-function module which is not at the position of the voter in each sub-function module corresponding to the top-layer function module, or taking a third research and development guarantee level as the second research and development guarantee level of at least two sub-function modules which are not at the position of the voter in the sub-function module corresponding to the top-layer function module, wherein the third research and development guarantee level is lower than the first research and development guarantee level.

In the embodiment of the present application, please refer to fig. 11, another application evaluation apparatus 600 is provided, where the application evaluation apparatus 600 includes, in addition to the modules included in the application evaluation apparatus 500, optionally, the application evaluation apparatus 600 further includes an adjustment module 504.

The adjustment module 504 is configured to determine a probability level that the application fails to avoid the hazardous event; the second level of development assurance is adjusted according to a level of probability that the application fails to avoid the hazardous event.

In this embodiment of the application, the adjusting module 504 is specifically configured to increase the level of the second development guarantee level when the probability level that the application fails to avoid the dangerous event falls within a preset level range.

For the specific limitations of the application evaluation device, reference may be made to the above limitations of the application evaluation method, which are not described herein again. The various modules in the application evaluation apparatus described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.

In the embodiment of the present application, a computer device is provided, and the computer device may be a terminal, and its internal structure diagram may be as shown in fig. 12. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement an application evaluation method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.

Those skilled in the art will appreciate that the architecture shown in fig. 12 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In an embodiment of the present application, there is provided a computer device including a memory and a processor, the memory storing a computer program, and the processor implementing the following steps when executing the computer program:

In an embodiment of the application, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, realizes the steps of:

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. An application evaluation method, the method comprising:

determining a first research and development guarantee level of each top-level function module of an application program according to a danger level of the application program, wherein the danger level comprises at least one of a severity level of dangerous consequences caused after the application program fails, a frequency level of the application program contacting external dangerous events and a probability level of the external dangerous events, in the application program, each top-level function module corresponds to at least one sub-function module, and each top-level function module depends on each sub-function module corresponding to the top-level function module;

for each top-level function module, establishing a dependency relationship tree corresponding to the top-level function module, where the dependency relationship tree includes dependency relationships between the top-level function module and each of the sub-function modules corresponding to the top-level function module;

and for each top-level function module, determining a second research and development guarantee level of each sub-function module corresponding to the top-level function module according to the first research and development guarantee level and the dependency relationship tree.

2. The method of claim 1, wherein determining a first level of development assurance for each top-level functional module of an application based on a risk level of the application comprises:

acquiring a risk level matrix table;

determining the first research and development guarantee level of each top-level functional module of the application program according to the danger level of the application program.

3. The method according to claim 1, wherein the dependency relationship includes a serial dependency relationship, and the serial dependency relationship is used for characterizing that all sub-function modules corresponding to the top-level function module operate normally on the premise that the top-level function module operates normally, and the determining a second development guarantee level of each sub-function module corresponding to the top-level function module according to the first development guarantee level and the dependency relationship tree includes:

4. The method according to claim 1, wherein the dependency relationship includes a parallel dependency relationship, and the parallel dependency relationship is used for characterizing that it is guaranteed that the top-level function module operates normally on the premise that it is guaranteed that any one of the sub-function modules corresponding to the top-level function module operates normally, and the determining, according to the first development guarantee level and the dependency relationship tree, a second development guarantee level of each of the sub-function modules corresponding to the top-level function module includes:

5. The method according to claim 1, wherein the dependency relationship includes a series-parallel dependency relationship and a parallel-series dependency relationship, and the series-parallel dependency relationship and the parallel-series dependency relationship are used for characterizing that it is guaranteed that all sub-function modules in the series relationship in each sub-function module corresponding to the top-level function module are normally operated and any sub-function module in the parallel relationship is normally operated, and the determining a second development guarantee level of each sub-function module corresponding to the top-level function module according to the first development guarantee level and the dependency relationship tree includes:

taking the first research and development guarantee level of the top-level function module as a second research and development guarantee level of at least one sub-function module in the sub-function modules in parallel relation in each sub-function module corresponding to the top-level function module, or taking a third research and development guarantee level as a second research and development guarantee level of at least two sub-function modules in the sub-function modules in parallel relation in each sub-function module corresponding to the top-level function module, wherein the third research and development guarantee level is lower than the first research and development guarantee level;

and taking the first research and development guarantee level as a second research and development guarantee level of a sub-function module in a series relation in each sub-function module corresponding to the top-layer function module, or taking a fourth research and development guarantee level as a second research and development guarantee level of at least one sub-function module in a series relation in a parallel relation in a sub-function module corresponding to the top-layer function module, wherein the fourth research and development guarantee level is the highest research and development guarantee level in the sub-function module in the parallel relation in the sub-function module corresponding to the top-layer function module.

6. The method of claim 1, wherein the dependency relationship comprises a voting relationship, and the voting relationship is used for characterizing that a precondition for ensuring that the top-level function module is normal is to ensure that a preset number of sub-function modules in each sub-function module corresponding to the top-level function module are normal, and the determining, according to the first development guarantee level and the dependency relationship tree, a second development guarantee level of each sub-function module corresponding to the top-level function module comprises:

taking the first research and development guarantee level of the top-layer function module as a second research and development guarantee level of a sub-function module at the position of a voter in each sub-function module corresponding to the top-layer function module;

taking the first research and development guarantee level of the top-level function module as a second research and development guarantee level of at least one sub-function module which is not at the position of the voter in each sub-function module corresponding to the top-level function module, or,

and taking a third research and development guarantee level as the second research and development guarantee level of at least two sub-function modules which are not positioned at the position of the voter in the sub-function modules corresponding to the top-layer function module, wherein the third research and development guarantee level is lower than the first research and development guarantee level.

7. The method of claim 1, wherein after determining a second development assurance level for each of the sub-functional modules corresponding to the top-level functional module according to the first development assurance level and the dependency tree, the method further comprises:

and adjusting the second research and development guarantee level according to the probability level of the application program failing to avoid the dangerous event.

8. The method of claim 7, wherein said adjusting the second level of development assurance according to the level of probability that the application fails to avoid the hazardous event comprises:

and when the probability level of the application program which cannot avoid the dangerous event belongs to a preset level range, increasing the level of the second research and development guarantee level.

9. An application evaluation apparatus, the apparatus comprising:

the establishing module is used for establishing a dependency relationship tree corresponding to the top-level function module for each top-level function module, wherein the dependency relationship tree comprises the dependency relationship between the top-level function module and each sub-function module corresponding to the top-level function module;

and a second determining module, configured to determine, for each top-level function module, a second research and development guarantee level of each sub-function module corresponding to the top-level function module according to the first research and development guarantee level and the dependency relationship tree.

10. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 8 when executing the computer program.

11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 8.