CN107562615B - Airworthiness conformance testing method based on target conformance review and demonstration tree model - Google Patents
Airworthiness conformance testing method based on target conformance review and demonstration tree model Download PDFInfo
- Publication number
- CN107562615B CN107562615B CN201710601046.2A CN201710601046A CN107562615B CN 107562615 B CN107562615 B CN 107562615B CN 201710601046 A CN201710601046 A CN 201710601046A CN 107562615 B CN107562615 B CN 107562615B
- Authority
- CN
- China
- Prior art keywords
- target
- evidence
- tree
- node
- test
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention relates to a seaworthiness conformance testing method based on a target conformance review and demonstration tree model. The method is used for solving the problems that the demonstration structure lacks associated form description, the demonstration structure lacks change control and the demonstration structure lacks utilization of shared sub-items in airworthiness conformance testing.
Description
Technical Field
The invention relates to the field of computers, in particular to a seaworthiness conformance testing method based on a target conformance review and demonstration tree model.
Background
The basic process of target compliance review can be described as: the method comprises the steps of determining key items of testing target conformance by analyzing targets and related requirements proposed in the airworthiness conformance approval standard, and verifying whether the development process of the airworthiness software and final products thereof meet various targets in the standard by combining a proper demonstration method, such as a check sheet, qualitative analysis, quantitative analysis and the like.
In the above process, the key item of test target compliance obtained from the standard analysis is used as the input of the demonstration method, which may affect the reliability and efficiency of the subsequent demonstration to a great extent. Therefore, designing a demonstration structure with strong branch coverage and clear relationship to describe the above key items is particularly important for the target compliance review process.
Currently, the existing demonstration structure, such as the demonstration structure used in the gsn (global Structuring notification) demonstration method, although it can describe the demonstration related elements and the relationship existing between them, it has the following defects in the expression ability:
a) the argumentation logic of AND can only be expressed, but not of OR. However, in reality there is often the case: for an object, it can be proven to be true as long as a portion of its sub-objects are true;
b) failure to represent "evidence of a negative goal";
c) failure to represent "evidence of evidence";
in addition, the current demonstration structure has weak capability of dealing with changes, such as addition of additional target items, removal of evidence items, modification of evidence items and the like, so that the demonstration of target compliance needs to be performed again.
In addition, in the process of checking the conformity of a plurality of targets, the same associated target item may be shared; the same evidence item may in turn support multiple target items. However, the current demonstration structure does not establish a sharing mechanism well, so that each time the compliance inspection process of one target is completed, the evidence item and the associated target item involved in the process are recalculated.
Disclosure of Invention
In view of the foregoing analysis, the present invention aims to provide a seaworthiness conformance testing method based on a target conformance review and demonstration tree model, so as to solve the problems of lack of description of the demonstration structure on the associated form, lack of alteration control on the demonstration structure, and lack of utilization of the demonstration structure on the shared sub-item in the seaworthiness conformance testing.
The purpose of the invention is mainly realized by the following technical scheme:
a airworthiness conformance testing method based on a target conformance review and demonstration tree model comprises the following steps:
step S1, determining the standard of airworthiness conformance test; the standard is a comparison object of the airworthiness conformance test;
step S2, determining each target in the standard according to the step S1, and establishing a test model; the test model is a model tree;
and S3, testing each parameter to be tested of the airworthiness conformance test by adopting the test model of each target established in the step S2.
Further, the step S2 includes the following sub-steps:
step S201, data preparation; determining the association level of the target item according to the association hierarchy among the target items in the standard and acquiring an evidence item required by the target item according to the conformity;
step S202: establishing a demonstration tree; the evidence tree comprises a target node and an evidentiary node; the target nodes comprise a test target and related target items, the test target is used as a root node of the tree, the related target items are used as leaf nodes of the tree, and the levels of the related target items in the tree are determined according to the association levels; the evidentiary nodes comprise evidence items collected during tree building and evidence items supporting evidence collected in a subsequent process, the evidence items collected during tree building are child nodes of leaf nodes corresponding to the evidence items, and the evidence items supporting evidence collected in the subsequent process are child nodes of the supported evidence leaf nodes;
step S203, assigning values to nodes in the tree; target node assignment and evidentiary node assignment are included; the step of assigning values to the nodes comprises:
establishing a unique identity I for the node;
defining the type of the node, the type of the target node being 'object', and the type of the evidentiary node being 'evidence';
creating a storage object S to record the association form of the node to each father node;
creating a storage object R to record the results of the conformance tests of the nodes;
access to relevant data by identifying the form of the I + storage object name.
Further, the data preparation comprises determining an association level value of the target item and obtaining an evidence item;
the association level value of the target item represents the number of targets involved in establishing association between a certain target item associated with the test target and the target item; the correlation level calculation comprises the test target per se, and the test target is divided into 1 level and 2 levels until n level correlation and infinity level correlation are carried out, wherein the n level correlation is the maximum correlation level of the test target and the target item, and infinity represents no correlation between targets;
the evidence items include evidence related to the target item without a downward-related target or evidence used to prove evidence provided by a software vendor.
Further, the process of establishing the demonstration tree comprises the following steps:
establishing an empty tree, and taking a target to be tested as a root node of the tree;
putting the target item related to the target to be tested into a tree as a leaf node of the tree, wherein the associated level value L of the target item is the L-th layer of the target item in the tree;
placing an evidence item in the tree as a child node of a leaf node to which the evidence item corresponds; ,
if an evidence item supporting evidence is collected in a subsequent process, the evidence item is placed in the tree as a child node of the evidence.
Further, the placement criteria of the target item include:
a. acquiring the depth of a current tree, wherein the depth of the current tree is the association level value L of the target item;
b. traversing each leaf node in the current tree, acquiring a next-level associated target item taking a target corresponding to the leaf node as a reference from the target item with the associated level of the target C being L +1, and putting the next-level associated target item into the tree as a child node of the leaf node;
if the depth L of the current tree is less than n, repeating the steps a and b; otherwise, exiting.
Further, the putting criteria of the evidence items are as follows: and traversing each leaf node in the current tree, acquiring an evidence item required by the target item corresponding to the node, and putting the related evidence item into the tree as a child node of the node.
Further, the main association forms of the demonstration tree are mainly 6, including strong support and weak support of the target item and the test target, forward support and backward support of the evidence and the target item, and forward support and backward support of the evidence and the evidence of the demonstration.
Further, when the airworthiness conformance test is carried out on the parameter to be demonstrated, a bottom-up demonstration method is adopted, evidence to target demonstration is learned by combining a D-S evidence theory, and the target to target demonstration is completed by combining Bayes event probability, so that a test result of whether the target can pass the airworthiness conformance test under the current evidence information is obtained, and the test result is given in a confidence degree mode.
Further, the test results include: the system comprises a pass, a fail and an uncertain, wherein the pass represents the confidence that the judgment target passes the conformity review, the fail represents the confidence that the judgment target cannot pass the conformity review, and the uncertain represents the confidence that whether the judgment target passes the review.
Further, DO-178C was used as the comparison subject for the airworthiness compliance test.
The invention has the following beneficial effects:
1) the given test structure is additionally provided with an OR logic and a negative logic demonstration rule, and can further cover demonstration scenes involved in practical application.
2) The target conformance test result storage comprises three results of pass, fail and uncertain, which are respectively expressed in a form of confidence, so that the universality is strong.
3) The intermediate products output in the test process, such as the conformity result of the intermediate target item, can be repeatedly used for conformity demonstration of other related targets, so that the utilization of the shared target item is enriched, and the test cost is saved.
4) The tree structure is convenient to operate, and the test efficiency is improved.
5) Clear associated structure provides basis for quickly tracking evidence items influencing target conformity; meanwhile, for the change operation influencing the test structure, the spread range can be clearly defined, and the subsequent test method can be conveniently re-demonstrated in a local range.
Drawings
The drawings are only for purposes of illustrating particular embodiments and are not to be construed as limiting the invention, wherein like reference numerals are used to designate like parts throughout.
FIG. 1 is a diagram of a process for constructing a demonstration tree;
FIG. 2 is a diagram of an association relationship between target items.
Detailed Description
The preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings, which form a part hereof, and which together with the embodiments of the invention serve to explain the principles of the invention.
The embodiment discloses a seaworthiness conformance testing method based on a target conformance review and demonstration tree model, which comprises the following steps of:
step S1, determining the standard of airworthiness conformance test; the standard is a comparison object of the airworthiness conformance test.
In the embodiment, DO-178C is adopted as a comparison object of the airworthiness conformance test, 71 targets are mentioned in the DO-178C, and a demonstration tree with strong branch coverage and clear relation is established for each target according to the construction process given below and is used as an input model of the airworthiness conformance examination process.
Step S2, determining each target in the standard according to S1, and establishing a test model; the test model is a demonstration tree model;
as shown in fig. 1, the step S2 includes the following sub-steps:
step S201, data preparation. And in the data preparation stage, determining the association level of the target item according to the association hierarchy among the target items and acquiring the evidence item required by the target item according to the compliance. The method specifically comprises the following substeps:
and step S201-1, determining the association level value of the target item.
To ensure that the test covers as many processing cases as possible, in the examples, the DO-178C reference tables A-x were targeted to demonstrate the Set G-Set. The target (A-3-1) "High-level requirements with system requirements" in the G-Set is taken as the test target, and the target is given the alias "C" for convenience of the following description.
Target items associated downward with a test target C are obtained from DO-178C, and the association level among the target items is determined, the association level is divided into 1-level, 2-level, … … -level, n-level association and ∞ level association, and n is the maximum association level of the target C with the target items. The level value indicates the number of objects involved in the association between a certain object associated with object C and object C, and the certain object itself is included in the calculation of the level. Wherein ∞ represents no correlation between objects.
For target C, to demonstrate whether the target can pass compliance validation, the following 5 associated targets need to be involved: target D (all system requirements area verified by The high level requirements), target H (depleted requirements and The response for The existing register corrected, target F (The performance requirements of The system register verified by The high level requirements), and target G (The safety-related requirements of The system register verified by The high level requirements).
As shown in fig. 2, the association levels of the object D, E, F, G, H are 1 level, 2 level, and 1 level, respectively, with the object C as a reference; the association levels of the object E, F, G, H are 1 level, and infinity level, respectively, with the object D as a reference.
And step S201-2, acquiring an evidence item.
The evidence items include evidence or evidence of evidence related to the target item without a downward related target. Here, it includes obtaining evidence of the target E, F, G and H and evidence of evidence provided by the software vendor.
Step S202: and establishing a demonstration tree.
The demonstration tree comprises a target node and an evidentiary node, the target node comprises a test target C and an associated target item E, F, G, H, and the evidentiary node comprises an evidence item collected during tree building and an evidence item of supporting evidence collected in a subsequent process; the test target C is used as a root node of the tree; the related target items serve as leaf nodes of the tree, and the levels of the related target items in the tree are determined according to the association levels; the evidence items collected during the tree building process are child nodes of the leaf nodes corresponding to the evidence items, and the evidence items supporting evidence collected in the subsequent process are child nodes of the supported evidence leaf nodes.
Establishing the demonstration tree comprises the following substeps:
step S202-1, an empty tree is established, and a target C to be tested is used as a root node of the tree.
And S202-2, putting the target item related to the target C into a tree as a leaf node of the tree, wherein the association level value L is the L-th level of the target item in the tree. The placement criteria for the target item are described as follows:
a. and acquiring the depth of the current tree, wherein the depth of the current tree is the association level value L of the target item.
b. And traversing each leaf node in the current tree, acquiring a target item associated with the next level 1 by taking the target corresponding to the leaf node as a reference from the target item associated with the target C and having the level L +1, and putting the target item into the tree as a child node of the leaf node.
If the depth L of the current tree is less than n, repeating the steps a and b; otherwise, exiting.
By combining the above steps, we have built a tree with depth of 2, whose root node is C, the first level nodes are D and H, and E, H is the child node of D.
Step S202-3, the evidence item is taken as a child node of a leaf node corresponding to the evidence item and is put into a tree, and the specific putting criteria are described as follows:
and traversing each leaf node in the current tree, acquiring an evidence item required by the corresponding target of the node, and putting the evidence item into the tree as a child node of the node.
Step S202-4, if an evidence item supporting evidence is collected in the subsequent process, the evidence item is taken as a child node of the evidence and is put into a tree.
And S202-5, completing the establishment of a basic structure of a demonstration tree with the depth of n +1, wherein the expression form of the tree structure is more favorable for dynamic change management.
And step S203, assigning values to the nodes in the tree.
In the node assignment process, the scheme considers three aspects of description of the associated form, storage of the target conformity examination result and storage of the support degree of the evidence, and gives a more fresh meaning to the demonstration tree, so that the problem that other demonstration structures lack the description of the associated form can be solved, and the utilization of shared sub-items can be enriched.
The main association forms of the demonstration tree are mainly 6, as shown in table 1.
TABLE 1 Association modalities in an Association support model
Combining the main association form of the demonstration tree, the specific assignment of the nodes of the tree comprises the following steps:
and step S203-1, assigning a target node.
a) Establishing a unique identifier I of the node;
b) defining the type of the node as 'object';
c) creating a storage object S to record the association form of the storage object S to each father node, recording as strong support when the value is 1, and recording as weak support when the value is 0;
d) and creating a storage object R to record the self-conformity examination result of the node.
The data structure of the storage object is described as follows:
{pass:p，fail:q,uncertain:k}
and pass, fail and uncertain respectively represent the confidence degrees of the nodes in the compliance examination under the corresponding target items, wherein the confidence degrees of the nodes are respectively pass, fail and pass. In the default state, p ═ k ═ 0 and q ═ 1.
e) Finally, we can access the relevant data by identifying the form of the I + storage object name.
And step S203-2, assigning evidentiary nodes.
a) Establishing a unique identifier I of the node;
b) defining the type of the node as 'evidence';
c) and creating a storage object S to record the association form of the storage object S to each father node, recording the association form as forward support when the value is 1, and recording the association form as reverse support when the value is 0.
d) The storage object R is created to record its support for each parent node.
The data structure of the storage object is described as follows:
wherein, I1-In indicates that the evidence item supports n father nodes In total, object | | evidence indicates the father node type, and the meaning descriptions of pass, fail and uncertain In support are shown In Table 2:
TABLE 2 evidentiary node assignment Definitions for pass, fail and uncertain in support
e) Finally, we can access the relevant data by identifying the form of the I + storage object name.
Thus, a demonstration tree structure with strong branch coverage and clear relation used as a target conformance examination process is completed.
S3, testing each parameter to be tested of the airworthiness conformance test by adopting the test model of each target established in the step S2.
When the evidence tree constructed in the embodiment is used for carrying out airworthiness conformance testing on each parameter to be tested of the airplane, a bottom-up demonstration method is adopted, evidence to target demonstration is practiced by combining a D-S evidence theory, and the demonstration from the target to the target is completed by combining Bayes event probability, so that a test result of whether the target can pass the airworthiness conformance testing under the current evidence information is obtained, and the test result is given in a form of confidence. Specifically, the demonstration result is expressed as { pass: p, fail: q, uncertain: k }, wherein pass represents the confidence that the determination target passes the compliance review, fail represents the confidence that the determination target cannot pass the compliance review, and uncertain represents the confidence that the determination target cannot pass the review. Compared with the traditional method, the method is more flexible in either 'pass' or 'fail', is applicable to more demonstration methods and is more universal.
The beneficial effect that this embodiment can bring:
1) the given test structure is additionally provided with an OR logic and a negative logic demonstration rule, and can further cover demonstration scenes involved in practical application.
2) The target conformance test result storage comprises three results of pass, fail and uncertain, which are respectively expressed in a form of confidence, so that the universality is strong.
3) The intermediate products output in the test process, such as the conformity result of the intermediate target item, can be repeatedly used for conformity demonstration of other related targets, so that the utilization of the shared target item is enriched, and the test cost is saved.
4) The tree structure is convenient to operate, and the test efficiency is improved.
5) Clear associated structure provides basis for quickly tracking evidence items influencing target conformity; meanwhile, for the change operation influencing the test structure, the spread range can be clearly defined, and the subsequent test method can be conveniently re-demonstrated in a local range.
Those skilled in the art will appreciate that all or part of the flow of the method implementing the above embodiments may be implemented by a computer program, which is stored in a computer readable storage medium, to instruct related hardware. The computer readable storage medium is a magnetic disk, an optical disk, a read-only memory or a random access memory.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention.
Claims (6)
1. A airworthiness conformance testing method based on a target conformance review and demonstration tree model is characterized by comprising the following steps of:
step S1, determining the standard of airworthiness conformance test; the standard is a comparison object of the airworthiness conformance test;
s2, establishing a test model according to each target in the standard determined in the S1; the test model is a target conformance review demonstration tree model;
s3, testing each parameter to be tested of the airworthiness conformance test by adopting the test model of each target established in the S2;
the step S2 includes the following sub-steps:
step S201, data preparation; determining the association level of the target item according to the association hierarchy among the target items in the standard and acquiring an evidence item required by the target item according to the conformity;
the step S201 data preparation includes determining an association level value of a target item and acquiring an evidence item;
the association level value of the target item represents the number of targets involved in establishing association between a certain target item associated with the test target and the target item; the correlation level calculation comprises the test target per se, and the test target is divided into 1 level and 2 levels until n level correlation and infinity level correlation are carried out, wherein the n level correlation is the maximum correlation level of the test target and the target item, and infinity represents no correlation between targets;
the evidence items comprise evidence related to the target item without a downward related target or evidence used to support evidence;
step S202: establishing a demonstration tree; the demonstration tree comprises a target node and an evidentiary node; the target nodes comprise a test target and related target items, the test target is used as a root node of the tree, the related target items are used as leaf nodes of the tree, and the levels of the related target items in the tree are determined according to the association levels; the evidence nodes comprise evidence items collected during tree building and evidence items supporting evidence collected in a subsequent process, the evidence items collected during tree building are child nodes of leaf nodes corresponding to the evidence items, specifically, each leaf node in the current tree is traversed, the evidence items required by target items corresponding to the leaf nodes are obtained, and related evidence items are placed into the tree as the child nodes of the leaf nodes; the evidence items of the supporting evidence collected in the subsequent process are child nodes of the supported evidence leaf nodes;
the main association forms of the demonstration tree mainly comprise 6 types: strong support and weak support of the target item and the test target, forward support and reverse support of the evidence and the test target, and forward support and reverse support of the evidence and the supported evidence; step S203, assigning values to nodes in the tree; target node assignment and evidentiary node assignment are included; the node assignment step comprises:
step S203-1, target node assignment:
a) establishing a unique identifier I of the node;
b) defining the type of the node as 'object';
c) creating a storage object S to record the association form of the storage object S to each father node, recording as strong support when the value is 1, and recording as weak support when the value is 0;
d) creating a storage object R to record a self-conformity examination result of the node;
the data structure of the storage object is described as follows:
{pass: p，fail: q,uncertain: k}
wherein, pass, fail and uncertain respectively represent the confidence degrees of { pass }, { fail }, { pass, fail } in the correspondence examination under the target item of the node; in a default state, p = k = 0 and q = 1;
e) accessing the relevant data in the form of identifying the name of the I + storage object;
step S203-2, evidentiary node assignment:
a) establishing a unique identifier I of the node;
b) defining the type of the node as 'evidence';
c) creating a storage object S to record the association form of the storage object S to each father node, recording the association form as forward support when the value is 1, and recording the association form as reverse support when the value is 0;
d) creating a storage object R to record the support degree of the storage object R to each father node;
in the data structure of the storage object, I1-In parent represents that the evidence item supports n father nodes, object | evidence represents the father node type, pass In support represents the probability that airworthiness software passes through the airworthiness requirement of a top-level target under the support of the current evidence on the father node; fail represents the probability that airworthiness software cannot pass the airworthiness requirement of the top-level target under the support of the current evidence on the father node; the uncertain represents the probability that airworthiness software cannot determine whether the airworthiness software can pass the airworthiness requirement of the top-level target under the support of the current evidence on the father node;
e) the associated data is accessed by identifying the form of the I + storage object name.
2. The testing method according to claim 1, wherein the step S202 of building the demonstration tree comprises the following steps:
establishing an empty tree, and taking a target to be tested as a root node of the tree;
putting the target item related to the target to be tested into a tree as a leaf node of the tree, wherein the associated level value L of the target item is the L-th layer of the target item in the tree;
traversing each leaf node in the current tree, acquiring an evidence item required by the leaf node corresponding to a target item, and putting a related evidence item into the tree as a child node of the leaf node;
if an evidence item supporting evidence is collected in the subsequent process, the evidence item is put into the tree as a child node of the supported evidence.
3. The method of claim 1, wherein placing the target item into the tree as a leaf node of the tree comprises:
a. acquiring the depth of a current tree, wherein the depth of the current tree is the association level value L of the target item;
b. traversing each leaf node in the current tree, acquiring a next-level associated target item taking a target corresponding to the leaf node as a reference from the target item with the associated level of the target C being L +1, and putting the next-level associated target item into the tree as a child node of the leaf node;
if the depth L of the current tree is less than n, repeating the steps a and b; otherwise, exiting.
4. The test method according to claim 1, wherein when the airworthiness conformance test is performed on the parameter to be demonstrated, a bottom-up demonstration method is adopted, evidence-to-target demonstration is realized by combining a D-S evidence theory, target-to-target demonstration is completed by combining Bayes event probability, a test result of whether the target can pass the airworthiness conformance test under the current evidence information is obtained, and the test result is given in a form of confidence.
5. The test method of claim 4, wherein the test results comprise: the system comprises a pass, a fail and an uncertain, wherein the pass represents the confidence that the judgment target passes the conformity review, the fail represents the confidence that the judgment target cannot pass the conformity review, and the uncertain represents the confidence that whether the judgment target passes the review.
6. The test method according to any one of claims 1 to 5, wherein DO-178C is used as the comparison subject for the airworthiness compliance test.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710601046.2A CN107562615B (en) | 2017-07-21 | 2017-07-21 | Airworthiness conformance testing method based on target conformance review and demonstration tree model |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710601046.2A CN107562615B (en) | 2017-07-21 | 2017-07-21 | Airworthiness conformance testing method based on target conformance review and demonstration tree model |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107562615A CN107562615A (en) | 2018-01-09 |
| CN107562615B true CN107562615B (en) | 2020-09-25 |
Family
ID=60974132
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710601046.2A Active CN107562615B (en) | 2017-07-21 | 2017-07-21 | Airworthiness conformance testing method based on target conformance review and demonstration tree model |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107562615B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108521332A (en) * | 2018-04-09 | 2018-09-11 | 深圳市大恒数据安全科技有限责任公司 | A kind of electronic data demonstrate,proves correlating method admittedly |
| CN112084322A (en) * | 2020-07-30 | 2020-12-15 | 中国民用航空上海航空器适航审定中心 | Airworthiness case recommendation method based on conformance vector |
| CN116955211B (en) * | 2023-09-21 | 2024-01-12 | 中国标准化研究院 | Standard compliance testing method and device, electronic equipment and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6182058B1 (en) * | 1997-02-28 | 2001-01-30 | Silicon Graphics, Inc. | Bayes rule based and decision tree hybrid classifier |
| CN1855052A (en) * | 2005-04-25 | 2006-11-01 | 罗迪平 | Method for generating target source code from tree structural data and a set of fragment structure |
| CN104978275B (en) * | 2015-07-16 | 2017-09-29 | 北京航空航天大学 | A kind of target verification and evidence model extracting method towards DO 178C software test procedures |
-
2017
- 2017-07-21 CN CN201710601046.2A patent/CN107562615B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107562615A (en) | 2018-01-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10067776B2 (en) | Codeless generation of APIs | |
| JP6751235B2 (en) | Machine learning program, machine learning method, and machine learning device | |
| Krishna et al. | Too much automation? The bellwether effect and its implications for transfer learning | |
| CN110337641B (en) | Determining application test results using screen shot primitive data | |
| Ouni et al. | Web service antipatterns detection using genetic programming | |
| WO2019085061A1 (en) | Automatic test management method, apparatus and device for fund system, and storage medium | |
| JP6898562B2 (en) | Machine learning programs, machine learning methods, and machine learning equipment | |
| US8893035B2 (en) | Method, system and graphical user interface for configuring a simulator to simulate a plurality of devices | |
| JP6898561B2 (en) | Machine learning programs, machine learning methods, and machine learning equipment | |
| Fang et al. | The influence of knowledge networks on a firm’s innovative performance | |
| CN101526916B (en) | Method and system for using page-based object flow verification in regression test | |
| CN107562615B (en) | Airworthiness conformance testing method based on target conformance review and demonstration tree model | |
| CN111858615B (en) | Database table generation method, system, computer system and readable storage medium | |
| CN109034562B (en) | Social network node importance evaluation method and system | |
| US8141050B2 (en) | Deadlock detection by lock classification | |
| CN108399151B (en) | Data comparison system and method | |
| CN107832446B (en) | Configuration item information searching method and computing device | |
| CN103957116A (en) | Decision-making method and system of cloud failure data | |
| Dakhil et al. | BIM client maturity: literature review | |
| CN110334012B (en) | Risk assessment method and device | |
| Papadakis et al. | JedAI3: beyond batch, blocking-based Entity Resolution. | |
| EP3452927A1 (en) | Feature-set augmentation using knowledge engine | |
| US9324056B2 (en) | Model entity network for analyzing a real entity network | |
| CN115130130B (en) | Network disk file unlocking method and device, network disk and storage medium | |
| JP2013077124A (en) | Software test case generation device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |