CN111611150A - Test method, test device, test medium and electronic equipment - Google Patents
Test method, test device, test medium and electronic equipment Download PDFInfo
- Publication number
- CN111611150A CN111611150A CN201910138377.6A CN201910138377A CN111611150A CN 111611150 A CN111611150 A CN 111611150A CN 201910138377 A CN201910138377 A CN 201910138377A CN 111611150 A CN111611150 A CN 111611150A
- Authority
- CN
- China
- Prior art keywords
- node
- group
- nodes
- score
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 189
- 238000010998 test method Methods 0.000 title claims abstract description 11
- 238000000034 method Methods 0.000 claims abstract description 41
- 238000010586 diagram Methods 0.000 description 16
- 238000012545 processing Methods 0.000 description 14
- 238000004891 communication Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000011144 upstream manufacturing Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Abstract
The embodiment of the invention provides a test method, a test device, a test medium and electronic equipment, wherein the method comprises the following steps: determining a structure tree of a corresponding output result of a comparison group test system, wherein the output result of the comparison group test system is determined according to the same input data; determining a corresponding node group in a structure tree of the comparison group test system; and comparing the nodes in the node group according to a set rule, and determining the difference information corresponding to the comparison group test system. The difference comparison can be automatically carried out, and the efficiency and the accuracy are higher.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a test method and apparatus, a storage medium, and an electronic device.
Background
During system creation, maintenance, etc., differences in actual performance of the corresponding test system and the control system are often discovered by examining differences in output returned by the control group test system for the same input.
In the process of comparing the difference, the structured result data in the output result of the system is usually adopted for manual comparison, but because the data volume ratio of the output result is increased, the manual comparison usually comprises several key data, and the accuracy of the output result is influenced.
Disclosure of Invention
The embodiment of the invention provides a test method for improving test accuracy.
Correspondingly, the embodiment of the invention also provides a testing device, a storage medium and electronic equipment, which are used for ensuring the realization and application of the method.
In order to solve the above problem, an embodiment of the present invention discloses a test method, including: determining a structure tree of a corresponding output result of a comparison group test system, wherein the output result of the comparison group test system is determined according to the same input data; determining a corresponding node group in a structure tree of the comparison group test system; and comparing the nodes in the node group according to a set rule, and determining the difference information corresponding to the comparison group test system.
Optionally, the determining the structure tree of the corresponding output result of the control group test system includes: inputting the input data into each system included in the comparison group test system respectively to obtain an output result; and respectively establishing a structure tree corresponding to each system according to the output result.
Optionally, the determining a corresponding node group in the structure tree of the control group test system includes: respectively traversing nodes in a structure tree of the comparison group test system according to a set mode; and determining the corresponding relation of the nodes in different structure trees to obtain more than one node group.
Optionally, the comparing the nodes in the node group according to the set rule to determine the difference information corresponding to the comparison group test system includes: comparing the nodes in each node group according to a set rule to obtain the difference value of the nodes in the corresponding group of each node group; and obtaining difference information corresponding to the test system of the comparison group according to the difference value of the nodes in the corresponding group of each node group.
Optionally, the comparing, according to a set rule, the nodes in each node group to obtain a difference score of the nodes in the group corresponding to each node group includes at least one of: if the nodes in the node group are leaf nodes, determining the difference values of the nodes in the corresponding group of the node group according to the characteristics of the leaf nodes; and if the node group has non-leaf nodes, determining the difference score of the nodes in the group corresponding to the node group according to the characteristics of the nodes in the node group and at least one child node of the node.
Optionally, the characteristics of the node include node content and node attributes; the step of determining the difference score of the nodes in the corresponding group of the node group according to the characteristics of the nodes comprises the following steps: comparing the node contents of the nodes in the node group to determine a corresponding first score; comparing the node attributes of the nodes in the node group according to the attribute names to determine at least one second score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score and the at least one second score.
Optionally, the determining, according to the characteristics of the nodes in the node group and at least one child node of the node, a difference score of the node in the group corresponding to the node group includes: obtaining a corresponding first score and at least one second score according to the characteristics of the nodes; acquiring the difference score of each child node as each corresponding third score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score, the at least one second score and each third score.
Optionally, if the node in the node group is an array node, the difference score is related to the number of child nodes of the array node.
Optionally, before the obtaining the difference score of each child node, the method further includes: judging the category of the child node; and determining the category of the child node as a key category.
Optionally, the obtaining difference information corresponding to the comparison group test system according to the difference score of the node in the group corresponding to each node group includes: determining the difference value of the nodes in the corresponding group of the node group to which the root node belongs in the structure tree; and taking the difference value of the node in the corresponding group of the node group to which the root node belongs as the difference information corresponding to the comparison group test system.
Optionally, the control group test system at least comprises: a test system and a control system, the structure tree comprising at least: the test structure tree of the test system corresponding to the output result and the comparison structure tree of the comparison system corresponding to the output result.
The embodiment of the invention also provides a testing device, which comprises: the structure determining module is used for determining a structure tree of an output result corresponding to the comparison group test system, wherein the output result of the comparison group test system is determined according to the same input data; the node group determining module is used for determining a corresponding node group in the structure tree of the comparison group test system; and the difference determining module is used for comparing the nodes in the node group according to a set rule and determining the difference information corresponding to the comparison group test system.
Optionally, the structure determining module includes: the result determining submodule is used for respectively inputting the input data into each system contained in the comparison group test system to obtain an output result; and the structure tree establishing submodule is used for respectively establishing the structure trees corresponding to the systems according to the output results.
Optionally, the node group determining module is configured to traverse nodes in a structure tree of the comparison group test system respectively according to a set manner; and determining the corresponding relation of the nodes in different structure trees to obtain more than one node group.
Optionally, the difference determining module includes: the node group difference determining submodule is used for respectively comparing the nodes in each node group according to a set rule to obtain the difference value of the nodes in the corresponding group of each node group; and the system difference determining submodule is used for obtaining the difference information corresponding to the test system of the comparison group according to the difference value of the nodes in the corresponding group of each node group.
Optionally, the node group difference determining submodule is configured to determine, if a node in the node group is a leaf node, a difference score of a node in a group corresponding to the node group according to a feature of the leaf node; and if the node group has non-leaf nodes, determining the difference score of the nodes in the group corresponding to the node group according to the characteristics of the nodes in the node group and at least one child node of the node.
Optionally, the node group difference determining submodule is configured to compare node contents of nodes in the node group, and determine a corresponding first score; comparing the node attributes of the nodes in the node group according to the attribute names to determine at least one second score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score and the at least one second score.
Optionally, the node group difference determining submodule is configured to obtain a corresponding first score and at least one second score according to the characteristics of the node; acquiring the difference score of each child node as each corresponding third score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score, the at least one second score and each third score.
Optionally, if the node in the node group is an array node, the difference score is related to the number of child nodes of the array node.
Optionally, the node group difference determining submodule is further configured to determine a category of the child node; and determining the category of the child node as a key category.
Optionally, the system difference determining submodule is configured to determine a difference score of a node in a group corresponding to a node group to which a root node belongs in the structure tree; and taking the difference value of the node in the corresponding group of the node group to which the root node belongs as the difference information corresponding to the comparison group test system.
Optionally, the control group test system at least comprises: a test system and a control system, the structure tree comprising at least: the test structure tree of the test system corresponding to the output result and the comparison structure tree of the comparison system corresponding to the output result.
Embodiments of the present invention further provide a readable storage medium, where instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the test method according to any one of the embodiments of the present invention.
Embodiments of the present invention also provide an electronic device, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs configured to be executed by the one or more processors include instructions for: determining a structure tree of a corresponding output result of a comparison group test system, wherein the output result of the comparison group test system is determined according to the same input data; determining a corresponding node group in a structure tree of the comparison group test system; and comparing the nodes in the node group according to a set rule, and determining the difference information corresponding to the comparison group test system.
Optionally, the determining the structure tree of the corresponding output result of the control group test system includes: inputting the input data into each system included in the comparison group test system respectively to obtain an output result; and respectively establishing a structure tree corresponding to each system according to the output result.
Optionally, the determining a corresponding node group in the structure tree of the control group test system includes: respectively traversing nodes in a structure tree of the comparison group test system according to a set mode; and determining the corresponding relation of the nodes in different structure trees to obtain more than one node group.
Optionally, the comparing the nodes in the node group according to the set rule to determine the difference information corresponding to the comparison group test system includes: comparing the nodes in each node group according to a set rule to obtain the difference value of the nodes in the corresponding group of each node group; and obtaining difference information corresponding to the test system of the comparison group according to the difference value of the nodes in the corresponding group of each node group.
Optionally, the comparing, according to a set rule, the nodes in each node group to obtain a difference score of the nodes in the group corresponding to each node group includes at least one of: if the nodes in the node group are leaf nodes, determining the difference values of the nodes in the corresponding group of the node group according to the characteristics of the leaf nodes; and if the node group has non-leaf nodes, determining the difference score of the nodes in the group corresponding to the node group according to the characteristics of the nodes in the node group and at least one child node of the node.
Optionally, the characteristics of the node include node content and node attributes; the step of determining the difference score of the nodes in the corresponding group of the node group according to the characteristics of the nodes comprises the following steps: comparing the node contents of the nodes in the node group to determine a corresponding first score; comparing the node attributes of the nodes in the node group according to the attribute names to determine at least one second score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score and the at least one second score.
Optionally, the determining, according to the characteristics of the nodes in the node group and at least one child node of the node, a difference score of the node in the group corresponding to the node group includes: obtaining a corresponding first score and at least one second score according to the characteristics of the nodes; acquiring the difference score of each child node as each corresponding third score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score, the at least one second score and each third score.
Optionally, if the node in the node group is an array node, the difference score is related to the number of child nodes of the array node.
Optionally, before the obtaining the difference score of each child node, the method further includes: judging the category of the child node; and determining the category of the child node as a key category.
Optionally, the obtaining difference information corresponding to the comparison group test system according to the difference score of the node in the group corresponding to each node group includes: determining the difference value of the nodes in the corresponding group of the node group to which the root node belongs in the structure tree; and taking the difference value of the node in the corresponding group of the node group to which the root node belongs as the difference information corresponding to the comparison group test system.
Optionally, the control group test system at least comprises: a test system and a control system, the structure tree comprising at least: the test structure tree of the test system corresponding to the output result and the comparison structure tree of the comparison system corresponding to the output result.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, the structure tree of the output result corresponding to the comparison group test system is determined, wherein the output result of the comparison group test system is determined according to the same input data, then the corresponding node group in the structure tree of the comparison group test system is determined, so that a plurality of node groups can be determined according to the structure tree, the coverage rate of comparison difference is increased, then the nodes in the node groups are compared according to a set rule, the difference information corresponding to the comparison group test system is determined, the difference comparison can be automatically carried out, and the efficiency and the accuracy are higher.
Drawings
FIG. 1 is a flow chart of the steps of one test method embodiment of the present invention;
FIG. 2 is a flow chart of the steps of another test method embodiment of the present invention;
FIG. 3 is a flowchart illustrating exemplary steps for comparing node group differences in accordance with an embodiment of the present invention;
FIG. 4 is a block diagram of an embodiment of a test apparatus according to the present invention;
FIG. 5 is a block diagram of another test apparatus embodiment of the present invention;
FIG. 6 illustrates a block diagram of an electronic device for testing in accordance with an exemplary embodiment;
fig. 7 is a schematic structural diagram of an electronic device for testing according to another exemplary embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
In the process of system creation, maintenance and the like, the difference of actual performances of different systems is often discovered by checking the difference of outputs returned by a control group test system to the same input. Wherein, the comparison group test system at least comprises a test system and a comparison system, wherein the test system comprises at least one test system, and the comparison system comprises: at least one control system. Therefore, the same input data are respectively input into each system in the comparison group test system, and the corresponding output results are obtained for difference comparison.
Referring to fig. 1, a flowchart illustrating steps of an embodiment of a testing method of the present invention is shown, which may specifically include the following steps:
and 102, determining a structure tree of the corresponding output result of the comparison group test system.
For the comparison group test system, the input data required for performing the test may be determined, and the input data may be determined according to the system and the test requirements, which is not limited in the embodiment of the present invention. The input data may include structured data, such as XML (Extensible Markup Language) data, JSON (JavaScript object notation) data, and the like. The input data can then be input into each system included in the control group test system, respectively, to obtain the results output by each system, respectively. The output result may also include structured data, so that a corresponding structure tree may be determined according to the structured output result in the output result, where the corresponding structure tree may be obtained according to a structural relationship of each structured data in the output result.
And 104, determining a corresponding node group in the structure tree of the comparison group test system.
Comparing the structure trees in the comparison group test system, determining the corresponding relation of the nodes in different structure trees, taking at least one corresponding node in different structure trees as a node group, and obtaining more than one node group. For example, the leaf nodes at the bottom layer are compared upwards step by step to obtain the corresponding node group.
In the embodiment of the present invention, the node group includes at least one node; if corresponding nodes exist in different structure trees, the node group comprises more than one node; if some nodes in one structure tree may not have corresponding nodes in another structure tree in the process of traversing and contrasting the nodes in different structure trees, the nodes can also form node groups, and the node groups can be determined to be dissimilar to the corresponding nodes when correspondingly compared.
And 106, comparing the nodes in the node group according to a set rule, and determining the difference information corresponding to the comparison group test system.
In the embodiment of the invention, a structure tree comparison rule can be set, the nodes in the node group can be compared according to the set rule to obtain the difference score of the nodes in the corresponding group of the node group, and then the difference information corresponding to the comparison group test system is obtained according to the difference score of the nodes in the corresponding group of each node group corresponding to the structure tree, wherein the difference information refers to the difference condition of different systems in the comparison group test system and can be measured through score, description and the like. Therefore, the difference of the test systems of the comparison group can be matched based on the structure, and each node can be compared respectively, so that the accuracy is higher.
In summary, a structure tree of an output result corresponding to the comparison group test system is determined, wherein the output result of the comparison group test system is determined according to the same input data, and then a corresponding node group in the structure tree of the comparison group test system is determined, so that a plurality of node groups can be determined according to the structure tree, the coverage rate of comparison difference is increased, nodes in the node groups are compared according to a set rule, difference information corresponding to the comparison group test system is determined, difference comparison can be automatically performed, and efficiency and accuracy are high.
Referring to fig. 2, a flowchart of steps of another embodiment of the testing method of the present invention is shown, which may specifically include the following steps:
And 204, respectively establishing a structure tree corresponding to each system according to the output result.
The input data can be respectively input into each system in the comparison group test system to obtain the output result respectively output by each system, the output result comprises the structured data, so that the corresponding structure tree can be determined according to the structured output result in the output result, and the corresponding structure tree can be obtained according to the structural relationship of each structured data in the output result. The structural information can be determined according to the relationship between the structured output results, such as the structural information of parent-child and affiliation among data in the structured output results, and the relationship among data in the structured output results can be established according to the structural information, so as to construct a structural tree capable of representing the structural characteristics of the output results.
And step 206, traversing the nodes in the structure tree of the comparison group test system respectively according to a set mode.
And step 208, determining the corresponding relation of the nodes in different structure trees to obtain more than one node group.
After the structure tree is obtained, the structure tree of the comparison group test system may be traversed according to a set manner, for example, the structure tree is traversed upward from the leaf node of the bottom layer, so as to obtain nodes having a corresponding relationship in different structure trees corresponding to the comparison group test system, and obtain corresponding node groups.
In an optional embodiment of the present invention, the difference between the nodes in the node group is related to the child nodes of the node, so that the node group can be traversed upward from the bottom layer, and the nodes corresponding to different structure trees are determined from the bottom layer node to obtain the corresponding node group, thereby obtaining more than one node group. If the different structure trees all have the node, the node group comprises the nodes in each structure tree, and if the node in one structure tree does not have corresponding nodes in other structure trees, the node group can also be formed, so that the number of the nodes in one node group is between 1 and the number of the structure trees. For example, if there are two structure trees, the number of nodes in the node group is 1 or 2, and if there are three structure trees, the number of nodes in the node group is 1 or 2 or 3, etc.
And step 210, comparing the nodes in each node group according to a set rule to obtain the difference score of the nodes in the corresponding group of each node group.
After traversing more than one node group, the difference between the nodes in the node group can be determined according to the set rule for each node group, so as to obtain the difference score of the nodes in the corresponding group corresponding to each node group. After a node group is obtained through traversal, the difference score of the nodes in the group corresponding to the node group is determined, then the next node group is determined, and the difference score of the nodes in the group corresponding to each node group is obtained after the node group is traversed.
In an optional embodiment, the comparing the more than one node groups according to a set rule to obtain a difference score of nodes in the group corresponding to each node group includes at least one of: if the nodes in the node group are leaf nodes, determining the difference values of the nodes in the corresponding group of the node group according to the characteristics of the leaf nodes; and if the node group has non-leaf nodes, determining the difference score of the nodes in the group corresponding to the node group according to the characteristics of the nodes in the node group and at least one sub-node of the nodes.
The structure tree includes multiple types of nodes, such as root nodes, child nodes, etc., where a node without a child node is referred to as a leaf node, and a corresponding non-leaf node may refer to a node with a child node. For nodes in a node group, each node is a leaf node, and the node group is a leaf node group; if any node in a node group is a non-leaf node, the node group is a non-leaf node group. For the leaf nodes in the leaf node group, the difference can be directly compared, for example, the characteristics of each leaf node can be obtained, the difference between the leaf nodes is determined according to the characteristics, and the difference value of the node in the group corresponding to the node group is obtained; for non-leaf nodes, the difference between two non-leaf nodes is also related to the difference between the child nodes, so that the difference score of the node in the corresponding group of the node group can be determined according to the characteristics of the nodes in the node group and the child nodes of the node.
Further, the characteristics of the nodes comprise node contents and node attributes; the node content refers to content contained in the node, such as a text description, and the node attribute refers to an attribute possessed by the node, wherein one node may correspond to one or more attributes, and each attribute may include an attribute name and an attribute value. The step of determining the difference score of the nodes in the corresponding group of the node group according to the characteristics of the nodes comprises the following steps: comparing the node contents of the nodes in the node group to determine a corresponding first score; comparing the node attributes of the nodes in the node group according to the attribute names to determine at least one second score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score and the at least one second score. For the nodes in each node group, the difference can be determined between the corresponding nodes through the content and the attribute, wherein the text in the node content can be compared aiming at the node content, and the first score of the difference is determined through the text; and comparing the attribute values among the same attribute names aiming at the attributes to obtain corresponding second scores so as to obtain at least one second score, and then determining the difference score of the nodes in the corresponding group of the node group according to the first score and the at least one second score.
The determining the difference score of the node in the corresponding group of the node group according to the characteristics of the node in the node group and at least one child node of the node comprises: obtaining a corresponding first score and at least one second score according to the characteristics of the nodes; obtaining the difference scores of the child nodes as corresponding third scores; and determining the difference score of the nodes in the corresponding group of the node group according to the first score, the at least one second score and each third score. For a node having a child node, a first score may be determined according to the node content of the node and at least one second score may be determined according to the node attribute for each node, the determination method is similar to the above-described embodiment, and the difference score of the node corresponding to each child node may be used as a third score, so that at least one third score may be determined, and the difference score of the node group corresponding to the group node may be determined according to the first score, the at least one second score, and the at least one third score.
In the embodiment of the present invention, for the above example of determining the difference scores according to the plurality of scores, an average value of each score may be used as the difference score, for example, for a leaf node group, a first score corresponding to a node content between leaf nodes and a second score corresponding to each node attribute may be calculated, and then, an average value of the first score and each second score may be calculated as the difference score of a node in the group corresponding to the node group; aiming at a non-leaf node group, calculating a first score corresponding to node contents among non-leaf nodes, wherein a second score corresponding to each node attribute and a difference score among sub-nodes corresponding to the non-leaf nodes are respectively third scores, and thus the mean value of the first score, the second scores and the third scores is used as the difference score; or setting the node content, the node attribute and the weight of the child node, and calculating a weighted average value as a difference score and the like.
In the embodiment of the present invention, the number of nodes in some node groups is less than the number of the structure trees, and in this case, the nodes in the node groups are considered to be completely dissimilar, for example, if the difference score is a value between [0 and 1], the maximum difference is 1 if the difference is completely dissimilar, and the maximum difference is 0 if the difference is not, so as to obtain the corresponding difference score.
In some optional embodiments of the present invention, there may be a node of a number type in the structure tree, and if the node in the node group is a node of an number group type, the difference score may further be related to the number of child nodes of the number group type node, and it may be determined whether the difference in the number of child nodes in the array is considered as a difference by configuration.
In other optional embodiments of the present invention, before obtaining the difference score of the child node of at least one of the nodes, the method further includes: judging the category of the child node; and determining the category of the child node as a key category. After judging the category of the child node, if the category of the child node is a key category, executing a step of acquiring a difference score of at least one child node of the node. In the embodiment of the present invention, the child nodes of a node may further set categories according to importance, for example, the categories include a key class node and a negligible node, so that for the key class node, the difference score of the child node may be used as a third score for calculating the difference score of its parent node, and for the negligible node, the difference score of such child node may be ignored and is not transmitted to its parent node.
In an alternative embodiment, an example of a comparison between nodes in a node group is illustrated in FIG. 3.
Thus, after the comparison in the above manner, one node can have the degree of difference scores of multiple dimensions (attributes, contents, etc.). For each node, weighted average can be carried out according to a certain numerical value, and the final difference value is obtained and transmitted upwards. Instead of integrating the differential scores of the child nodes, scores of multiple dimensions may be passed upwards, such as directly passing the first scores, the second scores, and the like of the child nodes.
The difference scores of the nodes in the corresponding groups of the node groups can be obtained, so that the difference information corresponding to the comparison group test system can be obtained according to the difference scores of the nodes in the corresponding groups of the node groups, wherein the difference score of the node in each node group is related to the child node of the node, so that the difference scores of the nodes in each node group can be upwards transmitted to the root node, the root node is determined in the above mode, the difference scores of the nodes in the corresponding groups of the node groups to which the root node belongs are obtained by transmitting the difference scores layer by layer, and then the difference scores are used as the difference information corresponding to the comparison group test system to evaluate the difference of the two output results.
Therefore, the difference on the node structure can be reflected in the test comparison result in a recursive traversal mode, and simultaneously, the test can also cover each node of the structure tree.
The embodiment of the invention provides a set traversal mode and a scoring thought for identifying differences, and an actual scoring strategy can be modified according to the requirements of comparison objects, such as: and adopting different traversal strategies, selecting depth priority or breadth priority, or giving different weights to different nodes, thereby reducing the false alarm rate in the contrast test.
For the sub-node differences in the test process, the embodiment of the invention can adopt a weighted average method to obtain the total difference. In combination with other ways, for example, structured data returned by a certain module of the test system, the importance degree of the structured data returned by the test module can be distinguished by applying the method of using the field content by the upstream module, for example, the importance degree is divided into "very important use/frequent use/infrequent use/hardly use/completely unused", and the like, so as to set different weights.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 4, a block diagram of a testing apparatus according to an embodiment of the present invention is shown, which may specifically include the following modules: a structure determination module 402, a node group determination module 404, and a difference determination module 406, wherein,
a structure determining module 402, configured to determine a structure tree of an output result corresponding to the comparison group test system, where the output result of the comparison group test system is determined according to the same input data.
A node group determining module 404, configured to determine a corresponding node group in the structure tree of the comparison group test system.
And a difference determining module 406, configured to compare nodes in the node group according to a set rule, and determine difference information corresponding to the comparison group test system.
In summary, a structure tree of an output result corresponding to the comparison group test system is determined, wherein the output result of the comparison group test system is determined according to the same input data, and then a corresponding node group in the structure tree of the comparison group test system is determined, so that a plurality of node groups can be determined according to the structure tree, the coverage rate of comparison difference is increased, nodes in the node groups are compared according to a set rule, difference information corresponding to the comparison group test system is determined, difference comparison can be automatically performed, and efficiency and accuracy are high.
Referring to fig. 5, a block diagram of another testing apparatus according to another embodiment of the present invention is shown, which may specifically include the following modules: a structure determination module 402, a node group determination module 404, and a difference determination module 406, wherein,
a structure determining module 402, configured to determine a structure tree of an output result corresponding to the comparison group test system, where the output result of the comparison group test system is determined according to the same input data.
A node group determining module 404, configured to determine a corresponding node group in the structure tree of the comparison group test system.
And a difference determining module 406, configured to compare nodes in the node group according to a set rule, and determine difference information corresponding to the comparison group test system.
Wherein the structure determining module 402 comprises: result determination submodule 4022 and structure tree building submodule 4024.
The result determining sub-module 4022 is configured to input the input data to each system included in the control group test system, and obtain an output result.
The structure tree establishing sub-module 4024 is configured to respectively establish a structure tree corresponding to each test system according to the output result.
The node group determining module 404 is configured to traverse nodes in a structure tree of the comparison group test system respectively according to a set manner; and determining the corresponding relation of the nodes in different structure trees to obtain more than one node group.
The difference determining module 406 includes: a node group difference determination sub-module 4062 and a system difference determination sub-module 4064.
The node group difference determining submodule 4062 is configured to compare the nodes in each node group according to a set rule, and obtain a difference score of the node in the group corresponding to each node group;
the system difference determining submodule 4064 is configured to obtain difference information corresponding to the comparison group test system according to the difference score of the node in the group corresponding to each node group.
The node group difference determining submodule 4062 is configured to determine, if a node in the node group is a leaf node, a difference score of a node in a group corresponding to the node group according to a feature of the leaf node; and if the node group has non-leaf nodes, determining the difference score of the nodes in the group corresponding to the node group according to the characteristics of the nodes in the node group and at least one sub-node of the nodes.
The node group difference determining submodule 4062 is configured to compare node contents of nodes in the node group, and determine a corresponding first score; comparing the node attributes of the nodes in the node group according to the attribute names to determine at least one second score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score and the at least one second score.
The node group difference determining submodule 4062 is configured to obtain a corresponding first score and at least one second score according to the characteristics of the node; acquiring the difference score of each child node as each corresponding third score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score, the at least one second score and each third score.
Wherein, if the node in the node group is an array type node, the difference score is related to the number of child nodes of the array type node.
The node group difference determining submodule 4062 is further configured to determine the category of the child node; and determining the category of the child node as a key category.
The system difference determining submodule 4064 is configured to determine a difference score of a node in a group corresponding to a node group to which a root node belongs in the structure tree; and taking the difference value of the node in the corresponding group of the node group to which the root node belongs as the difference information corresponding to the comparison group test system.
In an embodiment of the present invention, the test system at least includes: a test system and a control system, the structure tree comprising at least: the test structure tree of the test system corresponding to the output result and the comparison structure tree of the comparison system corresponding to the output result.
Therefore, the difference on the node structure can be reflected in the test comparison result in a recursive traversal mode, and simultaneously, the test can also cover each node of the structure tree.
The embodiment of the invention provides a set traversal mode and a scoring thought for identifying differences, and an actual scoring strategy can be modified according to the requirements of comparison objects, such as: and adopting different traversal strategies, selecting depth priority or breadth priority, or giving different weights to different nodes, thereby reducing the false alarm rate in the contrast test.
For the sub-node differences in the test process, the embodiment of the invention can adopt a weighted average method to obtain the total difference. In combination with other ways, for example, structured data returned by a certain module of the test system, the importance degree of the structured data returned by the test module can be distinguished by applying the method of using the field content by the upstream module, for example, the importance degree is divided into "very important use/frequent use/infrequent use/hardly use/completely unused", and the like, so as to set different weights.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
FIG. 6 is a block diagram illustrating a structure of an electronic device 600 for testing according to an example embodiment. For example, the electronic device 600 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 6, electronic device 600 may include one or more of the following components: a processing component 602, a memory 604, a power component 606, a multimedia component 608, an audio component 610, an interface to input/output (I/O) 612, a sensor component 614, and a communication component 616.
The processing component 602 generally controls overall operation of the electronic device 600, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing elements 602 may include one or more processors 620 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 602 can include one or more modules that facilitate interaction between the processing component 602 and other components. For example, the processing component 602 can include a multimedia module to facilitate interaction between the multimedia component 608 and the processing component 602.
The memory 604 is configured to store various types of data to support operation at the device 600. Examples of such data include instructions for any application or method operating on the electronic device 600, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 604 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The multimedia component 608 includes a screen that provides an output interface between the electronic device 600 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 608 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 600 is in an operation mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 610 is configured to output and/or input audio signals. For example, the audio component 610 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 600 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 604 or transmitted via the communication component 616. In some embodiments, audio component 610 further includes a speaker for outputting audio signals.
The I/O interface 612 provides an interface between the processing component 602 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 614 includes one or more sensors for providing status assessment of various aspects of the electronic device 600. For example, the sensor component 614 may detect an open/closed state of the device 600, the relative positioning of components, such as a display and keypad of the electronic device 600, the sensor component 614 may also detect a change in the position of the electronic device 600 or a component of the electronic device 600, the presence or absence of user contact with the electronic device 600, orientation or acceleration/deceleration of the electronic device 600, and a change in the temperature of the electronic device 600. The sensor assembly 614 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 616 is configured to facilitate communications between the electronic device 600 and other devices in a wired or wireless manner. The electronic device 600 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 614 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 614 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the electronic device 600 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 604 comprising instructions, executable by the processor 620 of the electronic device 600 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform a method of testing, the method comprising: determining a structure tree of a corresponding output result of a comparison group test system, wherein the output result of the comparison group test system is determined according to the same input data; determining a corresponding node group in a structure tree of the comparison group test system; and comparing the nodes in the node group according to a set rule, and determining the difference information corresponding to the comparison group test system.
Optionally, the determining the structure tree of the corresponding output result of the control group test system includes: inputting the input data into each system included in the comparison group test system respectively to obtain an output result; and respectively establishing a structure tree corresponding to each system according to the output result.
Optionally, the determining a corresponding node group in the structure tree of the control group test system includes: respectively traversing nodes in a structure tree of the comparison group test system according to a set mode; and determining the corresponding relation of the nodes in different structure trees to obtain more than one node group.
Optionally, the comparing the nodes in the node group according to the set rule to determine the difference information corresponding to the comparison group test system includes: comparing the nodes in each node group according to a set rule to obtain the difference value of the nodes in the corresponding group of each node group; and obtaining difference information corresponding to the test system of the comparison group according to the difference value of the nodes in the corresponding group of each node group.
Optionally, the comparing, according to a set rule, the nodes in each node group to obtain a difference score of the nodes in the group corresponding to each node group includes at least one of: if the nodes in the node group are leaf nodes, determining the difference values of the nodes in the corresponding group of the node group according to the characteristics of the leaf nodes; and if the node group has non-leaf nodes, determining the difference score of the nodes in the group corresponding to the node group according to the characteristics of the nodes in the node group and at least one child node of the node.
Optionally, the characteristics of the node include node content and node attributes; the step of determining the difference score of the nodes in the corresponding group of the node group according to the characteristics of the nodes comprises the following steps: comparing the node contents of the nodes in the node group to determine a corresponding first score; comparing the node attributes of the nodes in the node group according to the attribute names to determine at least one second score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score and the at least one second score.
Optionally, the determining, according to the characteristics of the nodes in the node group and at least one child node of the node, a difference score of the node in the group corresponding to the node group includes: obtaining a corresponding first score and at least one second score according to the characteristics of the nodes; acquiring the difference score of each child node as each corresponding third score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score, the at least one second score and each third score.
Optionally, if the node in the node group is an array node, the difference score is related to the number of child nodes of the array node.
Optionally, before the obtaining the difference score of each child node, the method further includes: judging the category of the child node; and determining the category of the child node as a key category.
Optionally, the obtaining difference information corresponding to the comparison group test system according to the difference score of the node in the group corresponding to each node group includes: determining the difference value of the nodes in the corresponding group of the node group to which the root node belongs in the structure tree; and taking the difference value of the node in the corresponding group of the node group to which the root node belongs as the difference information corresponding to the comparison group test system.
Optionally, the control group test system at least comprises: a test system and a control system, the structure tree comprising at least: the test structure tree of the test system corresponding to the output result and the comparison structure tree of the comparison system corresponding to the output result.
Fig. 7 is a schematic structural diagram of an electronic device 700 for testing according to another exemplary embodiment of the present invention. The electronic device 700 may be a server, which may vary significantly depending on configuration or performance, and may include one or more Central Processing Units (CPUs) 722 (e.g., one or more processors) and memory 732, one or more storage media 730 (e.g., one or more mass storage devices) storing applications 742 or data 744. Memory 732 and storage medium 730 may be, among other things, transient storage or persistent storage. The program stored in the storage medium 730 may include one or more modules (not shown), each of which may include a series of instruction operations for the server. Further, the central processor 722 may be configured to communicate with the storage medium 730, and execute a series of instruction operations in the storage medium 730 on the server.
The server may also include one or more power supplies 726, one or more wired or wireless network interfaces 750, one or more input-output interfaces 758, one or more keyboards 756, and/or one or more operating systems 741, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.
An electronic device comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors the one or more programs including instructions for: determining a structure tree of a corresponding output result of a comparison group test system, wherein the output result of the comparison group test system is determined according to the same input data; determining a corresponding node group in a structure tree of the comparison group test system; and comparing the nodes in the node group according to a set rule, and determining the difference information corresponding to the comparison group test system.
Optionally, the determining the structure tree of the corresponding output result of the control group test system includes: inputting the input data into each system included in the comparison group test system respectively to obtain an output result; and respectively establishing a structure tree corresponding to each system according to the output result.
Optionally, the determining a corresponding node group in the structure tree of the control group test system includes: respectively traversing nodes in a structure tree of the comparison group test system according to a set mode; and determining the corresponding relation of the nodes in different structure trees to obtain more than one node group.
Optionally, the comparing the nodes in the node group according to the set rule to determine the difference information corresponding to the comparison group test system includes: comparing the nodes in each node group according to a set rule to obtain the difference value of the nodes in the corresponding group of each node group; and obtaining difference information corresponding to the test system of the comparison group according to the difference value of the nodes in the corresponding group of each node group.
Optionally, the comparing, according to a set rule, the nodes in each node group to obtain a difference score of the nodes in the group corresponding to each node group includes at least one of: if the nodes in the node group are leaf nodes, determining the difference values of the nodes in the corresponding group of the node group according to the characteristics of the leaf nodes; and if the node group has non-leaf nodes, determining the difference score of the nodes in the group corresponding to the node group according to the characteristics of the nodes in the node group and at least one child node of the node.
Optionally, the characteristics of the node include node content and node attributes; the step of determining the difference score of the nodes in the corresponding group of the node group according to the characteristics of the nodes comprises the following steps: comparing the node contents of the nodes in the node group to determine a corresponding first score; comparing the node attributes of the nodes in the node group according to the attribute names to determine at least one second score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score and the at least one second score.
Optionally, the determining, according to the characteristics of the nodes in the node group and at least one child node of the node, a difference score of the node in the group corresponding to the node group includes: obtaining a corresponding first score and at least one second score according to the characteristics of the nodes; acquiring the difference score of each child node as each corresponding third score; and determining the difference score of the nodes in the corresponding group of the node group according to the first score, the at least one second score and each third score.
Optionally, if the node in the node group is an array node, the difference score is related to the number of child nodes of the array node.
Optionally, before the obtaining the difference score of each child node, the method further includes: judging the category of the child node; and determining the category of the child node as a key category.
Optionally, the obtaining difference information corresponding to the comparison group test system according to the difference score of the node in the group corresponding to each node group includes: determining the difference value of the nodes in the corresponding group of the node group to which the root node belongs in the structure tree; and taking the difference value of the node in the corresponding group of the node group to which the root node belongs as the difference information corresponding to the comparison group test system.
Optionally, the control group test system at least comprises: a test system and a control system, the structure tree comprising at least: the test structure tree of the test system corresponding to the output result and the comparison structure tree of the comparison system corresponding to the output result.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The above detailed description of the testing method, the testing apparatus, the storage medium, and the electronic device provided by the present invention, and the specific examples are applied herein to explain the principles and embodiments of the present invention, and the descriptions of the above examples are only used to help understand the method and the core ideas of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A method of testing, comprising:
determining a structure tree of a corresponding output result of a comparison group test system, wherein the output result of the comparison group test system is determined according to the same input data;
determining a corresponding node group in a structure tree of the comparison group test system;
and comparing the nodes in the node group according to a set rule, and determining the difference information corresponding to the comparison group test system.
2. The method of claim 1, wherein determining the structure tree corresponding to the output results for the control group test system comprises:
inputting the input data into each system included in the comparison group test system respectively to obtain an output result;
and respectively establishing a structure tree corresponding to each system according to the output result.
3. The method of claim 1, wherein determining the corresponding set of nodes in the structure tree of the control group test system comprises:
respectively traversing nodes in a structure tree of the comparison group test system according to a set mode;
and determining the corresponding relation of the nodes in different structure trees to obtain more than one node group.
4. The method of claim 3, wherein comparing the nodes in the node group according to the set rule to determine the difference information corresponding to the control group test system comprises:
comparing the nodes in each node group according to a set rule to obtain the difference value of the nodes in the corresponding group of each node group;
and obtaining difference information corresponding to the test system of the comparison group according to the difference value of the nodes in the corresponding group of each node group.
5. The method according to claim 4, wherein comparing the nodes in each node group according to a set rule to obtain a difference score of the nodes in the group corresponding to each node group comprises at least one of:
if the nodes in the node group are leaf nodes, determining the difference values of the nodes in the corresponding group of the node group according to the characteristics of the leaf nodes;
and if the node group has non-leaf nodes, determining the difference score of the nodes in the group corresponding to the node group according to the characteristics of the nodes in the node group and at least one child node of the node.
6. The method of claim 5, wherein the characteristics of the nodes include node content and node attributes; the step of determining the difference score of the nodes in the corresponding group of the node group according to the characteristics of the nodes comprises the following steps:
comparing the node contents of the nodes in the node group to determine a corresponding first score;
comparing the node attributes of the nodes in the node group according to the attribute names to determine at least one second score;
and determining the difference score of the nodes in the corresponding group of the node group according to the first score and the at least one second score.
7. The method of claim 6, wherein determining the difference score of the node in the group corresponding to the node group according to the characteristics of the node in the group and at least one child node of the node comprises:
obtaining a corresponding first score and at least one second score according to the characteristics of the nodes;
acquiring the difference score of each child node as each corresponding third score;
and determining the difference score of the nodes in the corresponding group of the node group according to the first score, the at least one second score and each third score.
8. A test apparatus, the apparatus comprising:
the structure determining module is used for determining a structure tree of an output result corresponding to the comparison group test system, wherein the output result of the comparison group test system is determined according to the same input data;
the node group determining module is used for determining a corresponding node group in the structure tree of the comparison group test system;
and the difference determining module is used for comparing the nodes in the node group according to a set rule and determining the difference information corresponding to the comparison group test system.
9. A readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform a testing method according to any of method claims 1-7.
10. An electronic device comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors the one or more programs including instructions for:
determining a structure tree of a corresponding output result of a comparison group test system, wherein the output result of the comparison group test system is determined according to the same input data;
determining a corresponding node group in a structure tree of the comparison group test system;
and comparing the nodes in the node group according to a set rule, and determining the difference information corresponding to the comparison group test system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910138377.6A CN111611150B (en) | 2019-02-25 | 2019-02-25 | Test method, test device, test medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910138377.6A CN111611150B (en) | 2019-02-25 | 2019-02-25 | Test method, test device, test medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111611150A true CN111611150A (en) | 2020-09-01 |
| CN111611150B CN111611150B (en) | 2024-03-22 |
Family
ID=72202108
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910138377.6A Active CN111611150B (en) | 2019-02-25 | 2019-02-25 | Test method, test device, test medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111611150B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040254749A1 (en) * | 2003-06-16 | 2004-12-16 | Canon Kabushiki Kaisha | Insulation verification system, insulation verification method, and storage medium |
| US20150242380A1 (en) * | 2014-02-27 | 2015-08-27 | International Business Machines Corporation | Checking testing coverage |
| US9483387B1 (en) * | 2014-03-17 | 2016-11-01 | Amazon Technologies, Inc. | Tree comparison functionality for services |
| CN107423217A (en) * | 2017-07-10 | 2017-12-01 | 东北大学秦皇岛分校 | Black box fuzz testing method and system based on variation tree |
| CN107516041A (en) * | 2017-08-17 | 2017-12-26 | 北京安普诺信息技术有限公司 | WebShell detection methods and its system based on deep neural network |
| US20180089067A1 (en) * | 2016-09-26 | 2018-03-29 | International Business Machines Corporation | White box testing |
| CN108984417A (en) * | 2018-08-15 | 2018-12-11 | 北京达佳互联信息技术有限公司 | Method for testing software, device, terminal and storage medium |
| CN109147949A (en) * | 2018-08-16 | 2019-01-04 | 辽宁大学 | A method of based on post-class processing come for detecting teacher's sub-health state |
| CN109241256A (en) * | 2018-08-20 | 2019-01-18 | 百度在线网络技术（北京）有限公司 | Dialog process method, apparatus, computer equipment and readable storage medium storing program for executing |
| CN109308411A (en) * | 2018-08-20 | 2019-02-05 | 中国电力科学研究院有限公司 | The method and system of layered weighting software action defect based on artificial intelligence decision tree |
-
2019
- 2019-02-25 CN CN201910138377.6A patent/CN111611150B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040254749A1 (en) * | 2003-06-16 | 2004-12-16 | Canon Kabushiki Kaisha | Insulation verification system, insulation verification method, and storage medium |
| US20150242380A1 (en) * | 2014-02-27 | 2015-08-27 | International Business Machines Corporation | Checking testing coverage |
| US9483387B1 (en) * | 2014-03-17 | 2016-11-01 | Amazon Technologies, Inc. | Tree comparison functionality for services |
| US20180089067A1 (en) * | 2016-09-26 | 2018-03-29 | International Business Machines Corporation | White box testing |
| CN107423217A (en) * | 2017-07-10 | 2017-12-01 | 东北大学秦皇岛分校 | Black box fuzz testing method and system based on variation tree |
| CN107516041A (en) * | 2017-08-17 | 2017-12-26 | 北京安普诺信息技术有限公司 | WebShell detection methods and its system based on deep neural network |
| CN108984417A (en) * | 2018-08-15 | 2018-12-11 | 北京达佳互联信息技术有限公司 | Method for testing software, device, terminal and storage medium |
| CN109147949A (en) * | 2018-08-16 | 2019-01-04 | 辽宁大学 | A method of based on post-class processing come for detecting teacher's sub-health state |
| CN109241256A (en) * | 2018-08-20 | 2019-01-18 | 百度在线网络技术（北京）有限公司 | Dialog process method, apparatus, computer equipment and readable storage medium storing program for executing |
| CN109308411A (en) * | 2018-08-20 | 2019-02-05 | 中国电力科学研究院有限公司 | The method and system of layered weighting software action defect based on artificial intelligence decision tree |
Non-Patent Citations (1)
| Title |
|---|
| 王立新;杨峻;万仁霞;王铭军;: "基于树模型和输入参数关系的组合测试集精简方法", 计算机应用研究, no. 03 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111611150B (en) | 2024-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2670786C9 (en) | System, method and apparatus for device group control | |
| RU2638154C2 (en) | Methods and devices for number labeling | |
| CN109359056B (en) | Application program testing method and device | |
| WO2017031905A1 (en) | Social relationship analysis method and device | |
| CN105930536B (en) | Index establishing method, page jumping method and device | |
| EP3779968A1 (en) | Audio processing | |
| US20230217212A1 (en) | Ranging capacity request method, ranging capacity sending method, and ranging capacity receiving method | |
| CN111160448B (en) | Training method and device for image classification model | |
| US11335348B2 (en) | Input method, device, apparatus, and storage medium | |
| CN113826089A (en) | Contextual feedback with expiration indicators for natural understanding systems in chat robots | |
| US10356160B2 (en) | Methods and devices for acquiring user information | |
| RU2721181C1 (en) | Super network construction method, method of use, device and data medium | |
| CN104951445B (en) | Webpage processing method and device | |
| CN110928425A (en) | Information monitoring method and device | |
| KR101895701B1 (en) | Method and device for pushing user information | |
| CN111382064B (en) | Test method, test device, test medium and electronic equipment | |
| CN111611150B (en) | Test method, test device, test medium and electronic equipment | |
| CN111831132A (en) | Information recommendation method and device and electronic equipment | |
| CN108345590B (en) | Translation method, translation device, electronic equipment and storage medium | |
| CN112825247A (en) | Data processing method and device and electronic equipment | |
| CN112331194A (en) | Input method and device and electronic equipment | |
| CN111611470A (en) | Data processing method and device and electronic equipment | |
| CN111401048B (en) | Intention identification method and device | |
| CN111538486B (en) | Layout file nesting layer number screening method and device and electronic equipment | |
| CN110110292A (en) | A kind of data processing method, device and the device for data processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |