CN110333998B - Intelligent test scene arrangement method for networked control CPS system - Google Patents
Intelligent test scene arrangement method for networked control CPS system Download PDFInfo
- Publication number
- CN110333998B CN110333998B CN201910236986.5A CN201910236986A CN110333998B CN 110333998 B CN110333998 B CN 110333998B CN 201910236986 A CN201910236986 A CN 201910236986A CN 110333998 B CN110333998 B CN 110333998B
- Authority
- CN
- China
- Prior art keywords
- information
- test
- tested target
- generating
- arrangement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 134
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000013101 initial test Methods 0.000 claims abstract description 31
- 230000000007 visual effect Effects 0.000 claims abstract description 19
- 238000012545 processing Methods 0.000 claims abstract description 17
- 230000009471 action Effects 0.000 claims description 39
- 230000008569 process Effects 0.000 claims description 10
- 238000013461 design Methods 0.000 claims description 8
- 238000010586 diagram Methods 0.000 claims description 8
- 230000000694 effects Effects 0.000 claims description 4
- 230000003068 static effect Effects 0.000 claims description 3
- 230000001939 inductive effect Effects 0.000 claims 1
- 238000011056 performance test Methods 0.000 description 10
- 230000006399 behavior Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 206010013710 Drug interaction Diseases 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000002068 genetic effect Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000001172 regenerating effect Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 238000013522 software testing Methods 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Abstract
The invention relates to an intelligent test scene arrangement method for a networked control CPS system, which comprises the following steps: selecting a tested target, testing the tested target by using test software, and generating first test information; processing the first test information, wherein the processing comprises extracting the state information, classifying the state information and generating an initial test submodule; converting the initial test sub-module into an equivalent directed graph, checking logic between state information, and generating an equivalent directed model; proposing a requirement criterion, arranging the equivalent directed model for a plurality of times to generate a plurality of test scenes and generating arrangement information corresponding to the arrangement scenes; applying the arrangement information to the tested target, and executing again to generate second test information; and analyzing the second test information to evaluate the tested target. The method and the system can realize the generation of object-oriented visual and intelligent test scenes.
Description
Technical Field
The invention discloses an intelligent test scene arrangement method for a networked control CPS system, and belongs to the technical field of tests.
Background
With the continuous development of software testing technology, in the face of the existence of a complex system with tens of millions of users implementing concurrent load and real-time performance monitoring, a load testing tool capable of predicting system behaviors and performance becomes an essential product for technicians, so that performance testing software such as Loadrunner, Web Bench and kyline is widely applied. The performance testing software is mostly the whole enterprise or network system, and helps enterprise users to find and find problems faster and better by simulating the operation behavior of actual users and carrying out real-time performance monitoring.
In a physical information system (CPS), each subsystem performs information transmission through various types of communication networks, one system may be formed by interconnecting a plurality of subsystems with smaller scale, and physical devices in the subsystems also need to be interconnected by one or more heterogeneous networks, which makes performance testing of the converged system extremely complicated. A great deal of effort is required to face the numerous test codes and the corresponding multiple test scenarios to be established. The complex calling relationship between codes faces a technician with another level of dilemma. In a complex system combining hardware, software and a network, for example, a wireless or wired controlled network control robot is faced, and in the performance test process by using LoadRunner, technicians need to record all actions and protocols when performing performance tests on different action combinations, which is not only inefficient, but also requires manual modification due to the possible confusion in the recording process. Meanwhile, the test scenes are complicated and changeable, the test model graphs are mutually associated and restricted to generate a message sequence, and complicated message types are easy to appear in the test model. The method for generating the test scene by the test model is also complex, and generally comprises the steps of establishing a sequence graph model, extracting state information, defining a cross chain table structure, traversing an algorithm, establishing an equivalent directed graph and the like. Based on the complex test scenario generation method and the intelligent test implemented on the basis of the test scenario, the object-oriented visual scenario arrangement method can save code writing time and facilitate the process of generating a plurality of test scenarios.
Disclosure of Invention
The invention solves the problems: the method for arranging the intelligent test scenes of the networked control CPS system can solve the problems that in the prior art, all test scenes need to be generated when performance test is implemented, manual intervention and manual modification are needed when codes are generated in a disordered manner, and can realize object-oriented visualization and intelligent test scene generation.
The technical scheme of the invention is as follows:
an intelligent test scene arrangement method for a networked control CPS system comprises the following specific implementation steps:
step 1: selecting a tested target, testing the tested target by using test software, and generating first test information;
step 2: processing the first test information, wherein the processing comprises extracting the state information, classifying the state information and generating an initial test submodule;
and step 3: converting the initial test sub-module into an equivalent directed graph, checking logic between state information, and generating an equivalent directed model;
and 4, step 4: proposing a requirement criterion, arranging the equivalent directed model for a plurality of times to generate a plurality of test scenes and generating arrangement information corresponding to the arrangement scenes;
and 5: applying the arrangement information to the tested target, and executing again to generate second test information;
step 6: and analyzing the second test information to evaluate the tested target.
Through the steps, the problems that in the prior art, all test scenes are required to be generated when performance tests are carried out on a networked system or a whole enterprise, and manual intervention and manual modification are required when codes are generated in a disordered manner can be solved, the object-oriented visual test scenes can be generated, the scene design aiming at user requirement criteria can be realized, and the whole process is simplified.
And selecting the tested target in the step 1, testing the tested target by using test software, and generating first test information. The specific implementation steps are as follows: the tested target comprises a networked system, an enterprise and other units needing to be tested; the test software is a commercial or open source test software which is connected with a tested target physically or through a network and tests and analyzes the tested target, and comprises performance test software such as Loadrunner (a commercial software for testing system behavior and performance), Web Bench (a tool for testing Web performance) and kyrinpet (a domestic commercial tool), wherein the performance test software supports one or more protocols and has a strong performance test function. When the test software finishes testing, a test file is automatically generated and recorded as first test information.
In step 2, "processing the first test information" includes extracting the state information, classifying the state information, and generating an initial test sub-module. The specific implementation steps are as follows: and importing the test information into any commercial or open source visual graphic design software which can read the third party information and regenerate the information for processing. In the processing process, the state information includes the state or the attribute of the tested target under the static or excitation condition, and the state information expression mode can be a code or a character. Under the condition that the state information is code information, the step of extracting the state information comprises the steps of extracting action function codes, condition function codes and circulation function codes, and the step of classifying the state information comprises the steps of dividing the extracted code information into action information, condition information and circulation information and forming an information set, wherein in the performance test of the network control robot, the information set comprises an action set, a protocol set and a constraint set; and deleting repeated information in the information set, and summarizing similar information to generate an initial test submodule. In one embodiment, after the LoadRunner is adopted to test the integrated action machine, the generated suffix is C, the file is imported into any readable file and is subjected to visual graphic operation, the visual graphic design software of the file is regenerated, an action instruction function, an inter-action thinking time function, an inter-action sequence and a circulation function of the machine are extracted, the functions are sorted and summarized, and the initial testing sub-module is integrated.
And 3, converting the initial test sub-module into an equivalent directed graph, checking logic among state information, and generating an equivalent directed model. The specific implementation steps are as follows: the initial testing submodule is abstracted into an execution node, the logical relation between the initial testing submodules is abstracted into an arc connecting each node, the execution nodes are connected by adopting the arc containing a unidirectional arrow, the scattered submodules are related on the basis of the logical relation between the modules, and the initial testing submodule can be converted into an equivalent directed model.
And step 4, proposing a demand criterion, arranging the equivalent directed model for a plurality of times to generate a plurality of test scenes, and generating arrangement information corresponding to the arrangement scenes. The method comprises the following specific steps: a requirement criterion is provided for changing the generated directed model according to the user requirement so as to ensure that the designed directed model meets the required test requirement; arranging for a plurality of times to generate a plurality of test scenes for carrying out maximum permutation and combination on the initial test sub-modules, and designing an equivalent directed model which accords with logic between the modules on the basis of a requirement criterion; generating arrangement information corresponding to the arrangement scene for enabling each equivalent directed model to be applied to the tested target in an information form, wherein the visual graph design software capable of reading and regenerating the information is required to have a visual graph operation function. In one embodiment, the requirement criterion is based on a maximum coverage criterion, and the designed directional model is to be able to test the information parameters in the tested target to the maximum extent. In the embodiment, the action instruction function is converted into independent buttons, the cycle, sequence and condition functions are converted into arc connection among the buttons, when the logical relation among the action instruction function or the actions needs to be changed, the buttons and the arcs only need to be dragged on a graphic design interface, and different arranging information is generated by storing different equivalent directed models for multiple times for subsequent use.
And step 5, applying the layout information to the tested target, and executing again to generate second test information. The specific implementation steps are as follows: the layout information is applied to the tested target and then executed again, and the layout information is used for leading the object logic diagram of the layout design into the tested target in a code or character mode and carrying out test categories different from the tested target; and generating second test information which is generated after the tested target executes the arrangement information.
Wherein, the second test information is analyzed in the step 6 to evaluate the tested object. The specific implementation steps are as follows: and analyzing the second test information, comparing the regenerated test information with the first test information, comparing the coverage rate conditions of the first test information and the second test information under the condition that the requirement criterion is a coverage rate criterion, obtaining the influence degree of different test scenes on the test effect, and judging the specific behavior information and the performance parameters of the tested target.
Compared with the prior art, the invention has the advantages that: through the steps, the problems that in the prior art, all test scenes are required to be generated when performance tests are carried out on a networked system or a whole enterprise, and manual intervention and manual modification are required when codes are generated in a disordered manner can be solved, the object-oriented visual test scenes can be generated, the scene design aiming at user requirement criteria can be realized, and the whole process is simplified.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a schematic diagram of an intelligent test scenario arrangement method of a networked control CPS system;
FIG. 2 is a schematic diagram of an intelligent test scenario orchestration method for networked control of a CPS system;
FIG. 3 is a schematic diagram of an intelligent test scenario arrangement method of a networked control CPS system;
fig. 4 is another schematic diagram of an intelligent test scenario arrangement method of a networked control CPS system.
Detailed Description
The exemplary embodiments will be described herein in detail, and the embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention; rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
As shown in fig. 1, the invention provides an intelligent test scenario arrangement method for a networked control CPS system, which comprises the following steps:
101. and selecting a tested target, testing the tested target by using test software, and generating first test information.
Wherein, the tested target comprises a networked system or an enterprise and other units to be tested; the test software is a commercial or open source test software which is connected with a tested target physically or through a network and tests and analyzes the tested target, and comprises performance test software such as Loadrunner (a commercial software for testing system behavior and performance), Web Bench (a tool for testing Web performance) and kyrinpet (a domestic commercial tool), wherein the performance test software supports one or more protocols and has a strong performance test function. When the test software finishes testing, a test file is automatically generated and recorded as first test information. In one embodiment, LoadRunner is adopted to test any type of integrated action machine, the machine can perform actions such as turning around front, back, left and right and the like according to instructions, and when the test is completed, suffixes of ws and c are generated.
102. And processing the first test information, wherein the processing comprises extracting the state information, classifying the state information and generating an initial test submodule.
And importing the test information into any commercial or open source visual graphic design software which can read the third party information and regenerate the information for processing. As shown in fig. 2, in the processing procedure, the state information includes the state or attribute of the tested target under the static or excited condition, and the representation of the state information may be a code or a word. Under the condition that the state information is the code information, the step of extracting the state information comprises extracting the action function code, the condition function code and the circulation function code, and the step of classifying the state information comprises dividing the extracted code information into the action information, the condition information and the circulation information and forming an information set; as shown in fig. 3, testing a network robot by using test software, extracting a test file generated after a testing process is completed, importing the test file into software for layout developed by a person skilled in the art, generating a sequence diagram, extracting key information, and generating different information sets includes: the system comprises an action set, a protocol set, a constraint set and the like, wherein the information set forms an initial testing submodule, each information set is subjected to random algorithm, genetic algorithm and variation algorithm processing by adopting any algorithm suitable for variation to form a new information set, the new information set generates an abnormal scene or a normal scene under the judgment of the constraint set, and a generation model of a testing scene is displayed in the arrangement software for the next testing and processing.
The information set includes an action set, a protocol set, and a constraint set: under the condition of limited action set, generating an action case by adopting methods such as a genetic algorithm or random generation and the like so as to ensure that the action set contains enough actions; in the protocol set, the protocol is divided into a fixed protocol set and also divided into a new protocol formed by variation combination under the condition of protocol fault injection; in the constraint set, there are constraints on the precedence order of actions and constraints on whether actions are allowed or not. And deleting repeated information in the information set, and summarizing similar information to generate an initial test submodule. In one embodiment, after the LoadRunner is adopted to test the integrated action machine, the generated suffixes of c and ws are imported into any readable file and visual graph operation is carried out, the visual graph design software of the file is regenerated, the action instruction function, the inter-action thinking time function, the inter-action sequence and the loop function of the machine are extracted, the functions are sorted and summarized, and the initial test submodule is integrated.
103. And converting the initial test sub-module into an equivalent directed graph, checking the logic between the state information, and generating an equivalent directed model.
The initial testing submodule is abstracted into an execution node, the logical relation between the initial testing submodules is abstracted into arcs connecting all the nodes, the execution nodes are connected by adopting the arcs containing unidirectional arrows, the scattered submodules are related on the basis of the logical relation between the modules, and the initial testing submodule can be converted into an equivalent directed model. In a specific implementation manner, an extended cross-linked list may be used for storing a directed graph, where an execution node includes two chain domains that respectively point to a first arc node that uses the vertex as an arc head and an arc tail, and further includes a related domain for storing object-related information, such as an object name, an accessed state of the node, and an object receiving and sending object.
104. And a requirement criterion is provided, the equivalent directed model is arranged for a plurality of times to generate a plurality of test scenes, and arrangement information corresponding to the arrangement scenes is generated.
A requirement criterion is provided for changing the generated directed model according to the user requirement so as to ensure that the designed directed model meets the required test requirement; arranging for a plurality of times to generate a plurality of test scenes for carrying out maximum permutation and combination on the initial test sub-modules, and designing an equivalent directed model which accords with logic between the modules on the basis of a requirement criterion; generating arrangement information corresponding to the arrangement scene for enabling each equivalent directed model to be applied to the tested target in an information form, wherein the visual graph design software capable of reading and regenerating the information is required to have a visual graph operation function. In one embodiment, the requirement is mainly the maximum coverage rate, so that the designed directional model can test the information parameters in the target to be tested to the maximum extent, when the directional model is arranged, the relative position of the initial testing sub-modules can be changed in the form of dragging buttons, and the logical relationship between the initial testing sub-modules can be changed in the form of dragging arcs. In the embodiment of the present invention, as shown in fig. 4, the action command function is converted into independent buttons, the loop, sequence and condition functions are converted into arc connection between the buttons, when the action command function itself or the logical relationship between actions is to be changed, the buttons and the arcs only need to be dragged in the graphic design interface, the arranging action is not limited to generating new actions by exchanging any one or more through actions in a single sequence, and in a plurality of sequences, the action units between different sequences are exchanged based on the arranging way in a single sequence. Meanwhile, the parameter information and the waiting time information of each action in the sequence can be changed according to the requirements of technicians. And storing different equivalent directed models for multiple times to generate different arrangement information for subsequent use.
105. And applying the arrangement information to the tested target, and executing again to generate second test information.
The layout information is applied to the tested target and then executed again, and the layout information is used for leading the object logic diagram of the layout design into the tested target in a code or character mode and carrying out test categories different from the tested target; and generating second test information which is generated after the tested target executes the arrangement information. In one embodiment, the layout information generated by the visual graphical design software is re-imported into the integrated action machine, generating test files suffixed with ws and c.
106. And analyzing the second test information to evaluate the tested target.
And analyzing the second test information, comparing the regenerated test information with the first test information, comparing the coverage rate between the first test information and the second test information under the condition that the requirement criterion is a coverage rate criterion, obtaining the influence degree of different test scenes on the test effect, and judging the specific behavior information and the performance parameters of the tested target. In an embodiment, in the process of performing a performance test on the network control integrated action machine by using the LoadRunner, for different test scenarios, different action arrangements have an effect of making the operation of the action machine uneven, so that it is also described that a test on the same test target is necessary by using different test scenarios.
Through the steps, the problems that in the prior art, all test scenes are required to be generated when performance tests are carried out on a networked system or a whole enterprise, and manual intervention and manual modification are required when codes are generated in a disordered manner can be solved, the object-oriented visual test scenes can be generated, the scene design aiming at user requirement criteria can be realized, and the whole process is simplified.
The above description is only exemplary of the present invention and should not be taken as limiting, and any modifications, equivalents, improvements and the like that are made within the spirit and the principle of the present invention should be included in the scope of the present invention.
Claims (1)
1. An intelligent test scene arranging method for a networked control CPS system is characterized by comprising the following steps:
step 1: selecting a tested target, testing the tested target by using test software, and generating first test information;
step 2: processing the first test information, wherein the processing comprises extracting the state information, classifying the state information and generating an initial test submodule;
and step 3: converting the initial test sub-module into an equivalent directed graph, checking logic between state information, and generating an equivalent directed model;
and 4, step 4: proposing a requirement criterion, arranging the equivalent directed model for a plurality of times to generate a plurality of test scenes and generating arrangement information corresponding to the arrangement scenes;
and 5: applying the arrangement information to the tested target, and executing again to generate second test information;
step 6: analyzing the second test information, and evaluating the tested target;
in step 1, the tested target is a networked system; the test software is commercial or open source test software which is in physical or network connection with a tested target and tests and analyzes the tested target, and when the test software finishes testing, a test file is automatically generated and recorded as first test information;
in the step 2, the concrete steps are as follows:
the first test information is imported into any commercial or open source visual graphic design software which can read the third party information and regenerate the information for processing, in the processing process, the state information comprises the state or the attribute of the tested target under the static or excited condition, and the expression mode of the state information is codes or characters; under the condition that the state information is code information, the step of extracting the state information comprises the steps of extracting action function codes, condition function codes and circulation function codes, and the step of classifying the state information comprises the steps of dividing the extracted code information into action information, condition information and circulation information and forming an information set, wherein the information set comprises an action set, a protocol set and a constraint set; deleting repeated information in the information set, and inducing similar information to generate an initial test submodule;
in step 3, the steps of converting the initial test sub-module into an equivalent directed graph, checking the logic between state information and generating an equivalent directed model are as follows:
abstracting an initial testing submodule into an execution node, abstracting a logical relation between the initial testing submodules into an arc connecting each node, connecting the execution nodes by adopting an arc containing a unidirectional arrow, associating scattered submodules on the basis of the logical relation between the modules, and converting the initial testing submodule into an equivalent directed model;
in the step 4, the concrete steps are as follows: a requirement criterion is provided for changing the generated equivalent directed model according to the user requirement so as to ensure that the designed equivalent directed model meets the required test requirement; arranging for a plurality of times to generate a plurality of test scenes for carrying out maximum permutation and combination on the initial test sub-modules, and designing an equivalent directed model which accords with logic between the modules on the basis of a requirement criterion; generating arrangement information corresponding to an arrangement scene, wherein the arrangement information is used for enabling each equivalent directed model to be applied and tested in an information form, and the commercial or open source visual graphic design software which can read the third-party information and regenerate the information is required to have a visual graphic operation function;
the step 5 comprises the following specific implementation steps: the layout information is applied to the tested target and then executed again, and the layout information is used for leading the object logic diagram of the layout design into the tested target in a code or character mode and carrying out test categories different from the tested target; generating second test information which is generated after the tested target executes the arrangement information;
the step 6 is implemented by the following steps: and analyzing the second test information, comparing the regenerated test information with the first test information, comparing the coverage rate conditions of the first test information and the second test information under the condition that the requirement criterion is a coverage rate criterion, obtaining the influence degree of different test scenes on the test effect, and judging the specific behavior information and the performance parameters of the tested target.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910236986.5A CN110333998B (en) | 2019-03-27 | 2019-03-27 | Intelligent test scene arrangement method for networked control CPS system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910236986.5A CN110333998B (en) | 2019-03-27 | 2019-03-27 | Intelligent test scene arrangement method for networked control CPS system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110333998A CN110333998A (en) | 2019-10-15 |
| CN110333998B true CN110333998B (en) | 2020-12-22 |
Family
ID=68139038
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910236986.5A Expired - Fee Related CN110333998B (en) | 2019-03-27 | 2019-03-27 | Intelligent test scene arrangement method for networked control CPS system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110333998B (en) |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10877874B2 (en) * | 2007-12-28 | 2020-12-29 | Federal Home Loan Mortgage Corporation (Freddie Mac) | Systems and methods for modeling and generating test requirements for software applications |
| CN103530228B (en) * | 2013-09-27 | 2016-09-28 | 西安电子科技大学 | A kind of method for testing software based on model |
| CN106814730B (en) * | 2016-12-14 | 2019-01-01 | 中国铁路总公司 | Train operation control system security critical software method for generating test case |
-
2019
- 2019-03-27 CN CN201910236986.5A patent/CN110333998B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN110333998A (en) | 2019-10-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107273286B (en) | Scene automatic test platform and method for task application | |
| CN109118353B (en) | Data processing method and device of wind control model | |
| CN103646104A (en) | Hard real-time fault diagnosis method and system | |
| CN111010316A (en) | Flow playback method, device and system | |
| CN113572726B (en) | Multimode network control-data plane consistency verification method and device | |
| CN111666217B (en) | Method and apparatus for testing code | |
| US6718521B1 (en) | Method and system for measuring and reporting test coverage of logic designs | |
| CN109284227A (en) | A kind of automation method for testing pressure and device calculate equipment and storage medium | |
| CN106776336A (en) | Test script generation method and device, method for testing software and device | |
| CN107577709B (en) | Graphical management method of information system resource model | |
| CN114003451B (en) | Interface testing method, device, system and medium | |
| Ding et al. | Numerically representing stochastic process algebra models | |
| CN113726613B (en) | Fabric block chain-oriented performance test method | |
| US20200076707A1 (en) | Autonomic or AI-assisted validation, decision making, troubleshooting and/or performance enhancement within a telecommunications network | |
| US6516306B1 (en) | Model checking of message flow diagrams | |
| JPWO2019189249A1 (en) | Learning devices, learning methods, and programs | |
| Kuroiwa et al. | Testing environment for CPS by cooperating model checking with execution testing | |
| CN110333998B (en) | Intelligent test scene arrangement method for networked control CPS system | |
| Li et al. | Automated functional scenarios-based formal specification animation | |
| CN112947907A (en) | Method for creating code branch | |
| CN114253920A (en) | Transaction reordering method, device, equipment and readable storage medium | |
| JP2021515942A (en) | Security assessment system | |
| Lee et al. | Simulation speedup for DEVS models by composition-based compilation | |
| Encinas et al. | On the Calibration, Verification and Validation of an Agent-Based Model of the HPC Input/Output System | |
| CN112540920A (en) | Test method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20201222 |