CN116166235B - P4Target logic verification method and system - Google Patents

P4Target logic verification method and system Download PDF

Info

Publication number
CN116166235B
CN116166235B CN202310458898.6A CN202310458898A CN116166235B CN 116166235 B CN116166235 B CN 116166235B CN 202310458898 A CN202310458898 A CN 202310458898A CN 116166235 B CN116166235 B CN 116166235B
Authority
CN
China
Prior art keywords
information
message
p4target
constraint
action
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310458898.6A
Other languages
Chinese (zh)
Other versions
CN116166235A (en
Inventor
张学利
张长述
何鱼
郭宸琛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Yunbao Intelligent Co ltd
Original Assignee
Shenzhen Yunbao Intelligent Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Yunbao Intelligent Co ltd filed Critical Shenzhen Yunbao Intelligent Co ltd
Priority to CN202310458898.6A priority Critical patent/CN116166235B/en
Publication of CN116166235A publication Critical patent/CN116166235A/en
Application granted granted Critical
Publication of CN116166235B publication Critical patent/CN116166235B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/31Programming languages or programming paradigms
    • G06F8/315Object-oriented languages
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44505Configuring for program initiating, e.g. using registry, configuration files

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Stored Programmes (AREA)

Abstract

The application relates to a P4Target logic verification method and a system, comprising the following steps: analyzing P4Target to be verified and application scene constraint information corresponding to the Target, wherein the application scene constraint information at least comprises network message feature constraint and corresponding message Action constraint; generating specific stream information and corresponding Action information according to application scene constraint information, generating table configuration information according to the specific stream information and the corresponding Action information, loading the table configuration information into a storage unit of a P4target, and generating message excitation according to the specific stream information; and respectively inputting the message excitation into a preset reference model and a P4Target, acquiring a reference message which is output after the reference model responds to the message excitation for processing and an actual measurement message which is output after the P4Target responds to the message excitation for processing, and determining a logic verification result of the P4Target according to a comparison result of the reference message and the actual measurement message. By the method and the device, verification of the P4Target logic can be efficiently completed.

Description

P4Target logic verification method and system
Technical Field
The application relates to the technical field of P4Target development, in particular to a P4Target logic verification method and system.
Background
P4 is a high-level language of a packet processor independent of protocol, and is known as ProgrammingProtocol-independentPacket Processors. P4Target logic generated based on P4 is widely applied to a plurality of programmable chips, wherein the P4Target refers to a hardware device capable of running a P4 program; the P4Target logic has the characteristic of flexible programming, and the programmable characteristic of the post-loading table entry makes the verification space of the P4Target logic become infinite.
In the prior art, a random verification method is adopted to verify the P4Target logic, and the verification has the defects that the simulation convergence time is uncontrollable and the simulation coverage is incomplete in the limited production development time, so that the verification of the P4Target logic cannot be completed efficiently.
Disclosure of Invention
The application aims to provide a P4Target logic verification method and system, which are used for solving the technical problem that the verification of the P4Target logic cannot be completed efficiently in the prior art.
The embodiment of the application provides a P4Target logic verification method, which comprises the following steps:
analyzing P4Target to be verified and application scene constraint information corresponding to the Target, wherein the application scene constraint information at least comprises network message feature constraint and corresponding message Action constraint;
generating specific stream information and corresponding Action information according to the application scene constraint information, generating table configuration information according to the specific stream information and the corresponding Action information, loading the table configuration information into a storage unit of the P4target, and generating message excitation according to the specific stream information;
and respectively inputting the message excitation into a preset reference model and the P4Target, acquiring a reference message which is output after the reference model responds to the message excitation for processing and an actual measurement message which is output after the P4Target responds to the message excitation for processing, and determining a logic verification result of the P4Target according to a comparison result of the reference message and the actual measurement message.
Optionally, the network message feature constraint includes message hierarchy information and message domain segment information; the Action constraint comprises an Action type and an Action value field.
Optionally, generating specific flow information and corresponding Action information according to the application scenario constraint, and generating the table configuration information according to the specific flow information and the corresponding Action information specifically includes:
generating a plurality of specific stream information randomly according to the scene constraint information, extracting stream characteristics of the stream information, obtaining message layer information and message domain segment information of the stream information according to the stream characteristics, and obtaining Match information according to the message layer information and the message domain segment information of a plurality of specific streams;
carrying out randomization according to the scene constraint to generate Action information;
generating table item configuration information according to the Match information and the Action information.
Optionally, the preset reference model is developed based on the application scenario constraint information.
Optionally, the determining the logic verification result of the P4Target according to the comparison result of the reference message and the actually measured message includes:
when the reference message is inconsistent with the actually measured message, determining that the P4Target logic verification is not passed;
and when the reference message is consistent with the actually measured message, determining that the P4Target logic verification passes.
The embodiment of the application also provides a P4Target logic verification system, which comprises:
the information processing unit is used for analyzing P4Target to be verified and application scene constraint information corresponding to the Target, wherein the application scene constraint information at least comprises network message feature constraint and corresponding message Action constraint;
the excitation generation unit is used for generating specific stream information and corresponding Action information according to the application scene constraint information, generating table item configuration information according to the specific stream information and the corresponding Action information, loading the table item configuration information into the storage unit of the P4target, and generating message excitation according to the specific stream information;
the verification judging unit is used for respectively inputting the message excitation into a preset reference model and the P4Target, obtaining a reference message which is output after the reference model responds to the message excitation for processing and an actual measurement message which is output after the P4Target responds to the message excitation for processing, and determining a logic verification result of the P4Target according to a comparison result of the reference message and the actual measurement message.
Optionally, the network message feature constraint includes message hierarchy information and message domain segment information; the Action constraint comprises an Action type and an Action value field.
Optionally, the excitation generating unit is specifically configured to:
generating a plurality of specific stream information randomly according to the scene constraint information, extracting stream characteristics of the stream information, obtaining message layer information and message domain segment information of the stream information according to the stream characteristics, and obtaining Match information according to the message layer information and the message domain segment information of a plurality of specific streams;
carrying out randomization according to the scene constraint to generate Action information;
and generating table entry configuration information according to the Match information and the Action information.
Optionally, the preset reference model is developed based on the application scenario constraint information.
Optionally, the verification determining unit is specifically configured to determine that the P4Target logic verification fails when the reference packet is inconsistent with the actually measured packet, and determine that the P4Target logic verification fails when the reference packet is consistent with the actually measured packet.
The embodiment of the application has the following beneficial effects:
in the embodiment of the application, the message excitation for verifying the P4Target logic is generated through scene constraint, the scene constraint is from the actual production operation scene of the P4Target, and the random message excitation is generated around the actual scene, so that the effectiveness is higher, the verification coverage efficiency is high, and the verification convergence time can be greatly reduced.
Additional features and advantages of embodiments of the application will be set forth in the description which follows.
Drawings
In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of a P4Target logic verification method in an embodiment of the present application.
Fig. 2 is a schematic diagram of entry configuration information in an embodiment of the present application.
Fig. 3 is a schematic diagram of a P4Target logic verification space in an embodiment of the application.
Fig. 4 is a schematic diagram of a P4Target logic verification convergence curve according to an embodiment of the application.
Fig. 5 is a schematic diagram of application scenario constraint information in an embodiment of the present application.
FIG. 6 is a flow chart of generating a message stimulus in an embodiment of the application.
Fig. 7 is a block diagram of a P4Target logic verification system according to an embodiment of the present application.
Detailed Description
The detailed description of the drawings is intended as an illustration of the presently preferred embodiment of the application and is not intended to represent the only form in which the present application may be practiced. It is to be understood that the same or equivalent functions may be accomplished by different embodiments that are intended to be encompassed within the spirit and scope of the application.
Referring to fig. 1, an embodiment of the present application proposes a P4Target logic verification method, which includes the following steps:
s1, analyzing P4Target to be verified and application scene constraint information corresponding to the Target, wherein the application scene constraint information at least comprises network message feature constraint and corresponding message Action constraint;
specifically, the P4Target includes a processor and a storage unit, where the storage unit stores P4Target logic executed by the processor; the P4Target refers to a hardware device capable of running a P4 program, such as a programmable chip, and in the development process of the P4Target, the P4 program needs to be written, and a Target compiler is used to generate a custom P4Target, which is a technical content well known to those skilled in the art, and is not described herein in detail; the method of the present embodiment is not limited to verification of the logic of a certain P4 Target;
s2, generating specific stream information and corresponding Action information according to the application scene constraint information, generating table configuration information according to the specific stream information and the corresponding Action information, loading the table configuration information into a storage unit of the P4target, and generating message excitation according to the specific stream information;
specifically, the table entry configuration information needs to be used by the P4Target in the operation process, as shown in fig. 2, where one part is Match information and the other part is Action information, where the Match information is used to Match the message hierarchy information and the message domain segment information, and if the matching is successful, the corresponding Action is executed, and the Action information records which Action the P4Target should execute, and correspondingly, the processor runs the P4Target logic in the storage unit to execute the corresponding Action.
And S3, respectively inputting the message excitation into a preset reference model and the P4Target, acquiring a reference message which is output after the reference model responds to the message excitation for processing and an actual measurement message which is output after the P4Target responds to the message excitation for processing, and determining a logic verification result of the P4Target according to a comparison result of the reference message and the actual measurement message.
Specifically, the reference model is a reference model developed for the P4Target and used for verifying whether the P4Target logic is correct, in short, for a correct P4Target, the same message is stimulated to be input into the P4Target and the reference model, and the outputs of the two are the same; the reference model also needs to receive and apply to the table item configuration information, and the reference model can be developed in advance and used for verifying the P4Target logic of the same type;
it should be noted that, in the embodiment of the present application, the message excitation for verifying the P4Target logic is generated through a scene constraint, the scene constraint is from the P4Target real productive operation scene, and the random message excitation is generated around the real scene, so that the effectiveness is higher, the verification coverage efficiency is high, and the verification convergence time can be greatly reduced; the effect of the method of this embodiment can refer to fig. 3 and fig. 4, as shown in fig. 3, the conventional verification of the P4Target logic is used for verifying that the message excitation of the P4Target logic is not constrained, so that many invalid message excitation can be generated, the P4Target and the reference model cannot process the invalid message excitation, so that the verification time is increased, the random verification space is larger, the verification space realized based on the scheme of this embodiment does not generate excessive invalid message excitation due to the application scene constraint of the P4Target, the validity of the message excitation is higher, the verification time is reduced, and the random verification space is smaller.
In addition, the embodiment of the application has high automation efficiency in verifying the environment development, and the environment development efficiency is high because the message excitation, the configuration list item data and the reference model of the environment are all automatically generated. As shown in fig. 4, the time from 0 for the convergence curve for the P4Target logic verification using the embodiment of the present application is earlier than the convergence curve time point of the conventional scheme.
In some embodiments, in order to improve the development and verification efficiency, an end-to-end model may be set, where the end-to-end model includes the reference model and a comparison model for determining whether the P4Target logic verification passes according to a comparison result of the reference message and the actually measured message, that is, the input of the end-to-end model includes a message excitation and the actually measured message output by the P4Target, and the output is the comparison result.
In some embodiments, the network message feature constraints include message hierarchy information and message domain segment information; the Action constraint comprises an Action type and an Action value field.
Specifically, as shown in fig. 5, the message layer information and the message field section information are for example, the message layer information is for example, a plurality of layers of tunnels, each layer of tunnels has a plurality of layers of message heads, etc., the message field section information is for example, the type of each layer of message heads, the value of the field section in each message head, etc.; the Action type action_code comprises Encap, decap, modify and the like; the message field information action_data refers to field value Encapfield/Decap field/modification field which needs Encap/Decap/modification under the corresponding Action type.
In some embodiments, the generating specific flow information and corresponding Action information according to the application scenario constraint, and generating the table entry configuration information according to the specific flow information and the corresponding Action information specifically includes:
generating a plurality of specific stream information randomly according to the scene constraint information, extracting stream characteristics of the stream information, obtaining message layer information and message domain segment information of the stream information according to the stream characteristics, and obtaining Match information according to the message layer information and the message domain segment information of a plurality of specific streams;
carrying out randomization according to the scene constraint to generate Action information;
and generating table entry configuration information according to the Match information and the Action information.
In some embodiments, the preset reference model is developed based on the application scenario constraint information, so that the reference model can output a correct reference message for comparing whether the actual measurement message is correct, and P4Target logic verification is realized.
In some embodiments, the generating the message excitation based on the application scenario constraint information includes:
the message excitation is randomly generated based on the network message characteristic constraint, and the network message characteristic constraint is from a P4Target real productization operation scene, so that the random message excitation is generated around the real scene, the random message excitation has higher effectiveness, and the complete coverage verification with the actual maximum probability use scene is realized.
In some embodiments, as shown in fig. 6, the generating the message stimulus based on the network message feature constraint includes:
inputting the message layer information and the message domain segment information into a preset message Generator packet_generator, and randomly generating message excitation and outputting by the message Generator according to the message layer information and the message domain segment information.
In some embodiments, the verifying the P4Target logic based on the preset reference model, the table entry configuration information, and the application scenario constraint information includes:
when the reference message is inconsistent with the actually measured message, determining that the P4Target logic verification is not passed;
and when the reference message is consistent with the actually measured message, determining that the P4Target logic verification passes.
Specifically, when verifying P4Target logic, different message incentives (e.g., packet1, packet2, packet3, packet4, packet5 shown in fig. 6) need to be generated to verify the P4Target logic, the convergence of chip verification is measured by a specific index, and the coverage of verification is generally evaluated by analyzing coverage rate.
Referring to fig. 7, an embodiment of the present application provides a P4Target logic verification system, which may be used to implement the P4Target logic verification method described in the foregoing embodiment, where the system of the present embodiment includes:
the information processing unit is used for analyzing P4Target to be verified and application scene constraint information corresponding to the Target, wherein the application scene constraint information at least comprises network message feature constraint and corresponding message Action constraint;
the excitation generation unit is used for generating specific stream information and corresponding Action information according to the application scene constraint information, generating table item configuration information according to the specific stream information and the corresponding Action information, loading the table item configuration information into the storage unit of the P4target, and generating message excitation according to the specific stream information;
the verification judging unit is used for respectively inputting the message excitation into a preset reference model and the P4Target, obtaining a reference message which is output after the reference model responds to the message excitation for processing and an actual measurement message which is output after the P4Target responds to the message excitation for processing, and determining a logic verification result of the P4Target according to a comparison result of the reference message and the actual measurement message.
Optionally, the network message feature constraint includes message hierarchy information and message domain segment information; the Action constraint comprises an Action type and an Action value field.
Optionally, the excitation generating unit is specifically configured to:
generating a plurality of specific stream information randomly according to the scene constraint information, extracting stream characteristics of the stream information, obtaining message layer information and message domain segment information of the stream information according to the stream characteristics, and obtaining Match information according to the message layer information and the message domain segment information of a plurality of specific streams;
carrying out randomization according to the scene constraint to generate Action information;
and generating table entry configuration information according to the Match information and the Action information.
Optionally, the preset reference model is developed based on the application scenario constraint information.
Optionally, the verification determining unit is specifically configured to determine that the P4Target logic verification fails when the reference packet is inconsistent with the actually measured packet, and determine that the P4Target logic verification fails when the reference packet is consistent with the actually measured packet.
It should be noted that, the system of the present embodiment corresponds to the method of the foregoing embodiment, and therefore, a portion of the system of the present embodiment that is not described in detail may be obtained by referring to the specific content of the method of the foregoing embodiment, and thus, a detailed description is omitted herein.
The foregoing description of embodiments of the application has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the various embodiments described. The terminology used herein was chosen in order to best explain the principles of the embodiments, the practical application, or the technical improvements in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims (10)

1. A P4Target logic verification method, comprising:
analyzing application scene constraint information corresponding to a P4Target to be verified, wherein the application scene constraint information at least comprises network message feature constraint and corresponding message Action constraint;
generating specific stream information and corresponding Action information according to the application scene constraint information, generating table configuration information according to the specific stream information and the corresponding Action information, loading the table configuration information into a storage unit of the P4target, and generating message excitation according to the specific stream information;
and respectively inputting the message excitation into a preset reference model and the P4Target, acquiring a reference message which is output after the reference model responds to the message excitation for processing and an actual measurement message which is output after the P4Target responds to the message excitation for processing, and determining a logic verification result of the P4Target according to a comparison result of the reference message and the actual measurement message.
2. The P4Target logic verification method according to claim 1, wherein the network message feature constraint comprises message hierarchy information and message domain segment information; the Action constraint comprises an Action type and an Action value field.
3. The P4Target logic verification method according to claim 2, wherein generating specific flow information and corresponding Action information according to the application scenario constraint, and generating entry configuration information according to the specific flow information and the corresponding Action information specifically comprises:
generating a plurality of specific stream information randomly according to the scene constraint information, extracting stream characteristics of the stream information, obtaining message layer information and message domain segment information of the stream information according to the stream characteristics, and obtaining Match information according to the message layer information and the message domain segment information of a plurality of specific streams;
carrying out randomization according to the scene constraint to generate Action information;
generating table item configuration information according to the Match information and the Action information.
4. The P4Target logic verification method according to claim 3, wherein the preset reference model is developed based on the application scenario constraint information.
5. The method for P4Target logic verification according to claim 1, wherein determining the P4Target logic verification result according to the comparison result of the reference message and the actually measured message comprises:
when the reference message is inconsistent with the actually measured message, determining that the P4Target logic verification is not passed;
and when the reference message is consistent with the actually measured message, determining that the P4Target logic verification passes.
6. A P4Target logic verification system, comprising:
the information processing unit is used for analyzing P4Target to be verified and application scene constraint information corresponding to the Target, wherein the application scene constraint information at least comprises network message feature constraint and corresponding message Action constraint;
the excitation generation unit is used for generating specific stream information and corresponding Action information according to the application scene constraint information, generating table item configuration information according to the specific stream information and the corresponding Action information, loading the table item configuration information into the storage unit of the P4target, and generating message excitation according to the specific stream information;
the verification judging unit is used for respectively inputting the message excitation into a preset reference model and the P4Target, obtaining a reference message which is output after the reference model responds to the message excitation for processing and an actual measurement message which is output after the P4Target responds to the message excitation for processing, and determining a logic verification result of the P4Target according to a comparison result of the reference message and the actual measurement message.
7. The P4Target logic verification system according to claim 6, wherein said network message feature constraints include message hierarchy information and message domain segment information; the Action constraint comprises an Action type and an Action value field.
8. The P4Target logic verification system according to claim 7, wherein said stimulus generation unit is specifically configured to:
generating a plurality of specific stream information randomly according to the scene constraint information, extracting stream characteristics of the stream information, obtaining message layer information and message domain segment information of the stream information according to the stream characteristics, and obtaining Match information according to the message layer information and the message domain segment information of a plurality of specific streams;
carrying out randomization according to the scene constraint to generate Action information;
generating table item configuration information according to the Match information and the Action information.
9. The P4Target logic verification system according to claim 6, wherein the preset reference model is developed based on the application scenario constraint information.
10. The P4Target logic verification system according to claim 6, wherein the verification determining unit is specifically configured to determine that the P4Target logic verification fails when the reference message is inconsistent with the actually measured message, and determine that the P4Target logic verification passes when the reference message is consistent with the actually measured message.
CN202310458898.6A 2023-04-26 2023-04-26 P4Target logic verification method and system Active CN116166235B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310458898.6A CN116166235B (en) 2023-04-26 2023-04-26 P4Target logic verification method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310458898.6A CN116166235B (en) 2023-04-26 2023-04-26 P4Target logic verification method and system

Publications (2)

Publication Number Publication Date
CN116166235A CN116166235A (en) 2023-05-26
CN116166235B true CN116166235B (en) 2023-08-22

Family

ID=86416798

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310458898.6A Active CN116166235B (en) 2023-04-26 2023-04-26 P4Target logic verification method and system

Country Status (1)

Country Link
CN (1) CN116166235B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104322023A (en) * 2013-05-24 2015-01-28 华为技术有限公司 Stream forwarding method, device and system
CN107704384A (en) * 2017-09-14 2018-02-16 郑州云海信息技术有限公司 A kind of convergent method and system of speed-up chip functional verification
CN109992462A (en) * 2017-12-29 2019-07-09 北京中科寒武纪科技有限公司 Verify excitation producing method, device, chip verification method and system
CN113312879A (en) * 2021-07-28 2021-08-27 北京燧原智能科技有限公司 Chip circuit function verification system, method, device and storage medium
CN114091383A (en) * 2021-11-23 2022-02-25 海光信息技术股份有限公司 Test sequence generation method, device and system and related equipment
CN114422385A (en) * 2022-03-28 2022-04-29 阿里云计算有限公司 Method and system for generating network system test case
CN115499312A (en) * 2022-11-11 2022-12-20 之江实验室 Integration configuration method based on FPGA (field programmable Gate array) back-end P4 multi-mode intelligent network card

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113868987A (en) * 2020-06-30 2021-12-31 澜至电子科技(成都)有限公司 System-level chip verification platform and verification method thereof

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104322023A (en) * 2013-05-24 2015-01-28 华为技术有限公司 Stream forwarding method, device and system
CN107704384A (en) * 2017-09-14 2018-02-16 郑州云海信息技术有限公司 A kind of convergent method and system of speed-up chip functional verification
CN109992462A (en) * 2017-12-29 2019-07-09 北京中科寒武纪科技有限公司 Verify excitation producing method, device, chip verification method and system
CN113312879A (en) * 2021-07-28 2021-08-27 北京燧原智能科技有限公司 Chip circuit function verification system, method, device and storage medium
CN114091383A (en) * 2021-11-23 2022-02-25 海光信息技术股份有限公司 Test sequence generation method, device and system and related equipment
CN114422385A (en) * 2022-03-28 2022-04-29 阿里云计算有限公司 Method and system for generating network system test case
CN115499312A (en) * 2022-11-11 2022-12-20 之江实验室 Integration configuration method based on FPGA (field programmable Gate array) back-end P4 multi-mode intelligent network card

Also Published As

Publication number Publication date
CN116166235A (en) 2023-05-26

Similar Documents

Publication Publication Date Title
CN111414172B (en) Automatic deployment and release system and method for application software
Le Goues et al. Genprog: A generic method for automatic software repair
Qi et al. The strength of random search on automated program repair
CN111327490B (en) Byzantine fault-tolerant detection method of block chain and related device
CN110688313B (en) Fault injection method for software testing under VxWorks operating system
CN106708687A (en) Executable file-based chip verification method and apparatus
CN112579437B (en) Method for verifying conformity in program running process
CN105637516A (en) Method for verifying integrity of dynamic code using hash
CN110704314B (en) Fault injection method for embedded software test
CN108846292B (en) Desensitization rule generation method and device
CN105117340A (en) URL (Uniform Resource Locator) detection method and device used for quality evaluation of iOS browser application
CN114328217A (en) Application testing method, device, equipment, medium and computer program product
CN107844410A (en) The adjustment method and device of a kind of distributed cluster system
CN116166235B (en) P4Target logic verification method and system
CN110727575B (en) Information processing method, system, device and storage medium
CN111221721A (en) Automatic recording and executing method and device for unit test cases
US20170220449A1 (en) Infrastructure rule generation
CN107145342A (en) The treating method and apparatus of the channel information of application
CN114004206A (en) Form generation method and device, computer equipment and storage medium
CN113868116A (en) Test dependent data generation method and device, server and storage medium
CN112015648A (en) Test method, device, computer equipment and medium based on automation script
CN112433947A (en) Chaos engineering method and system based on network data
CN114745216B (en) Dynamic access method and device
Yokogawa et al. Consistency verification of UML diagrams based on process bisimulation
CN117076333B (en) Vulnerability verification method based on script breakpoint and browser automation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant