CN117436380A

CN117436380A - Regression verification method and device

Info

Publication number: CN117436380A
Application number: CN202311766450.7A
Authority: CN
Inventors: 汤雅权
Original assignee: Xinyaohui Technology Co ltd
Current assignee: Xinyaohui Technology Co ltd
Priority date: 2023-12-21
Filing date: 2023-12-21
Publication date: 2024-01-23
Anticipated expiration: 2043-12-21
Also published as: CN117436380B

Abstract

The application provides a regression verification method and device, comprising the following steps: acquiring a verification schedule of the mixed signal circuit; acquiring a verification case library corresponding to a verification schedule; extracting a simulation verification case set and a digital verification case set from a verification case library; determining a use case execution path of the verification use case according to the use case dependency relationship; according to the use case execution path, carrying out regression verification on the mixed signal circuit according to the verification use cases in the analog verification use case set or the digital verification use case set in sequence; under the condition that regression verification is finished, the verification coverage rate of the mixed signal circuit is counted; and if the verification coverage rate meets the preset condition, determining that the mixed signal circuit passes regression verification. The effects that can be achieved include: the real-time performance of the verification coverage rate counted according to the verification result is improved, the regression verification efficiency of the mixed signal circuit is improved, execution deviation of a verification plan or transmission verification errors are avoided, and verification defects and verification risks in regression verification are reduced.

Description

Regression verification method and device

Technical Field

The present disclosure relates to the field of testing technologies, and in particular, to a regression verification method and apparatus.

Background

The mixed signal circuit includes an analog signal processing circuit (analog circuit) and a digital signal processing circuit (digital circuit). In the process of designing the mixed signal circuit, the problems of noise and interference resistance in the analog signal processing circuit, time sequence and logic operation in the digital signal processing circuit and the like are simultaneously considered so as to ensure the stability and reliability of the operation of the mixed signal circuit. If the mixed signal circuit has more functions, the mixed signal circuit can be split into a plurality of circuit modules, and the circuit modules can be analog circuit modules and also can be digital circuit modules.

In the process of verifying the mixed signal circuit, firstly, a certain number of excitation tests are conducted on a single circuit module, and if a plurality of circuit modules pass the excitation test verification, regression verification is conducted on the signal interaction process among different circuit modules so as to prevent the whole mixed signal circuit from being mistakenly caused by modification or introduction of a new circuit module.

In the related art, the regression verification process may include: a detailed verification plan (including defining verification details) is first formulated for each circuit module in the mixed signal circuit, and a verification case library is configured. Then, selecting the verification case from the verification case library, constructing a work task corresponding to the verification case, and running the work task to carry out regression verification on each circuit module. And after the regression verification is started, the verification coverage rate of the mixed signal circuit is counted according to a preset period. And finally, if the verification coverage rate does not meet the preset condition, continuously adjusting the regression verification process according to the verification result of the single circuit module until the verification coverage rate meets the preset condition.

In the regression verification process, the verification case library includes at least one verification case. The interaction condition between the single circuit module and other circuit modules can be verified through the verification use case. The respective verification plans of the circuit modules are executed hierarchically according to the cascade relationship of the plurality of circuit modules. In the process of executing verification, the verification result and the statistical verification coverage are collected.

In this way, in the regression verification process, each circuit module is used as a scattered execution subject, so that the collected verification result is fragmented and not concentrated data, and the verification coverage rate counted according to the verification result is not real-time, and further, the execution deviation of the verification plan or the verification error occurs.

Disclosure of Invention

One embodiment of the present application provides a regression verification method, including: acquiring a verification schedule of a mixed signal circuit, wherein the mixed signal circuit comprises an analog circuit module and a digital circuit module; acquiring a verification case library corresponding to the verification schedule, wherein the verification case library is used for storing verification cases, and the verification cases are used for verifying the mixed signal circuit; extracting an analog verification case set and a digital verification case set from the verification case library, wherein the analog verification case set is used for adapting to an analog verification environment corresponding to the analog circuit module, and the digital verification case set is used for adapting to a digital verification environment corresponding to the digital circuit module; determining a use case execution path of the verification use case according to the use case dependency relationship, wherein the use case execution path is used for indicating the execution sequence of the verification use case in the verification use case library; according to the use case execution path, carrying out regression verification on the mixed signal circuit according to the simulation verification use case set or the verification use cases in the digital verification use case set in sequence; under the condition that the regression verification is finished, the verification coverage rate of the mixed signal circuit is counted; and if the verification coverage rate meets the preset condition, determining that the mixed signal circuit passes regression verification.

In some embodiments, the determining the use case execution path of the verification use case according to the use case dependency relationship includes: dividing the verification cases into at least one level of verification cases according to the case dependency relationship, wherein input data of a later level of verification cases in the at least one level of verification cases comprises case verification results of a previous level of verification cases; and determining an application execution path corresponding to the verification application according to the order of the application levels in the verification applications of the at least one level.

In some embodiments, the counting the verification coverage of the mixed signal circuit includes: and counting the verification coverage rate of the mixed signal circuit according to the verified ratio of the verification schedule and the verified ratio of the verification cases in the verification case library.

In some embodiments, the regression verification method further comprises: updating the verification schedule.

In some embodiments, the regression verification method further comprises: if the verification coverage rate does not meet the preset condition, updating the verification case according to the verification result of the regression verification; updating the analog verification case set and the digital verification case set according to the updated verification case; and carrying out regression verification on the mixed signal circuit according to the updated analog verification case set or the updated verification cases in the digital verification case set in sequence according to the case execution path.

In some embodiments, the verification result of the end of the regression verification includes a failure of the regression verification or a success of the regression verification, and the updating the verification case according to the verification result of the end of the regression verification includes: if the verification result of the regression verification is that the regression verification is successful, updating the verification cases in the verification case library according to the verification schedule and the mixed signal circuit; if the verification result after the regression verification is the regression verification failure, judging whether the verification case corresponding to the regression verification failure has errors or not; if the verification case corresponding to the regression verification failure has errors, modifying the verification case corresponding to the regression verification failure, and updating the verification case in the verification case library so that the updated verification case can carry out regression verification on the mixed signal circuit; and if the verification case corresponding to the regression verification failure does not have errors, modifying and updating the mixed signal circuit, and updating the verification case in the verification case library according to the verification schedule and the updated mixed signal circuit.

In some embodiments, the performing regression verification on the mixed signal circuit according to the use case execution path sequentially according to the updated analog verification use case set or the updated verification use case in the digital verification use case set includes: when the use case dependency relationship of the updated verification use case is unchanged and the verification result of the end of the regression verification is that the regression verification is successful, carrying out the regression verification on the mixed signal circuit according to the use case execution path and the updated simulation verification use case set or the updated verification use case in the digital verification use case set in sequence;

and when the use case dependency relationship of the updated verification use case is unchanged and the verification result of the end of the regression verification is that the regression verification fails, continuing to perform the regression verification on the mixed signal circuit according to the updated simulation verification use case set or the updated verification use case in the digital verification use case set sequentially from the modified verification use case corresponding to the regression verification failure according to the use case execution path.

In some embodiments, the performing regression verification on the mixed signal circuit according to the use case execution path sequentially according to the updated analog verification use case set or the updated verification use case in the digital verification use case set includes: when the updated use case dependency relationship of the verification use case is changed, re-determining the use case execution path of the verification use case according to the changed use case dependency relationship; and carrying out regression verification on the mixed signal circuit according to the redetermined use case execution path and the updated analog verification use case set or the updated verification use cases in the digital verification use case set in sequence.

In some embodiments, the preset conditions include at least one of: the coverage of the functions in the verification schedule is up to 100%, and the coverage of the codes in the verification case library is up to 100%.

One of the embodiments of the present application provides a regression verification system, comprising: the device comprises a first acquisition module, a second acquisition module, an extraction module, a first determination module, a verification module, a statistics module and a second determination module; the first acquisition module is used for acquiring a verification schedule of a mixed signal circuit, and the mixed signal circuit comprises an analog circuit module and a digital circuit module; the second acquisition module is used for acquiring a verification case library corresponding to the verification schedule, wherein the verification case library is used for storing verification cases, and the verification cases are used for verifying the mixed signal circuit; the extraction module is used for extracting an analog verification case set and a digital verification case set from the verification case library, wherein the analog verification case set is used for adapting to an analog verification environment corresponding to the analog circuit module, and the digital verification case set is used for adapting to a digital verification environment corresponding to the digital circuit module; the first determining module is used for determining a use case execution path of the verification use case according to the use case dependency relationship, wherein the use case execution path is used for indicating the execution sequence of the verification use case in the verification use case library; the verification module is used for carrying out regression verification on the mixed signal circuit according to the use case execution path and the simulation verification use case set or the verification use cases in the digital verification use case set in sequence; the statistics module is used for counting the verification coverage rate of the mixed signal circuit under the condition that the regression verification is finished; and the second determining module is used for determining that the mixed signal circuit passes regression verification if the verification coverage rate meets a preset condition.

In some embodiments, the first determining module is configured to: dividing the verification cases into at least one level of verification cases according to the case dependency relationship, wherein input data of a later level of verification cases in the at least one level of verification cases comprises case verification results of a previous level of verification cases; and determining an application execution path corresponding to the verification application according to the order of the application levels in the verification applications of the at least one level.

In some embodiments, the statistics module is to: and counting the verification coverage rate of the mixed signal circuit according to the verified ratio of the verification schedule and the verified ratio of the verification cases in the verification case library.

In some embodiments, the regression verification device further comprises: a second update module; the second updating module is used for updating the verification schedule.

In some embodiments, the regression verification device further comprises: a first update module and a second update module; the first updating module is used for updating the verification case according to the verification result of the regression verification ending if the verification coverage rate does not meet the preset condition; the second updating module is used for updating the analog verification case set and the digital verification case set according to the updated verification case; the verification module is further configured to perform regression verification on the mixed signal circuit according to the use case execution path sequentially according to the updated analog verification use case set or the updated verification use case in the digital verification use case set.

In some embodiments, the verification result of the end of the regression verification includes a failure or a success of the regression verification, and the first updating module is configured to update the verification use cases in the verification use case library according to the verification schedule and the mixed signal circuit if the verification result of the end of the regression verification is the success of the regression verification; if the verification result after the regression verification is the regression verification failure, judging whether the verification case corresponding to the regression verification failure has errors or not; if the verification case corresponding to the regression verification failure has errors, modifying the verification case corresponding to the regression verification failure, and updating the verification case in the verification case library so that the updated verification case can carry out regression verification on the mixed signal circuit; and if the verification case corresponding to the regression verification failure does not have errors, modifying and updating the mixed signal circuit, and updating the verification case in the verification case library according to the verification schedule and the updated mixed signal circuit.

In some embodiments, the verification module is further to: when the use case dependency relationship of the updated verification use case is unchanged and the verification result of the end of the regression verification is that the regression verification is successful, carrying out the regression verification on the mixed signal circuit according to the use case execution path and the updated simulation verification use case set or the updated verification use case in the digital verification use case set in sequence;

In some embodiments, the verification module is further to: when the updated use case dependency relationship of the verification use case is changed, re-determining the use case execution path of the verification use case according to the changed use case dependency relationship; and carrying out regression verification on the mixed signal circuit according to the redetermined use case execution path and the updated analog verification use case set or the updated verification use cases in the digital verification use case set in sequence.

According to the regression verification method and device, aiming at the analog circuit module and the digital circuit module which are included in the mixed signal circuit, all verification cases of all circuit modules are integrated by acquiring the verification case library corresponding to the verification plan, so that unified regression verification is conducted on the mixed signal circuit. And carrying out regression verification on the analog circuit module according to the analog verification case set, carrying out regression verification on the digital circuit module according to the digital verification case set, and obtaining a concentrated regression verification result so as to improve the real-time performance of verification coverage rate counted according to the verification result. The regression verification is carried out according to the use case execution path, so that each verification use case can be ensured to have corresponding input data, the condition that verification cannot be carried out due to lack of input data related to the use case dependency relationship is avoided, and the regression verification efficiency of the mixed signal circuit is improved. And carrying out regression verification according to the use case execution path, and also carrying out visual and controllable monitoring on the regression verification process, so as to avoid execution deviation of a verification plan or sending verification errors. The regression verification is performed according to the use case execution path, and all verification use cases can be ensured to be executed, namely, all verification plans in the verification schedule are ensured to be subjected to the regression verification, so that verification defects and verification risks in the regression verification can be reduced.

Drawings

The following figures describe in detail exemplary embodiments disclosed in the present application. Wherein like reference numerals refer to like structure throughout the several views of the drawings. Those of ordinary skill in the art will understand that these embodiments are non-limiting, exemplary embodiments, and that the drawings are for illustration and description purposes only and are not intended to limit the scope of the present application, other embodiments may equally well accomplish the intent of the invention in this application. It should be understood that the drawings are not to scale. Wherein:

FIG. 1 is a flow chart of a first regression verification method according to some embodiments of the present application;

FIG. 2 is a flow chart of a second regression verification method according to some embodiments of the present application;

FIG. 3 is a flow chart of a third regression verification method shown in accordance with some embodiments of the present application;

fig. 4 is a block diagram of a regression verification device shown according to some embodiments of the present application.

Detailed Description

The following description provides specific applications and requirements to enable any person skilled in the art to make and use the teachings of the present application. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the application. Thus, the present application is not limited to the embodiments shown, but is to be accorded the widest scope consistent with the claims.

The mixed signal circuit is a circuit design comprising an analog signal circuit and a digital signal circuit, and has the advantages of high integration level, small area, low power consumption and the like. The mixed signal circuit has wide application in the fields of communication, consumer electronics, automobiles, industrial automation and the like.

The design flow of the mixed signal circuit mainly comprises: design planning, system level design, hardware circuit design, circuit design verification, layout level design and flow sheet. The circuit design verification refers to verifying whether the requirements are met, whether risks have been released and whether all defects are found and corrected before the mixed signal circuit is produced by adopting corresponding verification language, verification tool and verification method. The circuit design verification can be realized by simulating the mixed signal circuit through a hardware description language and then running a verification use case in a simulation verification environment.

The circuit scale of the mixed signal circuit may be large, and may be divided into a plurality of circuit modules according to functions and signal types, and the circuit modules may be analog circuit modules or digital circuit modules. In verifying a mixed signal circuit, first, a certain number of stimulus tests are performed for a single circuit module, and during the stimulus test, it is often necessary to modify the circuit module, that is, modify a design code corresponding to the circuit module, so that the circuit module can pass the stimulus test. If the plurality of circuit modules pass the stimulus test verification, the test case in the stimulus test may be determined as the verification case in the regression verification. The regression verification process is a process of signal interaction among different circuit modules, and retests are carried out according to the existing test cases so as to prevent the whole mixed signal circuit from generating errors due to modification of a single circuit module or introduction of a new circuit module.

In the related technology, the verification team of each circuit module always verifies the interaction between the circuit module and other circuit modules continuously according to the verification environment of the circuit module, the respective verification plans are executed in a grading manner, the execution condition of the verification plans is tracked in a manual statistics mode, and finally verification record and statistical verification coverage rate are collected in a unified mode. That is, each circuit module is used as a decentralized execution main body to carry out regression verification on the mixed signal circuit. Therefore, the collected verification result is fragmented and not concentrated data, so that statistics according to the verification result are not real-time, and further execution deviation of a verification plan or verification errors occur.

In order to solve the above technical problems, an embodiment of the present application provides a regression verification method, including: aiming at an analog circuit module and a digital circuit module which are included in the mixed signal circuit, all verification cases of all circuit modules are integrated by acquiring a verification case library corresponding to a verification plan, so that unified regression verification is conducted on the mixed signal circuit. And carrying out regression verification on the analog circuit module according to the analog verification case set, carrying out regression verification on the digital circuit module according to the digital verification case set, and obtaining a concentrated regression verification result so as to improve the real-time performance of verification coverage rate counted according to the verification result. The regression verification is carried out according to the use case execution path, so that each verification use case can be ensured to have corresponding input data, the condition that verification cannot be carried out due to lack of input data related to the use case dependency relationship is avoided, and the regression verification efficiency of the mixed signal circuit is improved. And carrying out regression verification according to the use case execution path, and also carrying out visual and controllable monitoring on the regression verification process, so as to avoid execution deviation of a verification plan or sending verification errors. The regression verification is performed according to the use case execution path, and all verification use cases can be ensured to be executed, namely, all verification plans in the verification schedule are ensured to be subjected to the regression verification, so that verification defects and verification risks in the regression verification can be reduced.

The technical scheme of the invention is described in detail below with reference to the examples and the accompanying drawings.

FIG. 1 is a flow chart of a regression verification method shown according to some embodiments of the present application. The regression verification method shown in fig. 1 may be implemented by the regression verification apparatus 400 shown in fig. 4.

As shown in fig. 1, the regression verification method 100 provided in the embodiment of the present application may include the following steps:

step S110, a verification schedule of the mixed signal circuit is obtained. Specifically, step S110 may be performed by the first acquisition module 410 in the regression verification apparatus 400 illustrated in fig. 4.

The mixed signal circuit comprises an analog circuit module and a digital circuit module. And the analog circuit module is used for realizing the functions of signal acquisition, amplification, filtering, modulation and the like. The digital circuit module is used for realizing the functions of data acquisition, digital signal processing, data transmission, controller adjustment and the like.

In the embodiment of the application, the verification schedule can be embodied by descriptive language, such as function description, limit description, requirement description and the like.

In the embodiment of the application, the plan basis of the verification schedule may be the product requirement of the mixed signal circuit, the overall function of the mixed signal circuit, the module function of the circuit module in the mixed signal circuit, and the like.

In an embodiment of the present application, after acquiring the verification schedule, before determining that the mixed signal circuit passes the regression verification, the regression verification method 100 provided in the embodiment of the present application may include: the verification schedule is updated.

Due to the reasons of changing product requirements, increasing product functions, finding out incomplete verification functions and the like, the plan verification table can be updated at any time, so that verification of a mixed signal circuit is facilitated to be perfected, and reliability of a verification result of regression verification is improved.

In an embodiment of the present application, the verification schedule may include at least one verification sub-plan, each verification sub-plan including at least one verification target, each verification target being verifiable by at least one verification use case. For example, the verification schedule includes 3 verification sub-schedules (analog signal acquisition reliability, analog-to-digital conversion reliability, and digital signal reliability). The verification target of the analog signal acquisition reliability comprises an analog signal boundary value and an analog signal noise reduction effect, the verification target of the analog-to-digital conversion reliability comprises a step of judging whether conversion deviation exists or not and whether fault tolerance is possible or not, and the verification target of the digital signal reliability comprises a data signal boundary value and a digital signal verification effect. The verification target for the analog signal boundary value can be verified through 3 verification cases, and the verification cases can be minimum value verification, maximum value verification and interval invalid value verification.

Step S120, obtaining a verification case library corresponding to the verification schedule. Specifically, step S120 may be performed by the second acquisition module 420 in the regression verification apparatus 400 illustrated in fig. 4.

In the embodiment of the application, the verification case library is used for storing verification cases, and the verification cases are used for verifying the mixed signal circuit. Each verification case can verify one function in the mixed signal circuit, or a part of functions in an analog circuit module or a digital circuit module in the mixed signal circuit, such as generating a voltage of 5V, realizing digital-to-analog conversion, realizing logic and control, and the like. The verification use case is adapted to the verification schedule and the mixed signal circuit.

In some implementations, the obtaining the verification case library may select a verification case that is compatible with the verification schedule from existing verification cases, and import the verification case library. The conventional verification case may be a test case used for performing excitation test on the mixed signal circuit, or may be a verification case for verifying another mixed signal circuit.

Thus, by multiplexing the verification cases, the possible use of the verification cases can be ensured, and the regression verification efficiency of the mixed signal circuit can be improved.

In other implementations, the verification cases may be obtained by compiling the verification cases in a programmable logic language according to a verification schedule and an analog circuit module and a digital circuit module in the mixed signal circuit, and importing the verification cases into a verification case library. That is, descriptive language in the verification schedule is disassembled into a plurality of verification targets, and the plurality of verification targets are converted into corresponding verification cases.

In the embodiment of the application, the verification use cases in the verification use case library can be correspondingly updated (added or modified) according to the updated verification schedule, the verification use cases can be modified according to the verification result, and whether the verification use cases are added or not can be judged according to the verification coverage rate.

It should be noted that, since there may be an interaction relationship between different verification cases, once the verification cases are modified or added, the verification cases having the interaction relationship need to be adaptively adjusted.

Step S130, a simulation verification case set and a digital verification case set are extracted from the verification case library. Specifically, step S130 may be performed by the extraction module 430 in the regression verification apparatus 400 shown in fig. 4.

In the embodiment of the application, the analog verification case set is used for adapting to an analog verification environment corresponding to the analog circuit module, and the digital verification case set is used for adapting to a digital verification environment corresponding to the digital circuit module.

It should be noted that the mixed signal circuit may be characterized by specific components, such as an operational amplifier, a transistor, a capacitor, a logic gate, and the like. The analog circuit module is used for processing continuous analog signals, and regression verification is carried out by adopting a bottom-up design flow. The digital circuit module is used for processing discrete digital signals, and carrying out register transmission level description and register transmission level and regression verification by adopting a top-down design flow. If the analog circuit module and the digital circuit module are subjected to mixed regression verification, the mixed regression verification may be mixed regression verification of a digital circuit of a register transmission stage and an analog circuit of a transistor stage, or mixed regression verification of a digital circuit and an analog circuit of a gate stage or a transistor stage.

In this way, in the case of once verification failure occurs in hybrid regression verification, it is difficult to determine for which verification case the verification failure is caused when the regression verification is performed, and it is difficult to determine whether the verification case is in the circuit with the design or not.

In the embodiment of the application, verification cases are classified into a simulation verification case set and a digital verification case set. The simulation verification case set is used for adapting to a simulation verification environment corresponding to the simulation circuit module and comprises at least one verification case for carrying out regression verification on the simulation circuit module. The digital verification case set is used for adapting to the digital verification environment corresponding to the digital circuit module and comprises at least one verification case for carrying out regression verification on the digital circuit module.

Thus, the analog circuit module and the digital circuit module in the mixed signal circuit respectively carry out regression verification according to the corresponding analog verification environment or digital verification environment, which is favorable for determining the reason causing the failure of the regression verification, thereby improving the speed of correcting the mixed signal circuit and shortening the research and development period of the mixed signal circuit.

In the embodiment of the application, after the analog verification case set and the digital verification case set are extracted, if verification cases are added in the verification case library, the added verification cases are divided into the analog verification case set and the digital verification case set, respectively.

Step S140, determining a use case execution path according to the use case dependency relationship. Specifically, step S140 may be performed by the first determination module 440 in the regression verification apparatus 400 illustrated in fig. 4.

In the embodiment of the present application, the use case execution path is used to indicate the execution order of the verification use cases in the verification use case library.

In the embodiment of the present application, the use case dependency refers to a verification result that one verification use case depends on other verification use cases.

For example, if the logic determination result output by the first verification case is yes, verifying the mixed signal circuit through the second verification case; if the logic judgment result output by the first verification case is negative, verifying the mixed signal circuit through the third verification case; if the first verification case and the second verification case have case dependency, the first verification case and the third verification case also have case dependency.

In some embodiments, the step S140 determines the use case execution path according to the use case dependency relationship, as shown in fig. 2, and may be implemented through step S210 and step S220.

Step S210, dividing the verification cases into at least one level of verification cases according to the case dependency relationship.

Step S220, determining an application execution path corresponding to the verification application according to the order of the application levels in the verification applications of at least one level.

In the embodiment of the present application, the input data of the next-level verification use case in the at least one-level verification use case includes the use case verification result of the previous-level verification use case.

It can be appreciated that the verification cases are divided into different priority levels by case dependency relationships, and are used to indicate the priority order of execution of the verification cases.

In the embodiment of the application, first-stage verification cases in the verification cases are determined first, and input data of the first-stage verification cases are independent of verification results of other verification cases. Then, when the number of cases of the first-stage cases is smaller than the number of cases of the verification cases in the verification case library, determining second-stage verification cases from the verification case library, wherein input data of any second-stage verification case comprises a verification result of at least one first-stage verification case, and the second-stage verification case has a case dependency relationship with the first-stage verification case.

If the verification cases are not classified in the verification case library, similar to the process of determining the second-stage verification case, the third-stage verification case, the fourth-stage verification case and the fifth-stage verification case are continuously determined until all the verification cases in the verification case library can determine the priority level. It is understood that the verification cases correspond to at least one priority level, and accordingly, the second level verification case, the third level verification case, the fourth level verification case, and the fifth level verification case may all exist, none, or none.

In the embodiment of the present application, assuming that 1000 verification cases are included in the verification case library, the number of cases of the first-stage verification case is 350, the number of cases of the second-stage verification case is 300, the number of cases of the third-stage verification case is 200, the number of cases of the fourth-stage verification case is 100, and the number of cases of the fifth-stage verification case is 50.

Therefore, the verification cases are classified, regression verification is carried out in a classified mode, errors or potential problems in the verification cases can be found as early as possible, and the iteration efficiency of the regression verification is accelerated.

Step S150, according to the use case execution path, carrying out regression verification on the mixed signal circuit according to the verification use cases in the analog verification use case set or the digital verification use case set in sequence. Specifically, step S150 may be performed by the verification module 450 in the regression verification apparatus 400 shown in fig. 4.

In this embodiment of the present application, at least one first-level verification case is obtained according to a case execution path first, where the first-level verification case may belong to an analog verification case set or may belong to a digital verification case set.

In the embodiment of the application, the mixed signal circuit is verified according to at least one first-stage verification use case through a distributed algorithm. Therefore, the number of cases for simultaneous verification is reduced in the regression verification process, the concurrent verification pressure is reduced, and the stability of regression verification is improved.

In the embodiment of the application, after the first-stage verification case is verified, the second-stage verification case is obtained, and the mixed signal circuit is verified according to at least one second-stage verification case through the distributed algorithm.

For example, when the analog circuit module a is electrically connected to the digital circuit D and the analog circuit module a is verified by the verification case M, the verification result of the digital circuit D needs to be obtained. Once the verification result of the digital circuit D has an error, there is a high possibility that an error exists in the process of verifying the analog circuit module a by the verification use case M.

In this way, once the verification error exists in the process of verifying the mixed signal circuit through the first-stage verification use case, the verification of the mixed signal circuit through the second-stage verification use case can be stopped, the invalid verification of the mixed signal circuit through the second-stage verification use case can be avoided, the execution times of the verification use case in the regression verification are reduced, and the speed of the regression verification is improved.

In the embodiment of the application, in the regression verification process, the number of cases of the executed verification cases and the verification result of the executed cases can be counted and simulated in the simulated verification case set and the digital verification case set. The number of cases of the executed verification cases and the verification result of the executed cases can also be calculated and simulated by adding a marking mode in the verification case set and the digital verification case set. In the embodiment of the present application, the manner of counting the number of executed verification cases and the verification result of the executed cases is not limited.

Step S160, under the condition that the regression verification is finished, the verification coverage rate of the mixed signal circuit is counted. Specifically, step S160 may be performed by the statistics module 460 in the regression verification apparatus 400 shown in fig. 4.

In the embodiment of the application, the end of the regression verification may include two results of success and failure of the regression verification. If all the verification cases in the verification case library can pass the verification of the mixed signal circuit in the regression verification process, the regression verification is successful. If any verification case cannot be executed in the process of verifying the mixed signal circuit, the verification result does not belong to the preset verification result range or the running error and the like, the regression verification fails.

In the embodiment of the present application, the verification coverage rate of the statistical mixed signal circuit may be achieved by the following steps: and counting the verification coverage rate of the mixed signal circuit according to the verified ratio of the verification schedule and the verified ratio of the verification cases in the verification case library.

Thus, the verification coverage is counted together by the verification ratio of the verification schedule and the verification ratio of the verification use case, so that the accuracy of the coverage can be improved.

And step S170, if the verification coverage rate meets the preset condition, determining that the mixed signal circuit passes regression verification. Specifically, step S170 may be performed by the second determination module 470 in the regression verification apparatus 400 illustrated in fig. 4.

In an embodiment of the present application, the preset condition includes at least one of: the coverage of the functions in the verification schedule is up to 100%, and the coverage of the codes in the verification case library is up to 100%.

It can be understood that the functional coverage rate and the code coverage rate complement each other, and whether the code redundancy of the verification case exists in the regression verification process or the verification requirement in the verification schedule exists can be combined and judged.

In the embodiment of the application, if the mixed signal circuit is determined to pass the regression verification, the mixed signal circuit can be subjected to subsequent design steps such as layout level design, stream slice and the like.

In the embodiment of the application, if the non-verification coverage rate meets the preset condition, the verification case needs to be modified, or the verification case is modified again after the mixed signal circuit is modified, and then the regression verification is performed again. And continuously modifying the verification process until the verification coverage rate meets the preset condition.

Specifically, in the embodiment of the present application, as shown in fig. 3, the regression verification method further includes: step S310 to step S330.

Step S310, if the verification coverage rate does not meet the preset condition, updating the verification case according to the verification result of the regression verification.

Step S320, the simulation verification case set and the digital verification case set are updated according to the updated verification case.

Step S330, according to the use case execution path, performing regression verification on the mixed signal circuit according to the updated analog verification use case set or the updated digital verification use case set in turn.

In this embodiment of the present application, the verification result after the completion of the regression verification includes a regression verification failure or a regression verification success, and the specific implementation manner of step S310 includes: if the verification result of the end of the regression verification is that the regression verification is successful, updating the verification cases in the verification case library according to the verification schedule and the mixed signal circuit; if the verification result after the regression verification is the regression verification failure, judging whether the verification case corresponding to the regression verification failure has errors or not; if the verification case corresponding to the regression verification failure has errors, modifying the verification case corresponding to the regression verification failure, and updating the verification case in the verification case library so that the updated verification case can carry out regression verification on the mixed signal circuit; if the verification case corresponding to the regression verification failure has no error, modifying and updating the mixed signal circuit, and updating the verification case in the verification case library according to the verification schedule and the updated mixed signal circuit.

In one case, if the result of the regression verification is that the regression verification is successful, when the verification use case library corresponding to the verification schedule is obtained, the verification requirement in the verification schedule may be omitted, and the updated verification schedule may increase the verification requirement, which may result in that the verification coverage may not meet the preset condition. The verification schedule and the regression verification exist in parallel, and therefore, if the verification schedule is updated in the process of performing the regression verification by the verification use case, even if the verification result at the end of the regression verification is the success of the regression verification, the verification coverage may also deviate. In this case, it is necessary to update the verification cases in the verification case library based on the updated verification schedule and the mixed signal circuit.

It may be understood that if the verification result of the end of the regression verification is that the regression verification fails, it is determined whether the verification case corresponding to the regression verification failure has an error. And updating the verification case by adopting different updating modes according to different judging results.

In another case, if the verification case corresponding to the regression verification failure has an error, the verification case corresponding to the regression verification failure is modified, and the verification case in the verification case library is updated, so that the updated verification case can carry out regression verification on the mixed signal circuit. After determining that the verification case corresponding to the regression verification failure has errors, determining whether the input, the case dependency relation, the related verification case and the verification schedule related to the error verification case need to be updated, and updating the input, the case dependency relation, the related verification case and the verification schedule together if the input, the case dependency relation, the related verification case and the verification schedule need to be updated.

In still another case, if there is no error in the verification case corresponding to the regression verification failure, the mixed signal circuit is modified and updated, and the verification case of the verification case library is updated according to the verification schedule and the updated mixed signal circuit. After the mixed signal circuit is modified and updated, it is also required to determine whether the verification schedule needs to be updated, and if the verification schedule also needs to be updated, the verification cases of the verification case library are updated according to the updated verification schedule and the updated mixed signal circuit.

In some embodiments, the specific implementation manner of the step S330 may be: under the condition that the use case dependency relationship of the updated verification use case is unchanged, and under the condition that the verification result of the end of the regression verification is that the regression verification is successful, carrying out the regression verification on the mixed signal circuit according to the use case execution path and the updated simulation verification use case set or the updated verification use case in the digital verification use case set in sequence; and when the use case dependency relationship of the updated verification use case is unchanged and the verification result of the end of the regression verification is that the regression verification fails, continuing to perform the regression verification on the mixed signal circuit according to the updated simulation verification use case set or the verification use cases in the updated digital verification use case set in sequence from the modified verification use case corresponding to the regression verification failure according to the use case execution path.

It can be understood that if the case dependency of the updated verification case is unchanged, repeated verification of the verified verification case is not performed, and the code data quantity operated in the regression verification process is reduced, so that the regression verification efficiency of the mixed signal circuit is improved.

In other embodiments, the specific implementation manner of the step S330 may be: when the updated use case dependency relationship of the verification use case is changed, re-determining the use case execution path of the verification use case according to the changed use case dependency relationship; and carrying out regression verification on the mixed signal circuit according to the redetermined use case execution path and the updated analog verification use case set or the updated digital verification use case set in sequence.

It can be understood that after the verification cases are updated, the mixed signal circuit is verified according to all the current verification cases, so that the completeness of regression verification can be ensured, and the reliability of the mixed signal circuit can be improved.

In the embodiment of the application, a regression verification method of a mixed signal circuit is provided, and the top-down implementation steps are as follows: the method is based on a unified verification schedule, and the regression verification process of the missing east mixed signal circuit is performed through the verification schedule. After the verification schedule is acquired, a verification case library corresponding to the verification schedule is acquired. Of course, the verification schedule and the verification case library can be updated passively according to the actual requirement of the regression verification condition, and can be updated actively after error and leakage are found. After the verification schedule and the verification case library are obtained, the process of carrying out regression verification on the mixed signal circuit through the test cases is started to be partially or completely repeated until the verification schedule is completed completely. Before verification, the verification method is decomposed into verification cases which are adapted to different verification environments for different verification environments so as to accelerate complete verification planning (verification coverage rate is 100%). And then, according to verification cases in different verification environments, planning and defining a reasonable regression verification execution path by combing the dependency relationship among the verification cases, so as to discover errors or potential problems in the verification cases as soon as possible in real time and accelerate the iteration efficiency of the regression verification. And finally, uniformly analyzing the regression verification result, and collecting the verification coverage rate in a concentrated way. And under the condition that the verification coverage rate is achieved and the verification schedule is presented, realizing regression verification of the mixed signal circuit.

Aiming at an analog circuit module and a digital circuit module which are included in the mixed signal circuit, all verification cases of all circuit modules are integrated by acquiring a verification case library corresponding to a verification plan, so that unified regression verification is conducted on the mixed signal circuit. And carrying out regression verification on the analog circuit module according to the analog verification case set, carrying out regression verification on the digital circuit module according to the digital verification case set, and obtaining a concentrated regression verification result so as to improve the real-time performance of verification coverage rate counted according to the verification result. The regression verification is carried out according to the use case execution path, so that each verification use case can be ensured to have corresponding input data, the condition that verification cannot be carried out due to lack of input data related to the use case dependency relationship is avoided, and the regression verification efficiency of the mixed signal circuit is improved. And carrying out regression verification according to the use case execution path, and also carrying out visual and controllable monitoring on the regression verification process, so as to avoid execution deviation of a verification plan or sending verification errors. The regression verification is performed according to the use case execution path, and all verification use cases can be ensured to be executed, namely, all verification plans in the verification schedule are ensured to be subjected to the regression verification, so that verification defects and verification risks in the regression verification can be reduced.

As shown in fig. 4, the embodiment of the present application further provides a regression verification apparatus 400, where the regression verification apparatus 400 may include a first obtaining module 410, a second obtaining module 420, an extracting module 430, a first determining module 440, a verifying module 450, a statistics module 460, and a second determining module 470.

The first obtaining module 410 is configured to obtain a verification schedule of a mixed signal circuit, where the mixed signal circuit includes an analog circuit module and a digital circuit module;

the second obtaining module 420 is configured to obtain a verification case library corresponding to the verification schedule, where the verification case library is used to store verification cases, and the verification cases are used to verify the mixed signal circuit;

the extracting module 430 is configured to extract an analog verification case set and a digital verification case set from the verification case library, where the analog verification case set is used to adapt to an analog verification environment corresponding to the analog circuit module, and the digital verification case set is used to adapt to a digital verification environment corresponding to the digital circuit module;

the first determining module 440 is configured to determine a use case execution path of the verification use case according to a use case dependency relationship, where the use case execution path is used to indicate an execution order of the verification use cases in the verification use case library;

The verification module 450 is configured to perform regression verification on the mixed signal circuit according to the use case execution path sequentially according to the analog verification use case set or the verification use cases in the digital verification use case set;

the statistics module 460 is configured to, when the regression verification is finished, count a verification coverage of the mixed signal circuit;

the second determining module 470 is configured to determine that the mixed signal circuit passes regression verification if the verification coverage meets a preset condition.

The regression verification device provided in the embodiment of the present application corresponds to a regression verification method, and the implementation process and the beneficial effects of the regression verification device are not described in detail herein.

It should be noted that, the advantages that may be generated by different embodiments may be different, and in different embodiments, the advantages that may be generated may be any one or a combination of several of the above, or any other possible advantages that may be obtained.

While the basic concepts have been described above, it will be apparent to those skilled in the art that the foregoing detailed disclosure is by way of example only and is not intended to be limiting. Although not explicitly described herein, various modifications, improvements, and adaptations of the present application may occur to one skilled in the art. Such modifications, improvements, and modifications are intended to be suggested within this specification, and therefore, such modifications, improvements, and modifications are intended to be included within the spirit and scope of the exemplary embodiments of the present application.

It should be noted that, in the description of the present application, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "fixed" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally formed; can be mechanically or electrically connected; the device can be rotationally connected or slidingly connected; can be directly connected or indirectly connected through an intermediate medium, and can be communicated with the inside of two elements or the interaction relationship of the two elements. The specific meaning of the terms in this application will be understood by those of ordinary skill in the art in conjunction with the specific circumstances.

In addition, when terms such as "first," "second," "third," etc. are used in the present specification to describe various features, these terms are used merely to distinguish between the features and are not to be construed as indicating or implying any association, relative importance, or implicitly indicating the number of features indicated.

In addition, the present specification describes exemplary embodiments by reference to idealized exemplary cross-sectional and/or plan and/or perspective views. Thus, differences from the illustrated shapes, due to, for example, manufacturing techniques and/or tolerances, are to be expected. Thus, the exemplary embodiments should not be construed as limited to the shapes of regions illustrated herein but are to include deviations in shapes that result, for example, from manufacturing. Thus, the regions illustrated in the figures are schematic in nature and their shapes are not intended to illustrate the actual shape of a region of a device and are not intended to limit the scope of the exemplary embodiments.

Meanwhile, the present application uses specific words to describe embodiments of the present specification. Reference to "one embodiment," "an embodiment," and/or "some embodiments" means that a particular feature, structure, or characteristic is associated with at least one embodiment of the present application. Thus, it is emphasized and should be appreciated that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various positions in this application are not necessarily referring to the same embodiment. Furthermore, certain features, structures, or characteristics of one or more embodiments of the present application may be combined as suitable.

Likewise, it should be noted that in order to simplify the presentation disclosed herein and thereby aid in understanding one or more inventive embodiments, various features are sometimes grouped together in a single embodiment, figure, or description thereof. This method of disclosure, however, is not intended to imply that more features than are presented in the claims are required for the subject application. Indeed, less than all of the features of a single embodiment disclosed above.

Finally, it should be understood that the embodiments described herein are merely illustrative of the principles of the embodiments of the present application. Other variations are also possible within the scope of this application. Thus, by way of example, and not limitation, alternative configurations of embodiments of the present application may be considered in keeping with the teachings of the present application. Accordingly, embodiments of the present application are not limited to only the embodiments explicitly described and depicted herein.

Claims

1. A regression verification method, comprising:

acquiring a verification schedule of a mixed signal circuit, wherein the mixed signal circuit comprises an analog circuit module and a digital circuit module;

acquiring a verification case library corresponding to the verification schedule, wherein the verification case library is used for storing verification cases, and the verification cases are used for verifying the mixed signal circuit;

extracting an analog verification case set and a digital verification case set from the verification case library, wherein the analog verification case set is used for adapting to an analog verification environment corresponding to the analog circuit module, and the digital verification case set is used for adapting to a digital verification environment corresponding to the digital circuit module;

determining a use case execution path of the verification use case according to the use case dependency relationship, wherein the use case execution path is used for indicating the execution sequence of the verification use case in the verification use case library;

according to the use case execution path, carrying out regression verification on the mixed signal circuit according to the simulation verification use case set or the verification use cases in the digital verification use case set in sequence;

under the condition that the regression verification is finished, the verification coverage rate of the mixed signal circuit is counted;

And if the verification coverage rate meets the preset condition, determining that the mixed signal circuit passes regression verification.

2. The regression verification method according to claim 1, wherein the determining the use case execution path of the verification use case from the use case dependency relationship comprises:

dividing the verification cases into at least one level of verification cases according to the case dependency relationship, wherein input data of a later level of verification cases in the at least one level of verification cases comprises case verification results of a previous level of verification cases;

and determining an application execution path corresponding to the verification application according to the order of the application levels in the verification applications of the at least one level.

3. The regression verification method of claim 1 wherein said counting the verification coverage of the mixed signal circuit comprises:

and counting the verification coverage rate of the mixed signal circuit according to the verified ratio of the verification schedule and the verified ratio of the verification cases in the verification case library.

4. The regression verification method of claim 1, further comprising:

Updating the verification schedule.

5. The regression verification method of claim 4, further comprising:

if the verification coverage rate does not meet the preset condition, updating the verification case according to the verification result of the regression verification;

updating the analog verification case set and the digital verification case set according to the updated verification case;

and carrying out regression verification on the mixed signal circuit according to the updated analog verification case set or the updated verification cases in the digital verification case set in sequence according to the case execution path.

6. The regression verification method according to claim 5, wherein the verification result of the end of the regression verification includes a failure of the regression verification or a success of the regression verification, and the updating the verification case based on the verification result of the end of the regression verification includes:

if the verification result of the regression verification is that the regression verification is successful, updating the verification cases in the verification case library according to the verification schedule and the mixed signal circuit;

if the verification result after the regression verification is the regression verification failure, judging whether the verification case corresponding to the regression verification failure has errors or not;

If the verification case corresponding to the regression verification failure has errors, modifying the verification case corresponding to the regression verification failure, and updating the verification case in the verification case library so that the updated verification case can carry out regression verification on the mixed signal circuit;

and if the verification case corresponding to the regression verification failure does not have errors, modifying and updating the mixed signal circuit, and updating the verification case in the verification case library according to the verification schedule and the updated mixed signal circuit.

7. The regression verification method according to claim 6, wherein the performing regression verification on the mixed signal circuit according to the use case execution path sequentially according to the updated analog verification use case set or the updated verification use case in the digital verification use case set comprises:

when the use case dependency relationship of the updated verification use case is unchanged and the verification result of the end of the regression verification is that the regression verification is successful, carrying out the regression verification on the mixed signal circuit according to the use case execution path and the updated simulation verification use case set or the updated verification use case in the digital verification use case set in sequence;

8. The regression verification method according to claim 6, wherein the performing regression verification on the mixed signal circuit according to the use case execution path sequentially according to the updated analog verification use case set or the updated verification use case in the digital verification use case set comprises:

when the updated use case dependency relationship of the verification use case is changed, re-determining the use case execution path of the verification use case according to the changed use case dependency relationship;

and carrying out regression verification on the mixed signal circuit according to the redetermined use case execution path and the updated analog verification use case set or the updated verification use cases in the digital verification use case set in sequence.

9. The regression verification method according to any one of claims 1 to 8, wherein the preset conditions include at least one of: the coverage of the functions in the verification schedule is up to 100%, and the coverage of the codes in the verification case library is up to 100%.

10. A regression verification apparatus, comprising: the device comprises a first acquisition module, a second acquisition module, an extraction module, a first determination module, a verification module, a statistics module and a second determination module; wherein,

the first acquisition module is used for acquiring a verification schedule of a mixed signal circuit, and the mixed signal circuit comprises an analog circuit module and a digital circuit module;

the second acquisition module is used for acquiring a verification case library corresponding to the verification schedule, wherein the verification case library is used for storing verification cases, and the verification cases are used for verifying the mixed signal circuit;

the extraction module is used for extracting an analog verification case set and a digital verification case set from the verification case library, wherein the analog verification case set is used for adapting to an analog verification environment corresponding to the analog circuit module, and the digital verification case set is used for adapting to a digital verification environment corresponding to the digital circuit module;

The first determining module is used for determining a use case execution path of the verification use case according to the use case dependency relationship, wherein the use case execution path is used for indicating the execution sequence of the verification use case in the verification use case library;

the verification module is used for carrying out regression verification on the mixed signal circuit according to the use case execution path and the simulation verification use case set or the verification use cases in the digital verification use case set in sequence;

the statistics module is used for counting the verification coverage rate of the mixed signal circuit under the condition that the regression verification is finished or the regression verification fails;

and the second determining module is used for determining that the mixed signal circuit passes regression verification if the verification coverage rate meets a preset condition.