CN103870383A - Test coverage statistical method and system based on JVM - Google Patents
Test coverage statistical method and system based on JVM Download PDFInfo
- Publication number
- CN103870383A CN103870383A CN201210532089.7A CN201210532089A CN103870383A CN 103870383 A CN103870383 A CN 103870383A CN 201210532089 A CN201210532089 A CN 201210532089A CN 103870383 A CN103870383 A CN 103870383A
- Authority
- CN
- China
- Prior art keywords
- virtual machine
- bytecode
- class
- test
- jvm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention relates to the technical field of software test, and provides a test coverage statistical method and a test coverage statistical system based on JVM. The method comprises the steps of: S1, introducing taxons needing subjecting to statistics as parameters while starting JVM; S2, judging whether classes loaded into a virtual machine need to be injected, if yes, executing a step S3, otherwise, directly executing a step S4; S3, implementing bytecode operation to the classes needing subjecting to statistics and writing back into the virtual machine; S4, normally executing the operation of the classes and automatically recording statistical information in the execution by the virtual machine; S5, when the virtual machine exits, computing test coverage according to the statistical information and outputting result. According to the test coverage statistical method and system based on JVM, the bytecode is injected without changing original program structure, the test coverage of the code line level can be obtained in a black-box testing manner, the test coverage of the software code can be quantitatively evaluated, and a forceful reference index can be provided for the sufficiency of the test and the execution efficiency of a test case.
Description
Technical field
The present invention relates to software testing technology field, particularly a kind of test coverage statistical method and system based on JVM.
Background technology
Computer software programs are mainly completed by artificial exploitation, conventionally also can jointly be completed by several developers, inevitably can have all kinds of beyond thought mistakes.Therefore, software product will be through repeatedly testing and revising before formal issue, and the basic goal of software test is exactly to find as much as possible the defect in software before software product is issued, to guarantee the quality of formal product.Wherein Black-box Testing is from user perspective, program is regarded as to the black box that can not open, in the situation that giving no thought to program inner structure and bulk properties, input and output to program are tested, Black-box Testing is tested mainly for software interface and software function, is one of the most practical software test mode.
Existing software test theory is mature on the whole, most test modes all can realize test process by automatic means, for Black-box Testing, if can select suitable test case for each test process, can effectively design efficient automatic testing process.But, day by day huge along with software systems to be tested, the workload of test is exponential growth, has brought a lot of new problems to software Black-box Testing work.Do outside coverage test because Black-box Testing only creates test case for demand, in the situation that demand is not detailed, have very big possibility test case cannot contain whole software codes, cause test incomplete.In the incomplete situation of test, very easily undetected system bugs, bring much probabilistic hidden danger to product quality.Guarantee adequacy and the completeness of test, only adopt various measures and improve the code coverage of test case.
But in prior art, program inner structure and bulk properties are not considered in Black-box Testing, cannot directly as white-box testing process for source code rank, can only after test, carry out posterior result reckoning according to the result data of collecting, be difficult to directly obtain the code coverage data of test, calculate that result also often exists relatively large deviation.In the absence of code coverage data, obviously can not correctly assess adequacy and the completeness of testing, let alone make improvements.If only depend on white-box testing and abandon Black-box Testing, can make again testing cost too expensive, inefficiency.
Summary of the invention
(1) technical matters that will solve
In order to solve the problem that cannot directly obtain Black-box Testing code coverage data in prior art, the invention provides a kind of test coverage statistical method and system based on JVM.
(2) technical scheme
For solving the problems of the technologies described above, the present invention adopts following technical scheme to implement:
First, the invention provides a kind of test coverage statistical method based on JVM, described method comprises step:
S1 imports the class name of needs statistics into when JVM starts as parameter;
S2, judges that whether the class that virtual machine is written into needs to inject, and if desired performs step S3, otherwise directly performs step S4;
S3, carries out bytecode operation and is written back into virtual machine the class of needs statistics;
S4, virtual machine is normally carried out generic operation, automatically records executory statistical information;
S5, in the time that virtual machine exits, calculates coverage rate Output rusults according to statistical information.
Preferably, in step S5, if there is repeatedly execution result, joint account is repeatedly exported after execution result.
Preferably, in step S1, the described class name that needs statistics imports into as parameter using the form of regular expression.
Preferably, in step S2, compare by class name, whether the class that judgement is written into needs to carry out bytecode operation.
Preferably, in step S3, described bytecode operation comprises: processing is resolved, injected to bytecode; Acquisition bag, class, the direct structural relation of method are recorded in Installed System Memory.
Preferably, describedly bytecode is carried out to dissection process comprise: the executable code in recognition category file bytecode, code is distinguished with behavior unit;
Described bytecode is injected to process comprise: every a line of the executable code identifying after, insert and add up this line code and be performed the code of situation.
Preferably, in step S5, the described method according to statistical information calculating coverage rate Output rusults is: calculate according to the structural relation of the statistical information of step S4 record and step S3 acquisition, obtain coverage data Output rusults.
Preferably, in step S4, after automatically recording executory statistical information, the method also comprises: by execution information by bag, class, method layering statistic record.
On the other hand, the present invention also provides a kind of test coverage statistical system based on JVM simultaneously, and described system comprises:
Afferent module, for importing the class name of needs statistics into when JVM starts as parameter;
Inject judge module, for judging that whether the class that virtual machine is written into needs to inject, and if desired transfers to the processing of bytecode operational module, otherwise directly transfers to execution module processing;
Bytecode operational module, for carrying out bytecode operation and be written back into virtual machine the class of needs statistics;
Execution module, for making virtual machine normally carry out generic operation, records executory statistical information automatically;
Calculate output module, in the time that virtual machine exits, calculate coverage rate Output rusults according to statistical information.
Preferably, in described calculating output module, also comprise: joint account module, in the time having repeatedly execution result, joint account is repeatedly exported after execution result.
(3) beneficial effect
In technical scheme of the present invention, on the basis that does not change original program structure, carry out bytecode injection, in implementation, carry out dynamic statistics, can obtain the test coverage of code line rank in the mode of Black-box Testing, thereby can carry out quantitative evaluation to the Test coverage degree of the each version of software and overall code, for test adequacy and the execution efficiency of test case strong reference index is provided.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of the test coverage statistical method based on JVM in the present invention;
Fig. 2 is the category code of java example in one embodiment of the present of invention;
Fig. 3 is virtual machine implementation status schematic diagram in one embodiment of the present of invention;
Fig. 4 is the Output rusults schematic diagram of XML format record in one embodiment of the present of invention;
Fig. 5 is that the html document of Output rusults in one embodiment of the present of invention is shown content schematic diagram.
Embodiment
Below in conjunction with each accompanying drawing, the technical scheme in the embodiment of the present invention is carried out to clear, complete description, obviously, described embodiment is a part of embodiment of the present invention, rather than whole embodiment.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skills obtain under the prerequisite of not making creative work, belongs to the scope of protection of the invention.
Black-box Testing, because automaticity is high, is analyzed source code without manual read, adds that it tests from user perspective, be quite efficiently, easily to understand and practical test mode, because of but requisite a kind of test mode in current software test.But as mentioned above, Black-box Testing also exists some obvious defects, such as knowing test code coverage rate, can not guarantee adequacy and the completeness of test, very easily undetected system bugs in the situation that demand is not detailed, more cannot adjust test case targetedly to improve test completeness.
In the prior art that has its source in view of the above problems, there is not the code coverage statistical project for Black-box Testing, primary and foremost purpose of the present invention is just to provide a kind of test coverage statistical method, further, the method is based on JVM(java virtual machine, in the present invention referred to as " virtual machine ") test coverage statistical method.In an embodiment of the present invention, as shown in Figure 1, the method specifically comprises step:
S1 imports the class name of needs statistics into when JVM starts as parameter;
S2, judges that whether the class that virtual machine is written into needs to inject, and if desired performs step S3, otherwise directly performs step S4;
S3, carries out bytecode operation and is written back into virtual machine the class of needs statistics;
In this step, the judged result that needs the class of statistics to be in step S2 is the class that needs injection.
S4, virtual machine is normally carried out generic operation, automatically records executory statistical information;
S5, in the time that virtual machine exits, calculates coverage rate Output rusults according to statistical information.
Wherein, in the step S5 of said method, if there is repeatedly execution result, when virtual machine is normally carried out generic operation in step S4, repeatedly carry out some code, in step S5, want joint account repeatedly after execution result, to export.Output rusults can adopt XML form to preserve, and final result shows tester with HTML or XML document form.Tester can have an overall control to test effect according to this result, thereby whether can accurately understand test complete, and according to circumstances weighs, and judges whether suitably to supplement partial test use-case to improve test.
How each step that further illustrates the inventive method as an example of one section of java program example below realizes.As shown in Figure 2 be a basic HelloWorld class, wherein defined a Boolean, utilize if statement, be judged as and really carry out once, be judged as false not carrying out; Adopt for statement circulation 10 times simultaneously.
Particularly, in step S1, method provided by the invention together starts with JVM, and the class name (being above-mentioned HelloWorld class) of needs statistics is imported into as parameter using the form of regular expression.
In step S2, judge whether the class that virtual machine is written into needs the method for injecting to be: obtain the class being written into from virtual machine interface, compare by class name, judge whether the class that virtual machine is written into needs to inject, and whether the class that judgement is written into needs to carry out bytecode operation.Particularly, judge according to the bag name of product to be tested, distinguish java system bag or bag to be tested, if bag to be tested, being written into class and need to carrying out bytecode operation, execution step S3 wherein; If java system bag, wherein be written into class without carrying out bytecode operation, directly perform step S4.The class of Fig. 2 example belongs to testpackage bag, is bag to be tested, thereby need to carries out bytecode operation.
In step S3, the bytecode operation that the class of needs statistics is carried out comprises: obtain the bytecode that is written into class; Processing is resolved, injected to bytecode; Acquisition bag, class, the direct structural relation of method are recorded in Installed System Memory.Above-mentioned bytecode is resolved, injects to process with obtaining bag, class, the direct structural relation of method be recorded in these two kinds of bytecodes operations of Installed System Memory and can carry out simultaneously, also can successively carry out.Then, pass the byte of handling well back virtual machine.
Particularly, bytecode being carried out to dissection process comprises: the executable code in recognition category file bytecode; Code is distinguished with behavior unit.Dissection process can adopt existing bytecode analytical tool to realize, such as the line number of the decompiling acquisition code by bytecode.Bytecode is injected to process and comprise: this line code of insertion statistics is performed the code of situation after every row of the executable code identifying, such as inserting a segment counter code, when this line code of correspondence is performed once, carry out this counter code, add up the number of times that is performed of this line code with the accumulated value of counter.
Still take the code of Fig. 2 as example, when identifying its line number be 14 after this line code of System.out.println in such main method (" hello world ") being by decompiling, insert at once a predefined counter method _ runs thereafter, such as _ runs (14, main, () V); First parameter of the method is the former line number of the code of identification, and second is method name, and the 3rd is that parameter adds rreturn value.Can generate a data structure in the simultaneity factor of insertion method code, (be System.out.println (" hello world ") at above-mentioned the 14th line code like this; ) the method execution that also can be called when being performed, and often the called start-stop counter value of carrying out adds one, can in trend data structure, record corresponding line number simultaneously, be performed number of times and method name etc., is convenient to follow-up layering statistics.Because such code has very strong versatility, tester only need pre-define the class that needs statistics, carries out automatic injection subsequently and enter above-mentioned counter method after every a line executable code, has greatly improved the automaticity of statistical efficiency and test.
In step S4, virtual machine is normally carried out generic operation, program is normally moved in original mode, after automatically recording executory statistical information, because being written in class of test pack injected bytecode, in the time carrying out bytecode, just can obtain the relevant information of code implementation status, obtain execution information, therefore, this step also comprises: by obtain execution information by bag, class, method layering statistic record.An example of implementation status as shown in Figure 3.
In step S5, in the time that virtual machine exits, to calculate coverage rate Output rusults according to statistical information, here, the method of calculating coverage rate Output rusults according to statistical information can be: calculate according to the structural relation of the statistical information of step S4 record and step S3 acquisition, obtain coverage data Output rusults.Further, the common layering logic layers of the structural relation of code is bag → class → method → OK, have different class files in a bag, and class file is made up of method, and method is made up of code line; Like this, the method coverage rate of calculating equals the total line number of row/method that method is carried out, class coverage rate equals the total line number of all methods in row sum/class that in class, all methods are carried out, and bag coverage rate equals total line number of all classes in row sum/bag that in bag, all classes are carried out.
An Output rusults example of XML form as shown in Figure 4, wherein, in coverage item, line-rate represents that coverage, lines-covered represent that the line number, the lines-valid that carry out represent that effective row, version representational tool version, timestamp represent the rise time; In package item, name represents that bag name, line-rate represent coverage; In class item, name represents that class name, the residing filename of filename representation class, line-rate represent coverage; In method item, name method for expressing name, signature represent that parameter adds rreturn value (the uniqueness method name of a method, parameter determine jointly), line-rate represents coverage; In line item, number represents that line number, the run in file represents the number of times of carrying out.According to the result of Fig. 4, as shown in Figure 5, according to this displaying, tester can obtain test coverage and code implementation status to the displaying example of the html document of production intuitively, thereby can adjust targetedly to guarantee the completeness of test.
In addition, one of ordinary skill in the art will appreciate that, the all or part of step realizing in above-described embodiment method is can carry out the hardware that instruction is relevant by program to complete, described program can be stored in a computer read/write memory medium, this program is in the time carrying out, comprise each step of above-described embodiment method, and described storage medium can be: ROM/RAM, magnetic disc, CD, storage card etc.Therefore, corresponding with method of the present invention, the present invention also comprises a kind of test coverage statistical system based on JVM simultaneously, and this system comprises:
Afferent module, for importing the class name of needs statistics into when JVM starts as parameter;
Inject judge module, for judging that whether the class that virtual machine is written into needs to inject, and if desired transfers to the processing of bytecode operational module, otherwise directly transfers to execution module processing;
Bytecode operational module, for carrying out bytecode operation and be written back into virtual machine the class of needs statistics;
Execution module, for making virtual machine normally carry out generic operation, records executory statistical information automatically;
Calculate output module, in the time that virtual machine exits, calculate coverage rate Output rusults according to statistical information.
In the test coverage statistical system based on JVM proposing in the present invention, calculate in output module and can also comprise joint account module, this joint account module is in the time having repeatedly execution result, and joint account is repeatedly exported after execution result.
In sum, in technical scheme of the present invention, on the basis that does not change original program structure, carry out bytecode injection, in implementation, carry out dynamic statistics, can obtain the test coverage of code line rank in the mode of Black-box Testing, thereby can carry out quantitative evaluation to the Test coverage degree of the each version of software and overall code, for test adequacy and the execution efficiency of test case strong reference index is provided.In addition, the present invention is little to the performance impact of system, affects hardly proper testing process; During due to version upgrading, do not need to do any operation bidirectional, it is very convenient to dispose, and has very strong practicality.
Above embodiment is only for illustrating the present invention; and be not limitation of the present invention; the those of ordinary skill in relevant technologies field; without departing from the spirit and scope of the present invention; can also make a variety of changes and modification; therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.
Claims (10)
1. the test coverage statistical method based on JVM, is characterized in that, described method comprises step:
S1 imports the class name of needs statistics into when JVM starts as parameter;
S2, judges that whether the class that virtual machine is written into needs to inject, and if desired performs step S3, otherwise directly performs step S4;
S3, carries out bytecode operation and is written back into virtual machine the class of needs statistics;
S4, virtual machine is normally carried out generic operation, automatically records executory statistical information;
S5, in the time that virtual machine exits, calculates coverage rate Output rusults according to statistical information.
2. method according to claim 1, is characterized in that, in step S5, if there is repeatedly execution result, joint account is repeatedly exported after execution result.
3. method according to claim 1, is characterized in that, in step S1, the described class name that needs statistics imports into as parameter using the form of regular expression.
4. method according to claim 1, is characterized in that, in step S2, compares by class name, and whether the class that judgement is written into needs to carry out bytecode operation.
5. method according to claim 1, is characterized in that, in step S3, described bytecode operation comprises: processing is resolved, injected to bytecode; Acquisition bag, class, the direct structural relation of method are recorded in Installed System Memory.
6. method according to claim 5, is characterized in that,
Describedly bytecode is carried out to dissection process comprise: the executable code in recognition category file bytecode, code is distinguished with behavior unit;
Described bytecode is injected to process comprise: every a line of the executable code identifying after, insert and add up this line code and be performed the code of situation.
7. method according to claim 5, it is characterized in that, in step S5, the described method according to statistical information calculating coverage rate Output rusults is: calculate according to the structural relation of the statistical information of step S4 record and step S3 acquisition, obtain coverage data Output rusults.
8. method according to claim 1, is characterized in that, in step S4, after automatically recording executory statistical information, the method also comprises: by execution information by bag, class, method layering statistic record.
9. the test coverage statistical system based on JVM, is characterized in that, described system comprises:
Afferent module, for importing the class name of needs statistics into when JVM starts as parameter;
Inject judge module, for judging that whether the class that virtual machine is written into needs to inject, and if desired transfers to the processing of bytecode operational module, otherwise directly transfers to execution module processing;
Bytecode operational module, for carrying out bytecode operation and be written back into virtual machine the class of needs statistics;
Execution module, for making virtual machine normally carry out generic operation, records executory statistical information automatically;
Calculate output module, in the time that virtual machine exits, calculate coverage rate Output rusults according to statistical information.
10. system according to claim 9, is characterized in that, in described calculating output module, also comprises: joint account module, in the time having repeatedly execution result, joint account is repeatedly exported after execution result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210532089.7A CN103870383A (en) | 2012-12-11 | 2012-12-11 | Test coverage statistical method and system based on JVM |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210532089.7A CN103870383A (en) | 2012-12-11 | 2012-12-11 | Test coverage statistical method and system based on JVM |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103870383A true CN103870383A (en) | 2014-06-18 |
Family
ID=50908939
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210532089.7A Pending CN103870383A (en) | 2012-12-11 | 2012-12-11 | Test coverage statistical method and system based on JVM |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103870383A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105629948A (en) * | 2015-12-24 | 2016-06-01 | 北京新能源汽车股份有限公司 | Test case detection method and device |
| CN106354624A (en) * | 2015-07-17 | 2017-01-25 | 北京奇虎科技有限公司 | Automatic testing method and device |
| CN106909498A (en) * | 2015-12-22 | 2017-06-30 | 阿里巴巴集团控股有限公司 | A kind of java applet injects the method and system of failure |
| CN108108304A (en) * | 2017-12-29 | 2018-06-01 | 北京奇艺世纪科技有限公司 | A kind of detection method and device of test coverage |
| CN110008113A (en) * | 2019-02-20 | 2019-07-12 | 北京三快在线科技有限公司 | A kind of test method, device, electronic equipment |
| CN110309055A (en) * | 2019-05-23 | 2019-10-08 | 深圳壹账通智能科技有限公司 | Black-box Testing method, apparatus, terminal and storage medium based on Java Virtual Machine |
| CN112506782A (en) * | 2020-12-08 | 2021-03-16 | 北京指掌易科技有限公司 | Application program testing method, device, equipment and storage medium |
| CN114996128A (en) * | 2022-05-19 | 2022-09-02 | 青矩技术股份有限公司 | Script processing method, device and equipment based on ASM framework and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101561777A (en) * | 2008-04-14 | 2009-10-21 | 中兴通讯股份有限公司 | System and method for realizing coverage rate test |
| CN102103538A (en) * | 2011-02-22 | 2011-06-22 | 南京航空航天大学 | Method for testing palletizing robot control software based on Agent |
-
2012
- 2012-12-11 CN CN201210532089.7A patent/CN103870383A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101561777A (en) * | 2008-04-14 | 2009-10-21 | 中兴通讯股份有限公司 | System and method for realizing coverage rate test |
| CN102103538A (en) * | 2011-02-22 | 2011-06-22 | 南京航空航天大学 | Method for testing palletizing robot control software based on Agent |
Non-Patent Citations (2)
| Title |
|---|
| 何伟: "基于字节码插装的白盒测试系统的设计与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
| 王轶 等: "基于路径覆盖插桩的可执行代码测试工具实现", 《计算机工程》 * |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106354624A (en) * | 2015-07-17 | 2017-01-25 | 北京奇虎科技有限公司 | Automatic testing method and device |
| CN106909498A (en) * | 2015-12-22 | 2017-06-30 | 阿里巴巴集团控股有限公司 | A kind of java applet injects the method and system of failure |
| CN106909498B (en) * | 2015-12-22 | 2020-12-22 | 创新先进技术有限公司 | Method and system for injecting fault into Java program |
| CN105629948A (en) * | 2015-12-24 | 2016-06-01 | 北京新能源汽车股份有限公司 | Test case detection method and device |
| CN108108304A (en) * | 2017-12-29 | 2018-06-01 | 北京奇艺世纪科技有限公司 | A kind of detection method and device of test coverage |
| CN110008113A (en) * | 2019-02-20 | 2019-07-12 | 北京三快在线科技有限公司 | A kind of test method, device, electronic equipment |
| CN110008113B (en) * | 2019-02-20 | 2023-08-29 | 北京三快在线科技有限公司 | Test method and device and electronic equipment |
| CN110309055A (en) * | 2019-05-23 | 2019-10-08 | 深圳壹账通智能科技有限公司 | Black-box Testing method, apparatus, terminal and storage medium based on Java Virtual Machine |
| CN112506782A (en) * | 2020-12-08 | 2021-03-16 | 北京指掌易科技有限公司 | Application program testing method, device, equipment and storage medium |
| CN114996128A (en) * | 2022-05-19 | 2022-09-02 | 青矩技术股份有限公司 | Script processing method, device and equipment based on ASM framework and storage medium |
| CN114996128B (en) * | 2022-05-19 | 2023-03-14 | 青矩技术股份有限公司 | Script processing method, device and equipment based on ASM framework and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103870383A (en) | Test coverage statistical method and system based on JVM | |
| US9594543B2 (en) | Activity diagram model-based system behavior simulation method | |
| CN101710378B (en) | Software security flaw detection method based on sequential pattern mining | |
| CN103257919B (en) | Inspection method and device for script programs | |
| Gabmeyer et al. | A classification of model checking-based verification approaches for software models | |
| Simons | JWalk: a tool for lazy, systematic testing of java classes by design introspection and user interaction | |
| Ricca et al. | Three open problems in the context of e2e web testing and a vision: Neonate | |
| Song et al. | FBDTester 2.0: Automated test sequence generation for FBD programs with internal memory states | |
| CN107850641A (en) | The whole-system verification of on-chip system (SoC) | |
| Alpuente et al. | Using conditional trace slicing for improving Maude programs | |
| CN112433948A (en) | Simulation test system and method based on network data analysis | |
| Said et al. | Towards Interactive Mining of Understandable State Machine Models from Embedded Software. | |
| Cheon | Automated random testing to detect specification-code inconsistencies | |
| CN104050069B (en) | A kind of automated testing method realizing MIPS processor correctness based on Mars judge Verilog | |
| Calvagna et al. | Automated conformance testing of Java virtual machines | |
| US8850407B2 (en) | Test script generation | |
| Wiederseiner et al. | An open-source tool for automated generation of black-box xunit test code and its industrial evaluation | |
| CN110633199A (en) | Testing apparatus, method, and medium for block chain supporting intelligent contract | |
| US20130283238A1 (en) | Testing system for an integrated software system | |
| CN105045698A (en) | Method for analyzing chip verification progress by using MATPLOTLIB of PYTHON | |
| Kugler et al. | Testing scenario-based models | |
| Matsubara et al. | Model checking with program slicing based on variable dependence graphs | |
| WO2021104027A1 (en) | Code performance testing method, apparatus and device, and storage medium | |
| Lukács et al. | Practical UML subset for railway engineers to support formal modeling | |
| CN114924992B (en) | Formalized FPGA software security verification method and verification system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140618 |