CN110806969A - Test case integrity evaluation method and device and electronic equipment - Google Patents
Test case integrity evaluation method and device and electronic equipment Download PDFInfo
- Publication number
- CN110806969A CN110806969A CN201910881783.1A CN201910881783A CN110806969A CN 110806969 A CN110806969 A CN 110806969A CN 201910881783 A CN201910881783 A CN 201910881783A CN 110806969 A CN110806969 A CN 110806969A
- Authority
- CN
- China
- Prior art keywords
- case
- vocabulary list
- vocabulary
- special
- integrity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 114
- 238000011156 evaluation Methods 0.000 title claims abstract description 19
- 238000000034 method Methods 0.000 claims abstract description 25
- 238000012812 general test Methods 0.000 claims description 14
- 230000014509 gene expression Effects 0.000 claims description 10
- 238000012545 processing Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000013522 software testing Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3676—Test management for coverage analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Abstract
The invention discloses a test case integrity evaluation method, a test case integrity evaluation device and electronic equipment, wherein the method comprises the following steps: respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list; and comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list respectively to evaluate the integrity of the universal case and the integrity of the special case. Respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list through word frequency statistics; and comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list respectively to evaluate the integrity of the universal case and the integrity of the special case. The invention can output the test case integrity evaluation report only by inputting the service requirement file and the test case file, has the advantages of simple operation and quick test, and can improve the test case coverage and ensure the test accuracy.
Description
Technical Field
The invention relates to the field of software testing, in particular to a method and a device for evaluating the integrity of a test case, electronic equipment and a computer readable medium.
Background
In the field of software testing, test cases are indispensable tools for testers. The test case scientifically organizes and summarizes the behavior activities of the software test, and aims to convert the behavior of the software test into a manageable mode. Meanwhile, the test case is also one of the methods for specifically quantifying the test. Therefore, the quality of the test case directly affects the test quality.
At present, the evaluation of the test cases is mostly carried out in a form of manual evaluation of the cases, and the test cases are specifically evaluated by people combining various aspects of products, design, development and the like. The manual review method is time-consuming and labor-consuming, and increases the cost of software testing.
Disclosure of Invention
The invention aims to solve the technical problem that manual evaluation software in the prior art is time-consuming and labor-consuming.
In order to solve the above technical problem, a first aspect of the present invention provides a method for evaluating integrity of a test case, where the method includes:
respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list;
and comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list respectively to evaluate the integrity of the universal case and the integrity of the special case.
In a specific embodiment, the creating the requirement vocabulary list includes:
counting high-frequency words of the demand files through regular expressions, and creating a demand word list according to the high-frequency words of the demand files.
In a specific embodiment, the creating a universal use case vocabulary list includes:
setting a general test case keyword, and creating a general case vocabulary list according to the general test case keyword.
In a specific embodiment, the creating of the special use case vocabulary list includes:
and counting special test case file high-frequency words through a regular expression, and creating a special case word list according to the special test case file high-frequency words.
In a specific embodiment, the comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list to evaluate the integrity of the universal case and the integrity of the special case respectively includes:
evaluating the integrity of the universal case according to the occurrence rate of the high-frequency vocabulary of the requirement file in the universal test case vocabulary list;
and evaluating the integrity of the special use case according to the occurrence rate of the high-frequency vocabulary of the requirement file in the special use case vocabulary list.
In a specific embodiment, the method further comprises:
and prompting a first vocabulary which does not appear in the universal test case vocabulary list and the special use case vocabulary list in the requirement vocabulary list, and recommending a test case containing the first vocabulary.
In order to solve the above technical problem, a second aspect of the present invention provides a test case integrity evaluation apparatus, including:
the creating module is used for respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list;
and the determining module is used for respectively comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list to evaluate the integrity of the universal case and the integrity of the special case.
In one embodiment, the creating module includes:
the first creating module is used for counting high-frequency words of the demand files through regular expressions and creating a demand word list according to the high-frequency words of the demand files.
And the second creating module is used for setting the general test case keywords and creating a general case vocabulary list according to the general test case keywords.
And the third creating module is used for counting the high-frequency vocabulary of the special test case file through the regular expression and creating a special case vocabulary list according to the high-frequency vocabulary of the special test case file.
In one embodiment, the determining module comprises:
the first determining module is used for evaluating the integrity of the universal case according to the occurrence rate of the high-frequency vocabulary of the requirement file in the universal test case vocabulary list;
and the second determining module is used for evaluating the integrity of the special use case according to the occurrence rate of the high-frequency vocabulary of the requirement file in the special use case vocabulary list.
In one embodiment, the apparatus further comprises:
and the prompting recommending module is used for prompting a first vocabulary which does not appear in the universal test case vocabulary list and the special case vocabulary list in the requirement vocabulary list and recommending a test case containing the first vocabulary.
In order to solve the above technical problem, a third aspect of the present invention provides an electronic device, comprising: a processor; and a memory storing computer-executable instructions that, when executed, cause the processor to perform the above-described method.
In order to solve the above technical problem, a fourth aspect of the present invention proposes a computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs that, when executed by a processor, implement the above method.
Respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list through word frequency statistics; and comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list respectively to evaluate the integrity of the universal case and the integrity of the special case. The invention can output the test case integrity evaluation report only by inputting the service requirement file and the test case file, has the advantages of simple operation and quick test, can improve the test case coverage and ensure the test accuracy.
Drawings
In order to make the technical problems solved by the present invention, the technical means adopted and the technical effects obtained more clear, the following will describe in detail the embodiments of the present invention with reference to the accompanying drawings. It should be noted, however, that the drawings described below are only illustrations of exemplary embodiments of the invention, from which other embodiments can be derived by those skilled in the art without inventive step.
FIG. 1 is a flow chart of a test case integrity evaluation method according to the present invention;
FIG. 2 is a flow chart of another test case integrity evaluation method of the present invention;
FIG. 3 is a schematic structural framework diagram of a test case integrity evaluation apparatus according to the present invention;
FIG. 4 is a block diagram of an electronic device of the present invention;
FIG. 5 is a schematic diagram of one embodiment of a computer-readable medium of the present invention.
Detailed Description
Exemplary embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the invention may be embodied in many specific forms, and should not be construed as limited to the embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the invention to those skilled in the art.
The structures, properties, effects or other characteristics described in a certain embodiment may be combined in any suitable manner in one or more other embodiments, while still complying with the technical idea of the invention.
In describing particular embodiments, specific details of structures, properties, effects, or other features are set forth in order to provide a thorough understanding of the embodiments by one skilled in the art. However, it is not excluded that a person skilled in the art may implement the invention in a specific case without the above-described structures, performances, effects or other features.
The flow chart in the drawings is only an exemplary flow demonstration, and does not represent that all the contents, operations and steps in the flow chart are necessarily included in the scheme of the invention, nor does it represent that the execution is necessarily performed in the order shown in the drawings. For example, some operations/steps in the flowcharts may be divided, some operations/steps may be combined or partially combined, and the like, and the execution order shown in the flowcharts may be changed according to actual situations without departing from the gist of the present invention.
The block diagrams in the figures generally represent functional entities and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.
The same reference numerals denote the same or similar elements, components, or parts throughout the drawings, and thus, a repetitive description thereof may be omitted hereinafter. It will be further understood that, although the terms first, second, third, etc. may be used herein to describe various elements, components, or sections, these elements, components, or sections should not be limited by these terms. That is, these phrases are used only to distinguish one from another. For example, a first device may also be referred to as a second device without departing from the spirit of the present invention. Furthermore, the term "and/or", "and/or" is intended to include all combinations of any one or more of the listed items.
The terms referred to in this application are explained first:
in the present invention, the test case refers to a set of test inputs, execution conditions and expected results compiled for a specific target for implementing a test in an automated test so as to test a certain program path or verify whether a certain specific requirement is met. In the embodiment automation test, an automation test tool is used to test software in cooperation with a test case. In the face of increasingly complex software, the requirement for testing is more and more, and with the continuous promotion of projects, the size of a use case library of a test case is more and more huge, and more occupied resources are also more and more, so that the performance and the efficiency of the test are reduced. Therefore, the integrity of the test case needs to be evaluated, the coverage of the test case is improved, and the accuracy of the test is ensured.
One of the main evaluation methods to determine whether a test case is complete is based on coverage of demand. In the invention, the integrity of the test case refers to the coverage degree of the test case on the requirement file. The test cases comprise a general test case and a special test case, wherein the general test case is a test case suitable for each service, and the special test case is a test case suitable for a specific service. The integrity of the general test case refers to the coverage degree of the general test case on the requirement file, and the integrity of the special test case refers to the coverage degree of the special test case on the requirement file. Respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list through word frequency statistics; evaluating the integrity of the universal use case according to the occurrence rate of the vocabularies in the universal use case vocabulary list in the requirement list; and evaluating the integrity of the special use case according to the vocabulary in the special use case vocabulary list and the occurrence rate in the demand list.
Embodiments of the present invention will be described below with reference to the accompanying drawings.
Fig. 1 is a flowchart of a test case integrity evaluation method provided by the present invention, and as shown in fig. 1, the method includes:
s1, respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list;
the requirement vocabulary list is specifically used for counting high-frequency vocabularies of requirement files through regular expressions and establishing the high-frequency vocabularies according to the requirement files. The high-frequency vocabulary of the requirement file refers to vocabulary with the occurrence frequency in the requirement file larger than a first threshold value, and the first threshold value can be set according to actual needs.
The universal case vocabulary list is created according to the universal test case keywords by setting the universal test case keywords. The keywords refer to words capable of reflecting that the general test cases describe the performance or quality of a certain aspect. In this embodiment, the general test case keywords include, but are not limited to, vocabularies such as compatibility, model adaptation, interaction, and exception.
And the special case vocabulary list counts special test case file high-frequency vocabularies through a regular expression and is created according to the special test case file high-frequency vocabularies. The special test case file high-frequency vocabulary refers to vocabulary with the occurrence frequency in the special test case file larger than a second threshold value, and the second threshold value can be set according to actual needs.
S2, comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list respectively to evaluate the integrity of the universal case and the integrity of the special case.
In the embodiment, the integrity of the universal use case can be evaluated according to the number of the vocabularies in the requirement vocabulary list in the universal test case vocabulary list. The completeness of the special case can be evaluated according to the number of vocabularies in the requirement vocabulary list appearing in the special test case vocabulary list. The vocabulary in the universal test case vocabulary list or the special test case vocabulary list is the same as the side vocabulary in the requirement vocabulary list or has the same meaning, namely the vocabulary in the requirement vocabulary list appears in the universal test case vocabulary list or the special test case vocabulary list. For example, whether the test case reflects the content of the requirement word "authority" can be evaluated for completeness by whether the use case includes words such as "administrator", "anonymous user", and the like.
Specifically, the method comprises the following steps:
s21, evaluating the integrity of the universal case according to the occurrence rate of the high-frequency vocabulary of the requirement file in the vocabulary list of the universal test case;
specifically, the universal test case vocabulary list is subjected to traversal scanning aiming at the high-frequency vocabulary of the specified requirement file. The scan here may be a full match scan or a partial match scan. Complete matching refers to listing the condition completely identical with the high-frequency vocabulary of the requirement file as the scanning result, and partial matching refers to listing the condition identical with the high-frequency vocabulary of the requirement file as the scanning result. Further, for the case of partial matching, the matching degree of the vocabulary may be determined first, a threshold value of the matching degree may be set, and the vocabulary with the matching degree higher than or equal to the threshold value may be listed in the scanning result. The determination of the matching degree may be obtained based on semantic analysis, or may be realized by text comparison.
And determining the occurrence rate of the high-frequency vocabulary of the requirement file in the universal test case vocabulary list according to the scanning result. And the occurrence rate of the high-frequency vocabulary of the requirement file in the universal test case vocabulary list is the evaluation result of the integrity of the universal case.
And S22, evaluating the integrity of the special use case according to the occurrence rate of the high-frequency vocabulary of the requirement file in the special use case vocabulary list.
Step S22 differs from step S21 in that the general use case vocabulary list is replaced with a special use case vocabulary list. The rest is the same and is not described in detail.
Fig. 2 shows another test case integrity evaluation method provided by the present invention, which can further improve the integrity of a test case on the basis of evaluating the integrity of the test case, as shown in fig. 2, the method includes:
s201, respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list;
s202, comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list respectively to evaluate the integrity of the universal case and the integrity of the special case.
Steps S201 and S202 are the same as steps S1 and S2, respectively, and are not described herein again.
S203, prompting a first vocabulary which is not in the universal test case vocabulary list and the special case vocabulary list in the requirement vocabulary list, and recommending a test case containing the first vocabulary.
Specifically, a first vocabulary which is not present in the universal test case vocabulary list and the special use case vocabulary list at the same time in the requirement vocabulary list can be prompted in an enumeration manner. And displaying a plurality of test cases containing the first vocabulary for test selection.
Those skilled in the art will appreciate that the modules in the above-described embodiments of the apparatus may be distributed as described in the apparatus, and may be correspondingly modified and distributed in one or more apparatuses other than the above-described embodiments. The modules of the above embodiments may be combined into one module, or further split into multiple sub-modules.
In the following, embodiments of the electronic device of the present invention are described, which may be regarded as an implementation in physical form for the above-described embodiments of the method and apparatus of the present invention. Details described in the embodiments of the electronic device of the invention should be considered supplementary to the embodiments of the method or apparatus described above; for details which are not disclosed in embodiments of the electronic device of the invention, reference may be made to the above-described embodiments of the method or the apparatus.
Fig. 3 is a schematic diagram of an architecture of a test case integrity evaluation apparatus according to the present invention, as shown in fig. 3, the apparatus includes:
the creating module is used for respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list;
and the determining module is used for respectively comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list to evaluate the integrity of the universal case and the integrity of the special case.
And the prompting recommending module is used for prompting a first vocabulary which does not appear in the universal test case vocabulary list and the special case vocabulary list in the requirement vocabulary list and recommending a test case containing the first vocabulary.
In one embodiment, the creating module includes:
the first creating module is used for counting high-frequency words of the demand files through regular expressions and creating a demand word list according to the high-frequency words of the demand files.
And the second creating module is used for setting the general test case keywords and creating a general case vocabulary list according to the general test case keywords.
And the third creating module is used for counting the high-frequency vocabulary of the special test case file through the regular expression and creating a special case vocabulary list according to the high-frequency vocabulary of the special test case file.
In one embodiment, the determining module comprises:
the first determining module is used for evaluating the integrity of the universal case according to the occurrence rate of the high-frequency vocabulary of the requirement file in the universal test case vocabulary list;
and the second determining module is used for evaluating the integrity of the special use case according to the occurrence rate of the high-frequency vocabulary of the requirement file in the special use case vocabulary list.
Fig. 4 is a block diagram of an exemplary embodiment of an electronic device according to the present invention. The electronic device shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 4, the electronic device 400 of the exemplary embodiment is represented in the form of a general-purpose data processing device. The components of electronic device 400 may include, but are not limited to: at least one processing unit 410, at least one memory unit 420, a bus 430 that connects the various system components (including the memory unit 420 and the processing unit 410), a display unit 440, and the like.
The storage unit 420 stores a computer-readable program, which may be a code of a source program or a read-only program. The program may be executed by the processing unit 410 such that the processing unit 410 performs the steps of various embodiments of the present invention. For example, the processing unit 410 may perform the steps as shown in fig. 1.
The storage unit 420 may include readable media in the form of volatile storage units, such as a random access memory unit (RAM)4201 and/or a cache memory unit 4202, and may further include a read only memory unit (ROM) 4203. The storage unit 420 may also include a program/utility 4204 having a set (at least one) of program modules 4205, such program modules 4205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The electronic device 400 may also communicate with one or more external devices 300 (e.g., keyboard, display, network device, bluetooth device, etc.), enable a user to interact with the electronic device 400 via the external devices 300, and/or enable the electronic device 400 to communicate with one or more other data processing devices (e.g., router, modem, etc.). Such communication may occur via input/output (I/O) interfaces 450, and may also occur via a network adapter 460 with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network such as the Internet). The network adapter 460 may communicate with other modules of the electronic device 400 via the bus 430. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in the electronic device 400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
FIG. 5 is a schematic diagram of one computer-readable medium embodiment of the present invention. As shown in fig. 5, the computer program may be stored on one or more computer readable media. The computer readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. The computer program, when executed by one or more data processing devices, enables the computer-readable medium to implement the above-described method of the invention, namely: respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list; and comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list respectively to evaluate the integrity of the universal case and the integrity of the special case.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments of the present invention described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiment of the present invention can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to make a data processing device (which can be a personal computer, a server, or a network device, etc.) execute the above-mentioned method according to the present invention.
The computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
In summary, the present invention can be implemented as a method, an apparatus, an electronic device, or a computer-readable medium executing a computer program. Some or all of the functions of the present invention may be implemented in practice using a general purpose data processing device such as a microprocessor or a Digital Signal Processor (DSP).
While the foregoing embodiments have described the objects, aspects and advantages of the present invention in further detail, it should be understood that the present invention is not inherently related to any particular computer, virtual machine or electronic device, and various general-purpose machines may be used to implement the present invention. The invention is not to be considered as limited to the specific embodiments thereof, but is to be understood as being modified in all respects, all changes and equivalents that come within the spirit and scope of the invention.
Claims (9)
1. A test case integrity evaluation method is characterized by comprising the following steps:
respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list;
and comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list respectively to evaluate the integrity of the universal case and the integrity of the special case.
2. The method of claim 1, wherein creating the list of requirement words comprises:
counting high-frequency words of the demand files through regular expressions, and creating a demand word list according to the high-frequency words of the demand files.
3. The method according to any of claims 1-2, wherein the creating a universal use case vocabulary list comprises:
setting a general test case keyword, and creating a general case vocabulary list according to the general test case keyword.
4. The method according to any of claims 1-3, wherein the creating a specialized use case vocabulary list comprises:
and counting special test case file high-frequency words through a regular expression, and creating a special case word list according to the special test case file high-frequency words.
5. The method according to any one of claims 1-4, wherein the comparing the universal test case vocabulary list and the special use case vocabulary list with the requirement vocabulary list to evaluate the integrity of the universal use case and the integrity of the special use case comprises:
evaluating the integrity of the universal case according to the occurrence rate of the high-frequency vocabulary of the requirement file in the universal test case vocabulary list;
and evaluating the integrity of the special use case according to the occurrence rate of the high-frequency vocabulary of the requirement file in the special use case vocabulary list.
6. The method according to any one of claims 1-5, further comprising:
and prompting a first vocabulary which does not appear in the universal test case vocabulary list and the special use case vocabulary list in the requirement vocabulary list, and recommending a test case containing the first vocabulary.
7. A test case integrity evaluation apparatus, the apparatus comprising:
the creating module is used for respectively creating a demand vocabulary list, a general use case vocabulary list and a special use case vocabulary list;
and the determining module is used for respectively comparing the universal test case vocabulary list and the special case vocabulary list with the requirement vocabulary list to evaluate the integrity of the universal case and the integrity of the special case.
8. An electronic device, comprising:
a processor; and
a memory storing computer-executable instructions that, when executed, cause the processor to perform the method of any of claims 1-6.
9. A computer readable storage medium, wherein the computer readable storage medium stores one or more programs which, when executed by a processor, implement the method of any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910881783.1A CN110806969A (en) | 2019-09-18 | 2019-09-18 | Test case integrity evaluation method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910881783.1A CN110806969A (en) | 2019-09-18 | 2019-09-18 | Test case integrity evaluation method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110806969A true CN110806969A (en) | 2020-02-18 |
Family
ID=69487576
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910881783.1A Pending CN110806969A (en) | 2019-09-18 | 2019-09-18 | Test case integrity evaluation method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110806969A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022042726A1 (en) * | 2020-08-28 | 2022-03-03 | 中兴通讯股份有限公司 | System testing method and apparatus, device, and storage medium |
| CN117313111A (en) * | 2023-11-30 | 2023-12-29 | 中汽智联技术有限公司 | Labeling and indexing method and system based on automobile information security test cases |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101192194A (en) * | 2007-01-19 | 2008-06-04 | 中兴通讯股份有限公司 | Test case design method based on test case database |
| US20100058300A1 (en) * | 2008-08-26 | 2010-03-04 | International Business Machines Corporation | Test coverage analysis method and apparatus |
| CN103246355A (en) * | 2012-02-06 | 2013-08-14 | 百度在线网络技术（北京）有限公司 | On-line input method evaluation method, system and device |
| CN103838672A (en) * | 2014-03-04 | 2014-06-04 | 中国工商银行股份有限公司 | Automated testing method and device for all-purpose financial statements |
| CN105302723A (en) * | 2015-11-06 | 2016-02-03 | 北京京东尚科信息技术有限公司 | Test case evaluation method and apparatus |
| CN107229559A (en) * | 2016-03-23 | 2017-10-03 | 阿里巴巴集团控股有限公司 | For the detection method and device of the test integrity degree of operation system |
| CN108920374A (en) * | 2018-07-11 | 2018-11-30 | 郑州云海信息技术有限公司 | A kind of method and system of express statistic demand test coverage |
| CN109871311A (en) * | 2017-12-04 | 2019-06-11 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus for recommending test case |
-
2019
- 2019-09-18 CN CN201910881783.1A patent/CN110806969A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101192194A (en) * | 2007-01-19 | 2008-06-04 | 中兴通讯股份有限公司 | Test case design method based on test case database |
| US20100058300A1 (en) * | 2008-08-26 | 2010-03-04 | International Business Machines Corporation | Test coverage analysis method and apparatus |
| CN103246355A (en) * | 2012-02-06 | 2013-08-14 | 百度在线网络技术（北京）有限公司 | On-line input method evaluation method, system and device |
| CN103838672A (en) * | 2014-03-04 | 2014-06-04 | 中国工商银行股份有限公司 | Automated testing method and device for all-purpose financial statements |
| CN105302723A (en) * | 2015-11-06 | 2016-02-03 | 北京京东尚科信息技术有限公司 | Test case evaluation method and apparatus |
| CN107229559A (en) * | 2016-03-23 | 2017-10-03 | 阿里巴巴集团控股有限公司 | For the detection method and device of the test integrity degree of operation system |
| CN109871311A (en) * | 2017-12-04 | 2019-06-11 | 北京京东尚科信息技术有限公司 | A kind of method and apparatus for recommending test case |
| CN108920374A (en) * | 2018-07-11 | 2018-11-30 | 郑州云海信息技术有限公司 | A kind of method and system of express statistic demand test coverage |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022042726A1 (en) * | 2020-08-28 | 2022-03-03 | 中兴通讯股份有限公司 | System testing method and apparatus, device, and storage medium |
| CN117313111A (en) * | 2023-11-30 | 2023-12-29 | 中汽智联技术有限公司 | Labeling and indexing method and system based on automobile information security test cases |
| CN117313111B (en) * | 2023-11-30 | 2024-04-09 | 中汽智联技术有限公司 | Labeling and indexing method and system based on automobile information security test cases |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9122540B2 (en) | Transformation of computer programs and eliminating errors | |
| US9158514B2 (en) | Method and apparatus for providing change-related information | |
| CN113032195A (en) | Chip simulation verification method, system, equipment and storage medium | |
| US9298683B2 (en) | Generation of test data using text analytics | |
| US8578311B1 (en) | Method and system for optimal diameter bounding of designs with complex feed-forward components | |
| US20110307875A1 (en) | Tracking variable information in optimized code | |
| US9626432B2 (en) | Defect record classification | |
| US9965252B2 (en) | Method and system for generating stateflow models from software requirements | |
| CN112035443B (en) | Big data execution method, system, equipment and storage medium based on Linux platform | |
| US20130290933A1 (en) | Translation verification testing | |
| CN109872230B (en) | Test method and device of financial data analysis system, medium and electronic equipment | |
| JP2012113706A (en) | Computer-implemented method, computer program, and data processing system for optimizing database query | |
| CN112100079A (en) | Test method and system based on simulation data calling and electronic equipment | |
| CN110688111A (en) | Configuration method, device, server and storage medium of business process | |
| CN110806969A (en) | Test case integrity evaluation method and device and electronic equipment | |
| CN115292058A (en) | Service scene level service topology generation method and device and electronic equipment | |
| CN109684207B (en) | Method and device for packaging operation sequence, electronic equipment and storage medium | |
| US10229223B2 (en) | Mining relevant approximate subgraphs from multigraphs | |
| CN112286802B (en) | Method and device for testing program performance and electronic equipment | |
| US9275358B1 (en) | System, method, and computer program for automatically creating and submitting defect information associated with defects identified during a software development lifecycle to a defect tracking system | |
| CN114090514A (en) | Log retrieval method and device for distributed system | |
| GB2603252A (en) | Data quality-based confidence computations for kpis derived from time-series data | |
| CN110795338B (en) | Front-end and back-end interaction-based automatic testing method and device and electronic equipment | |
| CN109062797B (en) | Method and device for generating information | |
| CN113127284A (en) | Server pressure testing method and system, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200218 |