CN111177000A - Test method and test system based on big data test case - Google Patents
Test method and test system based on big data test case Download PDFInfo
- Publication number
- CN111177000A CN111177000A CN201911362953.1A CN201911362953A CN111177000A CN 111177000 A CN111177000 A CN 111177000A CN 201911362953 A CN201911362953 A CN 201911362953A CN 111177000 A CN111177000 A CN 111177000A
- Authority
- CN
- China
- Prior art keywords
- test
- software
- tested
- test case
- big data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the invention discloses a test method based on big data test cases, which comprises the following steps: adopting a pre-established test case model to perform modeling conversion on the demand case set to generate a modeled test case set, wherein the generated modeled test case set comprises a test case identifier, an input, an expected output and a passing criterion; and automatically testing the software to be tested by adopting a test program, wherein the test program uses a modeled test case set as a test condition in the test process. The embodiment of the invention solves the problems of diversified and complicated user requirements, automatic test of big data test cases and information acquisition of error results by software testers; manpower resources are reduced, and software testing efficiency is improved.
Description
Technical Field
The present application relates to the field of software testing technologies, and in particular, to a test method and a test system based on big data test cases.
Background
From the intellectualization of household appliances in daily life to the high-tech field, even other fields all relate to the development of software, and corresponding systems, products and software can be generated as long as users, markets and demands exist.
The software test is generated along with the generation of software, the early user requirement is single, the complexity is low, and after the software is developed and debugged, the problems are few or the main functions of the product are not greatly influenced. However, with the great development of software and IT industries and the diversification and complication of user requirements, the functional requirements for realizing large-scale and high-complexity software are more and more strict, and software testing is not equal to 'debugging' of software developers any more. The establishment of a software testing system and the research of a software testing method directly improve the quality of software/products.
The complexity of the input, output and logic algorithm of the software is increased along with the increase and increase of the software requirement, and for software testers, the full coverage of the required functions of the complex system software is time-consuming, brain-wasting and easy to make mistakes; and the software problem with complex logic algorithm cannot be quickly and accurately positioned.
Disclosure of Invention
In order to solve the above technical problems, embodiments of the present invention provide a test method and a test system based on a big data test case, so as to solve the problems of diversified and complicated user requirements, automated testing of the big data test case, and information acquisition of a wrong result by a software tester; manpower resources are reduced, and software testing efficiency is improved.
The embodiment of the invention provides a test method based on big data test cases, which comprises the following steps:
adopting a pre-established test case model to perform modeling conversion on the demand case set to generate a modeled test case set, wherein the generated modeled test case set comprises a test case identifier, an input, an expected output and a passing criterion;
and automatically testing the software to be tested by adopting a test program, wherein the test program uses the modeled test case set as a test condition in the test process.
Optionally, in the test method based on the big data test case, the automatically testing the software to be tested by using the test program includes:
performing interface conversion on the input of the test;
calling software to be tested, and testing the test software to obtain actual test output;
carrying out interface conversion on the actual output of the test;
the expected output is compared to the converted actual output.
Optionally, in the test method based on the big data test case as described above, the interface converting the input of the test includes:
and converting the input in the modeling test case set into the external input of the software to be tested.
Optionally, in the test method based on the big data test case as described above, the interface converting the actual output of the test includes:
and converting the actual output of the software to be tested into actual output which can be compared with the expected output in the modeling test case set.
Optionally, in the test method based on big data test cases as described above, the comparing the expected output with the converted actual output includes:
comparing the expected output with the converted actual output according to a passing criterion;
when the comparison result meets the passing criterion, the test is finished;
when the comparison result does not accord with the passing criterion, extracting inconsistent test information in the comparison result, wherein the extracted information comprises: test identification, test input, expected output, actual output, passing criterion and test result corresponding to the inconsistent test information.
Optionally, in the test method based on the big data test case as described above, the method further includes:
according to the functional requirements of the software to be tested, a test case generation tool is adopted to generate a requirement case set, and the requirement case set comprises requirement input and requirement output.
Optionally, in the test method based on the big data test case as described above, the method further includes:
and generating a test program for testing the software to be tested according to the software to be tested and the modeled test case set.
The embodiment of the invention provides a test system based on big data test cases, which comprises: the device to be tested comprises a computer for running software to be tested, and a software integration development tool and a test program are configured in the test device;
the software integration development tool is configured to compile and connect software to be tested and then download the software to be tested into a computer of equipment to be tested;
the device to be tested is further configured to import a modeled test case set, and automatically test software to be tested by adopting a test program, wherein the test program uses the modeled test case set as a test condition in a test process.
According to the test method and the test system based on the big data test case, provided by the embodiment of the invention, aiming at diversified and complicated user requirements, the requirement test case generation tool is used and the test case model is combined, the big data test case is imported into a software test environment, the software to be tested is automatically tested, the test cases with inconsistent software test results are subjected to information extraction, and the problem pertinence analysis and fault positioning of software test personnel are facilitated. The embodiment of the invention has the following advantages:
a) generating a big data test case by combining the existing resource-demand test case generation tool;
b) standardizing test identification, input, expected output, passing criteria requirements;
c) automatic testing can be realized;
d) extracting information of error results of the software test;
e) the method has strong universality, and can be applied to software tests with diversified systems and high complexity in other fields;
f) the workload of testers is reduced, the testing efficiency and the accuracy are increased, and the quality of software/products is improved.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention.
Fig. 1 is a flowchart of a test method based on big data test cases according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a big data test case based test method shown in FIG. 1;
FIG. 3 is a flow chart comparing expected output and converted actual output in an embodiment of the present invention;
FIG. 4 is a diagram illustrating a test case set transformation diagram according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The following specific embodiments of the present invention may be combined, and the same or similar concepts or processes may not be described in detail in some embodiments.
Fig. 1 is a flowchart of a testing method based on big data test cases according to an embodiment of the present invention, and fig. 2 is a schematic diagram of the testing method based on big data test cases shown in fig. 1. The test method based on the big data test case provided by the embodiment can comprise the following steps:
s110, performing modeling conversion on the demand case set by adopting a pre-established test case model to generate a modeled test case set, wherein the generated modeled test case set comprises test case identification, input, expected output and passing criteria;
and S120, automatically testing the software to be tested by adopting a test program, wherein the test program uses the modeled test case set as a test condition in the test process.
Optionally, in the embodiment of the present invention, an implementation manner of performing an automated test on software to be tested by using a test program may include:
a, performing interface conversion on the input of a test; the specific implementation manner of this step may be: and converting the input in the modeling test case set into the external input of the software to be tested.
b, calling the software to be tested, and testing the test software to obtain the actual output of the test;
c, performing interface conversion on the actual output of the test; the specific implementation manner of this step may be: and converting the actual output of the software to be tested into actual output which can be compared with the expected output in the modeling test case set.
d, comparing the expected output with the converted actual output.
The specific implementation manner of the step d may include:
d1, comparing the expected output with the converted actual output according to the passing criterion;
d2, when the comparison result meets the passing criterion, completing the test;
d3, when the comparison result does not meet the passing criterion, extracting the inconsistent test information in the comparison result, wherein the extracted information comprises: test identification, test input, expected output, actual output, passing criterion and test result corresponding to the inconsistent test information. Fig. 3 is a flow chart illustrating comparison between the expected output and the converted actual output according to an embodiment of the present invention.
Optionally, as shown in fig. 1, the method provided in the embodiment of the present invention may further include:
and S130, generating a test program for testing the software to be tested according to the software to be tested and the modeled test case set.
Based on the big data test case-based test method provided by the embodiment of the invention, the embodiment of the invention also provides a big data test case-based test system, and as shown in reference to fig. 2, the test system comprises: the device to be tested comprises a computer for running software to be tested, and a software integration development tool and a test program are configured in the test device;
the software integration development tool is configured to compile and connect the software to be tested and then download the software to be tested into a computer of the equipment to be tested;
the device to be tested is also configured to import a modeled test case set, and automatically test the software to be tested by adopting a test program, wherein the test program uses the modeled test case set as a test condition in the test process.
The embodiment of the invention provides an automatic test method based on a big data test case. Aiming at diversified and complicated user requirements, a requirement test case generation tool is used and a test case model is combined, a big data test case is imported into a software test environment, automatic test is carried out on software to be tested, information extraction is carried out on the test cases with inconsistent software test results, and the problem pertinence analysis and fault location of software testers are facilitated. Meanwhile, the human resources are reduced, the software testing efficiency is improved, and the quality of software/products is ensured.
The invention provides an automatic test method based on big data test cases for the first time, which has the following characteristics:
a) based on diversified and complicated user requirements;
b) effectively combining the existing resource-demand test case generation tool to generate a big data test case;
c) establishing a test case model, and standardizing test identification, input, expected output and passing criterion requirements;
d) establishing a software test program to realize automatic test;
e) information extraction is carried out on the error result of the software test, so that the targeted analysis and fault location of software problems are facilitated;
f) manpower resources are reduced, software testing efficiency is improved, and the quality of software/products is ensured;
g) the method has strong universality and can be applied to software tests with diversified systems and high complexity in other fields.
The following describes in detail an implementation of the test method based on big data test cases according to an embodiment of the present invention with a specific implementation example. A schematic diagram of an automated testing method based on big data test cases is shown in fig. 2, and the specific implementation manner is as follows:
step 1, compiling a requirement expression, namely the design of a software test case, through a case generation tool T-Vec, entering a T-Vec VGS module through a conversion model, compiling a condition file which automatically generates a software function requirement, and acquiring and exporting a test case set of big data; software testers can manually modify, add and delete the test cases in the map according to requirements to form a software test case set to be tested;
and 2, converting the final version software test case set formed in the step 1 according to a case model, converting the final version software test case set into a case standard format, and converting the input, output and passing criteria of each test case. Fig. 4 is a schematic diagram of a test case set conversion diagram in the embodiment of the present invention, which illustrates the test case conversion manner in step 1 and step 2;
and 3, automatically testing the software test case set generated in the step 2 by establishing a software test program, wherein the method comprises the following steps: interface conversion of test input, calling of software to be tested, interface conversion of test output, comparison of expected output and actual output, and extraction of information with inconsistent test results, wherein the pseudo code content of a software test program is as follows:
step 4, the interface conversion of the test input in the step 3 is to convert the input of the software test case set into the external input of the system software; the interface conversion of the test output is to convert the output of the system software into actual data which can be compared with the expected output in the software test case set; the output comparison function is to compare the actual operation result of the system software with the expected output in the software test case set, and if no difference exists, the test is passed; if the differences exist, extracting the information of the test cases with inconsistent results, wherein the information extraction comprises the following steps: test identification, test input, expected output, actual output, pass criteria, and test results. FIG. 3 is a flow chart of the output compare function;
step 5, introducing a modeling test case set into the built software test environment, wherein the built software test environment is provided with application software for software testing, such as a software integration development environment, a software test program and the like; by automatically testing the tested system software, software testers can directly observe and analyze test cases with inconsistent test results to perform fault location, so that the human resources are reduced, and the software testing efficiency is improved.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (8)
1. A test method based on big data test cases is characterized by comprising the following steps:
adopting a pre-established test case model to perform modeling conversion on the demand case set to generate a modeled test case set, wherein the generated modeled test case set comprises a test case identifier, an input, an expected output and a passing criterion;
and automatically testing the software to be tested by adopting a test program, wherein the test program uses the modeled test case set as a test condition in the test process.
2. The big data test case-based test method according to claim 1, wherein the automated testing of the software to be tested by using the test program comprises:
performing interface conversion on the input of the test;
calling software to be tested, and testing the test software to obtain actual test output;
carrying out interface conversion on the actual output of the test;
the expected output is compared to the converted actual output.
3. The big data test case based test method according to claim 2, wherein the interface conversion of the test input comprises:
and converting the input in the modeling test case set into the external input of the software to be tested.
4. The big data test case-based test method according to claim 2, wherein the interface converting the actual output of the test comprises:
and converting the actual output of the software to be tested into actual output which can be compared with the expected output in the modeling test case set.
5. The big data test case based test method according to claim 2, wherein the comparing the expected output with the converted actual output comprises:
comparing the expected output with the converted actual output according to a passing criterion;
when the comparison result meets the passing criterion, the test is finished;
when the comparison result does not accord with the passing criterion, extracting inconsistent test information in the comparison result, wherein the extracted information comprises: test identification, test input, expected output, actual output, passing criterion and test result corresponding to the inconsistent test information.
6. The big data test case based test method according to any one of claims 1 to 5, further comprising:
according to the functional requirements of the software to be tested, a test case generation tool is adopted to generate a requirement case set, and the requirement case set comprises requirement input and requirement output.
7. The big data test case based test method according to any one of claims 1 to 5, further comprising:
and generating a test program for testing the software to be tested according to the software to be tested and the modeled test case set.
8. A big data test case based test system is characterized by comprising: the device to be tested comprises a computer for running software to be tested, and a software integration development tool and a test program are configured in the test device;
the software integration development tool is configured to compile and connect software to be tested and then download the software to be tested into a computer of equipment to be tested;
the device to be tested is further configured to import a modeled test case set, and automatically test software to be tested by adopting a test program, wherein the test program uses the modeled test case set as a test condition in a test process.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911362953.1A CN111177000A (en) | 2019-12-25 | 2019-12-25 | Test method and test system based on big data test case |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911362953.1A CN111177000A (en) | 2019-12-25 | 2019-12-25 | Test method and test system based on big data test case |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111177000A true CN111177000A (en) | 2020-05-19 |
Family
ID=70657475
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911362953.1A Withdrawn CN111177000A (en) | 2019-12-25 | 2019-12-25 | Test method and test system based on big data test case |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111177000A (en) |
-
2019
- 2019-12-25 CN CN201911362953.1A patent/CN111177000A/en not_active Withdrawn
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10108536B2 (en) | Integrated automated test case generation for safety-critical software | |
| CN111176995B (en) | Test method and test system based on big data test case | |
| CN111459821A (en) | Software automation unit testing method based on TestNG | |
| CN102495802B (en) | Method and device for testing software system, and computer system | |
| CN109977012B (en) | Joint debugging test method, device, equipment and computer readable storage medium of system | |
| CN111176984A (en) | Signal-oriented automatic test implementation method | |
| CN117421217B (en) | Automatic software function test method, system, terminal and medium | |
| CN108763064A (en) | A kind of code tester generation method and device based on black box function and machine learning | |
| CN109783063B (en) | Signal-oriented automatic test system self-checking program development method and device | |
| CN105760300B (en) | A kind of automated testing method and test macro of STK/UTK business | |
| CN113590454A (en) | Test method, test device, computer equipment and storage medium | |
| CN107622017B (en) | Analysis method for universal automation software test | |
| CN111124892B (en) | Automatic testing method and system based on command line | |
| CN114238081A (en) | Method and system suitable for small satellite batch test | |
| CN105677569A (en) | Automatic Android testing tool based on event processor and testing method | |
| CN110286882B (en) | Foreground system design and verification method based on model detection | |
| CN116090376B (en) | Chip integrated verification component development method and device and computer equipment | |
| CN111506305A (en) | Tool kit generation method and device, computer equipment and readable storage medium | |
| CN111177000A (en) | Test method and test system based on big data test case | |
| Mehlhop et al. | Model-aware simulation of IEC 61499 designs | |
| CN115033434A (en) | Kernel performance theoretical value calculation method and device and storage medium | |
| CN115237759A (en) | Method and system for automatic API performance test | |
| CN112214201A (en) | Method, device, equipment and storage medium for authenticating bottom interface of vehicle machine system | |
| CN109710809B (en) | Automatic SCD file virtual terminal connection method based on expert database | |
| CN112231222A (en) | Object-oriented communication protocol automated testing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200519 |
|
| WW01 | Invention patent application withdrawn after publication |