CN111625471A - Execution processing and exception positioning method, device, equipment and medium of test case - Google Patents
Execution processing and exception positioning method, device, equipment and medium of test case Download PDFInfo
- Publication number
- CN111625471A CN111625471A CN202010538121.7A CN202010538121A CN111625471A CN 111625471 A CN111625471 A CN 111625471A CN 202010538121 A CN202010538121 A CN 202010538121A CN 111625471 A CN111625471 A CN 111625471A
- Authority
- CN
- China
- Prior art keywords
- test
- case
- target
- functional module
- test case
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
- Test And Diagnosis Of Digital Computers (AREA)
Abstract
The invention discloses a method, a device, equipment and a medium for executing and processing a test case and positioning an exception, wherein the executing and processing method comprises the following steps: inputting the test case into a target test channel of a system to be tested, wherein the target test channel comprises a plurality of functional modules which are arranged in sequence; the technical scheme of the embodiment of the invention provides a new mode for automatically naming the test cases according to the test channels through which the test cases pass, and increases the effective information amount included in the test case naming so as to improve the positioning efficiency of test abnormity.
Description
Technical Field
The embodiment of the invention relates to data processing, in particular to a method, a device, equipment and a medium for executing and processing test cases and positioning exceptions.
Background
The test case is used for testing a specific software product, and the software product can be a system which needs to test the availability and stability of a plurality of internal functional modules by the test case before the software product is put into use or is on-line for service, namely a system to be tested. Because the functional modules in different systems to be tested are different, before testing the system, developers need to design test cases meeting the test requirements of the system to be tested according to actual experience and configuration parameters of the functional modules in the system to be tested, so that the functional modules to be tested are prevented from being missed.
After the test cases are input into the system to be tested, the functional modules in the processing channels sequentially process the test cases according to a set sequence, and finally, an execution result is output. When the output execution result is abnormal, the developer needs to test each functional module in the processing channel.
In the prior art, developers need to trace back each function module for processing a test case according to an execution result of the test case by a processing channel, and manually determine and locate an abnormal function module. The process of positioning the abnormal functional module has high labor cost, long time consumption and poor test efficiency.
Disclosure of Invention
The embodiment of the invention provides a method, a device, equipment and a medium for executing and processing a test case and positioning an exception, and provides a new mode for naming the test case, so that the test exception can be quickly positioned through the naming mode.
In a first aspect, an embodiment of the present invention provides a method for executing and processing a test case, where the method includes:
inputting the test case into a target test channel of a system to be tested, wherein the target test channel comprises a plurality of functional modules which are arranged in sequence;
and performing operation processing on the input test case through each functional module in the target test channel in sequence, and adding operation description information of the functional module in the case name of the test case.
In a second aspect, an embodiment of the present invention provides a method for locating a test exception, where the method includes:
respectively inputting each test case to at least one target test channel of a system to be tested, wherein the target test channel comprises a plurality of function modules to be tested which are arranged in sequence;
performing operation processing on the input test case through each functional module in each target test channel in sequence, and adding operation description information of each functional module in the matched target test channel in the case name of each test case;
and acquiring the test result of each test case output by each target test channel, and positioning the abnormal functional module according to the case name of each test case with the abnormal test result.
In a third aspect, an embodiment of the present invention further provides a device for executing and processing a test case, where the device includes:
the test case input module is used for inputting the test cases to a target test channel of the system to be tested, and the target test channel comprises a plurality of functional modules which are arranged in sequence;
and the case name adding module is used for sequentially carrying out operation processing on the input test case through each functional module in the target test channel and adding the operation description information of the functional module in the case name of the test case.
In a fourth aspect, an embodiment of the present invention further provides a positioning apparatus for testing an anomaly, where the apparatus includes:
the test case input module is used for respectively inputting each test case to at least one target test channel of the system to be tested, and the target test channel comprises a plurality of function modules to be tested which are arranged in sequence;
the case name adding module is used for carrying out operation processing on the input test cases through each functional module sequence in each target test channel and adding operation description information of each functional module in the matched target test channel in the case name of each test case;
and the abnormity positioning module is used for acquiring the test result of each test case output by each target test channel and positioning the abnormal functional module according to the case name of each test case with the abnormal test result.
In a fifth aspect, an embodiment of the present invention further provides a computer device, where the computer device includes:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors execute the method for executing and processing the test case provided by any embodiment of the present invention, or execute the method for locating the test exception provided by any embodiment of the present invention.
In a sixth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where the storage medium stores a computer program, and the computer program, when executed by a processor, implements a method for executing and processing a test case provided in any embodiment of the present invention, or implements a method for locating a test exception provided in any embodiment of the present invention.
According to the technical scheme of the embodiment of the invention, the test cases are input into the target test channel of the system to be tested, the input test cases are sequentially operated and processed through each functional module in the target test channel, and the operation description information of the functional modules is added in the case names of the test cases, so that a new mode for automatically naming the test cases according to the test channels through which the test cases pass is provided, the effective information content included in the test case naming is increased, the common problem of each abnormal test case can be rapidly determined by analyzing the names of each test case with abnormal test, the functional modules with abnormal test can be automatically positioned, the labor cost consumption is reduced to the greatest extent, and the positioning efficiency of the abnormal test is greatly improved.
Drawings
FIG. 1 is a flowchart of a method for processing test cases according to a first embodiment of the present invention;
FIG. 2 is a flowchart of a test case execution processing method according to a second embodiment of the present invention;
FIG. 3 is a flowchart of a method for processing test cases according to a third embodiment of the present invention;
FIG. 4 is a flowchart of a method for locating a test exception according to a fourth embodiment of the present invention;
FIG. 5 is a block diagram of a device for processing test cases according to a fifth embodiment of the present invention;
FIG. 6 is a block diagram of a positioning apparatus for testing anomalies according to a sixth embodiment of the present invention;
fig. 7 is a schematic structural diagram of a computer device in a seventh embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example one
Fig. 1 is a flowchart of a method for executing and processing a test case according to an embodiment of the present invention, where this embodiment is applicable to a case where, when a system under test (typically, VPSS) is tested using a test case, the test case is automatically named according to a functional module that processes the test case, and the method may be executed by a device for executing and processing the test case, where the device may be implemented by software and/or hardware, and may be generally integrated in a computer device, and specifically includes the following steps:
In this embodiment, the system under test specifically refers to a system that needs to use a test case to perform usability and stability tests on a function that is expected to be provided by the system before the system is put into use or brought online for service. The system to be tested comprises a plurality of functional modules, and each functional module is used for performing set processing operation on a test case. The system to be tested can be preset to be one or more test channels, and each test channel comprises a plurality of functional modules arranged according to a set sequence. That is, a test channel in the system under test uniquely corresponds to a plurality of sequentially executed processing operations.
Optionally, the test case may be set in a self-defined manner according to a function of the system to be tested, for example, the test case may be a test image or a calculation formula, and the like.
Optionally, the System to be tested may be a Video processing Sub-System (VPSS), and the VPSS is mainly used for performing pixel-level processing on the image before performing deep learning inference operation on the image. The VPSS supports uniform preprocessing, such as flipping, scaling, etc., of an input image, and finally outputs the processed image. The VPSS comprises a plurality of functional modules, such as an intercepting module, a turning module, a scaling module, a filling module, a mirror image module, a color space conversion module and the like. The VPSS sequences the functional modules to form various processing channels. To speed up the processing of images, VPSS sets an efficient processing channel. Each functional module in the efficient processing channel sequentially processes the images according to a set sequence, and the running speed is higher than that of the freely specified sequence. The output image of the VPSS is determined by the input image and each functional module in the processing channel, and when the output image is abnormal, a tester needs to test each functional module in the processing channel.
A plurality of functional modules (such as an interception module, a turning module and the like) in the VPSS generate various processing channels after different sequencing. The processing channel in which the plurality of functional modules currently required to be tested are located may be used as the target testing channel. The test case is used for testing each functional module included in the target test channel.
Accordingly, before the test case is input into the target test channel of the system to be tested, the target test channel may be set in the system to be tested. Specifically, each functional module may be packaged in advance in the form of an interface, and the target test channel may be set in a manner of interface calling. Or, after all the functional modules included in the system to be tested are combined in advance according to a preset sequence, the target test channel may be set in a manner of controlling each functional module to operate or not to operate by sending an on or off signal to each functional module.
Optionally, before the step of inputting the test case into the target test channel of the system under test, the method may further include: sending an enabling control signal matched with a target test channel to each functional module in a system to be tested so as to form the target test channel in the system to be tested;
wherein the enable control signal comprises: an on signal and an off signal; the system to be tested arranges all the functional modules according to a set sequence, the functional module receiving the opening signal can operate and process the input test case, and the functional module receiving the closing signal can give up operating and processing the input test case.
Before the system to be tested processes the input data, a preset complete channel exists, that is, all the functional modules are arranged in a set sequence. The preset complete channel comprises all the functional modules. To meet the actual testing requirements (e.g., to provide testing processing speed), multiple efficient testing channels may be provided by shutting down one or more functional modules in one or more defined locations in the full channel. And the processing operation of the test case is executed in sequence by a plurality of functional modules included in the test channel.
And 120, performing operation processing on the input test case through each functional module sequence in the target test channel, and adding operation description information of the functional module in a case name of the test case.
In this embodiment, in order to quickly determine the common problem of each abnormal test case, the inventor creatively provides a new way of automatically naming the test case according to the test channel through which the test case passes, and accordingly, after the test case is processed by all the function modules included in the target test channel, the name of the case finally output by the test case is visually observed, which operation processing of which function modules the test case specifically passes can be directly determined, and then when the test case is abnormal, the abnormal function module can be directly analyzed and positioned according to the name of the case.
Specifically, the operation description information may include: identification information of the functional module, information of an operation performed by the functional module (for example, an operation type), or information of a key parameter used when the functional module performs the operation; or, in order to ensure privacy of this test system, the operation description information may further include identification information for describing each functional module, information of an operation performed by the functional module, or an operation code of information such as a key parameter used when the functional module performs the operation, and the like, which is not limited in this embodiment.
Optionally, after the test case operation processing is completed by each functional module of the target test channel, the operation description information is correspondingly added by each functional module; or, considering the one-to-one correspondence relationship between the target test channel and the functional modules, after all the functional modules in the target test channel complete the processing of the test case, the operation description information of each functional module may be added at one time.
In an optional implementation manner of the embodiment of the present invention, performing operation processing on the input test case through each functional module in the target test channel in sequence, and adding operation description information of the functional module in a case name of the test case may include:
after the test cases are operated and processed through the functional modules, the operation description information of the functional modules is added to the case names of the currently processed test cases.
The operation description information may include at least one information item, where the information item is: a module operation type or a module processing parameter or a module operation result. The module operation type is the specific processing function of the functional module, such as filling, intercepting, scaling and the like. The module processing parameters are corresponding algorithm parameters when the functional module processes the test case. And the module operation result is the result of the functional module after processing the test case, if the test case is a picture, the functional module is an intercepting module, and the corresponding module operation result is an intercepted image.
In this embodiment, after each functional module in the target test channel performs operation processing on a test case, operation description information of the functional module is added in a case name of the currently processed test case, for example, assuming that a first functional module in the target test channel is an inversion module, after the functional module completes the inversion processing on the test case, the functional module adds operation description information of "inversion, inversion parameters" in the name of the test case; the second functional module is a scaling module, and after the functional module finishes scaling processing on the test case, the functional module adds operation description information of scaling and scaling parameters in the name of the test case.
Optionally, after performing operation processing on the input test case through each functional module in the target test channel in sequence, and adding the operation description information of the functional module in the case name of the test case, the method may further include: and acquiring a test result of the test case output by the target test channel, and storing the test result and the case name in an associated manner.
In this step, the test result, the case name and the mapping relationship between the test result and the case name are stored, so that when the test result is abnormal, the corresponding case name can be quickly found, and the abnormal function module in the system to be tested can be positioned according to the case name or the common characteristics in the case names of a plurality of abnormal test cases.
According to the technical scheme of the embodiment of the invention, the test case is input into the target test channel of the system to be tested, the input test case is operated and processed through each functional module in the target test channel, and the operation description information of the functional module is added into the case name of the test case, so that a new mode for automatically naming the test case according to the test channel through which the test case passes is provided, and the effective information content included in the test case naming is increased.
In an optional implementation manner of the embodiment of the present invention, the test case may be a test image; correspondingly, before inputting the test case into the target test channel of the system under test, the method may further include:
determining an output image format of the test case according to the input image format of the test case and the type of the target test channel; adding the input image format and the output image format in the case name of the test case; and setting the processing parameters of each functional module matched with the target testing channel according to the type of the target testing channel, the input image format and the output image format.
In this embodiment, in order to further enrich the information content included in the case name of the test case, an input image format and an output image format may be further added to the case name, so as to more quickly and accurately locate the abnormal function module in the system under test.
The type of the target test channel may be information for uniquely determining the target test channel, and specifically may be identification information of the target test channel, and the like.
Correspondingly, the output image format can be determined jointly according to the input image format and the type of the target test channel. For example, if a functional module for realizing image format conversion is included in the target test channel, the output image format matches with the operation type of the functional module for realizing image format conversion; or, if the functional module for realizing the image format conversion is not included in the target test channel, the output image format is matched with the input image format.
Besides, the image format conversion algorithm used by the functional module for realizing the image format conversion can be correspondingly added to the case name of the test case in order to further enrich the information content contained in the case name.
Optionally, when the functional module is a color space conversion module, the corresponding algorithm parameter may be determined according to the input image format, the output image format, and the color space conversion mode (for example, converting the RGB color mode into the YUV color mode), and the algorithm parameter is added to the use case name.
Correspondingly, after the output image format is determined, the input image format and the output image format can be added in the case name of the test case, and the processing parameters of each functional module matched with the target test channel can be set according to the type of the target test channel, the input image format and the output image format.
Example two
In this embodiment, a specific implementation manner of adding operation description information of a function module to a case name of a test case is provided on the basis of the first embodiment, and the same or corresponding terms as those in the above embodiments are explained, and are not described again in this embodiment. Fig. 2 is a flowchart of a method for executing and processing a test case according to a second embodiment of the present invention, in this embodiment, the technical solution of this embodiment may be combined with one or more methods in the solutions of the foregoing embodiments, and in this embodiment, as shown in fig. 2, the method according to the second embodiment of the present invention may further include:
And step 220, performing operation processing on the input test case through each functional module in the target test channel in sequence.
And step 230, generating operation description information corresponding to the function modules through the function modules, wherein in the operation description information, adjacent information items are connected by using a first separator.
Wherein the operation description information may include at least one information item, where the information item is: a module operation type or a module processing parameter or a module operation result. In this step, after the test case is subjected to the operation processing by each functional module, the operation description information corresponding to the functional module is generated, for example, assuming that the functional module is a flip module, and after the test case is subjected to the flip processing, the operation description information corresponding to the flip functional module is generated as a "flip-flip parameter", where the first delimiter is set to "-". If the number of the roll-over parameters is multiple, the operation description information corresponding to the roll-over function module is generated to be 'roll-over-roll parameter 1-roll-over parameter 2-roll-over parameter 3', and the like.
Meanwhile, it is understood that the above-mentioned first delimiter is only an example, and other forms of first delimiter may also be used, for example, ", or", and other forms of characters may also be used, as long as it is ensured that the first delimiter is not confused with the symbol used in the case name of the test case.
Generally, after a test case is generated, the test case itself has an original case name, and taking a test image as an example of the test case, after a test image is generated, the form of the test case can be constructed as follows: the example names of the images 00001_1024 _ 768, wherein the image 00001 is the number of the test example, and 1024 _ 768 is the resolution of the test example.
Optionally, before the input test case is sequentially operated and processed through each functional module in the target test channel, an input image format and an output image format are added to the case name of the test case, for example, the input image format is RGB (red, green, and blue color mode), the output image format is YUV (color coding method), and an algorithm for converting RGB into YUV is implemented as algorithm 1. Accordingly, the case name of the test case can be firstly converted into "RGB _ image 00001_1024 × 768_ YUV _ algorithm 1" by adding the input image format, the output image format and the algorithm implementation. Furthermore, taking the first functional module in the target test channel as a flipping module, and taking the operation description information generated by the flipping module after the processing operation is finished as "flipping-flipping parameter" as an example, after the flipping module obtains the operation description information, a second delimiter (taking "_" as an example) may be generated, and the operation description information is directly added to the tail of the current case name, for example: "RGB _ image 00001_1024 _ 768_ YUV _ algorithm 1_ flip-flip parameter", which may also be added to the name of the current use case to represent the whole circulation process of the test use case in the target test channel, and output the front part of the image format, for example: "RGB _ image 00001_1024 _ 768_ flip-flip parameter _ YUV _ algorithm 1".
In this step, assuming that the name of the current use case is "RGB _ image 00001_1024 _ 768_ YUV _ algorithm 1_ flip-flip parameter", the target test channel further has a scaling module to perform operation processing on the test case, the operation description information generated by the scaling module is "scaling-scaling parameter", the second delimiter generated by the scaling module is "adding the operation description information of the scaling module in the name of the use case of the test case according to the second delimiter, and the added use case name is" RGB _ image 00001_1024 _ YUV _ algorithm 1_ flip-flip parameter, scaling-scaling parameter ".
In this embodiment, the first delimiter and the second delimiter are different symbols, and the processing parameters corresponding to different functional modules can be distinguished by the first delimiter and the second delimiter. When a certain functional module is abnormal, the corresponding processing parameter can be quickly searched, and the processing parameter is modified.
According to the technical scheme of the embodiment of the invention, the test case is input into the target test channel of the system to be tested, the input test case is sequentially operated and processed through each functional module in the target test channel, the operation description information corresponding to the functional module is generated through each functional module, the second separator is generated through each functional module, and the operation description information of each functional module is added into the case name of the test case according to the second separator, so that a new mode for automatically naming the test case according to the test channel through which the test case passes is provided, the effective information content included in the test case name is increased, and the searching speed of the operation description information of the specific functional module is improved.
EXAMPLE III
This embodiment provides another implementation way for adding operation description information of a function module in a case name of a test case based on the above embodiment, and the same or corresponding terms as those in the above embodiment are explained, and this embodiment is not described again. Fig. 3 is a flowchart of a method for executing and processing a test case according to a third embodiment of the present invention, in this embodiment, the technical solution of this embodiment may be combined with one or more methods in the solutions of the foregoing embodiments, and in this embodiment, as shown in fig. 3, the method according to the third embodiment of the present invention may further include:
And 320, operating and processing the test case through each functional module.
And step 330, after all the functional modules in the target test channel are processed, adding operation description information of each functional module in the case name of the test case.
Wherein the operation description information includes: the module matched with the functional module executes the code.
In an optional implementation manner of the embodiment of the present invention, adding operation description information of each functional module in a case name of the test case may include:
acquiring a target execution code in a code table according to the input image format of the test case and the type of the target test channel, wherein the target execution code comprises at least two sequentially formed subcodes, and the subcodes are matched with the functional modules in the target test channel; and adding the target execution code in the case name of the test case.
The type of the target test channel includes operation types of each functional module in the target test channel, such as flipping, zooming, and the like. The system to be tested stores a code table in advance, and the code table comprises the mapping relation between target execution codes and the format of the input image and the type of the target test channel. For example, assuming that only three functional modules (e.g., an intercepting module, a flipping module, and a scaling module) exist in the target test channel to perform operation processing on the test case, when the format of the input image is determined, if the sub-code (or the code identifier of the sub-code) matched with the intercepting module is a, the sub-code matched with the flipping module is b, and the sub-code matched with the scaling module is c, the target execution code corresponding to the target test channel is abc, and the target execution code is added to the case name of the test case.
In the embodiment, according to the input image format of the test case and the type of the target test channel, the target execution code is obtained in the code table, and the target execution code is added in the case name of the test case, so that the case name of the test case can be simplified, the operation type and the processing parameters of the module can be quickly obtained through the target execution code, the problem that query is difficult due to excessively long case name is avoided, and the key information in the test process can be effectively hidden in the case name.
According to the technical scheme of the embodiment of the invention, the test case is input into the target test channel of the system to be tested, the test case is operated and processed through each functional module, and after all functional modules in the target test channel are processed, the operation description information of each functional module is added in the case name of the test case, so that a new mode for automatically naming the test case according to the test channel through which the test case passes is provided, the effective information content included in the naming of the test case is increased, the operation description information corresponding to each functional module can be quickly obtained through the target execution code, the problem of difficult query caused by excessively long case name is avoided, and the key information in the test process can be effectively hidden in the case name.
Example four
Fig. 4 is a flowchart of a positioning method for testing an exception according to a fourth embodiment of the present invention, where the embodiment is applicable to a situation that an exception function module is automatically positioned according to a test result when a test case is used to test a system under test (typically, a VPSS), and the method may be executed by a positioning apparatus for testing an exception, where the positioning apparatus may be implemented by software and/or hardware, and may be generally integrated in a computer device, and specifically includes the following steps:
And step 420, performing operation processing on the input test case through each functional module sequence in each target test channel, and adding operation description information of each functional module in the matched target test channel in the case name of each test case.
And 430, acquiring the test result of each test case output by each target test channel, and positioning the abnormal functional module according to the case name of each test case with the test result as the abnormal.
In an optional implementation manner of the embodiment of the present invention, the locating, according to the case name of each test case whose test result is abnormal, the abnormal function module may include: analyzing the case names of the test cases with abnormal test results to obtain operation description information sets respectively matched with the case names; and performing classified statistics on the operation description information included in each operation description information set to obtain target operation description information with the occurrence frequency meeting a preset threshold condition, and determining the functional module matched with the target operation description information as an abnormal functional module.
After the test of each target test channel is completed by using each test case, abnormal test results output by all target test channels in the system to be tested can be obtained, case names of all the abnormal test results are analyzed according to preset identifiers, operation description information sets respectively matched with the case names are obtained, and the operation description information sets comprise operation description information corresponding to a plurality of function modules.
After operation description information sets respectively matched with a plurality of use case names are obtained, classifying and counting operation description information in the operation description information sets, taking the operation description information with the occurrence frequency larger than a preset threshold value as target operation description information, and determining a functional module matched with the target operation description information as an abnormal functional module.
For example, assuming that the preset threshold is 2, and all target test channels in the system to be tested output three abnormal test results in total, the case names of the three abnormal test results are analyzed according to the preset identifier; acquiring operation description information sets respectively matched with three case names, wherein the operation description information set matched with the first case name is 'turning-turning parameter 1, zooming-zooming parameter 1', the operation description information set matched with the second case name is 'turning-turning parameter 1, filling-filling parameter 1', and the operation description information set matched with the third case name is 'turning-turning parameter 1, intercepting-intercepting parameter 1'; the number of times of occurrence of the operation description information 'flip-flip parameter 1' is greater than a preset threshold, so that the operation description information is used as target operation description information, and the flip module is determined to be an abnormal functional module.
The technical scheme of the embodiment of the invention comprises the steps of respectively inputting each test case to at least one target test channel of a system to be tested, sequentially operating and processing the input test cases through each functional module in each target test channel, adding operation description information of each functional module in the matched target test channel in the case name of each test case, obtaining the test result of each test case output by each target test channel, and positioning the abnormal functional module according to the case name of each test case with the abnormal test result. The technical scheme of the embodiment of the invention provides a new mode for automatically naming the test cases according to the test channels through which the test cases pass, and the common problem of the various abnormal test cases can be quickly determined by analyzing the names of the various abnormal test cases, so that the functional modules with the abnormal test can be automatically positioned, the labor cost consumption is reduced to the greatest extent, and the positioning efficiency of the abnormal test is greatly improved.
EXAMPLE five
Fig. 5 is a block diagram of a device for executing and processing a test case according to a fifth embodiment of the present invention, where the device includes: a test case input module 510 and a case name addition module 520.
The test case input module 510 is configured to input a test case into a target test channel of a system to be tested, where the target test channel includes a plurality of function modules arranged in sequence; a case name adding module 520, configured to perform operation processing on the input test case through each functional module in the target test channel in sequence, and add operation description information of the functional module in the case name of the test case.
According to the technical scheme of the embodiment of the invention, the test case is input into the target test channel of the system to be tested, the input test case is operated and processed through each functional module in the target test channel, and the operation description information of the functional module is added into the case name of the test case, so that a new mode for automatically naming the test case according to the test channel through which the test case passes is provided, and the effective information content included in the test case naming is increased.
On the basis of the above embodiments, the test case input module 510 may include:
an enable control signal sending unit, configured to send an enable control signal matched with a target test channel to each functional module in the system under test, so as to form the target test channel in the system under test, where the enable control signal includes: an on signal and an off signal; the system to be tested arranges all the functional modules according to a set sequence, the functional module receiving the opening signal can operate and process the input test case, and the functional module receiving the closing signal can give up operating and processing the input test case; the test case is a test image;
the output image format determining unit is used for determining the output image format of the test case according to the input image format of the test case and the type of the target test channel;
the case name adding unit is used for adding the input image format and the output image format in the case name of the test case;
and the processing parameter setting unit is used for setting the processing parameters of each functional module matched with the target testing channel according to the type of the target testing channel, the input image format and the output image format.
The use case name adding module 520 may include:
the current functional module processing unit is used for increasing the operation description information of the functional module in the case name of the currently processed test case after the test case is operated and processed by each functional module; the operation description information comprises at least one information item, wherein the information item is: module operation type or module processing parameters or module operation results;
the test case processing unit is used for carrying out operation processing on the test cases through each functional module;
all functional module processing units are used for adding operation description information of all functional modules in the case names of the test cases after all functional modules in the target test channel are processed; the test case is a test image; the operation description information includes: the module matched with the functional module executes the code;
an operation description information generation unit configured to generate, by each function module, the operation description information corresponding to the function module, in which adjacent information items are connected using a first separator;
an operation description information adding unit, configured to generate a second delimiter through each functional module, and add operation description information of each functional module in a case name of a test case according to the second delimiter, where the second delimiter is used to separate the operation description information generated by different functional modules; the first delimiter and the second delimiter are different symbols;
a target execution code obtaining unit, configured to obtain a target execution code in a code table according to an input image format of the test case and a type of the target test channel, where the target execution code includes at least two sequentially formed sub-codes, and the sub-codes are matched with the function modules in the target test channel;
the target execution code adding unit is used for adding the target execution code in the case name of the test case;
the device for executing and processing the test case further comprises:
and the test result acquisition module is used for acquiring the test result of the test case output by the target test channel and storing the test result and the case name in an associated manner.
The test case execution processing device provided by the embodiment of the invention can execute the test case execution processing method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method.
EXAMPLE six
Fig. 6 is a structural diagram of a positioning apparatus for testing an anomaly according to a sixth embodiment of the present invention, where the apparatus includes: a test case input module 610, a case name adding module 620 and an exception locating module 630.
The test case input module 610 is configured to input each test case to at least one target test channel of the system to be tested, where the target test channel includes a plurality of function modules to be tested, which are arranged in sequence; a case name adding module 620, configured to perform operation processing on the input test case through each functional module in each target test channel in sequence, and add operation description information of each functional module in the matched target test channel in the case name of each test case; the exception positioning module 630 is configured to obtain a test result of each test case output by each target test channel, and position an abnormal functional module according to a case name of each test case whose test result is abnormal.
The technical scheme of the embodiment of the invention comprises the steps of respectively inputting each test case to at least one target test channel of a system to be tested, sequentially operating and processing the input test cases through each functional module in each target test channel, adding operation description information of each functional module in the matched target test channel in the case name of each test case, obtaining the test result of each test case output by each target test channel, and positioning the abnormal functional module according to the case name of each test case with the abnormal test result. The technical scheme of the embodiment of the invention provides a new mode for automatically naming the test cases according to the test channels through which the test cases pass, and the common problem of the various abnormal test cases can be quickly determined by analyzing the names of the various abnormal test cases, so that the functional modules with the abnormal test can be automatically positioned, the labor cost consumption is reduced to the greatest extent, and the positioning efficiency of the abnormal test is greatly improved.
On the basis of the foregoing embodiments, the anomaly locating module 630 may include:
the case name analyzing unit is used for analyzing the case names of the test cases with abnormal test results to obtain operation description information sets respectively matched with the case names;
and the abnormal function module determining unit is used for performing classified statistics on each operation description information included in each operation description information set to obtain target operation description information of which the occurrence frequency meets a preset threshold condition, and determining a function module matched with the target operation description information as an abnormal function module.
The positioning device for the test exception provided by the embodiment of the invention can execute the positioning method for the test exception provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
EXAMPLE seven
Fig. 7 is a schematic structural diagram of a computer apparatus according to a seventh embodiment of the present invention, as shown in fig. 7, the computer apparatus includes a processor 710, a memory 720, an input device 730, and an output device 740; the number of the processors 710 in the computer device may be one or more, and one processor 710 is taken as an example in fig. 7; the processor 710, the memory 720, the input device 730, and the output device 740 in the computer apparatus may be connected by a bus or other means, and the connection by the bus is exemplified in fig. 7. The memory 720 is a computer-readable storage medium, and can be used for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to a test case execution processing method in any embodiment of the present invention (for example, the test case input module 510, the case name adding module 520, and the test result obtaining module 530 in a test case execution processing apparatus). The processor 710 executes various functional applications and data processing of the computer device by executing the software programs, instructions and modules stored in the memory 720, that is, implements the above-described execution processing method of the test case. That is, the program when executed by the processor implements:
inputting the test case into a target test channel of a system to be tested, wherein the target test channel comprises a plurality of functional modules which are arranged in sequence;
and performing operation processing on the input test case through each functional module in the target test channel in sequence, and adding operation description information of the functional module in the case name of the test case.
The memory 720, as a computer-readable storage medium, can also be used to store program instructions/modules corresponding to a method for locating a test exception according to any embodiment of the present invention (e.g., the test case input module 610, the case name adding module 620, and the exception locating module 630 in a device for locating a test exception). The processor 710 executes various functional applications and data processing of the computer device by executing software programs, instructions and modules stored in the memory 720, so as to implement one of the above-mentioned test exception locating methods. That is, the program when executed by the processor implements:
respectively inputting each test case to at least one target test channel of a system to be tested, wherein the target test channel comprises a plurality of function modules to be tested which are arranged in sequence;
performing operation processing on the input test case through each functional module in each target test channel in sequence, and adding operation description information of each functional module in the matched target test channel in the case name of each test case;
and acquiring the test result of each test case output by each target test channel, and positioning the abnormal functional module according to the case name of each test case with the abnormal test result.
The memory 720 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 720 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 720 may further include memory located remotely from the processor 710, which may be connected to a computer device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. The input device 730 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the computer apparatus, and may include a keyboard and a mouse, etc. The output device 740 may include a display device such as a display screen.
Example eight
The sixth embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the method according to any embodiment of the present invention. Of course, the computer-readable storage medium provided in the embodiments of the present invention may perform relevant operations in the method for processing test cases according to any embodiment of the present invention. That is, the program when executed by the processor implements:
inputting the test case into a target test channel of a system to be tested, wherein the target test channel comprises a plurality of functional modules which are arranged in sequence;
and performing operation processing on the input test case through each functional module in the target test channel in sequence, and adding operation description information of the functional module in the case name of the test case.
The computer-readable storage medium provided in the embodiments of the present invention may further perform related operations in a method for locating a test exception provided in any embodiment of the present invention. That is, the program when executed by the processor implements:
respectively inputting each test case to at least one target test channel of a system to be tested, wherein the target test channel comprises a plurality of function modules to be tested which are arranged in sequence;
performing operation processing on the input test case through each functional module in each target test channel in sequence, and adding operation description information of each functional module in the matched target test channel in the case name of each test case;
and acquiring the test result of each test case output by each target test channel, and positioning the abnormal functional module according to the case name of each test case with the abnormal test result.
From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods according to the embodiments of the present invention.
It should be noted that, in the above embodiment of the positioning apparatus for testing an exception, each unit and each module included in the positioning apparatus are only divided according to functional logic, but are not limited to the above division, as long as the corresponding function can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (15)
1. A method for executing and processing test cases is characterized by comprising the following steps:
inputting the test case into a target test channel of a system to be tested, wherein the target test channel comprises a plurality of functional modules which are arranged in sequence;
and performing operation processing on the input test case through each functional module in the target test channel in sequence, and adding operation description information of the functional module in the case name of the test case.
2. The method according to claim 1, wherein the performing operation processing on the input test case through each functional module in the target test channel in sequence, and adding the operation description information of the functional module in the case name of the test case comprises:
after the test cases are operated and processed through the functional modules, the operation description information of the functional modules is added to the case names of the currently processed test cases.
3. The method according to claim 1, wherein the performing operation processing on the input test case through each functional module in the target test channel in sequence, and adding the operation description information of the functional module in the case name of the test case comprises:
performing operation processing on the test cases through each functional module;
and after all the functional modules in the target test channel are processed, adding operation description information of each functional module in the case name of the test case.
4. The method of claim 1, wherein before inputting the test case into the target test channel of the system under test, further comprising:
sending an enabling control signal matched with a target test channel to each functional module in the system to be tested so as to form the target test channel in the system to be tested, wherein the enabling control signal comprises: an on signal and an off signal;
the system to be tested arranges all the functional modules according to a set sequence, the functional module receiving the opening signal can operate and process the input test case, and the functional module receiving the closing signal can give up operating and processing the input test case.
5. The method of claim 1, wherein the test case is a test image;
before the test case is input to a target test channel of the system to be tested, the method further comprises the following steps:
determining an output image format of the test case according to the input image format of the test case and the type of the target test channel;
adding the input image format and the output image format in the case name of the test case;
and setting the processing parameters of each functional module matched with the target testing channel according to the type of the target testing channel, the input image format and the output image format.
6. The method of claim 1, wherein the operation description information comprises at least one information item, wherein the information item is: a module operation type or a module processing parameter or a module operation result.
7. The method according to claim 6, wherein the sequentially performing operation processing on the input test case through each functional module in the target test channel and adding operation description information of the functional module in a case name of the test case comprises:
generating the operation description information corresponding to the function module through each function module, wherein in the operation description information, adjacent information items are connected by using a first separator;
generating a second separator through each functional module, and adding operation description information of each functional module in a case name of a test case according to the second separator, wherein the second separator is used for separating the operation description information generated through different functional modules;
the first delimiter and the second delimiter are different symbols.
8. The method of claim 1, wherein the test case is a test image;
the operation description information includes: the module matched with the functional module executes the code;
the method comprises the following steps of sequentially carrying out operation processing on the input test case through each functional module in a target test channel, and adding operation description information of the functional module in a case name of the test case, wherein the operation processing comprises the following steps:
acquiring a target execution code in a code table according to the input image format of the test case and the type of the target test channel, wherein the target execution code comprises at least two sequentially formed subcodes, and the subcodes are matched with the functional modules in the target test channel;
and adding the target execution code in the case name of the test case.
9. The method according to any one of claims 1 to 8, wherein after adding the operation description information of the functional module in the case name of the test case, the method further comprises:
and acquiring a test result of the test case output by the target test channel, and storing the test result and the case name in an associated manner.
10. A method for locating a test anomaly, comprising:
respectively inputting each test case to at least one target test channel of a system to be tested, wherein the target test channel comprises a plurality of function modules to be tested which are arranged in sequence;
performing operation processing on the input test case through each functional module in each target test channel in sequence, and adding operation description information of each functional module in the matched target test channel in the case name of each test case;
and acquiring the test result of each test case output by each target test channel, and positioning the abnormal functional module according to the case name of each test case with the abnormal test result.
11. The method of claim 10, wherein locating the abnormal function module according to the case name of each test case with abnormal test result comprises:
analyzing the case names of the test cases with abnormal test results to obtain operation description information sets respectively matched with the case names;
and performing classified statistics on the operation description information included in each operation description information set to obtain target operation description information with the occurrence frequency meeting a preset threshold condition, and determining the functional module matched with the target operation description information as an abnormal functional module.
12. An apparatus for executing and processing a test case, comprising:
the test case input module is used for inputting the test cases to a target test channel of the system to be tested, and the target test channel comprises a plurality of functional modules which are arranged in sequence;
and the case name adding module is used for sequentially carrying out operation processing on the input test case through each functional module in the target test channel and adding the operation description information of the functional module in the case name of the test case.
13. A test anomaly locating apparatus, comprising:
the test case input module is used for respectively inputting each test case to at least one target test channel of the system to be tested, and the target test channel comprises a plurality of function modules to be tested which are arranged in sequence;
the case name adding module is used for carrying out operation processing on the input test cases through each functional module sequence in each target test channel and adding operation description information of each functional module in the matched target test channel in the case name of each test case;
and the abnormity positioning module is used for acquiring the test result of each test case output by each target test channel and positioning the abnormal functional module according to the case name of each test case with the abnormal test result.
14. A computer device, comprising:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the execution processing method of the test case according to any one of claims 1 to 9, or the positioning method of the test exception according to any one of claims 10 to 11.
15. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements a method for performing processing of a test case according to any one of claims 1 to 9, or implements a method for locating a test exception according to any one of claims 10 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010538121.7A CN111625471B (en) | 2020-06-12 | 2020-06-12 | Method, device, equipment and medium for executing and processing test cases and locating abnormality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010538121.7A CN111625471B (en) | 2020-06-12 | 2020-06-12 | Method, device, equipment and medium for executing and processing test cases and locating abnormality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111625471A true CN111625471A (en) | 2020-09-04 |
| CN111625471B CN111625471B (en) | 2023-05-09 |
Family
ID=72272837
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010538121.7A Active CN111625471B (en) | 2020-06-12 | 2020-06-12 | Method, device, equipment and medium for executing and processing test cases and locating abnormality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111625471B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112684321A (en) * | 2020-12-18 | 2021-04-20 | 无锡灵汐类脑科技有限公司 | Chip testing method and device |
| CN112835796A (en) * | 2021-02-01 | 2021-05-25 | 中汽数据(天津)有限公司 | Fuzzy test method and device and computer readable storage medium |
| CN112905488A (en) * | 2021-03-30 | 2021-06-04 | 平安国际智慧城市科技股份有限公司 | Link testing method and device, computer equipment and storage medium |
| CN117573533A (en) * | 2023-11-20 | 2024-02-20 | 北京国科天迅科技股份有限公司 | Test case design method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130275946A1 (en) * | 2012-04-16 | 2013-10-17 | Oracle International Corporation | Systems and methods for test development process automation for a test harness |
| CN107766194A (en) * | 2017-11-17 | 2018-03-06 | 深圳市泉眼网络科技有限公司 | Method of testing, device, system, terminal device and computer-readable recording medium |
| CN108255738A (en) * | 2018-04-09 | 2018-07-06 | 平安普惠企业管理有限公司 | Automated testing method, device, computer equipment and storage medium |
| CN110046091A (en) * | 2019-03-12 | 2019-07-23 | 阿里巴巴集团控股有限公司 | A kind of automatic test approach and device |
| CN110765000A (en) * | 2019-09-06 | 2020-02-07 | 深圳开源互联网安全技术有限公司 | Program testing method and device |
| CN110781090A (en) * | 2019-10-31 | 2020-02-11 | 北京东软望海科技有限公司 | Control method and device for data processing test, computer equipment and storage medium |
| CN110941546A (en) * | 2019-10-12 | 2020-03-31 | 平安健康保险股份有限公司 | Automatic test method, device, equipment and storage medium for WEB page case |
-
2020
- 2020-06-12 CN CN202010538121.7A patent/CN111625471B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130275946A1 (en) * | 2012-04-16 | 2013-10-17 | Oracle International Corporation | Systems and methods for test development process automation for a test harness |
| CN107766194A (en) * | 2017-11-17 | 2018-03-06 | 深圳市泉眼网络科技有限公司 | Method of testing, device, system, terminal device and computer-readable recording medium |
| CN108255738A (en) * | 2018-04-09 | 2018-07-06 | 平安普惠企业管理有限公司 | Automated testing method, device, computer equipment and storage medium |
| CN110046091A (en) * | 2019-03-12 | 2019-07-23 | 阿里巴巴集团控股有限公司 | A kind of automatic test approach and device |
| CN110765000A (en) * | 2019-09-06 | 2020-02-07 | 深圳开源互联网安全技术有限公司 | Program testing method and device |
| CN110941546A (en) * | 2019-10-12 | 2020-03-31 | 平安健康保险股份有限公司 | Automatic test method, device, equipment and storage medium for WEB page case |
| CN110781090A (en) * | 2019-10-31 | 2020-02-11 | 北京东软望海科技有限公司 | Control method and device for data processing test, computer equipment and storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112684321A (en) * | 2020-12-18 | 2021-04-20 | 无锡灵汐类脑科技有限公司 | Chip testing method and device |
| CN112835796A (en) * | 2021-02-01 | 2021-05-25 | 中汽数据(天津)有限公司 | Fuzzy test method and device and computer readable storage medium |
| CN112905488A (en) * | 2021-03-30 | 2021-06-04 | 平安国际智慧城市科技股份有限公司 | Link testing method and device, computer equipment and storage medium |
| CN117573533A (en) * | 2023-11-20 | 2024-02-20 | 北京国科天迅科技股份有限公司 | Test case design method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111625471B (en) | 2023-05-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111625471B (en) | Method, device, equipment and medium for executing and processing test cases and locating abnormality | |
| CN107908541B (en) | Interface testing method and device, computer equipment and storage medium | |
| US9389849B2 (en) | Test case pattern matching | |
| CN108307021B (en) | Parallel following test equipment, cloud real machine and method for mobile terminal | |
| CN109902002B (en) | Generation method and device of combined test case, storage medium and computer equipment | |
| EP3264274B1 (en) | Input discovery for unknown program binaries | |
| CN114546738A (en) | Server general test method, system, terminal and storage medium | |
| CN112181749A (en) | Hardware testing method and device, electronic equipment and storage medium | |
| CN113434396A (en) | Interface test method, device, equipment, storage medium and program product | |
| CN110941553A (en) | Code detection method, device, equipment and readable storage medium | |
| CN110806965A (en) | Automatic test method, device, equipment and medium | |
| CN112306495A (en) | Picture verification method and device, computer equipment and computer-readable storage medium | |
| CN113220588A (en) | Automatic testing method, device and equipment for data processing and storage medium | |
| CN111988322A (en) | Attack event display system | |
| CN111176995A (en) | Test method and test system based on big data test case | |
| CN114676066A (en) | Security testing method and device for target application, electronic equipment and storage medium | |
| CN109800362B (en) | Identification code processing method and device, storage medium and computer equipment | |
| CN109359042B (en) | Automatic testing method based on path search algorithm | |
| CN115543263A (en) | Script generation method, device, equipment and medium | |
| CN114238110A (en) | Software application testing method, device, equipment and storage medium | |
| CN112015633B (en) | Test excitation multi-platform multiplexing method, device, equipment and storage medium | |
| CN115114136A (en) | Test data generation method and device, electronic equipment and program product | |
| CN112765041A (en) | Game automatic testing method and device and electronic equipment | |
| CN116756052B (en) | Data processing method and device | |
| CN112181912B (en) | Method, device, equipment and storage medium for determining file format |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |