CN113609008A - Test result analysis method and device and electronic equipment - Google Patents
Test result analysis method and device and electronic equipment Download PDFInfo
- Publication number
- CN113609008A CN113609008A CN202110853283.4A CN202110853283A CN113609008A CN 113609008 A CN113609008 A CN 113609008A CN 202110853283 A CN202110853283 A CN 202110853283A CN 113609008 A CN113609008 A CN 113609008A
- Authority
- CN
- China
- Prior art keywords
- test
- indexes
- test case
- analyzing
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 255
- 238000004458 analytical method Methods 0.000 title claims abstract description 64
- 238000000034 method Methods 0.000 claims abstract description 30
- 238000012216 screening Methods 0.000 claims description 8
- 238000001514 detection method Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 9
- 238000004590 computer program Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a test result analysis method, a test result analysis device, electronic equipment and a computer readable medium, wherein the method comprises the following steps: acquiring a plurality of indexes used for analyzing test results in the test case; according to the multiple indexes, searching index data matched with the multiple indexes from result data generated by the test case; and generating a test result analysis report according to the index data. According to the technical scheme of the invention, the automatic analysis of the test case result is realized, the test result analysis report is provided for the user, and the efficiency of test case management is improved.
Description
Technical Field
The invention relates to the field of computer information processing, in particular to a test result analysis method and device, electronic equipment and a computer readable medium.
Background
The test methods applied to the computer field are various, such as common a/B-test (a/B test), which makes two (a/B) or multiple (a/B/n) versions for a Web or App interface or process, respectively makes groups of visitors (target groups) with the same (similar) composition randomly access the versions in the same time dimension, collects user experience data and business data of each group, and finally analyzes and evaluates the best version for formal adoption. The application range of the A/B-Test is wide, as the A/B-Test has gradually increased Test cases, and some A/B-Test observation periods are long and long, the A/B-Test cases needing to be managed and followed are piled up like a mountain, and a great deal of time and energy are consumed for tracking the Test cases.
Therefore, how to realize the automatic tracking management of a large number of A/B-Test conclusions and give decision suggestions based on the structure of hypothesis Test, and the improvement of the management efficiency of A/B-Test cases becomes a problem to be solved.
Disclosure of Invention
The invention aims to realize automatic management of test cases and complete result analysis.
In order to solve the above technical problem, a first aspect of the present invention provides a method for analyzing a test result, where the method includes: acquiring a plurality of indexes used for analyzing test results in the test case; according to the indexes, searching index data matched with the indexes from result data generated by the test case; and generating a test result analysis report according to the index data.
According to a preferred embodiment of the present invention, the obtaining of the plurality of indexes for analyzing the test result in the test case includes: and searching a preset index template corresponding to the test case according to the unique identifier of the test case, wherein the index template records the plurality of indexes for analyzing the test result.
According to a preferred embodiment of the present invention, the obtaining of the plurality of indexes for analyzing the test result in the test case includes: and screening a plurality of indexes meeting the analysis requirements from the indexes set in the test case according to the analysis requirements provided by the user for analyzing the test results.
According to a preferred embodiment of the present invention, the obtaining of the plurality of indexes for analyzing the test result in the test case includes: and according to the business links participated by the user, screening a plurality of indexes related to the business links from the indexes set in the test case for analyzing the test result.
According to a preferred embodiment of the present invention, before the obtaining of the plurality of indexes for analyzing the test result in the test case, the method further includes: and judging whether the test work is finished at present according to the test time corresponding to the test case, and executing the acquisition of a plurality of indexes used for analyzing the test result in the test case when the judgment result is yes.
In order to solve the above technical problem, a second aspect of the present invention provides a test result analysis apparatus, including: the index acquisition module is used for acquiring a plurality of indexes used for analyzing the test result in the test case; the data searching module searches index data matched with the indexes from the result data generated by the test case according to the indexes; and the report generation module is used for generating a test result analysis report according to the index data.
According to a preferred embodiment of the present invention, the index obtaining module searches a preset index template corresponding to the test case according to the unique identifier of the test case, and the index template records the plurality of indexes used for analyzing the test result.
According to a preferred embodiment of the present invention, the index obtaining module screens out a plurality of indexes meeting the analysis requirement from the indexes set in the test case according to the analysis requirement provided by the user, and uses the indexes to analyze the test result.
According to a preferred embodiment of the present invention, the index obtaining module screens out a plurality of indexes related to the business link from the indexes set in the test case according to the business link participated by the user, and analyzes the test result.
According to a preferred embodiment of the present invention, further comprising: the event detection module is used for judging whether the test work is finished currently or not according to the test time corresponding to the test case before the plurality of indexes used for analyzing the test result in the test case are obtained; and the index acquisition module executes the acquisition of the plurality of indexes used for analyzing the test result in the test case when the judgment result is yes.
In order to solve the above technical problem, a third aspect of the present invention proposes an electronic device comprising a processor and a memory storing computer-executable instructions that, when executed, cause the processor to perform the above method.
In order to solve the above technical problem, a fourth aspect of the present invention proposes a computer-readable storage medium storing one or more programs which, when executed by a processor, implement the above-mentioned method.
According to the technical scheme of the invention, part of indexes used for result analysis are selected from all indexes of the test case, and then the data matched with the part of indexes are found from all the test data, so that the data matched with the part of indexes can reflect the analysis result, and the result analysis report can be automatically generated according to the data.
Drawings
In order to make the technical problems solved by the present invention, the technical means adopted and the technical effects obtained more clear, the following will describe in detail the embodiments of the present invention with reference to the accompanying drawings. It should be noted, however, that the drawings described below are only illustrations of exemplary embodiments of the invention, from which other embodiments can be derived by those skilled in the art without inventive step.
FIG. 1 is a flow diagram of a test result analysis method according to one embodiment of the invention;
FIG. 2 is a flow diagram of a test result analysis method according to one embodiment of the invention;
FIG. 3 is a block diagram of a test result analysis device according to one embodiment of the present invention;
FIG. 4 is a block diagram of a test result analysis device according to one embodiment of the present invention;
FIG. 5 is a block diagram of an electronic device according to one embodiment of the invention;
FIG. 6 is a schematic diagram of a computer-readable storage medium according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the invention may be embodied in many specific forms, and should not be construed as limited to the embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the invention to those skilled in the art.
The structures, properties, effects or other characteristics described in a certain embodiment may be combined in any suitable manner in one or more other embodiments, while still complying with the technical idea of the invention.
In describing particular embodiments, specific details of structures, properties, effects, or other features are set forth in order to provide a thorough understanding of the embodiments by one skilled in the art. However, it is not excluded that a person skilled in the art may implement the invention in a specific case without the above-described structures, performances, effects or other features.
The flow chart in the drawings is only an exemplary flow demonstration, and does not represent that all the contents, operations and steps in the flow chart are necessarily included in the scheme of the invention, nor does it represent that the execution is necessarily performed in the order shown in the drawings. For example, some operations/steps in the flowcharts may be divided, some operations/steps may be combined or partially combined, and the like, and the execution order shown in the flowcharts may be changed according to actual situations without departing from the gist of the present invention.
The block diagrams in the figures generally represent functional entities and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.
The same reference numerals denote the same or similar elements, components, or parts throughout the drawings, and thus, a repetitive description thereof may be omitted hereinafter. It will be further understood that, although the terms first, second, third, etc. may be used herein to describe various elements, components, or sections, these elements, components, or sections should not be limited by these terms. That is, these phrases are used only to distinguish one from another. For example, a first device may also be referred to as a second device without departing from the spirit of the present invention. Furthermore, the term "and/or", "and/or" is intended to include all combinations of any one or more of the listed items.
Taking the A/B-Test (A/B Test) as an example, when the A/B-Test cases are increased and the observation period is long, the A/B-Test cases needing to be managed and followed consume a lot of time and energy. How to realize the automatic tracking management of a large number of A/B-Test conclusions and improve the management efficiency of A/B-Test cases becomes a problem to be solved. The invention designs a technical scheme for solving the problem, firstly, a plurality of indexes used for analyzing a test result in a test case are obtained, then index data matched with the indexes are searched from result data generated by the test case according to the indexes, and finally, a test result analysis report is generated according to the index data. According to the technical scheme, automatic analysis of the test case results is realized, a test result analysis report is provided for a user, and the efficiency of test case management is improved.
As shown in fig. 1, in one embodiment of the present invention, a method for analyzing test results is provided, the method including:
step S110, a plurality of indexes used for analyzing the test result in the test case are obtained.
In the embodiment of the present invention, the technical solution is described by using an a/B-Test, but the Test case in the embodiment is not limited to the a/B-Test, and may be other types of Test cases. In this embodiment, generally, a large number of indexes exist in the test case, some of the indexes are key indexes to be extracted, for example, in the test case for testing the service handling condition, the service handling time, the abnormal occurrence rate, and other indexes are key indexes.
And step S120, according to the indexes, searching index data matched with the indexes from the result data generated by the test case.
In this embodiment, taking a/B-Test as an example, each Test sample generates Test result data, and at this time, corresponding result data can be searched according to the index.
And step S130, generating a test result analysis report according to the index data.
In this embodiment, for the a/B-Test, it is necessary to determine the grouping label of the data sample, i.e. it belongs to the Test group or the control group, and finally generate an analysis report according to the data of the Test group or the control group. In this embodiment, for each A/B-Test, a standardized Test report is ultimately output based on the selected evaluation index. In this embodiment, a standard report template may be constructed, in which data indexes (such as passing rate, pen, etc.) are displayed, and a p-value (assumed value, assumed probability) based on hypothesis testing may also be displayed, a hypothesis testing result of the test is given, and a finally automatically generated report may be displayed on Excel or a constructed website platform.
According to the technical scheme of the embodiment, part of indexes used for result analysis are selected from all indexes of the test case, and then data matched with the part of indexes are found from all test data, so that the data matched with the part of indexes can reflect the analysis result, and the result analysis report can be automatically generated according to the data.
As shown in fig. 2, in an embodiment of the present invention, a method for analyzing a test result is provided, the method including:
step S210, determining whether the testing operation is currently completed according to the testing time corresponding to the testing case.
In this embodiment, the test online time and the test offline time of the data sample may be set, whether the test work is completed or not is determined according to the time, and the index and the related data are extracted in time after the test is completed to generate the test result analysis report.
And step S220, when the judgment result is yes, searching a preset index template corresponding to the test case according to the unique identifier of the test case, wherein a plurality of indexes for analyzing the test result are recorded in the index template.
In this embodiment, the a/B-Test samples to be analyzed and followed are normalized to determine the minimum sample granularity: unique user id (userid) or unique application NO (appl NO). For each A/B-Test report, indexes which are of special concern exist, in order to respond to various A/B-tests, a templated index set can be established, and a unique user ID (userid) or a unique application NO (application _ NO) of a data sample is bound with a matched index template, so that the index template can be automatically obtained after the data sample is input, and different tests can be realized to automatically select different observation indexes: specifically, common indexes of a test report need to be combed, and the indexes are classified according to different process links; the indexes are calculated and packaged into a universal template, and the corresponding indexes can be calculated only by inputting standardized data samples.
In this embodiment, the following two schemes for automatically extracting the test indexes may also be used:
(1) and screening a plurality of indexes meeting the analysis requirements from the indexes set in the test case according to the analysis requirements provided by the user for analyzing the test results.
When the test case relates to multi-aspect tests and a user only needs to perform test analysis on one aspect, part of indexes can be extracted from all indexes according to the analysis requirements of the user, for example, when the test case is used for testing the overall operation condition of a business system and the user only needs to perform safety analysis currently, part of indexes related to safety are automatically extracted from all indexes.
(2) And according to the business links participated by the user, screening a plurality of indexes related to the business links from the indexes set in the test case for analyzing the test result.
When the test case relates to all links of a certain business and the user only needs to test and analyze the links in charge of the user, part of indexes related to the links can be extracted from all indexes according to the links in charge of the user in business work, for example, the business links in charge of the user can be automatically determined according to the posts and the jobs of the user, and then the indexes related to the business links are searched.
Step S230, according to the multiple indexes, searching index data matched with the multiple indexes from the result data generated by the test case.
And step S240, generating a test result analysis report according to the index data.
According to the technical scheme of the embodiment, automatic tracking of a large number of A/B-Test cases can be realized, and the management efficiency of the Test cases is greatly improved.
Those skilled in the art will appreciate that all or part of the steps for implementing the above-described embodiments are implemented as programs executed by data processing apparatuses (including computers), i.e., computer programs. When the computer program is executed, the method provided by the invention can be realized. Furthermore, the computer program may be stored in a computer readable storage medium, which may be a readable storage medium such as a magnetic disk, an optical disk, a ROM, a RAM, or a storage array composed of a plurality of storage media, such as a magnetic disk or a magnetic tape storage array. The storage medium is not limited to centralized storage, but may be distributed storage, such as cloud storage based on cloud computing.
Embodiments of the apparatus of the present invention are described below, which may be used to perform method embodiments of the present invention. The details described in the device embodiments of the invention should be regarded as complementary to the above-described method embodiments; reference is made to the above-described method embodiments for details not disclosed in the apparatus embodiments of the invention.
As shown in fig. 3, in one embodiment of the present invention, there is provided a test result analysis apparatus including:
the index obtaining module 310 obtains a plurality of indexes used for analyzing the test result in the test case.
In the embodiment of the present invention, the technical solution is described by using an a/B-Test, but the Test case in the embodiment is not limited to the a/B-Test, and may be other types of Test cases. In this embodiment, generally, a large number of indexes exist in the test case, some of the indexes are key indexes to be extracted, for example, in the test case for testing the service handling condition, the service handling time, the abnormal occurrence rate, and other indexes are key indexes.
The data searching module 320 searches index data matched with the plurality of indexes from the result data generated by the test case according to the plurality of indexes.
In this embodiment, taking a/B-Test as an example, each Test sample generates Test result data, and at this time, corresponding result data can be searched according to the index.
The report generation module 330 generates a test result analysis report according to the index data.
In this embodiment, for the a/B-Test, it is necessary to determine the grouping label of the data sample, i.e. it belongs to the Test group or the control group, and finally generate an analysis report according to the data of the Test group or the control group. In this embodiment, for each A/B-Test, a standardized Test report is ultimately output based on the selected evaluation index. In this embodiment, a standard report template may be constructed, in which data indexes (such as passing rate, pen, etc.) are displayed, and a p-value (assumed value, assumed probability) based on hypothesis testing may also be displayed, a hypothesis testing result of the test is given, and a finally automatically generated report may be displayed on Excel or a constructed website platform.
According to the technical scheme of the embodiment, part of indexes used for result analysis are selected from all indexes of the test case, and then data matched with the part of indexes are found from all test data, so that the data matched with the part of indexes can reflect the analysis result, and the result analysis report can be automatically generated according to the data.
As shown in fig. 4, in one embodiment of the present invention, there is provided a test result analysis apparatus including:
the event detection module 410 determines whether the test is currently completed according to the test time corresponding to the test case.
In this embodiment, the test online time and the test offline time of the data sample may be set, whether the test work is completed or not is determined according to the time, and the index and the related data are extracted in time after the test is completed to generate the test result analysis report.
And the index obtaining module 420 searches a preset index template corresponding to the test case according to the unique identifier of the test case when the judgment result is yes, wherein a plurality of indexes for analyzing the test result are recorded in the index template.
In this embodiment, the a/B-Test samples to be analyzed and followed are normalized to determine the minimum sample granularity: unique user id (userid) or unique application NO (appl NO). For each A/B-Test report, indexes which are of special concern exist, in order to respond to various A/B-tests, a templated index set can be established, and a unique user ID (userid) or a unique application NO (application _ NO) of a data sample is bound with a matched index template, so that the index template can be automatically obtained after the data sample is input, and different tests can be realized to automatically select different observation indexes: specifically, common indexes of a test report need to be combed, and the indexes are classified according to different process links; the indexes are calculated and packaged into a universal template, and the corresponding indexes can be calculated only by inputting standardized data samples.
In this embodiment, the following two schemes for automatically extracting the test indexes may also be used:
(1) and screening a plurality of indexes meeting the analysis requirements from the indexes set in the test case according to the analysis requirements provided by the user for analyzing the test results.
When the test case relates to multi-aspect tests and a user only needs to perform test analysis on one aspect, part of indexes can be extracted from all indexes according to the analysis requirements of the user, for example, when the test case is used for testing the overall operation condition of a business system and the user only needs to perform safety analysis currently, part of indexes related to safety are automatically extracted from all indexes.
(2) And according to the business links participated by the user, screening a plurality of indexes related to the business links from the indexes set in the test case for analyzing the test result.
When the test case relates to all links of a certain business and the user only needs to test and analyze the links in charge of the user, part of indexes related to the links can be extracted from all indexes according to the links in charge of the user in business work, for example, the business links in charge of the user can be automatically determined according to the posts and the jobs of the user, and then the indexes related to the business links are searched.
The data searching module 430 searches index data matched with the plurality of indexes from the result data generated by the test case according to the plurality of indexes.
And a report generation module 440 for generating a test result analysis report according to the index data.
According to the technical scheme of the embodiment, automatic tracking of a large number of A/B-Test cases can be realized, and the management efficiency of the Test cases is greatly improved.
Those skilled in the art will appreciate that the modules in the above-described embodiments of the apparatus may be distributed as described in the apparatus, and may be correspondingly modified and distributed in one or more apparatuses other than the above-described embodiments. The modules of the above embodiments may be combined into one module, or further split into multiple sub-modules.
In the following, embodiments of the electronic device of the present invention are described, which may be regarded as an implementation in physical form for the above-described embodiments of the method and apparatus of the present invention. Details described in the embodiments of the electronic device of the invention should be considered supplementary to the embodiments of the method or apparatus described above; for details which are not disclosed in embodiments of the electronic device of the invention, reference may be made to the above-described embodiments of the method or the apparatus.
Fig. 5 is a block diagram of an exemplary embodiment of an electronic device according to the present invention. The electronic device shown in fig. 5 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 5, the electronic apparatus 200 of the exemplary embodiment is represented in the form of a general-purpose data processing apparatus. The components of the electronic device 200 may include, but are not limited to: at least one processing unit 210, at least one memory unit 220, a bus 230 connecting different system components (including the memory unit 220 and the processing unit 210), a display unit 240, and the like.
The storage unit 220 stores a computer readable program, which may be a code of a source program or a read-only program. The program may be executed by the processing unit 210 such that the processing unit 210 performs the steps of various embodiments of the present invention. For example, the processing unit 210 may perform the steps shown in fig. 1 or fig. 2.
The memory unit 220 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)2201 and/or a cache memory unit 2202, and may further include a read only memory unit (ROM) 2203. The storage unit 220 may also include a program/utility 2204 having a set (at least one) of program modules 2205, such program modules 2205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The electronic device 200 may also communicate with one or more external devices 300 (e.g., keyboard, display, network device, bluetooth device, etc.), enable a user to interact with the electronic device 200 via the external devices 300, and/or enable the electronic device 200 to communicate with one or more other data processing devices (e.g., router, modem, etc.). Such communication may occur via input/output (I/O) interfaces 250, and may also occur via network adapter 260 with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network such as the Internet). The network adapter 260 may communicate with other modules of the electronic device 200 via the bus 230. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in the electronic device 200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
FIG. 6 is a schematic diagram of one computer-readable medium embodiment of the present invention. As shown in fig. 6, the computer program may be stored on one or more computer readable media. The computer readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. The computer program, when executed by one or more data processing devices, enables the computer-readable medium to implement the above-described method of the invention, namely: acquiring a plurality of indexes used for analyzing test results in the test case; according to the multiple indexes, searching index data matched with the multiple indexes from result data generated by the test case; and generating a test result analysis report according to the index data.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments of the present invention described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiment of the present invention can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to make a data processing device (which can be a personal computer, a server, or a network device, etc.) execute the above-mentioned method according to the present invention.
The computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
In summary, the present invention can be implemented as a method, an apparatus, an electronic device, or a computer-readable medium executing a computer program. Some or all of the functions of the present invention may be implemented in practice using a general purpose data processing device such as a microprocessor or a Digital Signal Processor (DSP).
While the foregoing embodiments have described the objects, aspects and advantages of the present invention in further detail, it should be understood that the present invention is not inherently related to any particular computer, virtual machine or electronic device, and various general-purpose machines may be used to implement the present invention. The invention is not to be considered as limited to the specific embodiments thereof, but is to be understood as being modified in all respects, all changes and equivalents that come within the spirit and scope of the invention.
Claims (12)
1. A method for analyzing test results, comprising:
acquiring a plurality of indexes used for analyzing test results in the test case;
according to the indexes, searching index data matched with the indexes from result data generated by the test case;
and generating a test result analysis report according to the index data.
2. The method of claim 1, wherein the obtaining of the plurality of indicators for analyzing the test results in the test case comprises:
and searching a preset index template corresponding to the test case according to the unique identifier of the test case, wherein the index template records the plurality of indexes for analyzing the test result.
3. The method of claim 1, wherein the obtaining of the plurality of indicators for analyzing the test results in the test case comprises:
and screening a plurality of indexes meeting the analysis requirements from the indexes set in the test case according to the analysis requirements provided by the user for analyzing the test results.
4. The method of claim 1, wherein the obtaining of the plurality of indicators for analyzing the test results in the test case comprises:
and according to the business links participated by the user, screening a plurality of indexes related to the business links from the indexes set in the test case for analyzing the test result.
5. The method of claim 1, further comprising, prior to the obtaining the plurality of indicators for analyzing test results in the test case:
and judging whether the test work is finished at present according to the test time corresponding to the test case, and executing the acquisition of a plurality of indexes used for analyzing the test result in the test case when the judgment result is yes.
6. A test result analysis apparatus, comprising:
the index acquisition module is used for acquiring a plurality of indexes used for analyzing the test result in the test case;
the data searching module searches index data matched with the indexes from the result data generated by the test case according to the indexes;
and the report generation module is used for generating a test result analysis report according to the index data.
7. The test result analysis device according to claim 6,
the index acquisition module searches a preset index template corresponding to the test case according to the unique identifier of the test case, and the index template records the indexes for analyzing the test result.
8. The test result analysis device according to claim 6,
the index acquisition module screens out a plurality of indexes meeting the analysis requirements from the indexes set in the test case according to the analysis requirements provided by the user, and the indexes are used for analyzing the test results.
9. The test result analysis device according to claim 6,
and the index acquisition module screens out a plurality of indexes related to the business link from the indexes set in the test case according to the business link participated by the user for analyzing the test result.
10. The test result analysis device according to claim 6, further comprising:
the event detection module is used for judging whether the test work is finished currently or not according to the test time corresponding to the test case before the plurality of indexes used for analyzing the test result in the test case are obtained;
and the index acquisition module executes the acquisition of the plurality of indexes used for analyzing the test result in the test case when the judgment result is yes.
11. An electronic device, comprising:
a processor; and
a memory storing computer-executable instructions that, when executed, cause the processor to perform the method of any of claims 1-5.
12. A computer readable storage medium, wherein the computer readable storage medium stores one or more programs which, when executed by a processor, implement the method of any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110853283.4A CN113609008A (en) | 2021-07-27 | 2021-07-27 | Test result analysis method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110853283.4A CN113609008A (en) | 2021-07-27 | 2021-07-27 | Test result analysis method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113609008A true CN113609008A (en) | 2021-11-05 |
Family
ID=78305660
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110853283.4A Pending CN113609008A (en) | 2021-07-27 | 2021-07-27 | Test result analysis method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113609008A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115292202A (en) * | 2022-09-29 | 2022-11-04 | 立臻科技(昆山)有限公司 | Product test analysis method and device, electronic equipment and storage medium |
| CN115543773A (en) * | 2022-08-17 | 2022-12-30 | 睿智合创(北京)科技有限公司 | Automatic comparison method for test results |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105426278A (en) * | 2015-11-20 | 2016-03-23 | 北京畅游天下网络技术有限公司 | Client equipment performance test method and system |
| CN108845914A (en) * | 2018-06-29 | 2018-11-20 | 平安科技（深圳）有限公司 | Generation method, electronic device and the readable storage medium storing program for executing of performance test report |
| CN109669853A (en) * | 2018-10-23 | 2019-04-23 | 深圳壹账通智能科技有限公司 | Test report generation method and device, storage medium, electric terminal |
| CN110061889A (en) * | 2019-04-01 | 2019-07-26 | 北京众享比特科技有限公司 | Block chain performance test methods, device, equipment and storage medium |
| CN111241804A (en) * | 2020-01-21 | 2020-06-05 | 中国海洋大学 | Household appliance test report generation and interaction method and device for Internet of things |
-
2021
- 2021-07-27 CN CN202110853283.4A patent/CN113609008A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105426278A (en) * | 2015-11-20 | 2016-03-23 | 北京畅游天下网络技术有限公司 | Client equipment performance test method and system |
| CN108845914A (en) * | 2018-06-29 | 2018-11-20 | 平安科技（深圳）有限公司 | Generation method, electronic device and the readable storage medium storing program for executing of performance test report |
| CN109669853A (en) * | 2018-10-23 | 2019-04-23 | 深圳壹账通智能科技有限公司 | Test report generation method and device, storage medium, electric terminal |
| CN110061889A (en) * | 2019-04-01 | 2019-07-26 | 北京众享比特科技有限公司 | Block chain performance test methods, device, equipment and storage medium |
| CN111241804A (en) * | 2020-01-21 | 2020-06-05 | 中国海洋大学 | Household appliance test report generation and interaction method and device for Internet of things |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115543773A (en) * | 2022-08-17 | 2022-12-30 | 睿智合创(北京)科技有限公司 | Automatic comparison method for test results |
| CN115292202A (en) * | 2022-09-29 | 2022-11-04 | 立臻科技(昆山)有限公司 | Product test analysis method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Hall et al. | A systematic literature review on fault prediction performance in software engineering | |
| US20130086556A1 (en) | System for ensuring comprehensiveness of requirements testing of software applications | |
| CN102402479B (en) | For the intermediate representation structure of static analysis | |
| CN105095059A (en) | Method and device for automated testing | |
| CN111316232A (en) | Providing optimization using annotations of programs | |
| CN113609008A (en) | Test result analysis method and device and electronic equipment | |
| US20210200740A1 (en) | System and method for processing logs | |
| US11704186B2 (en) | Analysis of deep-level cause of fault of storage management | |
| CN109872230B (en) | Test method and device of financial data analysis system, medium and electronic equipment | |
| Mairiza et al. | Towards a Catalogue of Conflicts Among Non-functional Requirements. | |
| CN112287603A (en) | Prediction model construction method and device based on machine learning and electronic equipment | |
| CN112948275A (en) | Test data generation method, device, equipment and storage medium | |
| Zhu et al. | Loghub: A large collection of system log datasets for ai-driven log analytics | |
| CN111178701A (en) | Risk control method and device based on feature derivation technology and electronic equipment | |
| Fu et al. | An empirical study of the impact of log parsers on the performance of log-based anomaly detection | |
| CN113326261A (en) | Data blood relationship extraction method and device and electronic equipment | |
| CN112650673A (en) | Method and device for creating test case in transaction tracking system and electronic equipment | |
| CN110806969A (en) | Test case integrity evaluation method and device and electronic equipment | |
| CN116860311A (en) | Script analysis method, script analysis device, computer equipment and storage medium | |
| US11860727B2 (en) | Data quality-based computations for KPIs derived from time-series data | |
| US11971802B2 (en) | Method, electronic device, and computer program product for code defect detection | |
| CN114385155A (en) | vue project visualization tool generation method, device, equipment and storage medium | |
| CN115033489A (en) | Code resource detection method and device, electronic equipment and storage medium | |
| US9667706B2 (en) | Distributed processing systems | |
| US10409871B2 (en) | Apparatus and method for searching information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |