CN112286808A

CN112286808A - Application program testing method and device, electronic equipment and medium

Info

Publication number: CN112286808A
Application number: CN202011185903.3A
Authority: CN
Inventors: 戴骏
Original assignee: Beijing ByteDance Network Technology Co Ltd
Current assignee: Beijing ByteDance Network Technology Co Ltd
Priority date: 2020-10-29
Filing date: 2020-10-29
Publication date: 2021-01-29
Anticipated expiration: 2040-10-29
Also published as: CN112286808B

Abstract

The embodiment of the disclosure provides a method and a device for testing an application program, electronic equipment and a medium. The method comprises the following steps: acquiring first program error record information generated by testing a target application program; searching a program error record information base of the target application program, wherein each historical program error record information generated by testing the target application program is recorded in the program error record information base; determining similarity between the first program error record information and each historical program error record information in the program error record information base; and when the similarity between the first program error record information and a certain historical program error record information is higher than a preset similarity threshold value, merging the first program error record information and the historical program error record information. The embodiment of the disclosure reduces manpower consumption and time consumption, and improves test efficiency.

Description

Application program testing method and device, electronic equipment and medium

Technical Field

The present disclosure relates to the field of application program testing technologies, and in particular, to a method and an apparatus for testing an application program, an electronic device, and a medium.

Background

With the continuous development of computer technology, the variety and functions of application programs are more and more. For each application program, the application program needs to be tested on various tester types to meet the compatibility requirement of the application program.

In the process of testing the application program, generally, for each type of test machine, the application program needs to be tested on at least one electronic device of the test machine, and meanwhile, as the functions of the application program are increased, the interaction complexity of the application program is also increased, for example, the operation of some game-type application programs is closely related to the behavior of users. In order to ensure the integrity of the application program test, the application program test usually requires multiple persons to perform the test cooperatively. When multiple persons collaboratively test the application program, the situation of information leakage or repetition often occurs easily, and the test efficiency is low.

Disclosure of Invention

The disclosure provides a method and a device for testing an application program, an electronic device and a medium, which can solve the technical problem of low testing efficiency.

In a first aspect, a method for testing an application program is provided, where the method includes:

acquiring first program error record information generated by testing a target application program;

searching a program error record information base of the target application program, wherein each historical program error record information generated by testing the target application program is recorded in the program error record information base;

determining similarity between the first program error record information and each historical program error record information in the program error record information base;

and when the similarity between the first program error record information and a certain historical program error record information is higher than a preset similarity threshold value, merging the first program error record information and the historical program error record information.

In a second aspect, there is provided an apparatus for testing an application, the apparatus comprising:

the acquisition module is used for acquiring first program error record information generated by testing a target application program;

the searching module is used for searching a program error record information base of the target application program, and each historical program error record information generated by testing the target application program is recorded in the program error record information base;

the determining module is used for determining the similarity between the first program error record information and each historical program error record information in the program error record information base;

and the merging module is used for merging the first program error record information and the historical program error record information when the similarity between the first program error record information and the historical program error record information is higher than a preset similarity threshold value.

In a third aspect, an electronic device is provided, which includes:

one or more processors;

a memory;

one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to: and executing the operation corresponding to the test method of the application program shown in the first aspect.

In a fourth aspect, there is provided a computer-readable medium on which a computer program is stored, which program, when executed by a processor, is a method for testing an application program as set forth in the first aspect.

The technical scheme provided by the disclosure has the following beneficial effects:

the present disclosure provides a method, an apparatus, an electronic device, and a medium for testing an application program, which, compared with the prior art, acquires first program error record information generated by testing a target application program, searches a program error record information library of the target application program, wherein each historical program error record information generated by testing the target application program is recorded in the program error record information library, determines a similarity between the first program error record information and each historical program error record information in the program error record information library, and when the similarity between the first program error record information and a certain historical program error record information is higher than a preset similarity threshold, combines the first program error record information and the historical program error record information, thereby realizing the purpose of calculating the similarity between the first program error record information and each historical program error record information, the historical program error record information corresponding to the similarity greater than the preset similarity threshold and the first program error record information are automatically combined, so that the labor consumption and the time consumption in the analysis process can be reduced, and the test efficiency is improved.

Drawings

The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.

Fig. 1 is a schematic flowchart of a method for testing an application according to an embodiment of the present disclosure;

fig. 2 is an input/output schematic diagram of a bug model association model according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of an apparatus for testing an application according to an embodiment of the present disclosure;

fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

FIG. 5 is a diagram illustrating a similarity between bug records according to an embodiment of the present disclosure;

fig. 6 is a schematic diagram illustrating processing of a current vulnerability (english name: Bug) according to an embodiment of the present application.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.

It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing the devices, modules or units, and are not used for limiting the devices, modules or units to be different devices, modules or units, and also for limiting the sequence or interdependence relationship of the functions executed by the devices, modules or units.

It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.

The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.

The following describes the technical solutions of the present disclosure and how to solve the above technical problems in specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present disclosure will be described below with reference to the accompanying drawings.

The embodiment of the present disclosure provides a method for testing an application, which may be executed by an electronic device, where the electronic device may be a terminal device such as a mobile phone, a tablet computer, a notebook computer, a desktop computer, or a server, and optionally, the electronic device may be a test terminal device of a tester, as shown in fig. 1, where the method includes steps S101 to S104.

Step S101, acquiring first program error record information generated by aiming at the target application program test.

The first program error record information may be acquired in real time, that is, the first program error record information may be program error record information acquired in a current state in a test process for a target application program.

Step S102, searching a program error record information base of the target application program, wherein each historical program error record information generated by testing the target application program is recorded in the program error record information base.

The program error record information base includes various historical program error record information, that is, various program error record information obtained by testing when the current program error record information is obtained by testing. The program error record information may include various test information recorded by a general program error test, program error record information automatically generated by test software in a test process, and program error record information filled by a tester.

The target application program may be any application program, such as any type of game application program, instant messaging application program, and the like. In the embodiment of the disclosure, in the process of testing the target application program, the tested program error record information is obtained in real time. Generally, in the testing process, a testing technician may screen a testing device to be tested according to a testing requirement and model information, and then log in a cooperative testing platform (it may be understood that multiple testing technicians may also log in the cooperative testing platform at the same time to perform a cooperative test), execute the cooperative test on the cooperative testing platform, and fill in a testing record. When finding a program error in the testing process, the testing technician feeds back program error record information of the program error, wherein the program error record information of the program error is used for recording detailed information of the program error, such as at least one of a program error type of the program error, text description information of the program error, picture information of the program error, and the like. Each time a test technician feeds back one piece of program error record information, the program error record information is recorded under a corresponding test task in the cooperative test platform, so that each test technician can know the program error record information and/or perform subsequent analysis on the program error record information.

And when first program error record information of the currently tested program error is acquired, acquiring various historical program error record information of the target application program. Wherein the program error record information base comprises at least one historical program error record information. Of course, the bug record information base may also include other information, such as model information of the testing device for historical tests.

It should be noted that at least one test may be performed when testing the target application. For any historical program error log information, the historical program error log information may be the program error log information already recorded in the process of the current test or the test before the current test.

In step S103, a similarity between the first program error record information and each of the historical program error record information in the program error record information base is determined.

In the embodiment of the present disclosure, the similarity between the first program error record information and each historical program error record information may be calculated, and the calculation manner of the similarity is not limited herein.

And step S104, merging the first program error record information and the historical program error record information when the similarity between the first program error record information and the historical program error record information is higher than a preset similarity threshold value.

In the embodiment of the present disclosure, the similarity higher than the preset similarity threshold may be at least one. When the historical program error record information corresponding to the similarity higher than the preset similarity threshold is merged with the first program error record information, there may be two merging cases, which are respectively denoted as a merging case a1 and a merging case a 2.

In the merging case a1, when the similarity higher than the preset similarity threshold is one, the historical program error record information corresponding to the similarity higher than the preset similarity threshold may be merged with the first program error record information.

In the merging case a2, when the similarity higher than the preset similarity threshold is at least two, the maximum similarity may be determined from the similarities higher than the preset similarity threshold, and the historical program error record information corresponding to the maximum similarity and the first program error record information may be merged.

Of course, the above two combining cases are only one possible implementation manner, and in the process of practical application, other implementation manners may be adopted for combining, which is not limited herein.

It should be noted that, because the program errors are various, and the description information of the same program error is also various, that is, the same program error may have a plurality of different program error record information, in this embodiment of the present application, the program errors are merged by the method of steps S101 to S104, and different program error record information of the same program error can be merged into one program error record information, so that it can be ensured that the same program error only corresponds to one program error record information, and in the subsequent analysis, the manpower consumption and the time consumption in the analysis process can be greatly reduced.

In the embodiment of the application, for the same test task, when a program error occurs in the test process, the test technicians can record the program error record information of the program error on the collaborative test platform, and correspondingly, the pages of the test technicians of the same test task in the collaborative test platform can be synchronously updated, so that the program error record information of the program error occurs on the pages of the test technicians. The synchronous updating of the page may be implemented by using a Websocket, which is a full duplex communication Protocol based on a Transmission Control Protocol (TCP).

Compared with the prior art, the method for testing the application program obtains the first program error record information generated by testing the target application program, searches the program error record information base of the target application program, records each historical program error record information generated by testing the target application program in the program error record information base, determines the similarity between the first program error record information and each historical program error record information in the program error record information base, and combines the first program error record information and the historical program error record information when the similarity between the first program error record information and a certain historical program error record information is higher than a preset similarity threshold value, so that the similarity between the first program error record information and each historical program error record information is calculated, the historical program error record information corresponding to the similarity greater than the preset similarity threshold and the first program error record information are automatically combined, so that the labor consumption and the time consumption in the analysis process can be reduced, and the test efficiency is improved.

In another possible implementation manner of the embodiment of the present disclosure, for any program error record information, the program error record information includes program error text description information and/or program error picture information.

The program error record information in the embodiment of the present disclosure includes three cases, which are respectively denoted as cases B1-B3. Wherein the program error record information includes first program error record information and historical program error record information. Specifically, the method comprises the following steps:

case B1, the bug record information includes bug text description information.

In case B1, if the program error record information includes program error text description information, then in step S103, for any historical program error record information, the similarity between the first program error record information and the historical program error record information in the program error record information base is determined, which includes, specifically, steps S1031 to S1034.

Step S1031 determines each first keyword included in the program error text description information in the first program error record information and each second keyword included in the program error text description information in the historical program error record information.

In the embodiment of the present disclosure, the similarity between the first program error record information and the historical program error record information may be determined by using each first keyword included in the program error text description information in the first program error record information and each second keyword included in the program error text description information in the historical program error record information.

For example, if the program error text description information in the first program error record information includes the first keywords 11, 12, and 13, and the program error text description information in the historical program error record information includes the second keywords 21 and 22, the similarity between the first program error record information and the historical program error record information is determined according to the first keywords 11, 12, and 13 and the second keywords 21 and 22.

Specifically, the description information of the program error text in the first program error record information may be segmented, and each of the segmented words is compared with the keywords in the keyword library one by one, so that each of the first keywords included in the description information of the program error text in the first program error record information may be determined; similarly, the procedural error text description information in the historical procedural error record information may be segmented, and each segmented word may be compared with the keywords in the keyword library one by one, so as to determine each second keyword included in the procedural error text description information in the historical procedural error record information.

Step S1032 determines similarity between the keywords and/or the number of the same keywords included in the first program error record information and the historical program error record information according to each first keyword and each second keyword.

In the embodiment of the present disclosure, when determining the similarity between keywords according to each first keyword and each second keyword, for each first keyword, the similarity between the first keyword and each second keyword may be calculated, the maximum similarity is used as the similarity of the first keyword, and the similarity between the keywords is calculated according to the similarity of each first keyword, for example, an average value of the similarities of each first keyword is used as the similarity between the keywords.

Of course, during actual calculation, when the maximum similarity is greater than a predetermined threshold, the maximum similarity value may be used as the similarity of the first keyword (it can be understood that, at this time, the similarity of the first keyword is higher, and is an effective similarity); when the maximum similarity is not greater than the predetermined threshold, the similarity of the first keyword is marked as 0 (it can be understood that the similarity of the first keyword is low, and is invalid similarity). Accordingly, when the similarity between keywords is calculated according to the similarity of each first keyword, an average value between the effective similarities of the first keywords may be calculated as the similarity between the keywords.

Of course, the above similarity calculation method between keywords is only an example, and when actually calculating, other methods may be used for calculation, which is not limited herein.

In the embodiment of the present disclosure, the number of the same keywords included in the first program error record information and the historical program error record information may also be determined according to each first keyword and each second keyword.

For example, of the first keywords 11, 12, and 13 and the second keywords 21 and 22, the first keyword 11 and the second keyword 21 are the same keyword, it is understood that the first bug record information and the historical bug record information include the same keyword (the first keyword 11 or the second keyword 21), and the first keyword 13 and the second keyword 22 are the same-meaning keywords, for example, mom and mom, it is understood that the first program error log information and the historical program error log information contain the same keyword (the first keyword 13 or the second keyword 22), therefore, the first program error record information and the historical program error record information contain two identical keywords, that is, the number of identical keywords included in the first program error log information and the historical program error log information is two.

Step S1033, determining a text similarity between the first program error record information and the historical program error record information according to the similarity between the keywords and/or the number of the same keywords.

In the embodiment of the present disclosure, the following three implementations are included, which are respectively denoted as implementation C1-implementation C3.

In the implementation manner C1, the text similarity may be determined according to the similarity between the keywords, for example, the similarity between the keywords is taken as the text similarity.

In the implementation manner C2, the text similarity may be determined according to the number of the same keywords, for example, a mapping relationship table between the number of the same keywords and the text similarity is preset, and after determining the number of one same keyword, the text similarity may be obtained through conversion according to the mapping relationship table.

In the implementation C3, the text similarity may be determined according to the similarity between the keywords and the number of the same keywords, for example, two similarities may be determined according to the implementation C1 and the implementation C2, respectively, and then the average value of the two similarities is used as the text similarity.

It is understood that the specific implementation in implementation C1-implementation C3 is merely an example, and the actual calculation may be performed in other manners, which is not limited herein.

Step S1034, according to the text similarity, the similarity between the first program error record information and the historical program error record information is determined.

In the embodiment of the present disclosure, the text similarity may be used as the similarity between the first program error record information and the historical program error record information, or the text similarity may be calculated with other similarities to obtain the similarity between the first program error record information and the historical program error record information, which is not limited herein.

In case B2, the bug record information includes bug picture information.

In case B2, if the program error record information includes program error picture information, then in step S103, for any historical program error record information, the similarity between the first program error record information and the historical program error record information in the program error record information base is determined, which may specifically include steps S1035 to S1036.

In step S1035, a picture structure similarity and/or a picture cosine similarity between the first program error record information and the historical program error record information is determined by using the program error picture information in the first program error record information and the program error picture information in the historical program error record information.

In the embodiment of the present disclosure, the picture structure Similarity may be determined by using a structure Similarity metric (SSIM), and the picture Cosine Similarity may be determined by using Cosine Similarity (Cosine Similarity). Of course, in actual execution, other manners for determining the similarity of the pictures may also be adopted, which is not limited herein.

Step S1036 determines the similarity between the first program error record information and the historical program error record information based on the picture structure similarity and/or the picture cosine similarity.

In the embodiment of the present disclosure, the image similarity may be used as the similarity between the first program error record information and the historical program error record information, or the image similarity may be calculated from other similarities to obtain the similarity between the first program error record information and the historical program error record information, which is not limited herein.

In case B3, the bug record information includes bug text description information and bug picture information.

In case B3, if the bug record information includes bug text description information and bug picture information, then, in step S103, for any historical bug record information, determining a similarity between the first bug record information and the historical bug record information in the bug record information base may specifically include steps S1037-S1039.

Step S1037 determines a text similarity between the first program error record information and the historical program error record information using the program error text description information in the first program error record information and the program error text description information in the historical program error record information.

In this embodiment of the disclosure, step S1037 may specifically include step S1031 to step S1033, and it may be seen from the relevant description of step S1031 to step S1033, which is not described herein again.

In step S1038, a picture similarity between the first program error record information and the historical program error record information is determined by using the program error picture information in the first program error record information and the program error picture information in the historical program error record information.

In the embodiment of the present disclosure, step S1038 may specifically include step S1035, and reference to relevant description of step S1035 is not repeated here.

Step S1039 determines a similarity between the first program error record information and the historical program error record information using at least one of a text similarity and a picture similarity between the first program error record information and the historical program error record information.

In the embodiment of the present disclosure, regarding the text similarity and the picture similarity of the first program error recording information and the historical program error recording information, a maximum similarity value among the text similarity and the picture similarity may be used as the similarity between the first program error recording information and the historical program error recording information; or the minimum similarity value in the text similarity and the picture similarity can be used as the similarity between the first program error record information and the historical program error record information; the average value of the text similarity and the picture similarity may also be used as the similarity between the first program error record information and the historical program error record information, which is not limited herein.

Of course, when calculating the average value of the text similarity and the picture similarity, the average value may be calculated using the text similarity and the weight information thereof, and the picture similarity and the weight information thereof, and the average value may be used as the similarity between the first program error record information and the historical program error record information.

To further illustrate case B3, as shown in fig. 5, fig. 5 is a schematic diagram for calculating similarity between bug records according to an embodiment of the present application. The similarity between the program error record information is the similarity between the first program error record information and the historical program error record information, the first program error record information includes program error text description information (fig. 5 is current program error text description information) and program error picture information (fig. 5 is current program error picture information), and the historical program error record information includes program error text description information (fig. 5 is historical program error text description information) and program error picture information (fig. 5 is historical program error picture information).

Specifically, the text similarity may be calculated by comparing the current program error text description information with the historical program error text description information, the picture similarity may be calculated by comparing the current program error picture information with the historical program error picture information, then the similarity between the first program error record information and the historical program error record information may be calculated based on the text similarity and the picture similarity, and when the similarity is higher, that is, the similarity is higher than a preset similarity threshold, the first program error record information and the historical program error record information may be merged.

In another possible implementation manner of the embodiment of the present disclosure, in step S104, when a similarity between a first program error record information and a certain historical program error record information is higher than a preset similarity threshold, merging the first program error record information and the historical program error record information, which may specifically include step S1041 and step S1042.

In step S1041, when the similarity between the first program error record information and a certain historical program error record information is higher than a preset similarity threshold, generating and displaying a merge prompt message by using the first program error record information and the historical program error record information.

During actual execution, the merged prompt information may be generated by using the historical program error record information and the first program error record information corresponding to each similarity higher than the preset similarity threshold, and each generated merged prompt information is displayed, or each generated merged prompt information is sent to the preset electronic device, and each merged prompt information is displayed by the preset electronic device.

The preset electronic device may include a designated electronic device, such as the electronic device numbered 0011, or an electronic device of a test group leader, and the preset electronic device may also include an electronic device related to any piece of merging prompt information, for example, the preset electronic device may include an electronic device of a submitter of historical program error record information corresponding to the merging prompt information, and/or an electronic device of a submitter of first program error record information corresponding to the merging prompt information.

In step S1042, when a merge confirmation operation for the merge hint information is received, the first program error record information and the historical program error record information are merged.

In the embodiment of the present disclosure, the electronic device displaying any one of the merged notification messages may receive a merge confirmation operation or cancel the merge operation performed by the user with respect to the merged notification message. When the merge confirmation operation is received, the historical program error record information corresponding to the merge prompt information may be merged with the first program error record information.

When the electronic equipment displaying any one piece of combined prompt information is preset electronic equipment, the preset electronic equipment generates a combined instruction and sends the combined instruction to the electronic equipment generating the combined prompt information when receiving a combined confirmation operation aiming at the combined prompt information, and after the electronic equipment generating the combined prompt information receives the combined instruction, the historical program error record information corresponding to the combined prompt information and the first program error record information are combined.

It should be noted that the historical program error record information corresponding to each piece of merging prompt information is the historical program error record information corresponding to the similarity higher than the preset similarity threshold.

Further, in step S104 or step S1042, merging the first program error record information and the historical program error record information, including:

deleting the first program error record information; alternatively, the historical program error record information is replaced with the first program error record information.

In the embodiment of the present disclosure, the first program error record information may be deleted, and the historical program error record information may be retained, so as to implement merging the first program error record information and the historical program error record information; the first program error record information may also be used to replace the historical program error record information, that is, the first program error record information is retained, and the historical program error record information is deleted, so as to implement merging of the first program error record information and the historical program error record information.

Of course, in actual implementation, new program error record information may be obtained by using the first program error record information and the historical program error record information, so as to implement merging the first program error record information and the historical program error record information.

In another possible implementation manner of the embodiment of the present disclosure, the method for testing the application program may further include step S105 and step S106.

In step S105, first model information of the test device related to the first bug record information is acquired.

And S106, analyzing through a pre-trained program error model association model based on the first model information and the first program error record information of the test equipment to obtain second model information, wherein the second model information refers to other model information of which the first program error record information can appear when the target application program is operated.

Wherein, for any model information, the model information comprises at least one of the following items:

central Processing Unit (CPU) information, Graphics Processing Unit (GPU) information, operating system information, screen information, Open Graphics Library (OpenGL) information, storage space information, and operating memory information.

The model information may include other information, such as battery information, in addition to the above-mentioned information.

In the embodiment of the present disclosure, step S105 and step S106 may be performed after step S103. During actual execution, the first model information of the testing equipment corresponding to the first program error record information can be acquired before or after the combination; or when the similarity does not exist in the similarity, the first program error record information cannot be merged with any historical program error record information, and the first model information of the test equipment corresponding to the first program error record information is acquired; when a non-merging instruction generated and sent by the merging cancellation operation or the preset electronic device based on the merging cancellation operation for the merging prompt information is received, at this time, the first program error record information is not merged with the historical program error record information corresponding to the similarity higher than the preset similarity threshold, and the first model information of the test device corresponding to the first program error record information is acquired.

In step S106, based on the first model information and the first programmed error record information of the test device, the second model information is obtained by analyzing a pre-trained programmed error model association model, which may specifically include step S1061 and step S1062.

Step S1061, obtaining the program error type of the program error and the keywords included in the first program error record information according to the first program error record information.

Step S1062, analyzing the pre-trained programmed error model association model to obtain second model information by using the keyword, the programmed error type of the programmed error, and the first model information included in the first programmed error record information.

Wherein the type of bug of the bug comprises at least one of:

an installed program error type, a started program error type, a running program error type, a screen-adapted program error type, a User Interface (UI) program error type, a (game) model program error type, a scene program error type, and the like.

The program error type of the program error is the program error type of the program error corresponding to the first program error record information.

In the embodiment of the present disclosure, as shown in fig. 2, the keyword, the program error type of the program error, and the first model information included in the first program error record information may be used as input information, and the second model information having the program error is determined by using the program error model association model, so as to associate the model information having the program error, prevent missing test, and improve the integrity of the test.

Specifically, the program error type of the program error may be converted into a1 × n matrix, where the preset number of model information is classified according to the program error type of the program error, so as to obtain n classes, each of which includes at least one model information, and n is a positive integer. And converting the keywords contained in the first program error record information into a1 x n matrix, and converting the first model information into an m x n matrix, wherein the first model information can be divided into m dimensions according to CPU information, GPU information, operating system information, screen information, OpenGL information, storage space information, running memory information and the like, and m is a positive integer. And inputting the two 1 x n matrixes and the m x n matrix into a programmed error model association model, and outputting the similarity values of the n categories by the programmed error model association model.

For the respective similarity values of the n categories, a category corresponding to the similarity value larger than a preset threshold value can be selected as a target category, and the model information in the target category is used as second model information.

In the embodiment of the disclosure, the program error type of the program error, the first program error record information, the first model information, the second model information, and the like may be stored, so that data analysis may be performed subsequently or the program error model association model may be updated, thereby increasing the accuracy of model prediction.

After the second model information with the program error is determined by using the keyword, the program error type of the program error and the first model information included in the first program error record information, the program error of the target application program can be tested in the test equipment corresponding to the second model information, and the program error has a very high probability to exist in the test equipment corresponding to the second model information, so that the efficiency of testing the program error can be improved on the basis of greatly reducing the number of the test equipment needing to be tested, and whether the program error exists in the test equipment corresponding to the second model information can be further verified.

And the second model information is determined by using the bug model association model.

The training data set of the program error model association model comprises training data subsets of all sample program errors, and the training data subset of any sample program error comprises program error record information of the sample program error and at least one sample model information of the sample program error.

Any sample program error can be a program error generated when an application program runs and/or a program error generated when the application program is tested, wherein the application program comprises a target application program and/or other application programs.

For any sample procedure error, the sample model information of the sample procedure error is at least one, for example, the sample device 0011 and the sample device 0201 may generate the same sample procedure error "login exception". The program error log information of the sample program error and at least one sample model information of the sample program error may be utilized to construct a training data subset of the sample program error.

Of course, the program error record information of the sample program error may be processed, for example, the keyword included in the program error record information of the sample program error is determined according to the program error record information of the sample program error, the program error type of the sample program error is determined according to the program error record information of the sample program error, and the training data subset of the sample program error is configured by using the determined keyword and program error type and at least one sample model information of the sample program error.

In the embodiment of the present disclosure, the method for testing the application program further includes:

when the similarity between the first program error record information and each historical program error record information is not higher than a preset similarity threshold, updating the first program error record information to a training set of a program error model association model; and the updated training set is used for optimizing the program error model association model.

In the embodiment of the disclosure, when the similarity between the first program error record information and each historical program error record information is not higher than the preset similarity threshold, it indicates that the first program error record information is newly appeared program error record information, and the first program error record information can be collected in real time.

The collected first program error record information can be updated to a training set of the program error model association model, and the program error model association model is optimized by using the updated training set.

While the above method for testing an application program is specifically described from the perspective of method steps, for better understanding and explaining the schemes provided in the embodiments of the present application, the following describes alternative embodiments of the present application with reference to specific application scenarios. In the application scenario, the Bug is a Bug (English name: Bug).

Fig. 6 is a schematic diagram of processing a current Bug according to an embodiment of the present application, where an execution subject of fig. 6 is the electronic device described above. Specifically, before the tester tests the application program, the tester can configure the tester type information to be tested and the tester to perform the test according to the test requirement, and the electronic device can acquire the configured tester type information and the tester information and generate a test record by using the tester type information and the tester information. The tester type information comprises at least one, and the tester information also comprises at least one.

After the test record is generated, a tester can perform a test on a test machine type corresponding to the test machine type information, and the number of the bugs obtained by the test may be 0 or at least one. When the Bug (which can be recorded as the current Bug) is obtained through the test, a tester can fill a test record on the collaborative test platform, the tester can fill Bug record information (which can be recorded as the current Bug record information) of the current Bug in the test record, and the filled test record is stored in the electronic equipment. The current Bug record information comprises a text description of the current Bug and a picture of the current Bug.

The electronic equipment can obtain the current Bug record information filled in the test record, and compares the current Bug record information with each historical Bug record information to obtain the similarity between the current Bug record information and each historical Bug record information. Each piece of historical Bug record information can be stored in a Bug record information base, and any piece of historical Bug record information comprises a text description of the historical Bug and a picture of the historical Bug.

Further, for the similarity between the current Bug record information and each historical Bug record information, when the similarity is higher than a threshold (namely a preset similarity threshold), merging the historical Bug record information corresponding to the similarity higher than the threshold with the current Bug record information; and when the similarity is not higher than the threshold, model association can be carried out by using the current Bug record information, namely, other model information capable of presenting the current Bug is obtained by using the type of the current Bug, the keyword in the current Bug record information and the test model information corresponding to the test model of the current Bug.

Furthermore, after the recorded information of each Bug obtained by the test is processed in the above manner, a test report can be generated and stored. The test report may be stored in the cloud, or locally, or in a database or any other storage device.

The method for testing the application program is specifically described from the perspective of the method steps, and the following introduces a testing apparatus for the application program from the perspective of the virtual module, specifically as follows:

the embodiment of the present disclosure provides a testing apparatus for an application, and as shown in fig. 3, the testing apparatus 30 for an application may include: an acquisition module 301, a lookup module 302, a determination module 303, and a merge module 304, wherein,

an obtaining module 301, configured to obtain first program error record information generated by testing a target application program.

The searching module 302 is configured to search a program error record information base of the target application program, where each piece of historical program error record information generated by testing the target application program is recorded in the program error record information base.

A determining module 303, configured to determine similarity between the first program error record information and each historical program error record information in the program error record information base.

The merging module 304 is configured to merge the first program error record information with the historical program error record information when a similarity between the first program error record information and a certain historical program error record information is higher than a preset similarity threshold.

In another possible implementation manner of the embodiment of the present disclosure, the obtaining module 301 is further configured to:

acquiring first model information of the test equipment related to the first program error record information;

based on the first model information and the first program error record information of the test equipment, second model information is obtained by analyzing a pre-trained program error model correlation model, and the second model information refers to other model information of which the first program error record information can appear when the target application program is operated.

In another possible implementation manner of the embodiment of the present disclosure, the merging module 304 is specifically configured to:

when the similarity between the first program error record information and a certain historical program error record information is higher than a preset similarity threshold, generating and displaying merging prompt information by using the first program error record information and the historical program error record information;

and when a merging confirmation operation aiming at the merging prompt information is received, merging the first program error record information and the historical program error record information.

In another possible implementation manner of the embodiment of the present disclosure, when the merging module 304 merges the first program error record information and the historical program error record information, it is specifically configured to:

deleting the first program error record information; alternatively, the first and second electrodes may be,

the historical program error record information is replaced with the first program error record information.

In another possible implementation manner of this embodiment of the present disclosure, when determining, for any piece of historical program error record information, a similarity between the first piece of program error record information and the piece of historical program error record information in the program error record information base, the determining module 303 is specifically configured to:

determining the text similarity between the first program error record information and the historical program error record information by using the program error text description information in the first program error record information and the program error text description information in the historical program error record information;

determining picture similarity between the first program error record information and the historical program error record information by using program error picture information in the first program error record information and program error picture information in the historical program error record information;

determining a similarity between the first program error record information and the historical program error record information using at least one of a text similarity and a picture similarity between the first program error record information and the historical program error record information.

In another possible implementation manner of the embodiment of the present disclosure, when determining the text similarity between the first program error record information and the historical program error record information by using the program error text description information in the first program error record information and the program error text description information in the historical program error record information, the determining module 303 is specifically configured to:

determining each first keyword contained in program error text description information in the first program error record information and each second keyword contained in program error text description information in the historical program error record information;

determining similarity between keywords and/or the number of the same keywords contained in the first program error record information and the historical program error record information according to the first keywords and the second keywords;

and determining the text similarity of the first program error record information and the historical program error record information according to the similarity between the keywords and/or the number of the same keywords.

In another possible implementation manner of the embodiment of the present disclosure, when determining, by using the program error picture information in the first program error record information and the program error picture information in the historical program error record information, the picture similarity between the first program error record information and the historical program error record information, the determining module 303 is specifically configured to:

and determining picture structure similarity and/or picture cosine similarity between the first program error record information and the historical program error record information by utilizing the program error picture information in the first program error record information and the program error picture information in the historical program error record information.

In another possible implementation manner of the embodiment of the present disclosure, the apparatus further includes:

the updating module is used for updating the first program error record information to a training set of the program error model association model when the similarity between the first program error record information and each historical program error record information is not higher than a preset similarity threshold; and the updated training set is used for optimizing the program error model association model.

The testing apparatus 30 of the application program of this embodiment can execute the testing method of the application program provided in the method embodiment of the present disclosure, and the implementation principles thereof are similar, and are not described herein again.

Compared with the prior art, the testing device of the application program obtains the first program error record information generated by testing the target application program, searches the program error record information base of the target application program, records each historical program error record information generated by testing the target application program in the program error record information base, determines the similarity between the first program error record information and each historical program error record information in the program error record information base, and combines the first program error record information and the historical program error record information when the similarity between the first program error record information and a certain historical program error record information is higher than a preset similarity threshold value, so that the similarity between the first program error record information and each historical program error record information is calculated, the historical program error record information corresponding to the similarity greater than the preset similarity threshold and the first program error record information are automatically combined, so that the labor consumption and the time consumption in the analysis process can be reduced, and the test efficiency is improved.

The above describes the testing device of the application program of the present disclosure from the perspective of a virtual module, and the following describes the electronic device of the present disclosure from the perspective of a physical device.

An embodiment of the present disclosure provides an electronic device, as shown in fig. 4, the electronic device includes:

one or more processors;

a memory;

one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to: a test method of the application shown according to the method embodiment is performed.

Referring now to fig. 4, a schematic diagram of an electronic device (e.g., a terminal device or server) 400 suitable for use in implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

The electronic device includes: a memory and a processor, wherein the processor may be referred to as a processing device 401 described below, and the memory may include at least one of a Read Only Memory (ROM)402, a Random Access Memory (RAM)403, and a storage device 408, which are described below:

as shown in fig. 4, electronic device 400 may include a processing device (e.g., central processing unit, graphics processor, etc.) 401 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)402 or a program loaded from a storage device 408 into a Random Access Memory (RAM) 403. In the RAM 403, various programs and data necessary for the operation of the electronic apparatus 400 are also stored. The processing device 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.

Generally, the following devices may be connected to the I/O interface 405: input devices 406 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 407 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 408 including, for example, tape, hard disk, etc.; and a communication device 409. The communication means 409 may allow the electronic device 400 to communicate wirelessly or by wire with other devices to exchange data. While fig. 4 illustrates an electronic device 400 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 409, or from the storage device 408, or from the ROM 402. The computer program performs the above-described functions defined in the methods of the embodiments of the present disclosure when executed by the processing device 401.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.

The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring first program error record information generated by testing a target application program; searching a program error record information base of the target application program, wherein the program error record information base records various historical program error record information generated by testing the target application program; determining similarity between the first program error record information and each historical program error record information in the program error record information base; and when the similarity between the first program error record information and one piece of historical program error record information is higher than a preset similarity threshold, merging the first program error record information and the historical program error record information.

Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The modules or units described in the embodiments of the present disclosure may be implemented by software or hardware. The name of a module or a unit does not in some cases constitute a limitation of the unit itself, and for example, the determination module may be further described as a "module that determines a similarity between the first program error record information and each of the historical program error record information in the program error record information base".

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The electronic device of the present disclosure is described above from the perspective of a physical apparatus, and the computer-readable medium of the present disclosure is described below from the perspective of a medium.

The embodiment of the present disclosure provides a computer-readable medium, on which a computer program is stored, which, when running on a computer, enables the computer to execute the corresponding content in the foregoing method embodiments.

According to one or more embodiments of the present disclosure, there is provided an application program testing method, including:

searching a program error record information base of the target application program, wherein the program error record information base records various historical program error record information generated by testing the target application program;

and when the similarity between the first program error record information and one piece of historical program error record information is higher than a preset similarity threshold, merging the first program error record information and the historical program error record information.

According to one or more embodiments of the present disclosure, the method further comprises:

and analyzing through a pre-trained program error model association model based on the first model information of the test equipment and the first program error record information to obtain second model information, wherein the second model information refers to other model information of the first program error record information when the target application program is operated.

According to one or more embodiments of the present disclosure, merging the first program error record information and the historical program error record information when a similarity between the first program error record information and the historical program error record information is higher than a preset similarity threshold includes:

when the similarity between the first program error record information and one piece of historical program error record information is higher than a preset similarity threshold, generating and displaying merging prompt information by using the first program error record information and the historical program error record information;

According to one or more embodiments of the present disclosure, merging the first program error log information with the historical program error log information includes:

replacing the historical program error record information with the first program error record information.

According to one or more embodiments of the present disclosure, for any historical program error record information, determining a similarity between the first program error record information and the historical program error record information in the program error record information base includes:

determining the picture similarity between the first program error record information and the historical program error record information by using the program error picture information in the first program error record information and the program error picture information in the historical program error record information;

and determining the similarity between the first program error record information and the historical program error record information by using at least one of the text similarity and the picture similarity between the first program error record information and the historical program error record information.

According to one or more embodiments of the present disclosure, the determining the text similarity between the first program error record information and the historical program error record information by using the program error text description information in the first program error record information and the program error text description information in the historical program error record information includes:

According to one or more embodiments of the present disclosure, the determining a picture similarity between the first program error record information and the historical program error record information by using the program error picture information in the first program error record information and the program error picture information in the historical program error record information includes:

when the similarity between the first program error record information and each historical program error record information is not higher than a preset similarity threshold, updating the first program error record information to a training set of the program error model association model; and the updated training set is used for optimizing the program error model association model.

According to one or more embodiments of the present disclosure, there is provided a test apparatus of an application program, including:

and the merging module is used for merging the first program error record information and the historical program error record information when the similarity between the first program error record information and one of the historical program error record information is higher than a preset similarity threshold value.

According to one or more embodiments of the present disclosure, the obtaining module is further configured to:

According to one or more embodiments of the present disclosure, the merging module is specifically configured to:

According to one or more embodiments of the present disclosure, when merging the first program error record information and the historical program error record information, the merging module is specifically configured to:

According to one or more embodiments of the present disclosure, the determining module, when determining, for any one of the historical program error record information, a similarity between the first program error record information and the historical program error record information in the program error record information base, is specifically configured to:

According to one or more embodiments of the present disclosure, when determining the text similarity between the first program error record information and the historical program error record information by using the program error text description information in the first program error record information and the program error text description information in the historical program error record information, the determining module is specifically configured to:

According to one or more embodiments of the present disclosure, when determining the picture similarity between the first program error record information and the historical program error record information by using the program error picture information in the first program error record information and the program error picture information in the historical program error record information, the determining module is specifically configured to:

According to one or more embodiments of the present disclosure, the apparatus further comprises:

According to one or more embodiments of the present disclosure, there is provided an electronic device including:

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to: a test method of the application shown according to the method embodiment is performed.

According to one or more embodiments of the present disclosure, a computer-readable medium has stored thereon a computer program which, when executed by a processor, implements a method of testing an application program as shown in method embodiments.

The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A method for testing an application program, comprising:

2. The method of claim 1, further comprising:

3. The method of claim 1, wherein merging the first program error log information with the historical program error log information when a similarity between the first program error log information and the historical program error log information is higher than a preset similarity threshold comprises:

4. The method of claim 1 or 3, wherein merging the first program error log information with the historical program error log information comprises:

5. The method of claim 1, wherein determining a similarity between the first program error log information and any historical program error log information in the library of program error log information for any historical program error log information comprises:

6. The method of claim 5, wherein determining the text similarity between the first program error record information and the historical program error record information using the program error text description information in the first program error record information and the program error text description information in the historical program error record information comprises:

7. The method of claim 5, wherein determining the picture similarity between the first program error record information and the historical program error record information using the program error picture information in the first program error record information and the program error picture information in the historical program error record information comprises:

8. The method of claim 2, further comprising:

9. An apparatus for testing an application, comprising:

10. An electronic device, comprising:

one or more processors;

a memory;

one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to: a test method for executing an application according to any one of claims 1 to 8.

11. A computer-readable medium, on which a computer program is stored, which, when being executed by a processor, carries out a method for testing an application program according to any one of claims 1 to 8.