CN112732559A

CN112732559A - Picture comparison method, automatic dial testing method and system and storage medium

Info

Publication number: CN112732559A
Application number: CN202011613406.9A
Authority: CN
Inventors: 郭光景
Original assignee: Guangdong Yueyun Industrial Internet Innovation Technology Co ltd
Current assignee: Guangdong Yueyun Industrial Internet Innovation Technology Co ltd
Priority date: 2020-12-30
Filing date: 2020-12-30
Publication date: 2021-04-30

Abstract

The application discloses a picture comparison method, an automatic dial testing method and system and a computer readable storage medium. The picture comparison method comprises the following steps: acquiring an interface picture and a preset picture of an operation interface; acquiring a first resolution of an interface picture and a second resolution of a preset picture; in response to the first resolution being different from the second resolution, converting the interface picture and the preset picture into the same pixel coordinate system through equal-proportion conversion; extracting first characteristic information from the converted interface picture, and extracting second characteristic information from the converted preset picture; matching the first characteristic information with the second characteristic information; and responding to the successful matching, and judging that the interface picture is consistent with the preset picture. By the method, the image comparison accuracy can be improved.

Description

Picture comparison method, automatic dial testing method and system and storage medium

Technical Field

The present application relates to the field of automated testing techniques, and in particular, to a method for comparing pictures, a method and system for automated testing, and a computer-readable storage medium.

Background

Dial testing, i.e. dial testing, is a communication technology in which an operator initially dials a call number to determine whether a communication line is normal or unblocked. Dial testing is now extended to the field of internet software products, which means that operators simulate users to use software to judge service availability. After a software product needing to interact with a server is on line, service operators need to fixedly or non-fixedly test the main service flow of the software so as to observe whether the system can normally operate and maintain the corresponding design performance.

The inventor finds that in the long-term research and development process, in order to restore the whole service flow of the man-machine interaction of the service on the terminal and improve the intuition of the service, the service flow and the operation result thereof can be displayed in a picture form and compared with an expected interface picture to generate a test result; however, the conventional image comparison method is low in accuracy, so that the test result is easy to make mistakes.

Disclosure of Invention

The technical problem that this application mainly solved is how the precision of picture comparison.

In order to solve the technical problem, the application adopts a technical scheme that: an image comparison method is provided. The picture comparison method comprises the following steps: acquiring an interface picture and a preset picture of an operation interface; acquiring a first resolution of an interface picture and a second resolution of a preset picture; in response to the first resolution being different from the second resolution, converting the interface picture and the preset picture into the same pixel coordinate system through equal-proportion conversion; extracting first characteristic information from the converted interface picture, and extracting second characteristic information from the converted preset picture; matching the first characteristic information with the second characteristic information; and responding to the successful matching, and judging that the interface picture is consistent with the preset picture.

In order to solve the above technical problem, another technical solution adopted by the present application is: an automatic dial testing method is provided. The automatic dial testing method comprises the following steps: the dialing and testing end compiles a test script based on the service to be tested and sets an execution condition, wherein the test script comprises the execution logic and the operation steps of the service to be tested; in response to the execution condition being triggered, the dialing and testing terminal sends the test script to the client terminal; the client starts the service to be tested according to the test script, runs the operation steps according to the execution logic, and renders an operation interface based on the operation steps; the client acquires an interface picture of the operation interface, and compares the interface picture with a preset picture by adopting the picture comparison method to obtain a comparison result; and the client generates a test report based on the comparison result.

In order to solve the above technical problem, another technical solution adopted by the present application is: an automatic dial testing system is provided. This automatic dial testing system includes: the system comprises a dial-up test terminal and a client end communicated with the dial-up test terminal, wherein the dial-up test terminal compiles a test script on the service to be tested and sets an execution condition, and the test script comprises the execution logic and operation steps of the service to be tested; in response to the execution condition being triggered, the dialing and testing terminal sends the test script to the client terminal; the client starts the service to be tested according to the test script, runs the operation steps according to the execution logic, and renders an operation interface based on the operation steps; the client acquires an interface picture of the operation interface, and compares the interface picture with a preset picture by adopting the picture comparison method to obtain a comparison result; and the client generates a test report based on the comparison result.

In order to solve the above technical problem, another technical solution adopted by the present application is: a computer-readable storage medium is provided. The computer readable storage medium stores program instructions that can be executed to implement the image comparison method and the automatic dial testing method.

The beneficial effects of the embodiment of the application are that: the image comparison method comprises the following steps: acquiring an interface picture and a preset picture of an operation interface; acquiring a first resolution of an interface picture and a second resolution of a preset picture; in response to the first resolution being different from the second resolution, converting the interface picture and the preset picture into the same pixel coordinate system through equal-proportion conversion; extracting first characteristic information from the converted interface picture, and extracting second characteristic information from the converted preset picture; matching the first characteristic information with the second characteristic information; and responding to the successful matching, and judging that the interface picture is consistent with the preset picture. By the mode, when the characteristic information of different pictures of the same operation interface is matched, the different pictures are converted in equal proportion, so that the different pictures are converted into the same pixel coordinate system, bitmap data of the same picture element in the different pictures can be consistent, and the problem that the bitmap data of the picture element is inconsistent due to different picture resolutions and further the picture comparison precision is low can be solved; therefore, the method and the device can improve the image comparison accuracy.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

FIG. 1 is a schematic flow chart diagram illustrating an embodiment of an automatic dial testing method according to the present application;

FIG. 2 is a schematic flow chart diagram illustrating an embodiment of an automatic dial testing method according to the present application;

FIG. 3 is a flowchart illustrating a specific step of step S203 in the automatic dial testing method of the embodiment of FIG. 2;

FIG. 4 is a schematic flow chart diagram illustrating an embodiment of an automatic dial testing method according to the present application;

FIG. 5 is a schematic flow chart diagram illustrating an embodiment of an automatic dial testing method according to the present application;

FIG. 6 is a schematic flow chart diagram illustrating an embodiment of an automatic dial testing method according to the present application;

FIG. 7 is a flowchart illustrating an embodiment of a method for comparing images according to the present application;

FIG. 8 is a flowchart illustrating a specific step of step S705 in the method for comparing FIG. 7;

FIG. 9 is a flowchart illustrating the detailed step of step S802 in the embodiment of FIG. 8;

FIG. 10 is a flowchart illustrating the detailed step of step S802 in the embodiment of FIG. 8;

FIG. 11 is a flowchart illustrating the detailed step of step S1002 in the embodiment of FIG. 10;

FIG. 12 is a flowchart illustrating the detailed step of step S802 in the embodiment of FIG. 8;

FIG. 13 is a flowchart illustrating an embodiment of a method for comparing images according to the present application;

FIG. 14 is a schematic structural diagram of an embodiment of an automatic dial testing system according to the present application;

FIG. 15 is a schematic view of the workflow of the automatic dial testing system of the embodiment of FIG. 14;

FIG. 16 is a schematic structural diagram of an embodiment of a computer-readable storage medium according to the present application.

Detailed Description

The present application will be described in further detail with reference to the following drawings and examples. It is to be noted that the following examples are only illustrative of the present application, and do not limit the scope of the present application. Likewise, the following examples are only some examples and not all examples of the present application, and all other examples obtained by a person of ordinary skill in the art without any inventive step are within the scope of the present application.

The existing dial testing generally adopts two modes of manual operation or automatic operation, wherein the automatic dial testing generally adopts special software, a professional technical developer compiles a test script according to a server interface, when the script runs, the test software automatically initiates a request to the server interface and obtains a return value, and whether the service runs normally is judged by judging whether the return value is correct or not.

Therefore, the existing automatic dial test can only judge whether the server operates, but cannot judge whether an interface of server data rendered on a terminal is normal, and cannot test the performance index of a service; moreover, scripts need to be compiled by professional personnel, and service operators who actually execute tests often do not have script compiling capability, so that the full service flow of man-machine interaction of services on the terminal cannot be restored by the method, and the usability of the services cannot be visually observed.

To solve the above problems, the present application first provides an automatic dial testing method, as shown in fig. 1, where fig. 1 is a schematic flow chart of an embodiment of the automatic dial testing method. The automatic dial testing method of the embodiment specifically comprises the following steps:

step S101: and the dialing and testing terminal compiles a test script based on the service to be tested and sets an execution condition, wherein the test script comprises the execution logic and the operation steps of the service to be tested.

The dial testing end may be a server or a professional dial testing management platform, and the like, and is not limited specifically.

The execution condition of the present embodiment may be a timing trigger condition or an instruction trigger condition. For example, a timer program is set at the dial-up test end, a preset duration is set, and when the timing of the timer is equal to or greater than the preset duration, the timing trigger condition is triggered, although the timer may be replaced by a clock module; for another example, when the dial testing terminal receives an operation instruction, the instruction triggering condition is triggered.

The service to be tested can be a single or multiple service programs, which often include multiple operation steps (service flows), and the multiple operation steps are executed by the set execution logic to ensure normal operation of the service to be tested.

Step S102: and responding to the triggering of the execution condition, and sending the test script to the client by the dialing test terminal.

The client of the embodiment may be a mobile terminal, such as a mobile phone, or other electronic products, such as a computer.

When the timing of the timer is equal to or longer than the preset time length or an operation instruction is received, the dialing and testing end triggers the execution condition and sends the compiled test script of the service to be tested to the client.

Step S103: and the client starts the service to be tested according to the test script, runs the operation steps according to the execution logic, and renders an operation interface based on the operation steps.

The test script of the embodiment further comprises a starting method of the service to be tested, and the client acquires the starting method of the service to be tested from the test script and starts the service to be tested according to the starting method; the starting method at least comprises a starting instruction and identification information of the service to be tested, so that the client can identify the service to be tested to be dialed according to the identification information.

In order to improve the intuitiveness of the dial-up test process and the result, the running process and the running result of the operation step of the service to be tested are rendered to the interface of the client.

Step S104: the client acquires an interface picture of the operation interface, and compares the interface picture with a preset picture to obtain a comparison result.

The interface picture of this embodiment includes an interface picture of an operation process and an interface picture of an operation result of each operation step of the service to be tested.

Step S105: and the client generates a test report based on the comparison result.

And responding to the failure of the interface picture and the preset picture, and generating an error log and alarm information.

The test report of this embodiment at least includes: the comparison result of the interface pictures of all the operation steps (operation process and operation result) of the service to be tested, the abnormal condition of the comparison, the time length for presenting the operation of each operation step according to a report form mode and the like.

Further, the client sends the test report to the dial testing terminal, so that the dial testing terminal analyzes the test report and processes the alarm information in time.

Different from the prior art, the embodiment triggers the execution condition so that the dialing and testing end sends the test script to the client and controls the client to dial and test the service to be tested, thereby realizing the automatic dialing and testing of the service to be tested; in addition, the embodiment renders an operation interface for the operation steps of the service to be tested, so that information such as the operation process, the operation result and the like of the operation steps can exist in the form of interface pictures, and the operation flow and the operation result of the service to be tested can be more visual. Therefore, the method and the device can realize automatic dial testing of the service, and can improve the operation flow and the intuitiveness of the operation result of the automatic dial testing of the service.

The present application further provides an automatic dial testing method according to another embodiment, as shown in fig. 2, the automatic dial testing method according to this embodiment specifically includes the following steps:

step S201: the client pre-runs the service to be tested, and acquires a first interface picture of each operation step when the service to be tested runs.

Specifically, the client pre-runs each operation step of the service to be tested according to the execution logic of the service to be tested, and acquires a first interface picture of an operation interface of each operation step. On one hand, whether the service to be tested installed at the client can normally run can be detected, on the other hand, the whole running process of the service to be tested can be recorded, and each operation step and the running result thereof are stored in the form of interface pictures.

Before the test script is compiled, the dial testing end and the client end are operated, and the normal operation of the service program to be tested under the control of the dial testing end is ensured.

Step S202: and the client sends the execution logic of the service to be tested and the first interface picture to the dial testing terminal.

The client sends the execution logic of the service to be tested and the first interface picture to the dial testing terminal, so that the dial testing terminal can compile a test script of the service to be tested according to the execution logic and the first interface picture.

Step S203: and the dialing and testing terminal compiles a testing script based on the service to be tested and sets an execution condition.

The test script of this embodiment may adopt formatted text records, where the picture in the test script may be stored by a file server, and record a Uniform Resource Locator (URL) of the picture; the test script of this embodiment mainly includes a starting method of the service to be tested, an execution logic, a creation time of the test script, and information of all operation steps of the service to be tested, where the information includes a screenshot URL of an operation interface of each operation step, a URL of an expected result, and an area where comparison is not involved, and the like.

Alternatively, the present embodiment may implement step S203 by using the method shown in fig. 3. The method of the present embodiment specifically includes steps S301 to S304.

Step S301: and the dialing and testing terminal compiles a starting method for the service to be tested.

The starting method at least comprises a starting instruction and identification information of the service to be tested, so that the client can identify the service to be tested to be dialed according to the identification information.

Step S302: and the dialing and testing end compiles an operation step for the service to be tested and compiles an operation interface for the operation step.

According to the analysis, the service to be tested has a plurality of operation steps, and the dial testing end compiles an operation interface for each operation step.

The dialing and testing end can compile an operation interface according to a first interface picture of operation steps acquired when the client runs in advance.

Step S303: and the dialing and measuring end is used for compiling operation on an operation interface, wherein the operation comprises single click operation, double click operation, long press operation, expansion operation, reduction operation and sliding operation.

Further, the dial testing end divides the operation interface into an operation area and a non-operation area, and compiles the operation in the operation area; and the dial-testing end marks the non-operation area and acquires an interface picture of the marked operation interface as a preset picture.

As can be seen from the above analysis, when a test report is generated, an interface picture of an operation interface where a service to be tested runs at a client needs to be compared with a preset picture, and the preset picture in this embodiment has a negligible (non-operational) picture region, so that picture comparison may not be performed on the negligible picture region, and thus, the picture comparison efficiency can be improved, and further, the automatic dial test efficiency is improved.

In other embodiments, the client may also program other operations on the operation interface.

Step S304: and the dialing and testing terminal compiles execution logic for the service to be tested.

Multiple operational steps of the service to be dial-up tested should be associated with the execution logic.

Step S305: and creating a blank script, and storing the starting method, the operation steps, the operation interface, the operation and execution logic thereof in the blank script to generate a test script.

The test script further includes identification information (which may be the above-mentioned marking information) of the negligible picture area of the preset picture.

In an application scenario, as shown in fig. 4, the dial-up test end starts to create a test script, a blank script is created first, and then a starting method of a service to be tested is set in the blank script; a new step (operation step) is carried out, wherein in the step, an operation interface is compiled for the operation step (the data of the operation interface can be obtained according to the operation interface provided by the client); then, an operation area is marked out from the operation interface, and an operation is added to the operation area, for example, a click operation can be added, a click operation and a double click operation can be added under the click operation, for example, a new increase press operation can be added, for example, a new increase two-finger zoom operation can be added, an expansion operation and a reduction operation can be added in the two-finger zoom operation, for example, a new increase slide operation can be added, a slide direction can be selected, and the like; by dividing an operation area and adding operation newly, an expected result interface and an interface picture (corresponding to a preset picture of the application) thereof can be obtained; obtaining a negligible area (non-operation area) of the interface picture according to the operation area; storing the operations and steps; the method can be adopted to realize the compilation of each operation step of the service to be tested and store the compilation so as to finish the compilation of the test script.

Finally, setting an execution condition for the test script, specifically setting a timing period and time (timing execution) for the test script; the execution condition may also be other trigger conditions, and is not limited specifically.

Step S204: and responding to the triggering of the execution condition, and sending the test script to the client by the dialing test terminal.

Step S205: and the client starts the service to be tested according to the test script, runs the operation steps according to the execution logic, and renders an operation interface based on the operation steps.

Step S206: the client acquires an interface picture of the operation interface, and compares the interface picture with a preset picture to obtain a comparison result.

Step S207: and the client generates a test report based on the comparison result.

Steps S204 to S207 are similar to steps S102 to S105 described above, and are not repeated here.

The present application further provides an automatic dial testing method according to another embodiment, as shown in fig. 5, the automatic dial testing method specifically includes the following steps:

step S501: and the dialing and testing terminal compiles a test script based on the service to be tested and sets an execution condition, wherein the test script comprises the execution logic and the operation steps of the service to be tested.

Step S502: and responding to the triggering of the execution condition, and sending the test script to the client by the dialing test terminal.

Step S503: and the client starts the service to be tested according to the test script.

Step S504: and the client runs the operation steps according to the execution logic and renders an operation interface based on the operation steps.

Step S505: the client acquires an interface picture of the operation interface, and compares the interface picture with a preset picture to obtain a comparison result.

Steps S501 to S505 are similar to steps S102 to S104, and are not repeated here.

Step S506: in response to the failure of the comparison, the client generates an error log, and performs step S504.

And responding to the comparison failure, the client generates an error log, and runs the next operation step of the service to be tested according to the execution logic until all operation steps of the service to be tested are completed.

The error log at least comprises an interface picture and interface rendering time.

Step S507: in response to the comparison being successful, step S504 is performed.

And responding to the comparison failure, the client operates the next operation step of the service to be tested according to the execution logic, and stores the operation process data and the operation result (which can be in the form of an interface picture) of the current operation step.

Step S508: and the client generates a test report based on the comparison result.

Step S508 is similar to step S105 described above and will not be described here.

The automatic dial testing method of the present embodiment further includes step S509 and step S510.

Step S509: the client monitors the running condition of the service to be tested.

Step S510: and responding to the abnormal operation condition, the client generates first alarm information, and the first alarm information is recorded into the test report.

Through the steps of S509 and S510, the first alarm information can be generated when the automatic dial test generates an abnormality, and the client sends the test report to the dial test terminal, so that the operation and maintenance personnel can handle the abnormality in time according to the first alarm information.

The automatic dial testing method of the present embodiment further includes steps S511 to S513.

Step S511: and responding to the received dial testing instruction of the service to be tested, and carrying out function monitoring on the service to be tested by the client.

Before sending the test script to the client or at the same time of sending the test script to the client, the dial testing end sends a dial testing instruction to the client; and the client monitors the function of the service to be tested according to the dial test instruction so as to determine whether the service to be tested installed on the client can normally run.

Step S512: in response to the monitoring success, step S503 is performed.

Step S513: and responding to the monitoring failure, generating an error log, generating second alarm information, and recording the error log and the second alarm information into a test report.

Through the steps S511 and S513, the second alarm information can be generated when the detection of the service function to be detected fails, and the client sends the test report to the dial-test terminal, so that the operation and maintenance personnel can handle the abnormality in time according to the second alarm information.

In an application scenario, as shown in fig. 6, after receiving a dial test instruction and a test script, a client performs a function self-test on the client; if the self-check is passed, starting the service (the service to be detected), running the operation steps according to the sequence (execution logic), and rendering an interface (an operation interface) for the operation steps; judging whether the interface rendering is finished or not, if so, recording rendering time, and carrying out screen capture processing on the operation interface to obtain a screenshot (interface picture) of the operation interface; comparing the screenshot with an expected interface (a preset picture), and if the screenshot accords with the expected interface, executing script preset operation (operation steps) in sequence until all the operation steps are completed; if the screenshot does not conform to the expected interface, recording an error log, and executing script preset operation (operation steps) in sequence until all operation steps are completed; if the self-check fails, recording an error log, generating an alarm, and writing the alarm into a test report; monitoring the operation of each operation step, generating an alarm when the operation of the operation step is abnormal, and writing the alarm into a test report; and finally, sending the test report to the dial testing end, analyzing the test report of the dial testing end and timely processing the abnormity according to the alarm.

The test report can be sent to the dialing and testing terminal at regular time, according to the operation steps or according to the alarm.

The present application further provides an image comparison method, as shown in fig. 7, fig. 7 is a schematic flowchart of an embodiment of the image comparison method of the present application. The image comparison method of the embodiment specifically comprises the following steps:

step S701: and acquiring an interface picture and a preset picture of the operation interface.

The interface picture and the preset picture are two screenshots of the same operation interface.

Step S702: and acquiring a first resolution of the interface picture and a second resolution of the preset picture.

Specifically, the width and the height of the interface picture are obtained, and the width and the height of the preset picture are obtained.

Step S703: and in response to the first resolution being different from the second resolution, converting the interface picture and the preset picture into the same pixel coordinate system through equal-proportion conversion.

Under the influence of the resolution of the operation interface, the resolution of the interface screenshot (interface picture) of the operation interface of the device with different resolutions is different, which results in the inconsistency of the bitmap information of the same operation interface on the devices with different resolutions, and therefore, the interface picture and the preset picture need to be converted in equal proportion, so that the interface picture and the preset picture have the same proportion pixel coordinate system, that is, the interface picture and the preset picture are converted into the same pixel coordinate system, and the position coordinate of the same picture element in the interface picture can be the same as the position coordinate of the same picture element in the preset picture.

The embodiment can realize equal-scale conversion of the interface picture and the preset picture by scaling the interface picture and/or the preset picture.

Step S704: and extracting first characteristic information from the converted interface picture, and extracting second characteristic information from the converted preset picture.

The feature information of the picture may include picture elements and position coordinates thereof, and the picture elements may include color blocks, lines, texts, and the like.

Step S705: and matching the first characteristic information with the second characteristic information.

Step S705 may be implemented using the embodiments of fig. 8 to 12.

Step S706: and responding to the successful matching, and judging that the interface picture is consistent with the preset picture.

And responding to the matching failure, and judging that the interface picture is inconsistent with the preset picture.

Different from the prior art, when matching the feature information of different pictures of the same operation interface, the embodiment performs equal-proportion conversion on the different pictures to convert the different pictures into the same pixel coordinate system, so that the bitmap data of the same picture element in the different pictures can be consistent, and the problem that the bitmap data of the picture element is inconsistent due to different picture resolutions and the comparison precision of the pictures is not high can be solved; therefore, the embodiment can improve the image comparison accuracy.

Alternatively, the present embodiment may implement step S705 by using the method shown in fig. 8. The first characteristic information of this embodiment includes an interface picture element and a first position coordinate of the interface picture element in a pixel coordinate system, and the second characteristic information includes a preset picture element and a second position coordinate of the preset picture element in the pixel coordinate system. The method of the present embodiment specifically includes steps S801 to S803.

Step S801: the first position coordinates are matched with the second position coordinates.

As can be seen from the above analysis, the position coordinates of the same picture element in the interface picture are the same as the position coordinates of the same picture element in the preset picture, and whether the interface picture element is likely to be successfully matched with the preset picture element can be determined according to whether the first position coordinates of the interface picture element are consistent with the second position coordinates of the preset picture element.

The position coordinates of the picture elements may be the percentage distance of the picture elements from the upper and left edges of the picture.

Step S802: and matching the interface picture element with a preset picture element in response to the successful matching of the first position coordinate and the second position coordinate.

In response to that the first position coordinate is the same as the second position coordinate or that the position difference is smaller than the threshold, the first position and the second position are considered to be consistent, and the first position and the second position are successfully matched, so that the first picture element and the preset picture element can be further matched; and in response to that the first position coordinate is different from the second position coordinate or that the position difference value is greater than or equal to the threshold value, considering that the first position is inconsistent with the second position, and the first position and the second position fail to be matched, and directly judging that the interface picture element fails to be matched with the preset picture element.

Step S803: and responding to the successful matching of the interface picture element and the preset picture element, and judging that the interface picture is consistent with the preset picture.

And responding to the failure of the matching of the interface picture element and the preset picture element, and judging that the interface picture is inconsistent with the preset picture.

Alternatively, the present embodiment may adopt a method as shown in fig. 9 to implement step S802. The interface picture element of this embodiment includes a first color block, and the method of this embodiment in which the preset picture element includes a second color block specifically includes steps S901 to S903.

Step S901: and responding to the fact that the main body color of the first color block is the same as the main body color of the second color block, and calculating a first proportion of the first color block in the interface picture and a second proportion of the second color block in the preset picture.

And the main body colors of the first color block and the second color block are the same, the first color block and the second color block are considered to be the same color, and if the main body colors of the first color block and the second color block are different, the condition that the interface picture elements are not matched with the preset picture elements is directly judged.

In this embodiment, color patches (color areas) that account for more than a threshold in a picture may be selected for matching, and the threshold may be 99%.

Step S902: a difference between the first and second ratios is calculated.

Step S903: and responding to the difference value smaller than the first threshold value, and judging that the interface picture element is successfully matched with the preset picture element.

If the difference value between the first proportion of the first color block in the interface picture and the second proportion of the second color block in the preset picture is smaller than a first threshold value, the first color block and the second color block are considered to be consistent, and the matching is successful; otherwise, the first color block is inconsistent with the second color block, and the matching fails.

Alternatively, the present embodiment may adopt the method shown in fig. 10 to implement step S802. The interface picture element of the embodiment includes a first text, and the preset picture element includes a second text. The method of this embodiment specifically includes steps S1001 to S1003.

Step S1001: a first character string is extracted from the first text and a second character string is extracted from the second text.

Step S1002: and matching the first character string with the second character string.

The present embodiment may use Optical Character Recognition (OCR) or other techniques to recognize the Character string.

Specifically, the present embodiment may implement step S1002 by using the method shown in fig. 11. The method of the present embodiment includes steps S1101 to S1104.

Step S1101: and acquiring a first character from the first character string and acquiring a second character string from the second character string, wherein the coordinate value of the second position coordinate of the first character is the same as the coordinate value of the first position coordinate.

The embodiment may adopt OCR and other technologies to extract characters from the character string.

Step S1102: the first character is matched with the second character.

As can be seen from the above analysis, since the interface picture and the preset picture have the same pixel coordinate system, the first position coordinate of the same picture element in the interface picture is the same as the second position coordinate in the preset picture, and thus, it can be determined whether the first character string and the second character string are the same only by matching the first character and the second character having the same position coordinate.

Step S1103: and counting the matching success rate of all the first characters in the first character string and the corresponding second characters in the second character string.

Step S1104: and responding to the matching success rate larger than a second threshold value, and judging that the first character string and the second character string are successfully matched.

And if the matching success rate of all the first characters in the first character string and the corresponding second characters in the second character string is less than or equal to a second threshold value, the first character string and the second character string are considered to be failed to be matched.

Step S1003: and responding to the successful matching of the first character string and the second character string, and judging that the interface picture element is successfully matched with the preset picture element.

And responding to the failure of matching the first character string and the second character string, and judging the failure of matching the interface picture element and the preset picture element.

Alternatively, the present embodiment may adopt a method as shown in fig. 12 to implement step S802. The interface picture element of this embodiment includes a first line, and the method of this embodiment in which the preset picture element includes a second line specifically includes steps S1201 to S1203.

Step S1201: a first length of the first line is obtained, and a second length of the second line is obtained.

The range of the position coordinates of the line is large, so that the matching of the coordinate positions of the picture elements in the method can be respectively used for matching the initial position coordinates and the end position coordinates of the line, or can be used for matching the position coordinates of the center line point of the line.

It should be noted that lines often have multiple types or shapes, and in order to improve the matching accuracy of lines, the types or shapes of lines may be matched first.

Step S1202: a difference between the first length and the second length is calculated.

Step S1203: and responding to the difference value smaller than the third threshold value, and judging that the interface picture element is successfully matched with the preset picture element.

And in response to the difference being greater than or equal to a third threshold, determining that the first line and the second line fail to match.

The method can be used for respectively matching a plurality of interface picture elements in the interface picture with corresponding preset picture elements in the preset picture, and if the plurality of interface picture elements are successfully matched with the corresponding preset picture elements, the interface picture is judged to be consistent with the preset picture.

The present application further provides an image comparison method according to another embodiment, as shown in fig. 13, the image comparison method according to this embodiment specifically includes the following steps:

step S1301: and acquiring an interface picture and a preset picture of the operation interface.

Step S1302: and acquiring a first resolution of the interface picture and a second resolution of the preset picture.

Step S1303: and in response to the first resolution being different from the second resolution, converting the interface picture and the preset picture into the same pixel coordinate system through equal-proportion conversion.

Steps S1301 to S1303 are similar to steps S701 to S703, and are not repeated here.

Step S1304: and extracting first characteristic information from the converted interface picture and extracting second characteristic information from the converted preset picture by adopting scale-invariant characteristic transformation.

The scale invariant feature transformation is an algorithm of computer vision, is used for detecting and describing the local features in the image, it finds the extreme point in the space scale, and extract its position, scale, rotate invariant, it is invariant to rotate, scale zoom, luminance change, keep certain stability to change of view angle, affine transformation, noise; the scale-invariant feature transformation has the advantages of good uniqueness, multiple quantity, high speed, expandability and the like.

Step S1305: and calculating the cosine similarity of the first characteristic information and the second characteristic information.

Specifically, a first vector of the first feature information and a second vector of the second feature information are obtained, and similarity between the first feature information and the second feature information is evaluated by calculating a cosine value of an included angle between the first vector and the second vector.

Step 1306: and responding to the cosine similarity larger than a fourth threshold value, and judging that the first characteristic information and the second characteristic information are successfully matched.

And in response to the cosine similarity being smaller than or equal to the fourth threshold, determining that the first feature information and the second feature information fail to be matched.

Step S1307: and responding to the successful matching, and judging that the interface picture is consistent with the preset picture.

Step S1307 is similar to step S706 described above and is not described here in detail.

Further, the omitted regions of the pictures are not compared in the embodiment of the application.

The image comparison method can be used for comparing the interface image in the automatic dial testing method with the preset image.

The present application further provides an automatic dial testing system, as shown in fig. 14, fig. 14 is a schematic structural diagram of an embodiment of the automatic dial testing system of the present application. The automatic dial testing system 70 of this embodiment includes a dial testing end 71 and a client 72 communicating with the dial testing end 71, the dial testing end 71 compiles a test script based on a service to be tested and sets an execution condition, the test script includes an execution logic and an operation step of the service to be tested; in response to the execution condition being triggered, the dial-up terminal 71 sends the test script to the client terminal 72; the client 72 starts the service to be tested according to the test script, runs the operation steps according to the execution logic, and renders an operation interface based on the operation steps; the client 72 acquires an interface picture of the operation interface, and compares the interface picture with a preset picture to obtain a comparison result; the client 72 generates a test report based on the comparison results.

The automatic dial testing system 70 of this embodiment is further configured to implement the automatic dial testing method, where the dial testing terminal 71 is similar to the dial testing terminal of the above embodiment, and the client 72 is similar to the client of the above embodiment, which are not described herein again.

In this embodiment, the interface picture and the preset picture can be compared by using the picture comparison method.

In an application scenario, as shown in fig. 15, the work flow of the automatic dial testing system 70 of this embodiment is divided into three stages: a preparation stage, an execution stage and a report stage; the preparation stage is mainly used for completing the input and the compilation of a test script and the setting of an execution condition; the execution stage is mainly used for automatically testing the service to be tested according to the test script when the execution condition is triggered, and judging whether the test result is consistent with a preset result in the test script or not; if the script running process data and the running result data are not consistent, generating an alarm, and if the script running process data and the running result data are consistent, recording the running process data and the running result data of the script; and the reporting stage is mainly used for generating a test report according to the process data and the operation result data and sending an instant message alarm to inform operation and maintenance personnel to perform corresponding processing.

In an application scenario, the main functions and methods of the automatic dial testing system 70 of the present embodiment are summarized as follows:

by developing an APP program and opening a mobile phone developer mode, the following functions are realized:

and a monitoring function: the result of page rendering completion can be received, the screen can be captured and locally stored, and a server instruction can be received;

and (4) control functions: the touch screen can be simulated to operate the mobile phone;

and (4) a transmission function: the method comprises the steps that information and files can be sent to a server, and scripts sent by the server can be received;

the resident function: the memory can be resident and can be kept running in the background;

and (3) executing functions: the ability to start and shut down the program;

the android system and the IOS system can realize the functions although the development modes are different.

By developing a background program of the computer, the following functions are realized:

and a monitoring function: the method can receive information and files sent by the terminal and can receive the running state of the terminal;

script management: the method can support adding, deleting, modifying and viewing scripts;

planning a task: the method can initiate an instruction to the terminal according to the timer and the trigger;

report management: receiving and storing a test report, and supporting consulting and forwarding;

and (3) message notification: supporting the sending of instant messages to related personnel;

terminal management: monitoring the test terminal, supporting the registration, setting and removal of the terminal, and displaying the working state of the terminal in real time;

the embodiment can realize automatic dial testing execution, realizes various trigger execution modes of timing, random, event and manual by intuitively compiling scripts by operators without professional technology, automatically generates a test report capable of completely restoring a service flow after dial testing is finished, and automatically gives an alarm when the test is failed.

The present application further proposes a computer-readable storage medium, as shown in fig. 16, the computer-readable storage medium 80 of the present embodiment is used for storing the program instructions 810 of the above-mentioned embodiment, and the program instructions 810 can be executed by the method of the above-mentioned method embodiment. The program instructions 810 have been described in detail in the above method embodiments, and are not described in detail here.

The computer readable storage medium 80 of the embodiment may be, but is not limited to, a usb disk, an SD card, a PD optical drive, a removable hard disk, a high-capacity floppy drive, a flash memory, a multimedia memory card, a server, etc.

Different from the prior art, the image comparison method comprises the following steps: acquiring an interface picture and a preset picture of an operation interface; acquiring a first resolution of an interface picture and a second resolution of a preset picture; in response to the first resolution being different from the second resolution, converting the interface picture and the preset picture into the same pixel coordinate system through equal-proportion conversion; extracting first characteristic information from the converted interface picture, and extracting second characteristic information from the converted preset picture; matching the first characteristic information with the second characteristic information; and responding to the successful matching, and judging that the interface picture is consistent with the preset picture. By the mode, when the characteristic information of different pictures of the same operation interface is matched, the different pictures are converted in equal proportion, so that the different pictures are converted into the same pixel coordinate system, bitmap data of the same picture element in the different pictures can be consistent, and the problem that the bitmap data of the picture element is inconsistent due to different picture resolutions and further the picture comparison precision is low can be solved; therefore, the method and the device can improve the image comparison accuracy.

In addition, if the above functions are implemented in the form of software functions and sold or used as a standalone product, the functions may be stored in a storage medium readable by a mobile terminal, that is, the present application also provides a storage device storing program data, which can be executed to implement the method of the above embodiments, the storage device may be, for example, a usb disk, an optical disk, a server, etc. That is, the present application may be embodied as a software product, which includes several instructions for causing an intelligent terminal to perform all or part of the steps of the methods described in the embodiments.

In the description of the present application, reference to the description of the terms "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, mechanism, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, mechanisms, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.

The logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable instructions that can be viewed as implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device (e.g., a personal computer, server, network device, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions). For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory. The above description is only an embodiment of the present application, and not intended to limit the scope of the present application, and all equivalent mechanisms or equivalent processes performed by the present application and the contents of the appended drawings, or directly or indirectly applied to other related technical fields, are all included in the scope of the present application.

Claims

1. A method for comparing pictures, comprising:

acquiring an interface picture and a preset picture of an operation interface;

acquiring a first resolution of the interface picture and a second resolution of the preset picture;

in response to the first resolution being different from the second resolution, converting the interface picture and the preset picture into the same pixel coordinate system through equal-proportion conversion;

extracting first characteristic information from the converted interface picture, and extracting second characteristic information from the converted preset picture;

matching the first characteristic information with the second characteristic information;

and responding to the successful matching, and judging that the interface picture is consistent with the preset picture.

2. The method according to claim 1, wherein the first feature information includes an interface picture element and a first position coordinate of the interface picture element in the pixel coordinate system, the second feature information includes a preset picture element and a second position coordinate of the preset picture element in the pixel coordinate system, and the matching the first feature information and the second feature information includes:

matching the first position coordinates with the second position coordinates;

matching the interface picture element with the preset picture element in response to the first position coordinate and the second position coordinate being successfully matched;

and responding to the successful matching of the interface picture element and the preset picture element, and judging that the interface picture is consistent with the preset picture.

3. The method according to claim 2, wherein the interface picture element includes a first color block, the preset picture element includes a second color block, and the matching the interface picture element with the preset picture element includes:

in response to that the main body color of the first color block is the same as the main body color of the second color block, calculating a first proportion of the first color block in the interface picture and a second proportion of the second color block in the preset picture;

calculating a difference between the first and second ratios;

and responding to the difference value smaller than a first threshold value, and judging that the interface picture element is successfully matched with the preset picture element.

4. The method according to claim 2, wherein the interface picture element comprises a first text, the preset picture element comprises a second text, and the matching the interface picture element with the preset picture element comprises:

extracting a first character string from the first text and extracting a second character string from the second text;

matching the first character string with the second character string;

and responding to the successful matching of the first character string and the second character string, and judging that the interface picture element is successfully matched with the preset picture element.

5. The method of claim 4, wherein matching the first string with the second string comprises:

acquiring a first character from the first character string, and acquiring a second character string from the second character string, wherein the position coordinate of the first character string is the same as the second position coordinate of the second character string;

matching the first character with the second character;

counting the matching success rate of all the first characters in the first character string and the corresponding second characters in the second character string;

and in response to the matching success rate being greater than a second threshold, determining that the first character string and the second character string are successfully matched.

6. The method according to claim 2, wherein the interface picture element further comprises a first line, the preset picture element further comprises a second line, and the matching the interface picture element with the preset picture element comprises:

acquiring a first length of the first line and a second length of the second line;

calculating a difference between the first length and the second length;

and in response to the difference value being smaller than a third threshold value, determining that the first line and the second line are successfully matched.

7. The method according to claim 1, wherein the extracting first feature information from the converted interface picture and extracting second feature information from the converted preset picture comprises:

extracting first characteristic information from the converted interface picture and extracting second characteristic information from the converted preset picture by adopting scale-invariant characteristic transformation;

the matching the first feature information and the second feature information includes:

calculating cosine similarity of the first characteristic information and the second characteristic information;

and in response to the cosine similarity being greater than a fourth threshold, determining that the first feature information and the second feature information are successfully matched.

8. An automatic dial testing method is characterized by comprising the following steps:

the dialing and testing end compiles a test script based on the service to be tested and sets an execution condition, wherein the test script comprises the execution logic and the operation steps of the service to be tested;

responding to the triggering of the execution condition, and sending the test script to a client by the dialing test terminal;

the client starts the service to be tested according to the test script, runs the operation steps according to the execution logic, and renders an operation interface based on the operation steps;

the client acquires an interface picture of the operation interface, and compares the interface picture with a preset picture by adopting the picture comparison method of any one of claims 1 to 7 to obtain a comparison result;

and the client generates a test report based on the comparison result.

9. An automatic dial testing system, comprising: the system comprises a dial-up test terminal and a client terminal communicated with the dial-up test terminal, wherein the dial-up test terminal compiles a test script based on a service to be tested and sets an execution condition, and the test script comprises an execution logic and an operation step of the service to be tested; in response to the execution condition being triggered, the dialing terminal sends the test script to the client; the client starts the service to be tested according to the test script, runs the operation steps according to the execution logic, and renders an operation interface based on the operation steps; the client acquires an interface picture of the operation interface, and compares the interface picture with a preset picture by adopting the picture comparison method of any one of claims 1 to 7 to obtain a comparison result; and the client generates a test report based on the comparison result.

10. A computer-readable storage medium having stored thereon program instructions executable to implement the picture matching method of any one of claims 1-8 and the automatic dial testing method of claim 8.