CN104866414A

CN104866414A - Method, device and system for testing application program

Info

Publication number: CN104866414A
Application number: CN201410063291.9A
Authority: CN
Inventors: 李鸿翔
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2014-02-24
Filing date: 2014-02-24
Publication date: 2015-08-26
Anticipated expiration: 2034-02-24
Also published as: CN104866414B

Abstract

The invention discloses a method, a device and a system for testing an application program. The method comprises steps as follows: an interface where testing operation of the tested application program is executed, operation execution coordinates during execution of testing operation on the interface and a recorded picture corresponding to the operation execution coordinates are acquired on a first terminal; an interface picture acquired when the interface is operated on a second terminal is intercepted; the interface picture and the recorded picture are subjected to picture recognition, and operation playback coordinates corresponding to the operation execution coordinates in the interface picture are determined according to a picture recognition result; the testing operation is executed on the tested application program on an interface of the second terminal according to the operation playback coordinates. With the adoption of the method, the device and the system for testing the application program, the problem that a software testing result is inaccurate due to the fact that a record and playback method used for testing software in the prior art cannot adapt to terminals with different resolutions is solved, and the operation execution coordinates can be acquired accurately, so that the testing operation can be accurately performed on the second terminal, and an accurate testing result of the application program can be acquired.

Description

The method of testing of application program, Apparatus and system

Technical field

The present invention relates to internet arena, in particular to a kind of method of testing, Apparatus and system of application program.

Background technology

Android:Android is a kind of based on the freedom of Linux and the operating system of open source code, is mainly used in mobile device (as smart mobile phone, panel computer), is led and exploitation by Google company and open mobile phone alliance.Android not yet has unified Chinese at present, and the more people in CONTINENTAL AREA OF CHINA uses " Android ".

Pattern-recognition: pattern-recognition (Pattern Recognition) refers to and processes and analyze the information of the various forms (as numerical value, word or logical relation) characterizing things or phenomenon with the process being described things or phenomenon, recognizing, classifying and explaining, is the important component part of information science and artificial intelligence.

OpenCV:OpenCV is a cross-platform computer vision library of issuing based on (increasing income), it achieves a lot of general-purpose algorithms of image procossing and computer vision aspect.It is the one in pattern-recognition: the storehouse of increasing income of image and visual processes identification.

Software test, i.e. software testing describe the process that one is used for promoting the correctness of qualification software (or program), integrality, security and quality.Specifically refer to and under defined terms, program to be operated, a discovery procedure mistake, weigh software quality, and to its process assessed that whether can meet design requirement.

The resolution of the mobile phone of Android platform is used to vary in prior art, as resolution 480*800 pixel, 720*1280 pixel etc., in Android platform during testing software, frequent needs test same function on the mobile phone of different resolution, the mobile phone of different resolution is tested same software and just needs repeatedly same or analogous operation, so just need a large amount of test durations, in order to save the test duration, usually we use recording and playback function to reach this object, namely test on a mobile phone, test process is recorded and saves as test script, then this test script of playback on other mobile phones, to reduce the artificial time participated in.

Particularly, there is in prior art the method for the following two kinds recording and playback:

(1) method of recording and playback function is realized based on the mode of coordinate: namely on First Android platform mobile phone during testing software, the coordinate clicked in record test process also saves as test script.

(2) method of recording and playback function is realized based on the mode of control: this recording and playback across resolution, but can need the source code of journey to be tested.

But, adopt said method to there is a lot of defect:

The method that mode based on coordinate realizes recording and playback function depends on the resolution of mobile phone, such as, on the mobile phone that the coordinate that 480*800 resolution mobile phone obtains is applied to 720*1280 resolution during playback, position skew will be there is, just cannot navigate to position accurately at all, thus accurate test cannot be realized, also be, the coordinate that 480*800 resolution mobile phone obtains can only for the mobile phone of equal resolution, and in different resolution as playback on the mobile phone of 720*1280 resolution, larger limitation cannot be had; Although and realize the method for recording and playback function by the restriction of resolution based on the mode of control, but need to use the source code of program to be tested just can test, in the software test procedure of reality, be difficult to the source code getting program to be tested, thus the method cannot be used in the software test to the mobile phone of Android platform.

The terminal of different resolution cannot be adapted to for above-mentioned use recording and replaying method testing software, thus cause the inaccurate problem of software test result, not yet propose effective solution at present.

Summary of the invention

Embodiments provide a kind of method of testing of application program, Apparatus and system, at least to solve the terminal using recording and replaying method testing software cannot adapt to different resolution, thus cause the technical matters of the inaccurate problem of software test result.

According to an aspect of the embodiment of the present invention, provide a kind of method of testing of application program, the method comprises: obtain on first terminal the operation information that tested application program performs, wherein, operation information comprise on first terminal for perform test operation interface, on interface, perform test operation time operation perform coordinate and on interface, perform test operation time perform recording picture corresponding to coordinate with operating; Intercept interface images during runnable interface in the second terminal; Picture recognition is carried out to interface images and recording picture, performs operation playback coordinate corresponding to coordinate according in the result determination interface images of picture recognition with operation; On the interface of the second terminal, test operation is performed to tested application program according to operation playback coordinate.

According to an aspect of the embodiment of the present invention, provide a kind of proving installation of application program, this device comprises: data obtaining module, for obtaining on first terminal the operation information that tested application program performs, wherein, operation information comprise on first terminal for perform test operation interface, on interface, perform test operation time operation perform coordinate and on interface, perform test operation time perform recording picture corresponding to coordinate with operating; First screen capture module, interface images during for intercepting runnable interface in the second terminal; Picture recognition module, for carrying out picture recognition to interface images and recording picture, performs operation playback coordinate corresponding to coordinate according in the result determination interface images of picture recognition with operation; Testing execution module, for performing test operation to tested application program according to operation playback coordinate on the interface of the second terminal.

According to the another aspect of the embodiment of the present invention, additionally provide a kind of test macro of application program, this system comprises: first terminal, for generating and upload operation information according to the test operation performed tested application program, wherein, operation information comprise on first terminal for perform test operation interface, on interface, perform test operation time operation perform coordinate and on interface, perform test operation time perform recording picture corresponding to coordinate with operating; Server, is connected with first terminal, for preserving the operation information received, and after receiving test request, the operation information of correspondence is issued to corresponding terminal; Second terminal, be connected with server, for sending test request, and after receiving the operation information that server issues, intercept interface images during runnable interface in the second terminal, and to interface images with record picture and carry out picture recognition, according to after performing operation playback coordinate corresponding to coordinate with operation in the result determination interface images of picture recognition, according to operation playback coordinate on the interface of the second terminal to tested application program execution test operation.

Adopt the present invention, second terminal performs tested application program in the process of test operation, get on first terminal the operation information that tested application program performs, because operation when not only comprising the interface of execution test operation in operation information and perform test operation on interface performs coordinate, also be included in when interface performing test operation and perform recording picture corresponding to coordinate with operation, before second terminal performs test operation, with recording picture, picture recognition is carried out to interface images when the second terminal intercepted being run the interface of tested application program, and according in the result determination interface images of picture recognition with operation perform operation playback coordinate corresponding to coordinate after, on the interface of the second terminal, test operation is performed to tested application program according to operation playback coordinate (instead of the operation of recording on first terminal performs coordinate), thus when carrying out the test of application program in the second terminal, perform coordinate not based on the operation of recording on first terminal and perform test operation, but get by picture recognition the operation playback coordinate execution test operation that operation performs coordinate correspondence in the second terminal, the source code of resolution and tested application program is not relied in replayed section, only use coordinate just can determine test position (representing this position with operation playback coordinate) accurately in the second terminal, then on the interface of the second terminal, the test operation to tested application program is performed according to operation playback coordinate, solve in prior art the terminal using recording and replaying method testing software cannot adapt to different resolution, thus cause the inaccurate problem of software test result, achieve Obtaining Accurate operation and perform coordinate, thus in the second terminal, accurately can perform test operation, reach the effect of the test result obtaining application program accurately.

Accompanying drawing explanation

Accompanying drawing described herein is used to provide a further understanding of the present invention, and form a application's part, schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:

Fig. 1 is the process flow diagram of the method for testing of application program according to the embodiment of the present invention one;

Fig. 2 is the process flow diagram of the recording operation information according to the embodiment of the present invention one;

The process flow diagram of the determination operation playback coordinate of the embodiment of the present invention one shown in Fig. 3;

Fig. 4 is the process flow diagram finding the region corresponding with recording picture in interface images according to the embodiment of the present invention one;

Fig. 5 is the process flow diagram of the method for testing of a kind of optional application program according to the embodiment of the present invention one;

Fig. 6 is the schematic diagram of the proving installation of application program according to the invention process two;

Fig. 7 is the schematic diagram of the proving installation of a kind of optional application program according to the invention process two;

Fig. 8 is the schematic diagram of the picture recognition module according to the invention process two;

Fig. 9 is the schematic diagram of the region acquisition module according to the invention process two;

Figure 10 is the structural representation of the test macro of application program according to the embodiment of the present invention three; And

Figure 11 is the structural representation of the test macro of a kind of optional application program according to the embodiment of the present invention three.

Embodiment

The present invention program is understood better in order to make those skilled in the art person, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the embodiment of a part of the present invention, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, should belong to the scope of protection of the invention.

It should be noted that, term " first ", " second " etc. in instructions of the present invention and claims and above-mentioned accompanying drawing are for distinguishing similar object, and need not be used for describing specific order or precedence.Should be appreciated that the data used like this can be exchanged in the appropriate case, so as embodiments of the invention described herein can with except here diagram or describe those except order implement.In addition, term " comprises " and " having " and their any distortion, intention is to cover not exclusive comprising, such as, contain those steps or unit that the process of series of steps or unit, method, system, product or equipment is not necessarily limited to clearly list, but can comprise clearly do not list or for intrinsic other step of these processes, method, product or equipment or unit.

Embodiment 1

According to the embodiment of the present invention, provide a kind of embodiment of the method for the method of testing for implementing application, it should be noted that, can perform in the computer system of such as one group of computer executable instructions in the step shown in the process flow diagram of accompanying drawing, and, although show logical order in flow charts, in some cases, can be different from the step shown or described by order execution herein.

Fig. 1 is the process flow diagram of the method for testing of application program according to the embodiment of the present invention one.

As shown in Figure 1, the method can comprise the steps:

Step S102: obtain on first terminal the operation information that tested application program performs, wherein, operation information comprise on first terminal for perform test operation interface, on interface, perform test operation time operation perform coordinate and on interface, perform test operation time perform recording picture corresponding to coordinate with operating.

Step S104: intercept interface images during runnable interface in the second terminal.

Step S106: picture recognition is carried out to interface images and recording picture, performs operation playback coordinate corresponding to coordinate according in the result determination interface images of picture recognition with operation.

Step S108: on the interface of the second terminal, test operation is performed to tested application program according to operation playback coordinate.

Adopt the present invention, second terminal performs tested application program in the process of test operation, get on first terminal the operation information that tested application program performs, because operation when not only comprising the interface of execution test operation in operation information and perform test operation on interface performs coordinate, also be included in when interface performing test operation and perform recording picture corresponding to coordinate with operation, before second terminal performs test operation, picture recognition is carried out to the interface images in the second terminal intercepted during runnable interface and recording picture, and according in the result determination interface images of picture recognition with operation perform operation playback coordinate corresponding to coordinate after, on the interface of the second terminal, test operation is performed to tested application program according to operation playback coordinate (instead of the operation of recording on first terminal performs coordinate), thus when carrying out the test of application program in the second terminal, perform coordinate not based on the operation of recording on first terminal and perform test operation, but get by picture recognition the operation playback coordinate execution test operation that operation performs coordinate correspondence in the second terminal, the source code of resolution and tested application program is not relied in replayed section, only use coordinate just can determine test position (representing this position with operation playback coordinate) accurately in the second terminal, then on the interface of the second terminal, the test operation to tested application program is performed according to operation playback coordinate, solve in prior art the terminal using recording and replaying method testing software cannot adapt to different resolution, thus cause the inaccurate problem of software test result, achieve Obtaining Accurate operation and perform coordinate, thus in the second terminal, accurately can perform test operation, reach the effect of the test result obtaining application program accurately.

Fig. 2 is the process flow diagram of the recording operation information according to the embodiment of the present invention one.

As shown in Figure 2, on first terminal, recording operation information can comprise the steps:

Step S202: be enabled in the test event of first terminal being tested tested application program.

Particularly, before execution step S202, first terminal is installed tested application program, and on first terminal, runs tested application program.Wherein, test event can comprise one or more test operation, e.g., click, slide, long by and the short test operation such as to press.

Step S204: the operation when interface being recorded in first terminal performing test operation performs coordinate.

Particularly, each test operation is a corresponding test position on the interface of first terminal, and each test position all can use operation execution coordinate to represent, records the interface performing test operation and operate to perform coordinate when performing each test operation.

Step S206: intercept on the interface of first terminal according to default intercepting pixel data and perform recording picture corresponding to coordinate with operation.

In this embodiment, presetting and intercepting pixel data is the pixel data that the size of picture is recorded in default intercepting, as, presetting and intercept pixel data can be 60 pixel * 60 pixels, then can intercept according to the size of 60 pixel * 60 pixels on the interface of first terminal and record picture.Alternatively, intercepting in the process recording picture, operation can performed point corresponding to coordinate and carry out sectional drawing as the central point recording picture.

Step S208: detect whether execute test operation.

Wherein, when executing test operation, perform step S210; When not executing test operation, returning and performing step S204.

Step S210: preserve operation and perform coordinate, interface and record picture generating run information.

Particularly, record operation performs coordinate, interface and operation and performs coordinate and the incidence relation recording picture, generates and records script, preserves to record script and record picture to obtain operation information.Namely, operation information can comprise to be recorded script and records picture, records in script and records: first terminal performs coordinate for the operation performed when the interface of test operation, interface performing test operation and operation performs coordinate and the incidence relation recording picture.

The process of recording operation information on first terminal can be completed by above-mentioned step S202 to step S210.Wherein, after execution step S202 to step S210 completes recording operation information, step S102 to step S108 can be performed and realize playback operation information in the second terminal, to complete the test to tested application program.

Alternatively, step S102 to step S108 realizes in the second terminal.Particularly, first terminal in the method embodiment and the second terminal can be different user terminals (as mobile phone, panel computer etc.), also can be same user terminal, also be, in above-mentioned method of testing, the process of recording operation information and playback operation information can be completed on same user terminal.

According to the abovementioned embodiments of the present invention, the step S102 shown in Fig. 1 can realize by the following method: send test request to server, and the operation information corresponding with test request that reception server returns.

Particularly, second terminal sends the test request of the tested application program of test to server, server (as Cloud Server) is after receiving test request, read should the operation information of test request from database, and this operation information is issued to the second terminal, second terminal is after receiving the operation information that server returns, read test operation successively from the recording script operation information, and obtain corresponding recording picture by test operation and recording picture successively with the operation incidence relation performed between coordinate, then the interface images during interface the second terminal being run this execution test operation is intercepted, and picture recognition is carried out to interface images and recording picture, according in the result determination interface images of picture recognition with operation perform operation playback coordinate corresponding to coordinate after, judge whether that the operation identifying full performs coordinate, after having identified that operations all in recording script performs operation playback coordinate corresponding to coordinate, on the interface of the second terminal, successively test operation is performed to tested application program according to operation playback coordinate.

What needs further illustrated is, step S108 shown in Fig. 1: performing test operation to tested application program according to operation playback coordinate on the interface of the second terminal can realize by the following method: the second terminal recognition to operate and perform operation playback coordinate corresponding to coordinate after, the operation of recording in script is performed coordinate and replace with operation playback coordinate, obtain the recording script after upgrading; Then the recording script after interface (in the above-described embodiments for calculating interface) the upper playback of the second terminal upgrades, to perform test operation to tested application program according to operation playback coordinate on the interface of the second terminal.

Particularly, the first terminal in above-described embodiment and the second terminal can be the mobile terminal devices (as mobile phone, panel computer) based on Android platform, above-mentioned method of testing of the present invention can be applied in the software test of Android phone alternatively.

Such as, when testing the counter of Android phone, test event can be started: first test operation is for clicking " 5 " on first terminal (as the first mobile phone), when recording this test operation, record this click coordinate, namely " 5 " are at the coordinate (x1 at the calculating interface of the first mobile phone, y1), intercept should the recording picture A of coordinate the address D a(Da in practical operation obtaining this recording picture A be the address date of the memory location of concrete recording picture A simultaneously, Da is herein only as the symbol of address date), then can record: click(x1 in recording script, y1) _ Da.When this test event comprises a click action, after completing the recording to this click action, preserve and record script and record picture generating run information, and this operation information is uploaded onto the server (as Cloud Server), server is kept in the database of server after receiving operation information.

According to the abovementioned embodiments of the present invention, second terminal (as the second mobile phone) can send the test request of test application (as counter) to Cloud Server, Cloud Server is after receiving test request, obtain the operation information corresponding with this test request, and operation information is issued to the second mobile phone of request for test, second mobile phone is after receiving the operation information that Cloud Server issues, second mobile phone runs the application program (as counter) of having installed, intercept interface images B corresponding with the calculating interface in operation information on the second mobile phone, then read test operation from recording script successively, if first test operation is for clicking " 5 ", then obtain recording picture A according to recording the address D a recorded in script, by the image identification method in the inventive method embodiment, determine to perform coordinate (x1 with operation in interface images B, y1) corresponding operation playback coordinate (x2, y2) after, according to operation playback coordinate (x2, y2) on the interface of the second terminal, clicking operation is performed.According to above-mentioned embodiment of testing counter, the interface of the second terminal performs test operation to counter, being click coordinate on the calculating interface on the second mobile phone after start-up simulation device is the point of (x2, y2), with measuring and calculation device in the second terminal.

In the above-described embodiments, the test event with a test operation only illustrates, in the test of actual application programs, each test event all can comprise one or more test operation, above-mentioned method of testing all can be used to carry out the test of application program to the second terminal for each test operation, and in the test of actual application programs, operation playback coordinate corresponding to coordinate is performed getting with operations all in test event, and all operations recorded in script is performed coordinate all replace complete after, on the interface of the second terminal, test operation is performed to tested application program according to operation playback coordinate successively according to the order of the test operation recorded in the recording script after renewal again.

The process flow diagram of the determination operation playback coordinate of the embodiment of the present invention one shown in Fig. 3.

As shown in Figure 3, step S106: carry out picture recognition to interface images and recording picture, the operation playback coordinate according to performing coordinate corresponding with operation in the result determination interface images of picture recognition can realize by the following method:

Step S302: find the region corresponding with recording picture in interface images.

Step S304: zoning and the similarity recording picture.

Step S306: detect similarity and whether meet predetermined threshold value.

Wherein, when similarity meets predetermined threshold value, perform step S308; When similarity does not meet predetermined threshold value, perform step S310.

Particularly, predetermined threshold value characterizes region and the preset reference value recording picture analogies degree.In this step, it is effective region that similarity meets the predetermined threshold value region that then determining step S302 obtains, thus confirms that region is high with the similarity recording picture, if effective coverage then uses the method provided in step S308 to confirm operation playback coordinate; It is invalid that similarity does not meet the predetermined threshold value region that then determining step S302 obtains.Suppose to there is P button in the first mobile phone, and in the second mobile phone, there is not P button, even if corresponding region of recording picture can be found by step S302, but the similarity both calculating does not meet predetermined threshold value, then think that both similarities are on the low side, confirm that this region is invalid region, then use the method provided in step S310 to confirm operation playback coordinate.

Step S308: perform coordinate according to operation and search corresponding operation playback coordinate in the zone with the position relationship recording picture.

Step S310: the resolution determination operation playback coordinate performing coordinate and first terminal and the second terminal according to operation.

In this embodiment, owing to being same program in the tested application program of first terminal and the second terminal test, the region corresponding with recording picture then found in interface images, that similarity is very high or on all four theoretically, but in actual software performance history, developer is for different screen size, the mobile phone of different resolution or even different brands can do some differentiation process (such as: some Menu key is form in different resolution, vary in size, even some button existed on the mobile phone of giant-screen does not exist on little screen mobile phone), some differences may be there are in the region that these differentiation process cause execution step S302 to obtain with recording picture.

Can be confirmed to operate playback coordinate by different coordinate processing methods to the region different from the similarity degree recording picture by above-mentioned steps S304 to S310, the confirmation method of the operation playback coordinate that step S308 is calculated by pixel characteristic, and the method for step S310 is according to the multiplying power determination operation playback coordinate of resolution, high with the similarity recording picture in region, use the method in step S308 higher than the accuracy of the method used in step S310; And on the low side with the similarity recording picture in region, think there is not this recording picture in interface images, confirm that the accuracy of operation playback coordinate is higher by step S310 than step S308.Different coordinate confirmation methods is adopted from the similarity degree recording picture according to region, different process can be carried out to different test case, thus the method that is used alone step S308 or is used alone the confirmation coordinate in step S310 can be avoided, thus can obtain operating playback coordinate more accurately.

Fig. 4 is the process flow diagram finding the region corresponding with recording picture in interface images according to the embodiment of the present invention one.

Particularly, the second processor of the second terminal can call image data base of increasing income in interface images, find the region corresponding with recording picture.Alternatively, image data base of increasing income can be OpenCV, getting the execution of the operation in operation information coordinate (x1, y1) and after recording picture A, in the process of the second terminal playback operation information, can first intercept interface images B, then be calculated by the algorithm for pattern recognition in OpenCV and record the region of picture A in interface images B.In this embodiment, the function of pattern-recognition is introduced in the recording and playback process of first terminal and the second terminal, the remarkable operation according to recording performs coordinate and carry out playback in the second terminal, but inquire corresponding region of recording picture on interface images by the identification of pattern-recognition to pixel, do not rely on the source code of same resolution and application program, can determine that in the second terminal, respective operations performs the operation playback coordinate of coordinate, can navigate to the test position of the second terminal quickly and accurately, and the accuracy rate of searching is higher.

Particularly, as shown in Figure 4, in interface images, find the region corresponding with recording picture to realize as follows:

Step S402: unique point and the proper vector of being recorded picture and interface images by the collection of Scale invariant features transform algorithm.

Particularly, can by calling SURF algorithm that OpenCV carries to the collection of recording picture A and interface images B and carry out unique point and proper vector.

Wherein, unique point is the key point of the characteristics of image such as token image feature, image type or image location information on image; Proper vector is then the vector relations on image between unique point, as the vector distance etc. between unique point.

Above-mentioned Surf algorithm is Scale invariant features transform algorithm, completes the coupling of two width objects in images under temperate conditions.

Step S404: characteristic matching is carried out to the unique point collected and proper vector and calculates characteristic information.

Particularly, the match algorithm (i.e. matching algorithm) that can be carried by OpenCV finds the characteristic information mated with recording picture A in interface images B.Wherein, this characteristic information can comprise: the information such as the similarity between the unique point in two pictures, proper vector.

Step S406: according to pre-conditioned to characteristic information carry out filtration treatment obtain filter after characteristic information, use filter after characteristic information sketch out region.

Particularly, pre-conditionedly can comprise default unique point similarity threshold and proper vector similarity threshold, after getting characteristic information, the unique point and proper vector that do not meet unique point similarity threshold and proper vector similarity threshold in characteristic information can be given up to fall, obtain the characteristic information after filtering, use the characteristic information after filtering to sketch out above-mentioned region.Wherein, this region can be represented by a series of area coordinate.

In above-mentioned steps S402 to S406, the region obtained by pattern-recognition may be an irregular region, therefore, after execution step S406, can complete the confirmation to operating playback coordinate by performing S304 to S310 shown in Fig. 3.

In the above embodiment of the present invention, while the upper record operation of first terminal (as the first mobile phone) performs coordinate, intercepted operation and performed the recording picture of the vicinity of coordinate and preserve, this recording picture is used for carrying out pattern-recognition coupling in playback, in the replayed section of the second terminal, after installing and start tested application program, interface images is intercepted when the runnable interface of the second terminal (as the second mobile phone), OpenCV can be used to carry out image recognition to interface images and recording picture, identify and record the region of picture in interface images, and according to this region determination operation playback coordinate, then the operation of recording script is performed coordinate and replace with the recording script that operation playback coordinate obtains replacing rear (or after upgrading), and the recording script after the upper execution of the second terminal (as the second mobile phone) is replaced, the test to tested application program in the second terminal is completed after executing all test operations in the recording script after replacement.By said method, in whole test process, determine to test coordinate by pixel, be not subject to the image of the source code of resolution and tested application program, solve the problem across resolution, achieve and accurately lock test position, thus obtain the effect of test result accurately.

Fig. 5 is the process flow diagram of the method for testing of a kind of optional application program according to the embodiment of the present invention one.

As shown in Figure 5, the method can comprise the steps:

Step S502: start tested application program in the second terminal.

Particularly, before execution step S502, the second terminal is installed this tested application program.

Step S504: intercept interface images on the interface of the second terminal.

Step S506: carry out picture recognition to interface images and recording picture, determines to perform operation playback coordinate corresponding to coordinate with operation according to the result of picture recognition.

Particularly, this step is consistent with the implementation method of the step S106 shown in Fig. 1, does not repeat them here.

Step S508: the operation execution coordinate recorded in script obtains the recording script after upgrading to use operation playback coordinate to replace.

Step S510: perform the recording script after upgrading on the interface of the second terminal.

Particularly, record one or more test operations that tested application program is tested owing to recording in script, only carried out coordinate renew in step S508, any amendment is not carried out to the other guide recorded in script, thus all test operations that can intactly perform when performing step S510 in the script of recording, be only that the coordinate of operation is different.Pass through above-described embodiment, by the replacement to the coordinate recorded in script, when second terminal is tested tested application program, do not relate to the resolution of test terminal and the source code of application program, thus across the problem of resolution test, the effect of accurately searching test coordinate cannot be achieved when solving software test.

Need to further illustrate, performing coordinate according to operation and search corresponding operation playback coordinate in the zone can comprise with the position relationship of recording picture in Fig. 3: whether perform operating point corresponding to coordinate according to position relationship determination operation is the first nodal point recording picture; When operating point is first nodal point, the second central point of seek area, the coordinate of the second central point is operation playback coordinate; When operating point is not first nodal point, in region, randomly draw the playback point of predetermined number; Calculate the first distance between each playback point and the second central point; Second distance between calculating operation point and first nodal point; Calculate the first distance respectively and obtain difference collection with the difference of second distance; From the difference that difference converges extraction of values is minimum; Using the coordinate of playback point corresponding for difference minimum for value as operation playback coordinate.

Particularly, the recording picture A intercepted in first terminal is recorded this recording script comprises operation and performs operating point corresponding to coordinate, in the above-described embodiments, perform coordinate according to operation and can search corresponding operation playback coordinate in the zone with the position relationship recording picture.Wherein, when the operating point that operation execution coordinate is corresponding is the first nodal point recording picture, second central point of seek area, by the coordinate of the second central point for operating playback coordinate, in that case, even if region is not a regular region, but the central point in region can be determined accurately, thus playback coordinate can be operated accurately; When operating point is not first nodal point, the playback point of predetermined number is randomly drawed in region, several pixel can be got in practical operation more, then the first distance between each playback point and the second central point is calculated by distance algorithm, and the second distance between calculating operation point and first nodal point; Then using the coordinate of playback point corresponding for the first distance closest to second distance as operation playback coordinate.Particularly, the first distance can be calculated respectively and obtain difference collection with the difference of second distance, then from the difference that difference converges extraction of values is minimum, using the coordinate of playback point corresponding for difference minimum for value as operation playback coordinate.Wherein, the value of predetermined number can belong to interval [5,10].

In the above-described embodiments, by directly determining central point or carrying out determination operation playback coordinate by the distance relation between pixel, in the process of whole determination operation playback coordinate, do not need the resolution using first terminal and the second terminal, thus the process of whole identifying operation playback coordinate is not by the impact of resolution, thus the problem solved across resolution, achieve the effect of the operation playback coordinate accurately determining test position.

According to the abovementioned embodiments of the present invention, can comprise according to the resolution determination operation playback coordinate of operation execution coordinate and first terminal and the second terminal in Fig. 3: obtain the first resolution of first terminal and the second resolution of the second terminal; Calculate the multiplying power of first resolution and second resolution; Use multiplying power to carry out resolution conversion to operation execution coordinate and obtain operation playback coordinate.

Particularly, when region does not meet predetermined threshold value with the similarity recording picture, also be, confirm to find the correspondence position recording picture on the interface images of the second terminal, then obtain the first resolution of first terminal (as the first mobile phone) and the second resolution of the second terminal (the second mobile phone), then calculate the multiplying power of first resolution and second resolution, use this multiplying power to carry out resolution conversion to operation execution coordinate and obtain operation playback coordinate.

When the above embodiment of the present invention being applied in the software test based on Android mobile phone, such as, the resolution of the first mobile phone is 480*800, the resolution of the second mobile phone is 240*320, then first calculate the multiplying power of two resolution, then operation is performed the x1 in coordinate (x1, y1), y1 is multiplied with multiplying power respectively and obtains x2 and y2 and be and can obtain operating playback coordinate (x2, y2).

It should be noted that, for aforesaid each embodiment of the method, in order to simple description, therefore it is all expressed as a series of combination of actions, but those skilled in the art should know, the present invention is not by the restriction of described sequence of movement, because according to the present invention, some step can adopt other orders or carry out simultaneously.Secondly, those skilled in the art also should know, the embodiment described in instructions all belongs to preferred embodiment, and involved action and module might not be that the present invention is necessary.

Through the above description of the embodiments, those skilled in the art can be well understood to the mode that can add required general hardware platform by software according to the method for above-described embodiment and realize, hardware can certainly be passed through, but in a lot of situation, the former is better embodiment.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, CD), comprising some instructions in order to make a station terminal equipment (can be mobile phone, computing machine, server, or the network equipment etc.) perform the method for each embodiment of the present invention.

Embodiment 2

According to the embodiment of the present invention, additionally provide a kind of proving installation of the application program for implementing said method embodiment, this device can be realized by the method for testing related in embodiment one, is described in detail below from the implementation process of angle to the application running said apparatus in the second terminal.

Fig. 6 is the schematic diagram of the proving installation according to application program of the invention process.

As shown in Figure 6, this device can comprise: data obtaining module 10, first screen capture module 20, picture recognition module 30 and testing execution module 40.

Wherein, data obtaining module 10, for obtaining on first terminal the operation information that tested application program performs, wherein, operation information comprise on first terminal for perform test operation interface, on interface, perform test operation time operation perform coordinate and on interface, perform test operation time perform recording picture corresponding to coordinate with operating.

First screen capture module 20, interface images during for intercepting runnable interface in the second terminal.

Picture recognition module 30, for carrying out picture recognition to interface images and recording picture, performs operation playback coordinate corresponding to coordinate according in the result determination interface images of picture recognition with operation.

Testing execution module 40, for performing test operation to tested application program according to operation playback coordinate on the interface of the second terminal.

As shown in Figure 7, the proving installation in the embodiment of the present invention can comprise: start module 50, logging modle 60, second screen capture module 70, detection module 80 and preserve module 90.

Wherein, module 50 is started for being enabled in the test event of first terminal being tested tested application program.

Particularly, before startup module is started working, tested application program can be installed on first terminal, and on first terminal, run tested application program.Wherein, test event can comprise one or more test operation, e.g., click, slide, long by and the short test operation such as to press.

Logging modle 60 performs operation execution coordinate during test operation on the interface being recorded in first terminal.

Second screen capture module 70 performs recording picture corresponding to coordinate for intercepting on the interface of first terminal according to default intercepting pixel data with operation.

Detection module 80 is for detecting whether execute test operation.

Wherein, when executing test operation, control to preserve module work; When not executing test operation, returning control logging modle 60 and working.

Preserve module 90 perform coordinate, interface for preserving operation and record picture generating run information.

The process of recording operation information on first terminal can be completed by above-mentioned five modules.Wherein, after completing the recording operation information on first terminal by above-mentioned five modules, can data obtaining module 10, first screen capture module 20, picture recognition module 30 and testing execution module 40 playback operation information in the second terminal, to complete the test to tested application program.

Alternatively, data obtaining module 10, first screen capture module 20, picture recognition module 30 and testing execution module 40 can be arranged in the second terminal.Particularly, first terminal in this device embodiment and the second terminal can be different user terminals (as mobile phone, panel computer etc.), also can be same user terminal, also be, in above-mentioned proving installation, the process of recording operation information and playback operation information can be completed on same user terminal.

By above-mentioned startup module 50, logging modle 60, second screen capture module 70, detection module 80 and preservation module 90, the implementation method of the step S202 to step S210 respectively in corresponding method embodiment.The example that above-mentioned startup module 50, logging modle 60, second screen capture module 70, detection module 80 and preservation module 90 and corresponding step realize is identical with application scenarios, but is not limited to the content disclosed in above-described embodiment one.Above-mentioned startup module 50, logging modle 60, second screen capture module 70, detection module 80 and preservation module 90 may operate in terminal or mobile terminal, can pass through software or hardware implementing.

What needs further illustrated is, testing execution module shown in Fig. 6 can comprise: implementation sub-module, for the second terminal recognition to operation perform operation playback coordinate corresponding to coordinate after, the operation of recording in script is performed coordinate and replace with operation playback coordinate, obtain the recording script after upgrading; Then the recording script after interface (in the above-described embodiments for calculating interface) the upper playback of the second terminal upgrades, to perform test operation to tested application program according to operation playback coordinate on the interface of the second terminal.

Particularly, the first terminal in above-described embodiment and the second terminal can be the mobile terminal devices (as mobile phone, panel computer) based on Android platform, above-mentioned proving installation of the present invention can be applied in the software test of Android phone alternatively.

Such as, when testing the counter of Android phone, the startup module 50 can passed through on first terminal (as the first mobile phone) starts test event: first test operation is for clicking " 5 ", when recording this test operation, record this click coordinate, namely " 5 " are at the coordinate (x1 at the calculating interface of the first mobile phone, y1), intercept should the recording picture A of coordinate the address D a(Da in practical operation obtaining this recording picture A be the address date of the memory location of concrete recording picture A simultaneously, Da is herein only as the symbol of address date), then can record: click(x1 in recording script, y1) _ Da.When this test event comprises a click action, after completing the recording to this click action, preserve and record script and record picture generating run information, and this operation information is uploaded onto the server (as Cloud Server), server is kept in the database of server after receiving operation information.

According to the abovementioned embodiments of the present invention, second terminal (as the second mobile phone) can send the test request of test application (as counter) to Cloud Server, Cloud Server is after receiving test request, obtain the operation information corresponding with this test request, and operation information is issued to the second mobile phone of request for test, second mobile phone is after receiving the operation information that Cloud Server issues, second mobile phone runs the application program (as counter) of having installed, intercept interface images B corresponding with the calculating interface in operation information on the second mobile phone, then read test operation from recording script successively, if first test operation is for clicking " 5 ", then obtain recording picture A according to recording the address D a recorded in script, by the image identification method in said method embodiment of the present invention, determine to perform coordinate (x1 with operation in interface images B, y1) corresponding operation playback coordinate (x2, y2) after, according to operation playback coordinate (x2, y2) on the interface of the second terminal, clicking operation is performed.According to above-mentioned embodiment of testing counter, the interface of the second terminal performs test operation to counter, being click coordinate on the calculating interface on the second mobile phone after start-up simulation device is the point of (x2, y2), with measuring and calculation device in the second terminal.

In the above-described embodiments, the test event with a test operation only illustrates, in the test of actual application programs, each test event all can comprise one or more test operation, the method of testing in above-described embodiment one all can be used second terminal to be carried out to the test of application program for each test operation, and in the test of actual application programs, operation playback coordinate corresponding to coordinate is performed getting with operations all in test event, and all operations recorded in script is performed coordinate all replace complete after, on the interface of the second terminal, test operation is performed to tested application program according to operation playback coordinate successively according to the order of the test operation recorded in the recording script after renewal again.

In the above embodiment of the present invention, preserve module and can comprise preservation submodule and encrypting module, wherein, preserve submodule and perform coordinate, interface for preserving operation and record picture generation initial operation information, then initial operation information encryption is operation information by encrypting module; Proving installation in above-described embodiment can also comprise: deciphering module, deciphering module is used for being decrypted process to the operation information that server issues and obtains the operation information after deciphering, after data obtaining module 10 gets operation information, deciphered by deciphering module and obtained the operation information after deciphering, then passed through the first screen capture module 20, picture recognition module 30 and testing execution module 40 to tested Application testing.

According to the abovementioned embodiments of the present invention, before to tested Application testing, first terminal is installed tested application program, test event first terminal performing test operation to tested application program is enabled in by starting module 50, tested application program is operated after startup test event, the operation be recorded in the process operating tested application program on the interface of first terminal performs coordinate and performs recording picture corresponding to coordinate with operation, after completing the recording to tested application program, generate and record script, preserve to record script and record picture and generate initial operation information, after encrypting module receives initial operation information, initial operation information is encrypted and obtains operation information.

Proving installation in above-described embodiment can also comprise information sending module, and this information sending module is used for after obtaining operation information, and operation information is sent to server.

Particularly, the second terminal in above-described embodiment can also comprise request sending module and information receiving module, this request sending module is connected with server, for sending test request to server, after server receives test request, the operation information corresponding with test request is sent to the second corresponding terminal, after the information receiving module of the second terminal receives the operation information that server returns, deciphering module obtains the operation information after deciphering to operation information deciphering, then picture recognition module 30 is according to the operation information identifying operation playback coordinate after this deciphering, and pass through testing execution module 40 in the second terminal to tested Application testing.

Alternatively, information sending module in above-described embodiment one, request sending module and information receiving module can be the processing modules being built in first terminal or the second terminal, also can be directly use the network communication device (e.g., antenna) in first terminal or the second terminal (as mobile phone, panel computer) to realize.

As shown in Figure 8, the picture recognition module 30 in above-described embodiment can comprise: region acquisition module 31, similarity calculation module 32, detection module 33, first coordinate obtaining module 34 and the second coordinate obtaining module 35.

Wherein, region acquisition module 31, for finding the region corresponding with recording picture in interface images.

Similarity calculation module 32, for zoning and the similarity recording picture.

Whether detection module 33, meet predetermined threshold value for detecting similarity.

Particularly, predetermined threshold value characterizes region and the preset reference value recording picture analogies degree.In this step, similarity meets predetermined threshold value and then determines that the region obtained by region acquisition module 31 is effective region, thus confirm that region is high with the similarity recording picture, if effective coverage then uses the first coordinate obtaining module 34 to confirm operation playback coordinate; Similarity does not meet predetermined threshold value and then determines that the region obtained by region acquisition module 31 is invalid.Suppose to there is P button in the first mobile phone, and in the second mobile phone, there is not P button, even if corresponding region of recording picture can be found by region acquisition module 31, but the similarity both calculating does not meet predetermined threshold value, then think that both similarities are on the low side, confirm that this region is invalid region, then use the second coordinate obtaining module 35 to confirm operation playback coordinate.

First coordinate obtaining module 34, for when similarity meets predetermined threshold value, performs coordinate according to operation and searches corresponding operation playback coordinate in the zone with the position relationship recording picture.

Second coordinate obtaining module 35, for when similarity does not meet predetermined threshold value, performs the resolution determination operation playback coordinate of coordinate and first terminal and the second terminal according to operation.

In this embodiment, owing to being same program in the tested application program of first terminal and the second terminal test, the region corresponding with recording picture then found in interface images, that similarity is very high or on all four theoretically, but in actual software performance history, developer is for different screen size, the mobile phone of different resolution or even different brands can do some differentiation process (such as: some Menu key is form in different resolution, vary in size, even some button existed on the mobile phone of giant-screen does not exist on little screen mobile phone), these differentiation process result through region that region acquisition module 31 obtains and record picture and may there are some differences.

By above-mentioned zone acquisition module 31, similarity calculation module 32, detection module 33, first coordinate obtaining module 34, and second coordinate obtaining module 35 can confirm to operate playback coordinate by different coordinate processing methods to the region different from recording the similarity degree of picture, the confirmation method of the operation playback coordinate calculated by the first coordinate obtaining module 34 pairs of pixel characteristic, and the second coordinate obtaining module 35 is according to the multiplying power determination operation playback coordinate of resolution, high with the similarity recording picture in region, use the first coordinate obtaining module 34 higher than the accuracy of use second coordinate obtaining module 35, and on the low side with the similarity recording picture in region, think there is not this recording picture in interface images, confirm that the accuracy of operation playback coordinate is higher by the second coordinate obtaining module 35 to the first coordinate obtaining module 34.Different coordinate confirmation methods is adopted from the similarity degree recording picture according to region, different process can be carried out to different test case, thus can avoid being used alone the first coordinate obtaining module 34 or being used alone the second coordinate obtaining module 35 confirming the error that coordinate brings, thus can obtain operating playback coordinate more accurately.

Above-mentioned region acquisition module 31, similarity calculation module 32, detection module 33, first coordinate obtaining module 34 and the second coordinate obtaining module 35, the implementation method of the step S502 to step S510 respectively in corresponding method embodiment.The example that above-mentioned region acquisition module 31, similarity calculation module 32, detection module 33, first coordinate obtaining module 34 and the second coordinate obtaining module 35 and corresponding step realize is identical with application scenarios, but the content be not limited to disclosed in above-described embodiment one, and above-mentioned five modules may operate in terminal or mobile terminal, software or hardware implementing can be passed through.

Need to further illustrate, region acquisition module can call image data base of increasing income in interface images, find the region corresponding with recording picture.Wherein, alternatively, image data base of increasing income can be OpenCV, getting the execution of the operation in operation information coordinate (x1, y1) and after recording picture A, in the process of the second terminal playback operation information, can first intercepting interface images B, then recording the region of picture A in interface images B by using the algorithm for pattern recognition in OpenCV to calculate.In this embodiment, the function of pattern-recognition is introduced in the recording and playback process of first terminal and the second terminal, the remarkable operation according to recording performs coordinate and carry out playback in the second terminal, but inquire corresponding region of recording picture on interface images by the identification of pattern-recognition to pixel, do not rely on the source code of same resolution and application program, can determine that in the second terminal, respective operations performs the operation playback coordinate of coordinate, can navigate to the test position of the second terminal quickly and accurately, and the accuracy rate of searching is higher.

Particularly, as shown in Figure 9, region acquisition module 31 can comprise: collection apparatus module 311, characteristic matching module 313 and area determination module 315.

Wherein, collection apparatus module 311, for recording unique point and the proper vector of picture and interface images by the collection of Scale invariant features transform algorithm.

Characteristic matching module 313, calculates characteristic information for carrying out characteristic matching to the unique point collected and proper vector.

Area determination module 315, for according to pre-conditioned to characteristic information carry out filtration treatment obtain filter after characteristic information, use filter after characteristic information sketch out region.

In the above embodiment of the present invention, in the upper journey of first terminal (as the first mobile phone) while record operation performs coordinate, intercepted operation and performed the recording picture of the vicinity of coordinate and preserve, this recording picture is used for carrying out pattern-recognition coupling in playback, in the replayed section of the second terminal, after installing and start tested application program, interface images is intercepted when the runnable interface of the second terminal (as the second mobile phone), OpenCV can be used to carry out image recognition to interface images and recording picture, identify and record the region of picture in interface images, and according to this region determination operation playback coordinate, then the operation of recording script is performed coordinate and replace with the recording script that operation playback coordinate obtains replacing rear (or after upgrading), and the recording script after the upper execution of the second terminal (as the second mobile phone) is replaced, the test to tested application program in the second terminal is completed after executing all test operations in the recording script after replacement.

Further, record one or more test operations that tested application program is tested owing to recording in script, in the second terminal before playback, to recording script be only carried out coordinate renew, any amendment is not carried out to the other guide recorded in script, thus testing execution module intactly can perform all test operations in the script of recording, be only that the coordinate of operation is different.Pass through above-described embodiment, by the replacement to the coordinate recorded in script, when second terminal is tested tested application program, do not relate to the resolution of test terminal and the source code of application program, thus across the problem of resolution test, the effect of accurately searching test coordinate cannot be achieved when solving software test

The collection apparatus module 311 provided in the present embodiment, characteristic matching module 313 and area determination module 315 are identical with the using method that embodiment one provides, application scenarios also can be identical.It is noted, of course, that the scheme that above-mentioned module relates to can be not limited to content in above-described embodiment one and scene.

Whether according to the abovementioned embodiments of the present invention, the first coordinate obtaining module can comprise: position discrimination module, be the first nodal point recording picture for performing operating point corresponding to coordinate according to position relationship determination operation; Central point searches module, for when operating point is first nodal point, and the second central point of seek area, the coordinate of the second central point is operation playback coordinate; Abstraction module, for when operating point is not first nodal point, randomly draws the playback point of predetermined number in region; First distance calculation module, for calculating the first distance between each playback point and the second central point; Second distance computing module, for the second distance between calculating operation point and first nodal point; Difference calculating module, obtains difference collection for calculating the first distance respectively with the difference of second distance; Extraction module, for from the minimum difference of difference converges extraction of values; Coordinate determination module, for being worth the coordinate of playback point corresponding to minimum difference as operation playback coordinate.

In the above embodiment of the present invention, the second coordinate obtaining module can comprise: resolution acquisition module, for the second resolution of the first resolution and the second terminal that obtain first terminal; Multiplying power computing module, for calculating the multiplying power of first resolution and second resolution; Coordinate transformation module, carries out resolution conversion for using multiplying power to operation execution coordinate and obtains operation playback coordinate.

Embodiment 3

In the configuration that it is the most basic, Figure 10 is the structural representation of the test macro of application program according to the embodiment of the present invention three.For purposes of illustration, the architecture of painting is only an example of proper environment, not proposes any limitation to the usable range of the application or function.This computing system should be interpreted as, to the arbitrary assembly shown in Figure 10 or its combination, there is any dependence or demand yet.

As shown in Figure 10, this system can comprise: first terminal 1, server 3 and the second terminal 5.

Wherein, first terminal 1, for generating and upload operation information according to the test operation performed tested application program, wherein, operation information comprise on first terminal for perform test operation interface, on interface, perform test operation time operation perform coordinate and on interface, perform test operation time perform recording picture corresponding to coordinate with operating.

Server 3, is connected with first terminal 1, for preserving the operation information received, and after receiving test request, the operation information of correspondence is issued to corresponding terminal;

Second terminal 5, be connected with server 3, for sending test request, and after receiving the operation information that server issues, intercept interface images during runnable interface in the second terminal, and to interface images with record picture and carry out picture recognition, according to after performing operation playback coordinate corresponding to coordinate with operation in the result determination interface images of picture recognition, according to operation playback coordinate on the interface of the second terminal to tested application program execution test operation.

Adopt the present invention, by the test operation generating run information that first terminal performs tested application program, the process that first terminal obtains operation information is recording process, operation when not only have recorded the interface of execution test operation and perform test operation in this recording process on interface performs coordinate, also have recorded when to perform test operation on interface and perform recording picture corresponding to coordinate with operation, in the second terminal, this operation information of playback is with before completing the test to tested application program, namely in the above-described embodiments, before second terminal performs test operation to tested application program, picture recognition is carried out to the interface images in the second terminal intercepted during runnable interface and recording picture, according in the result determination interface images of picture recognition with operation perform operation playback coordinate corresponding to coordinate after, on the interface of the second terminal, test operation is performed to tested application program according to operation playback coordinate (instead of the operation of recording on first terminal performs coordinate), thus when carrying out the test of application program in the second terminal, perform coordinate not based on the operation of recording on first terminal and perform test operation, but get by picture recognition the operation playback coordinate execution test operation that operation performs coordinate correspondence in the second terminal, the source code of resolution and tested application program is not relied in replayed section, only use coordinate just can determine test position (representing this position with operation playback coordinate) accurately in the second terminal, then on the interface of the second terminal, the test operation to tested application program is performed according to operation playback coordinate, solve in prior art the terminal using recording and replaying method testing software cannot adapt to different resolution, thus cause the inaccurate problem of software test result, achieve Obtaining Accurate operation and perform coordinate, thus in the second terminal, accurately can perform test operation, reach the effect of the test result obtaining application program accurately.

Wherein, the first terminal 1 in above-described embodiment and the second terminal 5 can be same user terminals, also, in above-mentioned test macro, can complete the test process of recording operation information and playback operation information on same user terminal; And in the above embodiment of the present invention, the quantity of the second terminal 5 can be one or more, also namely the operation information that server is preserved according to the test request of the second different terminal transmissions, can be issued to corresponding one or more second terminals by server.

What needs further illustrated is, on first terminal 1, recording operation information can first be installed and start tested application program on first terminal 1, start the test duration of the tested application program of test, realize the test to tested application program on first terminal in particular by this tested application program of operation.First terminal 1 performs when interface, operation when performing test operation on interface of recording each test operation in the process of test operation perform coordinate and perform test operation on interface and perform recording picture corresponding to coordinate with operating.Wherein, test operation, interface and operation perform coordinate record in recording script, and the incidence relation in this script between in store test operation and recording picture.

Above-mentioned test event comprises one or more test operation, particularly, second terminal sends the test request of the tested application program of test to server, server (as Cloud Server) is after receiving test request, read should the operation information of test request from database, and this operation information is issued to the second terminal, second terminal is after receiving the operation information that server returns, read test operation successively from the recording script operation information, and obtain corresponding recording picture by test operation and recording picture successively with the operation incidence relation performed between coordinate, then the interface images during interface the second terminal being run this execution test operation is intercepted, and picture recognition is carried out to interface images and recording picture, according in the result determination interface images of picture recognition with operation perform operation playback coordinate corresponding to coordinate after, judge whether that the operation identifying full performs coordinate, after having identified that operations all in recording script performs operation playback coordinate corresponding to coordinate, on the interface of the second terminal, successively test operation is performed to tested application program according to operation playback coordinate.

Particularly, second terminal performs test operation to tested application program according to operation playback coordinate on the interface of the second terminal to be realized by the method in embodiment one: the second terminal recognition to operate and perform operation playback coordinate corresponding to coordinate after, the operation of recording in script is performed coordinate and replace with operation playback coordinate, obtain the recording script after upgrading; Then the recording script after interface (in the above-described embodiments for calculating interface) the upper playback of the second terminal upgrades, to perform test operation to tested application program according to operation playback coordinate on the interface of the second terminal

Wherein, the first terminal 1 in above-described embodiment and the second terminal 5 can be the mobile terminal devices (as mobile phone, panel computer) based on Android platform, above-mentioned test macro of the present invention can be applied in the software test of Android phone alternatively.

Such as, when testing the counter of Android phone, can at first terminal 1(as the first mobile phone) on start test event: first test operation is for clicking " 5 ", when recording this test operation, record this click coordinate, namely " 5 " are at the coordinate (x1 at the calculating interface of the first mobile phone, y1), intercept should the recording picture A of coordinate the address D a(Da in practical operation obtaining this recording picture A be the address date of the memory location of concrete recording picture A simultaneously, Da is herein only as the symbol of address date), then can record: click(x1 in recording script, y1) _ Da.When this test event comprises a click action, after completing the recording to this click action, preserve and record script and record picture generating run information, and this operation information is uploaded onto the server 3(as Cloud Server), server 3 is kept in the database of server 3 after receiving operation information.

According to the abovementioned embodiments of the present invention, second terminal 5(is as the second mobile phone) test request of test application (as counter) can be sent to Cloud Server, Cloud Server is after receiving test request, obtain the operation information corresponding with this test request, and operation information is issued to the second mobile phone of request for test, second mobile phone is after receiving the operation information that Cloud Server issues, second mobile phone runs the application program (as counter) of having installed, intercept interface images B corresponding with the calculating interface in operation information on the second mobile phone, then read test operation from recording script successively, if first test operation is for clicking " 5 ", then obtain recording picture A according to recording the address D a recorded in script, by the image identification method in the inventive method embodiment, determine to perform coordinate (x1 with operation in interface images B, y1) corresponding operation playback coordinate (x2, y2) after, according to operation playback coordinate (x2, y2) on the interface of the second terminal, clicking operation is performed.According to above-mentioned embodiment of testing counter, the interface of the second terminal performs test operation to counter, being click coordinate on the calculating interface on the second mobile phone after start-up simulation device is the point of (x2, y2), with measuring and calculation device in the second terminal.

As shown in figure 11, the first terminal 1 in the above embodiments of the present application three can comprise as lower part: first processor 101 and encryption device 103; Second terminal 5 can comprise the second processor 501: any one the proving installation 513 in decryption device 511 and embodiment two.

Wherein, first processor 101, for after the test event starting tested application program on first terminal, the operation when interface being recorded in first terminal performing test operation performs coordinate, and intercept on the interface of first terminal according to default intercepting pixel data and performs recording picture corresponding to coordinate with operation, then preserve operation and perform coordinate, interface and record picture generation initial operation information.Test event can comprise one or more test operation.

Encryption device 103, is connected with first processor 101, for being operation information by initial operation information encryption.

Decryption device 511, is connected between server 3 and proving installation 513, and the operation information for issuing server is decrypted process and obtains the operation information after deciphering.

According to the abovementioned embodiments of the present invention, before to tested Application testing, first terminal 1 installs tested application program, test event first terminal 1 performing test operation to tested application program is enabled in by first processor 101, tested application program is operated after startup test event, the operation be recorded in the process operating tested application program on the interface of first terminal performs coordinate and performs recording picture corresponding to coordinate with operation, generate after completing the recording to tested application program and record script, wherein, record script to comprise interface and operate execution coordinate and operate the incidence relation performing coordinate and recording picture, preserve to record script and record picture and generate initial operation information, encryption device 103 is encrypted initial operation information and obtains operation information after receiving the initial operation information that first processor 101 sends.

First terminal 1 in above-described embodiment can also comprise information transmitting apparatus 105, and as shown in Figure 2, this dispensing device 105 is connected between encryption device 103 and server 3, for after obtaining operation information, this operation information is sent to server 3.

Particularly, the second terminal in above-described embodiment can also comprise send-request unit 505 and information receiver 507, this send-request unit is connected with server 3, for sending test request to server, after server 3 receives test request, the operation information corresponding with test request is sent to the second corresponding terminal, after the information receiver 507 of the second terminal 5 receives the operation information that server returns, decryption device 511 pairs of operation information deciphering obtain the operation information after deciphering, second processor 501 is according to the operation information identifying operation playback coordinate after this deciphering, and realize in the second terminal the test of tested application program.

Alternatively, information transmitting apparatus 105 in above-described embodiment three, send-request unit 505 and information receiver 507 can be the processing modules being built in first terminal 1 or the second terminal 5, also can be directly use first terminal 1 or the second terminal 5(as mobile phone, panel computer) on network communication device (e.g., antenna) realize.

Startup module 50 in above-described embodiment two, logging modle 60, second screen capture module 70, detection module 80 and preservation module 90 can be arranged on first terminal, and first terminal is by generating run information in above-mentioned proving installation; Data obtaining module 10, first screen capture module 20, picture recognition module 30 and testing execution module 40 in above-described embodiment can be arranged in the second processor 503, and the second terminal 5 is by the test of above-mentioned processing modules implement to tested application program.

From the above description, can find out and present invention achieves following technique effect:

Adopt the present invention, second terminal performs tested application program in the process of test operation, get on first terminal the operation information that tested application program performs, because operation when not only comprising the interface of execution test operation in operation information and perform test operation on interface performs coordinate, also be included in when interface performing test operation and perform recording picture corresponding to coordinate with operation, before second terminal performs test operation, picture recognition is carried out to the interface images in the second terminal intercepted during runnable interface and recording picture, and according in the result determination interface images of picture recognition with operation perform operation playback coordinate corresponding to coordinate after, on the interface of the second terminal, test operation is performed to tested application program according to operation playback coordinate (instead of the operation of recording on first terminal performs coordinate), perform coordinate not based on the operation of recording on first terminal and perform test operation, but get by picture recognition the operation playback coordinate execution test operation that operation performs coordinate correspondence in the second terminal, the source code of resolution and tested application program is not relied in replayed section, only use coordinate just can determine test position (representing this position with operation playback coordinate) accurately in the second terminal, then on the interface of the second terminal, the test operation to tested application program is performed according to operation playback coordinate, solve in prior art the terminal using recording and replaying method testing software cannot adapt to different resolution, thus cause the inaccurate problem of software test result, achieve Obtaining Accurate operation and perform coordinate, thus in the second terminal, accurately can perform test operation, reach the effect of the test result obtaining application program accurately.

The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.

In the above embodiment of the present invention, the description of each embodiment is all emphasized particularly on different fields, in certain embodiment, there is no the part described in detail, can see the associated description of other embodiments.

In several embodiments that the application provides, should be understood that, disclosed terminal, the mode by other realizes.Wherein, device embodiment described above is only schematic, the division of such as unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, such as multiple unit or assembly can in conjunction with or another system can be integrated into, or some features can be ignored, or do not perform.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of unit or module or communication connection can be electrical or other form.

The unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, or also can be distributed in multiple network element.Some or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.

In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, also can be that the independent physics of unit exists, also can two or more unit in a unit integrated.Above-mentioned integrated unit both can adopt the form of hardware to realize, and the form of SFU software functional unit also can be adopted to realize.

If integrated unit using the form of SFU software functional unit realize and as independently production marketing or use time, can be stored in a computer read/write memory medium.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words or all or part of of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprises all or part of step of some instructions in order to make a computer equipment (can be personal computer, server or the network equipment etc.) perform each embodiment method of the present invention.And aforesaid storage medium comprises: USB flash disk, ROM (read-only memory) (ROM, Read-OnlyMemory), random access memory (RAM, Random Access Memory), portable hard drive, magnetic disc or CD etc. various can be program code stored medium.

Below be only the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.

Claims

1. a method of testing for application program, is characterized in that, comprising:

Obtain on first terminal the operation information that tested application program performs, wherein, described operation information comprise on described first terminal for perform test operation interface, on described interface, perform described test operation time operation perform coordinate and on described interface, perform described test operation time perform recording picture corresponding to coordinate with described operation;

Intercept interface images when the second terminal running described interface;

Picture recognition is carried out to described interface images and described recording picture, determines to perform operation playback coordinate corresponding to coordinate with described operation in described interface images according to the result of picture recognition;

On the described interface of described second terminal, described test operation is performed to described tested application program according to described operation playback coordinate.

2. method of testing according to claim 1, it is characterized in that, picture recognition is carried out to described interface images and described recording picture, determines to comprise with the described operation playback coordinate performing coordinate corresponding that operates in described interface images according to the result of picture recognition:

The region corresponding with described recording picture is found in described interface images;

Calculate the similarity of described region and described recording picture;

Detect described similarity and whether meet predetermined threshold value;

When described similarity meets described predetermined threshold value, perform coordinate according to described operation and search corresponding described operation playback coordinate in this region with the position relationship of described recording picture;

When described similarity does not meet described predetermined threshold value, determine described operation playback coordinate according to the resolution that described operation performs coordinate and described first terminal and described second terminal.

3. method of testing according to claim 2, is characterized in that, finds the region corresponding with described recording picture to comprise in described interface images:

Unique point and the proper vector of described recording picture and described interface images is gathered by Scale invariant features transform algorithm;

Characteristic matching is carried out to the described unique point collected and described proper vector and calculates characteristic information;

According to pre-conditioned to described characteristic information carry out filtration treatment obtain filter after described characteristic information, use the described characteristic information after described filtration to sketch out described region.

4. method of testing according to claim 2, is characterized in that, searches corresponding described operation playback coordinate in this region comprise according to described operation execution coordinate with the position relationship of described recording picture:

Determine that described operation performs the first nodal point whether operating point corresponding to coordinate be described recording picture according to described position relationship;

When described operating point is described first nodal point, search second central point in described region, the coordinate of described second central point is described operation playback coordinate;

When described operating point is not described first nodal point, in described region, extract the playback point of predetermined number;

Calculate the first distance between each described playback point and described second central point;

Calculate the second distance between described operating point and described first nodal point;

Calculate described first distance respectively and obtain difference collection with the difference of described second distance;

From the described difference that described difference converges extraction of values is minimum;

Using the coordinate of described playback point corresponding for described difference minimum for described value as described operation playback coordinate.

5. method of testing according to claim 2, is characterized in that, determines that described operation playback coordinate comprises according to the resolution that described operation performs coordinate and described first terminal and described second terminal:

Obtain the first resolution of described first terminal and the second resolution of described second terminal;

Calculate the multiplying power of described first resolution and described second resolution;

Use described multiplying power to carry out resolution conversion to described operation execution coordinate and obtain described operation playback coordinate.

6. method of testing as claimed in any of claims 1 to 5, is characterized in that, before obtaining the operation information performed tested application program on first terminal, described method of testing comprises:

Be enabled in the test event of described first terminal being tested described tested application program, wherein, described test event comprises one or more test operation;

Described operation when the described interface being recorded in described first terminal performing described test operation performs coordinate;

Intercept on the described interface of described first terminal according to default intercepting pixel data and perform described recording picture corresponding to coordinate with described operation;

Preserve described operation execution coordinate, described interface and described recording picture and generate described operation information.

7. a proving installation for application program, is characterized in that, comprising:

Data obtaining module, for obtaining on first terminal the operation information that tested application program performs, wherein, described operation information comprise on described first terminal for perform test operation interface, on described interface, perform described test operation time operation perform coordinate and on described interface, perform described test operation time perform recording picture corresponding to coordinate with described operation;

First screen capture module, for intercepting interface images when the second terminal running described interface;

Picture recognition module, for carrying out picture recognition to described interface images and described recording picture, determines to perform operation playback coordinate corresponding to coordinate with described operation in described interface images according to the result of picture recognition;

Testing execution module, for performing described test operation to described tested application program according to described operation playback coordinate on the described interface of described second terminal.

8. proving installation according to claim 7, is characterized in that, described picture recognition module comprises:

Region acquisition module, for finding the region corresponding with described recording picture in described interface images;

Similarity calculation module, for calculating the similarity of described region and described recording picture;

Whether detection module, meet predetermined threshold value for detecting described similarity;

First coordinate obtaining module, for when described similarity meets described predetermined threshold value, performs coordinate according to described operation and searches corresponding described operation playback coordinate in this region with the position relationship of described recording picture;

Second coordinate obtaining module, for when described similarity does not meet described predetermined threshold value, determines described operation playback coordinate according to the resolution that described operation performs coordinate and described first terminal and described second terminal.

9. proving installation according to claim 8, is characterized in that, described region acquisition module comprises:

Collection apparatus module, for gathering unique point and the proper vector of described recording picture and described interface images by Scale invariant features transform algorithm;

Characteristic matching module, calculates characteristic information for carrying out characteristic matching to the described unique point collected and described proper vector;

Area determination module, for according to pre-conditioned to described characteristic information carry out filtration treatment obtain filter after described characteristic information, use the described characteristic information after described filtration to sketch out described region.

10. proving installation according to claim 8, is characterized in that, described first coordinate obtaining module comprises:

Position discrimination module, for determining that according to described position relationship described operation performs the first nodal point whether operating point corresponding to coordinate be described recording picture;

Central point searches module, for when described operating point is described first nodal point, searches second central point in described region, and the coordinate of described second central point is described operation playback coordinate;

Abstraction module, for when described operating point is not described first nodal point, extracts the playback point of predetermined number in described region;

First distance calculation module, for calculating the first distance between each described playback point and described second central point;

Second distance computing module, for calculating the second distance between described operating point and described first nodal point;

Difference calculating module, obtains difference collection for calculating described first distance respectively with the difference of described second distance;

Extraction module, for from the minimum described difference of described difference converges extraction of values;

Coordinate determination module, for using the coordinate of described playback point corresponding for described difference minimum for described value as described operation playback coordinate.

11. proving installations according to claim 8, is characterized in that, described second coordinate obtaining module comprises:

Resolution acquisition module, for the second resolution of the first resolution and described second terminal that obtain described first terminal;

Multiplying power computing module, for calculating the multiplying power of described first resolution and described second resolution;

Coordinate transformation module, carries out resolution conversion for using described multiplying power to described operation execution coordinate and obtains described operation playback coordinate.

12., according to the proving installation in claim 7 to 11 described in any one, is characterized in that, described proving installation comprises:

Start module, for being enabled in the test event of described first terminal being tested described tested application program, wherein, described test event comprises one or more test operation;

Logging modle, described operation when performing described test operation on the described interface being recorded in described first terminal performs coordinate;

Second screen capture module, performs described recording picture corresponding to coordinate for intercepting on the described interface of described first terminal according to default intercepting pixel data with described operation;

Preserving module, generating described operation information for preserving described operation execution coordinate, described interface and described recording picture.

The test macro of 13. 1 kinds of application programs, is characterized in that, comprising:

First terminal, for generating and upload operation information according to the test operation performed described tested application program, wherein, described operation information comprise on described first terminal for perform test operation interface, on described interface, perform described test operation time operation perform coordinate and on described interface, perform described test operation time perform recording picture corresponding to coordinate with described operation;

Server, is connected with described first terminal, for preserving the described operation information received, and after receiving test request, the described operation information of correspondence is issued to corresponding terminal;

Second terminal, be connected with described server, for sending described test request, and after receiving the described operation information that described server issues, intercept interface images when the second terminal running described interface, and picture recognition is carried out to described interface images and described recording picture, determine according to the result of picture recognition in described interface images with described operate perform operation playback coordinate corresponding to coordinate after, on the described interface of described second terminal, described test operation is performed to described tested application program according to described operation playback coordinate.

14. test macros according to claim 13, is characterized in that,

Described first terminal comprises: first processor, for after being enabled in the test event of described first terminal being tested described tested application program, described operation when the described interface being recorded in described first terminal performing test operation performs coordinate, and intercept on the described interface of described first terminal according to default intercepting pixel data and perform described recording picture corresponding to coordinate with described operation, then preserve described operation and perform coordinate, described interface and described recording picture and generate initial operation information; Encryption device, is connected with described first processor, and for being described operation information by described initial operation information encryption, wherein, described test event comprises one or more test operation;

Described second terminal comprises: the second processor, and described second processor comprises the proving installation in decryption device and claim 8 to 11 described in any one;

Described decryption device, is connected between described server and described proving installation, and the described operation information for issuing described server is decrypted process and obtains the described operation information after deciphering.