CN110347608A

CN110347608A - A kind of test method and relevant apparatus of interactive application

Info

Publication number: CN110347608A
Application number: CN201910647927.7A
Authority: CN
Inventors: 韩尹波; 孙大伟; 方亮; 荆彦青; 贺国睿; 曹斌; 李林申
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-07-17
Filing date: 2019-07-17
Publication date: 2019-10-18
Anticipated expiration: 2039-07-17
Also published as: CN110347608B

Abstract

This application discloses a kind of test methods of interactive application, for improving the testing efficiency of interactive application during the test.The application method includes: to obtain the first image, and the first image is the screenshot in interactive application operational process；By detection model, the target point set of the first image is obtained, target point set includes one or more coordinates of targets points；According to target point set, operational order set is generated, includes one or more operational orders corresponding with coordinates of targets point in operational order set；Test result is obtained according to operational order set.

Description

A kind of test method and relevant apparatus of interactive application

Technical field

This application involves field of computer technology more particularly to the test methods and relevant apparatus of a kind of interactive application.

Background technique

With the development of mobile communication technology, mobile terminal has become the indispensable tool of people.People not only may be used To be communicated by mobile terminal, mobile terminal Internet access, office, amusement etc. can also be used.Wherein, since mobile terminal has There is portability, the game on mobile terminal can play whenever and wherever possible, therefore the substituted tradition of the game on mobile terminal The game of PC end trend, become the first choice of people's amusement and recreation.

In the development process of game of mobile terminal, it usually needs the test of various aspects is carried out to game of mobile terminal, with Whether test game of mobile terminal reruns in the process can have exception.Currently, the testing scheme of game of mobile terminal be based on Monkey testing tool is tested, i.e., by the way that click, sliding etc. is randomly generated in the operational process of game of mobile terminal Operation carrys out the operation of analog subscriber, to realize the test to game of mobile terminal.

However, pure randomness is had based on the scheme that Monkey testing tool is tested, in most cases, Random operation caused by Monkey testing tool is invalid operation, i.e., can not trigger corresponding operation response events, operation has Low efficiency causes testing efficiency low.

Summary of the invention

The embodiment of the present application provides the test method and relevant apparatus of a kind of interactive application, is answered by obtaining interactive mode Screenshot is handled with the interface screenshot in operational process, and by preparatory trained detection model, is obtained on screenshot It is capable of the efficient point set of trigger action response events, then corresponding click is carried out to interactive application based on the efficient point set and is grasped Make, can guarantee in the test process of interactive application can effective trigger action response events, improve testing efficiency.

The embodiment of the present application first aspect provides a kind of test method of interactive application, comprising:

The first image is obtained, the first image is the screenshot in interactive application operational process；

By detection model, the target point set of the first image is obtained, target point set includes one or more coordinates of targets points；

According to target point set, operational order set is generated, includes one or more and coordinates of targets in operational order set The corresponding operational order of point；

Test result is obtained according to operational order set.

The embodiment of the present application second aspect provides a kind of test device of interactive application, comprising:

Acquiring unit, using the first image is obtained, the first image is the screenshot in interactive application operational process；

Acquiring unit, is also used to obtain the target point set of screenshot by detection model, and target point set includes one or more Coordinates of targets point；

Generation unit generates operational order set, includes one or more in operational order set using according to target point set A operational order corresponding with coordinates of targets point；

Acquiring unit is also used to obtain test result according to operational order set.

It further include adding in a kind of implementation of the second aspect of the embodiment of the present application in a kind of possible design Enter unit；

Acquiring unit is also used to obtain the corresponding classification of one or more coordinates of targets points；

Adding unit is used for according to the corresponding classification of one or more coordinates of targets points, by one or more coordinates of targets Point is added to the first processing queue；

Generation unit is also used to the sequence according to one or more coordinates of targets o'clock in the first processing queue, generates behaviour Make instruction set, the operational order in operational order set has corresponding operation order.

In a kind of possible design, in the first implementation of the second aspect of the embodiment of the present application,

Acquiring unit is also used to obtain location information of one or more coordinates of targets points in screenshot；

Adding unit is also used to the location information according to one or more coordinates of targets points in screenshot, by one or more A coordinates of targets point is added to second processing queue；

Generation unit is also used to the sequence according to one or more coordinates of targets points in second processing queue, generates behaviour Make instruction set, the operational order in operational order set has corresponding operation order.

Acquiring unit is also used to obtain the displaying type of screenshot, shows that type includes that transverse screen is shown and vertical screen displaying；

Adding unit is also used to the exhibition of the location information and screenshot according to one or more coordinates of targets points in screenshot Show type, one or more coordinates of targets points are added to second processing queue.

In a kind of possible design, in the first implementation of the second aspect of the embodiment of the present application, further include Replacement unit；

Generation unit is also used to generate stochastic set, wherein stochastic set includes N number of random coordinates according to the first image Point, and the mutual distance values of N number of random coordinates point are greater than preset threshold；

Replacement unit, for M random coordinates point in stochastic set to be replaced with the point of the coordinates of targets in target point set, Updated stochastic set is obtained, wherein includes M coordinates of targets point in target point set；

Generation unit is also used to generate operational order set according to updated stochastic set.

In a kind of possible design, in the first implementation of the second aspect of the embodiment of the present application, further include Operating unit；

Acquiring unit, if being also used on the runnable interface of interactive application obtain the first interface there are target pages Control information, wherein target pages are the subpage frame independently of the main interface of interactive application；

Generation unit generates page object if being also used to the first interface control information and preset regular expression matching Cancel operational order in face；

Operating unit is also used to cancel operational order according to target pages operating to target pages.

Acquiring unit obtains second contact surface control letter if the runnable interface for being also used to interactive application is login interface Breath；

Acquiring unit is matched with preset login interface control information if being also used to second contact surface control information, is obtained Log-on message；

Operating unit is also used to carry out register to login interface according to log-on message.

The embodiment of the present application third aspect provides a kind of server, comprising:

Memory, transceiver, processor and bus system；

Wherein, memory is for storing program；

Processor is used to execute the program in memory, includes the following steps:

By detection model, the target point set of screenshot is obtained, target point set includes one or more coordinates of targets points；

Test result is obtained according to operational order set；

Bus system is for connecting memory and processor, so that memory and processor are communicated.

The embodiment of the present application fourth aspect provides a kind of computer readable storage medium, in computer readable storage medium It is stored with instruction, when run on a computer, so that the method that computer executes any of the above-described aspect.

The aspect of the embodiment of the present application the 5th provides a kind of computer program product comprising instruction, when its in computer or When being run on person's processor, so that the method that computer or processor execute any of the above-described aspect.

As can be seen from the above technical solutions, the embodiment of the present application has the advantage that

Detailed description of the invention

Fig. 1 is a configuration diagram of the test macro of interactive application in the embodiment of the present application；

Fig. 2 is the exemplary diagram of the page provided by the embodiments of the present application for submitting interactive application to be tested；

Fig. 3 is a kind of exemplary diagram of the test method of interactive application provided by the embodiments of the present application；

Fig. 4 is the exemplary diagram of the interface screenshot provided in the present embodiment；

Fig. 5 is the exemplary diagram that the interface screenshot in Fig. 4 is labeled and is classified；

Fig. 6 is a kind of positional priority exemplary diagram of transverse screen screenshot provided by the embodiments of the present application；

Fig. 7 is a kind of positional priority exemplary diagram of vertical screen screenshot provided by the embodiments of the present application；

Fig. 8 is the testing process schematic diagram of interactive application provided by the embodiments of the present application；

Fig. 9 is the flow diagram provided by the embodiments of the present application for generating point set；

Figure 10 is test device one embodiment schematic diagram of interactive application in the embodiment of the present application；

Figure 11 is a kind of server architecture schematic diagram provided by the embodiments of the present application.

Specific embodiment

The embodiment of the present application provides the test method and relevant apparatus of a kind of interactive application, answers for improving interactive mode With testing efficiency during the test.

The description and claims of this application and term " first ", " second ", " third ", " in above-mentioned attached drawing The (if present)s such as four " are to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should manage The data that solution uses in this way are interchangeable under appropriate circumstances, so that embodiments herein described herein for example can be to remove Sequence other than those of illustrating or describe herein is implemented.In addition, term " includes " and " corresponding to " and their times What is deformed, it is intended that cover it is non-exclusive include, for example, contain the process, method of a series of steps or units, system, Product or equipment those of are not necessarily limited to be clearly listed step or unit, but may include be not clearly listed or for The intrinsic other step or units of these process, methods, product or equipment.

It should be understood that the embodiment of the present application is applied to specifically can be applied to based on machine learning using test scene The scene that the application programs such as instant messaging program, information browing program or interactive application are tested.Wherein, machine learning (Machine Learning, ML) is a multi-field cross discipline, is related to probability theory, statistics, Approximation Theory, convextiry analysis, calculation The multiple subjects such as method complexity computation.The learning behavior that the mankind were simulated or realized to computer how is specialized in, to obtain newly Knowledge or skills reorganize the existing structure of knowledge and are allowed to constantly improve the performance of itself.Machine learning is artificial intelligence Core, is the fundamental way for making computer have intelligence, and application spreads the every field of artificial intelligence.Machine learning and depth Study generally includes the technologies such as artificial neural network, confidence network, intensified learning, transfer learning, inductive learning, formula teaching habit.

For example, passing through the main interface in interception instant messaging program, chat window when testing instant messaging program The screenshot at the interfaces such as interface either chat message input interface is then based on preparatory trained detection model (on e.g. The artificial neural network stated) screenshot is identified, effective operation point set in screenshot is obtained, such as obtain and correspond to main interface The point set of the positions such as " chat window ", " address list " in screenshot, or obtain and correspond in the screenshot of chat window interface The point set of the positions such as " text input ", " picture input " " sending information " is then based on these effectively operation point sets to Instant Messenger News program interface is operated, and to trigger corresponding operation event, enters the corresponding scene page.In another example to game into When row test, the screenshot of the pages such as the page is adjusted by stage property purchase page, the fight page either battle array in interception game, It is then based on preparatory trained detection model to identify screenshot, obtains effective operation point set in screenshot, such as obtain Corresponding to the point set of " gold coin purchase ", the positions such as " diamond purchase " in stage property purchase page, it is then based on these and effectively operates Point set operates games page, to trigger corresponding operation event, enters the corresponding scene page.For the ease of chatting It states, the test method of interactive application provided by the embodiments of the present application will be described in detail for testing game below.

Currently, the scheme tested game is typically based on Monkey testing tool to test, i.e., in game Operational process in by the way that the operations such as click, sliding are randomly generated come the operation of analog subscriber, to realize the test to game. Wherein, Monkey refers to the people for not testing experience even to computer uncomprehending people (just as monkey) at all, he is not Need to know the knowledge of any user interaction aspect of program, if giving him a program, he will be for the interface that he sees Operated, operation be it is random, disorderly point disorderly by, in other words, Monkey testing tool can be understood as to game Interface carries out the tool of random clicking operation.

For the scheme tested based on Monkey testing tool, it is assumed that have M pixel in interface, wherein N A pixel is effective click on area, then effectively clicking consuming number is then M/N.Wherein, it effectively clicks and refers in click interface Some position after, interface produces response and (such as has entered another scene interface, or popped up new response Interface), effective click on area is then that can produce the region effectively clicked after clicking, and effectively clicks and expends number for a boundary How many times are averagely clicked in face could generate primary effectively click, and effective coverage accounting is that can effectively be clicked in an interface Region accounts for the ratio of interfacial area.Effective coverage accounting for most of interface, in interface It is 1% to 10%, that is to say, that when effective coverage accounting is 1%, effectively clicking consuming number is 100.In addition, testing In the process, in order to which screen interface can be jumped normally, interval certain time interval is generally required between clicking operation twice (such as either 2 seconds 1 second), then, in this case, traversing an interface may need to 100 seconds, efficiency pole It is low.

In view of this, providing the test method and relevant apparatus of a kind of interactive application in the embodiment of the present application, pass through Obtain interactive application operational process in interface screenshot, and by advance trained detection model to screenshot at Reason can obtain screenshot since detection model is obtained using the sample training for largely having marked effective click on area On can be with the efficient point set of trigger action response events, then interactive application is carried out based on the efficient point set corresponding to click behaviour Make, can guarantee in the test process of interactive application can effective trigger action response events, improve testing efficiency.

A kind of test method for interactive application that the application proposes is applied to the test system of interactive application shown in FIG. 1 System, referring to Fig. 1, Fig. 1 is a configuration diagram of the test macro of interactive application in the embodiment of the present application, as schemed institute Show, terminal is established by network and server and communicated to connect, and the user for needing to test interactive application can will be to by terminal The interactive application of test is uploaded on server, and the test of interactive application provided by the embodiments of the present application is executed by server Method tests interactive application, and after testing, and test result is sent to terminal.

As shown in Fig. 2, Fig. 2 is the example of the page provided by the embodiments of the present application for submitting interactive application to be tested Figure.Wherein, user can be opened at the terminal accordingly using upload interface, and user can upload to be measured in the upload interface The interactive application of examination, and select to run the system or type of the interactive application, such as Android system either ios system Deng then interactive application is uploaded on server by clicking ACK button, is finally executed by server to the interaction The test of formula application.

It is worth noting that, in the embodiment of the present application, in addition to that can be answered by the interactive mode that server uploads user Except being tested, the method that can also have the interactive application mentioned in the embodiment of the present application to test in arrangement is corresponding Interactive application is tested in the terminal of software program, herein and is not specifically limited.

The above are the descriptions that the test macro to interactive application provided by the embodiments of the present application carries out, referring to Fig. 3, figure 3 be a kind of exemplary diagram of the test method of interactive application provided by the embodiments of the present application.

A kind of test method one embodiment of the interactive application provided in the embodiment of the present application includes:

301, the first image is obtained, the first image is the screenshot in interactive application operational process；

In the present embodiment, to interactive application, (such as game will be carried out so that interactive application is game as an example below Narration) tested during, available interface screenshot during a game running process, using the interface screenshot as to The interface of operation.Wherein, which can be the screenshot at any one interface in game play, e.g. game The screenshot of main interface, the screenshot etc. at the screenshot at interface of fighting either stage property purchase interface.

It specifically, can be the exemplary diagram of the interface screenshot provided in the present embodiment refering to Fig. 4, Fig. 4.Wherein, Fig. 4 Interface is bought for a stage property in game, it can be seen that in stage property purchase interface, there is multiple indicate not below interface With the purchase button of the amount of money, these purchase buttons are the pattern of rectangle, and there be corresponding can purchase in the top for buying button respectively Stage property (i.e. diamond), in the upper right corner at interface, there are also the return push-buttons of rectangle.Obviously, the purchase button and return push-button in interface It is effective click on area, that is, purchase instruction can be triggered later by clicking purchase button, buy corresponding stage property；Click closing Button can trigger shutoff operation instruction, close current stage property purchase page, back in upper level interface.And in addition to above-mentioned Purchase button and close button except, other regions are invalid clicks region, that is, click after can not obtain effective boundary Face response.

302, by detection model, the target point set of the first image is obtained, target point set includes that one or more targets are sat Punctuate；

In the present embodiment, detection model is preparatory trained model, can be to the available point in interface screenshot It hits region to be identified, to predict to obtain effective click on area in interface screenshot, based in interface screenshot Effective click on area can determine the coordinates of targets point that can trigger effective clicking operation.

Specifically, which can be the model for being able to detect that current game element, i.e., the detection model is to adopt It is obtained with the sample training for being labeled with general game element.Wherein, obtaining detection model mainly includes following two steps: Data mark and model training.

Firstly, the detailed process of data mark are as follows: collect a certain number of game screenshots in advance, these game screenshots can be with It is the screenshot in different types of game, is also possible to the screenshot at the different interfaces in the same game, in these game screenshot It can also simultaneously include to have cutting for multiple and different interfaces in the screenshot in different types of game and each identical game Figure, to guarantee the diversity of game screenshot.After collection obtains game screenshot, can to versatility in these game screenshots compared with Strong game element is labeled and classifies.As shown in figure 5, Fig. 5 is that the interface screenshot in Fig. 4 is labeled and is classified Exemplary diagram.Wherein, multiple rectangular buttons below the median surface Fig. 5 are marked, and are marked as K1, what K1 was indicated It is rectangle type (i.e. rectangular buttons), that is to say, that the rectangular buttons for clicking purchase stage property are marked and classify for square Shape classification；The close button in the interface upper right corner is then marked and is marked as K2, and what K2 was indicated is to close classification, that is, uses It is marked in the button for closing the page and is classified as closing classification.

In the embodiment of the present application, the stronger game element of versatility refers to that effective operational order can be triggered after clicking Element, typically include, but not limited to the background frames such as rectangular shaped rim, round frame, round rectangle frame.It is understood that right For most of game, in order to guarantee the visual experience of user, effective click on area in interface often has It is added what corresponding text was constituted in the background frame of certain shapes, if it is possible to recognize specific background frame, also can To recognize specific effective click on area.

Secondly, the detailed process of model training are as follows: choose initial model to be trained, the sample data that will have been marked (i.e. game screenshot) is input in initial model, and is iterated training to the initial model, until the loss letter in model Number converges to stationary value, obtains trained detection model.

It is understood that detection model specifically can be a machine learning (Machine Learning, ML) model, After given certain sample data, machine learning (i.e. model training) can be carried out based on given sample data.? That is after being trained by using the sample data for being labeled with general game element to machine learning model, the mould Type can be learnt based on these specific sample data simulation mankind, to learn to differentiate game general in these samples Element so, can be by the trained model to interface screenshot after getting interface screenshot In current game element identified, obtain interface screenshot in current game element.In the present embodiment, mould is detected Type can specifically include but model not limited to the following: convolutional neural networks (convolutional neural network, CNN), full convolutional network (fully convolutional networks, FCN).

Specifically, when being detected by detection model to the first image, since detection model is by largely marking in advance The sample data training for being poured in current game element obtains, and therefore, detection model can be by the current game in the first image Element detection comes out.Since what is be detected in the first image is mostly rectangular shaped rim, round frame either round rectangle The background frame of frame, and for the background frame, any point in clicking operation background frame can trigger effective operation Instruction.Therefore, it is directed to a background frame (i.e. a game element), a target corresponding with the background frame can be generated and sit Punctuate e.g. takes the central point of the background frame as coordinates of targets point, that is to say, that is based on the first image target obtained Point is concentrated, and the quantity for the general element that the quantity of coordinates of targets point is obtained with detection is consistent.

303, according to target point set, operational order set is generated, includes one or more and target in operational order set The corresponding operational order of coordinate points；

In the present embodiment, due to that would generally include one or more coordinates of targets points in target point set, and to game The purpose tested then is to enable to enter in more scene of game by clicking the interface in game, therefore, After obtaining coordinates of targets point, the operational order for being used for clicking operation coordinates of targets point can be generated based on these coordinates of targets points Gather, includes operational order corresponding with each coordinates of targets point in operational order set, what these operational orders referred specifically to It is the instruction of the corresponding coordinates of targets point of clicking operation.

304, test result is obtained according to operational order set.

In the present embodiment, it after obtaining operational order set, can be operated based on one in operational order set Instruction operates game, so that game process jumps to another interface from a current interface. Specifically, obtain include one or more operational orders operational order set after, can one by one trigger behaviour one by one Make the operational order in instruction set, after thering is one of operational order to trigger and jumping interface, The test result of current game interface, such as the corresponding game performance data of current game interface, game day are then obtained accordingly The test datas such as will.In other words, obtain include one or more coordinates of targets points target point set after, can be one by one Clicking operation one by one is carried out to the coordinates of targets point in target point set, as long as effective behaviour can be triggered by clicking one of point It instructs, so that game enters another new interface and can achieve the goal, and does not need in target point set Each coordinates of targets point can come into force.Clearly as the coordinates of targets point in target point set is detected based on detection model The target area of acquisition is obtained, and therefore, the coordinates of targets point in target point set can trigger the probability of effective operational order The coordinate points significantly larger than clicked at random, to ensure that the high efficiency of test process.

Finally, corresponding screenshot image can be obtained based on new interface after entering new interface, Then the screenshot image is detected by detection model again, target point set is obtained, finally based on target point set again to new Screenshot image is operated, to guarantee that test process can constantly be carried out down.That is, in the test of entire game Cheng Zhong can carry out above-mentioned step 301 to 304 for each interface in game, execute step 301 to 304 purpose is more efficiently to enter in new interface, and obtains corresponding game test data, finally, When game, which is tested, to be terminated (such as having reached the scheduled game testing time), each new interface will be entered and obtained Game test data summarized, the corresponding game test result of the game can be obtained.

In the present embodiment, by obtaining the interface screenshot in interactive application operational process, and by training in advance Detection model screenshot is handled, obtain and be capable of the efficient point set of trigger action response events on screenshot, then had based on this It imitates point set and corresponding clicking operation is carried out to interactive application, can guarantee can be effective in the test process of interactive application Trigger action response events, improve testing efficiency.

Optionally, on the basis of above-mentioned Fig. 3 corresponding one embodiment, interactive mode provided by the embodiments of the present application is answered In one alternative embodiment of test method, according to target point set, before generating operational order set, method further include:

Obtain the corresponding classification of one or more coordinates of targets points；

According to the corresponding classification of one or more coordinates of targets points, one or more coordinates of targets points are added at first Manage queue；

According to target point set, operational order set is generated, comprising:

According to sequence of one or more coordinates of targets o'clock in the first processing queue, operational order set, operation are generated Operational order in instruction set has corresponding operation order.

In the present embodiment, due to coordinates of targets point be obtained based on the detected target area of detection model, and And the sample data of training detection model is labeled with the corresponding classification of each sample, therefore the target area that detection model detects Domain also has corresponding classification, and in other words, the point of coordinates of targets corresponding to target area also has its corresponding classification.It can manage Solution, in the same interface, after clicking different coordinates of targets points, the number for the interface that can finally traverse Mesh is different, such as after clicking the coordinates of targets point a1 in interface A, is able to enter interface B1, and point It has hit after the coordinates of targets point b in interface B1, also into interface C is opened, has so continued, it may can be with It enters in multiple interfaces；And after clicking the coordinates of targets point a2 in interface A, possibly into having arrived game circle Face B2, and for interface B2, any one coordinate points clicked in interface B2 may all cannot be introduced into newly Interface (be merely able to back to interface A), so, for the same interface, if every time Can preferentially click it is subsequent be able to enter the point of coordinates of targets corresponding to more interfaces, then can guarantee swimming More interfaces can be traversed in play test process, improve the validity of test.

It therefore, in the present embodiment, can be based on the classification of coordinates of targets point, operation corresponding to each coordinates of targets point The execution sequence of instruction is ranked up, i.e., the sequence for clicking coordinates of targets point to operation arranges, so that grasping clicking It can preferentially be clicked when making coordinates of targets point and subsequent be able to enter the point of coordinates of targets corresponding to more interfaces. Specifically, during practical application, as being able to enter mesh corresponding to more interfaces in different game It is different for marking the classification of coordinate points, therefore corresponding classification can be selected as the mesh preferentially clicked according to specific game Mark.

In addition, being able to enter after would generally having click for most interface, on interface new The button (such as rectangular buttons, round button etc.) of interface also has the return push-button back to upper one layer of interface； And for some specific interfaces, close button may be also had, these interfaces are mostly the shapes with pop-up Existing for formula, such as the interfaces such as advertisement interface, stage property column interface, server selection interface, activity bulletin interface, it is above-mentioned Corresponding close button is often had on these interfaces, corresponding pop-up can be closed after close button by clicking, and point Other buttons in these interfaces have been hit then to be likely difficult to enter in effective new interface.For example, for wide For accusing the page, the button in advertisement page in addition to close button is clicked, a link may be generated, terminal is caused to be beaten Browser is opened to enter in the corresponding webpage of the link；For server selects the page, it might have on the server page One server selection list includes multiple alternative servers in the list, click on the page except close by Selected server can be changed in button except button, be unable to enter in new interface.Therefore, for above-mentioned These games pages can preferentially click the close button in games page, that is, current games page be closed, to avoid at this The excessive clicking operation time is wasted on the page.

Obtain location information of one or more coordinates of targets points in screenshot；

According to location information of one or more coordinates of targets points in screenshot, one or more coordinates of targets points are added To second processing queue；

According to target point set, operational order set is generated, comprising:

According to sequence of one or more coordinates of targets points in second processing queue, operational order set, operation are generated Operational order in instruction set has corresponding operation order.

It is understood that since game is operate on mobile terminal, and swum on mobile terminals for most of For the user for playing game, they are while hand or hands hold mobile terminal, using thumb to mobile terminal Screen operated, play game to realize.However, screen is equal for most of mobile terminal on the market Larger, for user while holding mobile terminal, thumb is often difficult to effectively touch the institute on mobile terminal screen There is region, that is to say, that when user holds mobile terminal, user is often merely able to easily on mobile terminal screen Partial region effectively touched, so, have led to user and often frequently click on the area that he is easy to touch Domain, and the region that can not easily touch for him less can then be touched.In view of the click habit of user, most of game When design interface, it will usually which the button for needing frequently to click (or perhaps can be triggered that new interface is corresponding to press Button) it is placed in the region that user is easy to touch.

In view of this, in the present embodiment, it, can be accordingly based upon each coordinates of targets point after obtaining target point set Coordinate information obtain its location information in entire screenshot, that is, obtain each coordinates of targets point on mobile terminal screen Location information, the location information for being then based on coordinates of targets point are ranked up these coordinates of targets points, hold for being located at user For the coordinates of targets point in the region easily touched, it can preferential to click, i.e. click priority is higher；For be located at user compared with For the coordinates of targets point in the region that difficulty touches, then click can be delayed, i.e. click priority is lower.So, To be arranged according to click sequence of the location information of coordinates of targets point to each coordinates of targets point, that is to say, that can be right Operational order corresponding to each coordinates of targets point is ranked up.In this way, can be improved the effective percentage clicked every time, and Guarantee that the coordinates of targets point clicked is the coordinate points for being corresponding with subsequent multi-layer interface, improves the traversal number of interface Amount.

It is worth noting that, the size of screen is often different for the mobile terminal of different model, That is the position that user is easy the region touched is often also likely to be to have differences for unused mobile terminal , therefore, in the present embodiment, the specific screen message for running the mobile terminal of the game to be tested can also be obtained in advance (such as its screen message is determined according to the model of mobile terminal), then screen message and target based on the mobile terminal again The location information of coordinate points codetermines the priority of coordinates of targets point.In addition, (the example for different types of mobile terminal Such as smart phone and tablet computer), the difference of screen size may be bigger, and therefore, can obtaining operation in advance, this is to be measured The corresponding type of mobile terminal for trying game, then obtains the model for belonging to the mobile terminal of the type again, finally obtains it again Screen size information.

Optionally, on the basis of above-mentioned Fig. 3 corresponding one embodiment, interactive mode provided by the embodiments of the present application is answered In one alternative embodiment of test method, obtain location information of one or more coordinates of targets points in screenshot it Before, method further include:

The displaying type of screenshot is obtained, shows that type includes that transverse screen is shown and vertical screen displaying；

According to location information of one or more coordinates of targets points in screenshot, one or more coordinates of targets points are added To second processing queue, comprising:

According to the displaying type of location information and screenshot of one or more coordinates of targets points in screenshot, by one or Multiple coordinates of targets points are added to second processing queue.

It is understood that the location information that user is easy touching can for the mobile terminal of different screen size It can be different, and for the same mobile terminal, institute is right when user operates the interface of vertical screen display The easy touch position information answered and user easy touch position corresponding when being operated to the interface of transverse screen display Information is also likely to be different.

It specifically, can be that a kind of position of transverse screen screenshot provided by the embodiments of the present application is preferential refering to Fig. 6 and Fig. 7, Fig. 6 Grade exemplary diagram；Fig. 7 is a kind of positional priority exemplary diagram of vertical screen screenshot provided by the embodiments of the present application.As shown in fig. 6, Fig. 6 In (a) figure indicate be hands grasping vertical screen place mobile terminal, it can be seen that in this case, the thumb of user The position below mobile terminal screen can be touched easily, and the thumb of user needs mobile a certain distance that can touch Encounter the middle position of mobile terminal screen, and for the position above mobile terminal screen, the thumb of user generally requires Longer distance can touch, in other words, for the lower position of mobile terminal screen, middle position and upper position For setting, the complexity of user's touching is respectively as follows: easy, general and difficult；Based on this, figure (b) in Fig. 6 can be observed, In, (b) expression is schemed in Fig. 6 is mobile terminal when vertical screen is shown, the corresponding click behaviour of different location on mobile terminal screen Make priority, it can be seen that when coordinates of targets point is located at mobile terminal screen lower position, the click of coordinates of targets point Operator precedence grade is first；When coordinates of targets point is located at mobile terminal screen middle position, the click of coordinates of targets point Operator precedence grade is second；When coordinates of targets point is located at mobile terminal screen top position, the click of coordinates of targets point Operator precedence grade be third, that is to say, that can according to user touch mobile terminal screen on different location complexity come The priority of coordinates of targets point is set.

As shown in fig. 7, in Fig. 7 (a) figure indicate be hands grasping transverse screen place mobile terminal, it can be seen that at this In the case of kind, the thumb of user can touch position partially intermediate below mobile terminal screen, the big thumb of user easily Refer to that the position of mobile terminal screen two sides can be touched by needing to carry out certain curling, and for above mobile terminal screen Position, the thumb of user, which generally requires longer distance, to be touched；Based on this, figure (b) in Fig. 7 can be observed, Wherein, (b) expression is schemed in Fig. 7 is mobile terminal when transverse screen is shown, the corresponding click of different location on mobile terminal screen Operator precedence grade, it can be seen that when coordinates of targets point is located at inclined middle position below mobile terminal screen, coordinates of targets The clicking operation priority of point is first；When coordinates of targets point is located at mobile terminal screen middle part and inclined middle position, The clicking operation priority of coordinates of targets point is second；When coordinates of targets point is located at below mobile terminal screen both sides of the edge position partially When setting, the clicking operation priority of coordinates of targets point is third；When coordinates of targets point is located at mobile terminal screen others When position, the point set operator precedence grade of coordinates of targets point is the 4th；Obviously, when mobile terminal carries out transverse screen displaying, The complexity of different location on mobile terminal screen can be touched according to user the priority of coordinates of targets point is arranged.

According to the first image, stochastic set is generated, wherein stochastic set includes N number of random coordinates point, and N number of random seat The mutual distance values of punctuate are greater than preset threshold；

M random coordinates point in stochastic set is replaced with into the point of the coordinates of targets in target point set, is obtained updated Stochastic set wherein includes M coordinates of targets point in target point set；

According to target point set, operational order set is generated, comprising:

According to updated stochastic set, operational order set is generated.

It is understood that in the case where some more special, the coordinates of targets point that is detected by detection model Efficient operation instruction can not may be triggered, that is, after clicking these coordinates of targets points, can not all jump to new game page Face, then, in order to guarantee to can continue to carry out in test, certain alternative coordinate points can be previously provided with, such one Come, when coordinates of targets point can not trigger efficient operation instruction, can also click on alternative coordinate points to trigger.

Specifically, in the present embodiment, a stochastic set can be generated, i.e., at random when obtaining the first image Choose multiple coordinate points in the first image, such as randomly choose N number of coordinate points, N can be according to the case where actual play into One numerical value (such as 10) of row selection, also, this distance values of N number of random coordinates point from each other is greater than preset threshold , to guarantee that this N number of random coordinates point can be dispersed in as much as possible on each position in the first image；Then, by target All coordinates of targets points that point is concentrated replace the preceding M random coordinates point in stochastic set, and (i.e. hypothesis target point is concentrated with M Coordinates of targets point), obtain updated stochastic set (before i.e. M random coordinates point be replaced by after coordinates of targets point with Machine point set).Finally, triggering clicking operation based on updated stochastic set again.

It is worth noting that, the quantity of random coordinates point is greater than target point that is, in stochastic set in the case where N is greater than M The quantity of coordinates of targets point is concentrated, M random coordinates point before can directly replacing M coordinates of targets point；It is less than or waits in N In the case where M, i.e., the quantity of random coordinates point is less than or equal to the quantity of coordinates of targets point in target point set in stochastic set, Then stochastic set directly can be replaced with into target point set.

Optionally, on the basis of above-mentioned Fig. 3 corresponding one embodiment, interactive mode provided by the embodiments of the present application is answered In one alternative embodiment of test method, before obtaining the first image, method further include:

If there are target pages on the runnable interface of interactive application, the first interface control information is obtained, wherein mesh Marking the page is the subpage frame independently of the main interface of interactive application；

If the first interface control information and preset regular expression matching, generates target pages and cancel operational order；

Cancel operational order according to target pages to operate target pages.

It is understood that during a game running process, it is possible to institute on mobile terminal can be led to due to some The interface of display is not the interface in game, such as the interface on mobile terminal is covered by pop-up interface, either Interface is notified column interface and covers etc..In this case, it often requires being carried out to the interface except these game Processing, such as pop-up interface either notification bar interface is handled.

In the present embodiment, if detecting, there are independently of the subpage except game main interface on the runnable interface of game When face (such as pop-up interface), it can at this time pass through application programming interface (Application corresponding in calling system Programming Interface, API) current interface control information is obtained, if the interface control information that discovery acquires With preset regular expression matching, it may be considered that there are except independently of game main interface on the runnable interface of game Therefore subpage frame can generate target pages for the subpage frame (i.e. the pop-up page) and cancel operational order this when, and Cancel operational order according to the target pages and click the cancellation pop-up page, that is to say, that is detecting and preset pop-up canonical When the matched interface control of expression formula, cancels cancel button in pop-up by clicking and cancel the pop-up page, to guarantee Game test is normally carried out.

If the runnable interface of interactive application is login interface, second contact surface control information is obtained；

If second contact surface control information is matched with preset login interface control information, log-on message is obtained；

Register is carried out to login interface according to log-on message.

It, can be by automatically entering account number cipher etc. if having found that game enters login interface in the present embodiment Information completes the login of game.Specifically, the interface control of current interface can be obtained by API corresponding in calling system Part information represents current interface if interface control information is matched with preset login interface control information as login interface, this When available login needed for information (such as login account, login password etc.).Then, automatically right based on these log-on messages Login interface carries out register, login account and login password is e.g. automatically entered, and click login button, thus complete At register.

In order to make it easy to understand, below with reference to Fig. 8 and Fig. 9 to the test side of interactive application provided by the embodiments of the present application Method is described in detail.It can illustrate refering to the testing process that Fig. 8, Fig. 8 are interactive application provided by the embodiments of the present application Figure；Fig. 9 is the flow diagram provided by the embodiments of the present application for generating point set.

In fig. 8, the testing process of interactive application is specific as follows:

801, start game；

802, judge whether the currently displayed interface of mobile terminal is that interface in game specifically can pass through tune Current interface control information is obtained with the API that system responds to be judged；

If 803, the currently displayed interface of mobile terminal is not the interface in game, such as interface by pop-up interface It covers, either enter the desktop of mobile terminal or the interface of third party application in game login interface, have Body, current interface can be handled by calling system corresponding API, e.g. cancellation pop-up interface, automated log on trip Play either pull-up game again, returns to interface etc., complete to interface processing and then go to and continue to execute step 807；

If 804, the currently displayed interface of mobile terminal is the interface in game, obtain on current mobile terminal screen The screenshot at shown interface obtains the first image；

805, candidate point set is generated according to the first image, that is, generates the point set to clicking operation；

806, based on candidate point set, the sequence of coordinate points is concentrated to operate coordinate points one by one according to candidate point, if operation is wherein Effective clicking operation is triggered after one coordinate points, then jumps to new interface, without each coordinate points operation one It is secondary；

807, judge that game tests whether to terminate, such as judge whether the current testing time has had reached preset survey It tries time (such as 5 minutes), if having reached the preset testing time, otherwise Exit Game test goes to and continues to execute step 802；

808, Exit Game is tested.

In addition, Fig. 9 expression is specifically how to generate the process of candidate point set in Fig. 8 in step 805.

In Fig. 9, the process for generating candidate point set is specific as follows:

901, stochastic set is generated, specifically, the first image for being W*H for resolution ratio can randomly select N number of mutual Between distance values be greater than preset threshold S random coordinates point, constitute stochastic set；

902, the first image can specifically be detected by detection model by obtaining coordinates of targets point, obtain M Coordinates of targets point；

903, coordinate system is converted, and screen coordinate system is converted from image coordinate system for M coordinates of targets point, after obtaining conversion M coordinates of targets point, constitute target point set；

904, it updates stochastic set and the coordinates of targets point in target point set is specifically replaced into the preceding M in stochastic set A random coordinates point, obtains updated stochastic set；

905, candidate point set is obtained, wherein candidate point set is updated stochastic set.

Specifically, it can show refering to table 1, table 1 under conditions of length of testing speech is 5 minutes, be tested based on Monkey Scheme and testing scheme provided by the embodiments of the present application that tool is tested traverse comparison and the login interface of total scene quantity Attempt the comparison of number of clicks (partial game does not need to log in).Wherein, scene traversal number embodies the depth of game test, steps on Record number of attempt embodies the effective percentage of test execution operation.

Table 1

As can be seen from Table 1, scheme provided by the embodiments of the present application is compared in the case where no test script writes cost The test depth of operation validity is improved in Monkey scheme.

The device of the page presentation in the embodiment of the present application is described in detail below, referring to Fig. 10, Figure 10 is this Apply for test device one embodiment schematic diagram of interactive application in embodiment, the survey of interactive application in the embodiment of the present application Trial assembly sets 100

Acquiring unit 1001, using the first image is obtained, the first image is the screenshot in interactive application operational process；

Acquiring unit 1001, is also used to obtain the target point set of screenshot by detection model, target point set include one or Multiple coordinates of targets points；

Generation unit 1002 generates operational order set, includes one in operational order set using according to target point set Or multiple operational orders corresponding with coordinates of targets point；

Acquiring unit 1001 is also used to obtain test result according to operational order set.

Optionally, on the basis of the embodiment corresponding to above-mentioned Figure 10, interactive application provided by the embodiments of the present application Test device 100 another embodiment in, further include adding unit 1003；

Acquiring unit 1001 is also used to obtain the corresponding classification of one or more coordinates of targets points；

Adding unit 1003 is used for according to the corresponding classification of one or more coordinates of targets points, by one or more targets Coordinate points are added to the first processing queue；

Generation unit 1002 is also used to the sequence according to one or more coordinates of targets o'clock in the first processing queue, raw At operational order set, the operational order in operational order set has corresponding operation order.

Optionally, on the basis of the embodiment corresponding to above-mentioned Figure 10, interactive application provided by the embodiments of the present application Test device 100 another embodiment in,

Acquiring unit 1001 is also used to obtain location information of one or more coordinates of targets points in screenshot；

Adding unit 1003 is also used to the location information according to one or more coordinates of targets points in screenshot, by one Or multiple coordinates of targets points are added to second processing queue；

Generation unit 1002 is also used to the sequence according to one or more coordinates of targets points in second processing queue, raw At operational order set, the operational order in operational order set has corresponding operation order.

Acquiring unit 1001 is also used to obtain the displaying type of screenshot, shows that type includes that transverse screen is shown and vertical screen displaying；

Adding unit 1003 is also used to location information and screenshot according to one or more coordinates of targets points in screenshot Displaying type, one or more coordinates of targets points are added to second processing queue.

Optionally, on the basis of the embodiment corresponding to above-mentioned Figure 10, interactive application provided by the embodiments of the present application Test device 100 another embodiment in, further include replacement unit 1004；

Generation unit 1002 is also used to generate stochastic set according to the first image, wherein stochastic set includes N number of random Coordinate points, and the mutual distance values of N number of random coordinates point are greater than preset threshold；

Replacement unit 1004 is sat for M random coordinates point in stochastic set to be replaced with the target in target point set Punctuate obtains updated stochastic set, wherein includes M coordinates of targets point in target point set；

Generation unit 1002 is also used to generate operational order set according to updated stochastic set.

Optionally, on the basis of the embodiment corresponding to above-mentioned Figure 10, interactive application provided by the embodiments of the present application Test device 100 another embodiment in, further include operating unit 1005；

Acquiring unit 1001, if being also used on the runnable interface of interactive application, there are target pages, obtain first Interface control information, wherein target pages are the subpage frame independently of the main interface of interactive application；

Generation unit 1002 generates mesh if being also used to the first interface control information and preset regular expression matching It marks the page and cancels operational order；

Operating unit 1005 is also used to cancel operational order according to target pages operating to target pages.

Acquiring unit 1001 obtains second contact surface control if the runnable interface for being also used to interactive application is login interface Part information；

Acquiring unit 1001 matches if being also used to second contact surface control information with preset login interface control information, Obtain log-on message；

Operating unit 1005 is also used to carry out register to login interface according to log-on message.

Figure 11 is a kind of server architecture schematic diagram provided by the embodiments of the present application, which can be because of configuration or property Energy is different and generates bigger difference, may include one or more central processing units (central processing Units, CPU) 1122 (for example, one or more processors) and memory 1132, one or more storage applications The storage medium 1130 (such as one or more mass memory units) of program 1142 or data 1144.Wherein, memory 1132 and storage medium 1130 can be of short duration storage or persistent storage.The program for being stored in storage medium 1130 may include one A or more than one module (diagram does not mark), each module may include to the series of instructions operation in server.More into One step, central processing unit 1122 can be set to communicate with storage medium 1130, execute storage medium on server 1100 Series of instructions operation in 1130.

Server 1100 can also include one or more power supplys 1126, one or more wired or wireless nets Network interface 1150, one or more input/output interfaces 1158, and/or, one or more operating systems 1141, example Such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM etc..

In the embodiment of the present application, CPU 1322 included by the server 1300 is also with the following functions:

Test result is obtained according to operational order set.

It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description, The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.

In several embodiments provided herein, it should be understood that disclosed system, device and method can be with It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit It divides, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components It can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, it is shown or The mutual coupling, direct-coupling or communication connection discussed can be through some interfaces, the indirect coupling of device or unit It closes or communicates to connect, can be electrical property, mechanical or other forms.

The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.

It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of software functional units.

If the integrated unit is realized in the form of SFU software functional unit and sells or use as independent product When, it can store in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words It embodies, which is stored in a storage medium, including some instructions are used so that a computer Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the application Portion or part steps.And storage medium above-mentioned include: USB flash disk, mobile hard disk, read-only memory (read-only memory, ROM), random access memory (random access memory, RAM), magnetic or disk etc. are various can store program The medium of code.

The above, above embodiments are only to illustrate the technical solution of the application, rather than its limitations；Although referring to before Embodiment is stated the application is described in detail, those skilled in the art should understand that: it still can be to preceding Technical solution documented by each embodiment is stated to modify or equivalent replacement of some of the technical features；And these It modifies or replaces, the spirit and scope of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution.

Claims

1. a kind of test method of interactive application characterized by comprising

By detection model, the target point set of the first image is obtained, the target point set includes that one or more targets are sat Punctuate；

According to the target point set, generate operational order set, include in the operational order set it is one or more with it is described The corresponding operational order of coordinates of targets point；

Test result is obtained according to the operational order set.

2. the test method of interactive application according to claim 1, which is characterized in that described according to the target point Collection, before generating operational order set, the method also includes:

Obtain the corresponding classification of one or more of coordinates of targets points；

According to the corresponding classification of one or more of coordinates of targets points, one or more of coordinates of targets points are added to One processing queue；

It is described according to the target point set, generate operational order set, comprising:

According to sequence of one or more of coordinates of targets points in the first processing queue, operational order set is generated, The operational order in the operational order set has corresponding operation order.

3. the test method of interactive application according to claim 1, which is characterized in that described according to the target point Collection, before generating operational order set, the method also includes:

Obtain location information of one or more of coordinates of targets points in the screenshot；

According to location information of one or more of coordinates of targets points in the screenshot, one or more of targets are sat Punctuate is added to second processing queue；

According to sequence of one or more of coordinates of targets points in the second processing queue, operational order set is generated, The operational order in the operational order set has corresponding operation order.

4. the test method of interactive application according to claim 3, which is characterized in that it is described obtain it is one or Multiple coordinates of targets points before the location information in the screenshot, the method also includes:

The displaying type of the screenshot is obtained, the displaying type includes that transverse screen is shown and vertical screen displaying；

The location information according to one or more of coordinates of targets points in the screenshot, by one or more of mesh Mark coordinate points are added to second processing queue, comprising:

According to the displaying type of location information and the screenshot of one or more of coordinates of targets points in the screenshot, One or more of coordinates of targets points are added to the second processing queue.

5. the test method of interactive application according to claim 1, which is characterized in that described according to the target point Collection, before generating operational order set, the method also includes:

According to the first image, stochastic set is generated, wherein the stochastic set includes N number of random coordinates point, and the N The mutual distance values of a random coordinates point are greater than preset threshold；

M random coordinates point in the stochastic set is replaced with into the coordinates of targets point in the target point set, is updated Stochastic set afterwards, wherein including M coordinates of targets point in the target point set；

According to the updated stochastic set, operational order set is generated.

6. according to claim 1 to the test method of interactive application described in 5 any one, which is characterized in that obtained described Before taking the first image, the method also includes:

If there are target pages on the runnable interface of the interactive application, the first interface control information is obtained, wherein institute Stating target pages is the subpage frame independently of the main interface of the interactive application；

If first interface control information and preset regular expression matching, generates target pages and cancel operational order；

Cancel operational order according to the target pages to operate the target pages.

7. according to claim 1 to the test method of interactive application described in 5 any one, which is characterized in that obtained described Before taking the first image, the method also includes:

If the runnable interface of the interactive application is login interface, second contact surface control information is obtained；

If the second contact surface control information is matched with preset login interface control information, log-on message is obtained；

Register is carried out to the login interface according to the log-on message.

8. a kind of test device of interactive application characterized by comprising

The acquiring unit, is also used to obtain the target point set of the screenshot by detection model, and the target point set includes one A or multiple coordinates of targets points；

Generation unit generates operational order set, includes one in the operational order set using according to the target point set Or multiple operational orders corresponding with the coordinates of targets point；

The acquiring unit is also used to obtain test result according to the operational order set.

9. a kind of server characterized by comprising memory, transceiver, processor and bus system；

Wherein, the memory is for storing program；

The processor is used to execute the program in the memory, includes the following steps:

By detection model, the target point set of the screenshot is obtained, the target point set includes one or more coordinates of targets points；

Test result is obtained according to the operational order set；

The bus system is for connecting the memory and the processor, so that the memory and the processor It is communicated.

10. a kind of computer readable storage medium, including instruction, when run on a computer, so that computer executes such as Method described in any one of claims 1 to 7.