CN109815150A - Application testing method, device, electronic equipment and storage medium - Google Patents

Application testing method, device, electronic equipment and storage medium Download PDF

Info

Publication number
CN109815150A
CN109815150A CN201910087252.5A CN201910087252A CN109815150A CN 109815150 A CN109815150 A CN 109815150A CN 201910087252 A CN201910087252 A CN 201910087252A CN 109815150 A CN109815150 A CN 109815150A
Authority
CN
China
Prior art keywords
image
runnable interface
scene
application
interface image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910087252.5A
Other languages
Chinese (zh)
Other versions
CN109815150B (en
Inventor
王洁梅
周大军
张力柯
荆彦青
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201910087252.5A priority Critical patent/CN109815150B/en
Publication of CN109815150A publication Critical patent/CN109815150A/en
Application granted granted Critical
Publication of CN109815150B publication Critical patent/CN109815150B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention discloses a kind of application testing method, device, electronic equipment and storage mediums, belong to Internet technical field.The present invention is by determining the similarity between an at least runnable interface image and an at least scene template image when receiving test instruction, to be based on the similarity, can quickly determine the scene template image for applying operational process to be shown.Based on scene template image, accurately reflect that the practical scene shown improves to quickly and accurately know the practical operation situation of the application using the efficiency and accuracy tested when application operation.

Description

Application testing method, device, electronic equipment and storage medium
Technical field
The present invention relates to Internet technical field, in particular to a kind of application testing method, device, electronic equipment and storage Medium.
Background technique
Game AI (Artificial Intelligence, artificial intelligence) refers in game application for simulating the think of of people The operation logic of peacekeeping intelligent behavior.When terminal operating game application, the operation logic of game AI is executed, is somebody's turn to do with being shown to user The scene of game of game application realizes the interaction of user and game application.
Wherein, scene of game may include scene image, and terminal shows the scene image, to show sports ground to user Scape.For example, carrying out the scene image of selection to sports, ring or daily scene of game mode.However, if game application Operation logic mistake, it is most likely that so that the terminal shows mistake to the scene image.For example, some scene image is not shown, Cause terminal not show scene of game correctly, reduces user experience.Therefore, needing one kind at present can be accurately and efficiently right Using the method tested, to know the practical operation situation of game application.
Summary of the invention
The embodiment of the invention provides a kind of application testing method, device, electronic equipment and storage mediums, are able to solve nothing Method obtains the problem of practical operation situation of application.The technical solution is as follows:
On the one hand, a kind of application testing method is provided, which comprises
When receiving test instruction, an at least runnable interface image for application is obtained, the test instruction is used for pair The interface that the application is shown when running is tested；
According to an at least scene template image for an at least runnable interface image and the application, determine described in Similarity between an at least runnable interface image and an at least scene template image, an at least scene mould Plate image is used to indicate the intended display content of the correspondence scene of the application；
Based on the similarity between an at least runnable interface image and an at least scene template image, really The test result of the fixed application, the test result are used to indicate the scene shown when application operation.
On the other hand, provide a kind of using test device, described device includes:
Module is obtained, for obtaining an at least runnable interface image for application, the survey when receiving test instruction The interface shown when examination instruction is for running the application is tested；
Determining module, for at least scene template according to an at least runnable interface image and the application Image determines the similarity between an at least runnable interface image and an at least scene template image, described The intended display content that an at least scene template image is used to indicate the correspondence scene of the application；
The determining module is also used to based at least a runnable interface image and an at least scene template Similarity between image determines that the test result of the application, the test result are used to indicate application operation when institute The scene of displaying.
On the other hand, provide a kind of electronic equipment, the electronic equipment include one or more processors and one or Multiple memories are stored at least one instruction in one or more of memories, and at least one instruction is by described one A or multiple processors are loaded and are executed to realize the operation as performed by above-mentioned application testing method.
On the other hand, a kind of computer readable storage medium is provided, at least one finger is stored in the storage medium It enables, at least one instruction is loaded as processor and executed to realize the operation as performed by above-mentioned application testing method.
Technical solution bring beneficial effect provided in an embodiment of the present invention includes at least:
By determining at least a runnable interface image and an at least scene template image when receiving test instruction Between similarity can quickly determine that this applies the scene template that is shown of operational process to be based on the similarity Image is based on scene template image, accurately reflects the practical scene shown when application operation, to quickly and accurately obtain The practical operation situation for knowing the application improves efficiency and accuracy using test.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.
Fig. 1 is a kind of schematic diagram of implementation environment provided in an embodiment of the present invention；
Fig. 2 is a kind of flow chart of application testing method provided in an embodiment of the present invention；
Fig. 3 is a kind of feature point extraction schematic diagram provided in an embodiment of the present invention；
Fig. 4 is a kind of schematic diagram of determining description vectors provided in an embodiment of the present invention；
Fig. 5 is the signal of the distance ratio of a kind of nearest neighbor distance provided in an embodiment of the present invention and the second nearest neighbor distance Figure；
Fig. 6 is a kind of scene template image and runnable interface image schematic diagram provided in an embodiment of the present invention；
Fig. 7 is a kind of scene template image and runnable interface image schematic diagram provided in an embodiment of the present invention；
Fig. 8 is a kind of scene template image and runnable interface image schematic diagram provided in an embodiment of the present invention；
Fig. 9 is a kind of scene template image and runnable interface image schematic diagram provided in an embodiment of the present invention；
Figure 10 is a kind of scene template image and runnable interface image schematic diagram provided in an embodiment of the present invention；
Figure 11 is a kind of scene template image and runnable interface image schematic diagram provided in an embodiment of the present invention；
Figure 12 is that a kind of scene template image and runnable interface image characteristic point provided in an embodiment of the present invention extract signal Figure；
Figure 13 is a kind of scene template image provided in an embodiment of the present invention and runnable interface Image Feature Point Matching process Schematic diagram；
Figure 14 is a kind of scene template image provided in an embodiment of the present invention and runnable interface Image Feature Point Matching result Schematic diagram；
Figure 15 is that a kind of scene template image and runnable interface image characteristic point provided in an embodiment of the present invention extract signal Figure；
Figure 16 is a kind of scene template image provided in an embodiment of the present invention and runnable interface Image Feature Point Matching process Schematic diagram；
Figure 17 is a kind of scene template image provided in an embodiment of the present invention and runnable interface Image Feature Point Matching result Schematic diagram；
Figure 18 is a kind of flow chart of application test provided in an embodiment of the present invention；
Figure 19 is a kind of structural schematic diagram using test device provided in an embodiment of the present invention；
Figure 20 is a kind of structural schematic diagram of terminal provided in an embodiment of the present invention；
Figure 21 is a kind of structural schematic diagram of server provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, shall fall within the protection scope of the present invention.
Fig. 1 is a kind of schematic diagram of implementation environment provided in an embodiment of the present invention, and referring to Fig. 1, which includes: to survey Equipment 101 is tried, test application is installed in the test equipment 101, which is used for the boundary shown when running to application Face is tested, the practical scene shown when knowing application operation.
It can also include the equipment 102 for being equipped with application in the implementation environment, which can be from equipment 102 On, acquire at least runnable interface image when application operation.It is answered alternatively, being also equipped in the test equipment 101 With the test equipment 101 can open the application by the test application, and acquire at least Zhang Yun when application operation Row interface image.An at least scene template of the test equipment 101 based at least one the runnable interface image and the application Image, the interface shown when running to the application are tested, the practical scene shown when knowing application operation.
Wherein, which can be server or terminal, which can be independent using journey for one Sequence, or the test module being mounted in other application, for example, the probe card of installation in a browser.Wherein, this is answered With that can be game application, game application includes multiple scene of game, and each scene of game may include one or more game Picture, the test application can multiple game pictures based on real-time display in the game application operational process to game application transport The interface shown when row is tested, the practical scene of game shown when understanding game application operation.
Fig. 2 is a kind of flow chart of application testing method provided in an embodiment of the present invention.The execution master of the inventive embodiments Body is test equipment, which can be terminal, can also be not specifically limited in this embodiment with server, the embodiment of the present invention, Referring to fig. 2, this method comprises:
201, when receiving test instruction, test equipment obtains an at least runnable interface image for application.
Wherein, which refers to the interface image using actual displayed in operational process.It should The interface shown when test instruction is for running the application is tested, the practical field shown when knowing application operation Scape.
In the embodiment of the present invention, when receiving test instruction, which marks according to the application of application to be tested Know, obtains the runnable interface image that the application is shown in the process of running.Wherein, this can be installed in test equipment to answer With then the test equipment can directly acquire the runnable interface image when application is run；Alternatively, the test equipment can also be not The application is installed, then the test equipment obtains the runnable interface image from the equipment for installing the application.Correspondingly, this step can It is realized in a manner of through following two.
The application is installed in first way, the test equipment.It, should when the test equipment receives test instruction Test equipment opens the application, applies in operational process at this, which carries out screenshot to the application interface of the application, obtains To the runnable interface image of the application.
Wherein, which can apply currently running different scenes based on this, acquire the application and run different fields Different runnable interface images when scape.In this step, this using good in operational process, the test equipment is based on current presentation First scene, the test carry out screenshot to the application interface of the application, obtain this and apply the runnable interface image in the first scene. When the application runs to the later scene, which carries out screenshot to the application interface of the application again, obtains second The runnable interface image of scene.Wherein, test application is installed in the test equipment, which is used for test application program Operational process.The test equipment can be tested based on the triggering for testing instruction in the test application.A kind of possible In embodiment, the application identities of multiple applications can be provided in the application interface of the test application, when user's triggering is a certain When application identities, application identities of the test equipment based on the application being triggered receive test instruction, based on the application mark Know, opens the application.
Multiple scenes of application can be provided in a kind of possible embodiment, in the application interface of the test application Option, when user triggers a certain application identities, which shows multiple scenes of the application in current display interface Option, when user triggers a certain scene option, which is opened this and is answered based on the target scene option being triggered With, and it is based on the target scene option, start to execute the corresponding operation logic of the target scene.It is corresponding executing the target scene Operation logic during, the test equipment to this application carry out screenshot, obtain this and apply the fortune when showing the target scene Row interface image.
In the second way, the test equipment application is not installed.It, should when the test equipment receives test instruction Test equipment obtains the runnable interface image from the target device for installing the application.
Wherein, when the test equipment receives test instruction, which can send to the target device and obtain Request is taken, this applies an at least runnable interface image for real-time display in operational process to the acquisition request for request. The acquisition request can carry the application identities of the application.The target device receives the acquisition request, is taken according to the acquisition request The application identities of band open the application, apply in operational process at this, carry out screenshot to the application interface of the application, be somebody's turn to do The runnable interface image of application.The target device sends an at least runnable interface image to the test equipment in real time.The survey Examination equipment receives an at least runnable interface image for target device transmission.Wherein, which obtains the runnable interface The process of image, for above-mentioned first way, test equipment obtains the process of runnable interface image similarly, herein no longer It repeats one by one.
Wherein, user can also test the target scene in multiple scenes, then the acquisition request can also carry The target scene option.The target device can open the application, and the corresponding operation logic of the target scene for running the application, During executing the target scene corresponding operation logic, which carries out screenshot to the application, obtains this and applies Show the runnable interface image when target scene.The target device sends the corresponding operation of the target scene to the test equipment Interface image.
It should be noted that the test equipment can be real based on the actual moving process of the application in the embodiment of the present invention When acquisition applications screenshot image, as the runnable interface image of the application, it is subsequent be based on the actual moving process, to the application It is tested, the reality for being better understood by the application is operating condition, improves the accuracy using test.
202, the test equipment obtains an at least scene template image for the application.
Wherein, which is used to indicate the intended display content of the correspondence scene of the application.? It is that, if the application operates normally, the runnable interface image of the application should be shown as corresponding scene template image.This hair In bright embodiment, which has been previously stored an at least scene template image for the application, refers to when receiving the test When enabling, which obtains an at least scene template image for the application.In this step, the test equipment is according to the application Application identities, an at least scene template image is loaded from target storage space.
Wherein, which can be based on the scene that the application is currently shown, real-time loading field corresponding with the scene Scape template image, then this step can be with are as follows: this using in operational process, which is based on scene identity and scene template The corresponding relationship of image obtains the corresponding scene template of first scene according to the scene identity of currently running first scene Image.Certainly, when the application runs to later scene, when that is to say the second scene, the test equipment is based on second scene Scene identity loads the corresponding scene template image of second scene from target storage space.
In a kind of possible embodiment, which is also based on the scene of current presentation, and front court is worked as in load The scene template image of scape and later scene, then this step can be with are as follows: when receiving test instruction, which is based on The scene identity of first scene of current presentation loads the scene template image and second of the first scene from target storage space The scene template image of scene.Wherein, displaying sequence is at this first in multiple scenes which includes for the application Scene after scape.Certainly, which is also based on the scene of current presentation, loads current scene and displaying sequence exists The scene template image of two scenes after current scene, the embodiment of the present invention are not specifically limited in this embodiment.
Wherein, each scene identity and each scene identity pair for storing the application can be respectively corresponded in the test equipment The scene template image answered obtains the scene template image of corresponding scene in order to which the test equipment is based on scene identity in real time.
In the embodiment of the present invention, which can be the historical usage interface using the application, alternatively, in advance The image of drafting, or then the test equipment obtains the image drawn in advance, as the scene template image of the application, alternatively, The test equipment obtains the historical usage interface of the application, the scene template image as the application.It should be noted that this Scape template image can be drawn in advance and store into the target storage space, for example, when the application is first online, by exploit person Member draws the scene template image, and the operation logic of the application is designed based on the scene template image.Alternatively, the scene template Image can also be the history run interface image of the application, for example, when using online rear update application version, the test equipment Middle part partite transport row interface image may be still identical as a upper application version for the application, which can directly acquire this and answer With it is last online when history run interface image, as the scene template image.
It should be noted that the test equipment can be based on the scene template image and operation circle in the embodiment of the present invention Face image tests the operational process of the application.Also, the test equipment is also based on the scene of current presentation, real When obtain the corresponding scene template image of current scene and runnable interface image so that the scene template image and runnable interface figure As that can correspond, the accuracy for obtaining scene template image and runnable interface image is improved.Also, when obtaining current the When the scene template image of one scene, which can also obtain later scene in advance, that is to say the scene of the second scene Template image improves the efficiency for obtaining scene template image.It is drawn in addition, the test equipment can also obtain developer Scene template image, alternatively, enriching acquisition as scene template image using the history run interface image of last revision The source of scene template image improves applicability of the invention.
203, the test equipment is according at least scene Prototype drawing of an at least runnable interface image and the application Picture determines the similarity between an at least runnable interface image and an at least scene template image.
Wherein, the similarity is for indicating the similar journey of runnable interface image and scene template image on characteristics of image Degree, the test equipment can characteristics of image and scene template image based on runnable interface image characteristics of image, carry out it is similar The determination of degree.In this step, which extracts the characteristics of image of runnable interface image and the image spy of scene template image Sign, according to the characteristics of image of the characteristics of image of the runnable interface image and scene template image, determines any runnable interface figure Similarity between picture and any scene template image.Wherein, pictorial feature when which includes image display, should Characteristics of image may include figure, picture color, animation effect, gray scale, text information etc. in image.
In this step, for any runnable interface image, which obtains any runnable interface image Fisrt feature point；For any scene template image, which obtains the second spy of any scene template image Sign point；The test equipment is according to the of the fisrt feature point of any runnable interface image and any scene template image Two characteristic points determine the similarity between any runnable interface image and any scene template image.
In the embodiment of the present invention, which can extract the characteristic point of image to indicate characteristics of image, which sets The characteristic point of the standby whole region that can extract runnable interface image, as the characteristics of image of the runnable interface image, with determination Similarity between two images；Alternatively, the test equipment can also extract the characteristic point of the partial region of runnable interface image, The determination of similarity is carried out as the characteristics of image of the runnable interface image.Correspondingly, this step can be by following two side Formula is realized.
First way, test equipment extract the characteristic point of the whole region of runnable interface image.The test equipment is to this The whole region of runnable interface image carries out feature point extraction, obtains the fisrt feature point of runnable interface image.The test equipment According to the second feature point of the fisrt feature of runnable interface image point and scene template image, any runnable interface image is determined Similarity between any scene template image.
Wherein, for any of any runnable interface image fisrt feature point, which can determine this It whether include the second feature point to match with any one fisrt feature point in one scene template image.For this any Runnable interface image, the test equipment determine that this is any according to the quantity of matching characteristic point in any runnable interface image Open the similarity between runnable interface image and any scene template image.Wherein, which refers to and this The matched fisrt feature point of the second feature point of one scene template image.
Wherein, which can be according to the description vectors of fisrt feature point and the description vectors of second feature point, really Whether the fixed fisrt feature point matches with second feature point.In a kind of possible embodiment, which obtains this Any of the description vectors and the scene template image of any of one runnable interface image fisrt feature point second feature The description vectors of point；For any one fisrt feature point, the test equipment is according to the description vectors of the fisrt feature point and this The description vectors of one second feature point determine the fisrt feature point description distance with any one second feature point respectively, Obtain multiple description distances；The test equipment according to multiple description distance, determine in multiple second feature point whether include With the matched second feature point of the fisrt feature point.Wherein, any one description distance is a fisrt feature point and one second Description distance between characteristic point.Wherein, the test equipment can filter out it is multiple description distance in nearest neighbor distance and Second nearest neighbor distance, the test equipment determine the distance ratio of the nearest neighbor distance and the second nearest neighbor distance.When the distance ratio When less than threshold value, which, which determines in the scene template image, includes and the matched second feature point of the fisrt feature point； When the distance ratio is not less than threshold value, which, which determines in the scene template image, does not include and the fisrt feature point The second feature point matched.Wherein, which can be based on needing to be configured, and the present invention is not especially limit this, For example, the threshold value can be 0.75,0.8 etc..
Wherein, which can be according to any of runnable interface image fisrt feature point, from multiple second Lookup and the matched second feature point of the fisrt feature point, obtain multiple points pair in characteristic point, any one point is transported to including coming from One fisrt feature point of row interface image and a second feature point from scene template image.Wherein, the test equipment According to the quantity of the internal fisrt feature point of multiple point, the similarity of the runnable interface image and scene template image is determined.? In a kind of possible embodiment, which determines this according to the quantity of matching characteristic point in the runnable interface image When similarity between one runnable interface image and any scene template image, which can be directly more with this The quantity of a internal fisrt feature point of point, that is to say, the quantity of matching characteristic point, is expressed as the fortune in multiple fisrt feature point Similarity between row interface image and scene template image.Certainly, which can also be special by multiple centering first Levy point quantity and the runnable interface image in fisrt feature point total quantity ratio, be determined as the runnable interface image with The similarity of scene template image.
Wherein, the characteristic point of image refers to more significant point in the image, for example, in image figure profile point, compared with Bright spot in dark areas, the dim spot etc. in brighter areas.For the extraction process of fisrt feature point and second feature point, the test Equipment can extract multiple fisrt feature points by target algorithm from runnable interface image, and, from scene template image Extract second feature point.Wherein, which can be ORB (Oriented FAST and Rotated BRIEF, orientation Quickly rotation is succinct) algorithm.(Features from accelerated segment test is surveyed FAST based on Accelerated fractionation The feature of examination) algorithm extracts the process cardinal principle of characteristic point is: if (such as Fig. 3 institute in certain pixel p and its surrounding neighbors Show, pixel 1 arrives pixel 16), enough pixel differences are larger, then pixel p may be angle point, that is to say feature Point.Since the process that the FAST algorithm extracts characteristic point does not have scale invariability, feature is being carried out using ORB algorithm When point extracts, which can first construct gaussian pyramid, detect whether existing characteristics on each layer of pyramid diagram picture Point, to realize scale invariability.Since the FAST algorithm does not have direction invariance yet, characteristic point is being carried out using ORB algorithm When extraction, which can use gray scale centroid method extraction characteristic point and defines the neighborhood of p for any one characteristic point p The square of pixel isWherein, I (x, y) is characterized the gray value at point (x, y), the mass center of image are as follows:The angle of characteristic point and mass center is the direction of characteristic point: θ=arctan (m01,m10)。mpqFor indicating The square of image, m00For indicating 0 rank square, m01And m10Indicate 1 rank square.
For the determination process of the description vectors of fisrt feature point, since traditional algorithm is mainly by characteristic point P Around choose N number of point to (N be positive integer) more than or equal to 1, the comparing result of N number of point pair, which is then combined into length, is The two-value sequence of n, the Expressive Features as this feature point.Since the calculating process does not have rotational invariance, the test Equipment can use ORB algorithm, and when calculating the description vectors of characteristic point, which be can establish with characteristic point P as circle The heart, the two-dimensional coordinate system established using the line of characteristic point P and the mass center Q for taking a region as X-axis.As shown in figure 4, since the center of circle is Fixed, using PQ as x-axis coordinate, vertical direction is y-axis coordinate, under different rotation angles, what same characteristic point was taken out Point can have rotation consistency to being consistent.Wherein, in the test equipment, vector distance can be expressed as one A binary string.
For the description determination of distance process of fisrt feature point and second feature point, which can be used Hamming Distance (Hamming distance), wherein the Hamming distance of two isometric binary strings is that two binary strings are corresponding The number of the kinds of characters of position.In addition, being filtered out based on description distance, which can be based on distance ratio With threshold value, the multiple points pair being mutually matched are filtered out, as shown in figure 5, the test equipment can (ratio be examined using Ratio-Test Hold back) algorithm screened, and parameter ratio (ratio) controls the characteristic point for rejecting distance proportion except a certain range.One In the possible embodiment of kind, which can be the most short Euclidean distance between the description vectors of two characteristic points.Fig. 5 is The ratio of nearest neighbor distance and the second nearest neighbor distance figure, horizontal axis indicate the ratio between nearest neighbor distance and the second nearest neighbor distance, Longitudinal axis expression matches correct or matching error PDF (probability density function, probability density function), In, solid line is the PDF of ratio when matching is correct；The PDF of ratio when dotted line is erroneous matching.As shown in figure 5, the threshold value It, can be the best separation of correct matching and erroneous matching situation when being 0.75.Therefore, when the distance ratio is less than 0.75 When, it is determined that include in the second feature point and the matched characteristic point of fisrt feature point.
As shown in fig. 6, only the scene areas in part is identical, difference for some scene template images and runnable interface image Scene picture otherness it is bigger.As shown in fig. 6, the virtual figure image in runnable interface image and scene template image is It is identical, but scene template image is in scene of game selection mode, is the selection interface of scene of game, runnable interface image It then indicates the scene of selection virtual figure image, is virtual figure image selection interface, therefore, scene template image and operation circle Face image belongs to different scenes, mismatches.Therefore, which needs the Feature Points Matching strategy in conjunction with full figure, jointly Screen matching result.As shown in fig. 7, Fig. 7 is the practical interface schematic diagram of scene template image and runnable interface image, from Fig. 7 In clearer can represent the real difference of the scene template image and runnable interface image.
The second way, test equipment extract the characteristic point of the partial region of runnable interface image.The test equipment determines The matching area of the runnable interface image obtains the runnable interface image in the fisrt feature point of the matching area.The test is set It is standby according to any runnable interface image in the fisrt feature point of the matching area and the second feature point of scene template image, really Similarity between fixed any runnable interface image and any scene template image.
In this step, which obtains the mode and the test equipment of fisrt feature point from the matching area The mode of the similarity between runnable interface image and scene template image is determined based on the fisrt feature point and second feature point, Similarly with above-mentioned first way, it also, no longer repeats one by one herein.
It wherein, may include display user information display area and/or debugging region, the user in the runnable interface image Information display area is used to show the personal information of the personal information of user or the good friend user of the user, which uses Debugging message when showing the application operation.Since the personal information of different user is different, and different operational process Debugging message can also be different, and therefore, which can be by the area other than the user information display area and debugging region Domain is as the region for extracting characteristic point.Correspondingly, test equipment the step of fisrt feature point is extracted from runnable interface image can To include following two situation.
The first situation, for the first runnable interface image including user information display area, which obtains The fisrt feature point of first area in the first runnable interface image.
Wherein, which is the region in the first runnable interface image in addition to the user information display area； The test equipment can extract fisrt feature point out of this first area.
As shown in figure 8, not including user information in user information display area in the scene template image, and running In interface image, the user information of multiple good friend users in the user information display area including the user, it is clear that the scene The user information display area of template image and the user information display area of runnable interface image, it is not identical, it is set in test When the standby scene template image for determining the runnable interface images match, which can be based on the user information display area Region in addition is matched.Bullet image in the scene of game does not show the user information of good friend.If based on fortune The fisrt feature point of the whole region of row interface image is matched, in the fisrt feature point that user information display area is extracted It is the match point that can not be found in scene template image, so easilying lead to runnable interface image and scene template image In the characteristic point total number that is matched on the whole it is less, to judge the runnable interface image and scene template image picture is not The wrong conclusion of the same scene template image.As shown in figure 9, Fig. 9 is the reality of scene template image and runnable interface image Interface schematic diagram clearer can represent the scene template image and runnable interface image in the user information from Fig. 9 The difference of display area.
Second situation, the second runnable interface image for including debugging region, the test equipment obtain second fortune The fisrt feature point of second area in row interface image.Wherein, which is that the debugging area is removed in the runnable interface image Region other than domain.The test equipment can extract fisrt feature point out of this second area.
As shown in Figure 10, in the scene template image, debugging in region does not include Debugging message, and in runnable interface image In, it include the Debugging message that the application generates in the process of running in the debugging region, it is clear that the debugging of the scene template image The debugging region in region and runnable interface image, it is not identical, the scene of the runnable interface images match is determined in test equipment When template image, which can be matched based on the region other than the debugging region.As shown in figure 11, Figure 11 is field The practical interface schematic diagram of scape template image and runnable interface image clearer can represent the scene template from Figure 11 The difference of image and runnable interface image in the debugging region.
In a kind of possible embodiment, which can also be to above-mentioned first way and second way phase In conjunction with to determine the similarity between any runnable interface image and any scene template image.The process can be with are as follows: should Runnable interface image can be divided into multiple regions by test equipment, extract runnable interface image in first spy in any one region Sign point.Fisrt feature point of the test equipment based on any one region determines the fisrt feature point and scene in any one region The description distance of any one second feature point of template image is based on the description distance, determines the runnable interface image in the area Similarity between domain and scene template image, obtain the runnable interface image multiple region respectively with an at least scene Multiple similarities between template image.Then, the test equipment is according to the corresponding multiple similarities of multiple regions, from least one Similarity is filtered out in scene template image obtains an at least scene template image, the test equipment greater than similarity threshold Determine the similarity between an at least scene template image that the runnable interface image is obtained with the screening respectively.
As shown in figure 12, which extracts the characteristic point of the runnable interface image and scene template image, for packet The runnable interface image in debugging region is included, which can only extract the fisrt feature of the matching area other than debugging region Point, as shown in figure 13, the test equipment calculate description distance of each fisrt feature point respectively between each second feature point, Obtain multiple description distances.As shown in figure 14, which is based on the description distance, to multiple description apart from corresponding Fisrt feature point and second feature point are screened, filter out with the matched second feature point of fisrt feature point, obtain one a pair The multiple points pair answered, each pair of point include a second feature point of a fisrt feature point sum.In addition, Figure 15, Figure 16, Figure 17 The practical interface schematic diagram for respectively corresponding to Figure 12, Figure 13, Figure 14, clearer can represent the scene mould from Figure 11 The matching process of plate image and runnable interface image.
It should be noted that in the embodiment of the present invention, due to using the algorithm for having scale invariability and rotational invariance The extraction of characteristic point is carried out, rather than images match is directly carried out based on grey scale pixel value, due to being based on grey scale pixel value image Matching is that the grey scale pixel value of same position in image matches one by one, and cardinal principle is that the gray value size of same position pixel is wanted It is equal or close.When carrying out images match, because the user interface resolution ratio of different terminals, rendering are also different, lead to figure The differences such as the size of picture or user interface rendering position are bigger, cause images match inaccurate.And the embodiment of the present invention uses Matching based on characteristic point, since characteristic point refers to angle point or significant point in image, with the position where objects in images element Set unrelated with size relation, therefore, the method applicability of the embodiment of the present invention is stronger.Also, since ORB algorithm extracts characteristic point And when calculating the description vectors of characteristic point, using by FAST algorithm and BRIEF (Binary Robust Independent Elementary Features, the powerful independent essential characteristic of binary system) algorithm characteristics combine, and further progress changes Into with optimization, using with rotational invariance and scale invariability algorithm carry out similarity determination.Therefore, the present invention is implemented Method in example can greatly improve the accuracy and applicability for calculating the similarity of runnable interface image and scene template image.
204, the test equipment is based between an at least runnable interface image and an at least scene template image Similarity, determine the test result of the application.
In the embodiment of the present invention, which is used to indicate the scene shown when application operation.Wherein, the test Equipment can expire similarity according to the similarity of at least one the runnable interface image and at least one scene template image The scene template image of foot-eye screening conditions is determined as the scene template image shown when application operation.Wherein, the mesh Similarity threshold can be greater than for similarity by marking screening conditions.
Wherein, which can be based on the phase of any the runnable interface image and any scene template image Like degree, it is based on the object filtering condition, filters out the scene template image with any runnable interface images match；The test Equipment determines the field for applying operational process to be shown based on the scene template image with any runnable interface images match Scape.Wherein, the similarity of the runnable interface image and scene template image can be using matching characteristic in the runnable interface image The quantity of point indicates that then screening process of the test equipment based on the object filtering condition can be with are as follows: for each runnable interface Image, the test equipment can filter out the quantity of matching characteristic point according to the quantity of matching characteristic point in runnable interface image Corresponding runnable interface image and scene template image when greater than amount threshold, which is determined as and the operation The matched scene template image of interface image.Wherein, which can be configured based on needs, the embodiment of the present invention pair This is not especially limited.For example, the amount threshold can be 100,80 etc..
Further, which is also based on the scene template image that the target uses operational process to be shown The total quantity of quantity and at least one scene template image determines the application to the coverage rate of scene template image, the covering Rate is used to indicate the quantity of the scene shown using actual motion, applies the scene shown under desired operation with this The size relation of quantity, the coverage rate are numerically equal to the quantity for the scene template image that the actual moving process is shown and are somebody's turn to do Using the ratio of the total quantity of corresponding at least one scene template image.
It should be noted that the test equipment can be based on similar between the runnable interface image and scene template image Degree, using the biggish scene template image of similarity as the scene template image with runnable interface images match, so as to obtain The practical scene template image shown, accurately understands the practical scene shown of the operational process when application is run out, improves The determining accuracy using operational process.Further, which can also be using the application to scene template image Coverage rate, accurately indicate that this, to the level of coverage of scene template image, is based on user real using operational process The data on border understand the practical operation situation of the application, and the scene shown when running to the application numerically does further Assurance, improve user experience.
It should be noted that the test equipment can apply the scene template image that is shown of operational process based on this, Solve the application scenarios shown when application operation.Further, which is also based on the test result, by following Step 204, further the operation logic of the application is modified.
205, the test equipment patrols the operation of the application according to the scene template image for applying operational process not show It collects and modifies.
In the embodiment of the present invention, scene template image that when test equipment available application operation does not show；It should The scene template image that test equipment is not shown when being run according to the application, repeats and repairs to the operation logic of the application Change, the phase based on an at least scene template image and the corresponding at least one runnable interface image of modified operation logic Like degree, the step of determining the test result of the application, an at least scene template for the application is shown when application operation Image.
It should be noted that the test equipment is also based on test result in the embodiment of the present invention, the operation to application Logic carries out real-time optimization so that entire test process forms closed loop, the operation logic of application obtain continuing to optimize with it is perfect, mention The high practicability of application test and the accuracy of operational process.
The above process is introduced in order to clearer, for the process shown in Figure 18, to above-mentioned steps 201-204 Process be introduced.As shown in figure 18, the scene template image of test equipment load application, and input at least the one of the application The image collection of runnable interface image composition is opened, and successively traverses each runnable interface image, in ergodic process, to operation circle Face image and scene template image carry out the matching of partial region characteristic point and the matching of whole region characteristic point, based on spy The matching result of point, the scene template image of output and runnable interface images match are levied, which is application fortune The scene template image that row process is covered obtains application operation knot when all runnable interface image traversals finish All scene template images covered when beam are based on unlapped scene template image, carry out to the operation logic of the application Optimization, so that the operation logic of the application is further improved.
In the embodiment of the present invention, by when receiving test instruction, determine at least runnable interface image at least Similarity between one scene template image can quickly determine this using operational process to be based on the similarity The scene template image shown is based on scene template image, accurately reflects the practical scene shown when application operation, To quickly and accurately know the practical operation situation of the application, efficiency and accuracy using test are improved.
Figure 19 is a kind of structural schematic diagram using test device provided in an embodiment of the present invention.Referring to Figure 19, the device It include: to obtain module 1901 and determining module 1902.
Module 1901 is obtained, it, should for obtaining an at least runnable interface image for application when receiving test instruction The interface shown when test instruction is for running the application is tested；
Determining module 1902, for at least scene template according at least one the runnable interface image and the application Image determines the similarity between an at least runnable interface image and an at least scene template image, this at least one Open the intended display content that scene template image is used to indicate the correspondence scene of the application；
The determining module 1902 is also used to based on an at least runnable interface image and an at least scene Prototype drawing Similarity as between, determines the test result of the application, which is used to indicate the field shown when application operation Scape.
Optionally, the determining module 1902, comprising:
Acquiring unit, first for for any runnable interface image, obtaining any runnable interface image are special Sign point；
The acquiring unit is also used to obtain the of any scene template image for any scene template image Two characteristic points；
Determination unit, for the fisrt feature point and any scene Prototype drawing according to any runnable interface image The second feature point of picture determines the similarity between any runnable interface image and any scene template image.
Optionally, the acquiring unit is also used to obtain the first runnable interface image including user information display area The fisrt feature point of first area in the first runnable interface image is taken, which is to remove in the first runnable interface image Region other than the user information display area；For including the second runnable interface image in debugging region, second fortune is obtained The fisrt feature point of second area in row interface image, the second area are that the debugging region is removed in the second runnable interface image Region in addition.
Optionally, the determination unit is also used to for any of any runnable interface image fisrt feature point, really It whether include the second feature point to match with any one fisrt feature point in the fixed any scene template image；For this Any runnable interface image determines any Zhang Yun according to the quantity of matching characteristic point in any runnable interface image Similarity between row interface image and any scene template image, the matching characteristic point refer to and any scene mould The fisrt feature point that the second feature point of plate image matches.
Optionally, the determination unit is also used to for any one fisrt feature point, according to any one fisrt feature point Description vectors and any one second feature point description vectors, determine any one fisrt feature point respectively with this any one the The description distance of two characteristic points obtains multiple description distances；When nearest neighbor distance in multiple description distance and the second neighbour away from From ratio be less than threshold value when, determine to include the to match with any one fisrt feature point in any scene template image Two characteristic points.
Optionally, the acquisition module 1901 is also used to open the application when receiving test instruction；In the application In operational process, the first scene based on current presentation carries out screenshot to the application interface of the application, obtains first scene Runnable interface image.
Optionally, the acquisition module 1901 is also used to be based on scene identity and scene template using in operational process at this The corresponding relationship of image obtains the corresponding scene template of first scene according to the scene identity of the first scene of current presentation Image.
Optionally, the determining module 1902 is also used to according to an at least runnable interface image and an at least field Similarity is met the scene template image of object filtering condition by the similarity of scape template image, when being determined as application operation The scene template image shown.
Optionally, the device further include:
The acquisition module 1901 is also used to obtain the scene template image not shown when application operation；
Modified module, the scene template image not shown when for being run according to the application, repeats to the application Operation logic is modified, and an at least scene template image and the corresponding at least Zhang Yun of modified operation logic are based on The similarity of row interface image, the step of determining the test result of the application, show the application extremely when application operation A few scene template image.
In the embodiment of the present invention, by when receiving test instruction, determine at least runnable interface image at least Similarity between one scene template image can quickly determine this using operational process to be based on the similarity The scene template image shown is based on scene template image, accurately reflects the practical scene shown when application operation, To quickly and accurately know the practical operation situation of the application, efficiency and accuracy using test are improved.
All the above alternatives can form the alternative embodiment of the disclosure, herein no longer using any combination It repeats one by one.
It should be understood that application test device provided by the above embodiment application test when, only with above-mentioned each function The division progress of module can according to need and for example, in practical application by above-mentioned function distribution by different function moulds Block is completed, i.e., the internal structure of equipment is divided into different functional modules, to complete all or part of function described above Energy.In addition, application test device provided by the above embodiment and application testing method embodiment belong to same design, it is specific real Existing process is detailed in embodiment of the method, and which is not described herein again.
Figure 20 is a kind of structural schematic diagram of terminal provided in an embodiment of the present invention.The terminal 2000 may is that intelligent hand (Moving Picture Experts Group Audio Layer III, dynamic image are special for machine, tablet computer, MP3 player Family's compression standard audio level 3), MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image Expert's compression standard audio level 4) player, laptop or desktop computer.Terminal 2000 is also possible to referred to as user and sets Other titles such as standby, portable terminal, laptop terminal, terminal console.
In general, terminal 2000 includes: processor 2001 and memory 2002.
Processor 2001 may include one or more processing cores, such as 4 core processors, 8 core processors etc..Place Reason device 2001 can use DSP (Digital Signal Processing, Digital Signal Processing), FPGA (Field- Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, may be programmed Logic array) at least one of example, in hardware realize.Processor 2001 also may include primary processor and coprocessor, master Processor is the processor for being handled data in the awake state, also referred to as CPU (Central Processing Unit, central processing unit)；Coprocessor is the low power processor for being handled data in the standby state.? In some embodiments, processor 2001 can be integrated with GPU (Graphics Processing Unit, image processor), GPU is used to be responsible for the rendering and drafting of content to be shown needed for display screen.In some embodiments, processor 2001 can also be wrapped AI (Artificial Intelligence, artificial intelligence) processor is included, the AI processor is for handling related machine learning Calculating operation.
Memory 2002 may include one or more computer readable storage mediums, which can To be non-transient.Memory 2002 may also include high-speed random access memory and nonvolatile memory, such as one Or multiple disk storage equipments, flash memory device.In some embodiments, the non-transient computer in memory 2002 can Storage medium is read for storing at least one instruction, at least one instruction performed by processor 2001 for realizing this Shen Please in embodiment of the method provide application testing method.
In some embodiments, terminal 2000 is also optional includes: peripheral device interface 2003 and at least one periphery are set It is standby.It can be connected by bus or signal wire between processor 2001, memory 2002 and peripheral device interface 2003.It is each outer Peripheral equipment can be connected by bus, signal wire or circuit board with peripheral device interface 2003.Specifically, peripheral equipment includes: In radio circuit 2004, touch display screen 2005, camera 2006, voicefrequency circuit 2007, positioning component 2008 and power supply 2009 At least one.
Peripheral device interface 2003 can be used for I/O (Input/Output, input/output) is relevant outside at least one Peripheral equipment is connected to processor 2001 and memory 2002.In some embodiments, processor 2001, memory 2002 and periphery Equipment interface 2003 is integrated on same chip or circuit board；In some other embodiments, processor 2001, memory 2002 and peripheral device interface 2003 in any one or two can be realized on individual chip or circuit board, this implementation Example is not limited this.
Radio circuit 2004 is for receiving and emitting RF (Radio Frequency, radio frequency) signal, also referred to as electromagnetic signal. Radio circuit 2004 is communicated by electromagnetic signal with communication network and other communication equipments.Radio circuit 2004 is by telecommunications Number being converted to electromagnetic signal is sent, alternatively, the electromagnetic signal received is converted to electric signal.Optionally, radio circuit 2004 include: antenna system, RF transceiver, one or more amplifiers, tuner, oscillator, digital signal processor, volume solution Code chipset, user identity module card etc..Radio circuit 2004 can by least one wireless communication protocol come with it is other Terminal is communicated.The wireless communication protocol includes but is not limited to: Metropolitan Area Network (MAN), each third generation mobile communication network (2G, 3G, 4G and 5G), WLAN and/or WiFi (Wireless Fidelity, Wireless Fidelity) network.In some embodiments, radio frequency electrical Road 2004 can also include NFC (Near Field Communication, wireless near field communication) related circuit, the application This is not limited.
Display screen 2005 is for showing UI (User Interface, user interface).The UI may include figure, text, Icon, video and its their any combination.When display screen 2005 is touch display screen, display screen 2005 also there is acquisition to exist The ability of the touch signal on the surface or surface of display screen 2005.The touch signal can be used as control signal and be input to place Reason device 2001 is handled.At this point, display screen 2005 can be also used for providing virtual push button and/or dummy keyboard, it is also referred to as soft to press Button and/or soft keyboard.In some embodiments, display screen 2005 can be one, and the front panel of terminal 2000 is arranged；Another In a little embodiments, display screen 2005 can be at least two, be separately positioned on the different surfaces of terminal 2000 or in foldover design； In still other embodiments, display screen 2005 can be flexible display screen, is arranged on the curved surface of terminal 2000 or folds On face.Even, display screen 2005 can also be arranged to non-rectangle irregular figure, namely abnormity screen.Display screen 2005 can be with Using LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) etc. materials preparation.
CCD camera assembly 2006 is for acquiring image or video.Optionally, CCD camera assembly 2006 includes front camera And rear camera.In general, the front panel of terminal is arranged in front camera, the back side of terminal is arranged in rear camera.? In some embodiments, rear camera at least two is that main camera, depth of field camera, wide-angle camera, focal length are taken the photograph respectively As any one in head, to realize that main camera and the fusion of depth of field camera realize background blurring function, main camera and wide Pan-shot and VR (Virtual Reality, virtual reality) shooting function or other fusions are realized in camera fusion in angle Shooting function.In some embodiments, CCD camera assembly 2006 can also include flash lamp.Flash lamp can be monochromatic temperature flash of light Lamp is also possible to double-colored temperature flash lamp.Double-colored temperature flash lamp refers to the combination of warm light flash lamp and cold light flash lamp, can be used for Light compensation under different-colour.
Voicefrequency circuit 2007 may include microphone and loudspeaker.Microphone is used to acquire the sound wave of user and environment, and It converts sound waves into electric signal and is input to processor 2001 and handled, or be input to radio circuit 2004 to realize that voice is logical Letter.For stereo acquisition or the purpose of noise reduction, microphone can be separately positioned on the different parts of terminal 2000 to be multiple. Microphone can also be array microphone or omnidirectional's acquisition type microphone.Loudspeaker is then used to that processor 2001 or radio frequency will to be come from The electric signal of circuit 2004 is converted to sound wave.Loudspeaker can be traditional wafer speaker, be also possible to piezoelectric ceramics loudspeaking Device.When loudspeaker is piezoelectric ceramic loudspeaker, the audible sound wave of the mankind can be not only converted electrical signals to, can also be incited somebody to action Electric signal is converted to the sound wave that the mankind do not hear to carry out the purposes such as ranging.In some embodiments, voicefrequency circuit 2007 may be used also To include earphone jack.
Positioning component 2008 is used for the current geographic position of positioning terminal 2000, to realize navigation or LBS (Location Based Service, location based service).Positioning component 2008 can be the GPS (Global based on the U.S. Positioning System, global positioning system), the dipper system of China, Russia Gray receive this system or European Union The positioning component of Galileo system.
Power supply 2009 is used to be powered for the various components in terminal 2000.Power supply 2009 can be alternating current, direct current Electricity, disposable battery or rechargeable battery.When power supply 2009 includes rechargeable battery, which can support wired Charging or wireless charging.The rechargeable battery can be also used for supporting fast charge technology.
In some embodiments, terminal 2000 further includes having one or more sensors 2010.One or more sensing Device 2010 includes but is not limited to: acceleration transducer 2011, gyro sensor 2012, pressure sensor 2013, fingerprint sensing Device 2014, optical sensor 2015 and proximity sensor 2016.
Acceleration transducer 2011 can detecte the acceleration in three reference axis of the coordinate system established with terminal 2000 Size.For example, acceleration transducer 2011 can be used for detecting component of the acceleration of gravity in three reference axis.Processor The 2001 acceleration of gravity signals that can be acquired according to acceleration transducer 2011, control touch display screen 2005 with transverse views Or longitudinal view carries out the display of user interface.Acceleration transducer 2011 can be also used for game or the exercise data of user Acquisition.
Gyro sensor 2012 can detecte body direction and the rotational angle of terminal 2000, gyro sensor 2012 Acquisition user can be cooperateed with to act the 3D of terminal 2000 with acceleration transducer 2011.Processor 2001 is according to gyro sensors The data that device 2012 acquires, following function may be implemented: action induction (for example changing UI according to the tilt operation of user) is clapped Image stabilization, game control and inertial navigation when taking the photograph.
The lower layer of side frame and/or touch display screen 2005 in terminal 2000 can be set in pressure sensor 2013.When When the side frame of terminal 2000 is arranged in pressure sensor 2013, user can detecte to the gripping signal of terminal 2000, by Reason device 2001 carries out right-hand man's identification or prompt operation according to the gripping signal that pressure sensor 2013 acquires.Work as pressure sensor 2013 when being arranged in the lower layer of touch display screen 2005, is grasped by processor 2001 according to pressure of the user to touch display screen 2005 Make, realization controls the operability control on the interface UI.Operability control include button control, scroll bar control, At least one of icon control, menu control.
Fingerprint sensor 2014 is used to acquire the fingerprint of user, is collected by processor 2001 according to fingerprint sensor 2014 Fingerprint recognition user identity, alternatively, by fingerprint sensor 2014 according to the identity of collected fingerprint recognition user.Knowing Not Chu the identity of user when being trusted identity, authorize the user to execute relevant sensitive operation by processor 2001, which grasps Make to include solving lock screen, checking encryption information, downloading software, payment and change setting etc..Fingerprint sensor 2014 can be set Set the front, the back side or side of terminal 2000.When being provided with physical button or manufacturer Logo in terminal 2000, fingerprint sensor 2014 can integrate with physical button or manufacturer Logo.
Optical sensor 2015 is for acquiring ambient light intensity.In one embodiment, processor 2001 can be according to light The ambient light intensity that sensor 2015 acquires is learned, the display brightness of touch display screen 2005 is controlled.Specifically, work as ambient light intensity When higher, the display brightness of touch display screen 2005 is turned up；When ambient light intensity is lower, the aobvious of touch display screen 2005 is turned down Show brightness.In another embodiment, the ambient light intensity that processor 2001 can also be acquired according to optical sensor 2015, is moved The acquisition parameters of state adjustment CCD camera assembly 2006.
Proximity sensor 2016, also referred to as range sensor are generally arranged at the front panel of terminal 2000.Proximity sensor 2016 for acquiring the distance between the front of user Yu terminal 2000.In one embodiment, when proximity sensor 2016 is examined When measuring the distance between the front of user and terminal 2000 and gradually becoming smaller, by processor 2001 control touch display screen 2005 from Bright screen state is switched to breath screen state；When proximity sensor 2016 detect the distance between front of user and terminal 2000 by When gradual change is big, touch display screen 2005 is controlled by processor 2001 and is switched to bright screen state from breath screen state.
It, can be with it will be understood by those skilled in the art that the restriction of the not structure paired terminal 2000 of structure shown in Figure 20 Including than illustrating more or fewer components, perhaps combining certain components or being arranged using different components.
Figure 21 is a kind of structural schematic diagram of server provided in an embodiment of the present invention, the server 2100 can because of configuration or Performance is different and generates bigger difference, may include one or more processors (central processing Units, CPU) 2101 and one or more memory 2102, wherein at least one is stored in the memory 2102 Instruction, at least one instruction are loaded by the processor 2101 and are executed the application to realize above-mentioned each embodiment of the method offer Test method.Certainly, which can also have the portions such as wired or wireless network interface, keyboard and input/output interface Part, to carry out input and output, which can also include other for realizing the component of functions of the equipments, not do herein superfluous It states.
In the exemplary embodiment, a kind of computer readable storage medium is additionally provided, the memory for example including instruction, Above-metioned instruction can be executed by the processor in electronic equipment to complete the application testing method in above-described embodiment.For example, the meter Calculation machine readable storage medium storing program for executing can be ROM (Read-Only Memory, read-only memory), RAM (random access Memory, random access memory), it is CD-ROM (Compact Disc Read-Only Memory, CD-ROM), tape, soft Disk and optical data storage devices etc..
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.

Claims (15)

1. a kind of application testing method, which is characterized in that the described method includes:
When receiving test instruction, an at least runnable interface image for application is obtained, the test instruction is for described The interface shown when using operation is tested；
According to an at least scene template image for an at least runnable interface image and the application, determination is described at least Similarity between one runnable interface image and an at least scene template image, an at least scene Prototype drawing As the intended display content for indicating the correspondence scene of the application；
Based on the similarity between an at least runnable interface image and an at least scene template image, institute is determined The test result of application is stated, the test result is used to indicate the scene shown when application operation.
2. the method according to claim 1, wherein at least a runnable interface image and the institute according to An at least scene template image for application is stated, determines at least a runnable interface image and an at least scene mould Similarity between plate image includes:
For any runnable interface image, the fisrt feature point of any runnable interface image is obtained；
For any scene template image, the second feature point of any scene template image is obtained；
According to the second feature of the fisrt feature point of any runnable interface image and any scene template image Point determines the similarity between any runnable interface image and any scene template image.
3. according to the method described in claim 2, it is characterized in that, described for any runnable interface image, described in acquisition The fisrt feature point of any runnable interface image includes:
For the first runnable interface image including user information display area, obtain first in the first runnable interface image The fisrt feature point in region, the first area be the first runnable interface image in except the user information display area with Outer region；
For including the second runnable interface image in debugging region, the of second area in the second runnable interface image is obtained One characteristic point, the second area are the region in the second runnable interface image in addition to the debugging region.
4. according to the method described in claim 2, it is characterized in that, described according to the first of any runnable interface image The second feature point of characteristic point and any scene template image determines any runnable interface image and described Similarity between one scene template image includes:
For any of described any runnable interface image fisrt feature point, determine in any scene template image It whether include the second feature point to match with any one described fisrt feature point；
For any runnable interface image, according to the quantity of matching characteristic point in any runnable interface image, Determine the similarity between any runnable interface image and any scene template image, the matching characteristic point Refer to the fisrt feature point to match with the second feature point of any scene template image.
5. according to the method described in claim 4, it is characterized in that, described for any in any runnable interface image A fisrt feature point determines in any scene template image whether include matching with any one described fisrt feature point Second feature point include:
For any one described fisrt feature point, according to the description vectors of any one fisrt feature point and any one second spy The description vectors for levying point determine any one described fisrt feature point description distance with any one second feature point respectively, Obtain multiple description distances；
When the ratio of nearest neighbor distance and the second nearest neighbor distance is less than threshold value in the multiple description distance, determine described any It include the second feature point to match with any one described fisrt feature point in scene template image.
6. the method according to claim 1, wherein it is described when receive test instruction when, obtain application extremely A runnable interface image includes: less
When receiving test instruction, the application is opened；
In the application operational process, the first scene based on current presentation carries out screenshot to the application interface of the application, Obtain the runnable interface image of first scene.
7. the method according to claim 1, wherein at least a runnable interface image and the institute according to An at least scene template image for application is stated, determines at least a runnable interface image and an at least scene mould Before similarity between plate image, the method also includes:
In the application operational process, the corresponding relationship based on scene identity and scene template image, according to current presentation The scene identity of first scene obtains the corresponding scene template image of first scene.
8. the method according to claim 1, wherein described based at least a runnable interface image and the institute The similarity between an at least scene template image is stated, determines that the test result of the application includes:
According to the similarity of at least one the runnable interface image and at least one scene template image, similarity is expired The scene template image of foot-eye screening conditions is determined as the scene template image shown when application operation.
9. the method according to claim 1, wherein described based at least a runnable interface image and the institute State the similarity between an at least scene template image, after the test result for determining the application, the method also includes:
Obtain the scene template image not shown when application operation；
The scene template image not shown when being run according to the application, repeats and repairs to the operation logic of the application Change, based on the corresponding at least runnable interface image of an at least scene template image and modified operation logic Similarity, the step of determining the test result of the application, show at least one of the application when application operation Scene template image.
10. a kind of apply test device, which is characterized in that described device includes:
Module is obtained, for obtaining an at least runnable interface image for application, the test refers to when receiving test instruction The interface shown when enabling for running to the application is tested；
Determining module, for at least scene Prototype drawing according to an at least runnable interface image and the application Picture, determines the similarity between an at least runnable interface image and an at least scene template image, it is described extremely A few scene template image is used to indicate the intended display content of the correspondence scene of the application；
The determining module is also used to based at least a runnable interface image and an at least scene template image Between similarity, determine the test result of the application, the test result is shown when being used to indicate application operation Scene.
11. device according to claim 10, which is characterized in that the determining module, comprising:
Acquiring unit, for obtaining the fisrt feature of any runnable interface image for any runnable interface image Point；
The acquiring unit, is also used to for any scene template image, obtains the of any scene template image Two characteristic points；
Determination unit, for the fisrt feature point and any scene Prototype drawing according to any runnable interface image The second feature point of picture determines similar between any runnable interface image and any scene template image Degree.
12. device according to claim 11, which is characterized in that
The acquiring unit, is also used to for the first runnable interface image including user information display area, obtains described the The fisrt feature point of first area in one runnable interface image, the first area in the first runnable interface image remove institute State the region other than user information display area；For including the second runnable interface image in debugging region, described second is obtained The fisrt feature point of second area in runnable interface image, the second area are in the second runnable interface image except described Debug the region other than region.
13. device according to claim 11, which is characterized in that
The determination unit, is also used to for any of described any runnable interface image fisrt feature point, determine described in It whether include the second feature point to match with any one described fisrt feature point in any scene template image；For described Any runnable interface image determines described any according to the quantity of matching characteristic point in any runnable interface image The similarity between runnable interface image and any scene template image is opened, the matching characteristic point refers to and described The fisrt feature point that the second feature point of one scene template image matches.
14. a kind of electronic equipment, which is characterized in that the electronic equipment includes that one or more processors and one or more are deposited Reservoir is stored at least one instruction in one or more of memories, and at least one instruction is by one or more A processor is loaded and is executed to realize as performed by claim 1 to the described in any item application testing methods of claim 9 Operation.
15. a kind of computer readable storage medium, which is characterized in that be stored at least one instruction, institute in the storage medium At least one instruction is stated to be loaded by processor and executed to realize such as claim 1 to the described in any item applications of claim 9 Operation performed by test method.
CN201910087252.5A 2019-01-29 2019-01-29 Application testing method and device, electronic equipment and storage medium Active CN109815150B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910087252.5A CN109815150B (en) 2019-01-29 2019-01-29 Application testing method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910087252.5A CN109815150B (en) 2019-01-29 2019-01-29 Application testing method and device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN109815150A true CN109815150A (en) 2019-05-28
CN109815150B CN109815150B (en) 2021-08-06

Family

ID=66605698

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910087252.5A Active CN109815150B (en) 2019-01-29 2019-01-29 Application testing method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN109815150B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110502425A (en) * 2019-06-28 2019-11-26 平安银行股份有限公司 Test data generating method, device, electronic equipment and storage medium
CN110738185A (en) * 2019-10-23 2020-01-31 腾讯科技（深圳）有限公司 Form object identification method and device and storage medium
CN111273905A (en) * 2020-01-17 2020-06-12 南京大学 Application retrieval method and device based on interface sketch
CN111522615A (en) * 2020-04-23 2020-08-11 平安国际智慧城市科技股份有限公司 Method, device and equipment for updating command line interface and storage medium
CN112150464A (en) * 2020-10-23 2020-12-29 腾讯科技（深圳）有限公司 Image detection method and device, electronic equipment and storage medium
CN112559314A (en) * 2019-09-26 2021-03-26 上海汽车集团股份有限公司 Testing method and testing device for human-computer interaction interface
CN112559342A (en) * 2020-12-09 2021-03-26 上海米哈游天命科技有限公司 Method, device and equipment for acquiring picture test image and storage medium
CN112559341A (en) * 2020-12-09 2021-03-26 上海米哈游天命科技有限公司 Picture testing method, device, equipment and storage medium
CN113360378A (en) * 2021-06-04 2021-09-07 北京房江湖科技有限公司 Regression testing method and device for application program for generating VR scene
CN113782003A (en) * 2021-09-14 2021-12-10 上汽通用五菱汽车股份有限公司 Test method and system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1658158A (en) * 2004-01-28 2005-08-24 微软公司 Method and system for masking dynamic regions in a user interface to enable testing of user interface consistency
US20160117566A1 (en) * 2013-09-20 2016-04-28 Oracle International Corporation Screenshot database for application verification
CN105589801A (en) * 2014-10-20 2016-05-18 网易（杭州）网络有限公司 Mobile phone cluster test method and system
CN105630686A (en) * 2016-03-24 2016-06-01 厦门美图移动科技有限公司 Traversal testing method and device for applications and mobile terminal
CN105868102A (en) * 2016-03-22 2016-08-17 中国科学院软件研究所 Computer vision based mobile terminal application testing system and method
CN108304584A (en) * 2018-03-06 2018-07-20 百度在线网络技术（北京）有限公司 Illegal page detection method, apparatus, intruding detection system and storage medium
CN108875797A (en) * 2018-05-29 2018-11-23 腾讯科技（深圳）有限公司 A kind of method of determining image similarity, photograph album management method and relevant device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1658158A (en) * 2004-01-28 2005-08-24 微软公司 Method and system for masking dynamic regions in a user interface to enable testing of user interface consistency
US20160117566A1 (en) * 2013-09-20 2016-04-28 Oracle International Corporation Screenshot database for application verification
CN105589801A (en) * 2014-10-20 2016-05-18 网易（杭州）网络有限公司 Mobile phone cluster test method and system
CN105868102A (en) * 2016-03-22 2016-08-17 中国科学院软件研究所 Computer vision based mobile terminal application testing system and method
CN105630686A (en) * 2016-03-24 2016-06-01 厦门美图移动科技有限公司 Traversal testing method and device for applications and mobile terminal
CN108304584A (en) * 2018-03-06 2018-07-20 百度在线网络技术（北京）有限公司 Illegal page detection method, apparatus, intruding detection system and storage medium
CN108875797A (en) * 2018-05-29 2018-11-23 腾讯科技（深圳）有限公司 A kind of method of determining image similarity, photograph album management method and relevant device

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110502425A (en) * 2019-06-28 2019-11-26 平安银行股份有限公司 Test data generating method, device, electronic equipment and storage medium
CN112559314A (en) * 2019-09-26 2021-03-26 上海汽车集团股份有限公司 Testing method and testing device for human-computer interaction interface
CN110738185A (en) * 2019-10-23 2020-01-31 腾讯科技（深圳）有限公司 Form object identification method and device and storage medium
CN110738185B (en) * 2019-10-23 2023-07-07 腾讯科技（深圳）有限公司 Form object identification method, form object identification device and storage medium
CN111273905B (en) * 2020-01-17 2023-04-18 南京大学 Application retrieval method and device based on interface sketch
CN111273905A (en) * 2020-01-17 2020-06-12 南京大学 Application retrieval method and device based on interface sketch
CN111522615A (en) * 2020-04-23 2020-08-11 平安国际智慧城市科技股份有限公司 Method, device and equipment for updating command line interface and storage medium
CN111522615B (en) * 2020-04-23 2023-08-15 深圳赛安特技术服务有限公司 Method, device, equipment and storage medium for updating command line interface
CN112150464A (en) * 2020-10-23 2020-12-29 腾讯科技（深圳）有限公司 Image detection method and device, electronic equipment and storage medium
CN112150464B (en) * 2020-10-23 2024-01-30 腾讯科技（深圳）有限公司 Image detection method and device, electronic equipment and storage medium
CN112559342A (en) * 2020-12-09 2021-03-26 上海米哈游天命科技有限公司 Method, device and equipment for acquiring picture test image and storage medium
CN112559341A (en) * 2020-12-09 2021-03-26 上海米哈游天命科技有限公司 Picture testing method, device, equipment and storage medium
CN113360378A (en) * 2021-06-04 2021-09-07 北京房江湖科技有限公司 Regression testing method and device for application program for generating VR scene
CN113782003A (en) * 2021-09-14 2021-12-10 上汽通用五菱汽车股份有限公司 Test method and system

Also Published As

Publication number Publication date
CN109815150B (en) 2021-08-06

Similar Documents

Publication Publication Date Title
CN109815150A (en) Application testing method, device, electronic equipment and storage medium
CN111079576B (en) Living body detection method, living body detection device, living body detection equipment and storage medium
CN110083791B (en) Target group detection method and device, computer equipment and storage medium
CN110222789B (en) Image recognition method and storage medium
CN109086709A (en) Feature Selection Model training method, device and storage medium
CN109829456A (en) Image-recognizing method, device and terminal
CN108648235A (en) Method for relocating, device and the storage medium of camera posture tracing process
CN110650379B (en) Video abstract generation method and device, electronic equipment and storage medium
CN110148178A (en) Camera localization method, device, terminal and storage medium
CN109117635B (en) Virus detection method and device for application program, computer equipment and storage medium
CN109522863B (en) Ear key point detection method and device and storage medium
CN109285178A (en) Image partition method, device and storage medium
CN110059652A (en) Face image processing process, device and storage medium
CN110570460A (en) Target tracking method and device, computer equipment and computer readable storage medium
CN109558837A (en) Face critical point detection method, apparatus and storage medium
CN109360222A (en) Image partition method, device and storage medium
CN108288032A (en) Motion characteristic acquisition methods, device and storage medium
CN110059686A (en) Character identifying method, device, equipment and readable storage medium storing program for executing
CN111144365A (en) Living body detection method, living body detection device, computer equipment and storage medium
CN110705614A (en) Model training method and device, electronic equipment and storage medium
CN109886208A (en) Method, apparatus, computer equipment and the storage medium of object detection
CN111738365A (en) Image classification model training method and device, computer equipment and storage medium
CN109189290B (en) Click area identification method and device and computer readable storage medium
CN114741559A (en) Method, apparatus and storage medium for determining video cover
CN110097002A (en) Nearly word form determines method, apparatus, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant