CN108664364A - A kind of terminal test method and device - Google Patents
A kind of terminal test method and device Download PDFInfo
- Publication number
- CN108664364A CN108664364A CN201710208201.4A CN201710208201A CN108664364A CN 108664364 A CN108664364 A CN 108664364A CN 201710208201 A CN201710208201 A CN 201710208201A CN 108664364 A CN108664364 A CN 108664364A
- Authority
- CN
- China
- Prior art keywords
- terminal
- region
- intended application
- control
- test
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/26—Functional testing
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the invention discloses a kind of terminal test method and devices.Wherein, this method includes：Terminal test device is in the case where detecting that the intended application of terminal starts, pre-stored control picture corresponding with intended application can be obtained, the region to match with the control picture on identification terminal screen, and determine the location information in the region, to carry out functional test to the terminal based on the location information.In this way, it can realize the automated function test to terminal under the scene that None- identified goes out application controls, avoid user's manual operation to complete test job, so as to reduce the workload of terminal test.Further, great amount of terminals can be tested simultaneously with the program, so as to improve terminal test efficiency.
Description
Technical field
The present invention relates to field of terminal technology, and in particular to a kind of terminal test method and device.
Background technology
Certain controls that current bank finance class application can be generally directed in application carry out certain encryption, this kind of
Control hereinafter referred to as safe control by encryption.However function survey is being carried out to terminals such as smart mobile phone, tablet computers
When examination, the characteristics of due to safe control encryption so that the control information of terminal None- identified safe control, such as the volume of control
Number, textual value, hierarchical relationship character string etc., it is therefore desirable to user clicks each control manually could complete functional test.If
It needs to test multiple terminals, then substantially increases terminal test workload, reduce testing efficiency.
Invention content
The embodiment of the invention discloses a kind of terminal test method and devices, it is possible to reduce terminal test workload improves
Testing efficiency.
In a first aspect, the embodiment of the invention discloses a kind of terminal test method, this method may include：
In the case where detecting that the intended application of terminal starts, obtain pre-stored corresponding with the intended application
Control picture；
The region to match with the control picture on identification terminal screen, and determine described with the control picture phase
The location information in the region matched；
Functional test is carried out to the terminal based on the location information.
Second aspect, the embodiment of the invention discloses a kind of terminal test device, which may include：
Acquisition module, for detect terminal intended application start in the case of, obtain it is pre-stored with it is described
The corresponding control picture of intended application；
Identification module, the region to match for identification with the control picture on terminal screen；
Determining module, the location information for determining the region to match with the control picture；
Test module, for carrying out functional test to the terminal based on the location information.
Implement the embodiment of the present invention, has the advantages that：
In the embodiment of the present invention, terminal test device can be obtained in the case where detecting that the intended application of terminal starts
Take pre-stored control picture corresponding with intended application, the region to match with the control picture on identification terminal screen,
And determine the location information in the region, to carry out functional test to the terminal based on the location information.In this way, may be used
With under the scene that None- identified goes out application controls, realize the automated function test to terminal, avoid user's manual operation with
Test job is completed, so as to reduce the workload of terminal test.It further, can be simultaneously to a large amount of whole with the program
End is tested, so as to improve terminal test efficiency.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for
For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings
Attached drawing.
Fig. 1 is a kind of flow diagram of terminal test method disclosed by the embodiments of the present invention；
Fig. 2 is terminal test runnable interface schematic diagram disclosed by the embodiments of the present invention；
Fig. 3 is the flow diagram of another terminal test method disclosed by the embodiments of the present invention；
Fig. 4 is a kind of structural schematic diagram of terminal test device disclosed by the embodiments of the present invention；
Fig. 5 is a kind of structural schematic diagram of terminal test equipment disclosed by the embodiments of the present invention.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without creative efforts
Embodiment shall fall within the protection scope of the present invention.
The embodiment of the invention discloses a kind of terminal test method and devices, it is possible to reduce terminal test workload improves
Testing efficiency.It is described in detail separately below.
Referring to Fig. 1, Fig. 1 is a kind of flow diagram of terminal test method disclosed by the embodiments of the present invention.The present invention
Method described in embodiment, may comprise steps of：
101, terminal test device obtains pre-stored and mesh in the case where detecting that the intended application of terminal starts
Mark applies corresponding control picture.
In the embodiment of the present invention, which can include but is not limited to laptop, desktop computer, mobile phone, tablet electricity
The terminal devices such as brain, car-mounted terminal, intelligent wearable device, terminal test device can be located in tested terminal, also may be used
To be located at external test facility, the embodiment of the present invention does not limit.
In the embodiment of the present invention, intended application can be the arbitrary application installed in terminal, can also be preassigned
Using such as bank's class application, the application to the built-in control of application Jing Guo encryption such as finance and money management class application, the present invention is implemented
Example does not limit.
In the embodiment of the present invention, terminal can prestore control picture corresponding with intended application.Concrete mode can be with
For：
Terminal function test is being carried out for the first time and when starting intended application, can exported on the interface of terminal test device
One suspended window, as shown in Fig. 2, the suspended window may include the function buttons such as " sectional drawing ", " preservation ", " RUN ", when the user clicks
When " sectional drawing " button, terminal test device starts sectional drawing function, and user can carry out sectional drawing, Ke Yishi to the interface of intended application
Sectional drawing is carried out to entire interface, can also be to carry out local sectional drawing, for example, can be only to the single control in intended application interface
Sectional drawing is carried out, to obtain the control picture of each control.
For example, when user needs, to each function button progress sectional drawing of intended application, such as to return to button, can click
Picture etc., or to when each button carries out sectional drawing in the dummy keyboard of intended application, can after click " sectional drawing " button,
Adjust screenshot area, wherein screenshot area can be according to the shape for the button for waiting for sectional drawing, you can be adjusted according to user demand
Section, e.g., rectangular, round, oval, irregular polygon, etc., the embodiment of the present invention does not limit.After the completion of sectional drawing, user
" preservation " button can be clicked, terminal test device is stored in local so as to each control picture for obtaining these sectional drawings
In file, further, incidence relation or index relative etc. can also will be established between these control pictures and intended application,
Further, these control pictures can also be carried out classification preservation by terminal test device, as the key image of dummy keyboard preserves
Into a file of intended application, function button picture such as returns to button, homepage be saved in intended application another
It in file, is saved in another file of intended application with the picture of the relevant function button of picture, the present invention is implemented
Example does not limit.Further, terminal test device can also according to the shot operation of user, after the completion of recognizing sectional drawing,
Automatic execute preserves operation, and the embodiment of the present invention does not limit.
It is understood that suspended window displaying shown in Fig. 2 is only example, shape, size, display location and institute
Including function button, the embodiment of the present invention does not limit, for example, it may be suspended in any position at interface, user can be with
Dragging suspended window is to other positions as needed, and the button in suspended window can be circle as shown in Figure 2, the side of can also be
Shape can also be ellipse, can also be the other shapes, etc. with background picture.
Further, user can carry out sectional drawing according to demand, can also be cut under the prompt of terminal test device
Figure.For example, after terminal starts intended application, terminal test device can carry out analysis knowledge to the control in intended application first
Not, if it is possible to the attribute information of the control is obtained, such as id numbers, text textual values, key assignments, the hierarchical relationship character string of control
Deng, then will not prompt user need to the control carry out sectional drawing can be exported if the attribute information of the control cannot be accessed
Corresponding prompt message, such as " the control property information that cannot identify certain position ", or " control that please align Mr. Yu position is cut
Figure " etc., to prompt user to carry out sectional drawing processing to the control.
Wherein, control picture corresponding with intended application can be one, can also be multiple, the embodiment of the present invention is not done
It limits.
By carrying out sectional drawing to the control of intended application in advance and preserving, subsequently start same application at the same time to multiple ends
When end carries out functional test, it can avoid user's multi-pass operation directly using the sectional drawing pre-saved, reduce terminal test work
Amount.
102, the region to match with the control picture on terminal test device identification terminal screen, and determine and the control
The location information in the region that picture matches.
In the embodiment of the present invention, terminal test device is after getting control picture corresponding with intended application, Ke Yijin
Terminal screen is identified in one step, is such as directed to each control picture, matches with the control picture on identification terminal screen
Region, and then determine the location information in the region, to indicate the position of control on a terminal screen indicated by the control picture.
It is understood that the region to match with the control picture on terminal screen can be shape size, color, mark
Remember figure, the consistent region such as resolution ratio, can also be on terminal screen in all areas with the color of the control picture, mark
The similarities highest such as note, resolution ratio, or more than the region of certain threshold value, the embodiment of the present invention does not limit.
103, terminal test device is based on the location information and carries out functional test to the terminal.
In the specific implementation, the concrete mode that terminal test device carries out the terminal based on the location information functional test can
Think：
Terminal determines that the control of intended application is distributed according to location information, and the control based on intended application is distributed to terminal
Carry out the test of control clicking operation.
In the embodiment of the present invention, terminal test device after obtaining the location information of control corresponding to each control picture,
Functional test is carried out to terminal so as to be based on the location information.Specifically, in Android system, it can be by the position of control
Information calls native interface to be passed to terminal test device by Android system, you can according to each control of location information precise positioning
Position realize the automatic test to terminal so as to analog subscriber clicking operation.
Further, it for the application of built-in dummy keyboard encryption, can be obtained according to step 101 and 102
The distributed intelligence of dummy keyboard, so that it is determined that go out the specific location of the buttons such as " 0 ", " 1 ", " 2 " on a terminal screen, so as to
Analog subscriber clicking operation clicks dummy keyboard, to realize the functional test to terminal.It in this way can be same
When multiple terminals are tested, realize the automation application of terminal test, improve testing efficiency.
As it can be seen that in the method described in Fig. 1, terminal test device is the case where the intended application for detecting terminal starts
Under, can obtain pre-stored control picture corresponding with intended application, on identification terminal screen with the control picture phase
The region matched, and determine the location information in the region, to carry out functional test to the terminal based on the location information.Pass through this
Kind mode can be realized to the automated function test of terminal under the scene that None- identified goes out application controls, avoid user hand
Dynamic operation is to complete test job, so as to reduce the workload of terminal test.It further, can be simultaneously with the program
Great amount of terminals is tested, so as to improve terminal test efficiency.
Referring to Fig. 3, Fig. 3 is the flow diagram of another terminal test method disclosed by the embodiments of the present invention.This hair
Method described in bright embodiment, may comprise steps of：
301, in the case where detecting that the intended application of terminal starts, terminal test device identifies the current institute of intended application
The interface at place.
In the embodiment of the present invention, terminal test device, can be in the case where detecting that the intended application of terminal starts
The interface that further identification intended application is presently in, and in the case where the interface is default interface, detect whether to get
The distributed intelligence of dummy keyboard in default interface, if it is not, obtaining pre-stored control figure corresponding with intended application
Piece.
In the specific implementation, for certain bank's classes or the application of finance and money management class, it is not necessarily all interior to its
Control is set, if functionality buttons not being encrypted, it is only necessary to when user logs in and pays, place is encrypted to dummy keyboard
Reason.Therefore, terminal test device needs to identify the current institute of intended application in the case where detecting that the intended application of terminal starts
The interface at place.
302, in the case where the interface is default interface, terminal test device detects whether to get empty in default interface
The distributed intelligence of quasi- keyboard.
In the embodiment of the present invention, terminal test device is after the current interface to intended application is identified, if obtained
Current interface is terminal test device or tested terminal is pre-set that the control on the interface may be encrypted
The default interface of processing, such as the interface of dummy keyboard is shown on interface, terminal test device then further obtains the boundary
The distributed intelligence of dummy keyboard in face.Wherein, in the case where intended application is bank's type of financial financing class application,
The default interface can be user's login interface of intended application, it might even be possible to be logged in specific to needing user to input
The payment interface at interface or intended application when password, such as chooses the payment interface of payment cipher frame, the embodiment of the present invention
It does not limit.
303, in the case of the distributed intelligence of dummy keyboard being not detected in default interface, terminal test device obtains pre-
The control picture corresponding with intended application first stored, wherein the control picture includes the button of the dummy keyboard of intended application
Picture.
In the embodiment of the present invention, if terminal test device does not get the distributed intelligence of dummy keyboard, show mesh
Mark application may carry out encryption to built-in dummy keyboard, and therefore, terminal test device is needed from local folders
Search whether the key image for being stored with dummy keyboard associated with intended application, if be stored with, acquisition is pressed accordingly
Key picture carries out key position identifying processing.If the distributed intelligence for the dummy keyboard that terminal test device is got, shows
Intended application is not encrypted the button in dummy keyboard at current interface, and terminal test device is so as to straight
It connects and functional test is carried out to terminal according to the button distributed intelligence of dummy keyboard.
In this way, function survey can be carried out using to terminal to avoid each bank's class or finance and money management class is started
It when examination, is required for identifying the button distribution situation of the application by key image, terminal survey can be greatly reduced in this way
Try workload.
304, key image and terminal screen are carried out Characteristic Contrast by terminal test device, are obtained and the key image feature
The region to match.
In the embodiment of the present invention, if getting the key image of dummy keyboard corresponding with intended application, terminal test
Device can further identify the region to match with key image on a terminal screen.
It is understood that terminal test device, can specifically be directed to each key image, on identification terminal screen with should
The consistent region such as shape size, color, resolution ratio, the marker graphic of key image can also be all areas on terminal screen
In domain with the similarities highest such as the color of the control picture, label, resolution ratio, or more than the region of certain threshold value, the present invention
Embodiment does not limit.
Specifically, for bank's class, finance and money management class application, it is generally defeated in user in order to protect the property safety of user
It needs that the information of input is encrypted when entering account and password, distinctive dummy keyboard is applied especially by this is developed,
And dummy keyboard is encrypted to realize, the other application and external equipment of such terminal are all difficult to identify that user
The information inputted by dummy keyboard, to ensure the safety of account number cipher.Therefore, for this kind of application, terminal test dress
It sets before carrying out functional test to terminal, can sectional drawing be carried out to each button in this kind of dummy keyboard in advance and preserves.
Therefore, corresponding getting when realizing the functional test to terminal by testing this kind of application next time
After key image, need each band of position and the key image on terminal screen carrying out Characteristic Contrast, to obtain with often
The region that the feature of a key image matches.
As a kind of feasible embodiment, the key image and terminal screen are carried out feature pair by terminal test device
Than obtaining the concrete mode in the region to match with the key image feature can be：
Terminal screen is divided into multiple regions by terminal test device according to preset rules；
Terminal test device obtains the second spy of the fisrt feature information and key image in each region in multiple regions
Reference ceases；
Terminal test device is based on fisrt feature information and second feature information, calculates the phase in each region and key image
Like degree；
The highest region of similarity is determined as the region to match with key image feature by terminal test device.
In the specific implementation, terminal screen can be divided into multiple regions by terminal test device according to preset rules first,
Wherein, which can carry out region division according to features such as shape, the sizes of key image, for example, prestoring
Key image in, the shape of button is rectangular, and size is 2*5 unit quantity, and therefore, terminal test device can be by tested end
The screen at end is divided into multiple regions according to above-mentioned shape size, further, can be obtained with terminal test device
To the characteristic information in each region, for example, resolution ratio, color, the special marking etc. in each region.
Further, terminal test device can also be identified each key image, obtain the spy of each key image
Reference ceases, such as resolution ratio, color, special marking.Therefore, terminal test device is so as to according to dividing on terminal screen
Each characteristic information in region and the characteristic information of each key image calculate separately the phase in each region and each key image
Like degree.
Further, terminal test device, can be with needle after calculating similarity of each key image with each region
To some key image, using with the highest region of its similarity as the region to match with the key image feature.Pass through
This mode so as to respectively obtaining the region to match with the feature of each key image on a terminal screen.
It is understood that the characteristic information mentioned in the embodiment of the present invention can include but is not limited to color, differentiate
Rate, shape size, symbol, character, special marking etc..
Specifically, due in certain bank's classes or the application of finance and money management class, user is every time in input login password or branch
Pay password when, may be differed on key arrangement using built-in dummy keyboard, for example, on dummy keyboard it is each number or
The sequence of letter is random irregular.Therefore, terminal test device to terminal by this kind of application for carrying out functional test
Before, can each button in dummy keyboard be subjected to sectional drawing processing in advance, and when carrying out terminal function test, will each pressed
The picture of key carries out aspect ratio pair with terminal screen, so as to which specific position of each button in terminal screen is recognized accurately
It sets, in other words, can quickly obtain keyboard set up situation of the dummy keyboard when this is called.
Therefore, after terminal test device identifies the region to match with each control picture on a terminal screen, in turn
The location information of corresponding region can be obtained.It is understood that the location information can be specifically the region in terminal screen
On coordinate value.
Optionally, terminal test device can also be currently located the region that dummy keyboard is identified at interface according to intended application
Range carries out region division to the regional extent according to the shape size of button.For example, it is generally the case that when need into
When row input operation, dummy keyboard is normally at the lower end of terminal screen, occupies the area of terminal screen 1/3 or 1/2, because
This, terminal test device can be according to the size of pre-recorded dummy keyboard, the band of position, so that it is determined that going out on terminal screen
Corresponding regional location, to according to the division rule of dummy keyboard, such as the key shape of each position of dummy keyboard, to terminal
Corresponding position region is divided on screen, obtains subregion, to be calculated per height according to the characteristic information of every sub-regions
The similarity in region and each key image.
Each key image location on a terminal screen can be more quickly determined in this way, from
And the characteristic matching efficiency in picture and region can be improved.
305, terminal test device determines the location information in the region to match with the key image, and is believed based on the position
Breath carries out functional test to the terminal.
In the embodiment of the present invention, area that terminal test device matches on identifying terminal screen with each key image
Can be specifically coordinate value so as to obtain the location information in the region behind domain.
In the specific implementation, the concrete mode that terminal test device carries out the terminal based on the location information functional test can
Think：
Terminal determines that the control of intended application is distributed according to location information, and the control based on intended application is distributed to terminal
Carry out the test of control clicking operation.
In the embodiment of the present invention, terminal test device after obtaining the location information of control corresponding to each control picture,
Functional test is carried out to terminal so as to be based on the location information.Specifically, in Android system, it can be by the position of control
Information calls native interface to be passed to terminal test device by Android system, you can according to each control of location information precise positioning
Position realize the automatic test to terminal so as to analog subscriber clicking operation.
Further, it for the application of built-in dummy keyboard encryption, can be obtained according to step 101 and 102
The distributed intelligence of dummy keyboard, so that it is determined that go out the specific location of the buttons such as " 0 ", " 1 ", " 2 " on a terminal screen, so as to
Analog subscriber clicking operation clicks dummy keyboard, to realize the functional test to terminal.It in this way can be same
When multiple terminals are tested, realize the automation application of terminal test, improve testing efficiency.
As it can be seen that in the method described in Fig. 3, terminal test device is the case where the intended application for detecting terminal starts
Under, can obtain pre-stored control picture corresponding with intended application, on identification terminal screen with the control picture phase
The region matched, and determine the location information in the region, to carry out functional test to the terminal based on the location information.Pass through this
Kind mode can be realized to the automated function test of terminal under the scene that None- identified goes out application controls, avoid user hand
Dynamic operation is to complete test job, so as to reduce the workload of terminal test.It further, can be simultaneously with the program
Great amount of terminals is tested, so as to improve terminal test efficiency.
Based on terminal test method shown in above-described embodiment, the embodiment of the invention also discloses a kind of terminal test dresses
It sets, referring to Fig. 4, Fig. 4 is a kind of structural schematic diagram of terminal test device disclosed by the embodiments of the present invention.The embodiment of the present invention
Described device may include following module：
Acquisition module 401, in the case where detecting that the intended application of terminal starts, obtaining pre-stored and institute
State the corresponding control picture of intended application.
Identification module 402, the region to match for identification with the control picture on terminal screen.
Determining module 403, the location information for determining the region to match with the control picture.
Test module 404, for carrying out functional test to the terminal based on the location information.
In the embodiment of the present invention, intended application can be the arbitrary application installed in terminal, can also be preassigned
Using such as bank's class application, the application to the built-in control of application Jing Guo encryption such as finance and money management class application, the present invention is implemented
Example does not limit.Wherein, control picture corresponding with intended application can be one, can also be multiple.
In the embodiment of the present invention, terminal can prestore control picture corresponding with intended application.Concrete mode can be with
For：
Terminal function test is being carried out for the first time and when starting intended application, can exported on the interface of terminal test device
One suspended window, as shown in Fig. 2, the suspended window may include the function buttons such as " sectional drawing ", " preservation ", " RUN ", when the user clicks
When " sectional drawing " button, terminal test device starts sectional drawing function, and user can carry out sectional drawing, Ke Yishi to the interface of intended application
Sectional drawing is carried out to entire interface, can also be to carry out local sectional drawing, for example, can be only to the single control in intended application interface
Sectional drawing is carried out, to obtain the control picture of each control.
For example, when user needs, to each function button progress sectional drawing of intended application, such as to return to button, can click
Picture etc., or to when each button carries out sectional drawing in the dummy keyboard of intended application, can after click " sectional drawing " button,
Adjust screenshot area, wherein screenshot area can be according to the shape for the button for waiting for sectional drawing, you can be adjusted according to user demand
Section, e.g., rectangular, round, oval, irregular polygon, etc., the embodiment of the present invention does not limit.After the completion of sectional drawing, user
" preservation " button can be clicked, terminal test device is stored in local so as to each control picture for obtaining these sectional drawings
In file, further, incidence relation or index relative etc. can also will be established between these control pictures and intended application,
Further, these control pictures can also be carried out classification preservation by terminal test device, as the key image of dummy keyboard preserves
Into a file of intended application, function button picture such as returns to button, homepage be saved in intended application another
It in file, is saved in another file of intended application with the picture of the relevant function button of picture, the present invention is implemented
Example does not limit.Further, terminal test device can also according to the shot operation of user, after the completion of recognizing sectional drawing,
Automatic execute preserves operation, and the embodiment of the present invention does not limit.
It is understood that suspended window displaying shown in Fig. 2 is only example, shape, size, display location and institute
Including function button, the embodiment of the present invention does not limit, for example, it may be suspended in any position at interface, user can be with
Dragging suspended window is to other positions as needed, and the button in suspended window can be circle as shown in Figure 2, the side of can also be
Shape can also be ellipse, can also be the other shapes, etc. with background picture.
Further, user can carry out sectional drawing according to demand, can also be cut under the prompt of terminal test device
Figure.For example, after terminal starts intended application, terminal test device can carry out analysis knowledge to the control in intended application first
Not, if it is possible to the attribute information of the control is obtained, such as id numbers, text textual values, key assignments, the hierarchical relationship character string of control
Deng, then will not prompt user need to the control carry out sectional drawing can be exported if the attribute information of the control cannot be accessed
Corresponding prompt message, such as " the control property information that cannot identify certain position ", or " control that please align Mr. Yu position is cut
Figure " etc., to prompt user to carry out sectional drawing processing to the control.
In some feasible embodiments, the control picture includes the button figure of the dummy keyboard of the intended application
The concrete mode of piece, the region to match with the control picture on 402 identification terminal screen of the identification module is：
The key image and terminal screen are subjected to contrast characteristic's comparison, obtain matching with the key image feature
Region.
It is understood that the region to match with the control picture on terminal screen can be shape size, color, mark
The consistent region such as note, resolution ratio, marker graphic can also be the face on terminal screen in all areas with the control picture
The similarities highest such as color, label, resolution ratio, or more than the region of certain threshold value, the embodiment of the present invention does not limit.
In some feasible embodiments, the identification module 402 includes：
Division unit 4021, for the terminal screen to be divided into multiple regions according to preset rules.
Acquiring unit 4022, for obtaining in the multiple region the fisrt feature information in each region and described pressing
The second feature information of key picture.
Computing unit 4023 calculates described each for being based on the fisrt feature information and the second feature information
The similarity in region and the key image.
Determination unit 4024, the area for the highest region of similarity to be determined as matching with the key image feature
Domain.
It is understood that the characteristic information mentioned in the embodiment of the present invention can include but is not limited to color, differentiate
Rate, shape size, symbol, character, special marking etc..
Specifically, due in certain bank's classes or the application of finance and money management class, user is every time in input login password or branch
Pay password when, may be differed on key arrangement using built-in dummy keyboard, for example, on dummy keyboard it is each number or
The sequence of letter is random irregular.Therefore, terminal test device to terminal by this kind of application for carrying out functional test
Before, can each button in dummy keyboard be subjected to sectional drawing processing in advance, and when carrying out terminal function test, will each pressed
The picture of key carries out aspect ratio pair with terminal screen, so as to which specific position of each button in terminal screen is recognized accurately
It sets, in other words, can quickly obtain keyboard set up situation of the dummy keyboard when this is called.
Therefore, after terminal test device identifies the region to match with each control picture on a terminal screen, in turn
The location information of corresponding region can be obtained.It is understood that the location information can be specifically the region in terminal screen
On coordinate value.
Optionally, terminal test device can also be currently located the region that dummy keyboard is identified at interface according to intended application
Range carries out region division to the regional extent according to the shape size of button.For example, it is generally the case that when need into
When row input operation, dummy keyboard is normally at the lower end of terminal screen, occupies the area of terminal screen 1/3 or 1/2, because
This, terminal test device can be according to the size of pre-recorded dummy keyboard, the band of position, so that it is determined that going out on terminal screen
Corresponding regional location, to according to the division rule of dummy keyboard, such as the key shape of each position of dummy keyboard, to terminal
Corresponding position region is divided on screen, obtains subregion, to be calculated per height according to the characteristic information of every sub-regions
The similarity in region and each key image.
Each key image location on a terminal screen can be more quickly determined in this way, from
And the characteristic matching efficiency in picture and region can be improved.
In some feasible embodiments, the identification module 402 is additionally operable to identify that the intended application is presently in
Interface.
Described device further includes：
Detection module 405, in the case where the identification module 402 identifies that the interface is default interface, examining
The distributed intelligence for whether getting dummy keyboard in the default interface is surveyed, if it is not, then triggering the acquisition module 401 executes institute
State the operation for obtaining pre-stored control picture corresponding with the intended application.
Wherein, default interface can be user's login interface of intended application, it might even be possible to be inputted specific to user is needed
The payment interface at interface or intended application when login password such as chooses the payment interface of payment cipher frame, the present invention real
Example is applied not limit.
In this way, function survey can be carried out using to terminal to avoid each bank's class or finance and money management class is started
It when examination, is required for identifying the button distribution situation of the application by key image, terminal survey can be greatly reduced in this way
Try workload.
In some feasible embodiments, the test module 404 is based on the location information and is carried out to the terminal
The concrete mode of functional test can be：
The control distribution of the intended application, and the control based on the intended application point are determined according to the positional information
Cloth carries out the terminal test of control clicking operation.
As it can be seen that in the device described in Fig. 4, terminal test device is the case where the intended application for detecting terminal starts
Under, can obtain pre-stored control picture corresponding with intended application, on identification terminal screen with the control picture phase
The region matched, and determine the location information in the region, to carry out functional test to the terminal based on the location information.Pass through this
Kind mode can be realized to the automated function test of terminal under the scene that None- identified goes out application controls, avoid user hand
Dynamic operation is to complete test job, so as to reduce the workload of terminal test.It further, can be simultaneously with the program
Great amount of terminals is tested, so as to improve terminal test efficiency.
Please refer to fig. 5, Fig. 5 is a kind of structural schematic diagram of terminal test equipment disclosed by the embodiments of the present invention.This
Equipment described in inventive embodiments can be tested terminal itself, or external equipment, the embodiment of the present invention are not done
It limits.The equipment can include but is not limited to：At least one input equipment 501；At least one output equipment 502；It is at least one
Processor 503, such as CPU；With memory 504, above-mentioned input equipment 501, output equipment 502, processor 503 and memory
504 are connected by bus 505.
Wherein, output equipment 502 for example can be the screens/interfaces for output, such as display screen (Display), touch-control
Screen, specific such as target interface, input equipment 501 for example can be the keyboard (Keyboard) for input, mouse, for capturing
The camera of image, the receiver for playing voice signal and loud speaker, the touch screen etc. for detecting touch operation need
It is noted that display screen and touch screen herein can be the integrated design, keyboard both can be physical keyboard, or
Touch screen dummy keyboard can also be the keyboard that entity is combined with touch screen virtualphase.Memory 504 for storing instruction, processor
503 program for executing the storage of memory 504.Wherein：
Processor 503, for detect terminal intended application start in the case of, obtain it is pre-stored with it is described
The corresponding control picture of intended application.
Processor 503 is additionally operable to the region to match with the control picture on identification terminal screen.
Processor 503 is additionally operable to determine the location information in the region to match with the control picture.
Processor 503 is additionally operable to carry out functional test to the terminal based on the location information.
In the embodiment of the present invention, intended application can be the arbitrary application installed in terminal, can also be preassigned
Using such as bank's class application, the application to the built-in control of application Jing Guo encryption such as finance and money management class application, the present invention is implemented
Example does not limit.Wherein, control picture corresponding with intended application can be one, can also be multiple.
In some feasible embodiments, the control picture includes the button figure of the dummy keyboard of the intended application
The concrete mode of piece, the region to match with the control picture on 503 identification terminal screen of processor is：
The key image and terminal screen are subjected to contrast characteristic's comparison, obtain matching with the key image feature
Region.
It is understood that the region to match with the control picture on terminal screen can be shape size, color, mark
The consistent region such as note, resolution ratio, marker graphic can also be the face on terminal screen in all areas with the control picture
The similarities highest such as color, label, resolution ratio, or more than the region of certain threshold value, the embodiment of the present invention does not limit.
In some feasible embodiments, the key image and terminal screen are carried out contrast characteristic by processor 503
Comparison, obtaining the concrete mode in the region to match with the key image feature can be：
The terminal screen is divided into multiple regions according to preset rules, takes of each region in the multiple region
The second feature information of one characteristic information and the key image, and based on the fisrt feature information and second spy
Reference ceases, and calculates the similarity in each region and the key image, so that the highest region of similarity is determined as and
The region that the key image feature matches.
It is understood that the characteristic information mentioned in the embodiment of the present invention can include but is not limited to color, differentiate
Rate, shape size, symbol, character, special marking etc..
In some feasible embodiments, processor 503 is additionally operable to identify the boundary that the intended application is presently in
Face, and in the case where the interface is default interface, detect whether the distribution for getting dummy keyboard in the default interface
Information, if it is not, then executing the operation for obtaining pre-stored control picture corresponding with the intended application.
Wherein, default interface can be user's login interface of intended application, it might even be possible to be inputted specific to user is needed
The payment interface at interface or intended application when login password such as chooses the payment interface of payment cipher frame, the present invention real
Example is applied not limit.
In this way, function survey can be carried out using to terminal to avoid each bank's class or finance and money management class is started
It when examination, is required for identifying the button distribution situation of the application by key image, terminal survey can be greatly reduced in this way
Try workload.
In some feasible embodiments, processor 503 is based on the location information and carries out function survey to the terminal
The concrete mode of examination can be：
The control distribution of the intended application, and the control based on the intended application point are determined according to the positional information
Cloth carries out the terminal test of control clicking operation.
As it can be seen that in the equipment described in Fig. 5, terminal test equipment is the case where the intended application for detecting terminal starts
Under, can obtain pre-stored control picture corresponding with intended application, on identification terminal screen with the control picture phase
The region matched, and determine the location information in the region, to carry out functional test to the terminal based on the location information.Pass through this
Kind mode can be realized to the automated function test of terminal under the scene that None- identified goes out application controls, avoid user hand
Dynamic operation is to complete test job, so as to reduce the workload of terminal test.It further, can be simultaneously with the program
Great amount of terminals is tested, so as to improve terminal test efficiency.
One of ordinary skill in the art will appreciate that realizing all or part of flow in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the program can be stored in a computer read/write memory medium
In, the program is when being executed, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, the storage medium can be magnetic
Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access
Memory, RAM) etc..
The above disclosure is only the preferred embodiments of the present invention, cannot limit the right model of the present invention with this certainly
It encloses, therefore equivalent changes made in accordance with the claims of the present invention, is still within the scope of the present invention.
Claims (10)
1. a kind of terminal test method, which is characterized in that the method includes：
In the case where detecting that the intended application of terminal starts, pre-stored control corresponding with the intended application is obtained
Picture；
The region to match with the control picture on identification terminal screen, and determine what the described and control picture matched
The location information in region；
Functional test is carried out to the terminal based on the location information.
2. according to the method described in claim 1, it is characterized in that, the control picture includes the virtual key of the intended application
The key image of disk, the region to match with the control picture on the identification terminal screen, including：
The key image and terminal screen are subjected to Characteristic Contrast, obtain the region to match with the key image feature.
3. according to the method described in claim 2, it is characterized in that, described carry out feature by the key image and terminal screen
Comparison, obtains the region to match with the key image feature, including：
The terminal screen is divided into multiple regions according to preset rules；
Obtain the second feature information of the fisrt feature information and the key image in each region in the multiple region；
Based on the fisrt feature information and the second feature information, the phase in each region and the key image is calculated
Like degree；
The region that the highest region of similarity is determined as matching with the key image feature.
4. according to the method in claim 2 or 3, which is characterized in that described to obtain the pre-stored and intended application
Before corresponding control picture, the method further includes：
Identify the interface that the intended application is presently in；
In the case where the interface is default interface, the distribution letter for getting dummy keyboard in the default interface is detected whether
Breath, if it is not, then executing the operation for obtaining pre-stored control picture corresponding with the intended application.
5. according to the method described in claim 1, it is characterized in that, described carry out work(based on the location information to the terminal
It can test, including：
The control distribution of the intended application is determined according to the positional information, and based on the distribution pair of the control of the intended application
The terminal carries out the test of control clicking operation.
6. a kind of terminal test device, which is characterized in that described device includes：
Acquisition module, in the case where detecting that the intended application of terminal starts, obtaining the pre-stored and target
Using corresponding control picture；
Identification module, the region to match for identification with the control picture on terminal screen；
Determining module, the location information for determining the region to match with the control picture；
Test module, for carrying out functional test to the terminal based on the location information.
7. device according to claim 6, which is characterized in that the control picture includes the virtual key of the intended application
The key image of disk, the concrete mode in the region to match with the control picture on the identification module identification terminal screen
For：
The key image and terminal screen are subjected to contrast characteristic's comparison, obtain the area to match with the key image feature
Domain.
8. device according to claim 7, which is characterized in that the identification module includes：
Division unit, for the terminal screen to be divided into multiple regions according to preset rules；
Acquiring unit, for obtaining the fisrt feature information and the key image in each region in the multiple region
Second feature information；
Computing unit calculates each region and institute for being based on the fisrt feature information and the second feature information
State the similarity of key image；
Determination unit, the region for the highest region of similarity to be determined as matching with the key image feature.
9. device according to claim 7 or 8, which is characterized in that
The identification module is additionally operable to identify the interface that the intended application is presently in；
Described device further includes：
Detection module, in the case where the identification module identifies that the interface is default interface, detecting whether to obtain
To the distributed intelligence of dummy keyboard in the default interface, deposited in advance if it is not, then triggering the acquisition module and executing the acquisition
The operation of the control picture corresponding with the intended application of storage.
10. device according to claim 6, which is characterized in that the test module is based on the location information to described
Terminal carry out functional test concrete mode be：
The control distribution of the intended application is determined according to the positional information, and based on the distribution pair of the control of the intended application
The terminal carries out the test of control clicking operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710208201.4A CN108664364B (en) | 2017-03-31 | 2017-03-31 | Terminal testing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710208201.4A CN108664364B (en) | 2017-03-31 | 2017-03-31 | Terminal testing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108664364A true CN108664364A (en) | 2018-10-16 |
| CN108664364B CN108664364B (en) | 2023-05-09 |
Family
ID=63783728
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710208201.4A Active CN108664364B (en) | 2017-03-31 | 2017-03-31 | Terminal testing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108664364B (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109815947A (en) * | 2018-12-14 | 2019-05-28 | 深圳壹账通智能科技有限公司 | Test method, device and the computer equipment of application |
| CN110134807A (en) * | 2019-05-17 | 2019-08-16 | 苏州科达科技股份有限公司 | Target retrieval method, apparatus, system and storage medium |
| CN110765015A (en) * | 2019-10-24 | 2020-02-07 | 北京云聚智慧科技有限公司 | Method for testing application to be tested and electronic equipment |
| CN110888812A (en) * | 2019-11-26 | 2020-03-17 | 国核自仪系统工程有限公司 | System and method for testing response time of terminal page |
| CN111046873A (en) * | 2019-12-12 | 2020-04-21 | 电子科技大学中山学院 | Product function durability test self-learning method and system based on machine vision |
| CN111310776A (en) * | 2018-12-11 | 2020-06-19 | 航天信息股份有限公司 | Method, device and storage medium for identifying virtual numeric keyboard |
| CN111858356A (en) * | 2020-07-23 | 2020-10-30 | 北京首汽智行科技有限公司 | UI automatic testing method based on image recognition technology |
| CN111966847A (en) * | 2020-08-10 | 2020-11-20 | 上海中通吉网络技术有限公司 | Report regression testing method, device and system |
| CN112346795A (en) * | 2019-08-09 | 2021-02-09 | 北京小米移动软件有限公司 | Picture processing method and device and storage medium |
| CN112597053A (en) * | 2020-12-30 | 2021-04-02 | 中国工商银行股份有限公司 | User interface automatic testing method and device with safety control |
| CN113127348A (en) * | 2021-04-19 | 2021-07-16 | 广州掌动智能科技有限公司 | Method, system and storage medium for recording automatic test script of software |
| CN113157566A (en) * | 2021-03-26 | 2021-07-23 | 上海闻泰信息技术有限公司 | Screen control method, device, equipment and storage medium |
| CN114397965A (en) * | 2021-12-17 | 2022-04-26 | 北京云测信息技术有限公司 | Character input method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103678094A (en) * | 2012-08-31 | 2014-03-26 | 腾讯科技（深圳）有限公司 | Random key test method and device |
| CN104050076A (en) * | 2013-03-12 | 2014-09-17 | 阿里巴巴集团控股有限公司 | Testing method, device and system of application software on mobile terminal |
| CN104424089A (en) * | 2013-08-21 | 2015-03-18 | 中兴通讯股份有限公司 | Terminal testing method and device |
| CN104484273A (en) * | 2014-12-19 | 2015-04-01 | 广州博冠信息科技有限公司 | Test method for application program, device and system |
| CN106021108A (en) * | 2016-05-19 | 2016-10-12 | 努比亚技术有限公司 | Application program testing device, mobile terminal and method |
| CN106250307A (en) * | 2016-07-20 | 2016-12-21 | 福建省农村信用社联合社 | A kind of bank's mobile phone application automated testing method and system |
| CN106326104A (en) * | 2015-07-08 | 2017-01-11 | 腾讯科技（深圳）有限公司 | Terminal control test method and apparatus |
-
2017
- 2017-03-31 CN CN201710208201.4A patent/CN108664364B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103678094A (en) * | 2012-08-31 | 2014-03-26 | 腾讯科技（深圳）有限公司 | Random key test method and device |
| CN104050076A (en) * | 2013-03-12 | 2014-09-17 | 阿里巴巴集团控股有限公司 | Testing method, device and system of application software on mobile terminal |
| CN104424089A (en) * | 2013-08-21 | 2015-03-18 | 中兴通讯股份有限公司 | Terminal testing method and device |
| CN104484273A (en) * | 2014-12-19 | 2015-04-01 | 广州博冠信息科技有限公司 | Test method for application program, device and system |
| CN106326104A (en) * | 2015-07-08 | 2017-01-11 | 腾讯科技（深圳）有限公司 | Terminal control test method and apparatus |
| CN106021108A (en) * | 2016-05-19 | 2016-10-12 | 努比亚技术有限公司 | Application program testing device, mobile terminal and method |
| CN106250307A (en) * | 2016-07-20 | 2016-12-21 | 福建省农村信用社联合社 | A kind of bank's mobile phone application automated testing method and system |
Non-Patent Citations (1)
| Title |
|---|
| 徐秀林等: "基于移动平台的肌力康复评定系统的开发", 《生物医学工程学杂志》 * |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111310776A (en) * | 2018-12-11 | 2020-06-19 | 航天信息股份有限公司 | Method, device and storage medium for identifying virtual numeric keyboard |
| CN109815947A (en) * | 2018-12-14 | 2019-05-28 | 深圳壹账通智能科技有限公司 | Test method, device and the computer equipment of application |
| CN110134807A (en) * | 2019-05-17 | 2019-08-16 | 苏州科达科技股份有限公司 | Target retrieval method, apparatus, system and storage medium |
| CN112346795A (en) * | 2019-08-09 | 2021-02-09 | 北京小米移动软件有限公司 | Picture processing method and device and storage medium |
| CN110765015A (en) * | 2019-10-24 | 2020-02-07 | 北京云聚智慧科技有限公司 | Method for testing application to be tested and electronic equipment |
| CN110888812B (en) * | 2019-11-26 | 2023-11-07 | 国核自仪系统工程有限公司 | Test system and test method for response time of terminal page |
| CN110888812A (en) * | 2019-11-26 | 2020-03-17 | 国核自仪系统工程有限公司 | System and method for testing response time of terminal page |
| CN111046873A (en) * | 2019-12-12 | 2020-04-21 | 电子科技大学中山学院 | Product function durability test self-learning method and system based on machine vision |
| CN111046873B (en) * | 2019-12-12 | 2020-07-28 | 电子科技大学中山学院 | Product function durability test self-learning method based on machine vision |
| CN111858356A (en) * | 2020-07-23 | 2020-10-30 | 北京首汽智行科技有限公司 | UI automatic testing method based on image recognition technology |
| CN111966847A (en) * | 2020-08-10 | 2020-11-20 | 上海中通吉网络技术有限公司 | Report regression testing method, device and system |
| CN112597053A (en) * | 2020-12-30 | 2021-04-02 | 中国工商银行股份有限公司 | User interface automatic testing method and device with safety control |
| CN113157566A (en) * | 2021-03-26 | 2021-07-23 | 上海闻泰信息技术有限公司 | Screen control method, device, equipment and storage medium |
| CN113127348A (en) * | 2021-04-19 | 2021-07-16 | 广州掌动智能科技有限公司 | Method, system and storage medium for recording automatic test script of software |
| CN113127348B (en) * | 2021-04-19 | 2021-10-15 | 广州掌动智能科技有限公司 | Method, system and storage medium for recording automatic test script of software |
| CN114397965A (en) * | 2021-12-17 | 2022-04-26 | 北京云测信息技术有限公司 | Character input method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108664364B (en) | 2023-05-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108664364A (en) | A kind of terminal test method and device | |
| CN106327185B (en) | Starting method of payment application and mobile terminal | |
| US8938780B2 (en) | Display authentication | |
| CN104794050A (en) | Application program test method, device and system | |
| CN107274442A (en) | A kind of image-recognizing method and device | |
| CN112083973B (en) | Window closing method and device, electronic equipment and storage medium | |
| CN111814885A (en) | Method, system, device and medium for managing image frames | |
| CN105159475B (en) | A kind of characters input method and device | |
| CN108229418A (en) | Human body critical point detection method and apparatus, electronic equipment, storage medium and program | |
| CN109316747A (en) | Game auxiliary information reminding method, device and electronic equipment | |
| CN106778151A (en) | Method for identifying ID and device based on person's handwriting | |
| US11995428B2 (en) | Method and system for providing image-based interoperability with an application | |
| CN109785162A (en) | Medical insurance method for detecting abnormality, device, equipment and computer storage medium | |
| CN109271228A (en) | Interface function recognition methods, device and the electronic equipment of application | |
| CN106096043A (en) | A kind of photographic method and mobile terminal | |
| CN109933971A (en) | Verification method and device based on verification code, electronic equipment and storage medium | |
| KR102303206B1 (en) | Method and apparatus for recognizing object of image in electronic device | |
| CN107085694B (en) | Information display processing method and device | |
| CN111274602B (en) | Image characteristic information replacement method, device, equipment and medium | |
| CN110187806B (en) | Fingerprint template input method and related device | |
| CN106295472A (en) | A kind of fingerprint pattern application process and device | |
| CN107609397B (en) | Method and device for detecting malicious behavior of application program in android system | |
| CN115840931A (en) | Identity verification method based on face sliding screen interaction and related product | |
| CN107678612B (en) | Mobile payment method, device, mobile terminal and storage medium | |
| CN112000413B (en) | Screenshot method and system capable of protecting information and intelligent terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |