CN103377119B - A kind of non-standard control automated testing method and device - Google Patents
A kind of non-standard control automated testing method and device Download PDFInfo
- Publication number
- CN103377119B CN103377119B CN201210121186.7A CN201210121186A CN103377119B CN 103377119 B CN103377119 B CN 103377119B CN 201210121186 A CN201210121186 A CN 201210121186A CN 103377119 B CN103377119 B CN 103377119B
- Authority
- CN
- China
- Prior art keywords
- user interface
- image
- standard control
- current screen
- measured
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention discloses a kind of non-standard control automated testing method and device, belong to computer realm.Methods described includes：The graphical user interface image of the non-standard control to be measured of software under testing is obtained in advance；According to the graphical user interface image of the non-standard control to be measured obtained in advance, actual displayed position of the graphical user interface image of the non-standard control to be measured in current screen is determined；In the actual displayed position, analog subscriber is operated to the graphical user interface image of the non-standard control to be measured, to test the non-standard control to be measured.Described device includes：Acquisition module, determining module and analog module.By technical scheme, resource can be saved.
Description
Technical field
The present invention relates to computer realm, more particularly to a kind of non-standard control automated testing method and device.
Background technology
The object of UI (User Interface, user interface) automatic test mainly includes being based on GUI (Graphical
User Interface, graphical user interface) control, such as button, text box and check box.Control is divided into standard control
With non-standard control.Standard control by operating system API (Application Programming Interface, using journey
Sequence DLL) provide；Non-standard control is then voluntarily drawn by each applications providers.
At present, most of UI automated test tools only support testing standard control, and can not test non-standard control.This
Because these UI automated test tools are realized by API, the standard control that API is provided can only be recognized.In order to non-
Standard control is tested, and existing test mode positions non-standard control using virtual objects.Wherein, the virtual objects are pre-
The need first set test the virtual objects of non-standard control.Specifically, existing test mode includes, first, and seizure need to be tested non-
The region at interface where standard control sets virtual objects, and the stop of relative set virtual objects and Dimension Types etc. to believe
Breath；Secondly, according to virtual objects information, screen coordinate information and interface coordinate, seat of the dynamic calculation virtual objects in interface
Mark；Then, it is identified and operates according to the coordinate pair virtual objects；Finally, implementing result is checked, is verified whether and expected knot
Fruit is consistent.
During the present invention is realized, inventor has found that prior art at least has problems with：
Prior art needs coordinate of the dynamic calculation virtual objects in interface, when the non-standard control quantity ratio that need to be tested
When more, the virtual objects quantity that need to be set and safeguard accordingly increases, and the workload of dynamic calculation coordinate also becomes big therewith, will increase
Plus the burden of automatic test, cause the waste of resource.
The content of the invention
In order to save resource, and UI automatic tests are carried out to non-standard control, the embodiments of the invention provide one kind is non-
Standard control automated testing method and device.The technical scheme is as follows：
A kind of non-standard control automated testing method, methods described includes：
The GUI image of the non-standard control to be measured of software under testing is obtained in advance；
According to the GUI image of the non-standard control to be measured obtained in advance, the GUI of the non-standard control to be measured is determined
Actual displayed position of the image in current screen；
In the actual displayed position, analog subscriber is operated to the GUI image of the non-standard control to be measured, to survey
Try the non-standard control to be measured.
Wherein, the GUI image according to the non-standard control to be measured obtained in advance, is determined described to be measured non-standard
Actual displayed position of the GUI image of control in current screen, including：
Start the software under testing, the current screen is shown the UI of the software under testing；
Obtain the GUI image of the non-standard control to be measured obtained in advance described in the presence shown in the current screen
UI；
According to the UI, the GUI image is calculated in the actual displayed position of the current screen.
Wherein, it is described to obtain the non-standard control to be measured obtained in advance described in the presence shown in the current screen
GUI image UI before, in addition to：
The UI for the software under testing that the current screen is shown is read in real time；
According to the GUI image, search in the UI of the software under testing and whether there is and the GUI image identical figure
Picture；
If being not present, continue to read the UI for the software under testing that the current screen is shown.
Wherein, methods described also includes：
Pre-set the screen area that the GUI image is shown in screen；
Correspondingly, it is described read the software under testing that the current screen is shown in real time UI be,
In the screen area, the UI for the software under testing that the current screen is shown is read in real time.
Wherein, it is described according to the UI, the GUI image is calculated in the actual displayed position of the current screen, bag
Include：
Calculate position of the GUI image in the UI；
Obtain the UI and the current screen relative position relation；
According to position of the GUI image in the UI and the UI and the current screen relative position relation,
The GUI is calculated in the display location of the current screen.
A kind of non-standard control automatic test device, described device includes：
Acquisition module, the GUI image of the non-standard control to be measured for obtaining software under testing in advance；
Determining module, for the GUI image according to the non-standard control to be measured obtained in advance, is determined described to be measured non-
Actual displayed position of the GUI image of standard control in current screen；
Analog module, in the actual displayed position, GUI image of the analog subscriber to the non-standard control to be measured
Operated, to test the non-standard control to be measured.
Wherein, the determining module includes：
Start unit, for starting the software under testing, makes the current screen show the UI of the software under testing；
Acquiring unit, what is obtained in advance described in the presence shown in the current screen for obtaining is described to be measured non-standard
The UI of the GUI image of control；
Computing unit, for according to the UI, calculating the GUI image in the actual displayed position of the current screen
Put.
Wherein, the determining module also includes：
Reading unit, the UI for reading the software under testing that the current screen is shown in real time；
Search unit, for according to the GUI image, searching in the UI of the software under testing and whether there is and the GUI
Image identical image；
Correspondingly, the reading unit is additionally operable to,
If being not present, continue to read the UI for the software under testing that the current screen is shown.
Wherein, the determining module also includes：
Setting unit, the screen area of the GUI image is shown for pre-setting in screen；
Correspondingly, the reading unit is used for,
In the screen area, the UI for the software under testing that the current screen is shown is read in real time.
Wherein, the computing unit includes：
First computation subunit, for obtaining position of the GUI image in the UI；
Obtain subelement, the relative position relation for obtaining the UI and the current screen；
Second computation subunit, for according to position of the GUI image in the UI and the UI with it is described current
The relative position relation of screen, calculates the GUI in the display location of the current screen.
The beneficial effect that technical scheme provided in an embodiment of the present invention is brought is：By obtaining the to be measured of software under testing in advance
The GUI image of non-standard control；According to the GUI image of the non-standard control to be measured obtained in advance, determine described to be measured non-
Actual displayed position of the GUI image of standard control in current screen；In the actual displayed position, analog subscriber is to described
The GUI image of non-standard control to be measured is operated, to test the non-standard control to be measured；Due to the GUI of non-standard control
Image is easily obtained, and the physical location of non-standard control is determined according to the GUI image of non-standard control, can mitigate automation
The burden of test, improves the efficiency of automatic test, saves resource.
Brief description of the drawings
Technical scheme in order to illustrate the embodiments of the present invention more clearly, makes required in being described below to embodiment
Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for
For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings
Accompanying drawing.
Fig. 1 is the schematic diagram of the relation between UI, GUI element and the control three provided in the embodiment of the present invention；
Fig. 2 is a kind of flow chart of the non-standard control automated testing method provided in the embodiment of the present invention 1；
Fig. 3 is a kind of flow chart of the non-standard control automated testing method provided in the embodiment of the present invention 2；
Fig. 4 is a kind of schematic diagram of the non-standard control automatic test device provided in the embodiment of the present invention 3；
Fig. 5 is a kind of schematic diagram of the non-standard control automatic test device provided in the embodiment of the present invention 4.
Embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to embodiment party of the present invention
Formula is described in further detail.
For ease of the understanding to the technical scheme described by embodiment of the present invention, referring to Fig. 1, first to UI, GUI element
Relation between control three is introduced.Wherein, UI includes many visual interface graphic elements.GUI element is UI
Including interface graphic element in it is a kind of, be presented as specific graphic designs.Control is a kind of method encapsulation, and UI is designer
Created according to some controls.Specifically, the different control of each GUI element correspondence.After the application of user's runs software, it is exactly based on
Visual GUI element operates each control, so as to use software application.
Embodiment 1
Referring to Fig. 2, the embodiment of the present invention 1 provides a kind of non-standard control automated testing method, and this method includes：
101：The GUI image of the non-standard control to be measured of software under testing is obtained in advance.
102：According to the GUI image of the non-standard control to be measured obtained in advance, the GUI figures of the non-standard control to be measured are determined
As the actual displayed position in current screen.
103：In the actual displayed position, analog subscriber is operated to the GUI image of non-standard control to be measured, to test
Non-standard control to be measured.
The beneficial effect that technical scheme provided in an embodiment of the present invention is brought is：By obtaining the to be measured of software under testing in advance
The GUI image of non-standard control；According to the GUI image of the non-standard control to be measured obtained in advance, determine described to be measured non-
Actual displayed position of the GUI image of standard control in current screen；In the actual displayed position, analog subscriber is to described
The GUI image of non-standard control to be measured is operated, to test the non-standard control to be measured；Due to the GUI of non-standard control
Image is easily obtained, and the physical location of non-standard control is determined according to the GUI image of non-standard control, can mitigate automation
The burden of test, improves the efficiency of automatic test, saves resource.
Embodiment 2
Referring to Fig. 3, the embodiment of the present invention 2 provides a kind of non-standard control automated testing method, and this method includes：
201：The GUI image of the non-standard control to be measured of software under testing is obtained in advance.
Wherein, tester intends to carry out non-standard components testing to certain software.Tester should first obtain software under testing
In non-standard control to be measured GUI image.
Further, the mode of acquisition includes two kinds, the first, obtained by the UI resources bag of software under testing.Tester
Member matches the GUI image of non-standard control to be measured from the UI resource bags of software under testing, after the match is successful, directly schemes the GUI
As export.
Second, obtained by image aid.First, tester should by clicking on icon or other modes startup
Software.After the software is activated, a series of UI will be shown in desktop in real time, so that the programmed logic of the software is presented.Secondly, survey
Examination people finder and the GUI image for obtaining non-standard control to be measured.Specifically, it is assumed that the UI that current screen is shown includes to be measured non-
GUI image corresponding to standard control.The UI that tester's reading current screen is shown, range estimation is right to non-standard control institute to be measured
After the GUI image answered, by image aid with sectional drawing by way of obtain the GUI image of non-standard control to be measured.
Wherein, after the GUI image for obtaining non-standard control to be measured, by GUI image storage into server database.Specifically
Ground, the GUI image of storage is the picture file of PNG format.
202：According to the GUI image of the non-standard control to be measured obtained in advance, the GUI figures of the non-standard control to be measured are determined
As the actual displayed position in current screen.
Further, this step includes：
2021：Pre-set the screen area that the GUI image is shown in screen.
Wherein, the screen area for showing the GUI image is that the GUI image is by after screen display, and the GUI image is in screen
On physical location region.Specifically, screen area is made up of substantial amounts of screen coordinate information.Further, screen coordinate is believed
The acquisition of breath can be completed by technology well known in the art, will not be described in detail herein.
What deserves to be explained is, in the embodiment of the present invention 2, the size of screen area will not limited.The maximum of screen area
It is worth for full screen；The minimum value of screen area is the screen area shared by the corresponding GUI image of standard control to be measured.It is preferred that
Ground, shows the screen area that the screen area of GUI image UI where showing the GUI image takes.
2022：Start the software under testing, current screen is shown the UI of the software under testing.
Specifically, as described in 201, tester starts the software under testing by clicking on icon or other modes, makes to work as
Forth screen shows the UI of the software under testing.
What deserves to be explained is, 2021 and 2022 execution sequence is only preferred order in the embodiment of the present invention 2.It is actual to answer
In, 2021 and 2022 priority execution sequence will not be limited, 2021 and 2022 can perform simultaneously.
2023：In the screen area of setting, the UI for the software under testing that current screen is shown is read in real time.
Wherein, it is synchronous to read screen display in the screen area set when current screen shows the UI of the software under testing
Software under testing UI.Specifically, it is read out in the way of scan image.
2024：According to the GUI image of acquisition, search in the UI of the software under testing and whether there is and the GUI image identical
Image.
If in the presence of performing 2025；If being not present, it is judged as that current screen does not show the GUI image, performs 2023.
Wherein, searched for by image recognition technology in the screen area of setting and whether there is phase in the UI of the software under testing
Same GUI image.Specifically, using the GUI image of acquisition and the UI of screen display as two width figures, then using corresponding image
Identification technology is matched to two images.The content of images match includes pixel, profile and brightness etc..If in screen display
GUI image is matched in UI, then performs 2025；If not matching GUI image in the UI of screen display, 2023 are performed.
Further, foregoing image recognition technology includes SIFT (Scale Invariant Feature
Transform) algorithm.SIFT algorithms are based on metric space, image scaling, rotation even affine transformation are maintained the invariance
Image local feature algorithm.Occur translation, rotation, affine situation of change between can handling two images by SITF algorithms
Under matching problem, or even the image shot to any angle also possesses the characteristic matching ability of more temperature.This is at image
Technology is known in reason field, will not be described in detail herein.
2025：Obtain the UI of the GUI image for the non-standard control to be measured that the presence shown in current screen is obtained in advance.
Wherein, if in the UI of the software under testing exist with the GUI image identical image, obtain current screen in show
The UI of the GUI image of non-standard control to be measured that obtains in advance of presence.Specifically, it can be obtained by the way of snapshot in the presence of pre-
The UI of the GUI image of the non-standard control to be measured first obtained.
2026：According to the UI, the GUI image is calculated in the actual displayed position of current screen.
Further, this step includes：
2026a：UI and the relative position relation of current screen that acquisition current screen is shown.
Wherein, the UI that current screen is shown is actually the forms that current screen is shown.Usually, will when designing UI
Respective coordinates system, setting UI size attribute, including distance value of the forms away from screen coboundary (top) and left margin (left),
Forms width (width) in itself and height (height).And coordinate system be from the upper left corner of screen be origin, be to the right X-axis,
It is Y-axis downwards.Therefore, the UI and the relative position relation of current screen that acquisition current screen is shown are specifically included, and first, are obtained
The ID for the UI that current screen is shown；Secondly, according to UI ID, the UI is pulled from UI attributes away from screen coboundary and left margin
Distance value；Then, it regard the distance value as UI and the relative position relation of current screen.
2026b：Calculate position of the GUI image in the UI that current screen is shown.
Wherein, position of the GUI image in UI, is embodied as, position of the subgraph in master image.Specifically, it is first
First, the pixel value range of GUI image is obtained；Secondly, UI is subjected to pixel distribution；Then, in UI pixel distribution, picture is passed through
Element value is compared, and obtains position of the pixel value range of GUI image in UI.This is that image processing field knows technology, herein not
It is described in detail again.
2026c：The UI and the relative position relation of current screen shown according to current screen, calculates the GUI current
The display location of screen.
Specifically, first, the UI and the relative position relation of current screen shown according to current screen, by UI pixel point
Cloth is mapped to screen coordinate one by one；Then, the position according to the pixel value range of GUI image in UI, obtains the picture of GUI image
The corresponding screen coordinate of element value scope；The screen coordinate is screen coordinate of the GUI image in current screen.
203：In the actual displayed position, analog subscriber is operated to the GUI image of non-standard control to be measured, to test
Non-standard control to be measured.
Wherein, behind positioning to actual displayed position of the GUI image in current screen, analog subscriber is schemed to the GUI
As being operated.Further, by taking the non-standard control of button as an example, the test content of non-standard control is briefly described.For this
The non-standard control of button, analog subscriber is clicked or double-clicked to the GUI image of the control, checks the sound that the button is obtained
Should.Specifically, just whether tester will combine the design documentation of the software under testing, according to the design documentation requirements verification response
Really.Whether forms are ejected for example, clicking on；Click in forms after cancel button, whether forms close；Text input value is
During null, whether the prompting state of button is correct；Or, can click button submit page data and close page forms etc..Its
In, specific test operation flow is completed by predefined test case.Predefined test case is presented as specific script journey
Sequence.This is prior art, be will not be described in detail herein.
The beneficial effect that technical scheme provided in an embodiment of the present invention is brought is：By obtaining the to be measured of software under testing in advance
The GUI image of non-standard control；According to the GUI image of the non-standard control to be measured obtained in advance, determine described to be measured non-
Actual displayed position of the GUI image of standard control in current screen；In the actual displayed position, analog subscriber is to described
The GUI image of non-standard control to be measured is operated, to test the non-standard control to be measured；Due to the GUI of non-standard control
Image is easily obtained, and the physical location of non-standard control is determined according to the GUI image of non-standard control, can mitigate automation
The burden of test, improves the efficiency of automatic test, saves resource.
Embodiment 3
Referring to Fig. 4, the embodiment of the present invention 3 provides a kind of non-standard control automatic test device, and the device includes：
Acquisition module 301, the GUI image of the non-standard control to be measured for obtaining software under testing in advance.
Determining module 302, for the GUI image according to the non-standard control to be measured obtained in advance, determines that this is to be measured nonstandard
Actual displayed position of the GUI image of quasi- control in current screen.
Analog module 303, in the actual displayed position, analog subscriber to enter to the GUI image of non-standard control to be measured
Row operation, to test non-standard control to be measured.
The beneficial effect that technical scheme provided in an embodiment of the present invention is brought is：By obtaining the to be measured of software under testing in advance
The GUI image of non-standard control；According to the GUI image of the non-standard control to be measured obtained in advance, determine described to be measured non-
Actual displayed position of the GUI image of standard control in current screen；In the actual displayed position, analog subscriber is to described
The GUI image of non-standard control to be measured is operated, to test the non-standard control to be measured；Due to the GUI of non-standard control
Image is easily obtained, and the physical location of non-standard control is determined according to the GUI image of non-standard control, can mitigate automation
The burden of test, improves the efficiency of automatic test, saves resource.
Embodiment 4
Referring to Fig. 5, the embodiment of the present invention 4 provides a kind of non-standard control automatic test device, and the device includes：
Acquisition module 401, the GUI image of the non-standard control to be measured for obtaining software under testing in advance.
Determining module 402, for the GUI image according to the non-standard control to be measured obtained in advance, determines that this is to be measured nonstandard
Actual displayed position of the GUI image of quasi- control in current screen.
Wherein it is determined that module 402 includes：
Start unit 4021, for starting software under testing, makes current screen show the UI of software under testing.
Acquiring unit 4022, the non-standard control to be measured that the presence shown for obtaining in current screen is obtained in advance
The UI of GUI image.
Computing unit 4023, for according to the UI, calculating GUI image in the actual displayed position of current screen.
Wherein, computing unit 4023 includes：
First computation subunit 4023a, for obtaining position of the GUI image in UI.
Obtain subelement 4023b, the relative position relation for obtaining UI and current screen.
Second computation subunit 4023c, for according to the relative of position of the GUI image in UI and UI and current screen
Position relationship, calculates GUI in the display location of current screen.
Wherein it is determined that module 402 also includes：
Reading unit 4024, the UI for reading the software under testing that current screen is shown in real time.
Search unit 4025, for according to GUI image, searching in the UI of software under testing with the presence or absence of identical with GUI image
Image.
Correspondingly, acquiring unit 4022 is additionally operable to, if in the presence of what the presence shown in acquisition current screen was obtained in advance
The UI of the GUI image of non-standard control to be measured.
Correspondingly, reading unit 4024 is additionally operable to, if being not present, and continues to read the software under testing that current screen is shown
UI。
Wherein it is determined that module 402 also includes：
Setting unit 4026, the screen area of GUI image is shown for pre-setting in screen.
Correspondingly, reading unit 4024 is used for,
In screen area, the UI for the software under testing that current screen is shown is read in real time.
Analog module 403, in the actual displayed position, analog subscriber to enter to the GUI image of non-standard control to be measured
Row operation, to test non-standard control to be measured.
The beneficial effect that technical scheme provided in an embodiment of the present invention is brought is：By obtaining the to be measured of software under testing in advance
The GUI image of non-standard control；According to the GUI image of the non-standard control to be measured obtained in advance, determine described to be measured non-
Actual displayed position of the GUI image of standard control in current screen；In the actual displayed position, analog subscriber is to described
The GUI image of non-standard control to be measured is operated, to test the non-standard control to be measured；Due to the GUI of non-standard control
Image is easily obtained, and the physical location of non-standard control is determined according to the GUI image of non-standard control, can mitigate automation
The burden of test, improves the efficiency of automatic test, saves resource.
It should be noted that：Above-described embodiment provide automatic test device when testing non-standard control,
Only with the division progress of above-mentioned each functional module for example, in practical application, as needed can distribute above-mentioned functions
Completed by different functional modules, i.e., the internal structure of equipment is divided into different functional modules, it is described above to complete
All or part of function.In addition, the automatic test device that above-described embodiment is provided belongs to automated testing method embodiment
In same design, it implements process and refers to embodiment of the method, repeats no more here.
The embodiments of the present invention are for illustration only, and the quality of embodiment is not represented.
One of ordinary skill in the art will appreciate that realizing that all or part of step of above-described embodiment can be by hardware
To complete, the hardware of correlation can also be instructed to complete by program, described program can be stored in a kind of computer-readable
In storage medium, storage medium mentioned above can be read-only storage, disk or CD etc..
The foregoing is only presently preferred embodiments of the present invention, be not intended to limit the invention, it is all the present invention spirit and
Within principle, any modification, equivalent substitution and improvements made etc. should be included in the scope of the protection.
Claims (8)
1. a kind of non-standard control automated testing method, it is characterised in that methods described includes：
The graphical user interface image of the non-standard control to be measured of software under testing is obtained in advance；
According to the graphical user interface image of the non-standard control to be measured obtained in advance, the non-standard control to be measured is determined
Actual displayed position of the graphical user interface image in current screen：Start the software under testing, make the current screen
Show the user interface of the software under testing；Obtain obtained in advance described in the presence shown in the current screen described to be measured
The user interface of the graphical user interface image of non-standard control；According to the user interface, calculate described image user and connect
Mouth image is in the actual displayed position of the current screen；
In the actual displayed position, analog subscriber is grasped to the graphical user interface image of the non-standard control to be measured
Make, to test the non-standard control to be measured.
2. the method as described in claim 1, it is characterised in that pre- described in the presence shown in the acquisition current screen
Before the user interface of the graphical user interface image of the non-standard control to be measured first obtained, in addition to：
The user interface for the software under testing that the current screen is shown is read in real time；
According to described image user interface image, search for whether there is in the user interface of the software under testing and used with described image
Family interface image identical image；
If being not present, continue to read the user interface for the software under testing that the current screen is shown.
3. method as claimed in claim 2, it is characterised in that methods described also includes：
Pre-set the screen area that described image user interface image is shown in screen；
Correspondingly, it is described read the software under testing that the current screen is shown in real time user interface be,
In the screen area, the user interface for the software under testing that the current screen is shown is read in real time.
4. the method as described in claim 1, it is characterised in that described according to the user interface, calculates described image use
Family interface image in the actual displayed position of the current screen, including：
Calculate position of the described image user interface image in the user interface；
Obtain the relative position relation of the user interface and the current screen；
According to position of the described image user interface image in the user interface and the user interface and the current screen
The relative position relation of curtain, calculates described image user interface in the display location of the current screen.
5. a kind of non-standard control automatic test device, it is characterised in that described device includes：
Acquisition module, the graphical user interface image of the non-standard control to be measured for obtaining software under testing in advance；
Determining module, for the graphical user interface image according to the non-standard control to be measured obtained in advance, it is determined that described
Actual displayed position of the graphical user interface image of non-standard control to be measured in current screen；The determining module includes：
Start unit, for starting the software under testing, makes the current screen show the user interface of the software under testing；Obtain single
Member, the Graphical User of the non-standard control to be measured obtained in advance described in the presence shown in the current screen for obtaining
The user interface of interface image；Computing unit, exists for according to the user interface, calculating described image user interface image
The actual displayed position of the current screen；
Analog module, in the actual displayed position, analog subscriber to connect to the Graphical User of the non-standard control to be measured
Mouth image is operated, to test the non-standard control to be measured.
6. device as claimed in claim 5, it is characterised in that the determining module also includes：
Reading unit, the user interface for reading the software under testing that the current screen is shown in real time；
Search unit, for according to described image user interface image, whether being deposited in the user interface for searching for the software under testing
With described image user interface image identical image；
Correspondingly, the reading unit is additionally operable to,
If being not present, continue to read the user interface for the software under testing that the current screen is shown.
7. device as claimed in claim 6, it is characterised in that the determining module also includes：
Setting unit, the screen area of described image user interface image is shown for pre-setting in screen；
Correspondingly, the reading unit is used for,
In the screen area, the user interface for the software under testing that the current screen is shown is read in real time.
8. device as claimed in claim 5, it is characterised in that the computing unit includes：
First computation subunit, for obtaining position of the described image user interface image in the user interface；
Obtain subelement, the relative position relation for obtaining the user interface and the current screen；
Second computation subunit, for according to position of the described image user interface image in the user interface and described
User interface and the relative position relation of the current screen, calculate described image user interface in the aobvious of the current screen
Show position.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210121186.7A CN103377119B (en) | 2012-04-23 | 2012-04-23 | A kind of non-standard control automated testing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210121186.7A CN103377119B (en) | 2012-04-23 | 2012-04-23 | A kind of non-standard control automated testing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103377119A CN103377119A (en) | 2013-10-30 |
| CN103377119B true CN103377119B (en) | 2017-07-25 |
Family
ID=49462269
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210121186.7A Active CN103377119B (en) | 2012-04-23 | 2012-04-23 | A kind of non-standard control automated testing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103377119B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104636248B (en) * | 2013-11-13 | 2018-01-16 | 航天信息股份有限公司 | A kind of automatic test based on code injection assists in identifying method |
| CN103823758A (en) * | 2014-03-13 | 2014-05-28 | 北京金山网络科技有限公司 | Browser testing method and device |
| CN105204984B (en) * | 2014-06-17 | 2018-08-17 | 腾讯科技（深圳）有限公司 | A kind of owner-drawing control test method and device |
| CN105302715B (en) * | 2014-07-30 | 2019-05-24 | 腾讯科技（深圳）有限公司 | The acquisition methods and device of application program user interface |
| CN104268006B (en) * | 2014-10-27 | 2017-10-10 | 北京奇虎科技有限公司 | The back method and device of key mouse script |
| CN104391797B (en) * | 2014-12-09 | 2017-11-10 | 北京奇虎科技有限公司 | The recognition methods of GUI controls and device |
| CN104503778A (en) * | 2014-12-09 | 2015-04-08 | 北京奇虎科技有限公司 | Installation method and installation device for applications |
| CN104778121B (en) * | 2015-03-25 | 2018-09-18 | 网易（杭州）网络有限公司 | The test method of games, apparatus and system |
| CN104915053B (en) * | 2015-05-04 | 2018-04-13 | 北京奇艺世纪科技有限公司 | The location determining method and device of a kind of interface control |
| CN108509342A (en) * | 2018-04-04 | 2018-09-07 | 成都中云天下科技有限公司 | A kind of precisely quick App automated testing methods |
| CN109542440A (en) * | 2018-11-29 | 2019-03-29 | 金蝶软件（中国）有限公司 | To the operating method and device of window, computer installation and readable storage medium storing program for executing |
| CN109614169B (en) * | 2018-12-29 | 2022-03-15 | 上海上讯信息技术股份有限公司 | Automatic operation method of Windows client application program based on pixel coordinate mode |
| CN111913868B (en) * | 2019-05-07 | 2023-08-04 | 杭州海康威视数字技术股份有限公司 | User interface testing method, device, system and storage medium |
| CN110347585B (en) * | 2019-05-28 | 2023-06-06 | 成都美美臣科技有限公司 | UI (user interface) automatic test picture identification method |
| CN112882928B (en) * | 2021-02-02 | 2023-03-31 | 中国汽车技术研究中心有限公司 | Automatic testing method and system for touch screen of intelligent cabin of automobile |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101634952A (en) * | 2009-08-20 | 2010-01-27 | 中兴通讯股份有限公司 | Interface inputting method of simulation input device |
| CN101964062A (en) * | 2010-09-14 | 2011-02-02 | 北京神州泰岳软件股份有限公司 | Image searching method based on user interface |
| CN101996131A (en) * | 2009-08-19 | 2011-03-30 | 航天信息股份有限公司 | Automatic test method and automatic test platform for graphic user interface (GUI) based on x extensive makeup language (XML) packaging key word |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9049146B2 (en) * | 2008-10-22 | 2015-06-02 | Accenture Global Services Limited | Automatically connecting remote network equipment through a graphical user interface |
-
2012
- 2012-04-23 CN CN201210121186.7A patent/CN103377119B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101996131A (en) * | 2009-08-19 | 2011-03-30 | 航天信息股份有限公司 | Automatic test method and automatic test platform for graphic user interface (GUI) based on x extensive makeup language (XML) packaging key word |
| CN101634952A (en) * | 2009-08-20 | 2010-01-27 | 中兴通讯股份有限公司 | Interface inputting method of simulation input device |
| CN101964062A (en) * | 2010-09-14 | 2011-02-02 | 北京神州泰岳软件股份有限公司 | Image searching method based on user interface |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103377119A (en) | 2013-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103377119B (en) | A kind of non-standard control automated testing method and device | |
| US11604663B2 (en) | Detection of user interface controls via invariance guided sub-control learning | |
| WO2016062159A1 (en) | Image matching method and platform for testing of mobile phone applications | |
| US8751969B2 (en) | Information processor, processing method and program for displaying a virtual image | |
| US9311756B2 (en) | Image group processing and visualization | |
| CN107818290B (en) | Heuristic finger detection method based on depth map | |
| WO2015074521A1 (en) | Devices and methods for positioning based on image detection | |
| US8897598B1 (en) | Mosaicing documents for translation using video streams | |
| CN112150551B (en) | Object pose acquisition method and device and electronic equipment | |
| US20140351718A1 (en) | Information processing device, information processing method, and computer-readable medium | |
| CN104268083B (en) | Automatic software test method and device | |
| CN105589801B (en) | Mobile phone cluster test method and system | |
| CN115061769B (en) | Self-iteration RPA interface element matching method and system for supporting cross-resolution | |
| CN109783351A (en) | Interface detection method, apparatus and computer readable storage medium | |
| WO2022222510A1 (en) | Interaction control method, terminal device, and storage medium | |
| CN106919326A (en) | A kind of image searching method and device | |
| CN105354138A (en) | Method for determining specific control attribute of mobile phone page | |
| CN102622233A (en) | System and method for automatically generating user interface applicable to certain interactive terminal equipment | |
| CN111651368B (en) | User graphical interface testing method and computer readable storage medium | |
| CN116881515B (en) | Method and electronic equipment for comparing capacitance results solved by different algorithms | |
| CN108845924B (en) | Control response area display control method, electronic device, and storage medium | |
| US20240004541A1 (en) | Content Extraction Method, Electronic Device and Medium | |
| CN110956131B (en) | Single-target tracking method, device and system | |
| CN108984097B (en) | Touch operation method and device, storage medium and electronic equipment | |
| CN111368674B (en) | Image recognition method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |