CN103377119A - Automatic nonstandard control testing method and device - Google Patents
Automatic nonstandard control testing method and device Download PDFInfo
- Publication number
- CN103377119A CN103377119A CN2012101211867A CN201210121186A CN103377119A CN 103377119 A CN103377119 A CN 103377119A CN 2012101211867 A CN2012101211867 A CN 2012101211867A CN 201210121186 A CN201210121186 A CN 201210121186A CN 103377119 A CN103377119 A CN 103377119A
- Authority
- CN
- China
- Prior art keywords
- user interface
- standard control
- current screen
- measured
- graphical user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an automatic nonstandard control testing method and device and belongs to the field of computers. The automatic nonstandard control testing method includes acquiring an image user interface image of a nonstandard control to be tested of software to be tested in advance; determining the practical display position of the image user interface image of the nonstandard control to be tested in a current screen according to the image user interface image of the nonstandard control to be tested acquired in advance; simulating users to operate the image user interface image of the nonstandard control to be tested at the practical display position so as to test the nonstandard control to be tested. The automatic nonstandard control testing device comprises an acquiring module, a determining module and a simulating module. The automatic nonstandard control testing method and device can save resources.
Description
Technical field
The present invention relates to computer realm, particularly a kind of non-standard control automated testing method and device.
Background technology
The object of UI (User Interface, user interface) automatic test mainly comprises the control based on GUI (Graphical User Interface, graphical user interface), such as button, text box and check box etc.Control is divided into standard control and non-standard control.Standard control is provided by the API (Application Programming Interface, application programming interface) of operating system; Non-standard control is then drawn voluntarily by each applications providers.
At present, most of UI automated test tool is only supported the testing standard control, and can't test non-standard control.This is to realize by API because of these UI automated test tools, can only identify the standard control that API provides.For non-standard control is tested, existing test mode adopts virtual objects to locate non-standard control.Wherein, this virtual objects is the virtual objects that the need that set in advance are tested non-standard control.Particularly, existing test mode comprises that at first, catching needs the zone at test interface, non-standard control place that virtual objects is set, and the information such as the stop of relative set virtual objects and Dimension Types; Secondly, according to virtual objects information, screen coordinate information and interface coordinate, the coordinate of dynamic calculation virtual objects in the interface; Then, according to this coordinate virtual objects is identified and operated; At last, check execution result, whether unanimously with expected results verify.
In realizing process of the present invention, the inventor finds that there is following problem at least in prior art:
Prior art needs the coordinate of dynamic calculation virtual objects in the interface, when the non-standard control quantity of need test is many, the corresponding increase of virtual objects quantity that needs setting and safeguard, it is large that the workload of dynamic calculation coordinate also becomes thereupon, with increasing the burden of automatic test, cause the waste of resource.
Summary of the invention
For saving resource, and non-standard control carried out the UI automatic test, the embodiment of the invention provides a kind of non-standard control automated testing method and device.Described technical scheme is as follows:
A kind of non-standard control automated testing method, described method comprises:
Obtain in advance the GUI image of the non-standard control to be measured of software under testing;
According to the GUI image of the described non-standard control to be measured that obtains in advance, determine the actual displayed position of GUI image in current screen of described non-standard control to be measured;
In described actual displayed position, analog subscriber operates the GUI image of described non-standard control to be measured, to test described non-standard control to be measured.
Wherein, described GUI image according to the described non-standard control to be measured that obtains in advance, determine the actual displayed position of GUI image in current screen of described non-standard control to be measured to comprise:
Start described software under testing, make described current screen show the UI of described software under testing;
Obtain the UI of the GUI image that has the described described non-standard control to be measured that obtains in advance that shows in the described current screen;
According to described UI, calculate described GUI image in the actual displayed position of described current screen.
Wherein, before the described UI that obtains the GUI image that has the described described non-standard control to be measured that obtains in advance that shows in the described current screen, also comprise:
Read in real time the UI of the described software under testing of described current screen demonstration;
According to described GUI image, search among the UI of described software under testing whether have the image identical with described GUI image;
If do not exist, then continue to read the UI of the described software under testing that described current screen shows.
Wherein, described method also comprises:
Set in advance the screen area that shows described GUI image in the screen;
Correspondingly, the described UI that reads in real time the described software under testing that described current screen shows is,
In described screen area, read in real time the UI of the described software under testing of described current screen demonstration.
Wherein, described according to described UI, calculate described GUI image in the actual displayed position of described current screen, comprising:
Calculate the position of described GUI image in described UI;
Obtain the relative position relation of described UI and described current screen;
According to the position of described GUI image in described UI, and the relative position relation of described UI and described current screen, calculate described GUI at the display position of described current screen.
A kind of non-standard control automatic test device, described device comprises:
Acquisition module is for the GUI image that obtains in advance the non-standard control to be measured of software under testing;
Determination module is used for the GUI image according to the described non-standard control to be measured that obtains in advance, determines the actual displayed position of GUI image in current screen of described non-standard control to be measured;
Analog module is used in described actual displayed position, and analog subscriber operates the GUI image of described non-standard control to be measured, to test described non-standard control to be measured.
Wherein, described determination module comprises:
Start unit is used for starting described software under testing, makes described current screen show the UI of described software under testing;
Acquiring unit is used for obtaining the UI of the GUI image that has the described described non-standard control to be measured that obtains in advance that described current screen shows;
Computing unit is used for according to described UI, calculates described GUI image in the actual displayed position of described current screen.
Wherein, described determination module also comprises:
Reading unit is for the UI of the described software under testing that reads in real time described current screen demonstration;
Search unit is used for according to described GUI image, searches among the UI of described software under testing whether have the image identical with described GUI image;
Correspondingly, described reading unit also is used for,
If do not exist, then continue to read the UI of the described software under testing that described current screen shows.
Wherein, described determination module also comprises:
Setting unit is used for setting in advance the screen area that screen shows described GUI image;
Correspondingly, described reading unit is used for,
In described screen area, read in real time the UI of the described software under testing of described current screen demonstration.
Wherein, described computing unit comprises:
The first computation subunit is used for obtaining described GUI image in the position of described UI;
Obtain subelement, be used for obtaining the relative position relation of described UI and described current screen;
The second computation subunit, be used for according to described GUI image in the position of described UI, and the relative position relation of described UI and described current screen, calculate described GUI at the display position of described current screen.
The beneficial effect that the technical scheme that the embodiment of the invention provides is brought is: the GUI image of the non-standard control to be measured by obtaining in advance software under testing; According to the GUI image of the described non-standard control to be measured that obtains in advance, determine the actual displayed position of GUI image in current screen of described non-standard control to be measured; In described actual displayed position, analog subscriber operates the GUI image of described non-standard control to be measured, to test described non-standard control to be measured; Because the GUI image of non-standard control obtains easily, determine the physical location of non-standard control according to the GUI image of non-standard control, can alleviate the burden of automatic test, the efficient of raising automatic test, saving resource.
Description of drawings
In order to be illustrated more clearly in the technical scheme in the embodiment of the invention, the accompanying drawing of required use was done to introduce simply during the below will describe embodiment, apparently, accompanying drawing in the following describes only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the synoptic diagram of the relation between UI, GUI element and the control three who provides in the embodiment of the invention;
Fig. 2 is the process flow diagram of a kind of non-standard control automated testing method that provides in the embodiment of the invention 1;
Fig. 3 is the process flow diagram of a kind of non-standard control automated testing method that provides in the embodiment of the invention 2;
Fig. 4 is the synoptic diagram of a kind of non-standard control automatic test device that provides in the embodiment of the invention 3;
Fig. 5 is the synoptic diagram of a kind of non-standard control automatic test device that provides in the embodiment of the invention 4.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, embodiment of the present invention is described further in detail below in conjunction with accompanying drawing.
For ease of the understanding to the described technical scheme of embodiment of the present invention, referring to Fig. 1, at first the relation between UI, GUI element and the control three is introduced.Wherein, UI comprises a lot of visual interfaces graphic element.The GUI element is a kind of in the interface graphic element that comprises of UI, is presented as concrete graphic designs.Control is the encapsulation of a kind of method, and UI is that the deviser creates according to some controls.Particularly, control corresponding to each GUI element.User's operating software usually operates each control by visual GUI unit just, thereby software application is used after using.
Embodiment 1
Referring to Fig. 2, the embodiment of the invention 1 provides a kind of non-standard control automated testing method, and the method comprises:
101: the GUI image that obtains in advance the non-standard control to be measured of software under testing.
102: according to the GUI image of the non-standard control to be measured that obtains in advance, determine the actual displayed position of GUI image in current screen of this non-standard control to be measured.
103: in this actual displayed position, analog subscriber operates the GUI image of non-standard control to be measured, to test non-standard control to be measured.
The beneficial effect that the technical scheme that the embodiment of the invention provides is brought is: the GUI image of the non-standard control to be measured by obtaining in advance software under testing; According to the GUI image of the described non-standard control to be measured that obtains in advance, determine the actual displayed position of GUI image in current screen of described non-standard control to be measured; In described actual displayed position, analog subscriber operates the GUI image of described non-standard control to be measured, to test described non-standard control to be measured; Because the GUI image of non-standard control obtains easily, determine the physical location of non-standard control according to the GUI image of non-standard control, can alleviate the burden of automatic test, the efficient of raising automatic test, saving resource.
Embodiment 2
Referring to Fig. 3, the embodiment of the invention 2 provides a kind of non-standard control automated testing method, and the method comprises:
201: the GUI image that obtains in advance the non-standard control to be measured of software under testing.
Wherein, the tester plans certain software is carried out non-standard control test.The tester should obtain first the GUI image of non-standard control to be measured in the software under testing.
Further, the mode of obtaining comprises two kinds, the first, and the UI resource bag by software under testing obtains.The tester is mated the GUI image of non-standard control to be measured from the UI resource bag of software under testing, after the match is successful, directly this GUI image is derived.
The second obtains by the image aid.At first, the tester starts this software by clickable icon or other modes.After this software is activated, will show a series of UI at desktop in real time, to present the programmed logic of this software.Secondly, the tester searches and obtains the GUI image of non-standard control to be measured.Particularly, suppose that the UI that current screen shows comprises the corresponding GUI image of non-standard control to be measured.The tester UI that current screen shows that reads, range estimation will be obtained by the image aid GUI image of non-standard control to be measured in the mode of sectional drawing behind the corresponding GUI image of non-standard control to be measured.
Wherein, obtain the GUI image of non-standard control to be measured after, the GUI image is stored in the server database.Particularly, the GUI image of storage is the picture file of PNG form.
202: according to the GUI image of the non-standard control to be measured that obtains in advance, determine the actual displayed position of GUI image in current screen of this non-standard control to be measured.
Further, this step comprises:
2021: set in advance the screen area that shows this GUI image in the screen.
Wherein, show that the screen area of this GUI image is, this GUI image by screen display after, the physical location zone of this GUI image on screen.Particularly, screen area is comprised of a large amount of screen coordinate information.Further, obtaining of screen coordinate information can be finished by technology well known in the art, is not described in detail in this.
What deserves to be explained is, in the embodiment of the invention 2, will not limit the size of screen area.The maximal value of screen area is full screen; The minimum value of screen area is the shared screen area of GUI image corresponding to standard control to be measured.Preferably, the screen area of screen area for showing that this GUI image place UI takies that shows this GUI image.
2022: start this software under testing, make current screen show the UI of this software under testing.
Particularly, described in 201, the tester starts this software under testing by clickable icon or other modes, makes current screen show the UI of this software under testing.
What deserves to be explained is that 2021 and 2022 execution sequence only is preferred order in the embodiment of the invention 2.In the practical application, with the priority execution sequence that does not limit 2021 and 2022,2021 and 2022 can carry out simultaneously.
2023: in the screen area that arranges, read in real time the UI of the software under testing of current screen demonstration.
Wherein, when current screen shows the UI of this software under testing, read synchronously the UI of the software under testing of screen display in the screen area of setting.Particularly, the mode with scan image reads.
2024: according to the GUI image that obtains, search among the UI of this software under testing whether have the image identical with this GUI image.
If exist, then carry out 2025; If do not exist, then be judged as current screen and do not show this GUI image, carry out 2023.
Wherein, whether there is identical GUI image among the UI by image recognition technology this software under testing of search in the screen area that arranges.Particularly, as two width of cloth figure, then adopt corresponding image recognition technology that two width of cloth images are mated the UI of the GUI image that obtains and screen display.The content of images match comprises pixel, profile and brightness etc.If in the UI of screen display, match the GUI image, then carry out 2025; If in the UI of screen display, do not match the GUI image, then carry out 2023.
Further, aforesaid image recognition technology comprises SIFT (Scale Invariant Feature Transform) algorithm.The SIFT algorithm is for based on image local feature algorithm metric space, that image scaling, rotation even affined transformation are maintained the invariance.Can process the matching problem that occurs between two width of cloth images under translation, rotation, the affine situation of change by the SITF algorithm, even the image of arbitrarily angled shooting is also possessed the comparatively characteristic matching ability of temperature.This knows technology for image processing field, is not described in detail in this.
2025: the UI that obtains the GUI image of the non-standard control to be measured that the existence that shows in the current screen obtains in advance.
Wherein, if there be the image identical with this GUI image among the UI of this software under testing, then obtain the UI of the GUI image of the non-standard control to be measured that the existence that shows in the current screen obtains in advance.Particularly, can adopt the mode of snapshot to obtain the UI of the GUI image of the non-standard control to be measured that existence obtains in advance.
2026: according to this UI, calculate this GUI image in the actual displayed position of current screen.
Further, this step comprises:
2026a: obtain the UI of current screen demonstration and the relative position relation of current screen.
Wherein, the UI of current screen demonstration is actually the forms that current screen shows.Usually, when design UI, with respective coordinates system, the size attribute of UI is set, comprises that forms are apart from the distance value of screen coboundary (top) and left margin (left), width (width) and the height (height) of forms itself.Being initial point and coordinate system is the upper left corner from screen, is to the right X-axis, is downwards Y-axis.Therefore, obtain the UI of current screen demonstration and the relative position relation of current screen and specifically comprise, at first, obtain the ID of the UI of current screen demonstration; Secondly, according to the ID of UI, from the UI attribute, pull this UI apart from the distance value of screen coboundary and left margin; Then, with the relative position relation of this distance value as UI and current screen.
2026b: calculate the position of this GUI image in the UI that current screen shows.
Wherein, the position of GUI image in UI is embodied as, the position of subimage in master image.Particularly, at first, obtain the pixel value scope of GUI image; Secondly, UI is carried out pixel distribution; Then, in the pixel distribution of UI, by pixel value comparison, the position of pixel value scope in UI that obtains the GUI image.This knows technology for image processing field, is not described in detail in this.
2026c: according to the UI of current screen demonstration and the relative position relation of current screen, calculate this GUI at the display position of current screen.
Particularly, at first, the UI that shows according to current screen and the relative position relation of current screen are mapped to screen coordinate one by one with the pixel distribution of UI; Then, according to the position of pixel value scope in UI of GUI image, obtain the screen coordinate corresponding to pixel value scope of GUI image; This screen coordinate is the screen coordinate of GUI image in current screen.
203: in this actual displayed position, analog subscriber operates the GUI image of non-standard control to be measured, to test non-standard control to be measured.
Wherein, be positioned to the actual displayed position of this GUI image in current screen after, analog subscriber is operated this GUI image.Further, take the non-standard control of button as example, the content measurement of non-standard control is described simply.For the non-standard control of this button, analog subscriber is clicked or double-clicked the GUI image of this control, check the response that this button obtains.Particularly, whether the tester should respond correct in connection with the design documentation of this software under testing according to the design documentation requirements verification.For example, click this button and whether eject forms; Behind the cancel button, whether forms close in the click forms; When the text input value was null, whether the prompting state of button was correct; Or can button click submit page data and closed page face-port body etc. to.Wherein, concrete test operation flow process is finished by predefined test case.Predefined test case is presented as concrete shell script.This is prior art, is not described in detail in this.
The beneficial effect that the technical scheme that the embodiment of the invention provides is brought is: the GUI image of the non-standard control to be measured by obtaining in advance software under testing; According to the GUI image of the described non-standard control to be measured that obtains in advance, determine the actual displayed position of GUI image in current screen of described non-standard control to be measured; In described actual displayed position, analog subscriber operates the GUI image of described non-standard control to be measured, to test described non-standard control to be measured; Because the GUI image of non-standard control obtains easily, determine the physical location of non-standard control according to the GUI image of non-standard control, can alleviate the burden of automatic test, the efficient of raising automatic test, saving resource.
Embodiment 3
Referring to Fig. 4, the embodiment of the invention 3 provides a kind of non-standard control automatic test device, and this device comprises:
The beneficial effect that the technical scheme that the embodiment of the invention provides is brought is: the GUI image of the non-standard control to be measured by obtaining in advance software under testing; According to the GUI image of the described non-standard control to be measured that obtains in advance, determine the actual displayed position of GUI image in current screen of described non-standard control to be measured; In described actual displayed position, analog subscriber operates the GUI image of described non-standard control to be measured, to test described non-standard control to be measured; Because the GUI image of non-standard control obtains easily, determine the physical location of non-standard control according to the GUI image of non-standard control, can alleviate the burden of automatic test, the efficient of raising automatic test, saving resource.
Embodiment 4
Referring to Fig. 5, the embodiment of the invention 4 provides a kind of non-standard control automatic test device, and this device comprises:
Acquisition module 401 is for the GUI image that obtains in advance the non-standard control to be measured of software under testing.
Determination module 402 is used for the GUI image according to the non-standard control to be measured that obtains in advance, determines the actual displayed position of GUI image in current screen of this non-standard control to be measured.
Wherein, determination module 402 comprises:
Start unit 4021 is used for starting software under testing, makes current screen show the UI of software under testing.
Acquiring unit 4022 is used for obtaining the UI of the GUI image of the non-standard control to be measured that existence that current screen shows obtains in advance.
Computing unit 4023 is used for according to this UI, calculates the GUI image in the actual displayed position of current screen.
Wherein, computing unit 4023 comprises:
The first computation subunit 4023a is used for obtaining the GUI image in the position of UI.
Obtain subelement 4023b, be used for obtaining the relative position relation of UI and current screen.
The second computation subunit 4023c, be used for according to the GUI image in the position of UI, and the relative position relation of UI and current screen, calculate GUI at the display position of current screen.
Wherein, determination module 402 also comprises:
Reading unit 4024 is for the UI of the software under testing that reads in real time the current screen demonstration.
Search unit 4025 is used for according to the GUI image, whether has the image identical with the GUI image among the UI of search software under testing.
Correspondingly, acquiring unit 4022 also is used for, if exist, then obtains the UI of the GUI image of the non-standard control to be measured that the existence that shows in the current screen obtains in advance.
Correspondingly, reading unit 4024 also is used for, if do not exist, then continues to read the UI of the software under testing that current screen shows.
Wherein, determination module 402 also comprises:
Setting unit 4026 is used for setting in advance the screen area that screen shows the GUI image.
Correspondingly, reading unit 4024 is used for,
In screen area, read in real time the UI of the software under testing of current screen demonstration.
Analog module 403 is used in this actual displayed position, and analog subscriber operates the GUI image of non-standard control to be measured, to test non-standard control to be measured.
The beneficial effect that the technical scheme that the embodiment of the invention provides is brought is: the GUI image of the non-standard control to be measured by obtaining in advance software under testing; According to the GUI image of the described non-standard control to be measured that obtains in advance, determine the actual displayed position of GUI image in current screen of described non-standard control to be measured; In described actual displayed position, analog subscriber operates the GUI image of described non-standard control to be measured, to test described non-standard control to be measured; Because the GUI image of non-standard control obtains easily, determine the physical location of non-standard control according to the GUI image of non-standard control, can alleviate the burden of automatic test, the efficient of raising automatic test, saving resource.
Need to prove: the automatic test device that above-described embodiment provides is when testing non-standard control, only the division with above-mentioned each functional module is illustrated, in the practical application, can as required the above-mentioned functions distribution be finished by different functional modules, the inner structure of the equipment of being about to is divided into different functional modules, to finish all or part of function described above.In addition, the automatic test device that above-described embodiment provides and automated testing method embodiment belong to same design, and its specific implementation process sees embodiment of the method for details, repeats no more here.
The invention described above embodiment sequence number does not represent the quality of embodiment just to description.
The all or part of step that one of ordinary skill in the art will appreciate that realization above-described embodiment can be finished by hardware, also can come the relevant hardware of instruction to finish by program, described program can be stored in a kind of computer-readable recording medium, the above-mentioned storage medium of mentioning can be ROM (read-only memory), disk or CD etc.
The above only is preferred embodiment of the present invention, and is in order to limit the present invention, within the spirit and principles in the present invention not all, any modification of doing, is equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. non-standard control automated testing method is characterized in that described method comprises:
Obtain in advance the graphical user interface image of the non-standard control to be measured of software under testing;
According to the graphical user interface image of the described non-standard control to be measured that obtains in advance, determine the actual displayed position of graphical user interface image in current screen of described non-standard control to be measured;
In described actual displayed position, analog subscriber operates the graphical user interface image of described non-standard control to be measured, to test described non-standard control to be measured.
2. the method for claim 1, it is characterized in that, described graphical user interface image according to the described non-standard control to be measured that obtains in advance, determine the actual displayed position of graphical user interface image in current screen of described non-standard control to be measured to comprise:
Start described software under testing, make described current screen show the user interface of described software under testing;
Obtain the user interface of the graphical user interface image that has the described described non-standard control to be measured that obtains in advance that shows in the described current screen;
According to described user interface, calculate described graphical user interface image in the actual displayed position of described current screen.
3. method as claimed in claim 2 is characterized in that, before the described user interface of obtaining the graphical user interface image that has the described described non-standard control to be measured that obtains in advance that shows in the described current screen, also comprises:
Read in real time the user interface of the described software under testing of described current screen demonstration;
According to described graphical user interface image, search in the user interface of described software under testing whether have the image identical with described graphical user interface image;
If do not exist, then continue to read the user interface of the described software under testing that described current screen shows.
4. method as claimed in claim 3 is characterized in that, described method also comprises:
Set in advance the screen area that shows described graphical user interface image in the screen;
Correspondingly, the described user interface that reads in real time the described software under testing that described current screen shows is,
In described screen area, read in real time the user interface of the described software under testing of described current screen demonstration.
5. method as claimed in claim 2 is characterized in that, and is described according to described user interface, calculates described graphical user interface image in the actual displayed position of described current screen, comprising:
Calculate the position of described graphical user interface image in described user interface;
Obtain the relative position relation of described user interface and described current screen;
According to the position of described graphical user interface image in described user interface, and the relative position relation of described user interface and described current screen, calculate described graphical user interface at the display position of described current screen.
6. non-standard control automatic test device is characterized in that described device comprises:
Acquisition module is for the graphical user interface image that obtains in advance the non-standard control to be measured of software under testing;
Determination module is used for the graphical user interface image according to the described non-standard control to be measured that obtains in advance, determines the actual displayed position of graphical user interface image in current screen of described non-standard control to be measured;
Analog module is used in described actual displayed position, and analog subscriber operates the graphical user interface image of described non-standard control to be measured, to test described non-standard control to be measured.
7. device as claimed in claim 5 is characterized in that, described determination module comprises:
Start unit is used for starting described software under testing, makes described current screen show the user interface of described software under testing;
Acquiring unit is used for obtaining the user interface of the graphical user interface image that has the described described non-standard control to be measured that obtains in advance that described current screen shows;
Computing unit is used for according to described user interface, calculates described graphical user interface image in the actual displayed position of described current screen.
8. device as claimed in claim 7 is characterized in that, described determination module also comprises:
Reading unit is for the user interface of the described software under testing that reads in real time described current screen demonstration;
Search unit is used for according to described graphical user interface image, searches in the user interface of described software under testing whether have the image identical with described graphical user interface image;
Correspondingly, described reading unit also is used for,
If do not exist, then continue to read the user interface of the described software under testing that described current screen shows.
9. device as claimed in claim 8 is characterized in that, described determination module also comprises:
Setting unit is used for setting in advance the screen area that screen shows described graphical user interface image;
Correspondingly, described reading unit is used for,
In described screen area, read in real time the user interface of the described software under testing of described current screen demonstration.
10. device as claimed in claim 7 is characterized in that, described computing unit comprises:
The first computation subunit is used for obtaining described graphical user interface image in the position of described user interface;
Obtain subelement, be used for obtaining the relative position relation of described user interface and described current screen;
The second computation subunit, be used for according to described graphical user interface image in the position of described user interface, and the relative position relation of described user interface and described current screen, calculate described graphical user interface at the display position of described current screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210121186.7A CN103377119B (en) | 2012-04-23 | 2012-04-23 | A kind of non-standard control automated testing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210121186.7A CN103377119B (en) | 2012-04-23 | 2012-04-23 | A kind of non-standard control automated testing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103377119A true CN103377119A (en) | 2013-10-30 |
| CN103377119B CN103377119B (en) | 2017-07-25 |
Family
ID=49462269
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210121186.7A Active CN103377119B (en) | 2012-04-23 | 2012-04-23 | A kind of non-standard control automated testing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103377119B (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103823758A (en) * | 2014-03-13 | 2014-05-28 | 北京金山网络科技有限公司 | Browser testing method and device |
| CN104268006A (en) * | 2014-10-27 | 2015-01-07 | 北京奇虎科技有限公司 | Keyboard and mouse script playback method and device |
| CN104391797A (en) * | 2014-12-09 | 2015-03-04 | 北京奇虎科技有限公司 | GUI (graphical user interface) widget identification method and device |
| CN104503778A (en) * | 2014-12-09 | 2015-04-08 | 北京奇虎科技有限公司 | Installation method and installation device for applications |
| CN104636248A (en) * | 2013-11-13 | 2015-05-20 | 航天信息股份有限公司 | Automatic testing auxiliary recognition method based on code injection |
| CN104778121A (en) * | 2015-03-25 | 2015-07-15 | 网易（杭州）网络有限公司 | Game program test method, device and system |
| CN104915053A (en) * | 2015-05-04 | 2015-09-16 | 北京奇艺世纪科技有限公司 | Position determining method and device for interface controls |
| CN105204984A (en) * | 2014-06-17 | 2015-12-30 | 腾讯科技（深圳）有限公司 | Self-drawn control test method and device |
| CN105302715A (en) * | 2014-07-30 | 2016-02-03 | 腾讯科技（深圳）有限公司 | Application user interface acquisition method and apparatus |
| CN108509342A (en) * | 2018-04-04 | 2018-09-07 | 成都中云天下科技有限公司 | A kind of precisely quick App automated testing methods |
| CN109542440A (en) * | 2018-11-29 | 2019-03-29 | 金蝶软件（中国）有限公司 | To the operating method and device of window, computer installation and readable storage medium storing program for executing |
| CN109614169A (en) * | 2018-12-29 | 2019-04-12 | 上海上讯信息技术股份有限公司 | Window client application program automatic operation method based on pixel coordinate mode |
| CN110347585A (en) * | 2019-05-28 | 2019-10-18 | 成都美美臣科技有限公司 | A kind of UI automatic test image identification method |
| CN111913868A (en) * | 2019-05-07 | 2020-11-10 | 杭州海康威视数字技术股份有限公司 | User interface test method, device, system and storage medium |
| CN112882928A (en) * | 2021-02-02 | 2021-06-01 | 中国汽车技术研究中心有限公司 | Automatic testing method and system for touch screen of intelligent cabin of automobile |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101634952A (en) * | 2009-08-20 | 2010-01-27 | 中兴通讯股份有限公司 | Interface inputting method of simulation input device |
| US20100100767A1 (en) * | 2008-10-22 | 2010-04-22 | Huan Liu | Automatically connecting remote network equipment through a graphical user interface |
| CN101964062A (en) * | 2010-09-14 | 2011-02-02 | 北京神州泰岳软件股份有限公司 | Image searching method based on user interface |
| CN101996131A (en) * | 2009-08-19 | 2011-03-30 | 航天信息股份有限公司 | Automatic test method and automatic test platform for graphic user interface (GUI) based on x extensive makeup language (XML) packaging key word |
-
2012
- 2012-04-23 CN CN201210121186.7A patent/CN103377119B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100100767A1 (en) * | 2008-10-22 | 2010-04-22 | Huan Liu | Automatically connecting remote network equipment through a graphical user interface |
| CN101996131A (en) * | 2009-08-19 | 2011-03-30 | 航天信息股份有限公司 | Automatic test method and automatic test platform for graphic user interface (GUI) based on x extensive makeup language (XML) packaging key word |
| CN101634952A (en) * | 2009-08-20 | 2010-01-27 | 中兴通讯股份有限公司 | Interface inputting method of simulation input device |
| CN101964062A (en) * | 2010-09-14 | 2011-02-02 | 北京神州泰岳软件股份有限公司 | Image searching method based on user interface |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104636248A (en) * | 2013-11-13 | 2015-05-20 | 航天信息股份有限公司 | Automatic testing auxiliary recognition method based on code injection |
| CN104636248B (en) * | 2013-11-13 | 2018-01-16 | 航天信息股份有限公司 | A kind of automatic test based on code injection assists in identifying method |
| CN103823758A (en) * | 2014-03-13 | 2014-05-28 | 北京金山网络科技有限公司 | Browser testing method and device |
| CN105204984B (en) * | 2014-06-17 | 2018-08-17 | 腾讯科技（深圳）有限公司 | A kind of owner-drawing control test method and device |
| CN105204984A (en) * | 2014-06-17 | 2015-12-30 | 腾讯科技（深圳）有限公司 | Self-drawn control test method and device |
| CN105302715A (en) * | 2014-07-30 | 2016-02-03 | 腾讯科技（深圳）有限公司 | Application user interface acquisition method and apparatus |
| CN105302715B (en) * | 2014-07-30 | 2019-05-24 | 腾讯科技（深圳）有限公司 | The acquisition methods and device of application program user interface |
| CN104268006A (en) * | 2014-10-27 | 2015-01-07 | 北京奇虎科技有限公司 | Keyboard and mouse script playback method and device |
| CN104503778A (en) * | 2014-12-09 | 2015-04-08 | 北京奇虎科技有限公司 | Installation method and installation device for applications |
| CN104391797B (en) * | 2014-12-09 | 2017-11-10 | 北京奇虎科技有限公司 | The recognition methods of GUI controls and device |
| CN104391797A (en) * | 2014-12-09 | 2015-03-04 | 北京奇虎科技有限公司 | GUI (graphical user interface) widget identification method and device |
| CN104778121A (en) * | 2015-03-25 | 2015-07-15 | 网易（杭州）网络有限公司 | Game program test method, device and system |
| CN104778121B (en) * | 2015-03-25 | 2018-09-18 | 网易（杭州）网络有限公司 | The test method of games, apparatus and system |
| CN104915053A (en) * | 2015-05-04 | 2015-09-16 | 北京奇艺世纪科技有限公司 | Position determining method and device for interface controls |
| CN104915053B (en) * | 2015-05-04 | 2018-04-13 | 北京奇艺世纪科技有限公司 | The location determining method and device of a kind of interface control |
| CN108509342A (en) * | 2018-04-04 | 2018-09-07 | 成都中云天下科技有限公司 | A kind of precisely quick App automated testing methods |
| CN109542440A (en) * | 2018-11-29 | 2019-03-29 | 金蝶软件（中国）有限公司 | To the operating method and device of window, computer installation and readable storage medium storing program for executing |
| CN109614169A (en) * | 2018-12-29 | 2019-04-12 | 上海上讯信息技术股份有限公司 | Window client application program automatic operation method based on pixel coordinate mode |
| CN111913868A (en) * | 2019-05-07 | 2020-11-10 | 杭州海康威视数字技术股份有限公司 | User interface test method, device, system and storage medium |
| CN111913868B (en) * | 2019-05-07 | 2023-08-04 | 杭州海康威视数字技术股份有限公司 | User interface testing method, device, system and storage medium |
| CN110347585A (en) * | 2019-05-28 | 2019-10-18 | 成都美美臣科技有限公司 | A kind of UI automatic test image identification method |
| CN110347585B (en) * | 2019-05-28 | 2023-06-06 | 成都美美臣科技有限公司 | UI (user interface) automatic test picture identification method |
| CN112882928A (en) * | 2021-02-02 | 2021-06-01 | 中国汽车技术研究中心有限公司 | Automatic testing method and system for touch screen of intelligent cabin of automobile |
| CN112882928B (en) * | 2021-02-02 | 2023-03-31 | 中国汽车技术研究中心有限公司 | Automatic testing method and system for touch screen of intelligent cabin of automobile |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103377119B (en) | 2017-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103377119A (en) | Automatic nonstandard control testing method and device | |
| CN107025174B (en) | Method, device and readable storage medium for user interface anomaly test of equipment | |
| CN109086203B (en) | Page detection method and device | |
| WO2016062159A1 (en) | Image matching method and platform for testing of mobile phone applications | |
| WO2016206113A1 (en) | Technologies for device independent automated application testing | |
| US10810113B2 (en) | Method and apparatus for creating reference images for an automated test of software with a graphical user interface | |
| CN108829371B (en) | Interface control method and device, storage medium and electronic equipment | |
| US20140351718A1 (en) | Information processing device, information processing method, and computer-readable medium | |
| WO2015074521A1 (en) | Devices and methods for positioning based on image detection | |
| CN111950521A (en) | Augmented reality interaction method and device, electronic equipment and storage medium | |
| CN105589801B (en) | Mobile phone cluster test method and system | |
| CN108509343A (en) | Automated testing method based on image recognition technology and system | |
| US20130222241A1 (en) | Apparatus and method for managing motion recognition operation | |
| CN110442510A (en) | A kind of page properties acquisition methods, device and computer equipment, storage medium | |
| CN105094381B (en) | One kind writing treating method and apparatus | |
| CN111651368B (en) | User graphical interface testing method and computer readable storage medium | |
| CN113076257B (en) | Test script recording method, device, medium and computer equipment | |
| CN105808257B (en) | Application popup identification method and device | |
| CN108845924B (en) | Control response area display control method, electronic device, and storage medium | |
| CN117217993A (en) | Full-coverage screenshot method, system, electronic equipment and storage medium | |
| CN110779460B (en) | Offline guidance device, measurement control device, and storage medium | |
| US20190102148A1 (en) | Development Environment for Real-Time Application Development | |
| Pan et al. | Research on functional test of mobile app based on robot | |
| Pul et al. | Automatic functionality verification of hybrid set-top boxes with dynamic user interface | |
| US20160209989A1 (en) | Record and replay of operations on graphical objects |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |