CN107463327B - method and terminal for acquiring position information of interface control element - Google Patents
method and terminal for acquiring position information of interface control element Download PDFInfo
- Publication number
- CN107463327B CN107463327B CN201710594061.9A CN201710594061A CN107463327B CN 107463327 B CN107463327 B CN 107463327B CN 201710594061 A CN201710594061 A CN 201710594061A CN 107463327 B CN107463327 B CN 107463327B
- Authority
- CN
- China
- Prior art keywords
- interface
- control element
- characteristic value
- interface control
- target area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/0418—Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
the invention relates to the field of data processing, in particular to a method and a terminal for acquiring position information of an interface control element. The invention provides a method for acquiring position information of an interface control element, which comprises the following steps: when a touch event is monitored, a current screen image is intercepted to obtain a first interface image; executing a touch operation corresponding to the touch event; intercepting a current screen image to obtain a second interface image; when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, acquiring coordinate values of more than one touch point corresponding to the touch event; and adding the coordinate values to a preset interface control element coordinate set. The generality of the method for acquiring the position information of the interface control element is improved.
Description
Technical Field
the invention relates to the field of data processing, in particular to a method and a terminal for acquiring position information of an interface control element.
background
in order to facilitate the user to operate the terminal, a floating button with certain functions is often arranged on the terminal interface. However, when the positions of the hover button and the interface control element overlap, the hover button and the interface control element interfere with each other, and the operation required by the user cannot be accurately performed. For example, if a user originally wants to operate an interface control element, the user mistakenly operates the floating button because the interface control element and the floating button have an overlapping area, so that the interface returns to the first page of the terminal, and the original task is interrupted. In order to ensure that the operation of the user on the floating button does not conflict with the operation on the interface control element, or in order that the position of the floating button does not affect the operation on the interface control element, the position of the floating button needs to be automatically adjusted until the floating button and any interface control element do not have an overlapping area.
in order to solve the above-mentioned technical problem, patent document No. 201410286349.6 discloses a method, an apparatus and a terminal for adjusting the position of a floating button. The method comprises the following steps: acquiring the position information of a floating button on a mobile screen, and acquiring the position information of all interface control elements included in a current page on the mobile screen; determining whether the position of the floating button is overlapped with the position of any interface control element; if so, adjusting the hover button to a target region that does not overlap with the position of each interface control element. The patent document further discloses a method for obtaining position information of all interface control elements included in the current page on the mobile screen, that is, obtaining all interface control elements included in the current page, the size of each interface control element and the position of each interface control element in the current page from a source code corresponding to the current page.
however, for an operating system or most application programs with higher security, the operating system or most application programs are non-open source, that is, a third-party program cannot acquire the position information of the interface control element by analyzing the source code. Therefore, the method of acquiring the position information of the interface control element provided in the above patent document has no versatility, resulting in that the method of adjusting the position of the hover button has no versatility.
disclosure of Invention
the technical problem to be solved by the invention is as follows: the generality of the method for acquiring the position information of the interface control element is improved.
in order to solve the technical problems, the invention adopts the technical scheme that:
The invention provides a method for acquiring position information of an interface control element, which comprises the following steps:
s1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
s13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
And S3, adding the coordinate values to a preset interface control element coordinate set.
the invention also provides a terminal for acquiring the position information of the interface control element, which comprises one or more processors and a memory, wherein the memory stores programs and is configured to be executed by the one or more processors to execute the following steps:
s1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
S12, executing a touch operation corresponding to the touch event;
S13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
And S3, adding the coordinate values to a preset interface control element coordinate set.
the invention has the beneficial effects that: the method comprises the steps of identifying whether the coordinates of a current touch point are in an area where an interface control element is located or not by comparing the difference between a first interface graph before touch operation is executed and a second interface graph after touch operation is executed, and recording the coordinates of the touch point which can trigger the interface control element to execute corresponding operation; the method can acquire the position information of the interface control element without reading the source code of the system or the application program installed on the terminal, so that the method for acquiring the position information of the interface control element provided by the invention has universality.
Drawings
FIG. 1 is a flowchart illustrating a method for obtaining position information of an interface control element according to an embodiment of the present invention;
Fig. 2 is a block diagram illustrating a specific embodiment of a terminal for obtaining position information of an interface control element according to the present invention;
FIG. 3 is a schematic diagram illustrating the movement rules of the hover button;
description of reference numerals:
1. a processor; 2. a memory.
Detailed Description
In order to explain technical contents, achieved objects, and effects of the present invention in detail, the following description is made with reference to the accompanying drawings in combination with the embodiments.
referring to fig. 1 to 3 of the drawings,
As shown in fig. 1, the present invention provides a method for obtaining position information of an interface control element, including:
S1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
s13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
and S3, adding the coordinate values to a preset interface control element coordinate set.
further, still include:
acquiring more than one target area with the same area as that of the suspension button; the coordinate values of any point in the target area do not belong to the interface control element coordinate set;
And moving the floating button to the target area.
as can be seen from the above description, the method for adjusting the hover button to the area where the non-interface control element is located provided by the present invention does not need to obtain the location information of the interface control element by analyzing the source code, has universality, and can be applied to any system or application program.
further, still include:
calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set;
acquiring a target area corresponding to the minimum distance in the distance set to obtain a nearest target area;
moving a hover button to the proximate target region.
as can be seen from the above description, moving the hover button to the target area closest to the target position desired by the user (i.e., the current position of the hover button) facilitates user operation and is beneficial to improving user experience.
further, still include:
calculating a characteristic value of the first interface graph to obtain a first characteristic value;
binding the first characteristic value and the interface control element coordinate set;
and adding the first characteristic value to a preset interface characteristic value set.
further, still include:
intercepting a current screen image to obtain a third interface image;
calculating a characteristic value of the third interface graph to obtain a second characteristic value;
if the first characteristic value is the same as the second characteristic value in the interface characteristic value set, acquiring a target area according to an interface control element coordinate set corresponding to the first characteristic value; and the coordinate values of any point in the target area do not belong to an interface control element coordinate set corresponding to the first characteristic value.
the above description shows that the target area can be adapted according to the currently displayed interface of the screen, and the method has high flexibility and universality.
further, still include:
Acquiring the resolution of the first interface graph to obtain a first resolution;
Binding the first feature value and the first resolution.
further, still include:
Intercepting a current screen image to obtain a fourth interface image;
calculating a characteristic value of the fourth interface graph to obtain a third characteristic value;
If one first characteristic value and one third characteristic value in the interface characteristic value set are the same, then:
acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
converting the first interface control element coordinate set according to the resolution of the fourth interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
Acquiring a target area according to the second interface control element coordinate set; and the coordinate values of any point in the target area do not belong to the second interface control element coordinate set.
according to the description, the target area can be adapted according to the resolution of the current terminal and the interface displayed by the current screen, and the method has high flexibility and universality.
as shown in fig. 2, the present invention further provides a terminal for obtaining position information of an interface control element, including one or more processors and a memory, where the memory stores a program and is configured to be executed by the one or more processors to perform the following steps:
S1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
S13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
And S3, adding the coordinate values to a preset interface control element coordinate set.
further, still include:
acquiring more than one target area with the same area as that of the suspension button; the coordinate values of any point in the target area do not belong to the interface control element coordinate set;
calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set;
acquiring a target area corresponding to the minimum distance in the distance set to obtain a nearest target area;
moving a hover button to the proximate target region.
further, still include:
Calculating a characteristic value of the first interface graph to obtain a first characteristic value;
Binding the first characteristic value and the interface control element coordinate set;
adding the first characteristic value to a preset interface characteristic value set;
Acquiring the resolution of the first interface graph to obtain a first resolution;
Binding the first feature value and the first resolution;
intercepting a current screen image to obtain a fourth interface image;
calculating a characteristic value of the fourth interface graph to obtain a third characteristic value;
if one first characteristic value and one third characteristic value in the interface characteristic value set are the same, then:
acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
converting the first interface control element coordinate set according to the resolution of the fourth interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
acquiring a target area according to the second interface control element coordinate set; and the coordinate values of any point in the target area do not belong to the second interface control element coordinate set.
the first embodiment of the invention is as follows:
the embodiment provides a method for acquiring position information of an interface control element, which comprises the following steps:
S1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
optionally, after the current screen image is captured, the captured screen image is cut according to a preset top notification bar height value to obtain a first interface diagram, that is, the first interface diagram does not include a top notification bar area; because the top notification bar heights set by different systems are different, the top notification bar area is cut off, so that the method provided by the invention can be suitable for systems of different versions, and the universality of the method for acquiring the position information of the interface control element provided by the invention is improved;
s12, executing a touch operation corresponding to the touch event;
s13, intercepting the current screen image to obtain a second interface image;
optionally, after the current screen image is captured, the captured screen image is cut according to a preset top notification bar height value to obtain a second interface diagram, that is, the second interface diagram does not include a top notification bar area;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
S3, adding the coordinate values to a preset interface control element coordinate set;
s4, calculating a characteristic value of the first interface graph to obtain a first characteristic value; binding the first characteristic value and the interface control element coordinate set; acquiring the resolution of the first interface graph to obtain a first resolution; binding the first feature value and the first resolution; adding the first characteristic value to a preset interface characteristic value set;
s5, intercepting the current screen image to obtain a third interface image; calculating a characteristic value of the third interface graph to obtain a second characteristic value;
optionally, after the current screen image is captured, the captured screen image is cut according to a preset top notification bar height value to obtain a third interface diagram, that is, the third interface diagram does not include a top notification bar area;
s6, if there is one first feature value in the interface feature value set that is the same as the second feature value, then:
s61, acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
S62, converting the first interface control element coordinate set according to the resolution of the third interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
the method for acquiring the position information of the interface control element, provided by the invention, can be suitable for terminals with different resolutions through resolution conversion operation, and has better universality;
s63, acquiring a target area according to the second interface control element coordinate set; the coordinate values of any point in the target area do not belong to the second interface control element coordinate set;
optionally, the method for obtaining the target area according to the second interface control element coordinate set may adopt the following two ways, but is not limited to the following two ways:
the first mode is that more than one target area with the same area as the floating button is obtained; the coordinate values of any point in the target area do not belong to the second interface control element coordinate set; calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set; acquiring a target area corresponding to the minimum distance in the distance set to obtain a nearest target area; moving a hover button to the proximate target area;
in a second mode, as shown in fig. 3, when the floating button is rectangular, the coordinates of the center point of the current floating button, the width of the floating button, and the height of the floating button are obtained, and 4 vertex coordinates of the floating button are calculated; 4 vertex coordinates enclose a rectangular area; and if any coordinate point in the second interface control element coordinate set is contained in the rectangular area, the outer frame of the suspension button is taken as a boundary, the suspension button is moved anticlockwise from inside to outside by taking the height of the suspension button as a unit up and down and the width of the suspension button as a unit left and right, whether any coordinate point in the second interface control element coordinate set is contained in the current rectangular area is judged once, and if the any coordinate point is not contained, the suspension button is not moved.
the second embodiment of the invention is as follows:
The embodiment provides a terminal for acquiring position information of an interface control element, which includes one or more processors 1 and a memory 2, where the memory 2 stores a program and is configured to be executed by the one or more processors 1 to perform the following steps:
S1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
s13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
s3, adding the coordinate values to a preset interface control element coordinate set;
S4, acquiring more than one target area with the same area as the suspension button; the coordinate values of any point in the target area do not belong to the interface control element coordinate set;
s5, calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set;
s6, obtaining a target area corresponding to the minimum distance in the distance set to obtain a nearest target area;
and S7, moving the floating button to the nearest target area.
the third embodiment of the invention is as follows:
the embodiment provides a terminal for acquiring position information of an interface control element, which includes one or more processors 1 and a memory 2, where the memory 2 stores a program and is configured to be executed by the one or more processors 1 to perform the following steps:
s1, when a touch event is sensed,
S11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
S13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
s3, adding the coordinate values to a preset interface control element coordinate set;
s4, calculating a characteristic value of the first interface graph to obtain a first characteristic value; binding the first characteristic value and the interface control element coordinate set; acquiring the resolution of the first interface graph to obtain a first resolution; binding the first feature value and the first resolution; adding the first characteristic value to a preset interface characteristic value set;
s5, intercepting the current screen image to obtain a fourth interface image;
s6, calculating a characteristic value of the fourth interface graph to obtain a third characteristic value; if one first characteristic value and one third characteristic value in the interface characteristic value set are the same, then:
S61, acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
S62, converting the first interface control element coordinate set according to the resolution of the fourth interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
s63, acquiring a target area according to the second interface control element coordinate set; and the coordinate values of any point in the target area do not belong to the second interface control element coordinate set.
in summary, in the method for obtaining position information of an interface control element provided by the present invention, whether a coordinate of a current touch point is in an area where the interface control element is located is identified by comparing a difference between a first interface diagram before performing a touch operation and a second interface diagram after performing the touch operation, and a coordinate of a touch point that can trigger the interface control element to perform a corresponding operation is recorded; the method can acquire the position information of the interface control element without reading the source code of the system or the application program installed on the terminal, so that the method for acquiring the position information of the interface control element provided by the invention has universality. Furthermore, the method for adjusting the floating button to the area where the non-interface control element is located does not need to acquire the position information of the interface control element by analyzing the source code, has universality, and can be applied to any system or application program. Furthermore, the floating button is moved to a target area closest to a target position expected by the user (namely, the current position of the floating button), so that the operation of the user is facilitated, and the improvement of user experience is facilitated. Furthermore, the target area can be adapted according to the currently displayed interface of the screen, and the method has high flexibility and universality. Furthermore, the target area can be adapted according to the resolution of the current terminal and the interface displayed on the current screen, and the method has high flexibility and universality.
the above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent changes made by using the contents of the present specification and the drawings, or applied directly or indirectly to the related technical fields, are included in the scope of the present invention.
Claims (10)
1. a method for obtaining position information of an interface control element is characterized by comprising the following steps:
s1, when a touch event is sensed,
S11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
S13, intercepting the current screen image to obtain a second interface image;
S2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
And S3, adding the coordinate values to a preset interface control element coordinate set.
2. the method for obtaining interface control element position information according to claim 1, further comprising:
acquiring more than one target area with the same area as that of the suspension button; the coordinate values of any point in the target area do not belong to the interface control element coordinate set;
and moving the floating button to the target area.
3. the method for obtaining interface control element position information according to claim 2, further comprising:
calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set;
acquiring a target area corresponding to the minimum distance in the distance set to obtain a nearest target area;
moving a hover button to the proximate target region.
4. the method for obtaining interface control element position information according to claim 1, further comprising:
calculating a characteristic value of the first interface graph to obtain a first characteristic value;
binding the first characteristic value and the interface control element coordinate set;
And adding the first characteristic value to a preset interface characteristic value set.
5. the method for obtaining interface control element position information according to claim 4, further comprising:
intercepting a current screen image to obtain a third interface image;
calculating a characteristic value of the third interface graph to obtain a second characteristic value;
if the first characteristic value is the same as the second characteristic value in the interface characteristic value set, acquiring a target area according to an interface control element coordinate set corresponding to the first characteristic value; and the coordinate values of any point in the target area do not belong to an interface control element coordinate set corresponding to the first characteristic value.
6. the method for obtaining interface control element position information according to claim 4, further comprising:
acquiring the resolution of the first interface graph to obtain a first resolution;
binding the first feature value and the first resolution.
7. the method for obtaining interface control element position information according to claim 6, further comprising:
intercepting a current screen image to obtain a fourth interface image;
calculating a characteristic value of the fourth interface graph to obtain a third characteristic value;
if one first characteristic value and one third characteristic value in the interface characteristic value set are the same, then:
Acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
Converting the first interface control element coordinate set according to the resolution of the fourth interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
acquiring a target area according to the second interface control element coordinate set; and the coordinate values of any point in the target area do not belong to the second interface control element coordinate set.
8. a terminal for obtaining interface control element position information, comprising one or more processors and a memory, the memory storing a program and configured to perform the following steps by the one or more processors:
s1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
S13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
and S3, adding the coordinate values to a preset interface control element coordinate set.
9. The terminal for obtaining the position information of the interface control element according to claim 8, further comprising:
acquiring more than one target area with the same area as that of the suspension button; the coordinate values of any point in the target area do not belong to the interface control element coordinate set;
calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set;
acquiring a target area corresponding to the minimum distance in the distance set to obtain a nearest target area;
moving a hover button to the proximate target region.
10. the terminal for obtaining the position information of the interface control element according to claim 8, further comprising:
Calculating a characteristic value of the first interface graph to obtain a first characteristic value;
binding the first characteristic value and the interface control element coordinate set;
Adding the first characteristic value to a preset interface characteristic value set;
Acquiring the resolution of the first interface graph to obtain a first resolution;
binding the first feature value and the first resolution;
intercepting a current screen image to obtain a fourth interface image;
Calculating a characteristic value of the fourth interface graph to obtain a third characteristic value;
If one first characteristic value and one third characteristic value in the interface characteristic value set are the same, then:
acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
Converting the first interface control element coordinate set according to the resolution of the fourth interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
acquiring a target area according to the second interface control element coordinate set; and the coordinate values of any point in the target area do not belong to the second interface control element coordinate set.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710594061.9A CN107463327B (en) | 2017-07-20 | 2017-07-20 | method and terminal for acquiring position information of interface control element |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710594061.9A CN107463327B (en) | 2017-07-20 | 2017-07-20 | method and terminal for acquiring position information of interface control element |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107463327A CN107463327A (en) | 2017-12-12 |
CN107463327B true CN107463327B (en) | 2019-12-17 |
Family
ID=60546886
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710594061.9A Active CN107463327B (en) | 2017-07-20 | 2017-07-20 | method and terminal for acquiring position information of interface control element |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107463327B (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108449640B (en) * | 2018-03-26 | 2021-05-07 | 广州虎牙信息科技有限公司 | Live video output control method and device, storage medium and terminal |
CN112231032A (en) * | 2019-12-10 | 2021-01-15 | 北京来也网络科技有限公司 | Software interface element access method and device combining RPA and AI |
CN111580902B (en) * | 2020-04-20 | 2024-01-26 | 微梦创科网络科技(中国)有限公司 | Mobile terminal element positioning method and system based on picture analysis |
CN112044061B (en) * | 2020-08-11 | 2022-05-06 | 腾讯科技(深圳)有限公司 | Game picture processing method and device, electronic equipment and storage medium |
CN115033091B (en) * | 2021-03-03 | 2023-08-11 | 上海艾为电子技术股份有限公司 | Method and device for reducing power consumption of handheld mobile device |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9223134B2 (en) * | 2010-02-28 | 2015-12-29 | Microsoft Technology Licensing, Llc | Optical imperfections in a light transmissive illumination system for see-through near-eye display glasses |
US9280277B2 (en) * | 2012-07-11 | 2016-03-08 | Bae Systems Information And Electronic Systems Integration Inc. | Smart phone like gesture interface for weapon mounted systems |
CN104252410B (en) * | 2013-06-27 | 2017-12-22 | 阿里巴巴集团控股有限公司 | The method and apparatus that a kind of control in the page is tested |
CN104346085A (en) * | 2013-07-25 | 2015-02-11 | 北京三星通信技术研究有限公司 | Control object operation method and device and terminal device |
CN103645890B (en) * | 2013-11-29 | 2017-12-01 | 北京奇虎科技有限公司 | A kind of method and apparatus for being used for orient control in graphical user interfaces |
CN103793137B (en) * | 2014-01-23 | 2017-12-29 | 联想(北京)有限公司 | A kind of display methods and electronic equipment |
CN104866414B (en) * | 2014-02-24 | 2018-07-06 | 腾讯科技(深圳)有限公司 | The test method of application program, apparatus and system |
CN105302408A (en) * | 2014-06-24 | 2016-02-03 | 腾讯科技(深圳)有限公司 | Method and apparatus for adjusting position of hover button and terminal |
CN104391797B (en) * | 2014-12-09 | 2017-11-10 | 北京奇虎科技有限公司 | The recognition methods of GUI controls and device |
CN105808416B (en) * | 2014-12-27 | 2018-04-13 | 南车株洲电力机车研究所有限公司 | A kind of automated testing method and system of man-machine figure interactive interface |
CN106775195B (en) * | 2016-11-16 | 2018-09-18 | 竞技世界(北京)网络技术有限公司 | A kind of control method and device of suspension button |
CN106775223A (en) * | 2016-11-30 | 2017-05-31 | 宇龙计算机通信科技(深圳)有限公司 | The control method and terminal device of suspension button |
-
2017
- 2017-07-20 CN CN201710594061.9A patent/CN107463327B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN107463327A (en) | 2017-12-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107463327B (en) | method and terminal for acquiring position information of interface control element | |
CN107992275B (en) | Document printing method and device, computer equipment and storage medium | |
US20130201534A1 (en) | Document assembly and automated contextual form generation | |
KR102310903B1 (en) | Touch detection method and computer readable storage medium | |
CN110851299A (en) | Automatic flow exception eliminating method, device, equipment and storage medium | |
CN112101317B (en) | Page direction identification method, device, equipment and computer readable storage medium | |
CN110297681B (en) | Image processing method, device, terminal and storage medium | |
CN111104036B (en) | Element control method, device, equipment and storage medium | |
CN112686919B (en) | Object boundary line determining method and device, electronic equipment and storage medium | |
CN106201234A (en) | The inspection method of content of pages and device | |
CN113282488B (en) | Terminal test method and device, storage medium and terminal | |
US20140063073A1 (en) | Electronic device and method for controlling movement of images on screen | |
US20150169134A1 (en) | Methods circuits apparatuses systems and associated computer executable code for providing projection based human machine interfaces | |
JPH0348922A (en) | Pointing cursor predictive moving device | |
KR101158679B1 (en) | Method for directly inputting figure on electronic document, and computer-readable recording medium storing program of directly inputting figure on electronic document | |
US10303349B2 (en) | Image-based application automation | |
US20140189486A1 (en) | Non-Transitory Computer Readable Medium Storing Document Sharing Program, Terminal Device and Document Sharing Method | |
CN104133578A (en) | Touch screen panel display and touch key input system | |
CN110955379B (en) | Control method of mobile terminal, mobile terminal and storage medium | |
CN110458202B (en) | Picture processing method, device and equipment and computer readable storage medium | |
EP2784652A2 (en) | Information processing apparatus, information processing method, and information processing program | |
KR101503640B1 (en) | Apparatus and method for supporting electronic signature | |
JP5834253B2 (en) | Image processing apparatus, image processing method, and image processing program | |
CN113253891B (en) | Terminal control method and device, storage medium and terminal | |
CN106598446B (en) | Screenshot method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |