CN107463327B - method and terminal for acquiring position information of interface control element - Google Patents

method and terminal for acquiring position information of interface control element Download PDF

Info

Publication number
CN107463327B
CN107463327B CN201710594061.9A CN201710594061A CN107463327B CN 107463327 B CN107463327 B CN 107463327B CN 201710594061 A CN201710594061 A CN 201710594061A CN 107463327 B CN107463327 B CN 107463327B
Authority
CN
China
Prior art keywords
interface
control element
characteristic value
interface control
target area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710594061.9A
Other languages
Chinese (zh)
Other versions
CN107463327A (en
Inventor
刘德建
陈丛亮
陈圆治
郭玉湖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujian Netdragon Websoft Co Ltd
Original Assignee
Fujian Netdragon Websoft Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujian Netdragon Websoft Co Ltd filed Critical Fujian Netdragon Websoft Co Ltd
Priority to CN201710594061.9A priority Critical patent/CN107463327B/en
Publication of CN107463327A publication Critical patent/CN107463327A/en
Application granted granted Critical
Publication of CN107463327B publication Critical patent/CN107463327B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/0418Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

the invention relates to the field of data processing, in particular to a method and a terminal for acquiring position information of an interface control element. The invention provides a method for acquiring position information of an interface control element, which comprises the following steps: when a touch event is monitored, a current screen image is intercepted to obtain a first interface image; executing a touch operation corresponding to the touch event; intercepting a current screen image to obtain a second interface image; when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, acquiring coordinate values of more than one touch point corresponding to the touch event; and adding the coordinate values to a preset interface control element coordinate set. The generality of the method for acquiring the position information of the interface control element is improved.

Description

method and terminal for acquiring position information of interface control element
Technical Field
the invention relates to the field of data processing, in particular to a method and a terminal for acquiring position information of an interface control element.
background
in order to facilitate the user to operate the terminal, a floating button with certain functions is often arranged on the terminal interface. However, when the positions of the hover button and the interface control element overlap, the hover button and the interface control element interfere with each other, and the operation required by the user cannot be accurately performed. For example, if a user originally wants to operate an interface control element, the user mistakenly operates the floating button because the interface control element and the floating button have an overlapping area, so that the interface returns to the first page of the terminal, and the original task is interrupted. In order to ensure that the operation of the user on the floating button does not conflict with the operation on the interface control element, or in order that the position of the floating button does not affect the operation on the interface control element, the position of the floating button needs to be automatically adjusted until the floating button and any interface control element do not have an overlapping area.
in order to solve the above-mentioned technical problem, patent document No. 201410286349.6 discloses a method, an apparatus and a terminal for adjusting the position of a floating button. The method comprises the following steps: acquiring the position information of a floating button on a mobile screen, and acquiring the position information of all interface control elements included in a current page on the mobile screen; determining whether the position of the floating button is overlapped with the position of any interface control element; if so, adjusting the hover button to a target region that does not overlap with the position of each interface control element. The patent document further discloses a method for obtaining position information of all interface control elements included in the current page on the mobile screen, that is, obtaining all interface control elements included in the current page, the size of each interface control element and the position of each interface control element in the current page from a source code corresponding to the current page.
however, for an operating system or most application programs with higher security, the operating system or most application programs are non-open source, that is, a third-party program cannot acquire the position information of the interface control element by analyzing the source code. Therefore, the method of acquiring the position information of the interface control element provided in the above patent document has no versatility, resulting in that the method of adjusting the position of the hover button has no versatility.
disclosure of Invention
the technical problem to be solved by the invention is as follows: the generality of the method for acquiring the position information of the interface control element is improved.
in order to solve the technical problems, the invention adopts the technical scheme that:
The invention provides a method for acquiring position information of an interface control element, which comprises the following steps:
s1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
s13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
And S3, adding the coordinate values to a preset interface control element coordinate set.
the invention also provides a terminal for acquiring the position information of the interface control element, which comprises one or more processors and a memory, wherein the memory stores programs and is configured to be executed by the one or more processors to execute the following steps:
s1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
S12, executing a touch operation corresponding to the touch event;
S13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
And S3, adding the coordinate values to a preset interface control element coordinate set.
the invention has the beneficial effects that: the method comprises the steps of identifying whether the coordinates of a current touch point are in an area where an interface control element is located or not by comparing the difference between a first interface graph before touch operation is executed and a second interface graph after touch operation is executed, and recording the coordinates of the touch point which can trigger the interface control element to execute corresponding operation; the method can acquire the position information of the interface control element without reading the source code of the system or the application program installed on the terminal, so that the method for acquiring the position information of the interface control element provided by the invention has universality.
Drawings
FIG. 1 is a flowchart illustrating a method for obtaining position information of an interface control element according to an embodiment of the present invention;
Fig. 2 is a block diagram illustrating a specific embodiment of a terminal for obtaining position information of an interface control element according to the present invention;
FIG. 3 is a schematic diagram illustrating the movement rules of the hover button;
description of reference numerals:
1. a processor; 2. a memory.
Detailed Description
In order to explain technical contents, achieved objects, and effects of the present invention in detail, the following description is made with reference to the accompanying drawings in combination with the embodiments.
referring to fig. 1 to 3 of the drawings,
As shown in fig. 1, the present invention provides a method for obtaining position information of an interface control element, including:
S1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
s13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
and S3, adding the coordinate values to a preset interface control element coordinate set.
further, still include:
acquiring more than one target area with the same area as that of the suspension button; the coordinate values of any point in the target area do not belong to the interface control element coordinate set;
And moving the floating button to the target area.
as can be seen from the above description, the method for adjusting the hover button to the area where the non-interface control element is located provided by the present invention does not need to obtain the location information of the interface control element by analyzing the source code, has universality, and can be applied to any system or application program.
further, still include:
calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set;
acquiring a target area corresponding to the minimum distance in the distance set to obtain a nearest target area;
moving a hover button to the proximate target region.
as can be seen from the above description, moving the hover button to the target area closest to the target position desired by the user (i.e., the current position of the hover button) facilitates user operation and is beneficial to improving user experience.
further, still include:
calculating a characteristic value of the first interface graph to obtain a first characteristic value;
binding the first characteristic value and the interface control element coordinate set;
and adding the first characteristic value to a preset interface characteristic value set.
further, still include:
intercepting a current screen image to obtain a third interface image;
calculating a characteristic value of the third interface graph to obtain a second characteristic value;
if the first characteristic value is the same as the second characteristic value in the interface characteristic value set, acquiring a target area according to an interface control element coordinate set corresponding to the first characteristic value; and the coordinate values of any point in the target area do not belong to an interface control element coordinate set corresponding to the first characteristic value.
the above description shows that the target area can be adapted according to the currently displayed interface of the screen, and the method has high flexibility and universality.
further, still include:
Acquiring the resolution of the first interface graph to obtain a first resolution;
Binding the first feature value and the first resolution.
further, still include:
Intercepting a current screen image to obtain a fourth interface image;
calculating a characteristic value of the fourth interface graph to obtain a third characteristic value;
If one first characteristic value and one third characteristic value in the interface characteristic value set are the same, then:
acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
converting the first interface control element coordinate set according to the resolution of the fourth interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
Acquiring a target area according to the second interface control element coordinate set; and the coordinate values of any point in the target area do not belong to the second interface control element coordinate set.
according to the description, the target area can be adapted according to the resolution of the current terminal and the interface displayed by the current screen, and the method has high flexibility and universality.
as shown in fig. 2, the present invention further provides a terminal for obtaining position information of an interface control element, including one or more processors and a memory, where the memory stores a program and is configured to be executed by the one or more processors to perform the following steps:
S1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
S13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
And S3, adding the coordinate values to a preset interface control element coordinate set.
further, still include:
acquiring more than one target area with the same area as that of the suspension button; the coordinate values of any point in the target area do not belong to the interface control element coordinate set;
calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set;
acquiring a target area corresponding to the minimum distance in the distance set to obtain a nearest target area;
moving a hover button to the proximate target region.
further, still include:
Calculating a characteristic value of the first interface graph to obtain a first characteristic value;
Binding the first characteristic value and the interface control element coordinate set;
adding the first characteristic value to a preset interface characteristic value set;
Acquiring the resolution of the first interface graph to obtain a first resolution;
Binding the first feature value and the first resolution;
intercepting a current screen image to obtain a fourth interface image;
calculating a characteristic value of the fourth interface graph to obtain a third characteristic value;
if one first characteristic value and one third characteristic value in the interface characteristic value set are the same, then:
acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
converting the first interface control element coordinate set according to the resolution of the fourth interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
acquiring a target area according to the second interface control element coordinate set; and the coordinate values of any point in the target area do not belong to the second interface control element coordinate set.
the first embodiment of the invention is as follows:
the embodiment provides a method for acquiring position information of an interface control element, which comprises the following steps:
S1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
optionally, after the current screen image is captured, the captured screen image is cut according to a preset top notification bar height value to obtain a first interface diagram, that is, the first interface diagram does not include a top notification bar area; because the top notification bar heights set by different systems are different, the top notification bar area is cut off, so that the method provided by the invention can be suitable for systems of different versions, and the universality of the method for acquiring the position information of the interface control element provided by the invention is improved;
s12, executing a touch operation corresponding to the touch event;
s13, intercepting the current screen image to obtain a second interface image;
optionally, after the current screen image is captured, the captured screen image is cut according to a preset top notification bar height value to obtain a second interface diagram, that is, the second interface diagram does not include a top notification bar area;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
S3, adding the coordinate values to a preset interface control element coordinate set;
s4, calculating a characteristic value of the first interface graph to obtain a first characteristic value; binding the first characteristic value and the interface control element coordinate set; acquiring the resolution of the first interface graph to obtain a first resolution; binding the first feature value and the first resolution; adding the first characteristic value to a preset interface characteristic value set;
s5, intercepting the current screen image to obtain a third interface image; calculating a characteristic value of the third interface graph to obtain a second characteristic value;
optionally, after the current screen image is captured, the captured screen image is cut according to a preset top notification bar height value to obtain a third interface diagram, that is, the third interface diagram does not include a top notification bar area;
s6, if there is one first feature value in the interface feature value set that is the same as the second feature value, then:
s61, acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
S62, converting the first interface control element coordinate set according to the resolution of the third interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
the method for acquiring the position information of the interface control element, provided by the invention, can be suitable for terminals with different resolutions through resolution conversion operation, and has better universality;
s63, acquiring a target area according to the second interface control element coordinate set; the coordinate values of any point in the target area do not belong to the second interface control element coordinate set;
optionally, the method for obtaining the target area according to the second interface control element coordinate set may adopt the following two ways, but is not limited to the following two ways:
the first mode is that more than one target area with the same area as the floating button is obtained; the coordinate values of any point in the target area do not belong to the second interface control element coordinate set; calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set; acquiring a target area corresponding to the minimum distance in the distance set to obtain a nearest target area; moving a hover button to the proximate target area;
in a second mode, as shown in fig. 3, when the floating button is rectangular, the coordinates of the center point of the current floating button, the width of the floating button, and the height of the floating button are obtained, and 4 vertex coordinates of the floating button are calculated; 4 vertex coordinates enclose a rectangular area; and if any coordinate point in the second interface control element coordinate set is contained in the rectangular area, the outer frame of the suspension button is taken as a boundary, the suspension button is moved anticlockwise from inside to outside by taking the height of the suspension button as a unit up and down and the width of the suspension button as a unit left and right, whether any coordinate point in the second interface control element coordinate set is contained in the current rectangular area is judged once, and if the any coordinate point is not contained, the suspension button is not moved.
the second embodiment of the invention is as follows:
The embodiment provides a terminal for acquiring position information of an interface control element, which includes one or more processors 1 and a memory 2, where the memory 2 stores a program and is configured to be executed by the one or more processors 1 to perform the following steps:
S1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
s13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
s3, adding the coordinate values to a preset interface control element coordinate set;
S4, acquiring more than one target area with the same area as the suspension button; the coordinate values of any point in the target area do not belong to the interface control element coordinate set;
s5, calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set;
s6, obtaining a target area corresponding to the minimum distance in the distance set to obtain a nearest target area;
and S7, moving the floating button to the nearest target area.
the third embodiment of the invention is as follows:
the embodiment provides a terminal for acquiring position information of an interface control element, which includes one or more processors 1 and a memory 2, where the memory 2 stores a program and is configured to be executed by the one or more processors 1 to perform the following steps:
s1, when a touch event is sensed,
S11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
S13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
s3, adding the coordinate values to a preset interface control element coordinate set;
s4, calculating a characteristic value of the first interface graph to obtain a first characteristic value; binding the first characteristic value and the interface control element coordinate set; acquiring the resolution of the first interface graph to obtain a first resolution; binding the first feature value and the first resolution; adding the first characteristic value to a preset interface characteristic value set;
s5, intercepting the current screen image to obtain a fourth interface image;
s6, calculating a characteristic value of the fourth interface graph to obtain a third characteristic value; if one first characteristic value and one third characteristic value in the interface characteristic value set are the same, then:
S61, acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
S62, converting the first interface control element coordinate set according to the resolution of the fourth interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
s63, acquiring a target area according to the second interface control element coordinate set; and the coordinate values of any point in the target area do not belong to the second interface control element coordinate set.
in summary, in the method for obtaining position information of an interface control element provided by the present invention, whether a coordinate of a current touch point is in an area where the interface control element is located is identified by comparing a difference between a first interface diagram before performing a touch operation and a second interface diagram after performing the touch operation, and a coordinate of a touch point that can trigger the interface control element to perform a corresponding operation is recorded; the method can acquire the position information of the interface control element without reading the source code of the system or the application program installed on the terminal, so that the method for acquiring the position information of the interface control element provided by the invention has universality. Furthermore, the method for adjusting the floating button to the area where the non-interface control element is located does not need to acquire the position information of the interface control element by analyzing the source code, has universality, and can be applied to any system or application program. Furthermore, the floating button is moved to a target area closest to a target position expected by the user (namely, the current position of the floating button), so that the operation of the user is facilitated, and the improvement of user experience is facilitated. Furthermore, the target area can be adapted according to the currently displayed interface of the screen, and the method has high flexibility and universality. Furthermore, the target area can be adapted according to the resolution of the current terminal and the interface displayed on the current screen, and the method has high flexibility and universality.
the above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all equivalent changes made by using the contents of the present specification and the drawings, or applied directly or indirectly to the related technical fields, are included in the scope of the present invention.

Claims (10)

1. a method for obtaining position information of an interface control element is characterized by comprising the following steps:
s1, when a touch event is sensed,
S11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
S13, intercepting the current screen image to obtain a second interface image;
S2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
And S3, adding the coordinate values to a preset interface control element coordinate set.
2. the method for obtaining interface control element position information according to claim 1, further comprising:
acquiring more than one target area with the same area as that of the suspension button; the coordinate values of any point in the target area do not belong to the interface control element coordinate set;
and moving the floating button to the target area.
3. the method for obtaining interface control element position information according to claim 2, further comprising:
calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set;
acquiring a target area corresponding to the minimum distance in the distance set to obtain a nearest target area;
moving a hover button to the proximate target region.
4. the method for obtaining interface control element position information according to claim 1, further comprising:
calculating a characteristic value of the first interface graph to obtain a first characteristic value;
binding the first characteristic value and the interface control element coordinate set;
And adding the first characteristic value to a preset interface characteristic value set.
5. the method for obtaining interface control element position information according to claim 4, further comprising:
intercepting a current screen image to obtain a third interface image;
calculating a characteristic value of the third interface graph to obtain a second characteristic value;
if the first characteristic value is the same as the second characteristic value in the interface characteristic value set, acquiring a target area according to an interface control element coordinate set corresponding to the first characteristic value; and the coordinate values of any point in the target area do not belong to an interface control element coordinate set corresponding to the first characteristic value.
6. the method for obtaining interface control element position information according to claim 4, further comprising:
acquiring the resolution of the first interface graph to obtain a first resolution;
binding the first feature value and the first resolution.
7. the method for obtaining interface control element position information according to claim 6, further comprising:
intercepting a current screen image to obtain a fourth interface image;
calculating a characteristic value of the fourth interface graph to obtain a third characteristic value;
if one first characteristic value and one third characteristic value in the interface characteristic value set are the same, then:
Acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
Converting the first interface control element coordinate set according to the resolution of the fourth interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
acquiring a target area according to the second interface control element coordinate set; and the coordinate values of any point in the target area do not belong to the second interface control element coordinate set.
8. a terminal for obtaining interface control element position information, comprising one or more processors and a memory, the memory storing a program and configured to perform the following steps by the one or more processors:
s1, when a touch event is sensed,
s11, intercepting the current screen image to obtain a first interface image;
s12, executing a touch operation corresponding to the touch event;
S13, intercepting the current screen image to obtain a second interface image;
s2, when the similarity of the first interface diagram and the second interface diagram is smaller than a preset threshold value, obtaining coordinate values of more than one touch point corresponding to the touch event;
and S3, adding the coordinate values to a preset interface control element coordinate set.
9. The terminal for obtaining the position information of the interface control element according to claim 8, further comprising:
acquiring more than one target area with the same area as that of the suspension button; the coordinate values of any point in the target area do not belong to the interface control element coordinate set;
calculating the distance between the central point of more than one target area and the central point of the suspension button to obtain a distance set;
acquiring a target area corresponding to the minimum distance in the distance set to obtain a nearest target area;
moving a hover button to the proximate target region.
10. the terminal for obtaining the position information of the interface control element according to claim 8, further comprising:
Calculating a characteristic value of the first interface graph to obtain a first characteristic value;
binding the first characteristic value and the interface control element coordinate set;
Adding the first characteristic value to a preset interface characteristic value set;
Acquiring the resolution of the first interface graph to obtain a first resolution;
binding the first feature value and the first resolution;
intercepting a current screen image to obtain a fourth interface image;
Calculating a characteristic value of the fourth interface graph to obtain a third characteristic value;
If one first characteristic value and one third characteristic value in the interface characteristic value set are the same, then:
acquiring an interface control element coordinate set corresponding to the first characteristic value to obtain a first interface control element coordinate set;
Converting the first interface control element coordinate set according to the resolution of the fourth interface graph and the resolution corresponding to the first characteristic value to obtain a second interface control element coordinate set;
acquiring a target area according to the second interface control element coordinate set; and the coordinate values of any point in the target area do not belong to the second interface control element coordinate set.
CN201710594061.9A 2017-07-20 2017-07-20 method and terminal for acquiring position information of interface control element Active CN107463327B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710594061.9A CN107463327B (en) 2017-07-20 2017-07-20 method and terminal for acquiring position information of interface control element

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710594061.9A CN107463327B (en) 2017-07-20 2017-07-20 method and terminal for acquiring position information of interface control element

Publications (2)

Publication Number Publication Date
CN107463327A CN107463327A (en) 2017-12-12
CN107463327B true CN107463327B (en) 2019-12-17

Family

ID=60546886

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710594061.9A Active CN107463327B (en) 2017-07-20 2017-07-20 method and terminal for acquiring position information of interface control element

Country Status (1)

Country Link
CN (1) CN107463327B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108449640B (en) * 2018-03-26 2021-05-07 广州虎牙信息科技有限公司 Live video output control method and device, storage medium and terminal
CN112231032A (en) * 2019-12-10 2021-01-15 北京来也网络科技有限公司 Software interface element access method and device combining RPA and AI
CN111580902B (en) * 2020-04-20 2024-01-26 微梦创科网络科技(中国)有限公司 Mobile terminal element positioning method and system based on picture analysis
CN112044061B (en) * 2020-08-11 2022-05-06 腾讯科技(深圳)有限公司 Game picture processing method and device, electronic equipment and storage medium
CN115033091B (en) * 2021-03-03 2023-08-11 上海艾为电子技术股份有限公司 Method and device for reducing power consumption of handheld mobile device

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9223134B2 (en) * 2010-02-28 2015-12-29 Microsoft Technology Licensing, Llc Optical imperfections in a light transmissive illumination system for see-through near-eye display glasses
US9280277B2 (en) * 2012-07-11 2016-03-08 Bae Systems Information And Electronic Systems Integration Inc. Smart phone like gesture interface for weapon mounted systems
CN104252410B (en) * 2013-06-27 2017-12-22 阿里巴巴集团控股有限公司 The method and apparatus that a kind of control in the page is tested
CN104346085A (en) * 2013-07-25 2015-02-11 北京三星通信技术研究有限公司 Control object operation method and device and terminal device
CN103645890B (en) * 2013-11-29 2017-12-01 北京奇虎科技有限公司 A kind of method and apparatus for being used for orient control in graphical user interfaces
CN103793137B (en) * 2014-01-23 2017-12-29 联想(北京)有限公司 A kind of display methods and electronic equipment
CN104866414B (en) * 2014-02-24 2018-07-06 腾讯科技(深圳)有限公司 The test method of application program, apparatus and system
CN105302408A (en) * 2014-06-24 2016-02-03 腾讯科技(深圳)有限公司 Method and apparatus for adjusting position of hover button and terminal
CN104391797B (en) * 2014-12-09 2017-11-10 北京奇虎科技有限公司 The recognition methods of GUI controls and device
CN105808416B (en) * 2014-12-27 2018-04-13 南车株洲电力机车研究所有限公司 A kind of automated testing method and system of man-machine figure interactive interface
CN106775195B (en) * 2016-11-16 2018-09-18 竞技世界(北京)网络技术有限公司 A kind of control method and device of suspension button
CN106775223A (en) * 2016-11-30 2017-05-31 宇龙计算机通信科技(深圳)有限公司 The control method and terminal device of suspension button

Also Published As

Publication number Publication date
CN107463327A (en) 2017-12-12

Similar Documents

Publication Publication Date Title
CN107463327B (en) method and terminal for acquiring position information of interface control element
CN107992275B (en) Document printing method and device, computer equipment and storage medium
US20130201534A1 (en) Document assembly and automated contextual form generation
KR102310903B1 (en) Touch detection method and computer readable storage medium
CN110851299A (en) Automatic flow exception eliminating method, device, equipment and storage medium
CN112101317B (en) Page direction identification method, device, equipment and computer readable storage medium
CN110297681B (en) Image processing method, device, terminal and storage medium
CN111104036B (en) Element control method, device, equipment and storage medium
CN112686919B (en) Object boundary line determining method and device, electronic equipment and storage medium
CN106201234A (en) The inspection method of content of pages and device
CN113282488B (en) Terminal test method and device, storage medium and terminal
US20140063073A1 (en) Electronic device and method for controlling movement of images on screen
US20150169134A1 (en) Methods circuits apparatuses systems and associated computer executable code for providing projection based human machine interfaces
JPH0348922A (en) Pointing cursor predictive moving device
KR101158679B1 (en) Method for directly inputting figure on electronic document, and computer-readable recording medium storing program of directly inputting figure on electronic document
US10303349B2 (en) Image-based application automation
US20140189486A1 (en) Non-Transitory Computer Readable Medium Storing Document Sharing Program, Terminal Device and Document Sharing Method
CN104133578A (en) Touch screen panel display and touch key input system
CN110955379B (en) Control method of mobile terminal, mobile terminal and storage medium
CN110458202B (en) Picture processing method, device and equipment and computer readable storage medium
EP2784652A2 (en) Information processing apparatus, information processing method, and information processing program
KR101503640B1 (en) Apparatus and method for supporting electronic signature
JP5834253B2 (en) Image processing apparatus, image processing method, and image processing program
CN113253891B (en) Terminal control method and device, storage medium and terminal
CN106598446B (en) Screenshot method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant