CN110989895B - Control display state detection method and device - Google Patents
Control display state detection method and device Download PDFInfo
- Publication number
- CN110989895B CN110989895B CN201910979146.8A CN201910979146A CN110989895B CN 110989895 B CN110989895 B CN 110989895B CN 201910979146 A CN201910979146 A CN 201910979146A CN 110989895 B CN110989895 B CN 110989895B
- Authority
- CN
- China
- Prior art keywords
- control
- effective display
- display state
- effective
- detected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3438—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment monitoring of user actions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Abstract
The invention discloses a control display state detection method and device, which are suitable for the technical field of personal information processing. The method comprises the following steps: acquiring coordinates of an effective display area of a control to be detected; calculating a corresponding control overlapping area according to the coordinates of the effective display area; the proportion of the effective display area occupied by the control overlapping area is less than an effective threshold value, and the corresponding control is marked to be in an effective display state; the duration of time the control is in the active display state is recorded. The apparatus is for performing a method. The method and the device determine the position of a specific area capable of outputting information by acquiring the coordinates of the effective display area of the control to be detected, judge/mark the corresponding control to be in an effective display state according to the effective threshold value by calculating the control overlapping area, record the duration, distinguish which controls are concerned by the user according to the length of the duration, are favorable for judging the requirements of the user, can distinguish which controls are concerned by the user, and are favorable for judging the requirements of the user.
Description
Technical Field
The invention relates to the technical field of personal information processing, in particular to a method and a device for detecting a display state of a control.
Background
In the commercial field, if the requirements of users can be acquired correctly, products can be output in a targeted manner, and cost reduction is facilitated.
With the progress of information technology, users can conveniently acquire desired services through software such as APP (application). In consideration of the breadth and depth of the user's needs, information providing software provides a large amount of information for the user to select. Meanwhile, a large amount of information is output through various controls, such as video, voice, mini-games, text, pictures, and the like.
Although various controls can output information, no good judgment method is provided for how users look at the controls and how the actual output effects of the controls are. Moreover, users often perform multiple controls or tasks simultaneously, where it is difficult to determine which control is the primary focus of the customer. Therefore, the demand tendency of the user cannot be obtained efficiently.
Disclosure of Invention
Embodiments of the present invention aim to address, at least to some extent, one of the technical problems in the related art. Therefore, an object of the embodiments of the present invention is to provide a method and an apparatus for detecting a display state of a control.
The technical scheme adopted by the invention is as follows:
in a first aspect, an embodiment of the present invention provides a method for detecting a display state of a control, including: acquiring coordinates of an effective display area of a control to be detected; calculating a corresponding control overlapping area according to the coordinates of the effective display area; and marking the control to be detected as an effective display state when the proportion of the control overlapping area in the effective display area is less than an effective threshold value. The position of a specific area capable of outputting information is determined by acquiring the coordinates of the effective display area of the control to be detected, and the corresponding control is judged/marked to be in an effective display state according to the effective threshold value by calculating the control overlapping area.
Preferably, the obtaining the coordinates of the effective display area of the control to be detected includes: detecting an operation event of a display interface and starting a timer; determining an execution time based on an execution frequency and the timer; and acquiring the coordinates of the effective display area of the control to be detected based on the execution time. By detecting the operation of the display interface, the starting point of the user operation can be determined, and the timer can determine the execution time of each subsequent step and the time of the cycle execution in combination with the execution frequency.
Preferably, the operation event includes controlling the control to be detected through an indication point in a display interface and/or controlling the display interface through the indication point; and setting the execution frequency according to the time and the behavior attribute of the control behavior executed by the indication point. The purpose of the preferred scheme is to determine different detection schemes according to different behaviors, which is beneficial to data processing applicable to different user layers and provides targeted processing.
Preferably, the control display state detection method further comprises monitoring the duration of the control in the effective display state;
and marking the control to be detected to be in an effective display state, wherein the proportion of the control overlapping area in the effective display area is less than an effective threshold, and the duration is greater than a preset limit threshold. The duration is recorded, which controls can be distinguished according to the length of the duration, so that the requirements of a user can be judged, and in the actual operation of the user, a situation can occur, namely, when the controls are operated, the two controls are occasionally contacted in a short time, so that the controls are overlapped, and for the purpose of eliminating errors, the duration is required to be greater than a certain threshold value, so that the accuracy of control display state detection is improved.
Preferably, according to the coordinates of the effective display area, a corresponding control overlapping area is calculated, the control overlapping area does not exist, and the control to be detected is marked to be in an effective display state. If the control overlapping area does not exist, it is indicated that all the controls which are already running belong to the state capable of effectively outputting information, namely the requirements of customers are all met.
In a second aspect, an embodiment of the present invention provides a device for detecting a display state of a control, including:
the position unit is used for acquiring the coordinates of the effective display area of the control to be detected;
the duplication checking unit is used for calculating a corresponding control superposition area according to the coordinates of the effective display area;
and the judging unit is used for marking the control to be detected as an effective display state when the proportion of the control overlapping area occupying the effective display area is less than an effective threshold value.
And the recording unit is used for recording the duration of the control in the effective display state.
The position unit determines the position of a specific area capable of outputting information by acquiring the coordinates of an effective display area of the control to be detected, the duplication checking unit calculates the control superposition area, and the judging unit judges/marks the corresponding control to be in an effective display state according to an effective threshold.
Preferably, the control display state detection device further includes:
the trigger unit is used for detecting an operation event of the display interface and starting the timer;
a timing unit for determining an execution time based on an execution frequency and the timer;
correspondingly, the position unit is used for acquiring the coordinates of the effective display area of the control to be detected based on the execution time.
Preferably, the operation event includes controlling the control to be detected through an indication point in a display interface and/or controlling the display interface through the indication point;
and setting the execution frequency according to the time and the behavior attribute of the control behavior executed by the indication point.
Preferably, the control display state detection device further includes:
the recording unit is used for recording the duration of the control in the effective display state;
the control overlapping area of the judging unit occupies a proportion less than an effective threshold value in the effective display area, the duration time is longer than a preset limit threshold value, and the control to be detected is marked to be in an effective display state.
Preferably, the judging unit marks the corresponding control as an effective display state when no control overlapping area exists.
Drawings
FIG. 1 is a flow diagram of one embodiment of a control display state detection method;
FIG. 2 is a flow diagram of one embodiment of a control display state detection process;
fig. 3 is a connection diagram of a control display state detection apparatus.
Detailed Description
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Example 1.
The embodiment provides a method for detecting a display state of a control, as shown in fig. 1, which includes the steps of:
s1, obtaining the coordinates of the effective display area of the control to be detected;
s2, calculating a corresponding control overlapping area according to the coordinates of the effective display area;
s3, marking the corresponding control as an effective display state when the proportion of the effective display area occupied by the control overlapping area is less than an effective threshold value;
various application programs, which are simply referred to as applications, can be executed through electronic devices such as mobile phones, iPads, notebook computers and the like. It is an object of the present invention to detect the display state of various controls in an application to determine the level of user interest in the controls.
Although the purpose of the different controls is to output information in step S1, the layouts of the controls themselves are not necessarily consistent, for example, the means for outputting information by the browser is mainly to provide information such as characters, numbers, audio/video through corresponding linked windows, and the browser includes various elements such as toolbars to assist in outputting information. The window specifying the link of the browser belongs to the effective display area. The content and the range of the effective display area can be marked manually by various mainstream controls. Therefore, the effective display area of the control of the main stream can be specified in a preset manner. The coordinates are coordinates of display pixels inside the display interface, and the display interface is a carrier for outputting visual information for the display of the electronic device.
In step S2, calculating the control overlapping area according to the coordinates belongs to the technical features that can be realized by those skilled in the art based on conventional means, and the embodiment will not be further described.
In step S3, the valid threshold is a settable parameter, and the attribute of an object is determined/set according to the threshold, which belongs to the technical features that can be realized by those skilled in the art based on conventional means, and the embodiment will not be further described.
In this embodiment, step S4 is further included to record the duration of the control in the effective display state, record the duration of all the controls that need to be detected in the effective display state, and form a corresponding storage record by combining the attribute of each control itself. The attribute of the control is the type of the control; information of the provider of the control; what information the control specifically provides, etc. And when the proportion of the control overlapping area in the effective display area is less than an effective threshold value and the duration is greater than a preset limit threshold value, marking the control to be detected as an effective display state. In the actual operation of a user, a situation may occur, that is, when a control is operated, short-time contact between two controls may occasionally occur, resulting in control overlap, and for the purpose of eliminating errors, the duration is required to be greater than a certain threshold, so as to improve the accuracy of detection of the display state of the control.
For optional step S0, an operational event of the display interface is detected, a timer is started, and an execution time is determined based on the execution frequency and the timer.
Starting from the occurrence of the operation event on the display interface, starting a timer, and determining and judging the execution time based on the execution frequency and the timer. The execution frequency is the frequency of the display state detection of the cyclic execution control, and the cyclic frequency can be changed. Specifically, the cycle may be performed every 10 seconds. The method aims to reduce the probability of abnormity of the method/processing flow and improve the running stability of the method/processing flow. The timer here may serve the purpose of counting the starting point of time. By detecting the operation event of the display interface, the starting point of the user operation can be determined, and the timer can determine the execution time of each subsequent step and the time of the cycle execution in combination with the execution frequency.
Executing the above steps S1-4, it is necessary to determine that the user has entered the stage of the attention control, and this embodiment adopts a manner of detecting an operation event of the display interface, where the operation event is an action of changing for each element in the display interface and for the attribute of the display interface itself. For example, the display interface is turned on or off, and the color and size of the display interface are changed.
The method specifically comprises the step of controlling the control to be detected through an indication point in the display interface and/or controlling the display interface through the indication point. The display interface has a point as a destination of the behavior, namely a mouse point in a classical example, and the point is used as an indicator of the behavior; the control to be detected can be selected, cancelled and dragged through the indication point; the display interface itself can also be controlled, for example, the mobile phone can expand or contract the display interface through the operation of two fingers. The indication point is sometimes not a point recognizable by naked eyes, but at the level of an operating system, two coordinate points are necessarily present as the indication points of the contact of the finger with the screen; the behavior attribute is the above operation of selecting, canceling and dragging, enlarging or reducing the display interface, and the like, and in addition, the execution frequency can be set according to the time of executing the control behavior by the indication point and the behavior attribute for use in the subsequent steps.
By detecting the operation event, it can be judged that the user has formally used the electronic device.
With respect to step S2, there is a step S21 of a variation of the control display state detection procedure shown in fig. 2: and calculating a corresponding control overlapping area according to the coordinates of the effective display area, judging whether the control overlapping area exists or not, if the control overlapping area does not exist, marking the corresponding control to be in an effective display state, and executing the step S4, otherwise, executing the step S3.
The purpose of step S21 is to directly determine that the control corresponding to the mark is in the valid display state and directly record the duration when there is no control overlap area. At this time, the starting time of the effective display state is the control generation/loading time recorded by the timer; the termination time is the time when the control overlapping area is larger than the effective threshold value, or the time when the control is cancelled.
The operation event comprises controlling the control to be detected through an indication point in the display interface and/or controlling the display interface through the indication point, and setting execution frequency according to the time and behavior attribute of the indication point for executing the control behavior.
For example, if the control a is selected and dragged for 10 seconds, the corresponding execution frequency is 3 seconds, that is, the above-mentioned control display state detection method is executed every 3 seconds. The method aims to determine different detection schemes according to different behaviors, is beneficial to being suitable for data processing of different user layers, and provides pertinence.
Example 2.
The purpose of this embodiment is to provide a method for detecting a display state of a control applicable to a mobile phone, including the steps of:
and monitoring screen touch events, wherein the specific touch events are represented by that a finger slides across the touch screen.
When the user generates a touch event, the timer is started, and the steps S1-4 in embodiment 1 are executed every S milliseconds, where the value of S can be determined according to the speed of the user touch and the configuration of the external input.
The value of S may be based on the following:
take the sliding speed M when the user last touches the screen, for example: the last touch by the user, finger from the top of the screen: 100px is slid to 300px and then the finger is removed, assuming that 1 second is elapsed in the middle, the user's sliding speed is 200 px/second.
The corresponding selection formula:
when M < 200 px/S, S is 200 milliseconds;
when M < 400 px/S, S equals 100 milliseconds;
when M >400 px/sec, S is 50 msec.
If the hardware performance of the mobile phone of the user is stronger (CPU and memory), the value of S can be further improved.
The value of N may be based on the following:
take the sliding speed M when the user last touches the screen, for example: the last touch by the user, finger from the top of the screen: 100px is slid to 300px and then the finger is removed, assuming that 1 second is elapsed in the middle, the user's sliding speed is 200 px/second.
The corresponding selection formula:
when M < ═ 200 px/s, N < ═ 2 seconds;
when M < ═ 400 px/second, N < ═ 3 seconds;
when M is more than 400 px/s, N is 4 s.
If the hardware performance of the mobile phone of the user is stronger (CPU and memory), the value of N can be further improved.
Example 3.
The present embodiment provides a control display state detection apparatus as shown in fig. 3, including:
the trigger unit 1 is used for detecting an operation event of a display interface and starting a timer;
a timing unit 2 for determining an execution time based on the execution frequency and the timer;
the position unit 3 is used for acquiring the coordinates of the effective display area of the control to be detected;
the duplication checking unit 4 is used for calculating a corresponding control superposition area according to the coordinates of the effective display area;
the judging unit 5 is used for marking the corresponding control as an effective display state when the proportion of the effective display area occupied by the control overlapping area is less than an effective threshold value; and when the control overlapping area does not exist, marking the corresponding control as an effective display state.
In this embodiment, a recording unit 6 is further included for recording the duration of time that the control is in the active display state. And the judging unit 5 marks the control to be detected as an effective display state when the proportion of the control overlapping area in the effective display area is less than an effective threshold and the duration is greater than a preset limit threshold.
While the preferred embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (6)
1. A method for detecting a display state of a control is characterized by comprising the following steps:
acquiring coordinates of an effective display area of a control to be detected;
calculating a corresponding control overlapping area according to the coordinates of the effective display area;
the proportion of the control overlapping area in the effective display area is less than an effective threshold value, and the control to be detected is marked to be in an effective display state;
recording the duration of the control in the effective display state, and forming a corresponding storage record by combining the attribute of each control;
the obtaining of the coordinates of the effective display area of the control to be detected includes:
detecting an operation event of a display interface and starting a timer;
determining an execution time based on an execution frequency and the timer;
acquiring the coordinates of the effective display area of the control to be detected based on the execution time;
the operation event comprises controlling the control to be detected through an indication point in a display interface and/or controlling the display interface through the indication point;
and setting the execution frequency according to the time and the behavior attribute of the control behavior executed by the indication point.
2. The method for detecting the display state of the control according to claim 1, further comprising monitoring the duration of the control in the active display state;
and marking the control to be detected to be in an effective display state, wherein the proportion of the control overlapping area in the effective display area is less than an effective threshold, and the duration is greater than a preset limit threshold.
3. The method for detecting the display state of the control according to any one of claims 1 to 2, wherein a corresponding control overlapping region is calculated according to the coordinates of the effective display region, and the control to be detected is marked as the effective display state if the control overlapping region does not exist.
4. A detection device for a display state of a control, comprising:
the position unit is used for acquiring the coordinates of the effective display area of the control to be detected;
the duplication checking unit is used for calculating a corresponding control superposition area according to the coordinates of the effective display area;
the judging unit is used for marking the control to be detected to be in an effective display state when the proportion of the control overlapping area occupying the effective display area is less than an effective threshold value;
the recording unit is used for recording the duration time of the controls in the effective display state and forming corresponding storage records by combining the attributes of each control;
the trigger unit is used for detecting an operation event of the display interface and starting the timer;
a timing unit for determining an execution time based on an execution frequency and the timer;
correspondingly, the position unit is used for acquiring the coordinates of the effective display area of the control to be detected based on the execution time;
the operation event comprises controlling the control to be detected through an indication point in a display interface and/or controlling the display interface through the indication point;
and setting the execution frequency according to the time and the behavior attribute of the control behavior executed by the indication point.
5. The apparatus for detecting the display status of a control according to claim 4, further comprising:
the recording unit is used for recording the duration of the control in the effective display state;
the control overlapping area of the judging unit occupies a proportion less than an effective threshold value in the effective display area, the duration time is longer than a preset limit threshold value, and the control to be detected is marked to be in an effective display state.
6. The apparatus according to any one of claims 4 to 5, wherein the determining unit marks the corresponding control as an active display state when there is no control overlapping area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910979146.8A CN110989895B (en) | 2019-10-15 | 2019-10-15 | Control display state detection method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910979146.8A CN110989895B (en) | 2019-10-15 | 2019-10-15 | Control display state detection method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110989895A CN110989895A (en) | 2020-04-10 |
| CN110989895B true CN110989895B (en) | 2021-11-19 |
Family
ID=70082024
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910979146.8A Active CN110989895B (en) | 2019-10-15 | 2019-10-15 | Control display state detection method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110989895B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112988586B (en) * | 2021-03-25 | 2023-07-14 | 腾讯科技（深圳）有限公司 | Control testing method and device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102446192A (en) * | 2010-09-30 | 2012-05-09 | 国际商业机器公司 | Method and device for estimating attention in virtual world |
| CN104750358A (en) * | 2015-03-09 | 2015-07-01 | 深圳市艾优尼科技有限公司 | Terminal |
| CN105843383A (en) * | 2016-03-21 | 2016-08-10 | 努比亚技术有限公司 | Application starting device and application starting method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4883791B2 (en) * | 2007-04-04 | 2012-02-22 | キヤノン株式会社 | Information processing apparatus and display method |
| CN104102420B (en) * | 2013-04-01 | 2018-03-13 | 腾讯科技（深圳）有限公司 | The method and user terminal of user terminal control interface control |
-
2019
- 2019-10-15 CN CN201910979146.8A patent/CN110989895B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102446192A (en) * | 2010-09-30 | 2012-05-09 | 国际商业机器公司 | Method and device for estimating attention in virtual world |
| CN104750358A (en) * | 2015-03-09 | 2015-07-01 | 深圳市艾优尼科技有限公司 | Terminal |
| CN105843383A (en) * | 2016-03-21 | 2016-08-10 | 努比亚技术有限公司 | Application starting device and application starting method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110989895A (en) | 2020-04-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102033863B1 (en) | Device and method for processing touch input based on intensity | |
| US10042546B2 (en) | Systems and methods to present multiple frames on a touch screen | |
| US9756140B2 (en) | Tracking user behavior relative to a network page | |
| US8930852B2 (en) | Touch screen folder control | |
| KR101892315B1 (en) | Touch event anticipation in a computing device | |
| JP6214547B2 (en) | Measuring the rendering time of a web page | |
| CA2798507C (en) | Input pointer delay and zoom logic | |
| KR20120066122A (en) | Method and device for controlling touch screen using timeline bar, recording medium for program for the same, and user terminal having the same | |
| US20090228873A1 (en) | Display breakpointing based on user interface events | |
| WO2014118602A1 (en) | Emulating pressure sensitivity on multi-touch devices | |
| CN107608551B (en) | Touch operation response method and device | |
| US9021437B2 (en) | Declarative style rules for default touch behaviors | |
| TWI610220B (en) | Apparatus and method for automatically controlling display screen density | |
| US20140372903A1 (en) | Independent Hit Testing for Touchpad Manipulations and Double-Tap Zooming | |
| US9684445B2 (en) | Mobile gesture reporting and replay with unresponsive gestures identification and analysis | |
| CN110989895B (en) | Control display state detection method and device | |
| US9501210B2 (en) | Information processing apparatus | |
| JP5204343B1 (en) | Test system and program | |
| WO2015174110A1 (en) | Information-processing apparatus, information-processing method, and program | |
| CN111610900B (en) | Page display processing method, system and storage medium | |
| CN110990212A (en) | Control state detection method and device | |
| US9703469B2 (en) | Distinguishing between impulses and continuous drag operations on a touch-sensitive surface | |
| TWI493434B (en) | Electrcal device and adjustment method of application interface | |
| TW201426503A (en) | Method for enhancing the touch success rate of a touch-display device and electronic device using the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |