CN103885592A - Method and device for displaying information on screen - Google Patents
Method and device for displaying information on screen Download PDFInfo
- Publication number
- CN103885592A CN103885592A CN201410093097.5A CN201410093097A CN103885592A CN 103885592 A CN103885592 A CN 103885592A CN 201410093097 A CN201410093097 A CN 201410093097A CN 103885592 A CN103885592 A CN 103885592A
- Authority
- CN
- China
- Prior art keywords
- area
- screen
- eyeball
- working state
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 210000005252 bulbus oculi Anatomy 0.000 claims abstract description 115
- 210000001508 eye Anatomy 0.000 claims description 16
- 230000000694 effects Effects 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 6
- 230000004044 response Effects 0.000 description 4
- 230000003111 delayed effect Effects 0.000 description 3
- 230000007958 sleep Effects 0.000 description 2
- 230000002155 anti-virotic effect Effects 0.000 description 1
- 230000001680 brushing effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000006266 hibernation Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses a method and device for displaying information on a screen, and relates to the technical field of intelligent terminals. By means of the method and the device, an area where the user is focused on the screen at present can be determined by tracking a point where the eyeballs of a user are focused on the screen, and data are displayed on the area where the use is focused. The method includes the steps of determining the area where the eyeballs of the user of an operated electronic terminal are focused on the screen at present through an eyeball tracking sensor, and displaying target data on the determined area. The electronic terminal at least comprises the eyeball tracking sensor and the screen, wherein the eyeball tracking sensor is used for tracking eyeball movement conditions and determining the position where the current eyeball focus point is located. The method and device for displaying information on the screen are suitable for operating electronic devices through no fingers.
Description
Technical Field
The invention relates to the technical field of intelligent terminals, in particular to a method and a device for displaying information on a screen.
Background
Intelligent terminals such as smart phones and PADs have become important tools for people to acquire information in daily life. The operation mode of the intelligent terminal on the market at present is developed from keyboard operation to touch operation, so that a user can complete operation in a mode as simple as possible when holding the intelligent terminal, and particularly when reading a webpage, a short message and an email, the user can trigger the intelligent terminal to display information to be read on a screen only by performing simple sliding operation.
However, the current intelligent terminal still needs to be operated by the hand of the user. The user needs to call out information to be read through finger touch operation, display the information on a screen, then read the information, and perform operations of page turning, marking, display window adjustment and the like through the finger touch operation in the reading process. And many times, when the user tends to keep both hands free, such as: when the user is busy with the hands such as brushing teeth and playing games, if the user wants to read information, the user needs to stop other actions on the hands and operate the intelligent terminal through fingers, so that the information which the user wants to read is called out and displayed on a screen. Therefore, in the process of actually using the intelligent terminal, the user often delays other things at hand due to the need to make hands free to operate the intelligent terminal.
Disclosure of Invention
Embodiments of the present invention provide a method and an apparatus for displaying information on a screen, which are capable of determining an area of interest of a user on the screen by tracking a focus of an eyeball of the user focused on the screen, and displaying data on the area of interest of the user.
In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:
in a first aspect, an embodiment of the present invention provides a method for displaying information on a screen, where the method is used for an electronic terminal, where the electronic terminal at least includes an eyeball tracking sensor and a screen, and the eyeball tracking sensor is used for tracking an eyeball activity condition and determining a position of a current focus of an eyeball; the method comprises the following steps:
determining, by the eye tracking sensor, an area currently on the screen focused by eyes of a user operating the electronic terminal;
displaying the target data on the determined area.
In a first aspect, an embodiment of the present invention provides an apparatus for displaying information on a screen, where the apparatus is used for an electronic terminal, where the electronic terminal at least includes an eyeball tracking sensor and a screen, and the eyeball tracking sensor is used for tracking an eyeball activity condition and determining a position of a current focus of an eyeball; the device comprises:
the positioning module is used for determining an area focused by eyeballs of a user operating the electronic terminal on the screen by using the eyeball tracking sensor;
and the display module is used for displaying the target data on the determined area.
According to the method and the device for displaying information on the screen, provided by the embodiment of the invention, the eyeball tracking sensor can be utilized to determine the area focused by the eyeballs of the user operating the electronic terminal on the screen; displaying the target data on the determined area. Compared with the scheme that the user can display data on the screen only through finger operation in the prior art, the method and the device for displaying the data on the screen determine the area focused by the user on the screen currently by tracking the focus of the eyeball of the user on the screen, and display the data on the area focused by the user. Therefore, when a user uses the electronic equipment, particularly when the data required by the user needs to be displayed on a screen, the user does not need to leave hands for operation, and other things on hand are prevented from being delayed.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a method for displaying information on a screen according to an embodiment of the present invention;
FIG. 2 is a flow chart of another method for displaying information on a screen according to an embodiment of the present invention;
FIG. 2a is a schematic diagram of an embodiment of the present invention;
FIG. 3 is a flowchart of another method for displaying information on a screen according to an embodiment of the present invention;
FIG. 4 is a flowchart of another method for displaying information on a screen according to an embodiment of the present invention;
FIG. 4a is a schematic diagram of another embodiment of the present invention;
FIGS. 5a and 5b are schematic diagrams of another embodiment of the present invention;
fig. 6 is a schematic structural diagram of an apparatus for displaying information on a screen according to an embodiment of the present invention;
FIG. 7 is a schematic structural diagram of another apparatus for displaying information on a screen according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of another apparatus for displaying information on a screen according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used to describe various modules, units, connection ports and identification information in embodiments of the present invention, these modules, units, connection ports and identification information should not be limited to these terms. These terms are only used to distinguish one module, unit, connection port, and identification information from another. For example, a first connection port may also be referred to as a second connection port, and similarly, a second connection port may also be referred to as a first connection port, without departing from the scope of embodiments of the present invention.
The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrase "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)" depending on the context "
An embodiment of the present invention provides a method for displaying information on a screen, as shown in fig. 1, including:
and 101, determining an area focused by eyeballs of a user operating the electronic terminal on the screen by using the eyeball tracking sensor.
The embodiment of the invention can be used for an electronic terminal, which at least comprises an eyeball tracking sensor and a screen, wherein the eyeball tracking sensor is used for tracking the activity condition of eyeballs and determining the position of the current focus of the eyeballs. The screen is used for displaying data such as short messages, interface windows of various applications, text/picture information and the like.
And 102, displaying the target data on the determined area.
It can be understood that the target data mentioned in the embodiment of the present invention is one or a combination of multiple data such as short messages, interface windows of various applications, text/picture information, and the like, which need to be displayed on a screen.
According to the method for displaying information on the screen, provided by the embodiment of the invention, the eyeball tracking sensor can be utilized to determine the area focused by the eyeballs of the user operating the electronic terminal on the screen at present. Displaying the target data on the determined area. Compared with the scheme that the user can display data on the screen only through finger operation in the prior art, the method and the device for displaying the data on the screen determine the area focused by the user on the screen currently by tracking the focus of the eyeball of the user on the screen, and display the data on the area focused by the user. Therefore, when a user uses the electronic equipment, particularly when the data required by the user needs to be displayed on a screen, the user does not need to leave hands for operation, and other things on hand are prevented from being delayed.
On the basis of the method flow shown in fig. 1, the embodiment of the present invention further provides a scheme shown in fig. 2:
and 201, determining an area focused by eyeballs of a user operating the electronic terminal on the screen by using the eyeball tracking sensor.
202, detecting whether the area focused by the eyeball is in a first working state.
Wherein the screen is divided into at least two regions. Wherein one region has at least two operating states, and power consumption when one region is in a first operating state is lower than power consumption when one region is in a second operating state. Specifically, the first operating state may include states of hibernation, dimming brightness, turning off backlight, and the like; the second working state is a state that the screen normally runs and displays data. When the screen normally displays data, the backlight is often required to be turned on; increasing the screen brightness according to the ambient brightness or the system setting; and waking up from a sleep state and other processes, so that the power consumption of the screen in normal data display is higher than that in the states of sleeping, dimming brightness, turning off backlight and the like.
In this embodiment, as shown in fig. 2a, a screen of the electronic device may be divided into a plurality of regions that do not overlap with each other, and the operating states of the regions may be controlled separately by using a split-screen technique, for example, when a focus of an eyeball of a user is located in a region 4, the electronic device may switch the regions 1, 2, 3, 5, and 6 to a sleep state, and turn off backlights of the regions 1, 2, 3, 5, and 6; or the electronic device may turn the brightness of regions 1, 2, 3, 5, 6 to the lowest and turn off the backlight for regions 1, 2, 3, 5, 6. So that only the area 4 is kept in an operating state in which it can be used at any time for displaying data.
And 203, if the eyeball is in the first working state, switching the area focused by the eyeball to the second working state.
And if the second working state is reached, executing 204.
And 204, displaying the target data on the determined area.
As shown in fig. 3, after 102 or 204, the embodiment of the present invention may further include the following scheme:
301, using the eye tracking sensor, tracking a focus of an eye of a user of the electronic terminal to move from the first area to the second area, where the first area is in the second working state and the second area is in the first working state.
The area focused by the eyeballs is a first area, and the electronic equipment displays target data in the first area.
And 302, switching the second area to the second working state, and displaying the target data in the second area.
303, switching the first area to the first working state.
In order to further save the power consumption of the screen, before the target data is displayed on the determined area, the electronic device may further take measures for reducing the power consumption, such as sleeping, dimming the brightness, turning off the backlight, and the like, for a part of the area on the screen, wherein the area where the measures for reducing the power consumption are taken is mainly an area outside the area focused by the eyeball. Therefore, in the process that the user operates the electronic equipment through eyeball rotation, the power consumption of the screen can be reduced.
Further, in this embodiment, different regions may be divided on the screen of the electronic device, and one region divided on the screen may correspond to at least one application. When the eyeball of the user focuses on one area, the electronic equipment can automatically run the application program corresponding to the area. As shown in fig. 4, a specific implementation of 102 or 204 may include:
401, an application corresponding to an area focused by an eyeball of a user operating the electronic terminal is determined.
For example: as shown in fig. 4a, the screen of the electronic device is divided into 4 areas, and the corresponding relationship between each area and the application program is set in the electronic device, wherein area 1 corresponds to the monitoring program for monitoring the operating state of the electronic device; region 2 corresponds to a time-out program; area 3 corresponds to a message reading program for displaying short messages; the area 4 corresponds to a prompt program for displaying a prompt message indicating that the update message or the alarm message appears when the electronic device receives the update message or when the electronic device runs a program such as antivirus software and the like and the alarm message appears.
And 402, running the corresponding application program.
In this embodiment, the manner of running the application program corresponding to one region may be various, for example, as shown in fig. 4a, when the focus of the eyeball is located in the region 1, icons such as a signal intensity indicator and a remaining power indicator may be displayed on the region 1; when the focus of the eyeball is located in the area 2, a display interface of a time telling program can be displayed on the area 2, and the current time is displayed in the display interface of the time telling program; when the focus of the eyeball is located in the area 3 and the unread short messages exist in the electronic equipment, the specific content of the unread short messages, such as all characters of the unread short messages or the first 10 characters, can be displayed on the area 3; when the focus of the eyeball is located in the area 4, a prompt message may be displayed on the area 4.
It should be noted that, when the electronic device runs an application corresponding to one area and needs to display content corresponding to the application, the content corresponding to the application may be displayed on the area; or may be displayed at a position at the focal point of the eyeball; or displayed in a certain range on a screen centered on the focus of the eyeball without being limited by the size of the region; or all the areas on the screen can be switched to the second working state, and the corresponding content of the application program is displayed through the whole screen.
It should be further noted that, if the electronic device displays the content corresponding to the application program in one area, and the focus of the eyeball on the screen is moved, the electronic device may move the content corresponding to the application program to the position or area to which the focus of the eyeball on the screen is moved latest, such as: at the first time, the focus of the eyeballs on the screen is located in an area 1, the area 1 corresponds to an application program for reading short messages, and unread short messages are displayed on the area 1 of the electronic equipment; then, as the user rotates the eyeball, the focus of the eyeball on the screen moves, and the eyeball moves to the area 2 at the second time, and the electronic equipment can transfer and display the unread short message originally displayed on the area 1 on the area 2.
The method comprises the steps of dividing different areas on a screen of the electronic equipment, and enabling one area divided on the screen to correspond to at least one application program. The number of the application programs which can be called by the user through eyeball rotation can be increased, so that the mode of operating the electronic equipment through eyeballs by the user is more abundant and diversified.
Furthermore, in the actual use process, the gaze of the user can change on the screen at any time, so that the focus of the eyeball on the screen can move continuously, and if a time period is limited, a moving track of the focus of the eyeball on the screen can be obtained.
Further, the embodiment of the present invention may further include the following scheme:
501a, using the eyeball tracking sensor, tracking the focus of the eyeball of the user to move to a first action trigger area.
Wherein at least one action trigger area is divided on the screen. The action trigger area corresponds to at least one operation action.
502a, executing the operation action corresponding to the first action trigger area.
For example: as shown in fig. 5a, 4 action trigger areas are divided along 4 edges of a screen of the electronic device, and directional arrows indicating different directions are displayed on the 4 action trigger areas, wherein an operation action corresponding to the action trigger area 1 is to turn up a page; the operation action corresponding to the action triggering area 2 is downward page turning; the operation action corresponding to the action triggering area 3 is to turn a page to the left; the operation action corresponding to the action trigger area 4 is to turn the page to the right. And the area 5 is divided in the center of the screen of the electronic equipment, the area 5 corresponds to the webpage browsing program, at the moment, because the focus of the eyeball of the user is positioned on the area 5, the electronic equipment opens the webpage browsing program and displays the interface of the webpage browsing program on the area 5, so that the user can browse the webpage conveniently. When the user needs to turn the page downwards, the electronic equipment makes the page downwards turning action for the interface of the webpage browsing program only by rotating the eyeball and moving the focus to the action triggering area 2.
Or,
501b, tracking a movement locus of a focal point of an eyeball of the user within a specified time period by using the eyeball tracking sensor. And storing the corresponding relation between at least one moving track and the operation action in the electronic terminal.
502b, executing the operation action corresponding to the movement track of the focus of the eyeball of the user.
For example: as shown in fig. 5b, the screen of the electronic device is divided into 9 areas, and the correspondence between the movement locus of the zigzag and the screen unlocking action is set in the electronic terminal. When the user needs to unlock the screen, the user may rotate the eyeball to move the focus in the order of region 1 → region 2 → region 3 → region 5 → region 7 → region 8 → region 9, so that the movement track of the focus is in a "Z" shape, and when the electronic device detects that the movement track of the focus is in a "Z" shape and corresponds to the screen unlocking action, the screen is unlocked.
Further, in the present embodiment, in the process of determining the operation action by tracking the displacement of the focal point of the eyeball with the eyeball tracking sensor, the number of times of closing the eyes of the user and the closing time may be used as one parameter for determining the operation action, for example: when the eyeball tracking sensor determines that the focus of the eyeball stays in the area 1, wherein a page turning icon is displayed on the area 1, the area 1 corresponds to the operation action of page turning, and at the moment, the user blinks once, the electronic equipment can take the blink of the user as a clicking operation, judge that the user clicks the page turning icon on the area 1, and turn pages of the webpage content displayed on the current screen. Likewise, a rapid multiple blink by the user may be a double click operation.
It should be noted that 501a-502a provide a method for determining the area of eyeball focus on the screen, and determining the operation action according to the determined area. 501b-502b provide a method for determining an action by tracking the movement trajectory of the eye's focal point. Therefore, the execution time of 501a-502a and 501b-502b is not limited, and can be executed simultaneously with 101-.
The embodiment of the present invention provides a device 60 for displaying information on a screen, where the device 60 can be used in an electronic terminal, where the electronic terminal at least includes an eyeball tracking sensor and a screen, and the eyeball tracking sensor is used for tracking the activity of an eyeball and determining the position of the current focus of the eyeball; as shown in fig. 6, the apparatus 60 includes:
a positioning module 61, configured to determine, by using the eyeball tracking sensor, an area focused by an eyeball of a user operating the electronic terminal, which is currently on the screen;
and a display module 62 for displaying the target data on the determined area.
Further, as shown in fig. 7, the apparatus 60 further includes:
a detecting module 63, configured to detect whether an area focused by the eyeball is in a first working state before target data is displayed on the determined area;
wherein the screen is divided into at least two regions; the power consumption of one area in the first working state is lower than that of the area in the second working state;
a switching module 64, configured to switch the area focused by the eyeball to the second working state if the first working state is reached.
Optionally, the display module 62 may include:
an inquiring unit 621, configured to determine an application program corresponding to an area focused by an eyeball of a user operating the electronic terminal;
wherein an area divided on the screen corresponds to at least one application;
an executing unit 622, configured to execute the corresponding application program.
Further, the detecting module 63 is further configured to detect that the first area or the second area is in the first working state or the second working state; the area focused by the eyeballs is a first area, and the electronic equipment displays target data in the first area;
the switching module 64 is further configured to track, by using the eye tracking sensor, when a focus of an eye of a user of the electronic terminal moves from the first area to the second area, where the first area is in the second working state and the second area is in the first working state; switching the second area to the second working state, and displaying the target data in the second area; and switching the first area to the first working state.
As a further alternative, as shown in fig. 8, the apparatus 60 may further include:
a first motion recognition module 65, configured to track, by using the eye tracking sensor, that a focal point of an eye of the user moves to a first motion trigger area; wherein at least one action triggering area is divided on the screen; the action triggering area corresponds to at least one operation action;
a first triggering module 66, configured to execute an operation action corresponding to the first action triggering area;
and/or a second motion recognition module 67, configured to track, by using the eyeball tracking sensor, a movement trajectory of a focal point of an eyeball of the user within a specified time period; the electronic terminal stores the corresponding relation between at least one moving track and operation actions;
and the second triggering module 68 is configured to execute an operation action corresponding to the movement track of the focal point of the eyeball of the user.
The device for displaying information on the screen provided by the embodiment of the invention can utilize the eyeball tracking sensor to determine the area focused by the eyeballs of the user operating the electronic terminal on the screen at present; displaying the target data on the determined area. Compared with the scheme that the user can display data on the screen only through finger operation in the prior art, the method and the device for displaying the data on the screen determine the area focused by the user on the screen currently by tracking the focus of the eyeball of the user on the screen, and display the data on the area focused by the user. Therefore, when a user uses the electronic equipment, particularly when the data required by the user needs to be displayed on a screen, the user does not need to leave hands for operation, and other things on hand are prevented from being delayed.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus embodiment, since it is substantially similar to the method embodiment, it is relatively simple to describe, and reference may be made to some descriptions of the method embodiment for relevant points.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
The above description is only for the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. The method for displaying information on the screen is characterized by being used for an electronic terminal, wherein the electronic terminal at least comprises an eyeball tracking sensor and the screen, and the eyeball tracking sensor is used for tracking the activity condition of eyeballs and determining the position of the current focus of the eyeballs; the method comprises the following steps:
determining, by the eye tracking sensor, an area currently on the screen focused by eyes of a user operating the electronic terminal;
displaying the target data on the determined area.
2. A method of displaying information on a screen according to claim 1, wherein the screen is divided into at least two regions; the power consumption of one area in the first working state is lower than that of the area in the second working state;
before displaying the target data on the determined area, the method further comprises the following steps:
detecting whether an area focused by the eyeballs is in a first working state or not;
and if the eyeball is in the first working state, switching the area focused by the eyeball to the second working state.
3. A method of displaying information on a screen according to claim 1 or 2, wherein an area divided on the screen corresponds to at least one application; the displaying the target data on the determined area includes:
determining an application program corresponding to an area focused by eyeballs of a user operating the electronic terminal;
and running the corresponding application program.
4. The method of claim 2, wherein the area on which the eyeball is focused is a first area, and the electronic device displays target data in the first area;
the method further comprises the following steps:
when the focus of the eyeballs of the user of the electronic terminal is tracked to move from the first area to the second area by using the eyeball tracking sensor, the first area is in the second working state, and the second area is in the first working state;
switching the second area to the second working state, and displaying the target data in the second area;
and switching the first area to the first working state.
5. The method of displaying information on a screen of claim 2, further comprising:
tracking, by the eye tracking sensor, movement of a focal point of an eye of the user to a first action trigger area; wherein at least one action triggering area is divided on the screen; the action triggering area corresponds to at least one operation action;
executing the operation action corresponding to the first action trigger area;
and/or, the method further comprises:
tracking, with the eye tracking sensor, a movement trajectory of a focal point of an eye of the user over a specified time period; the electronic terminal stores the corresponding relation between at least one moving track and operation actions;
and executing the operation action corresponding to the movement track of the focus of the eyeball of the user.
6. The device for displaying information on the screen is characterized by being used for an electronic terminal, wherein the electronic terminal at least comprises an eyeball tracking sensor and a screen, and the eyeball tracking sensor is used for tracking the activity condition of eyeballs and determining the position of the current focus of the eyeballs; the device comprises:
the positioning module is used for determining an area focused by eyeballs of a user operating the electronic terminal on the screen by using the eyeball tracking sensor;
and the display module is used for displaying the target data on the determined area.
7. The apparatus for displaying information on a screen according to claim 6, wherein the screen is divided into at least two areas; the power consumption of one area in the first working state is lower than that of the area in the second working state;
the device further comprises:
the detection module is used for detecting whether the area focused by the eyeballs is in a first working state or not before the target data is displayed on the determined area;
and the switching module is used for switching the area focused by the eyeballs to the second working state if the switching module is in the first working state.
8. The apparatus for displaying information on a screen according to claim 6 or 7, wherein an area divided on the screen corresponds to at least one application; the display module includes:
the query unit is used for determining an application program corresponding to an area focused by eyeballs of a user operating the electronic terminal;
and the running unit is used for running the corresponding application program.
9. The apparatus according to claim 7, wherein the area on which the eyeball is focused is a first area, and the electronic device displays the target data in the first area;
the switching module is further configured to track, by using the eyeball tracking sensor, when a focus of an eyeball of a user of the electronic terminal moves from the first area to the second area, at this time, the first area is in the second working state, and the second area is in the first working state; switching the second area to the second working state, and displaying the target data in the second area; and switching the first area to the first working state.
10. The apparatus for displaying information on a screen according to claim 7, wherein the apparatus further comprises:
a first action recognition module, configured to track, by using the eyeball tracking sensor, that a focal point of an eyeball of the user moves to a first action trigger area; wherein at least one action triggering area is divided on the screen; the action triggering area corresponds to at least one operation action;
the first trigger module is used for executing the operation action corresponding to the first action trigger area;
and/or, the device further comprises:
a second motion recognition module for tracking a movement trajectory of a focal point of an eyeball of the user within a specified time period by using the eyeball tracking sensor; the electronic terminal stores the corresponding relation between at least one moving track and operation actions;
and the second trigger module is used for executing the operation action corresponding to the movement track of the focus of the eyeball of the user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410093097.5A CN103885592B (en) | 2014-03-13 | 2014-03-13 | Method and device for displaying information on screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410093097.5A CN103885592B (en) | 2014-03-13 | 2014-03-13 | Method and device for displaying information on screen |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103885592A true CN103885592A (en) | 2014-06-25 |
| CN103885592B CN103885592B (en) | 2017-05-17 |
Family
ID=50954526
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410093097.5A Active CN103885592B (en) | 2014-03-13 | 2014-03-13 | Method and device for displaying information on screen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103885592B (en) |
Cited By (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104461014A (en) * | 2014-12-26 | 2015-03-25 | 小米科技有限责任公司 | Screen unlocking method and device |
| CN104571528A (en) * | 2015-01-27 | 2015-04-29 | 王露 | Eyeball tracking-based IT (intelligent terminal) control device and method |
| CN105245724A (en) * | 2015-10-29 | 2016-01-13 | 努比亚技术有限公司 | Mobile terminal and incoming call processing method thereof |
| CN105323374A (en) * | 2015-05-19 | 2016-02-10 | 维沃移动通信有限公司 | Mobile terminal and multi-window task implementing method of same |
| CN105389151A (en) * | 2015-11-11 | 2016-03-09 | 腾讯科技（深圳）有限公司 | Information display method and display device |
| CN105528050A (en) * | 2014-09-30 | 2016-04-27 | 宇龙计算机通信科技(深圳)有限公司 | Terminal and terminal display control method |
| CN105739700A (en) * | 2016-01-29 | 2016-07-06 | 珠海市魅族科技有限公司 | Notice opening method and apparatus |
| CN105892642A (en) * | 2015-12-31 | 2016-08-24 | 乐视移动智能信息技术（北京）有限公司 | Method and device for controlling terminal according to eye movement |
| WO2016206201A1 (en) * | 2015-06-25 | 2016-12-29 | 小米科技有限责任公司 | Mobile terminal, and display control method and apparatus |
| CN106293086A (en) * | 2016-08-08 | 2017-01-04 | 广东小天才科技有限公司 | Information display control method and device |
| WO2017005114A1 (en) * | 2015-07-08 | 2017-01-12 | 阿里巴巴集团控股有限公司 | Screen processing method and apparatus |
| CN106547358A (en) * | 2016-11-25 | 2017-03-29 | 维沃移动通信有限公司 | A kind of display packing and terminal of terminal time information |
| CN106791034A (en) * | 2016-11-30 | 2017-05-31 | 宇龙计算机通信科技(深圳)有限公司 | A kind of message display method and device |
| CN107515669A (en) * | 2016-06-17 | 2017-12-26 | 北京小米移动软件有限公司 | Display methods and device |
| CN108008809A (en) * | 2016-10-31 | 2018-05-08 | 芜湖美的厨卫电器制造有限公司 | Household mirror and its display control method and device |
| CN105630439B (en) * | 2014-11-20 | 2018-09-28 | 联想（新加坡）私人有限公司 | Data presenting apparatus, method at least partly transparent display and glasses |
| CN108650408A (en) * | 2018-04-13 | 2018-10-12 | 维沃移动通信有限公司 | A kind of unlocking screen method and mobile terminal |
| CN108704308A (en) * | 2018-05-17 | 2018-10-26 | Oppo广东移动通信有限公司 | Control method, device, storage medium and the electronic equipment of shooting game |
| CN109040427A (en) * | 2018-07-03 | 2018-12-18 | Oppo广东移动通信有限公司 | split screen processing method, device, storage medium and electronic equipment |
| CN109542328A (en) * | 2018-11-30 | 2019-03-29 | 北京小米移动软件有限公司 | Method for displaying user interface, device, terminal and storage medium |
| CN109598424A (en) * | 2018-11-21 | 2019-04-09 | 山东交通学院 | A kind of scheme evaluation method and its system for the built-in scene in yacht cabin |
| CN110045907A (en) * | 2019-03-05 | 2019-07-23 | 北京三快在线科技有限公司 | Information display method and device |
| CN110221695A (en) * | 2019-05-31 | 2019-09-10 | 重庆爱奇艺智能科技有限公司 | The method and apparatus of the display properties of barrage are adjusted in virtual reality device |
| CN110456964A (en) * | 2019-07-26 | 2019-11-15 | 天脉聚源(杭州)传媒科技有限公司 | A kind of adaptive chat bubble display methods, system, device and storage medium |
| CN110554768A (en) * | 2018-05-31 | 2019-12-10 | 努比亚技术有限公司 | intelligent wearable device control method and device and computer readable storage medium |
| CN110968192A (en) * | 2019-11-25 | 2020-04-07 | 中国银行股份有限公司 | Transaction navigation method and device based on eyeball tracking |
| CN111367409A (en) * | 2020-02-27 | 2020-07-03 | 昆山国显光电有限公司 | Display control method, display control device and terminal |
| CN111506195A (en) * | 2020-04-17 | 2020-08-07 | 南京巨鲨显示科技有限公司 | Focal region highlighting system based on eyeball tracking equipment |
| CN111601373A (en) * | 2020-05-09 | 2020-08-28 | Oppo广东移动通信有限公司 | Backlight brightness control method and device, mobile terminal and storage medium |
| CN111813228A (en) * | 2020-09-07 | 2020-10-23 | 广东睿江云计算股份有限公司 | Image transmission method and system based on user vision |
| CN111931742A (en) * | 2020-09-30 | 2020-11-13 | 苏宁金融科技(南京)有限公司 | APP login verification method and device and computer readable storage medium |
| CN112036892A (en) * | 2020-09-01 | 2020-12-04 | 中国银行股份有限公司 | Verification method and device for audit task |
| CN112230790A (en) * | 2020-09-08 | 2021-01-15 | 盐城华旭光电技术有限公司 | Touch screen display device |
| CN112732080A (en) * | 2020-12-30 | 2021-04-30 | 宇龙计算机通信科技(深圳)有限公司 | Operation instruction generation method and device, storage medium and electronic equipment |
| WO2021143582A1 (en) * | 2020-01-16 | 2021-07-22 | 北京七鑫易维信息技术有限公司 | Operation-mode control method, apparatus, device, and storage medium |
| WO2021196716A1 (en) * | 2020-03-30 | 2021-10-07 | 广州橙行智动汽车科技有限公司 | Information display control method and apparatus, and vehicle |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100182232A1 (en) * | 2009-01-22 | 2010-07-22 | Alcatel-Lucent Usa Inc. | Electronic Data Input System |
| CN101893934A (en) * | 2010-06-25 | 2010-11-24 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for intelligently adjusting screen display |
| CN102402368A (en) * | 2010-09-10 | 2012-04-04 | 联想(北京)有限公司 | Display control method and device |
| CN102822771A (en) * | 2010-01-21 | 2012-12-12 | 托比技术股份公司 | Eye tracker based contextual action |
| CN102841683A (en) * | 2012-07-24 | 2012-12-26 | 东莞宇龙通信科技有限公司 | Application starting method and communication terminal of application |
| CN103309451A (en) * | 2013-06-20 | 2013-09-18 | 上海华勤通讯技术有限公司 | Mobile terminal and display method thereof |
| CN103336576A (en) * | 2013-06-28 | 2013-10-02 | 优视科技有限公司 | Method and device for operating browser based on eye-movement tracking |
| CN103500061A (en) * | 2013-09-26 | 2014-01-08 | 三星电子（中国）研发中心 | Method and equipment for controlling displayer |
| US20140023351A1 (en) * | 2012-07-20 | 2014-01-23 | Nikos Kaburlasos | Selective post-processing of decoded video frames based on focus point determination |
| CN103616953A (en) * | 2013-11-27 | 2014-03-05 | 福州瑞芯微电子有限公司 | Method and device for unlocking screen and initiating application |
-
2014
- 2014-03-13 CN CN201410093097.5A patent/CN103885592B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100182232A1 (en) * | 2009-01-22 | 2010-07-22 | Alcatel-Lucent Usa Inc. | Electronic Data Input System |
| CN102822771A (en) * | 2010-01-21 | 2012-12-12 | 托比技术股份公司 | Eye tracker based contextual action |
| CN101893934A (en) * | 2010-06-25 | 2010-11-24 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for intelligently adjusting screen display |
| CN102402368A (en) * | 2010-09-10 | 2012-04-04 | 联想(北京)有限公司 | Display control method and device |
| US20140023351A1 (en) * | 2012-07-20 | 2014-01-23 | Nikos Kaburlasos | Selective post-processing of decoded video frames based on focus point determination |
| CN102841683A (en) * | 2012-07-24 | 2012-12-26 | 东莞宇龙通信科技有限公司 | Application starting method and communication terminal of application |
| CN103309451A (en) * | 2013-06-20 | 2013-09-18 | 上海华勤通讯技术有限公司 | Mobile terminal and display method thereof |
| CN103336576A (en) * | 2013-06-28 | 2013-10-02 | 优视科技有限公司 | Method and device for operating browser based on eye-movement tracking |
| CN103500061A (en) * | 2013-09-26 | 2014-01-08 | 三星电子（中国）研发中心 | Method and equipment for controlling displayer |
| CN103616953A (en) * | 2013-11-27 | 2014-03-05 | 福州瑞芯微电子有限公司 | Method and device for unlocking screen and initiating application |
Cited By (57)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105528050A (en) * | 2014-09-30 | 2016-04-27 | 宇龙计算机通信科技(深圳)有限公司 | Terminal and terminal display control method |
| CN105630439B (en) * | 2014-11-20 | 2018-09-28 | 联想（新加坡）私人有限公司 | Data presenting apparatus, method at least partly transparent display and glasses |
| CN104461014A (en) * | 2014-12-26 | 2015-03-25 | 小米科技有限责任公司 | Screen unlocking method and device |
| CN104571528B (en) * | 2015-01-27 | 2017-09-05 | 王露 | It is a kind of to realize that eyeball controls the device and method of intelligent terminal based on eyeball tracking |
| CN104571528A (en) * | 2015-01-27 | 2015-04-29 | 王露 | Eyeball tracking-based IT (intelligent terminal) control device and method |
| CN105323374A (en) * | 2015-05-19 | 2016-02-10 | 维沃移动通信有限公司 | Mobile terminal and multi-window task implementing method of same |
| WO2016206201A1 (en) * | 2015-06-25 | 2016-12-29 | 小米科技有限责任公司 | Mobile terminal, and display control method and apparatus |
| US11226736B2 (en) | 2015-06-25 | 2022-01-18 | Xiaomi Inc. | Method and apparatus for controlling display and mobile terminal |
| US10620825B2 (en) | 2015-06-25 | 2020-04-14 | Xiaomi Inc. | Method and apparatus for controlling display and mobile terminal |
| CN106293444A (en) * | 2015-06-25 | 2017-01-04 | 小米科技有限责任公司 | Mobile terminal, display control method and device |
| EP3109727A3 (en) * | 2015-06-25 | 2017-03-22 | Xiaomi Inc. | A method and apparatus for controlling a display, and a mobile terminal |
| WO2017005114A1 (en) * | 2015-07-08 | 2017-01-12 | 阿里巴巴集团控股有限公司 | Screen processing method and apparatus |
| CN106339069A (en) * | 2015-07-08 | 2017-01-18 | 阿里巴巴集团控股有限公司 | Screen processing method and device |
| CN105245724A (en) * | 2015-10-29 | 2016-01-13 | 努比亚技术有限公司 | Mobile terminal and incoming call processing method thereof |
| CN105389151A (en) * | 2015-11-11 | 2016-03-09 | 腾讯科技（深圳）有限公司 | Information display method and display device |
| CN105389151B (en) * | 2015-11-11 | 2019-02-01 | 腾讯科技（深圳）有限公司 | Information display method and display equipment |
| CN105892642A (en) * | 2015-12-31 | 2016-08-24 | 乐视移动智能信息技术（北京）有限公司 | Method and device for controlling terminal according to eye movement |
| CN105739700B (en) * | 2016-01-29 | 2019-01-04 | 珠海市魅族通讯设备有限公司 | A kind of method and device for opening notice |
| CN105739700A (en) * | 2016-01-29 | 2016-07-06 | 珠海市魅族科技有限公司 | Notice opening method and apparatus |
| CN107515669A (en) * | 2016-06-17 | 2017-12-26 | 北京小米移动软件有限公司 | Display methods and device |
| CN107515669B (en) * | 2016-06-17 | 2021-01-29 | 北京小米移动软件有限公司 | Display method and device |
| CN106293086A (en) * | 2016-08-08 | 2017-01-04 | 广东小天才科技有限公司 | Information display control method and device |
| CN106293086B (en) * | 2016-08-08 | 2019-01-29 | 广东小天才科技有限公司 | Information display control method and device |
| CN108008809A (en) * | 2016-10-31 | 2018-05-08 | 芜湖美的厨卫电器制造有限公司 | Household mirror and its display control method and device |
| CN106547358A (en) * | 2016-11-25 | 2017-03-29 | 维沃移动通信有限公司 | A kind of display packing and terminal of terminal time information |
| CN106547358B (en) * | 2016-11-25 | 2019-06-04 | 维沃移动通信有限公司 | A kind of display methods and terminal of terminal time information |
| CN106791034A (en) * | 2016-11-30 | 2017-05-31 | 宇龙计算机通信科技(深圳)有限公司 | A kind of message display method and device |
| CN108650408A (en) * | 2018-04-13 | 2018-10-12 | 维沃移动通信有限公司 | A kind of unlocking screen method and mobile terminal |
| CN108650408B (en) * | 2018-04-13 | 2021-01-08 | 维沃移动通信有限公司 | Screen unlocking method and mobile terminal |
| CN108704308A (en) * | 2018-05-17 | 2018-10-26 | Oppo广东移动通信有限公司 | Control method, device, storage medium and the electronic equipment of shooting game |
| CN110554768A (en) * | 2018-05-31 | 2019-12-10 | 努比亚技术有限公司 | intelligent wearable device control method and device and computer readable storage medium |
| CN109040427A (en) * | 2018-07-03 | 2018-12-18 | Oppo广东移动通信有限公司 | split screen processing method, device, storage medium and electronic equipment |
| CN109040427B (en) * | 2018-07-03 | 2020-08-04 | Oppo广东移动通信有限公司 | Split screen processing method and device, storage medium and electronic equipment |
| CN109598424A (en) * | 2018-11-21 | 2019-04-09 | 山东交通学院 | A kind of scheme evaluation method and its system for the built-in scene in yacht cabin |
| CN109542328A (en) * | 2018-11-30 | 2019-03-29 | 北京小米移动软件有限公司 | Method for displaying user interface, device, terminal and storage medium |
| US11112967B2 (en) | 2018-11-30 | 2021-09-07 | Beijing Xiaomi Mobile Software Co., Ltd. | Method and apparatus for displaying user interface, terminal and storage medium |
| CN109542328B (en) * | 2018-11-30 | 2021-04-06 | 北京小米移动软件有限公司 | User interface display method, device, terminal and storage medium |
| WO2020177406A1 (en) * | 2019-03-05 | 2020-09-10 | 北京三快在线科技有限公司 | Information display |
| CN110045907A (en) * | 2019-03-05 | 2019-07-23 | 北京三快在线科技有限公司 | Information display method and device |
| CN110221695A (en) * | 2019-05-31 | 2019-09-10 | 重庆爱奇艺智能科技有限公司 | The method and apparatus of the display properties of barrage are adjusted in virtual reality device |
| CN110456964A (en) * | 2019-07-26 | 2019-11-15 | 天脉聚源(杭州)传媒科技有限公司 | A kind of adaptive chat bubble display methods, system, device and storage medium |
| CN110968192A (en) * | 2019-11-25 | 2020-04-07 | 中国银行股份有限公司 | Transaction navigation method and device based on eyeball tracking |
| WO2021143582A1 (en) * | 2020-01-16 | 2021-07-22 | 北京七鑫易维信息技术有限公司 | Operation-mode control method, apparatus, device, and storage medium |
| JP7421659B2 (en) | 2020-01-16 | 2024-01-24 | 北京七▲しん▼易維信息技術有限公司 | Operation mode control method, device, equipment, and storage medium |
| JP2023510407A (en) * | 2020-01-16 | 2023-03-13 | 北京七▲しん▼易維信息技術有限公司 | Operation mode control method, device, device, and storage medium |
| CN111367409A (en) * | 2020-02-27 | 2020-07-03 | 昆山国显光电有限公司 | Display control method, display control device and terminal |
| CN111367409B (en) * | 2020-02-27 | 2022-10-14 | 昆山国显光电有限公司 | Display control method, display control device and terminal |
| WO2021196716A1 (en) * | 2020-03-30 | 2021-10-07 | 广州橙行智动汽车科技有限公司 | Information display control method and apparatus, and vehicle |
| CN111506195A (en) * | 2020-04-17 | 2020-08-07 | 南京巨鲨显示科技有限公司 | Focal region highlighting system based on eyeball tracking equipment |
| CN111601373A (en) * | 2020-05-09 | 2020-08-28 | Oppo广东移动通信有限公司 | Backlight brightness control method and device, mobile terminal and storage medium |
| CN111601373B (en) * | 2020-05-09 | 2023-04-25 | Oppo广东移动通信有限公司 | Backlight brightness control method and device, mobile terminal and storage medium |
| CN112036892A (en) * | 2020-09-01 | 2020-12-04 | 中国银行股份有限公司 | Verification method and device for audit task |
| CN111813228B (en) * | 2020-09-07 | 2021-01-05 | 广东睿江云计算股份有限公司 | Image transmission method and system based on user vision |
| CN111813228A (en) * | 2020-09-07 | 2020-10-23 | 广东睿江云计算股份有限公司 | Image transmission method and system based on user vision |
| CN112230790A (en) * | 2020-09-08 | 2021-01-15 | 盐城华旭光电技术有限公司 | Touch screen display device |
| CN111931742A (en) * | 2020-09-30 | 2020-11-13 | 苏宁金融科技(南京)有限公司 | APP login verification method and device and computer readable storage medium |
| CN112732080A (en) * | 2020-12-30 | 2021-04-30 | 宇龙计算机通信科技(深圳)有限公司 | Operation instruction generation method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103885592B (en) | 2017-05-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103885592B (en) | Method and device for displaying information on screen | |
| KR101918421B1 (en) | Raise gesture detection in a device | |
| CN107391004B (en) | Control item based control of a user interface | |
| US9904409B2 (en) | Touch input processing method that adjusts touch sensitivity based on the state of a touch object and electronic device for supporting the same | |
| US20200004310A1 (en) | Battery usage tracking user interface | |
| WO2017032017A1 (en) | Method for controlling screen of user terminal and user terminal | |
| CA2922493C (en) | Presentation of a control interface on a touch-enabled device based on a motion or absence thereof | |
| CN106485124B (en) | Operation control method of mobile terminal and mobile terminal | |
| US20140247208A1 (en) | Invoking and waking a computing device from stand-by mode based on gaze detection | |
| US20140267085A1 (en) | Automatic detection for touch through glove | |
| US20110055753A1 (en) | User interface methods providing searching functionality | |
| CN105045394A (en) | Method and apparatus for starting preset function in wearable electronic terminal | |
| CN105446612A (en) | Terminal control method and terminal | |
| CN108055405B (en) | Terminal and method for awakening same | |
| CN103513788B (en) | Based on the gesture identification method of gyro sensor, system and mobile terminal | |
| CN107580134B (en) | Display method of mobile terminal and mobile terminal | |
| CN103955327B (en) | Information processing method and electronic equipment | |
| CN111951921A (en) | Information interaction method and device, electronic equipment and readable storage medium | |
| CN112445408B (en) | Information processing method, information processing device, electronic equipment and storage medium | |
| CN108920072A (en) | Electronic device touchscreen control method, device, electronic equipment and storage medium | |
| CN112631432A (en) | Screen control method, wearable device and storage medium | |
| CN106886351A (en) | A kind of display methods of terminal time information, device and computer equipment | |
| CN105068608B (en) | A kind of information processing method and electronic equipment | |
| CN105788535B (en) | Display screen control method and terminal equipment | |
| US12086325B2 (en) | Wearable device and screen wake-up method thereof, and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |