CN106814838B - Method and device for terminal automatic dormancy - Google Patents
Method and device for terminal automatic dormancy Download PDFInfo
- Publication number
- CN106814838B CN106814838B CN201510859765.5A CN201510859765A CN106814838B CN 106814838 B CN106814838 B CN 106814838B CN 201510859765 A CN201510859765 A CN 201510859765A CN 106814838 B CN106814838 B CN 106814838B
- Authority
- CN
- China
- Prior art keywords
- terminal
- eyes
- closure
- degree
- eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
- G06F1/3265—Power saving in display device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Abstract
The invention discloses a method for automatically sleeping a terminal, which comprises the following steps: when a terminal runs an application program, monitoring whether a touch screen or key operation signal exists on the terminal; when the duration of no operation on the terminal is greater than a first time threshold, acquiring the eye coordinate data of a user through a camera; calculating the degree of closure of the human eyes by adopting a human eye positioning algorithm according to the human eye coordinate data; and when the degree of closure of the human eyes is smaller than the threshold value of the degree of closure, starting the sleep mode of the terminal. The invention also discloses a device for automatically sleeping the terminal. When the terminal does not detect the touch screen or key operation for a long time, the camera is started to track the eyes of the current user, eye coordinate data are obtained, the eye closure degree is calculated, when the eye closure degree is smaller than the closure degree threshold value, the user is judged to enter the sleep state, the sleep mode is started, the terminal automatically enters the sleep state, and the energy consumption of the terminal is effectively reduced.
Description
Technical Field
The invention relates to the technical field of intelligent terminals, in particular to a method and a device for automatically sleeping a terminal.
Background
When an existing intelligent terminal runs, whether a user uses the terminal is generally judged according to clicking or sliding operation of the user on a touch screen. When the touch screen is not touched for a long time, the intelligent terminal usually starts an automatic sleep mode, stops running the currently running application program, closes screen brightness and sound, and enters a sleep state. However, when a user runs some application programs, the user may not operate the touch screen frequently, for example, when the user watches videos through the intelligent terminal, the operation on the screen is less, when the touch screen does not receive a touch screen operation for a long time, the terminal often starts the sleep automatically, and at this time, the user has to click the screen again to avoid the terminal sleep. In addition, if the user presets that the user does not enter the dormancy state when the terminal plays the video, the terminal can automatically play the same or the next video file all the time when the user sleeps when watching the video, the electric quantity of the terminal is wasted, and unnecessary troubles are brought to the user.
Disclosure of Invention
The embodiment of the invention provides a method and a device for automatically sleeping a terminal, which can intelligently judge whether to enter the sleep mode according to the eye state of a current user.
The embodiment of the invention provides a method for automatically sleeping a terminal, which comprises the following steps:
when a terminal runs an application program, monitoring whether a touch screen or key operation signal exists on the terminal;
when the duration of no operation on the terminal is greater than a first time threshold, acquiring the eye coordinate data of a user through a camera;
calculating the degree of closure of the human eyes by adopting a human eye positioning algorithm according to the human eye coordinate data;
and when the degree of closure of the human eyes is smaller than the threshold value of the degree of closure, starting the sleep mode of the terminal.
The embodiment of the invention also provides a device for automatically sleeping the terminal, which comprises the following steps:
the terminal comprises a touch screen monitoring module, a touch screen processing module and a display module, wherein the touch screen monitoring module is used for monitoring whether a touch screen or key operation signal exists on the terminal when the terminal runs an application program;
the human eye tracking module is used for acquiring human eye coordinate data of a user through a camera when the duration of no operation on the terminal is greater than a first time threshold;
the human eye positioning module is used for calculating the degree of closure of the human eyes by adopting a human eye positioning algorithm according to the human eye coordinate data;
and the dormancy control module is used for starting the dormancy mode of the terminal when the eye closure degree is smaller than the closure degree threshold value.
When the terminal does not detect the touch screen or key operation for a long time, the camera is started to track the eyes of the current user, eye coordinate data are obtained, the eye closure degree is calculated, when the eye closure degree is smaller than the closure degree threshold value, the user is judged to enter the sleep state, the sleep mode is started, the terminal automatically enters the sleep state, and the energy consumption of the terminal is effectively reduced.
Drawings
Fig. 1 is a bus diagram of a terminal where a device for automatically hibernating the terminal according to an embodiment of the present invention is located;
FIG. 2 is a flowchart illustrating a method for automatically hibernating a terminal according to a first embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for automatically hibernating a terminal according to a second embodiment of the present invention;
FIG. 4 is a flowchart illustrating a method for automatically hibernating a terminal according to a third embodiment of the present invention;
FIG. 5 is a flowchart illustrating a method for automatically hibernating a terminal according to a fourth embodiment of the present invention;
FIG. 6 is a flowchart illustrating a fifth embodiment of a method for automatic sleep of a terminal according to the present invention;
FIG. 7 is a flowchart illustrating a method for automatically hibernating a terminal according to a sixth embodiment of the present invention;
fig. 8 is a block diagram illustrating an exemplary embodiment of an apparatus for automatically hibernating a terminal according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a bus diagram of a terminal where a device for automatically hibernating a terminal according to an embodiment of the present invention is located, where the terminal shown in fig. 1 may include: at least one processor 101, e.g., a CPU, at least one network interface 104, a user interface 103, a memory 105, at least one communication bus 102. Wherein the communication bus 102 is used for enabling connection communication between these components. The user interface 103 may include a Display (Display), a Keyboard (Keyboard), a standard wired interface, and a standard wireless interface. The network interface 104 may include a standard wired interface, a wireless interface (e.g., a WIFI interface). The memory 105 may be a high-speed RAM memory or a non-volatile memory (e.g., at least one disk memory). The memory 105 may also be at least one storage device located remotely from the aforementioned processor 101. The memory 105, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a terminal auto-hibernation program.
In the terminal where the apparatus for automatically hibernating a terminal shown in fig. 1 is located, the network interface 104 is mainly used for connecting a server or other terminals and performing data communication with the server or other terminals; the user interface 103 is mainly used for receiving user instructions and interacting with users; and processor 101 may be configured to invoke the terminal auto-hibernate program stored in memory 105 and perform the following operations:
when the terminal runs an application program, monitoring whether a touch screen or key operation signal exists on the terminal through a user interface 103;
when the duration of no operation on the terminal is greater than a first time threshold, acquiring the eye coordinate data of a user through a camera by a user interface 103;
calculating the degree of closure of the human eyes by adopting a human eye positioning algorithm according to the coordinate data of the human eyes;
and when the degree of closure of the human eyes is smaller than the threshold value of the degree of closure, starting the sleep mode of the terminal.
In one embodiment, the processor 101 invoking the terminal auto-hibernate program stored in the memory 105 may further perform the following operations:
calculating the central coordinates of the two eyes according to the coordinate data of the eyes;
calculating the relative distance between the central coordinates of the eyes obtained twice before and after;
judging whether the relative distance between the central coordinates of the two eyes obtained in the previous and subsequent times is smaller than a distance threshold value;
and when the relative distance between the center coordinates of the eyes obtained in the two times is smaller than a distance threshold value, calculating the degree of closure of the human eyes according to the coordinate data of the human eyes.
In one embodiment, the processor 101 invoking the terminal auto-hibernate program stored in the memory 105 may further perform the following operations:
when (x1-x2)2+(y1-y2)2<k*w2Judging that the relative distance between the central coordinates of the two eyes obtained in the previous and later times is smaller than a distance threshold value; the coordinates of the center of the two eyes obtained at the previous time are p1 ═ (x1, y1), the coordinates of the center of the two eyes obtained at the next time are p2 ═ (x2, y2), the screen width of the terminal is w, and the threshold coefficient of the movement of the coordinates of the centers of the two eyes relative to the screen is k.
In one embodiment, the processor 101 invoking the terminal auto-hibernate program stored in the memory 105 may further perform the following operations:
reducing the screen brightness and the volume of the terminal, and continuously monitoring whether a touch screen or key operation signal exists on the terminal through the user interface 103;
when a touch screen or key operation signal is on the terminal, restoring the screen brightness and the volume of the terminal, and exiting the sleep mode;
and when no touch screen or key operation signal exists on the terminal and the duration of the terminal in the sleep mode is greater than a second time threshold, stopping running the current application program and closing the screen brightness and the volume of the terminal.
In one embodiment, the processor 101 invoking the terminal auto-hibernate program stored in the memory 105 may further perform the following operations:
reducing the screen brightness and the volume of the terminal, continuously acquiring the coordinate data of the eyes of the user through the camera through the user interface 103, and calculating the degree of closure of the eyes;
when the closeness of human eyes is larger than a closeness threshold value, restoring the screen brightness and the volume of the terminal, and exiting the sleep mode;
and when the closing degree of the human eyes is continuously smaller than the closing degree threshold value and the duration of the terminal in the sleep mode reaches a second time threshold value, stopping running the current application program and closing the brightness and the volume of the screen of the terminal.
In one embodiment, the processor 101 invoking the terminal auto-hibernate program stored in the memory 105 may further perform the following operations:
when the eye closure degree is smaller than the closure degree threshold value, the moment of currently acquiring the eye coordinate data of the user is taken as an initial moment, the eye coordinate data of the user is acquired again through the camera through the user interface 103 after a third time threshold value is set, and the eye closure degree is calculated;
and when the human eye closure degree is continuously smaller than the closure degree threshold value, starting the sleep mode of the terminal.
In the device for automatically hibernating the terminal and the terminal where the device are described in this embodiment in fig. 1, when a touch screen or key operation is not detected for a long time, the camera is started to track eyes of a current user, eye coordinate data is obtained, eye closure is calculated, and when the eye closure is smaller than a closure threshold, it is determined that the user has entered a sleep state, a hibernation mode is started, so that the terminal automatically enters the hibernation state, and energy consumption of the terminal is effectively reduced.
Fig. 2 is a flowchart illustrating a method for automatically hibernating a terminal according to a first embodiment of the present invention. The method for automatically sleeping the terminal provided by the embodiment comprises the following steps:
step S10, when the terminal runs the application program, monitoring whether a touch screen or key operation signal exists on the terminal;
the terminal of the embodiment can comprise a mobile phone, a tablet computer, a desktop computer with a camera, an all-in-one machine, a notebook computer and the like. The user may preset to turn on the auto-sleep switch. When a user starts an application program such as a browser and a player on a terminal, the terminal monitors a touch screen operation signal on a touch screen or a key operation signal generated by physical keys such as keys, a mouse and a keyboard. When the terminal monitors a touch screen or key operation signal, the terminal is indicated to be operated by a user at the moment, and the terminal does not need to enter a dormant state. In addition, a gravity sensing module can be further installed on the terminal and used for monitoring whether the terminal moves or not, and if the movement amplitude is larger than a movement threshold value, the fact that the user is operating the terminal is also indicated, and the user does not need to enter a dormant state.
Step S20, when the duration of no operation on the terminal is longer than a first time threshold, acquiring the human eye coordinate data of the user through the camera;
if the terminal does not detect the touch screen or key operation signal all the time, it indicates that the user has no operation or no displacement, and if the duration of the no operation or the no displacement is greater than the first time threshold, the user may not pay attention to the program running on the terminal, and needs to track the human eye state of the user to determine whether the user is watching the running program on the terminal. At this time, the terminal starts a front camera, shoots the binocular image of the current user through the camera, and obtains the coordinate data of human eyes in the image through an image recognition technology, for example, coordinate point data on a line frame diagram including eye sockets, eyelids, eye kernels and the like. And if the terminal identifies that no human eye image exists in the image shot by the camera, judging that the user does not pay attention to the program on the terminal, directly starting the sleep mode, and entering the sleep state.
Step S30, calculating the degree of closure of the human eyes by adopting a human eye positioning algorithm according to the coordinate data of the human eyes;
further, when the terminal identifies the eye coordinate data, the terminal system adopts a eye positioning algorithm, calculates the distance between the upper eyelid and the lower eyelid according to the coordinate point data of the line frame diagrams of the eye socket, the eyelid and the like, and obtains the eye closure degree, namely the closure program between the upper eyelid and the lower eyelid.
And step S40, when the degree of closure of the human eyes is smaller than the threshold value of the degree of closure, starting the sleep mode of the terminal.
And comparing the calculated closeness of the human eyes with a preset closeness threshold, wherein the closeness threshold is a closing degree statistic of the two eyes of the person in sleep under the normal condition. And when the closing degree of the eyes is smaller than the closing degree threshold value, judging that the user enters a sleep state, starting a sleep mode of the terminal at the moment, and automatically entering the sleep state by the terminal.
When the terminal of the embodiment does not detect the touch screen or key operation for a long time, the camera is started to track eyes of the current user, eye coordinate data are obtained, eye closure degree is calculated, when the eye closure degree is smaller than a closure degree threshold value, the user is judged to enter a sleep state, a sleep mode is started, the terminal automatically enters the sleep state, and energy consumption of the terminal is effectively reduced.
Fig. 3 is a flowchart illustrating a method for automatically hibernating a terminal according to a second embodiment of the present invention. The present embodiment includes the steps of the embodiment shown in fig. 2, and further includes, before step S30:
step S51, calculating the center coordinates of the two eyes according to the coordinate data of the eyes;
in order to further ensure the accuracy of the judgment result, the terminal of the embodiment also judges the movement amplitude of human eyes before comparing the closeness. The terminal obtains eye contour coordinates through an image recognition technology, calculates the center mark of the two eyes, for example, calculates the pupil coordinates of the two eyes, and takes the middle point of the connecting line of the pupil coordinates of the two eyes as the center coordinates of the two eyes.
Step S52, calculating the relative distance between the central coordinates of the eyes obtained in the two times;
the terminal can continuously acquire a plurality of human eye images at regular time and calculate the center coordinates of the two eyes of the human eye images acquired each time. And calculating the relative distance between the central coordinates of the two times before and after the calculation, and judging the displacement condition of the human eyes relative to the terminal screen.
Step S53, judging whether the relative distance between the central coordinates of the two eyes obtained in the previous and next two times is smaller than a distance threshold value; if so, go to step S30; if not, step S20 is performed.
The human eye movement distance, i.e. the relative distance between the two acquired eye center coordinates, is compared to a distance threshold. If the distance of the two times of movement of the human eyes is larger than the distance threshold value, the fact that the human eyes move in a large amplitude is judged, the user is still in a waking state, and the sleep mode does not need to be started. If the distance of the two times of movement of the human eyes is smaller than the distance threshold value, the user may be in a sleep state, and at the moment, the degree of closure of the human eyes needs to be further identified so as to accurately judge the current condition of the user.
According to the embodiment, before the degree of closure of the human eyes is identified, the displacement condition of the human eyes is judged in advance, if the displacement amplitude of the human eyes is large, the user is directly judged to be in a waking state, the sleep mode does not need to be started, the process of identifying the degree of closure of the human eyes is reduced, and the program simplification is facilitated. When the displacement amplitude of the human eyes is small, the closing degree of the human eyes is further identified so as to improve the accuracy of judging the state of the human eyes.
Fig. 4 is a flowchart illustrating a method for automatically hibernating a terminal according to a third embodiment of the present invention, as shown in fig. 4. This embodiment includes the steps of the embodiment shown in fig. 3, wherein step S53 includes:
step S531, judge (x1-x2)2+(y1-y2)2<k*w2Whether the result is true or not; if so, go to step S30; if not, step S20 is performed.
The present embodiment assumes that the coordinates of the center of the two eyes obtained at the previous time are p1 ═ x1, y1, the coordinates of the center of the two eyes obtained at the subsequent time are p2 ═ x2, y2, the screen width of the terminal is w, and the threshold coefficient of the movement of the coordinates of the centers of the two eyes with respect to the screen is k. The value of k suitable for the terminal is obtained in advance by debugging, and k is 0.01, for example. By the formula sqrt [ (x1-x2)2+(y1-y2)2]The distance between p1 and p2 is obtained by setting the distance threshold w sqrt (k). Mixing sqrt [ (x1-x2)2+(y1-y2)2]Comparison with w sqrt (k) gives, after removal of the root number, (x1-x2)2+(y1-y2)2And k w2And (6) comparing. If (x1-x2)2+(y1-y2)2≥k*w2If the distance of the eye movement is larger, the user is still in the waking state, and the sleep mode is not required to be started. Otherwise, the user may be in a sleep state, and at this time, the degree of closure of the human eyes needs to be further identified so as to accurately determine the current condition of the user. According to the embodiment, the displacement condition of the human eyes is calculated by adopting a simple distance formula, so that the identification program is simpler, and the processing difficulty of a terminal system is reduced.
Fig. 5 is a flowchart illustrating a method for automatically hibernating a terminal according to a fourth embodiment of the present invention. This embodiment includes the steps of the embodiment shown in fig. 2, wherein step S40 includes:
step S411, when the degree of closure of human eyes is smaller than the threshold value of the degree of closure, reducing the screen brightness and the volume of the terminal, and continuously monitoring whether a touch screen or key operation signal exists on the terminal;
in this embodiment, when the terminal enters the sleep mode, in order to avoid mistakenly blinking the user and determining that the user enters the sleep state, the screen brightness and the volume are not immediately turned off, but the terminal enters the semi-sleep state first, the screen brightness is dimmed, the volume is reduced, the touch screen or the physical keys of the terminal are monitored, and timing is performed at the same time.
Step S412, when a touch screen or key operation signal is provided on the terminal, restoring the screen brightness and the volume of the terminal, and exiting the sleep mode;
if the user continues to pay attention to the application program on the terminal at this time, the screen brightness and the volume are found to be different from the previous one, and the user usually actively adjusts the screen brightness or the volume at this time, and then generates an operation signal. In the monitoring process, if a touch screen or a key is operated on the terminal, the terminal judges that the user is in a waking state, the terminal restores to a normal operation mode, and exits from a sleep mode.
Step S413, when there is no touch screen or key operation signal on the terminal and the duration of the terminal in the sleep mode is greater than the second time threshold, stop running the current application, and turn off the screen brightness and volume of the terminal.
If the user does not operate the terminal in the monitoring process and the duration exceeds the second time threshold, the terminal judges that the user does not pay attention to the current program any more, the current program is stopped, the screen brightness and the volume are turned off, a complete sleep mode is entered, and the energy consumption of the terminal is reduced.
In the embodiment, at the initial stage when the terminal enters the sleep mode, the touch screen and the operation keys of the terminal are continuously monitored, and if the user operates before the second time threshold value is reached, the normal mode is recovered, so that the trouble of the user caused by closing the application program due to misjudgment is avoided, otherwise, when the waiting time exceeds the second time threshold value, the running program is closed, and the reduction of the energy consumption of the terminal is facilitated.
Fig. 6 is a flowchart illustrating a method for automatically hibernating a terminal according to a fifth embodiment of the present invention, as shown in fig. 6. The present embodiment includes the steps of the embodiment shown in fig. 2, wherein step S40 may further include:
step S421, when the eye closure degree is smaller than the closure degree threshold value, reducing the screen brightness and the volume of the terminal, continuously acquiring the eye coordinate data of the user through the camera, and calculating the eye closure degree;
in this embodiment, when the terminal enters the sleep mode, the screen brightness and the volume are not immediately turned off, but the terminal enters a semi-sleep state first, and the screen brightness is dimmed, and the volume is reduced, so as to avoid mistakenly blinking the user to determine that the user enters the sleep state. The difference between this embodiment and the above embodiments is that after entering the semi-sleep state, this embodiment continues to monitor the state of the human eye through the camera, and at the same time, also performs timing.
Step S422, when the closeness of human eyes is larger than the closeness threshold value, restoring the screen brightness and the volume of the terminal, and exiting the sleep mode;
in the eye state monitoring process, if the user opens the eyes again, the obtained eye closure degree is larger than the closure degree threshold value, the terminal judges that the user is awake, the terminal recovers to the normal operation mode, and the terminal exits from the sleep mode.
And step S423, when the closing degree of the human eyes is continuously smaller than the closing degree threshold value and the duration of the terminal in the sleep mode reaches a second time threshold value, stopping running the current application program and closing the brightness and the volume of the screen of the terminal.
If the closing degree of human eyes of the user is smaller than the closing degree threshold value all the time in the monitoring process, the user is judged to be in the sleep state all the time, and when the duration time exceeds a second time threshold value, the terminal stops the current program, closes the screen brightness and the screen volume, enters a complete sleep mode and reduces the energy consumption of the terminal.
In the embodiment, at the initial stage when the terminal enters the sleep mode, the eye state of the user is continuously monitored through the camera, and before the second time threshold is reached, if the eye closure degree of the user is greater than the closure degree threshold, the normal mode is recovered, so that the trouble of the user caused by closing the application program due to misjudgment is avoided, otherwise, when the waiting time exceeds the second time threshold, the running program is closed, and the reduction of the energy consumption of the terminal is facilitated.
Fig. 7 is a flowchart illustrating a method for automatically hibernating a terminal according to a sixth embodiment of the present invention. The present embodiment includes the steps of the embodiment shown in fig. 2, wherein step S40 may further include:
step S431, when the eye closure degree is smaller than the closure degree threshold value, taking the moment of currently acquiring the eye coordinate data of the user as an initial moment, acquiring the eye coordinate data of the user again through the camera after a third time threshold value, and calculating the eye closure degree;
in this embodiment, when the user just blinks, it is monitored that the human eye is closed, and at this time, if the user directly enters the sleep mode, normal use of the user is affected, so as to avoid a trouble of the user caused by reduction of screen brightness and volume due to misjudgment, the sleep mode is not immediately entered when it is monitored that the human eye closure degree is smaller than the closure degree threshold value for the first time, but the human eye coordinate is acquired again at an interval of a time period, that is, a third time threshold value in this embodiment, after the human eye coordinate is acquired at the previous time, and the human eye closure degree is judged. In order to avoid acquiring the eye coordinates of the user at the blinking time again, the time period of the interval is different from the blinking time interval of the user, and a user blinking time interval range can be estimated, for example, if the user blinking time interval range obtained through multiple experiments is 8-12 seconds in advance, the third time threshold value is set in the range of 13-15 seconds, the eye coordinates of one or multiple consecutive times can be acquired in the time range, and the probability of misjudgment is reduced.
And step S432, when the degree of closure of the human eyes is continuously smaller than the threshold value of the degree of closure, starting the sleep mode of the terminal.
If the result of the secondary judgment is that the eye closure degree is still smaller than the closure degree threshold value, it is determined that the user is not blinking at the moment, the user is judged to enter the sleep state, at the moment, the sleep mode of the terminal is started, and the terminal automatically enters the sleep state. If the result of the second judgment is that the closeness of the human eyes is greater than or equal to the closeness threshold, the previously monitored coordinates of the human eyes are judged to be the blink of the user, the user does not need to enter a sleep mode, and the brightness and the volume of the screen are kept.
In the embodiment, whether the sleep mode is entered or not is determined by acquiring the coordinates of human eyes at intervals for many times and judging the closeness of the human eyes, so that misjudgment caused by blinking of a user is avoided, and the accuracy of automatic sleep judgment is improved.
As shown in fig. 8, fig. 8 is a block diagram illustrating an embodiment of an apparatus for automatically hibernating a terminal according to the present invention. The device for automatically sleeping in the terminal provided by the embodiment comprises:
the touch screen monitoring module 110 is configured to monitor whether a touch screen or key operation signal exists on the terminal when the terminal runs the application program;
the human eye tracking module 120 is used for acquiring human eye coordinate data of the user through the camera when the duration of no operation on the terminal is greater than a first time threshold;
the human eye positioning module 130 is used for calculating the degree of closure of the human eye by adopting a human eye positioning algorithm according to the human eye coordinate data;
and the sleep control module 140 is configured to start the sleep mode of the terminal when the degree of closure of the human eye is smaller than the threshold value of the degree of closure.
The terminal of the embodiment can comprise a mobile phone, a tablet computer, a desktop computer with a camera, an all-in-one machine, a notebook computer and the like. The user may preset to turn on the auto-sleep switch. When a user starts an application program such as a browser and a player on a terminal, the terminal monitors a touch screen operation signal on a touch screen or a key operation signal generated by physical keys such as keys, a mouse and a keyboard. When the terminal monitors a touch screen or key operation signal, the terminal is indicated to be operated by a user at the moment, and the terminal does not need to enter a dormant state. In addition, a gravity sensing module can be further installed on the terminal and used for monitoring whether the terminal moves or not, and if the movement amplitude is larger than a movement threshold value, the fact that the user is operating the terminal is also indicated, and the user does not need to enter a dormant state.
If the terminal does not detect the touch screen or key operation signal all the time, it indicates that the user has no operation or no displacement, and if the duration of the no operation or the no displacement is greater than the first time threshold, the user may not pay attention to the program running on the terminal, and needs to track the human eye state of the user to determine whether the user is watching the running program on the terminal. At this time, the terminal starts a front camera, shoots the binocular image of the current user through the camera, and obtains the coordinate data of human eyes in the image through an image recognition technology, for example, coordinate point data on a line frame diagram including eye sockets, eyelids, eye kernels and the like. And if the terminal identifies that no human eye image exists in the image shot by the camera, judging that the user does not pay attention to the program on the terminal, directly starting the sleep mode, and entering the sleep state.
Further, when the terminal identifies the eye coordinate data, the terminal system adopts a eye positioning algorithm, calculates the distance between the upper eyelid and the lower eyelid according to the coordinate point data of the line frame diagrams of the eye socket, the eyelid and the like, and obtains the eye closure degree, namely the closure program between the upper eyelid and the lower eyelid.
And comparing the calculated closeness of the human eyes with a preset closeness threshold, wherein the closeness threshold is a closing degree statistic of the two eyes of the person in sleep under the normal condition. And when the closing degree of the eyes is smaller than the closing degree threshold value, judging that the user enters a sleep state, starting a sleep mode of the terminal at the moment, and automatically entering the sleep state by the terminal.
When the terminal of the embodiment does not detect the touch screen or key operation for a long time, the camera is started to track eyes of the current user, eye coordinate data are obtained, eye closure degree is calculated, when the eye closure degree is smaller than a closure degree threshold value, the user is judged to enter a sleep state, a sleep mode is started, the terminal automatically enters the sleep state, and energy consumption of the terminal is effectively reduced.
Further, the human eye positioning module 130 is further configured to:
calculating the central coordinates of the two eyes according to the coordinate data of the eyes;
calculating the relative distance between the central coordinates of the eyes obtained twice before and after;
judging whether the relative distance between the central coordinates of the two eyes obtained in the previous and subsequent times is smaller than a distance threshold value;
and when the relative distance between the center coordinates of the eyes obtained in the two times is smaller than a distance threshold value, calculating the degree of closure of the human eyes according to the coordinate data of the human eyes.
In order to further ensure the accuracy of the judgment result, the terminal of the embodiment also judges the movement amplitude of human eyes before comparing the closeness. The terminal obtains eye contour coordinates through an image recognition technology, calculates the center mark of the two eyes, for example, calculates the pupil coordinates of the two eyes, and takes the middle point of the connecting line of the pupil coordinates of the two eyes as the center coordinates of the two eyes.
The terminal can continuously acquire a plurality of human eye images at regular time and calculate the center coordinates of the two eyes of the human eye images acquired each time. And calculating the relative distance between the central coordinates of the two times before and after the calculation, and judging the displacement condition of the human eyes relative to the terminal screen.
The human eye movement distance, i.e. the relative distance between the two acquired eye center coordinates, is compared to a distance threshold. If the distance of the two times of movement of the human eyes is larger than the distance threshold value, the fact that the human eyes move in a large amplitude is judged, the user is still in a waking state, and the sleep mode does not need to be started.
If the distance of the two times of movement of the human eyes is smaller than the distance threshold value, the user may be in a sleep state, and at the moment, the degree of closure of the human eyes needs to be further identified so as to accurately judge the current condition of the user.
According to the embodiment, before the degree of closure of the human eyes is identified, the displacement condition of the human eyes is judged in advance, if the displacement amplitude of the human eyes is large, the user is directly judged to be in a waking state, the sleep mode does not need to be started, the process of identifying the degree of closure of the human eyes is reduced, and the program simplification is facilitated. When the displacement amplitude of the human eyes is small, the closing degree of the human eyes is further identified so as to improve the accuracy of judging the state of the human eyes.
Further, the human eye positioning module 130 is further configured to: when (x1-x2)2+(y1-y2)2<k*w2And judging that the relative distance between the central coordinates of the two eyes obtained twice before and after is smaller than a distance threshold value.
The present embodiment assumes that the coordinates of the center of the two eyes obtained at the previous time are p1 ═ x1, y1, the coordinates of the center of the two eyes obtained at the subsequent time are p2 ═ x2, y2, the screen width of the terminal is w, and the threshold coefficient of the movement of the coordinates of the centers of the two eyes with respect to the screen is k. The value of k suitable for the terminal is obtained in advance by debugging, and k is 0.01, for example. By the formula sqrt [ (x1-x2)2+(y1-y2)2]The distance between p1 and p2 is obtained by setting the distance threshold w sqrt (k). Mixing sqrt [ (x1-x2)2+(y1-y2)2]Comparison with w sqrt (k) gives, after removal of the root number, (x1-x2)2+(y1-y2)2And k w2And (6) comparing. If (x1-x2)2+(y1-y2)2≥k*w2If the distance of the eye movement is larger, the user is still in the waking state, and the sleep mode is not required to be started. Otherwise, the user may be in a sleep state, and at this time, the degree of closure of the human eyes needs to be further identified so as to accurately determine the current condition of the user. According to the embodiment, the displacement condition of the human eyes is calculated by adopting a simple distance formula, so that the identification program is simpler, and the processing difficulty of a terminal system is reduced.
Further, the sleep control module 140 is further configured to reduce the screen brightness and volume of the terminal;
the touch screen monitoring module 110 is further configured to continue to monitor whether a touch screen or key operation signal is present on the terminal;
the sleep control module 140 is further configured to, when a touch screen or key operation signal is present on the terminal, restore the screen brightness and volume of the terminal, and exit from the sleep mode;
the sleep control module 140 is further configured to stop running the current application program and turn off the terminal screen brightness and volume when there is no touch screen or key operation signal on the terminal and the duration of the terminal in the sleep mode is greater than the second time threshold.
In this embodiment, when the terminal enters the sleep mode, in order to avoid mistakenly blinking the user and determining that the user enters the sleep state, the screen brightness and the volume are not immediately turned off, but the terminal enters the semi-sleep state first, the screen brightness is dimmed, the volume is reduced, the touch screen or the physical keys of the terminal are monitored, and timing is performed at the same time.
If the user continues to pay attention to the application program on the terminal at this time, the screen brightness and the volume are found to be different from the previous one, and the user usually actively adjusts the screen brightness or the volume at this time, and then generates an operation signal. In the monitoring process, if a touch screen or a key is operated on the terminal, the terminal judges that the user is in a waking state, the terminal restores to a normal operation mode, and exits from a sleep mode.
If the user does not operate the terminal in the monitoring process and the duration exceeds the second time threshold, the terminal judges that the user does not pay attention to the current program any more, the current program is stopped, the screen brightness and the volume are turned off, a complete sleep mode is entered, and the energy consumption of the terminal is reduced.
In the embodiment, at the initial stage when the terminal enters the sleep mode, the touch screen and the operation keys of the terminal are continuously monitored, and if the user operates before the second time threshold value is reached, the normal mode is recovered, so that the trouble of the user caused by closing the application program due to misjudgment is avoided, otherwise, when the waiting time exceeds the second time threshold value, the running program is closed, and the reduction of the energy consumption of the terminal is facilitated.
Further, the sleep control module 140 is further configured to reduce the screen brightness and volume of the terminal;
the human eye tracking module 120 is further configured to continue to acquire the coordinate data of the human eye of the user through the camera, and calculate the degree of closure of the human eye;
the sleep control module 140 is further configured to, when the closeness of the human eyes is greater than a closeness threshold, restore the screen brightness and the volume of the terminal, and exit from the sleep mode;
the sleep control module 140 is further configured to stop running the current application program and turn off the terminal screen brightness and volume when the human eye closure is continuously smaller than the closure threshold and the duration of the terminal in the sleep mode reaches the second time threshold.
In this embodiment, when the terminal enters the sleep mode, the screen brightness and the volume are not immediately turned off, but the terminal enters a semi-sleep state first, and the screen brightness is dimmed, and the volume is reduced, so as to avoid mistakenly blinking the user to determine that the user enters the sleep state. The difference between this embodiment and the above embodiments is that after entering the semi-sleep state, this embodiment continues to monitor the state of the human eye through the camera, and at the same time, also performs timing.
In the eye state monitoring process, if the user opens the eyes again, the obtained eye closure degree is larger than the closure degree threshold value, the terminal judges that the user is awake, the terminal recovers to the normal operation mode, and the terminal exits from the sleep mode.
If the closing degree of human eyes of the user is smaller than the closing degree threshold value all the time in the monitoring process, the user is judged to be in the sleep state all the time, and when the duration time exceeds a second time threshold value, the terminal stops the current program, closes the screen brightness and the screen volume, enters a complete sleep mode and reduces the energy consumption of the terminal.
In the embodiment, at the initial stage when the terminal enters the sleep mode, the eye state of the user is continuously monitored through the camera, and before the second time threshold is reached, if the eye closure degree of the user is greater than the closure degree threshold, the normal mode is recovered, so that the trouble of the user caused by closing the application program due to misjudgment is avoided, otherwise, when the waiting time exceeds the second time threshold, the running program is closed, and the reduction of the energy consumption of the terminal is facilitated.
Further, the human eye tracking module 120 is further configured to, with a current time of obtaining the human eye coordinate data of the user as an initial time, obtain the human eye coordinate data of the user again through the camera after a third time threshold, and calculate the degree of closure of the human eye;
the sleep control module 140 is further configured to initiate a sleep mode of the terminal when the degree of closure of the human eye is continuously less than the threshold degree of closure.
In this embodiment, when the user just blinks, it is monitored that the human eye is closed, and at this time, if the user directly enters the sleep mode, normal use of the user is affected, so as to avoid a trouble of the user caused by reduction of screen brightness and volume due to misjudgment, the sleep mode is not immediately entered when it is monitored that the human eye closure degree is smaller than the closure degree threshold value for the first time, but the human eye coordinate is acquired again at an interval of a time period, that is, a third time threshold value in this embodiment, after the human eye coordinate is acquired at the previous time, and the human eye closure degree is judged. In order to avoid acquiring the eye coordinates of the user at the blinking time again, the time period of the interval is different from the blinking time interval of the user, and a user blinking time interval range can be estimated, for example, if the user blinking time interval range obtained through multiple experiments is 8-12 seconds in advance, the third time threshold value is set in the range of 13-15 seconds, the eye coordinates of one or multiple consecutive times can be acquired in the time range, and the probability of misjudgment is reduced.
If the result of the secondary judgment is that the eye closure degree is still smaller than the closure degree threshold value, it is determined that the user is not blinking at the moment, the user is judged to enter the sleep state, at the moment, the sleep mode of the terminal is started, and the terminal automatically enters the sleep state. If the result of the second judgment is that the closeness of the human eyes is greater than or equal to the closeness threshold, the previously monitored coordinates of the human eyes are judged to be the blink of the user, the user does not need to enter a sleep mode, and the brightness and the volume of the screen are kept.
In the embodiment, whether the sleep mode is entered or not is determined by acquiring the coordinates of human eyes at intervals for many times and judging the closeness of the human eyes, so that misjudgment caused by blinking of a user is avoided, and the accuracy of automatic sleep judgment is improved.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (14)
1. A method for terminal automatic dormancy is characterized in that the method comprises the following steps:
when a terminal runs an application program, monitoring whether a touch screen or key operation signal exists on the terminal; when the duration of no operation on the terminal is greater than a first time threshold, acquiring the eye coordinate data of a user through a camera;
when the relative distance between the center coordinates of the two eyes of the front and back two times calculated according to the human eye coordinate data is smaller than a distance threshold, calculating the degree of closure of the human eyes by adopting a human eye positioning algorithm according to the human eye coordinate data;
the distance threshold is the product of the root of the threshold coefficient of the movement of the center coordinates of the two eyes relative to the screen and the screen width of the terminal;
and when the degree of closure of the human eyes is smaller than the threshold value of the degree of closure, starting the sleep mode of the terminal.
2. The method for automatically hibernating a terminal according to claim 1, wherein when the relative distance between the two eye center coordinates before and after being calculated according to the eye coordinate data is smaller than a distance threshold, calculating the degree of eye closure by using an eye positioning algorithm according to the eye coordinate data, comprises:
calculating the central coordinates of the two eyes according to the human eye coordinate data;
calculating the relative distance between the central coordinates of the eyes obtained twice before and after;
judging whether the relative distance between the central coordinates of the two eyes obtained in the previous and subsequent times is smaller than a distance threshold value;
and when the relative distance between the center coordinates of the two eyes obtained in the previous and subsequent times is smaller than the distance threshold, calculating the degree of closure of the eyes by adopting an eye positioning algorithm according to the eye coordinate data.
3. The method of claim 2, wherein the step of determining whether the relative distance between the center coordinates of the two eyes obtained twice before and after is less than a distance threshold comprises:
when (x1-x2)2+(y1-y2)2<k*w2Judging that the relative distance between the central coordinates of the two eyes obtained in the previous and later times is smaller than the distance threshold value; wherein, the coordinates of the center of the two eyes obtained last time are p1 ═ x1, y1, the coordinates of the center of the two eyes obtained last time are p2 ═ x2, y2, the width of the screen of the terminal is w, and the threshold coefficient of the movement of the coordinates of the two eyes relative to the screen is k.
4. A method of automatically hibernating a terminal as claimed in any one of claims 1 to 3, wherein said step of initiating a hibernate mode of said terminal comprises:
reducing the screen brightness and the volume of the terminal, and continuously monitoring whether a touch screen or key operation signal exists on the terminal;
when a touch screen or key operation signal is provided on the terminal, restoring the screen brightness and the volume of the terminal, and exiting the sleep mode;
and when no touch screen or key operation signal exists on the terminal and the duration of the terminal in the sleep mode is greater than a second time threshold, stopping running the current application program and closing the screen brightness and the volume of the terminal.
5. A method of automatically hibernating a terminal as claimed in any one of claims 1 to 3, wherein said step of initiating a hibernate mode of said terminal comprises:
reducing the screen brightness and the volume of the terminal, continuously acquiring the coordinate data of the human eyes of the user through a camera, and calculating the closeness of the human eyes;
when the human eye closure degree is larger than the closure degree threshold value, restoring the screen brightness and the volume of the terminal, and exiting the sleep mode;
and when the closing degree of the human eyes is continuously smaller than the closing degree threshold value and the duration of the terminal in the sleep mode reaches a second time threshold value, stopping running the current application program and closing the screen brightness and the volume of the terminal.
6. The method for automatically hibernating a terminal as claimed in any one of claims 1 to 3, wherein said step of initiating a hibernation mode of the terminal when the eye closure is less than a closure threshold comprises:
when the human eye closure degree is smaller than the closure degree threshold value, the moment of currently acquiring the human eye coordinate data of the user is taken as an initial moment, the human eye coordinate data of the user is acquired again through the camera after a third time threshold value is set, and the human eye closure degree is calculated;
and when the human eye closure degree is continuously smaller than the closure degree threshold value, starting the sleep mode of the terminal.
7. An apparatus for automatically hibernating a terminal, comprising:
the terminal comprises a touch screen monitoring module, a touch screen processing module and a display module, wherein the touch screen monitoring module is used for monitoring whether a touch screen or key operation signal exists on the terminal when the terminal runs an application program;
the human eye tracking module is used for acquiring human eye coordinate data of a user through a camera when the duration of no operation on the terminal is greater than a first time threshold;
the human eye positioning module is used for calculating the degree of closure of the human eyes by adopting a human eye positioning algorithm according to the human eye coordinate data when the relative distance between the central coordinates of the two eyes which are calculated according to the human eye coordinate data and are carried out twice is smaller than a distance threshold value; the distance threshold is the product of the root of the threshold coefficient of the movement of the center coordinates of the two eyes relative to the screen and the screen width of the terminal;
and the dormancy control module is used for starting the dormancy mode of the terminal when the eye closure degree is smaller than the closure degree threshold value.
8. The apparatus for automatic dormancy of a terminal according to claim 7, wherein the eye location module is further configured to:
calculating the central coordinates of the two eyes according to the human eye coordinate data;
calculating the relative distance between the central coordinates of the eyes obtained twice before and after;
judging whether the relative distance between the central coordinates of the two eyes obtained in the previous and subsequent times is smaller than a distance threshold value;
and when the relative distance between the center coordinates of the eyes obtained in the two times is smaller than the distance threshold value, calculating the degree of closure of the human eyes according to the coordinate data of the human eyes.
9. The apparatus for automatically hibernating a terminal as claimed in claim 8, wherein the eye-positioning module is further configured to:
when (x1-x2)2+(y1-y2)2<k*w2Judging that the relative distance between the central coordinates of the two eyes obtained in the previous and later times is smaller than the distance threshold value; wherein, the coordinates of the center of the two eyes obtained last time are p1 ═ x1, y1, the coordinates of the center of the two eyes obtained last time are p2 ═ x2, y2, the width of the screen of the terminal is w, and the threshold coefficient of the movement of the coordinates of the two eyes relative to the screen is k.
10. The apparatus for automatically hibernating a terminal as claimed in any one of claims 7 to 9, wherein the hibernate control module is further configured to reduce screen brightness and volume of the terminal;
the touch screen monitoring module is further used for continuously monitoring whether a touch screen or key operation signal exists on the terminal;
the sleep control module is further used for recovering the screen brightness and the volume of the terminal and exiting the sleep mode when a touch screen or key operation signal exists on the terminal;
and the sleep control module is further used for stopping running the current application program and closing the screen brightness and the volume of the terminal when no touch screen or key operation signal exists on the terminal and the duration of the terminal in the sleep mode is greater than a second time threshold.
11. The apparatus for automatically hibernating a terminal as claimed in any one of claims 7 to 9, wherein the hibernate control module is further configured to reduce screen brightness and volume of the terminal;
the human eye tracking module is further used for continuously acquiring the human eye coordinate data of the user through the camera and calculating the human eye closure degree;
the sleep control module is further used for recovering the screen brightness and the volume of the terminal and exiting the sleep mode when the human eye closure degree is greater than the closure degree threshold value;
and the dormancy control module is also used for stopping running the current application program and closing the screen brightness and the volume of the terminal when the human eye closure degree is continuously smaller than the closure degree threshold value and the duration of the terminal in the dormancy mode reaches a second time threshold value.
12. The apparatus for automatically hibernating a terminal according to any one of claims 7 to 9, wherein the eye tracking module is further configured to, when the eye closure degree is smaller than the closure degree threshold, take a current time of acquiring the eye coordinate data of the user as an initial time, acquire the eye coordinate data of the user again via the camera after a third time threshold, and calculate the eye closure degree;
the dormancy control module is further used for starting the dormancy mode of the terminal when the eye closure degree is continuously smaller than the closure degree threshold value.
13. A computer-readable storage medium comprising executable instructions that, when executed, perform a method of auto-hibernating a terminal as claimed in any of claims 1 to 6.
14. A terminal, comprising:
a memory for storing executable instructions;
a processor configured to implement the method of automatically hibernating a terminal as claimed in any one of claims 1 to 6 when executing executable instructions stored in the memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510859765.5A CN106814838B (en) | 2015-11-30 | 2015-11-30 | Method and device for terminal automatic dormancy |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510859765.5A CN106814838B (en) | 2015-11-30 | 2015-11-30 | Method and device for terminal automatic dormancy |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106814838A CN106814838A (en) | 2017-06-09 |
| CN106814838B true CN106814838B (en) | 2020-12-04 |
Family
ID=59156733
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510859765.5A Active CN106814838B (en) | 2015-11-30 | 2015-11-30 | Method and device for terminal automatic dormancy |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106814838B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6971696B2 (en) * | 2017-08-04 | 2021-11-24 | キヤノン株式会社 | Electronic devices and their control methods |
| CN107861623A (en) * | 2017-11-30 | 2018-03-30 | 珠海市魅族科技有限公司 | A kind of terminal control method, device, terminal and readable storage medium storing program for executing |
| CN111212181A (en) * | 2018-11-22 | 2020-05-29 | 奇酷互联网络科技（深圳）有限公司 | Method for adjusting screen of intelligent terminal, intelligent terminal and storage device |
| CN111970753A (en) * | 2020-08-13 | 2020-11-20 | 珠海市魅族科技有限公司 | Intelligent terminal screen dormancy control method, storage medium, processor and intelligent terminal |
| CN112351482A (en) * | 2020-10-29 | 2021-02-09 | 深圳Tcl新技术有限公司 | Method and device for automatically controlling terminal dormancy and computer readable storage medium |
| CN112660048A (en) * | 2020-12-30 | 2021-04-16 | 诺博汽车科技有限公司 | Multi-screen power supply management method, device and system based on image recognition and automobile |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1603011A1 (en) * | 2004-06-01 | 2005-12-07 | Swisscom Mobile AG | Method and device for coordinate input |
| CN103177232A (en) * | 2013-03-21 | 2013-06-26 | 上海斐讯数据通信技术有限公司 | Electronic reading system and method based on mobile terminal |
| CN103257877A (en) * | 2013-05-06 | 2013-08-21 | 苏州三星电子电脑有限公司 | Automatic sleep control system of display device and control method thereof |
| CN103677215A (en) * | 2014-01-02 | 2014-03-26 | 重庆市科学技术研究院 | Power-saving control method for screen of intelligent device |
| CN104224204A (en) * | 2013-12-24 | 2014-12-24 | 烟台通用照明有限公司 | Driver fatigue detection system on basis of infrared detection technology |
-
2015
- 2015-11-30 CN CN201510859765.5A patent/CN106814838B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1603011A1 (en) * | 2004-06-01 | 2005-12-07 | Swisscom Mobile AG | Method and device for coordinate input |
| CN103177232A (en) * | 2013-03-21 | 2013-06-26 | 上海斐讯数据通信技术有限公司 | Electronic reading system and method based on mobile terminal |
| CN103257877A (en) * | 2013-05-06 | 2013-08-21 | 苏州三星电子电脑有限公司 | Automatic sleep control system of display device and control method thereof |
| CN104224204A (en) * | 2013-12-24 | 2014-12-24 | 烟台通用照明有限公司 | Driver fatigue detection system on basis of infrared detection technology |
| CN103677215A (en) * | 2014-01-02 | 2014-03-26 | 重庆市科学技术研究院 | Power-saving control method for screen of intelligent device |
Non-Patent Citations (2)
| Title |
|---|
| Research on driver fatigue detection strategy based on human eye state;Peijiang Chen;《2017 Chinese Automation Congress (CAC)》;20180101;全文 * |
| 驾驶人眼睛局部区域定位算法;张波，王文军，张伟等;《清华大学学报(自然科学版)》;20140630;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106814838A (en) | 2017-06-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106814838B (en) | Method and device for terminal automatic dormancy | |
| WO2018121428A1 (en) | Living body detection method, apparatus, and storage medium | |
| CN104246650B (en) | Energy saving method and apparatus | |
| US20130113955A1 (en) | Method for controlling mobile terminal status and mobile terminal | |
| AU2017293746B2 (en) | Electronic device and operating method thereof | |
| CN104899029A (en) | Screen control method and apparatus | |
| CN105045394A (en) | Method and apparatus for starting preset function in wearable electronic terminal | |
| WO2017156950A1 (en) | Method for improving unlock speed and mobile terminal | |
| CN108198553B (en) | Voice interaction method, device, equipment and computer readable storage medium | |
| US20180203568A1 (en) | Method for Enabling Function Module of Terminal, and Terminal Device | |
| WO2017133589A1 (en) | Safety monitoring method and device for terminal user | |
| KR20190030140A (en) | Method for eye-tracking and user terminal for executing the same | |
| CN112164608B (en) | Electronic device, control method and control device thereof | |
| CN105183138A (en) | Method and system for automatically switching into dormant state | |
| TW201426405A (en) | Smart switching device and smart switching method and system thereof | |
| CN107861620B (en) | Information processing method and electronic equipment | |
| EP3435215B1 (en) | Method, device, storage medium and mobile terminal for recognizing an off-screen gesture | |
| WO2017152592A1 (en) | Mobile terminal application operation method and mobile terminal | |
| CN111144198B (en) | Control method of intelligent bracket and intelligent bracket | |
| CN112634895A (en) | Voice interaction wake-up-free method and device | |
| US20220366721A1 (en) | Electronic apparatus and control method | |
| CN110691168A (en) | Screen control method and device of mobile terminal and storage medium | |
| WO2016065746A1 (en) | Terminal device wakeup method and apparatus and storage medium | |
| WO2019072169A1 (en) | Detection method and device for preventing accidental touch and terminal | |
| CN107437018B (en) | Mobile terminal, control method thereof, and computer-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |