CN113190119A - Mobile terminal screen lighting control method and device, mobile terminal and storage medium - Google Patents
Mobile terminal screen lighting control method and device, mobile terminal and storage medium Download PDFInfo
- Publication number
- CN113190119A CN113190119A CN202110490500.8A CN202110490500A CN113190119A CN 113190119 A CN113190119 A CN 113190119A CN 202110490500 A CN202110490500 A CN 202110490500A CN 113190119 A CN113190119 A CN 113190119A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- screen
- image
- human eyes
- eyes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 210000001508 eye Anatomy 0.000 claims abstract description 160
- 210000005252 bulbus oculi Anatomy 0.000 claims description 21
- 210000004279 orbit Anatomy 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 4
- 210000001747 pupil Anatomy 0.000 claims description 4
- 238000005070 sampling Methods 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 4
- 230000001815 facial effect Effects 0.000 abstract description 3
- 235000012054 meals Nutrition 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 4
- 210000004247 hand Anatomy 0.000 description 4
- 230000006872 improvement Effects 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005265 energy consumption Methods 0.000 description 2
- 210000000887 face Anatomy 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000000744 eyelid Anatomy 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
Abstract
The invention discloses a mobile terminal screen lighting control method, a device, a mobile terminal and a storage medium, wherein the method comprises the following steps: when the screen is in the screen-off state, the mobile terminal regularly shoots and acquires an image in front of the screen of the mobile terminal by a preset distance; identifying whether human eyes exist in the image or not based on the image in front of the screen of the mobile terminal; when the human eyes in the image are identified, judging whether the human eyes of the image watch the screen of the mobile terminal; and when judging that human eyes watch the screen of the mobile terminal, controlling to lighten the screen of the mobile terminal. The invention can identify human eyes, and lights the screen when the mobile terminal identifies that human eyes watch the screen of the mobile terminal within a preset distance. The screen lighting method aims to solve the problem that the existing screen lighting technology is difficult to light the screen to check the operation such as information and time in modes such as fingerprint and facial recognition when people eat meals and the like under the condition that both hands are inconvenient, and brings relatively poor user experience to users.
Description
Technical Field
The invention relates to the technical field of mobile terminals, in particular to a method and a device for controlling lighting of a screen of a mobile terminal, the mobile terminal and a storage medium.
Background
With the development of science and technology and the continuous improvement of the living standard of people, various mobile terminals such as mobile phones are more and more popular, and the mobile phones become indispensable communication tools in the life of people.
In the prior art, a user sometimes only needs to look at time or only looks at key point prompt, information prompt and the like in the process of using a mobile terminal such as a mobile phone, generally, at this time, the user needs to press a start key or a fingerprint key to open a screen, or the user takes up the mobile terminal to aim at the face to perform face recognition, when the user does not operate the mobile terminal with hands at the moment, such as eating, typing and the like, the user is inconveniently and manually lightened, so that the screen of the mobile terminal cannot be lightened to look up related information and content, poor user experience is caused, and the user is inconvenient to use.
Thus, there is a need for improvements and enhancements in the art.
Disclosure of Invention
The invention aims to solve the technical problem that the invention provides a method and a device for controlling the screen lighting of a mobile terminal, the mobile terminal and a storage medium aiming at the defects in the prior art.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows:
a mobile terminal screen lighting control method, wherein the method comprises the following steps:
when the screen is in the screen-off state, the mobile terminal regularly shoots and acquires an image in front of the screen of the mobile terminal by a preset distance;
identifying whether human eyes exist in the image or not based on the image in front of the screen of the mobile terminal;
when the human eyes in the image are identified, judging whether the human eyes of the image watch the screen of the mobile terminal;
and when judging that human eyes watch the screen of the mobile terminal, controlling to lighten the screen of the mobile terminal.
The method for controlling the screen lighting of the mobile terminal, wherein in the screen-off state, the step of regularly shooting and acquiring the image in front of the screen of the mobile terminal by the mobile terminal comprises the following steps:
detecting whether the mobile terminal is in a screen-off state;
when the mobile terminal is in a screen-off state, the mobile terminal regularly detects whether a face appears within a preset distance in front of a screen of the mobile terminal;
and when the fact that a face appears in the preset distance in front of the screen of the mobile terminal is detected, controlling to shoot and obtain a face image in front of the screen of the mobile terminal through a front camera of the mobile terminal.
The method for controlling lighting of the screen of the mobile terminal comprises the following steps of identifying whether human eyes exist in an image based on the image in front of the screen of the mobile terminal:
and identifying whether human eyes exist in the image or not according to human eye characteristics preset in the mobile terminal based on the image in front of the mobile terminal screen.
The method for controlling lighting of the screen of the mobile terminal, wherein when the eyes in the image are identified, the step of judging whether the eyes of the image watch the screen of the mobile terminal comprises the following steps:
when the eyes are identified in the image, thinning the eye position image, and not processing and sampling the image outside the eye position image range;
calculating the refined human eye position image, finding the human eye focus position, and judging whether human eyes of the image watch the screen of the mobile terminal.
The method for controlling the lighting of the screen of the mobile terminal comprises the following steps of calculating a refined human eye position image, finding a human eye focus position, and judging whether human eyes of the image watch the screen of the mobile terminal or not:
drawing a connecting line between the pupil center point and the eye center in the eyes according to the thinned eye image, finding a cross point of the connecting line between the pupils of the two eyes and the eye center, namely a focus of the eyes, and judging whether the cross point of the connecting line is within the target range of the whole image; if yes, judging that the eyes are looking at the mobile terminal;
wherein, the center of the human eyes is the center point of the eyeballs; the image target range is determined according to the position of the front camera in the mobile terminal and the size of the shot image.
The mobile terminal screen lighting control method comprises the following steps that the human eye center is obtained through the following method;
obtaining an eyeball contour according to the orbit and eye socket curves in the image;
and determining an eyeball center point according to the eyeball contour.
The mobile terminal screen lighting control method is characterized in that the image target range is determined according to the position of the front camera in the mobile terminal and the size of a shot image, and the range of the lower 70% of the image is set as the target range.
A mobile terminal screen lighting control apparatus, wherein the apparatus comprises:
the image shooting module is used for shooting and acquiring an image in front of a screen of the mobile terminal at a preset distance at fixed time by the mobile terminal when the screen is turned off;
the identification module is used for identifying whether human eyes exist in the image based on the image in front of the screen of the mobile terminal;
the judging module is used for judging whether the human eyes of the image watch the screen of the mobile terminal or not when the human eyes of the image are identified;
and the lighting control module is used for controlling the lighting of the screen of the mobile terminal when judging that human eyes watch the screen of the mobile terminal.
A mobile terminal comprises a memory, a processor and an image display program which is stored in the memory and can run on the processor, wherein when the processor executes the image display program, the step of realizing any one of the mobile terminal screen lighting control methods is realized.
A computer readable storage medium having stored thereon an image display program which, when executed by a processor, implements the steps of a mobile terminal screen lighting control method according to any one of the preceding claims.
Has the advantages that: compared with the prior art, the invention provides a mobile terminal screen lighting control method, which adopts the following steps: shooting through a front camera, searching whether human eyes exist in an image and whether the human eyes are looking at the mobile terminal, if so, outputting a command by a BB chip to control an LCD to be lightened, and displaying information such as time, information and key point prompt; the invention adds new functions by using the mobile terminal: the function of automatically identifying the lighting screen of the watching screen of human eyes is provided: only need the user to expect to mobile terminal, mobile terminal can intelligent awaken up the screen, time and information etc. on the display screen, and is very convenient, promotes user experience, provides convenience for user's use.
Drawings
Fig. 1 is a flowchart of a detailed implementation of a method for controlling lighting of a screen of a mobile terminal according to an embodiment of the present invention.
Fig. 2 is a flowchart illustrating that the mobile terminal periodically shoots and acquires an image at a predetermined distance in front of the screen of the mobile terminal in the screen-off state according to the embodiment of the present invention.
Fig. 3 is a flowchart for identifying whether human eyes are present in an image based on the image in front of the screen of the mobile terminal according to the embodiment of the present invention.
Fig. 4 is a flowchart for determining whether the human eye of the image watches the screen of the mobile terminal when the human eye of the image is identified according to the embodiment of the present invention.
Fig. 5 is a schematic block diagram of a mobile terminal screen lighting control device according to an embodiment of the present invention.
Fig. 6 is a schematic diagram of an internal structure of a terminal device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and effects of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It should be noted that, if directional indications (such as up, down, left, right, front, and back … …) are involved in the embodiment of the present invention, the directional indications are only used to explain the relative positional relationship between the components, the movement situation, and the like in a specific posture (as shown in the drawing), and if the specific posture is changed, the directional indications are changed accordingly.
In addition, if there is a description of "first", "second", etc. in an embodiment of the present invention, the description of "first", "second", etc. is for descriptive purposes only and is not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.
With the development of science and technology and the continuous improvement of the living standard of people, various mobile terminals such as mobile phones are more and more popular, and the mobile phones become indispensable communication tools in the life of people.
Through research and development, in the process of using a mobile terminal such as a mobile phone, a user sometimes only needs to look at time, or only needs to look at key point prompt, information prompt and the like, generally, at this time, the user needs to press an on-screen key or a fingerprint key to open a screen, or pick up the mobile terminal to align a face for face recognition, when the user does not operate with hands at the moment, for example, the user eats, types, and the like, and is inconvenient to manually light, so that the screen of the mobile terminal cannot be lighted to look up related information and content, and poor user experience and inconvenience in use are caused.
In order to solve the above problem, an embodiment of the present invention provides a mobile terminal screen lighting control method, which can automatically recognize a function of a screen lighting screen viewed by human eyes. In specific implementation, the method of the embodiment takes a picture through the front-facing camera, and searches whether human eyes exist in the picture and whether the human eyes are looking for the mobile terminal, if so, the BB chip outputs a command to control the LCD to be lightened, and displays information such as time, information, key point prompt and the like; the invention adds new functions by using the mobile terminal: the function of automatically identifying the lighting screen of the watching screen of human eyes is provided: only need the user to expect to mobile terminal, mobile terminal can intelligent awaken up the screen, time and information etc. on the display screen, and is very convenient, promotes user experience, provides convenience for user's use.
Exemplary method
The mobile terminal screen lighting control method in the embodiment can be applied to mobile terminals, such as intelligent devices like mobile phones and tablet computers. As shown in fig. 1 in detail, the method for controlling lighting of a screen of a mobile terminal includes the following steps:
s100, when the screen is turned off, the mobile terminal regularly shoots and acquires an image in front of a screen of the mobile terminal by a preset distance;
in the embodiment, when the screen is bright, the image in front of the screen does not need to be acquired; and when the screen is off, shooting an image in front of the screen by a preset distance through a front camera of the mobile terminal.
Specifically, as shown in fig. 2, the step S100 includes:
s101, detecting whether the mobile terminal is in a screen-off state;
step S102, when the mobile terminal is in a screen-off state, the mobile terminal regularly detects whether a face appears within a preset distance in front of a screen of the mobile terminal;
and S103, when the fact that a face appears in the preset distance in front of the screen of the mobile terminal is detected, controlling to shoot and obtain a face image in front of the screen of the mobile terminal through a front camera of the mobile terminal.
For example, whether the mobile terminal is in the screen-off state can be determined by detecting the screen input voltage, current or screen brightness value of the mobile terminal. For example, when the mobile phone screen normally works, the voltage of the input screen is 5V, when the screen input voltage is detected to be greater than 4V, the mobile terminal screen is judged to be in a bright screen state, when the screen input voltage is detected to be less than 4V, the mobile terminal screen is judged to be in a screen-off state, or a photoresistor is arranged in the mobile terminal screen to detect the screen brightness, when the screen brightness is less than 300nt, the resistance is increased, the circuit current is reduced and is lower than the preset current, and then the mobile phone screen is judged to be in the screen-off state at the moment. When the mobile phone is judged to be in the screen-off state, the mobile phone regularly detects whether a face appears in a preset distance in front of a screen, the preset distance can be set according to the self condition of a user, the user with better eyesight and the mobile phone not carried around often can set the preset distance to be 1m, the user who the mobile phone carries around often can reduce the preset distance to 30cm according to the use habit, and the judgment error is reduced. And when the face of the mobile phone is detected within the preset distance, shooting by a front-facing camera to obtain a face image within the preset distance in front of a mobile phone screen. Compared with the prior art of unlocking the mobile phone by facial recognition, the mobile phone unlocking method and the mobile phone unlocking device do not need to lift the mobile phone and recognize the face, and can further judge only by acquiring images similar to human faces within the range of the camera, so that most of mobile phones can be applied to occasions when being horizontally placed on a desktop without hands. Further, a wide-angle lens can be arranged at the position of the front camera, the recognition range of 122 degrees can be provided, and the image acquisition range and the user experience are further improved.
Further, step S200, identifying whether human eyes exist in the image based on the image in front of the screen of the mobile terminal;
in this embodiment, an image within a predetermined distance in front of a screen acquired by the mobile terminal is analyzed to identify whether human eyes exist in the image, and if the acquired image does not contain human eyes or the human eyes in the image are not clear, the mobile terminal is considered not to acquire human eyes, and then the next operation is not performed.
Specifically, as shown in fig. 3, the step S200 includes:
step S201, based on the image in front of the screen of the mobile terminal, whether human eyes exist in the image is identified according to human eye features preset in the mobile terminal.
For example, after the image is captured by the front camera of the mobile phone, whether the image contains human eyes or not may be analyzed according to human eye features preset in the mobile terminal, for example, for most asians, the simplest human eye features are that the color of the eyeball is white and brown, and the eyeball is wrapped in a crack-shaped region formed by the eyelids and having a wide middle and narrow sides, and further, the determination criteria and the determination accuracy may be improved according to the photographing pixels of the front camera of the mobile phone and the operation capability of the processor, for example, highlight in the eyeball region may be analyzed on the basis of the simplest features, when the eyeball reflected by the shape of the highlight is a curved surface similar to a spherical surface, the eyeball region may be determined as a true eyeball, and if the eyeball reflected by the shape of the highlight is a plane or other curved surface, and determining that no eyeball exists in the eyeball area, namely no human eye exists in the image, and setting a judgment standard according to the mobile phone performance and the user habit.
Further, step S300, when the eyes in the image are identified, determining whether the eyes of the image watch the screen of the mobile terminal;
in this embodiment, when the mobile terminal recognizes that the image contains human eyes, whether the human eyes in the image are observing the screen of the mobile terminal is further determined, if the human eyes are not watching the screen of the mobile terminal, the screen is not bright, and if the human eyes are watching the screen of the mobile terminal, the screen is bright.
Specifically, as shown in fig. 4, the step S300 includes:
s301, when the eyes are identified in the image, thinning the eye position image, and not processing and sampling the image outside the eye position image range;
step S302, calculating the refined human eye position image, finding the human eye focus position, and judging whether human eyes of the image watch the screen of the mobile terminal.
The step of calculating the refined human eye position image, finding the human eye focus position and judging whether the human eyes of the image watch the screen of the mobile terminal comprises the following steps:
drawing a connecting line between the pupil center point and the eye center in the eyes according to the thinned eye image, finding a cross point of the connecting line between the pupils of the two eyes and the eye center, namely a focus of the eyes, and judging whether the cross point of the connecting line is within the target range of the whole image; if yes, judging that the eyes are looking at the mobile terminal;
wherein, the center of the human eyes is the center point of the eyeballs; the image target range is determined according to the position of the front camera in the mobile terminal and the size of the shot image.
Wherein the human eye center is obtained by the following method;
obtaining an eyeball contour according to the orbit and eye socket curves in the image;
and determining an eyeball center point according to the eyeball contour.
The image target range is determined according to the position of the front camera in the mobile terminal and the size of the shot image, and the range of 70% of the inner lower part of the image is set as the target range.
For example, when the mobile phone recognizes that eyes exist in the acquired image, the range of the eyes is further refined, the eye image is only analyzed, and images outside the range of the eye position image are not processed and sampled. The mobile phone calculates the refined human eye position image, finds the human eye focus position, and judges whether the human eye of the image is watching the mobile phone screen according to the human eye focus, wherein the human eye focus is the intersection of the connecting line of the left eye pupil center point and the left eyeball center point and the connecting line of the right eye pupil center point and the right eyeball center point, and the eyeball center is determined by the eyepit and the eyepit curve in the image. Further judging whether the intersection point, namely the focus of the human eyes, is in the range of the image target point, if so, judging that the human eyes are in the mobile phone in the direction of looking; the target point range is a preset range in an image obtained by the front camera of the mobile phone and is used for showing the corresponding position of the mobile phone screen in the image, for example, when the mobile phone camera is positioned right above the mobile phone, the range of the lower part of the image, which is 70 percent, is set as the target point range, just like a person watching his left wrist, the sight focus of the person can be felt to fall on the lower left corner of the picture seen by the person, and similarly, if the sight of the person, namely the eye focus, falls in the target point range of the image at the moment, the person is considered to watch the mobile phone screen at the moment.
Further, in step S400, when it is determined that the mobile terminal screen is watched by human eyes, the mobile terminal screen is controlled to be lighted.
In the embodiment, when the human eyes are judged to be watching the screen of the mobile terminal, namely the focus of the human eyes is within the range of the target point of the image, the screen of the mobile terminal is controlled to be lightened.
For example, if the target point range is set by the mobile phone to be the whole area of 70% of the image at the moment, and the human eye focus is calculated to be located at the center of the image, the human eye focus is located in the target point range, that is, the human eye is watching the mobile phone screen at the moment, and the BB chip outputs a command to control the mobile phone screen to be powered on and lighted.
In a second embodiment, in order to further optimize the process of identifying whether a user approaches the mobile terminal in a screen-off state and reduce the energy consumption of the mobile terminal in a standby state, a sensor capable of detecting a human body, such as an infrared sensor or a radar, is equipped for the mobile phone, and whether a human body exists near the mobile terminal is monitored in real time according to a preset distance. In addition, the working states of sensors such as the infrared sensor, the radar and the like and the camera can be further limited by matching with a remote sensing sensor in the mobile terminal, for example, when the remote sensing sensor detects that the screen of the mobile terminal is placed downwards, the infrared sensor, the radar and the camera can be closed to collect pictures, the screen cannot be observed at the moment, and when the screen is placed upwards, the infrared sensor, the radar and the camera can be opened to collect pictures, so that the standby energy consumption of the mobile terminal is further reduced.
In a third embodiment, in order to further improve the judgment accuracy of the mobile terminal screen lighting control method, when the screen is turned off, the mobile terminal acquires images in a two-continuous-shooting or three-continuous-shooting manner when regularly shooting the images in front of the mobile terminal screen at a predetermined distance, the continuous-shooting interval can be set to 0.2s-0.5s, so as to eliminate the problem that the screen is turned on by unintentional behaviors of the user, when the similarity of the eye parts of the two pictures in the two-continuous-shooting reaches more than 80%, the behavior is continuously judged, if the similarity of the eye parts of the two pictures in the two-continuous-shooting is lower than 80%, the user is judged not to observe the mobile terminal screen, so that the judgment accuracy of the screen lighting method can be improved, and better use experience can be provided for the user.
Example apparatus
As shown in fig. 5, an embodiment of the present invention provides a mobile terminal screen lighting control apparatus, including: an image capturing module 510, a recognition module 520, a judgment module 530, and a lighting control module 540. Specifically, the image capturing module 510 is configured to capture an image of a predetermined distance in front of a screen of the mobile terminal at regular time when the screen is turned off; the identification module 520 is used for identifying whether human eyes exist in the image based on the image in front of the screen of the mobile terminal; a judging module 530, configured to judge whether the human eye of the image watches the screen of the mobile terminal when the human eye of the image is identified; and the lighting control module 540 is configured to control lighting of the screen of the mobile terminal when it is determined that human eyes watch the screen of the mobile terminal.
Based on the above embodiments, the present invention further provides a mobile terminal, and a schematic block diagram thereof may be as shown in fig. 6. The mobile terminal comprises a processor, a memory, a network interface, a display screen and a camera which are connected through a system bus. Wherein the processor of the mobile terminal is configured to provide computing and control capabilities. The memory of the mobile terminal comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the mobile terminal is used for connecting and communicating with an external terminal through a network. The computer program is executed by a processor to implement a mobile terminal screen lighting control method. The display screen of the mobile terminal can be a liquid crystal display screen or an electronic ink display screen, and the camera of the mobile terminal is arranged in the mobile terminal in advance and used for detecting and shooting human faces.
It will be understood by those skilled in the art that the block diagram of fig. 6 is a block diagram of only a portion of the structure associated with the inventive arrangements and is not intended to limit the mobile terminal to which the inventive arrangements may be applied, as a particular mobile terminal may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a mobile terminal is provided, the mobile terminal includes a memory, a processor, and an image display program stored in the memory and executable on the processor, and the processor implements the following operation instructions when executing the image display program:
when the screen is in the screen-off state, the mobile terminal regularly shoots and acquires an image in front of the screen of the mobile terminal by a preset distance;
identifying whether human eyes exist in the image or not based on the image in front of the screen of the mobile terminal;
when the human eyes in the image are identified, judging whether the human eyes of the image watch the screen of the mobile terminal;
and when judging that human eyes watch the screen of the mobile terminal, controlling to lighten the screen of the mobile terminal.
When the screen is turned off, the mobile terminal regularly shoots and acquires an image of a preset distance in front of a screen of the mobile terminal, and the shooting comprises the following steps:
detecting whether the mobile terminal is in a screen-off state;
when the mobile terminal is in a screen-off state, the mobile terminal regularly detects whether a face appears within a preset distance in front of a screen of the mobile terminal;
and when the fact that a face appears in the preset distance in front of the screen of the mobile terminal is detected, controlling to shoot and obtain a face image in front of the screen of the mobile terminal through a front camera of the mobile terminal.
The step of identifying whether human eyes exist in the image based on the image in front of the screen of the mobile terminal comprises the following steps:
and identifying whether human eyes exist in the image or not according to human eye characteristics preset in the mobile terminal based on the image in front of the mobile terminal screen.
When the human eyes in the image are identified, the step of judging whether the human eyes of the image watch the screen of the mobile terminal comprises the following steps:
when the eyes are identified in the image, thinning the eye position image, and not processing and sampling the image outside the eye position image range;
calculating the refined human eye position image, finding the human eye focus position, and judging whether human eyes of the image watch the screen of the mobile terminal.
The step of calculating the refined human eye position image, finding the human eye focus position and judging whether the human eyes of the image watch the screen of the mobile terminal comprises the following steps:
drawing a connecting line between the pupil center point and the eye center in the eyes according to the thinned eye image, finding a cross point of the connecting line between the pupils of the two eyes and the eye center, namely a focus of the eyes, and judging whether the cross point of the connecting line is within the target range of the whole image; if yes, judging that the eyes are looking at the mobile terminal;
wherein, the center of the human eyes is the center point of the eyeballs; the image target range is determined according to the position of the front camera in the mobile terminal and the size of the shot image.
Wherein the human eye center is obtained by the following method;
obtaining an eyeball contour according to the orbit and eye socket curves in the image;
and determining an eyeball center point according to the eyeball contour.
The image target range is determined according to the position of the front camera in the mobile terminal and the size of the shot image, and the range of 70% of the inner lower part of the image is set as the target range.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, databases, or other media used in embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
In summary, the present invention discloses a method, an apparatus, a mobile terminal and a storage medium for controlling lighting of a screen of a mobile terminal, wherein the method comprises: when the screen is in the screen-off state, the mobile terminal regularly shoots and acquires an image in front of the screen of the mobile terminal by a preset distance; identifying whether human eyes exist in the image or not based on the image in front of the screen of the mobile terminal; when the human eyes in the image are identified, judging whether the human eyes of the image watch the screen of the mobile terminal; and when judging that human eyes watch the screen of the mobile terminal, controlling to lighten the screen of the mobile terminal. The invention can identify human eyes, and lights the screen when the mobile terminal identifies that human eyes watch the screen of the mobile terminal within a preset distance. The screen lighting method aims to solve the problem that the existing screen lighting technology is difficult to light the screen to check the operation such as information and time in modes such as fingerprint and facial recognition when people eat meals and the like under the condition that both hands are inconvenient, and brings relatively poor user experience to users.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A mobile terminal screen lighting control method is characterized by comprising the following steps:
when the screen is in the screen-off state, the mobile terminal regularly shoots and acquires an image in front of the screen of the mobile terminal by a preset distance;
identifying whether human eyes exist in the image or not based on the image in front of the screen of the mobile terminal;
when the human eyes in the image are identified, judging whether the human eyes of the image watch the screen of the mobile terminal;
and when judging that human eyes watch the screen of the mobile terminal, controlling to lighten the screen of the mobile terminal.
2. The method for controlling the lighting of the screen of the mobile terminal according to claim 1, wherein the step of the mobile terminal regularly shooting and acquiring the image of the predetermined distance in front of the screen of the mobile terminal in the screen-off state comprises:
detecting whether the mobile terminal is in a screen-off state;
when the mobile terminal is in a screen-off state, the mobile terminal regularly detects whether a face appears within a preset distance in front of a screen of the mobile terminal;
and when the fact that a face appears in the preset distance in front of the screen of the mobile terminal is detected, controlling to shoot and obtain a face image in front of the screen of the mobile terminal through a front camera of the mobile terminal.
3. The method for controlling lighting of a screen of a mobile terminal according to claim 1, wherein the step of identifying whether human eyes are present in the image based on the image in front of the screen of the mobile terminal comprises:
and identifying whether human eyes exist in the image or not according to human eye characteristics preset in the mobile terminal based on the image in front of the mobile terminal screen.
4. The method for controlling lighting of a screen of a mobile terminal according to claim 1, wherein the step of determining whether the human eye of the image is watching the screen of the mobile terminal when the human eye of the image is recognized comprises:
when the eyes are identified in the image, thinning the eye position image, and not processing and sampling the image outside the eye position image range;
calculating the refined human eye position image, finding the human eye focus position, and judging whether human eyes of the image watch the screen of the mobile terminal.
5. The method for controlling lighting of a screen of a mobile terminal according to claim 4, wherein the step of calculating the refined image of the position of the human eyes to find the position of the focus of the human eyes and determining whether the human eyes of the image are watching the screen of the mobile terminal comprises:
drawing a connecting line between the pupil center point and the eye center in the eyes according to the thinned eye image, finding a cross point of the connecting line between the pupils of the two eyes and the eye center, namely a focus of the eyes, and judging whether the cross point of the connecting line is within the target range of the whole image; if yes, judging that the eyes are looking at the mobile terminal;
wherein, the center of the human eyes is the center point of the eyeballs; the image target range is determined according to the position of the front camera in the mobile terminal and the size of the shot image.
6. The mobile terminal screen lighting control method of claim 5, wherein the human eye center is obtained by the following method;
obtaining an eyeball contour according to the orbit and eye socket curves in the image;
and determining an eyeball center point according to the eyeball contour.
7. The method for controlling lighting of a screen of a mobile terminal according to claim 5, wherein the image target range is determined according to a position of the front camera in the mobile terminal and a size of a shot image, and the lower 70% range in the image is set as the target range.
8. A mobile terminal screen lighting control apparatus, characterized in that the apparatus comprises:
the image shooting module is used for shooting and acquiring an image in front of a screen of the mobile terminal at a preset distance at fixed time by the mobile terminal when the screen is turned off;
the identification module is used for identifying whether human eyes exist in the image based on the image in front of the screen of the mobile terminal;
the judging module is used for judging whether the human eyes of the image watch the screen of the mobile terminal or not when the human eyes of the image are identified;
and the lighting control module is used for controlling the lighting of the screen of the mobile terminal when judging that human eyes watch the screen of the mobile terminal.
9. A mobile terminal, characterized in that the mobile terminal comprises a memory, a processor and an image display program stored in the memory and operable on the processor, and the processor implements the steps of the mobile terminal screen lighting control method according to any one of claims 1-7 when executing the image display program.
10. A computer-readable storage medium, having stored thereon an image display program which, when executed by a processor, implements the steps of the mobile terminal screen lighting control method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110490500.8A CN113190119A (en) | 2021-05-06 | 2021-05-06 | Mobile terminal screen lighting control method and device, mobile terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110490500.8A CN113190119A (en) | 2021-05-06 | 2021-05-06 | Mobile terminal screen lighting control method and device, mobile terminal and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113190119A true CN113190119A (en) | 2021-07-30 |
Family
ID=76983737
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110490500.8A Pending CN113190119A (en) | 2021-05-06 | 2021-05-06 | Mobile terminal screen lighting control method and device, mobile terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113190119A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113885734A (en) * | 2021-11-01 | 2022-01-04 | 浙江方泰显示技术有限公司 | Control method based on integrated LED display screen |
| CN114938556A (en) * | 2022-04-29 | 2022-08-23 | 中国科学院半导体研究所 | Automatic adjusting method and device for light of desk lamp, electronic equipment and storage medium |
| CN116795212A (en) * | 2023-06-19 | 2023-09-22 | 深圳市晚成辉电子有限公司 | Control method of plasma display screen |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102999162A (en) * | 2012-11-20 | 2013-03-27 | 广东欧珀移动通信有限公司 | Mobile terminal as well as automatic bright screen state keeping method and system thereof |
| CN104113680A (en) * | 2013-04-19 | 2014-10-22 | 北京三星通信技术研究有限公司 | Sight line tracking system and method |
| CN104238948A (en) * | 2014-09-29 | 2014-12-24 | 广东欧珀移动通信有限公司 | Method for illumining screen of smart watch and smart watch |
| CN105549739A (en) * | 2015-12-10 | 2016-05-04 | 魅族科技（中国）有限公司 | Screen lighting method and terminal |
| CN106325510A (en) * | 2016-08-19 | 2017-01-11 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN106484113A (en) * | 2016-10-11 | 2017-03-08 | 京东方科技集团股份有限公司 | Screen Rouser and method |
| CN106547358A (en) * | 2016-11-25 | 2017-03-29 | 维沃移动通信有限公司 | A kind of display packing and terminal of terminal time information |
| CN106843468A (en) * | 2016-12-27 | 2017-06-13 | 努比亚技术有限公司 | A kind of man-machine interaction method in terminal and VR scenes |
| CN107566643A (en) * | 2017-08-31 | 2018-01-09 | 广东欧珀移动通信有限公司 | Information processing method, device, storage medium and electronic equipment |
| CN108509037A (en) * | 2018-03-26 | 2018-09-07 | 维沃移动通信有限公司 | A kind of method for information display and mobile terminal |
| CN109557999A (en) * | 2017-09-25 | 2019-04-02 | 北京小米移动软件有限公司 | Bright screen control method, device and storage medium |
| CN110580102A (en) * | 2018-04-12 | 2019-12-17 | Oppo广东移动通信有限公司 | screen lightening method and device, mobile terminal and storage medium |
-
2021
- 2021-05-06 CN CN202110490500.8A patent/CN113190119A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102999162A (en) * | 2012-11-20 | 2013-03-27 | 广东欧珀移动通信有限公司 | Mobile terminal as well as automatic bright screen state keeping method and system thereof |
| CN104113680A (en) * | 2013-04-19 | 2014-10-22 | 北京三星通信技术研究有限公司 | Sight line tracking system and method |
| CN104238948A (en) * | 2014-09-29 | 2014-12-24 | 广东欧珀移动通信有限公司 | Method for illumining screen of smart watch and smart watch |
| CN105549739A (en) * | 2015-12-10 | 2016-05-04 | 魅族科技（中国）有限公司 | Screen lighting method and terminal |
| CN106325510A (en) * | 2016-08-19 | 2017-01-11 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN106484113A (en) * | 2016-10-11 | 2017-03-08 | 京东方科技集团股份有限公司 | Screen Rouser and method |
| CN106547358A (en) * | 2016-11-25 | 2017-03-29 | 维沃移动通信有限公司 | A kind of display packing and terminal of terminal time information |
| CN106843468A (en) * | 2016-12-27 | 2017-06-13 | 努比亚技术有限公司 | A kind of man-machine interaction method in terminal and VR scenes |
| CN107566643A (en) * | 2017-08-31 | 2018-01-09 | 广东欧珀移动通信有限公司 | Information processing method, device, storage medium and electronic equipment |
| CN109557999A (en) * | 2017-09-25 | 2019-04-02 | 北京小米移动软件有限公司 | Bright screen control method, device and storage medium |
| CN108509037A (en) * | 2018-03-26 | 2018-09-07 | 维沃移动通信有限公司 | A kind of method for information display and mobile terminal |
| CN110580102A (en) * | 2018-04-12 | 2019-12-17 | Oppo广东移动通信有限公司 | screen lightening method and device, mobile terminal and storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113885734A (en) * | 2021-11-01 | 2022-01-04 | 浙江方泰显示技术有限公司 | Control method based on integrated LED display screen |
| CN114938556A (en) * | 2022-04-29 | 2022-08-23 | 中国科学院半导体研究所 | Automatic adjusting method and device for light of desk lamp, electronic equipment and storage medium |
| CN114938556B (en) * | 2022-04-29 | 2023-11-24 | 中国科学院半导体研究所 | Automatic adjusting method and device for light of desk lamp, electronic equipment and storage medium |
| CN116795212A (en) * | 2023-06-19 | 2023-09-22 | 深圳市晚成辉电子有限公司 | Control method of plasma display screen |
| CN116795212B (en) * | 2023-06-19 | 2024-03-01 | 深圳市晚成辉电子有限公司 | Control method of plasma display screen |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113190119A (en) | Mobile terminal screen lighting control method and device, mobile terminal and storage medium | |
| US10165176B2 (en) | Methods, systems, and computer readable media for leveraging user gaze in user monitoring subregion selection systems | |
| US11715231B2 (en) | Head pose estimation from local eye region | |
| WO2017161867A1 (en) | Screen brightness adjustment method and apparatus, and intelligent terminal | |
| US8988519B2 (en) | Automatic magnification of data on display screen based on eye characteristics of user | |
| US10776646B2 (en) | Identification method and apparatus and computer-readable storage medium | |
| CN107835359B (en) | Photographing triggering method of mobile terminal, mobile terminal and storage device | |
| KR102478396B1 (en) | The Electronic Device Recognizing the Text in the Image | |
| CN109375765B (en) | Eyeball tracking interaction method and device | |
| KR20180109109A (en) | Method of recognition based on IRIS recognition and Electronic device supporting the same | |
| US9563258B2 (en) | Switching method and electronic device | |
| US11816924B2 (en) | Method for behaviour recognition based on line-of-sight estimation, electronic equipment, and storage medium | |
| CN105068646A (en) | Terminal control method and system | |
| CN111045577A (en) | Horizontal and vertical screen switching method, wearable device and device with storage function | |
| KR20200144196A (en) | Electronic device and method for providing function using corneal image thereof | |
| CN113473015B (en) | Holder control method and electronic equipment | |
| KR101000130B1 (en) | Mobile terminal capable face recognition and method for face recognition thereof | |
| CN112733673B (en) | Content display method and device, electronic equipment and readable storage medium | |
| KR20140132906A (en) | Device and method for mobile tooltip using eye detecting | |
| CN114895790A (en) | Man-machine interaction method and device, electronic equipment and storage medium | |
| CN111179860A (en) | Backlight mode adjusting method of electronic equipment, electronic equipment and device | |
| CN110399780B (en) | Face detection method and device and computer readable storage medium | |
| CN111557007B (en) | Method for detecting opening and closing states of eyes and electronic equipment | |
| CN114724232A (en) | Posture recognition and correction method, device and system and electronic equipment | |
| US11790692B2 (en) | Method for behaviour recognition, electronic equipment, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210730 |
|
| RJ01 | Rejection of invention patent application after publication |