CN108469893B - Display screen control method, device, equipment and computer readable storage medium - Google Patents

Display screen control method, device, equipment and computer readable storage medium Download PDF

Info

Publication number
CN108469893B
CN108469893B CN201810194852.7A CN201810194852A CN108469893B CN 108469893 B CN108469893 B CN 108469893B CN 201810194852 A CN201810194852 A CN 201810194852A CN 108469893 B CN108469893 B CN 108469893B
Authority
CN
China
Prior art keywords
display
user
display screen
displays
cameras
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810194852.7A
Other languages
Chinese (zh)
Other versions
CN108469893A (en
Inventor
尹德帅
李晓琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Haier Uplus Intelligent Technology Beijing Co Ltd
Original Assignee
Haier Uplus Intelligent Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Haier Uplus Intelligent Technology Beijing Co Ltd filed Critical Haier Uplus Intelligent Technology Beijing Co Ltd
Priority to CN201810194852.7A priority Critical patent/CN108469893B/en
Publication of CN108469893A publication Critical patent/CN108469893A/en
Application granted granted Critical
Publication of CN108469893B publication Critical patent/CN108469893B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3231Monitoring the presence, absence or movement of users
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/325Power saving in peripheral device
    • G06F1/3265Power saving in display device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides a control method, a device, equipment and a computer readable storage medium of a display screen, wherein the method comprises the following steps: when the vision of the user is detected to be within the range of the display screen of any display through all or part of the cameras, the display screen of any display is controlled to display, and the display screens of other displays are closed. The invention realizes that the display screen watched by the user is controlled to display according to the sight of the user, and the display screen not watched by the user is closed, thereby effectively saving energy, prolonging the service life of the display screen and avoiding the radiation of a plurality of display screens to the user.

Description

Display screen control method, device, equipment and computer readable storage medium
Technical Field
The present invention relates to the field of display control technologies, and in particular, to a method, an apparatus, a device, and a computer-readable storage medium for controlling a display screen.
Background
With the rapid development of terminals (e.g., computers, mobile terminals, industrial processing equipment, etc.), the terminals are usually equipped with a plurality of display screens, and the display screens respectively display different display contents to increase the display area of the display screens. However, the existing display screen is completely displayed or completely closed according to the setting of the user, and the display screen watched by the user cannot be controlled according to the sight of the user to be displayed, and the display screen not watched by the user is controlled to be dormant or closed, so that huge energy waste is caused, the service life of the display screen is shortened, and the energy conservation and emission reduction are not facilitated.
Disclosure of Invention
The invention provides a display screen control method, a display screen control device, display screen control equipment and a computer readable storage medium, which are used for solving the problem that a plurality of display screens cannot dynamically display according to the sight of a user in the prior art.
The technical scheme adopted by the invention is to provide a control method of a display screen, which is applied to a terminal with at least two displays, wherein each display comprises: display screen and camera, the method includes:
when the vision of the user is detected to be within the range of the display screen of any display through all or part of the cameras, the display screen of any display is controlled to display, and the display screens of other displays are closed.
Optionally, controlling the display screen of any display to display, and closing the display screens of other displays, includes:
identifying the biological characteristics of the user through all or part of cameras to obtain first biological characteristic information corresponding to the user;
judging whether the user is a legal user or not according to the first biological characteristic information;
if so, controlling the display screen of any display to display, and closing the display screens of other displays;
otherwise, the display screens of all the displays are closed.
Optionally, in a case that the number of the users is multiple, the method further includes:
when the sight lines of all users are detected to be within the range of the display screen of one or more displays through all or part of the cameras, identifying the biological characteristics of all the users through all or part of the cameras to obtain second biological characteristic information corresponding to all the users;
judging whether a legal user exists in all users according to the second biological characteristic information;
if legal users exist in all the users, controlling display screens of all the displays to display; otherwise, the display screens of all the displays are closed.
Optionally, the method of detecting that the line of sight of the user is within the range of the display screen of any display through all or part of the cameras includes:
acquiring pupil information of a user through all or part of cameras;
and detecting whether the sight of the user is within the range of a display screen of any display or not according to the pupil information based on a preset pupil real-time tracking model.
Optionally, turning off the display screens of other displays includes:
and closing the display screens of other displays after the set time length.
The present invention also provides a control device for a display screen, which is disposed in a terminal having at least two displays, each display including: display screen and camera, the device includes:
and the control module is used for controlling the display screen of any display to display and closing the display screens of other displays when the vision of the user is detected to be within the range of the display screen of any display through all or part of the cameras. .
Optionally, the control module includes:
the first identification module is used for identifying the biological characteristics of the user through all or part of the cameras to obtain first biological characteristic information corresponding to the user when the fact that the sight line of the user is detected to be within the range of a display screen of any display through all or part of the cameras is detected;
the first judgment module is used for judging whether the user is a legal user or not according to the first biological characteristic information;
and the first execution module is used for controlling the display screen of any display to display and closing the display screens of other displays when the user is a legal user.
Optionally, the apparatus further comprises:
the second identification module is used for identifying the biological characteristics of all users through all or part of the cameras to obtain second biological characteristic information corresponding to all users when the number of the users is multiple and the sight lines of all the users are detected to be within the range of the display screen of one or more displays through all or part of the cameras;
the second judging module is used for judging whether legal users exist in all the users or not according to the second biological characteristic information;
the second execution module is used for controlling the display screens of all the displays to display if legal users exist in all the users; otherwise, the display screens of all the displays are closed.
The invention also provides a control device of the display screen, which comprises a processor, a memory and at least two displays; each display includes: a display screen and a camera;
the processor is used for executing the program for controlling the display screen stored in the memory so as to realize the steps of the control method of the display screen.
The present invention also provides a computer-readable storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the steps of the above-mentioned control method of a display screen.
By adopting the technical scheme, the invention at least has the following advantages:
the control method, the control device, the control equipment and the computer readable storage medium for the display screen realize that the display screen watched by the user is controlled according to the sight of the user to be displayed, and the display screen not watched by the user is closed, so that the energy is effectively saved, the service life of the display screen is prolonged, and the radiation of a plurality of display screens to the user is avoided.
Drawings
FIG. 1 is a flowchart illustrating a method for controlling a display screen according to a second embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for controlling a display screen according to a third embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for controlling a display screen according to a fourth embodiment of the present invention;
FIG. 4 is a flowchart illustrating a method for controlling a display screen according to a fifth embodiment of the present invention;
FIG. 5 is a flowchart illustrating a method for controlling a display screen according to a sixth embodiment of the present invention;
FIG. 6 is a schematic diagram of a control device of a display panel according to an eighth embodiment of the present invention;
FIG. 7 is a schematic diagram of a control device of a display panel according to a ninth embodiment of the present invention;
fig. 8 is a schematic structural diagram of a control device of a display screen according to a tenth embodiment of the present invention.
Detailed Description
To further explain the technical means and effects of the present invention adopted to achieve the intended purpose, the present invention will be described in detail with reference to the accompanying drawings and preferred embodiments.
A first embodiment of the present invention is a method for controlling a display screen, applied to a terminal having at least two displays, each display including: display screen and camera, including following concrete step:
and S101, when all or part of the cameras detect that the sight line of the user is within the range of the display screen of any display, controlling the display screen of any display to display, and closing the display screens of other displays.
Optionally, the manner of detecting that the line of sight of the user is within the range of the display screen of any display through all or part of the cameras includes but is not limited to:
acquiring pupil information of a user through all or part of cameras;
and detecting whether the sight of the user is within the range of a display screen of any display or not according to the pupil information based on a preset pupil real-time tracking model.
In this embodiment, the terminal is not specifically limited, and the terminal includes but is not limited to: computers, mobile terminals, industrial processing equipment, household appliances and the like having at least two displays.
In this embodiment, the size and the position of the display are not particularly limited, and the size of each display may be the same or different.
In this embodiment, for the case of detecting the line of sight of the user by using a part of the cameras, the determining manner of the cameras for detecting the line of sight of the user includes, but is not limited to:
the method comprises the steps that one or more cameras for detecting the sight of a user are determined according to the setting of the user;
determining one or more cameras for detecting the sight of the user according to factory settings of the cameras;
and determining one or more cameras for detecting the sight of the user according to the data statistics of the sight of the user detected by all the cameras for a limited number of times.
The control method of the display screen according to the first embodiment of the invention realizes that the display screen watched by the user is controlled according to the sight of the user, and the display screen not watched by the user is closed, thereby effectively saving energy, prolonging the service life of the display screen, and avoiding the radiation of a plurality of display screens to the user.
A second embodiment of the present invention is a method for controlling a display screen, applied to a terminal having at least two displays, each display including: the display screen and the camera, as shown in fig. 1, comprise the following steps:
step S201, when all or part of the cameras detect that the sight line of the user is within the range of the display screen of any display, all or part of the cameras identify the biological characteristics of the user to obtain first biological characteristic information corresponding to the user.
In this embodiment, identifying the biometric features of the user by all or part of the cameras to obtain the first biometric feature information corresponding to the user at least includes one of the following modes:
the method comprises the steps that firstly, the human faces of a user are identified through all or part of cameras, and first human face identification information corresponding to the user is obtained;
and secondly, identifying the irises of the user through all or part of the cameras to obtain first iris identification information corresponding to the user.
Optionally, the manner of detecting that the line of sight of the user is within the range of the display screen of any display through all or part of the cameras includes but is not limited to:
acquiring pupil information of a user through all or part of cameras;
and detecting whether the sight of the user is within the range of a display screen of any display or not according to the pupil information based on a preset pupil real-time tracking model.
Step S202, judging whether the user is a legal user or not according to the first biological characteristic information.
In this embodiment, the manner of determining whether the user is a valid user according to the first biometric information includes, but is not limited to:
matching the first biological characteristic information with pre-stored biological characteristic information;
if the first biological characteristic information is matched with the pre-stored biological characteristic information, judging that the user is a legal user;
and if the first biological characteristic information is not matched with the pre-stored biological characteristic information, judging that the user is not a legal user.
Step S203, if the user is judged to be a legal user, controlling the display screen of any display to display, and closing the display screens of other displays; otherwise, the display screens of all the displays are closed.
Optionally, the manner of turning off the display screen of other displays includes but is not limited to:
and closing the display screens of other displays after the set time length.
Through delaying the display screen that closes other displays, can avoid the user to carry out under the condition of comparing two or more display screen display content in turn, the scintillation that the frequent opening or closing of display screen that causes has effectively improved display effect and user experience.
In this embodiment, the set duration is not specifically limited, and may be set according to a statistical result obtained by counting the use condition of the display screen by the user, or may be manually set by the user.
In this embodiment, the terminal is not specifically limited, and the terminal includes but is not limited to: computers, mobile terminals, industrial processing equipment, household appliances and the like having at least two displays.
In this embodiment, the size and the position of the display are not particularly limited, and the size of each display may be the same or different.
In this embodiment, for the case of detecting the line of sight of the user by using a part of the cameras, the determining manner of the cameras for detecting the line of sight of the user includes, but is not limited to:
the method comprises the steps that one or more cameras for detecting the sight of a user are determined according to the setting of the user;
determining one or more cameras for detecting the sight of the user according to factory settings of the cameras;
and determining one or more cameras for detecting the sight of the user according to the data statistics of the sight of the user detected by all the cameras for a limited number of times.
The control method of the display screen according to the second embodiment of the invention realizes that the display screen watched by the user is controlled according to the sight of the user, and the display screen not watched by the user is closed, thereby effectively saving energy, prolonging the service life of the display screen, and avoiding the radiation of a plurality of display screens to the user.
In a third embodiment of the present invention, a method for controlling a display screen is applied to a terminal having at least two displays, where each display includes: as shown in fig. 2, the display screen and the camera include the following specific steps:
step S301, when all or part of the cameras detect that the sight lines of all the users are within the range of the display screen of one or more displays, the biological characteristics of all the users are identified through all or part of the cameras, and second biological characteristic information corresponding to all the users is obtained.
In this embodiment, the obtaining of the second biometric information corresponding to all users by identifying the biometric features of all or part of the cameras includes at least one of the following modes:
the method comprises the steps that firstly, the faces of all users are identified through all or part of cameras, and second face identification information corresponding to all the users is obtained;
and secondly, identifying the irises of all the users through all or part of the cameras to obtain second iris identification information corresponding to the users.
Optionally, the manner of detecting that all the user's sight lines are within the range of the display screen of one or more displays by all or part of the cameras includes but is not limited to:
acquiring pupil information of all users through all or part of cameras;
and detecting whether the sight lines of all users are within the range of the display screen of one or more displays according to the pupil information based on a preset pupil real-time tracking model.
Step S302, according to the second biological characteristic information, judging whether legal users exist in all users.
In this embodiment, the manner of determining whether there is a valid user in all users according to the second biometric information includes, but is not limited to:
matching the second biological characteristic information with pre-stored biological characteristic information;
if the second biological characteristic information contains biological characteristic information matched with the pre-stored biological characteristic information, judging that legal users exist in all users;
and if the second biological characteristic information does not have biological characteristic information matched with the pre-stored biological characteristic information, judging that no legal user exists in all the users.
Step S303, if legal users exist in all users, controlling display screens of all displays to display; otherwise, the display screens of all the displays are closed.
In this embodiment, the set duration is not specifically limited, and may be set according to a statistical result obtained by counting the use condition of the display screen by the user, or may be manually set by the user.
In this embodiment, the terminal is not specifically limited, and the terminal includes but is not limited to: computers, mobile terminals, industrial processing equipment, household appliances and the like having at least two displays.
In this embodiment, the size and the position of the display are not particularly limited, and the size of each display may be the same or different.
Under the condition that no legal user exists in the user, the display screens of all the displays are closed, so that the phenomenon that an illegal user steals privacy information and/or business information in the user terminal is avoided, and the safety of the information in the terminal is effectively improved.
In this embodiment, for the case of detecting the line of sight of the user by using a part of the cameras, the determining manner of the cameras for detecting the line of sight of the user includes, but is not limited to:
the method comprises the steps that one or more cameras for detecting the sight of a user are determined according to the setting of the user;
determining one or more cameras for detecting the sight of the user according to factory settings of the cameras;
and determining one or more cameras for detecting the sight of the user according to the data statistics of the sight of the user detected by all the cameras for a limited number of times.
The method for controlling the display screen according to the third embodiment of the invention realizes that the display screen watched by the user is controlled according to the sight of the user, and the display screen not watched by the user is closed, thereby effectively saving energy, prolonging the service life of the display screen, and avoiding the radiation of a plurality of display screens to the user.
A fourth embodiment of the present invention is based on the above embodiments, and an application example of the present invention is described with reference to fig. 3 by taking a control method of a display screen as an example.
The fourth embodiment of the present invention is applied to a notebook computer, which is connected to a second display in which a second camera is preset; wherein, this notebook computer includes: the device comprises a first camera and a first display.
The fourth embodiment of the present invention comprises the steps of:
step S401, pupil information of the user is acquired in real time through the first camera and the second camera.
Step S402, judging whether the user is a legal user according to the pupil information of the user.
In this embodiment, the manner of determining whether the user is a valid user according to the pupil information of the user includes, but is not limited to:
judging whether the pupil information of the user is matched with the preset pupil information;
if the pupil information of the user is matched with the preset pupil information, judging that the user is a legal user; otherwise, the user is judged not to be a legal user.
And step S403, under the condition that the user is judged to be a legal user, judging whether the sight line of the user is in the display range of the first display or the second display according to the pupil information of the user and based on a preset pupil real-time tracking model.
Optionally, step S403 includes:
according to the pupil information of the user, based on a gradient pupil center detection model, the iris edge and the key gradient of the iris are searched from K radial radiation directions, and the distribution range of K radial straight lines is adjusted to judge whether the sight line of the user is in the display range of the first display or the display range of the second display.
Experiments show that the gradient pupil center detection model has high sight line efficiency for judging the user, can adapt to pupil detection of the user under the condition that eyeballs are shielded, can achieve real-time tracking, and has good pupil detection precision.
Step S404, if the sight of the user is judged to be in the display range of the first display, the first display is controlled to display, and the second display is closed after the set time length;
and if the sight line of the user is judged to be in the display range of the second display, controlling the second display to display, and closing the first display after the set time length.
And step S405, when the sight lines of a plurality of users are judged to be in the display range of the first display and/or the second display, controlling the first display and the second display to display.
The method for controlling the display screen according to the fourth embodiment of the invention realizes that the display screen watched by the user is controlled according to the sight of the user, and the display screen not watched by the user is closed, thereby effectively saving energy, prolonging the service life of the display screen, and avoiding the radiation of a plurality of display screens to the user.
A fifth embodiment of the present invention is based on the above embodiments, and an application example of the present invention is described with reference to fig. 4 by taking a control method of a display screen as an example.
The fifth embodiment of the present invention is applied to a terminal device provided with a display in which four cameras are preset; wherein, the four displays are arranged horizontally; one or more cameras are preset on each display.
The fifth embodiment of the present invention comprises the steps of:
step S501, pupil information of the user is acquired in real time through all the cameras.
Step S502, according to the pupil information of the user, judging whether the user is a legal user.
In this embodiment, the manner of determining whether the user is a valid user according to the pupil information of the user includes, but is not limited to:
judging whether the pupil information of the user is matched with the preset pupil information;
if the pupil information of the user is matched with the preset pupil information, judging that the user is a legal user; otherwise, the user is judged not to be a legal user.
And step S503, under the condition that the user is judged to be a legal user, judging whether the sight line of the user is in the range of the display screen of any display or not based on a preset pupil real-time tracking model according to the pupil information of the user.
Optionally, step S503 includes:
and under the condition that the user is judged to be a legal user, searching iris edge and iris key gradient from K radial radiation directions based on a gradient pupil center detection model according to the pupil information of the user, and adjusting the distribution range of K radial straight lines to judge whether the sight of the user is in the range of a display screen of any display.
Experiments show that the gradient pupil center detection model has high sight line efficiency for judging the user, can adapt to pupil detection of the user under the condition that eyeballs are shielded, can achieve real-time tracking, and has good pupil detection precision.
And step S504, under the condition that the display screens of the four displays are all displayed, when the sight line of the user is judged to be within the display range of any display, the display screen of any display is kept to display, and the display screens of other displays are closed after the set time length.
And step S505, when the display screens of the four displays are all displayed, and the sight lines of a plurality of users are judged to be within the range of the display screens of one or more displays, the display screens of all the displays are kept for displaying.
And step S506, under the condition that the display screens of the four displays are closed, when the sight lines of a plurality of users are judged to be within the range of the display screens of one or more displays, controlling the display screens of all the displays to display.
The control method for the display screen according to the fifth embodiment of the invention realizes that the display screen watched by the user is controlled according to the sight of the user, and the display screen not watched by the user is closed, thereby effectively saving energy, prolonging the service life of the display screen, and avoiding the radiation of a plurality of display screens to the user.
A sixth embodiment of the present invention is based on the above embodiments, and an application example of the present invention is described with reference to fig. 5 by taking a control method of a display screen as an example.
The sixth embodiment of the present invention is applied to a terminal device provided with three displays, which are a first display, a second display, and a third display, respectively; wherein, the three displays are arranged horizontally; one or more cameras are preset in each camera.
The sixth embodiment of the present invention comprises the steps of:
step S601, acquiring pupil information of the user in real time by setting all or part of the cameras.
Step S602, determining whether the user is a valid user according to the pupil information of the user.
In this embodiment, the manner of determining whether the user is a valid user according to the pupil information of the user includes, but is not limited to:
judging whether the pupil information of the user is matched with the preset pupil information;
if the pupil information of the user is matched with the preset pupil information, judging that the user is a legal user; otherwise, the user is judged not to be a legal user.
Step S603, when it is determined that the user is a valid user, determining whether the line of sight of the user is within a display screen range of any display based on a preset pupil real-time tracking model according to the pupil information of the user.
Optionally, step S603 includes:
and under the condition that the user is judged to be a legal user, searching iris edge and iris key gradient from K radial radiation directions based on a gradient pupil center detection model according to the pupil information of the user, and adjusting the distribution range of K radial straight lines to judge whether the sight of the user is in the range of a display screen of any display.
Experiments show that the gradient pupil center detection model has high sight line efficiency for judging the user, can adapt to pupil detection of the user under the condition that eyeballs are shielded, can achieve real-time tracking, and has good pupil detection precision.
And step S604, when the display screen of the first display is displayed and the display screens of other displays are closed, and when the sight line of the user is determined to be within the display range of the second display, controlling the display screen of the second display to display, closing the display screen of the first display after the set time length, and keeping the closed state of the display screen of the third display.
And step S605, when the display screens of the first display are in display and the display screens of other displays are closed and the sight lines of a plurality of users are judged to be within the range of the display screen of one or more displays, the display state of the display screen of the first display is maintained, and the display screens of other displays are controlled to display.
The method for controlling the display screen according to the sixth embodiment of the invention realizes that the display screen watched by the user is controlled according to the sight of the user, and the display screen not watched by the user is closed, thereby effectively saving energy, prolonging the service life of the display screen, and avoiding the radiation of a plurality of display screens to the user.
In a seventh embodiment of the present invention, a control device for a display screen is disposed in a terminal having at least two displays, each display including: display screen and camera, including following component parts:
and the control module 100 is configured to control the display screen of any one of the displays to display and close the display screens of the other displays when it is detected that the line of sight of the user is within the range of the display screen of any one of the displays through all or part of the cameras.
Optionally, the manner of detecting that the line of sight of the user is within the range of the display screen of any display through all or part of the cameras includes but is not limited to:
acquiring pupil information of a user through all or part of cameras;
and detecting whether the sight of the user is within the range of a display screen of any display or not according to the pupil information based on a preset pupil real-time tracking model.
In this embodiment, the terminal is not specifically limited, and the terminal includes but is not limited to: computers, mobile terminals, industrial processing equipment, household appliances and the like having at least two displays.
In this embodiment, the size and the position of the display are not particularly limited, and the size of each display may be the same or different.
In this embodiment, for the case of detecting the line of sight of the user by using a part of the cameras, the determining manner of the cameras for detecting the line of sight of the user includes, but is not limited to:
the method comprises the steps that one or more cameras for detecting the sight of a user are determined according to the setting of the user;
determining one or more cameras for detecting the sight of the user according to factory settings of the cameras;
and determining one or more cameras for detecting the sight of the user according to the data statistics of the sight of the user detected by all the cameras for a limited number of times.
The control device for the display screen according to the seventh embodiment of the invention realizes that the display screen watched by the user is controlled according to the sight of the user, and the display screen not watched by the user is closed, thereby effectively saving energy, prolonging the service life of the display screen, and avoiding the radiation of a plurality of display screens to the user.
In an eighth embodiment of the present invention, a control device for a display screen is disposed in a terminal having at least two displays, each of the displays includes: the display screen and the camera, as shown in fig. 6, include the following components:
and the control module 100 is configured to control the display screen of any one of the displays to display and close the display screens of the other displays when it is detected that the line of sight of the user is within the range of the display screen of any one of the displays through all or part of the cameras.
Optionally, the control module 100 includes the following components:
the first identification module 101 is configured to identify biological features of a user through all or some cameras when it is detected that the line of sight of the user is within a display screen range of any display through all or some cameras, so as to obtain first biological feature information corresponding to the user.
In this embodiment, identifying the biometric features of the user by all or part of the cameras to obtain the first biometric feature information corresponding to the user at least includes one of the following modes:
the method comprises the steps that firstly, the human faces of a user are identified through all or part of cameras, and first human face identification information corresponding to the user is obtained;
and secondly, identifying the irises of the user through all or part of the cameras to obtain first iris identification information corresponding to the user.
Optionally, the manner of detecting that the line of sight of the user is within the range of the display screen of any display through all or part of the cameras includes but is not limited to:
acquiring pupil information of a user through all or part of cameras;
and detecting whether the sight of the user is within the range of a display screen of any display or not according to the pupil information based on a preset pupil real-time tracking model.
The first judging module 102 is configured to judge whether the user is a legal user according to the first biometric feature information.
In this embodiment, the manner of determining whether the user is a valid user according to the first biometric information includes, but is not limited to:
matching the first biological characteristic information with pre-stored biological characteristic information;
if the first biological characteristic information is matched with the pre-stored biological characteristic information, judging that the user is a legal user;
and if the first biological characteristic information is not matched with the pre-stored biological characteristic information, judging that the user is not a legal user.
The first execution module 103 is configured to control a display screen of any one of the displays to display and close display screens of other displays if it is determined that the user is a valid user; otherwise, the display screens of all the displays are closed.
Optionally, the manner of turning off the display screen of other displays includes but is not limited to:
and closing the display screens of other displays after the set time length.
Through delaying the display screen that closes other displays, can avoid the user to carry out under the condition of comparing two or more display screen display content in turn, the scintillation that the frequent opening or closing of display screen that causes has effectively improved display effect and user experience.
In this embodiment, the set duration is not specifically limited, and may be set according to a statistical result obtained by counting the use condition of the display screen by the user, or may be manually set by the user.
In this embodiment, the terminal is not specifically limited, and the terminal includes but is not limited to: computers, mobile terminals, industrial processing equipment, household appliances and the like having at least two displays.
In this embodiment, the size and the position of the display are not particularly limited, and the size of each display may be the same or different.
In this embodiment, for the case of detecting the line of sight of the user by using a part of the cameras, the determining manner of the cameras for detecting the line of sight of the user includes, but is not limited to:
the method comprises the steps that one or more cameras for detecting the sight of a user are determined according to the setting of the user;
determining one or more cameras for detecting the sight of the user according to factory settings of the cameras;
and determining one or more cameras for detecting the sight of the user according to the data statistics of the sight of the user detected by all the cameras for a limited number of times.
The control device for the display screen according to the eighth embodiment of the invention realizes that the display screen watched by the user is controlled according to the sight of the user, and the display screen not watched by the user is closed, thereby effectively saving energy, prolonging the service life of the display screen, and avoiding the radiation of a plurality of display screens to the user.
A ninth embodiment of the present invention is a control device for a display screen, applied to a terminal having at least two displays, each display including: the display screen and the camera, as shown in fig. 7, include the following components:
the second identification module 201 is configured to identify, by all or some of the cameras, the biometric features of all the users when it is detected that the lines of sight of all the users are within the range of the display screen of one or more displays, so as to obtain second biometric information corresponding to all the users.
In this embodiment, the obtaining of the second biometric information corresponding to all users by identifying the biometric features of all or part of the cameras includes at least one of the following modes:
the method comprises the steps that firstly, the faces of all users are identified through all or part of cameras, and second face identification information corresponding to all the users is obtained;
and secondly, identifying the irises of all the users through all or part of the cameras to obtain second iris identification information corresponding to the users.
Optionally, the manner of detecting that all the user's sight lines are within the range of the display screen of one or more displays by all or part of the cameras includes but is not limited to:
acquiring pupil information of all users through all or part of cameras;
and detecting whether the sight lines of all users are within the range of the display screen of one or more displays according to the pupil information based on a preset pupil real-time tracking model.
The second determining module 202 is configured to determine whether a valid user exists in all the users according to the second biometric information.
In this embodiment, the manner of determining whether there is a valid user in all users according to the second biometric information includes, but is not limited to:
matching the second biological characteristic information with pre-stored biological characteristic information;
if the second biological characteristic information contains biological characteristic information matched with the pre-stored biological characteristic information, judging that legal users exist in all users;
and if the second biological characteristic information does not have biological characteristic information matched with the pre-stored biological characteristic information, judging that no legal user exists in all the users.
The second execution module 203 is configured to control the display screens of all the displays to display if a valid user exists among all the users; otherwise, the display screens of all the displays are closed.
In this embodiment, the set duration is not specifically limited, and may be set according to a statistical result obtained by counting the use condition of the display screen by the user, or may be manually set by the user.
In this embodiment, the terminal is not specifically limited, and the terminal includes but is not limited to: computers, mobile terminals, industrial processing equipment, household appliances and the like having at least two displays.
In this embodiment, the size and the position of the display are not particularly limited, and the size of each display may be the same or different.
Under the condition that no legal user exists in the user, the display screens of all the displays are closed, so that the phenomenon that an illegal user steals privacy information and/or business information in the user terminal is avoided, and the safety of the information in the terminal is effectively improved.
In this embodiment, for the case of detecting the line of sight of the user by using a part of the cameras, the determining manner of the cameras for detecting the line of sight of the user includes, but is not limited to:
the method comprises the steps that one or more cameras for detecting the sight of a user are determined according to the setting of the user;
determining one or more cameras for detecting the sight of the user according to factory settings of the cameras;
and determining one or more cameras for detecting the sight of the user according to the data statistics of the sight of the user detected by all the cameras for a limited number of times.
The control device for the display screen according to the ninth embodiment of the invention realizes that the display screen watched by the user is controlled according to the sight of the user, and the display screen not watched by the user is closed, thereby effectively saving energy, prolonging the service life of the display screen, and avoiding the radiation of a plurality of display screens to the user.
A tenth embodiment of the present invention, a control apparatus for a display screen, as shown in fig. 8, includes the following components:
a processor 501, a memory 502, and at least two displays 503. In some embodiments of the invention, the processor 501, the memory 502, and the display 503 may be connected by a bus or other means. Wherein each display 503 comprises: a display 504 and a camera 505.
Processor 501 may be a general-purpose processor, such as a Central Processing Unit (Central Processing Unit,
CPU), a Digital Signal Processor (DSP), an application specific integrated circuit (english: an Application Specific Integrated Circuit, ASIC), or one or more Integrated circuits configured to implement embodiments of the present invention. Wherein, the memory 502 is used for storing executable instructions of the processor 501;
a memory 502 for storing program code and transferring the program code to the processor 501. Memory 502 may include Volatile Memory (Volatile Memory), such as Random Access Memory (RAM); the Memory 502 may also include a Non-Volatile Memory (Non-Volatile Memory), such as a Read-Only Memory (ROM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, HDD), or a Solid-State Drive (SSD); the memory 502 may also comprise a combination of memories of the kind described above.
The processor 501 is configured to call the program code management code stored in the memory 502, and perform some or all of the steps in any of the first embodiment to the fourth embodiment of the present invention.
The control device for the display screen according to the tenth embodiment of the invention realizes that the display screen watched by the user is controlled according to the sight of the user, and the display screen not watched by the user is closed, thereby effectively saving energy, prolonging the service life of the display screen, and avoiding the radiation of a plurality of display screens to the user.
An eleventh embodiment of the present invention is a computer-readable storage medium.
The computer storage media may be RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage media known in the art.
The computer readable storage medium stores one or more programs which are executable by one or more processors to implement some or all of the steps in any of the first to fourth embodiments of the present invention.
The computer-readable storage medium according to the eleventh embodiment of the present invention stores one or more programs, and the one or more programs can be executed by one or more processors, and can control the display screen watched by the user to display according to the line of sight of the user, and close the display screen not watched by the user, so as to effectively save energy, improve the service life of the display screen, and avoid radiation of multiple display screens to the user.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (7)

1. A control method of a display screen is applied to a terminal with at least two displays, and each display comprises: display screen and camera, its characterized in that, the method includes:
when the vision of a user is detected to be within the range of the display screen of any display through all or part of the cameras, controlling the display screen of any display to display, and closing the display screens of other displays;
the mode of detecting that the sight line of the user is within the range of the display screen of any display through all or part of the cameras comprises the following steps:
acquiring pupil information of the user through all or part of the cameras;
detecting whether the sight of the user is within the range of a display screen of any display or not according to the pupil information based on a preset pupil real-time tracking model;
in a case where the number of users is plural, the method further includes:
when all or part of the cameras detect that the sight lines of all the users are within the range of the display screen of one or more displays, identifying the biological characteristics of all the users through all or part of the cameras to obtain second biological characteristic information corresponding to all the users;
judging whether a legal user exists in all the users or not according to the second biological characteristic information;
if legal users exist in all the users, controlling display screens of all the displays to display; otherwise, the display screens of all the displays are closed.
2. The method according to claim 1, wherein the controlling the display screen of any one of the displays to display and the turning off the display screens of the other displays comprises:
identifying the biological characteristics of the user through all or part of the cameras to obtain first biological characteristic information corresponding to the user;
judging whether the user is a legal user or not according to the first biological characteristic information;
if so, controlling the display screen of any display to display, and closing the display screens of other displays;
otherwise, the display screens of all the displays are closed.
3. The method of any of claims 1-2, wherein turning off the display screens of the other displays comprises:
and closing the display screens of other displays after the set time length.
4. A control device of a display screen is arranged in a terminal with at least two displays, each display comprises: display screen and camera, its characterized in that, the device includes:
the control module is used for controlling the display screen of any display to display and closing the display screens of other displays when the camera detects that the sight line of the user is within the range of the display screen of any display;
the mode of detecting that the sight line of the user is within the range of the display screen of any display through all or part of the cameras comprises the following steps:
acquiring pupil information of the user through all or part of the cameras;
detecting whether the sight of the user is within the range of a display screen of any display or not according to the pupil information based on a preset pupil real-time tracking model;
the device further comprises:
the second identification module is used for identifying the biological characteristics of all the users through all or part of the cameras to obtain second biological characteristic information corresponding to all the users when the number of the users is multiple and all or part of the cameras detect that the sight lines of all the users are within the range of display screens of one or more displays;
the second judgment module is used for judging whether a legal user exists in all the users according to the second biological characteristic information;
the second execution module is used for controlling the display screens of all the displays to display if legal users exist in all the users; otherwise, the display screens of all the displays are closed.
5. The apparatus of claim 4, wherein the control module comprises:
the first identification module is used for identifying the biological characteristics of the user through all the cameras when the fact that the sight line of the user is detected to be within the range of a display screen of any display through all or part of the cameras is detected, and obtaining first biological characteristic information corresponding to the user;
the first judgment module is used for judging whether the user is a legal user or not according to the first biological characteristic information;
and the first execution module is used for controlling the display screen of any display to display and closing the display screens of other displays when the user is a legal user.
6. A control device for a display screen, the control device comprising a processor, a memory, and at least two displays; each of the displays includes: a display screen and a camera;
the processor is used for executing a program for controlling the display screen stored in the memory so as to realize the steps of the control method of the display screen according to any one of claims 1 to 3.
7. A computer readable storage medium, characterized in that the computer readable storage medium stores one or more programs executable by one or more processors to implement the steps of the control method of the display screen according to any one of claims 1 to 3.
CN201810194852.7A 2018-03-09 2018-03-09 Display screen control method, device, equipment and computer readable storage medium Active CN108469893B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810194852.7A CN108469893B (en) 2018-03-09 2018-03-09 Display screen control method, device, equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810194852.7A CN108469893B (en) 2018-03-09 2018-03-09 Display screen control method, device, equipment and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN108469893A CN108469893A (en) 2018-08-31
CN108469893B true CN108469893B (en) 2021-08-27

Family

ID=63265227

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810194852.7A Active CN108469893B (en) 2018-03-09 2018-03-09 Display screen control method, device, equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN108469893B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109582268A (en) * 2018-12-11 2019-04-05 浪潮(北京)电子信息产业有限公司 A kind of display panel control method, device and system
CN109714485B (en) * 2019-01-10 2021-07-23 维沃移动通信有限公司 Display method and mobile terminal
CN113157081A (en) * 2020-01-07 2021-07-23 种红侠 Display screen driving system and method based on angle detection
CN111880640B (en) * 2020-07-31 2022-03-22 Oppo广东移动通信有限公司 Screen control method and device, electronic equipment and storage medium
CN112233340A (en) * 2020-08-31 2021-01-15 中国农业银行股份有限公司浙江省分行 Prevent peeping finance storehouse body structure
CN111813228B (en) * 2020-09-07 2021-01-05 广东睿江云计算股份有限公司 Image transmission method and system based on user vision
CN112463097B (en) * 2020-12-11 2022-11-15 杭州拼便宜网络科技有限公司 Information display method and system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102761645A (en) * 2011-04-26 2012-10-31 富泰华工业(深圳)有限公司 Electronic equipment and control method thereof
CN105408838A (en) * 2013-08-09 2016-03-16 辉达公司 Dynamic GPU feature adjustment based on user-observed screen area
CN105630129A (en) * 2014-11-21 2016-06-01 三星电子株式会社 Power control method and apparatus for reducing power consumption
CN106681511A (en) * 2016-12-30 2017-05-17 宇龙计算机通信科技(深圳)有限公司 Method and device for controlling screen and multi-screen terminal
CN106709303A (en) * 2016-11-18 2017-05-24 深圳超多维科技有限公司 Display method and device and intelligent terminal
CN107077212A (en) * 2015-01-30 2017-08-18 惠普发展公司,有限责任合伙企业 Electronic console is illuminated

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3527121B1 (en) * 2011-02-09 2023-08-23 Apple Inc. Gesture detection in a 3d mapping environment
US8806235B2 (en) * 2011-06-14 2014-08-12 International Business Machines Corporation Display management for multi-screen computing environments
SE537580C2 (en) * 2012-08-03 2015-06-30 Crunchfish Ab Improved input
CN206479990U (en) * 2016-11-21 2017-09-08 歌尔科技有限公司 A kind of portable electric appts

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102761645A (en) * 2011-04-26 2012-10-31 富泰华工业(深圳)有限公司 Electronic equipment and control method thereof
CN105408838A (en) * 2013-08-09 2016-03-16 辉达公司 Dynamic GPU feature adjustment based on user-observed screen area
CN105630129A (en) * 2014-11-21 2016-06-01 三星电子株式会社 Power control method and apparatus for reducing power consumption
CN107077212A (en) * 2015-01-30 2017-08-18 惠普发展公司,有限责任合伙企业 Electronic console is illuminated
CN106709303A (en) * 2016-11-18 2017-05-24 深圳超多维科技有限公司 Display method and device and intelligent terminal
CN106681511A (en) * 2016-12-30 2017-05-17 宇龙计算机通信科技(深圳)有限公司 Method and device for controlling screen and multi-screen terminal

Also Published As

Publication number Publication date
CN108469893A (en) 2018-08-31

Similar Documents

Publication Publication Date Title
CN108469893B (en) Display screen control method, device, equipment and computer readable storage medium
US20190095059A1 (en) Method and device for processing application icon and electronic apparatus
EP3032418A1 (en) Permission control method and device
EP3547604A1 (en) Method and apparatus for security question generation and identity verification
US10216976B2 (en) Method, device and medium for fingerprint identification
WO2018176835A1 (en) Barrage management method and apparatus, memory and server
US9836592B2 (en) Fingerprint scans with power buttons
CN107506637B (en) Information display method and device, terminal and readable storage medium
CN109272917B (en) Screen brightness adjusting method and device, storage medium and electronic equipment
CN110188520B (en) Application authority management method and mobile terminal
US20150058788A1 (en) Information processing method and electronic device
CN106227585A (en) Application program starting method, device and equipment
CN107133002B (en) Information processing method and electronic equipment
CN111695151A (en) Application permission setting method and device, electronic equipment and readable storage medium
EP3328022A1 (en) Managing wireless network connection
WO2015018266A1 (en) Method and apparatus for determining health state of information system
CN111597009A (en) Application program display method and device and terminal equipment
CN110874729B (en) Switching method and switching device for electronic red packet identification strategy and mobile terminal
CN112016080A (en) Application authority management method and device and electronic equipment
CN108932704B (en) Picture processing method, picture processing device and terminal equipment
CN108763491B (en) Picture processing method and device and terminal equipment
US20180276719A1 (en) Method and device for determining area of message operation region and electronic device
CN108347401B (en) Method and device for processing login information
CN110874730B (en) Information processing method, information processing device and mobile terminal
CN106055229B (en) Display interface adjusting method and display interface adjusting module based on screen reading

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant