CN101860694A - Television operating mode switching device and method based on human eye feature analysis - Google Patents

Television operating mode switching device and method based on human eye feature analysis Download PDF

Info

Publication number
CN101860694A
CN101860694A CN 201010214931 CN201010214931A CN101860694A CN 101860694 A CN101860694 A CN 101860694A CN 201010214931 CN201010214931 CN 201010214931 CN 201010214931 A CN201010214931 A CN 201010214931A CN 101860694 A CN101860694 A CN 101860694A
Authority
CN
China
Prior art keywords
human eye
operating mode
background server
feature analysis
people
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 201010214931
Other languages
Chinese (zh)
Other versions
CN101860694B (en
Inventor
袁存鼎
马勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuxi Leqi Technology Co.,Ltd.
Original Assignee
Wuxi Venpoo Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuxi Venpoo Technology Co Ltd filed Critical Wuxi Venpoo Technology Co Ltd
Priority to CN2010102149313A priority Critical patent/CN101860694B/en
Publication of CN101860694A publication Critical patent/CN101860694A/en
Application granted granted Critical
Publication of CN101860694B publication Critical patent/CN101860694B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Analysis (AREA)

Abstract

The invention provides a television operating mode switching device based on human eye feature analysis, which has the advantages of low cost and high judgment accuracy. The device can identify the state of a human being doing other things around the television, and can realize efficient switching between the power-saving mode and the switching-on/off state, thereby saving the energy and protecting the environment. Moreover, the invention also provides a television operating mode switching method. The device is characterized by comprising a camera, a human face detection module device, a human eye feature analysis module device, a back-end server and an operating mode switching controller, wherein the output end of the camera is connected with the human face detection module device, the output end of the human face detection module device is respectively connected with the human eye feature analysis module device and the back-end server, the output end of the human eye feature analysis module device is connected with the back-end server, and the output end of the back-end server is connected with the operating mode switching controller.

Description

A kind of television operating mode switching device and method based on human eye feature analysis
Technical field
The present invention relates to a kind of television operating mode switching device, the invention still further relates to a kind of television operating mode changing method based on human eye feature analysis based on human eye feature analysis.
Background technology
Television set is leisure, the learning tool that frequency of utilization is quite high in people's daily life, also is one of main power consumption household electrical appliance.People situation away from keyboard, sleeping when watching, that the child is not intended to unlatching occurs through regular meeting in the process of using television set, this is not only in the electricity wasting resource, also are in the useful life that consumes television set.
Existing television set power-saving technique can be implemented in the function that changes battery saving mode, sleeping shutdown under the unmanned state over to, but still has following defective: one, adopt equipment such as pyroscan, thermal infrared imager, cost is higher and judging nicety rate is low more; Two, can not discern the people does other things around television set state; Three, can not in battery saving mode, on-off state, efficiently switch.
Summary of the invention
At the problems referred to above, the invention provides a kind of television operating mode switching device based on human eye feature analysis, cost is lower and judging nicety rate is high; And can discern state that the people does other things around the television set, can in battery saving mode, on-off state, efficiently switch, energy-conserving and environment-protective, for this reason, the present invention also provides the television operating mode changing method.
A kind of television operating mode switching device based on human eye feature analysis, it is characterized in that: it comprises video camera, people's face detection module device, the human eye feature analysis modular device, background server and mode of operation switch controller, the output of described video camera connects described people's face detection module device, the output of described people's face detection module device connects described human eye feature analysis modular device and described background server respectively, the output of described human eye feature analysis modular device connects described background server, and the output of described background server connects described mode of operation switch controller.
A kind of television operating mode changing method based on human eye feature analysis, it is characterized in that: it is by human eye feature analysis, determines that beholder's human eye is opened entire, direction of visual lines, further determines the method that television operating mode switches.
It is further characterized in that:
Its concrete steps are as follows:
When (1) opening television set, the video camera unlatching is also carried out video acquisition;
Whether (2) people's face detection module device is analyzed the image information of obtaining from video camera, have people's face to occur to judge:
If unmanned face information sends to background server with analytical information;
If people's face information is arranged, detected people's face information is sent to the human eye feature analysis module;
(3) the human eye feature analysis modular device uses human eye location and human eye line-of-sight detection algorithm based on sight angle, and human eye information from video camera is analyzed, and determines that beholder's eyes are opened entire and direction of visual lines, and analysis result is sent to background server;
(4) background server carries out comprehensive statistics, judges the duration of above state and analyzes whether need to switch television operating mode;
The unmanned face information time that background server obtains surpasses preheating setting time, sends the standby request signal to the television operating mode switch controller;
The human eye closure state information time that background server obtains surpasses preheating setting time, sends the standby request signal to the television operating mode switch controller;
The information time of people's an eye line misalignment screen that background server obtains surpasses first preheating setting time, sends the battery saving mode request signal to the television operating mode switch controller;
The information time of people's an eye line misalignment screen that background server obtains surpasses second preheating setting time, sends the standby request signal to the television operating mode switch controller;
The background server statistics standby mode time surpasses preheating setting time, sends the shutdown request signal to the television operating mode switch controller;
(5) the television operating mode switch controller carries out the switching of the mode of operation of television set according to the mode of operation switching signal that gets access to.
Adopt said method of the present invention, can analyze the beholder by people's face detection module device and human eye detection module and whether sleep, sight line towards, switch television operating mode according to beholder's state, not only save resource, and improved television set user's quality of life.This method can also be applied on the various devices such as personal computer widely, has very high economic worth and social effect.
Description of drawings:
The structural representation of Fig. 1 for using among the present invention;
Fig. 2 is an operation principle block diagram of the present invention.
Embodiment:
The present invention includes video camera 1, people's face detection module device 5, human eye feature analysis modular device 2, background server 3 and mode of operation switch controller 4, the output of video camera 1 connects people's face detection module device 5, the output of people's face detection module device 5 connects human eye feature analysis modular device 2 and background server 3 respectively, the output of human eye feature analysis modular device 2 connects background server 3, and the output of background server 3 connects mode of operation switch controller 4.
A kind of television operating mode changing method based on human eye feature analysis is by human eye feature analysis, determines that beholder's human eye is opened entire, direction of visual lines, further determines the method that television operating mode switches.
Concrete job step is as follows:
(1) television set the time, video camera is opened and is also carried out video acquisition;
Whether (2) people's face detection module device 5, and the image information of obtaining from video camera 1 is analyzed, have people's face to occur to judge:
If unmanned face information sends to background server 3 with analytical information;
If people's face information is arranged, detected people's face information is sent to human eye feature analysis modular device 2;
(3) human eye feature analysis modular device 2 uses human eyes location and human eye line-of-sight detection algorithm based on sight angle, human eye information from video camera 1 is analyzed, determine that beholder's eyes open entire and direction of visual lines, and analysis result is sent to background server 3;
(4) background server 3 carries out comprehensive statistics, judges the duration of above state and analyzes whether need to switch television operating mode.
The unmanned face information time that background server 3 obtains surpasses preheating setting time, sends the standby request signal to television operating mode switch controller 4;
The human eye closure state information time that background server 3 obtains surpasses preheating setting time, sends the standby request signal to television operating mode switch controller 4;
The information time of people's an eye line misalignment screen that background server 3 obtains surpasses first preheating setting time, sends the battery saving mode request signal to television operating mode switch controller 4;
The information time of people's an eye line misalignment screen that background server 3 obtains surpasses second preheating setting time, sends the standby request signal to television operating mode switch controller 4;
The 3 statistics standby mode times of background server surpass preheating setting time, send the shutdown request signal to television operating mode switch controller 4;
(5) television operating mode switch controller 4 carries out the switching of the mode of operation of television set according to the mode of operation switching signal that gets access to.
In the said method, the image that 5 pairs of video cameras 1 of people's face detection module device collect among Fig. 2 carries out people's face and detects, based on the adaboost learning algorithm of knowing altogether, its step is to use off-line training and then design feature selecting grader efficiently in people's face detection module device, this grader selects to use the tree decision device, and whether judgement exists people's face.
Human eye feature analysis modular device 2 has used the eyes location algorithm in detecting among Fig. 2, based on the human eye line-of-sight detection algorithm of sight angle determine human eye the position, open and close the state, sight angle of closing.
At first use the human eye location algorithm based on human face structure, to detect position of human eye information, its step is as follows: be gray level image with the image processing that collects earlier, former gray level image done edge gray scale reinforcement; In conjunction with the position of human eye decision criteria of setting up according to people's face geometric properties, determine position of human eye then; Come the authenticity of the eyes that inspection goes out at last as symmetrical similarity with the bidimensional coefficient correlation, and utilize the gray integration projection of the binocular images vertical direction find, close the gray threshold of state to find the switching that to distinguish human eye, if human eye is open, further utilize integral projection to determine pupil position, the pupil is positioned at the peak value of integrogram; Algorithm steps is known all altogether on it.Utilize human eye line-of-sight detection algorithm afterwards based on sight angle, detect people's an eye line information, its step is as follows: after the upper eyelid circumference that utilizes the Hough transformation calculations to go out human eye reaches inside and outside angle point, iris center, detecting the method for having taked branch to handle on the direction of visual lines then: at first judge the visual angle, calculate the direction of visual lines of eyes again.Finally obtain beholder's direction of visual lines, algorithm steps is known all altogether on it.

Claims (3)

1. television operating mode switching device based on human eye feature analysis, it is characterized in that: it comprises video camera, people's face detection module device, the human eye feature analysis modular device, background server and mode of operation switch controller, the output of described video camera connects described people's face detection module device, the output of described people's face detection module device connects described human eye feature analysis modular device and described background server respectively, the output of described human eye feature analysis modular device connects described background server, and the output of described background server connects described mode of operation switch controller.
2. television operating mode changing method based on human eye feature analysis, it is characterized in that: it is by human eye feature analysis, determines that beholder's human eye is opened entire, direction of visual lines, further determines the method that television operating mode switches.
3. a kind of television operating mode changing method based on human eye feature analysis according to claim 2 is characterized in that:
Its concrete steps are as follows:
When (1) opening television set, the video camera unlatching is also carried out video acquisition;
Whether (2) people's face detection module device is analyzed the image information of obtaining from video camera, have people's face to occur to judge:
If unmanned face information sends to background server with analytical information;
If people's face information is arranged, detected people's face information is sent to the human eye feature analysis module;
(3) the human eye feature analysis modular device uses human eye location and human eye line-of-sight detection algorithm based on sight angle, and human eye information from video camera is analyzed, and determines that beholder's eyes are opened entire and direction of visual lines, and analysis result is sent to background server;
(4) background server carries out comprehensive statistics, judges the duration of above state and analyzes whether need to switch television operating mode;
The unmanned face information time that background server obtains surpasses preheating setting time, sends the standby request signal to the television operating mode switch controller;
The human eye closure state information time that background server obtains surpasses preheating setting time, sends the standby request signal to the television operating mode switch controller;
The information time of people's an eye line misalignment screen that background server obtains surpasses first preheating setting time, sends the battery saving mode request signal to the television operating mode switch controller;
The information time of people's an eye line misalignment screen that background server obtains surpasses second preheating setting time, sends the standby request signal to the television operating mode switch controller;
The background server statistics standby mode time surpasses preheating setting time, sends the shutdown request signal to the television operating mode switch controller;
(5) the television operating mode switch controller carries out the switching of the mode of operation of television set according to the mode of operation switching signal that gets access to.
CN2010102149313A 2010-07-01 2010-07-01 Television operating mode switching device and method based on human eye feature analysis Active CN101860694B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010102149313A CN101860694B (en) 2010-07-01 2010-07-01 Television operating mode switching device and method based on human eye feature analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010102149313A CN101860694B (en) 2010-07-01 2010-07-01 Television operating mode switching device and method based on human eye feature analysis

Publications (2)

Publication Number Publication Date
CN101860694A true CN101860694A (en) 2010-10-13
CN101860694B CN101860694B (en) 2012-08-22

Family

ID=42946305

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010102149313A Active CN101860694B (en) 2010-07-01 2010-07-01 Television operating mode switching device and method based on human eye feature analysis

Country Status (1)

Country Link
CN (1) CN101860694B (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102629999A (en) * 2012-04-05 2012-08-08 邓中良 Automatic bedtime television shutdown service based on eye state identification technology
CN102984475A (en) * 2012-11-26 2013-03-20 王波兰 Control method for televisions
CN103123537A (en) * 2011-11-21 2013-05-29 国基电子(上海)有限公司 Electronic display device and power saving method thereof
CN103220583A (en) * 2013-03-28 2013-07-24 四川长虹电器股份有限公司 System and method for detecting user fatigue degree based on smart television
CN103576569A (en) * 2012-08-08 2014-02-12 联想(北京)有限公司 Automatic adjusting method, equipment and system
CN103747313A (en) * 2013-12-30 2014-04-23 镇江市高等专科学校 Smart television remote control and remote control method
CN104076704A (en) * 2014-06-27 2014-10-01 广东美的制冷设备有限公司 Terminal and control method thereof
CN104182044A (en) * 2014-05-14 2014-12-03 录可系统公司 Terminal adaption adjusting method and system
CN104683875A (en) * 2015-02-11 2015-06-03 华为技术有限公司 Method and device for presenting digital medium contents
CN106773815A (en) * 2016-11-30 2017-05-31 广州微至科技有限公司 Digital intelligent control method, device and central control system
CN106998499A (en) * 2017-04-28 2017-08-01 张青 It is capable of the intelligent TV set and its control system and control method of intelligent standby
CN108040291A (en) * 2017-12-21 2018-05-15 深圳Tcl新技术有限公司 Display device and its standby controlling method and computer-readable recording medium
CN111563435A (en) * 2020-04-28 2020-08-21 深圳市优必选科技股份有限公司 Sleep state detection method and device for user
CN112188289A (en) * 2020-09-04 2021-01-05 青岛海尔科技有限公司 Method, device and equipment for controlling television
CN112188288A (en) * 2020-09-04 2021-01-05 青岛海尔科技有限公司 Method, system, device and equipment for controlling television

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101072293A (en) * 2006-05-09 2007-11-14 深圳Tcl新技术有限公司 Device and method for automatically regulating television screen display
CN201069504Y (en) * 2007-06-13 2008-06-04 惠州市康力电子有限公司 Automatic back light control device for flat plate display
CN101656060A (en) * 2008-08-18 2010-02-24 鸿富锦精密工业(深圳)有限公司 Energy saving system and method for screen display

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101072293A (en) * 2006-05-09 2007-11-14 深圳Tcl新技术有限公司 Device and method for automatically regulating television screen display
CN201069504Y (en) * 2007-06-13 2008-06-04 惠州市康力电子有限公司 Automatic back light control device for flat plate display
CN101656060A (en) * 2008-08-18 2010-02-24 鸿富锦精密工业(深圳)有限公司 Energy saving system and method for screen display

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103123537A (en) * 2011-11-21 2013-05-29 国基电子(上海)有限公司 Electronic display device and power saving method thereof
CN102629999A (en) * 2012-04-05 2012-08-08 邓中良 Automatic bedtime television shutdown service based on eye state identification technology
CN103576569A (en) * 2012-08-08 2014-02-12 联想(北京)有限公司 Automatic adjusting method, equipment and system
CN102984475A (en) * 2012-11-26 2013-03-20 王波兰 Control method for televisions
CN103220583A (en) * 2013-03-28 2013-07-24 四川长虹电器股份有限公司 System and method for detecting user fatigue degree based on smart television
CN103747313A (en) * 2013-12-30 2014-04-23 镇江市高等专科学校 Smart television remote control and remote control method
CN104182044A (en) * 2014-05-14 2014-12-03 录可系统公司 Terminal adaption adjusting method and system
CN104076704A (en) * 2014-06-27 2014-10-01 广东美的制冷设备有限公司 Terminal and control method thereof
CN104683875A (en) * 2015-02-11 2015-06-03 华为技术有限公司 Method and device for presenting digital medium contents
CN106773815A (en) * 2016-11-30 2017-05-31 广州微至科技有限公司 Digital intelligent control method, device and central control system
CN106998499A (en) * 2017-04-28 2017-08-01 张青 It is capable of the intelligent TV set and its control system and control method of intelligent standby
CN108040291A (en) * 2017-12-21 2018-05-15 深圳Tcl新技术有限公司 Display device and its standby controlling method and computer-readable recording medium
CN111563435A (en) * 2020-04-28 2020-08-21 深圳市优必选科技股份有限公司 Sleep state detection method and device for user
CN112188289A (en) * 2020-09-04 2021-01-05 青岛海尔科技有限公司 Method, device and equipment for controlling television
CN112188288A (en) * 2020-09-04 2021-01-05 青岛海尔科技有限公司 Method, system, device and equipment for controlling television

Also Published As

Publication number Publication date
CN101860694B (en) 2012-08-22

Similar Documents

Publication Publication Date Title
CN101860694B (en) Television operating mode switching device and method based on human eye feature analysis
CN105700363B (en) A kind of awakening method and system of smart home device phonetic controller
CN103281064B (en) A kind of realize the method and device that household electrical appliances are energy-conservation
CN201742483U (en) Television (TV) working mode switching device based on analysis of human eye characteristics
CN103412647B (en) The page display control method of a kind of recognition of face and mobile terminal
CN109063764A (en) A kind of judgment method of disconnecting switch closing operation in place based on machine vision
CN102509100B (en) Knife switch connecting-disconnecting reliability recognition method based on image pattern recognition
US20100039376A1 (en) System and method for reducing power consumption of a display device
CN101980305A (en) Face identification and 3G communication-based intelligent household access control system
CN102326133B (en) The equipment of being provided for enters system, the method and apparatus of activity pattern
KR100954835B1 (en) System for extracting the face change of same person, and intelligent system using it
CN101889928A (en) Head gesture recognition technology-based wheelchair control method
WO2010072153A1 (en) Computer intelligent energy saving method
CN103236249B (en) The method and apparatus that display device regulates automatically
CN202196458U (en) Face recognition system
CN106410896B (en) Method and system for entering power saving mode during charging of mobile terminal
CN202502458U (en) Dormancy wake-up system having functions of face detection and identification
CN205427946U (en) Hotel moves in management system
US9632558B2 (en) Power supply control method for display device and display device
CN105183138A (en) Method and system for automatically switching into dormant state
CN103105922A (en) Method and device for mobile terminal backlight control
CN105786148A (en) Method and device for controlling power consumption of terminal, and terminal
CN109346887A (en) The intelligent socket of standby energy consumption reduction based on machine learning
CN106970710A (en) A kind of machine open/close method and headset equipment based on brain wave
CN105306985B (en) A kind of video playing interface intelligent locking unlocking method, system and mobile terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20160202

Address after: Xuelang Street Road Jinxi Binhu District 214122 in Jiangsu province Wuxi City Henghua Science Park No. 100, building 20, room 407

Patentee after: Wuxi Le Chi Technology Co. Ltd.

Address before: 214028 C Building 5, Xinhua Road Industrial Park, No. 512, Jiangsu, Wuxi,

Patentee before: Wuxi Venpoo Technology Co., Ltd.

CP03 Change of name, title or address
CP03 Change of name, title or address

Address after: 214122 room 1601, block D, swan tower, Wuxi Software Park, No. 111, Linghu Avenue, Xinwu District, Wuxi City, Jiangsu Province

Patentee after: Wuxi Leqi Technology Co.,Ltd.

Address before: 214122 room 407, building 20, Henghua Science Park, No. 100, Jinxi Road, Xuelang street, Binhu District, Wuxi City, Jiangsu Province

Patentee before: Wuxi Le Chi Technology Co.,Ltd.