CN101860694B - Television operating mode switching device and method based on human eye feature analysis - Google Patents

Television operating mode switching device and method based on human eye feature analysis Download PDF

Info

Publication number
CN101860694B
CN101860694B CN2010102149313A CN201010214931A CN101860694B CN 101860694 B CN101860694 B CN 101860694B CN 2010102149313 A CN2010102149313 A CN 2010102149313A CN 201010214931 A CN201010214931 A CN 201010214931A CN 101860694 B CN101860694 B CN 101860694B
Authority
CN
China
Prior art keywords
human eye
operating mode
feature analysis
people
background server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN2010102149313A
Other languages
Chinese (zh)
Other versions
CN101860694A (en
Inventor
袁存鼎
马勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuxi Leqi Technology Co.,Ltd.
Original Assignee
Wuxi Venpoo Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuxi Venpoo Technology Co Ltd filed Critical Wuxi Venpoo Technology Co Ltd
Priority to CN2010102149313A priority Critical patent/CN101860694B/en
Publication of CN101860694A publication Critical patent/CN101860694A/en
Application granted granted Critical
Publication of CN101860694B publication Critical patent/CN101860694B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention provides a television operating mode switching device based on human eye feature analysis, which has the advantages of low cost and high judgment accuracy. The device can identify the state of a human being doing other things around the television, and can realize efficient switching between the power-saving mode and the switching-on/off state, thereby saving the energy and protecting the environment. Moreover, the invention also provides a television operating mode switching method. The technical proposal of device is that the invention is characterized by comprising a camera, a human face detection module device, a human eye feature analysis module device, a back-end server and an operating mode switching controller, wherein the output end of the camera is connected with the human face detection module device, the output end of the human face detection module device is respectively connected with the human eye feature analysis module device and the back-end server, the output end of the human eye feature analysis module device is connected with the back-end server, and the output end of the back-end server is connected with the operating mode switching controller.

Description

A kind of television operating mode switching device and method based on human eye feature analysis
Technical field
The present invention relates to a kind of television operating mode switching device, the invention still further relates to a kind of television operating mode changing method based on human eye feature analysis based on human eye feature analysis.
Background technology
Television set is leisure, the learning tool that frequency of utilization is quite high in people's daily life, also is one of main power consumption household electrical appliance.People situation away from keyboard, sleeping when watching, that the child is not intended to unlatching occurs through regular meeting in the process of using television set, this is not only in the electricity wasting resource, also are in the useful life that consumes television set.
Existing television set power-saving technique can be implemented in the function that changes battery saving mode, sleeping shutdown under the unmanned state over to, but still has following defective: one, adopt equipment such as pyroscan, thermal infrared imager, cost is higher and judging nicety rate is low more; Two, can not discern the people does other things around television set state; Three, can not in battery saving mode, on-off state, efficiently switch.
Summary of the invention
To the problems referred to above, the invention provides a kind of television operating mode switching device based on human eye feature analysis, cost is lower and judging nicety rate is high; And can discern state that the people does other things around the television set, can in battery saving mode, on-off state, efficiently switch, energy-conserving and environment-protective, for this reason, the present invention also provides the television operating mode changing method.
A kind of television operating mode switching device based on human eye feature analysis; It is characterized in that: it comprises video camera, people's face detection module device, human eye feature analysis modular device, background server and mode of operation switch controller; The output of said video camera connects said people's face detection module device; The output of said people's face detection module device connects said human eye feature analysis modular device and said background server respectively; The output of said human eye feature analysis modular device connects said background server, and the output of said background server connects said mode of operation switch controller.
A kind of television operating mode changing method based on human eye feature analysis, it is characterized in that: it is through human eye feature analysis, confirms that beholder's human eye is opened entire, direction of visual lines, further confirms the method that television operating mode switches.
It is further characterized in that:
Its concrete steps are following:
When (1) opening television set, the video camera unlatching is also carried out video acquisition;
Whether (2) people's face detection module device is analyzed the image information of obtaining from video camera, have people's face to occur to judge:
If unmanned face information sends to background server with analytical information;
If people's face information is arranged, detected people's face information is sent to the human eye feature analysis module;
(3) the human eye feature analysis modular device uses human eye location and human eye line-of-sight detection algorithm based on sight angle, and human eye information from video camera is analyzed, and confirms that beholder's eyes are opened entire and direction of visual lines, and analysis result is sent to background server;
(4) background server carries out comprehensive statistics, judges the duration of above state and analyzes whether need switch television operating mode;
The unmanned face information time that background server obtains surpasses preheating setting time, sends the standby request signal to the television operating mode switch controller;
The human eye closure state information time that background server obtains surpasses preheating setting time, sends the standby request signal to the television operating mode switch controller;
The information time of people's an eye line misalignment screen that background server obtains surpasses first preheating setting time, sends the battery saving mode request signal to the television operating mode switch controller;
The information time of people's an eye line misalignment screen that background server obtains surpasses second preheating setting time, sends the standby request signal to the television operating mode switch controller;
The background server statistics standby mode time surpasses preheating setting time, sends the shutdown request signal to the television operating mode switch controller;
(5) the television operating mode switch controller carries out the switching of the mode of operation of television set according to the mode of operation switching signal that gets access to.
Adopt said method of the present invention; Can analyze the beholder through people's face detection module device and human eye detection module and whether sleep, sight line towards, switch television operating mode according to beholder's state; Not only practice thrift resource, and improved television set user's quality of life.This method can also be applied on the various devices such as personal computer widely, has very high economic worth and social effect.
Description of drawings:
The structural representation of Fig. 1 for using among the present invention;
Fig. 2 is an operation principle block diagram of the present invention.
Embodiment:
The present invention includes video camera 1, people's face detection module device 5, human eye feature analysis modular device 2, background server 3 and mode of operation switch controller 4; The output of video camera 1 connects people's face detection module device 5; The output of people's face detection module device 5 connects human eye feature analysis modular device 2 and background server 3 respectively; The output of human eye feature analysis modular device 2 connects background server 3, and the output of background server 3 connects mode of operation switch controller 4.
A kind of television operating mode changing method based on human eye feature analysis is through human eye feature analysis, confirms that beholder's human eye is opened entire, direction of visual lines, further confirms the method that television operating mode switches.
Concrete job step is following:
(1) television set the time, video camera is opened and is also carried out video acquisition;
Whether (2) people's face detection module device 5, and the image information of obtaining from video camera 1 is analyzed, have people's face to occur to judge:
If unmanned face information sends to background server 3 with analytical information;
If people's face information is arranged, detected people's face information is sent to human eye feature analysis modular device 2;
(3) human eye feature analysis modular device 2 uses human eyes location and human eye line-of-sight detection algorithm based on sight angle; Human eye information from video camera 1 is analyzed; Confirm that beholder's eyes open entire and direction of visual lines, and analysis result is sent to background server 3;
(4) background server 3 carries out comprehensive statistics, judges the duration of above state and analyzes whether need switch television operating mode.
The unmanned face information time that background server 3 obtains surpasses preheating setting time, sends the standby request signal to television operating mode switch controller 4;
The human eye closure state information time that background server 3 obtains surpasses preheating setting time, sends the standby request signal to television operating mode switch controller 4;
The information time of people's an eye line misalignment screen that background server 3 obtains surpasses first preheating setting time, sends the battery saving mode request signal to television operating mode switch controller 4;
The information time of people's an eye line misalignment screen that background server 3 obtains surpasses second preheating setting time, sends the standby request signal to television operating mode switch controller 4;
The 3 statistics standby mode times of background server surpass preheating setting time, send the shutdown request signal to television operating mode switch controller 4;
(5) television operating mode switch controller 4 carries out the switching of the mode of operation of television set according to the mode of operation switching signal that gets access to.
In the said method; The image that 5 pairs of video cameras 1 of people's face detection module device collect among Fig. 2 carries out people's face and detects; Based on the adaboost learning algorithm of knowing altogether; Its step is in people's face detection module device, to use off-line training and then design feature selecting grader efficiently, and this grader selects to use the tree decision device, and whether judgement exists people's face.
Human eye feature analysis modular device 2 has used the eye location algorithm in detecting among Fig. 2, based on the human eye line-of-sight detection algorithm of sight angle confirm human eye the position, open and close the state, sight angle of closing.
At first use the human eye location algorithm based on human face structure, to detect position of human eye information, its step is following: be gray level image with the image processing that collects earlier, former gray level image done edge gray scale reinforcement; Combine position of human eye decision criteria then, confirm position of human eye according to the foundation of people's face geometric properties; Come the authenticity of the eyes that inspection goes out at last as symmetrical similarity with the bidimensional coefficient correlation; And utilize the gray integration projection of the binocular images vertical direction find; Close the gray threshold of state to find the switching that to distinguish human eye; If human eye is open, further utilize integral projection to confirm pupil position, the pupil is positioned at the peak value of integrogram; Algorithm steps all is common knowledge on it.Utilize human eye line-of-sight detection algorithm afterwards based on sight angle; Detect people's an eye line information; Its step is following: after the upper eyelid circumference that utilizes the Hough transformation calculations to go out human eye reaches inside and outside angle point, iris center; Detecting the method for having taked branch to handle on the direction of visual lines then: at first judge the visual angle, calculate the direction of visual lines of eyes again.Finally obtain beholder's direction of visual lines, algorithm steps all is common knowledge on it.

Claims (2)

1. television operating mode switching device based on human eye feature analysis; It comprises video camera, human eye feature analysis modular device, background server and mode of operation switch controller; Said human eye feature analysis modular device is used for judging position of human eye; It is characterized in that: it also comprises and is used for judging the people's face detection module device that whether has people's face to occur, and detected people's face information is sent to said human eye feature analysis modular device; Said human eye feature analysis modular device also is used for judging closure state, pupil position, upper eyelid circumference, inside and outside angle point and the iris center of human eye, thereby comprehensively judges beholder's direction of visual lines; The output of said video camera connects said people's face detection module device; The output of said people's face detection module device connects said human eye feature analysis modular device and said background server respectively; The output of said human eye feature analysis modular device connects said background server, and the output of said background server connects said mode of operation switch controller.
2. television operating mode changing method based on human eye feature analysis, it is characterized in that: it is through human eye feature analysis, confirms that beholder's human eye is opened entire, direction of visual lines, further confirms the method that television operating mode switches; Its concrete steps are following:
When (1) opening television set, the video camera unlatching is also carried out video acquisition;
Whether (2) people's face detection module device is analyzed the image information of obtaining from video camera, have people's face to occur to judge:
If unmanned face information sends to background server with analytical information;
If people's face information is arranged, detected people's face information is sent to the human eye feature analysis module;
(3) the human eye feature analysis modular device uses human eye location and human eye line-of-sight detection algorithm based on sight angle, and human eye information from video camera is analyzed, and confirms that beholder's eyes are opened entire and direction of visual lines, and analysis result is sent to background server;
(4) background server carries out comprehensive statistics, judges the duration of above state and analyzes whether need switch television operating mode;
The unmanned face information time that background server obtains surpasses preheating setting time, sends the standby request signal to the television operating mode switch controller;
The human eye closure state information time that background server obtains surpasses preheating setting time, sends the standby request signal to the television operating mode switch controller;
The information time of people's an eye line misalignment screen that background server obtains surpasses first preheating setting time, sends the battery saving mode request signal to the television operating mode switch controller;
The information time of people's an eye line misalignment screen that background server obtains surpasses second preheating setting time, sends the standby request signal to the television operating mode switch controller;
The background server statistics standby mode time surpasses preheating setting time, sends the shutdown request signal to the television operating mode switch controller;
(5) the television operating mode switch controller carries out the switching of the mode of operation of television set according to the mode of operation switching signal that gets access to.
CN2010102149313A 2010-07-01 2010-07-01 Television operating mode switching device and method based on human eye feature analysis Active CN101860694B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010102149313A CN101860694B (en) 2010-07-01 2010-07-01 Television operating mode switching device and method based on human eye feature analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010102149313A CN101860694B (en) 2010-07-01 2010-07-01 Television operating mode switching device and method based on human eye feature analysis

Publications (2)

Publication Number Publication Date
CN101860694A CN101860694A (en) 2010-10-13
CN101860694B true CN101860694B (en) 2012-08-22

Family

ID=42946305

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010102149313A Active CN101860694B (en) 2010-07-01 2010-07-01 Television operating mode switching device and method based on human eye feature analysis

Country Status (1)

Country Link
CN (1) CN101860694B (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103123537B (en) * 2011-11-21 2016-04-20 国基电子(上海)有限公司 Electronic display unit and electricity saving method thereof
CN102629999A (en) * 2012-04-05 2012-08-08 邓中良 Automatic bedtime television shutdown service based on eye state identification technology
CN103576569B (en) * 2012-08-08 2017-03-01 联想(北京)有限公司 A kind of Automatic adjustment method, equipment and system
CN102984475A (en) * 2012-11-26 2013-03-20 王波兰 Control method for televisions
CN103220583A (en) * 2013-03-28 2013-07-24 四川长虹电器股份有限公司 System and method for detecting user fatigue degree based on smart television
CN103747313A (en) * 2013-12-30 2014-04-23 镇江市高等专科学校 Smart television remote control and remote control method
US20150332085A1 (en) * 2014-05-14 2015-11-19 Looq System Inc Method and system for adaptive adjustment of terminal
CN104076704A (en) * 2014-06-27 2014-10-01 广东美的制冷设备有限公司 Terminal and control method thereof
CN104683875A (en) * 2015-02-11 2015-06-03 华为技术有限公司 Method and device for presenting digital medium contents
CN106773815A (en) * 2016-11-30 2017-05-31 广州微至科技有限公司 Digital intelligent control method, device and central control system
CN106998499A (en) * 2017-04-28 2017-08-01 张青 It is capable of the intelligent TV set and its control system and control method of intelligent standby
CN108040291A (en) * 2017-12-21 2018-05-15 深圳Tcl新技术有限公司 Display device and its standby controlling method and computer-readable recording medium
CN111563435A (en) * 2020-04-28 2020-08-21 深圳市优必选科技股份有限公司 Sleep state detection method and device for user
CN112188288B (en) * 2020-09-04 2023-03-14 青岛海尔科技有限公司 Method, system, device and equipment for controlling television
CN112188289B (en) * 2020-09-04 2023-03-14 青岛海尔科技有限公司 Method, device and equipment for controlling television

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101072293B (en) * 2006-05-09 2010-06-09 深圳Tcl新技术有限公司 Device and method for automatically regulating television screen display
CN201069504Y (en) * 2007-06-13 2008-06-04 惠州市康力电子有限公司 Automatic back light control device for flat plate display
CN101656060A (en) * 2008-08-18 2010-02-24 鸿富锦精密工业(深圳)有限公司 Energy saving system and method for screen display

Also Published As

Publication number Publication date
CN101860694A (en) 2010-10-13

Similar Documents

Publication Publication Date Title
CN101860694B (en) Television operating mode switching device and method based on human eye feature analysis
CN105700363B (en) A kind of awakening method and system of smart home device phonetic controller
CN103281064B (en) A kind of realize the method and device that household electrical appliances are energy-conservation
CN201742483U (en) Television (TV) working mode switching device based on analysis of human eye characteristics
CN102509100B (en) Knife switch connecting-disconnecting reliability recognition method based on image pattern recognition
CN101889928B (en) Head gesture recognition technology-based wheelchair control method
CN103412647B (en) The page display control method of a kind of recognition of face and mobile terminal
US20100039376A1 (en) System and method for reducing power consumption of a display device
CN202196458U (en) Face recognition system
CN101976109A (en) Intelligent display and display control device and method thereof
CN103236249B (en) The method and apparatus that display device regulates automatically
CN101814130A (en) Iris identification device by using camera array and multimodal biometrics identification method
CN109063764A (en) A kind of judgment method of disconnecting switch closing operation in place based on machine vision
CN205427946U (en) Hotel moves in management system
CN202502458U (en) Dormancy wake-up system having functions of face detection and identification
CN105701457B (en) Direct current electromagnetic relay device and its control method based on recognition of face control
CN103105922A (en) Method and device for mobile terminal backlight control
CN105183138A (en) Method and system for automatically switching into dormant state
CN102479322A (en) System, apparatus and method for analyzing facial defect by facial image with angle
US20160274649A1 (en) Power Supply Control Method for Display Device and Display Device
KR20190001067A (en) Method and apparatus for speech recognition
CN107168134A (en) The household electric appliance control method of brain eye combination drive
US20140324764A1 (en) Control method and non-transtory computer readable recording medium
CN104182024B (en) A kind of method of information processing and electronic equipment
CN108647647B (en) Control method and control device of air conditioner and air conditioner

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20160202

Address after: Xuelang Street Road Jinxi Binhu District 214122 in Jiangsu province Wuxi City Henghua Science Park No. 100, building 20, room 407

Patentee after: Wuxi Le Chi Technology Co. Ltd.

Address before: 214028 C Building 5, Xinhua Road Industrial Park, No. 512, Jiangsu, Wuxi,

Patentee before: Wuxi Venpoo Technology Co., Ltd.

CP03 Change of name, title or address

Address after: 214122 room 1601, block D, swan tower, Wuxi Software Park, No. 111, Linghu Avenue, Xinwu District, Wuxi City, Jiangsu Province

Patentee after: Wuxi Leqi Technology Co.,Ltd.

Address before: 214122 room 407, building 20, Henghua Science Park, No. 100, Jinxi Road, Xuelang street, Binhu District, Wuxi City, Jiangsu Province

Patentee before: Wuxi Le Chi Technology Co.,Ltd.

CP03 Change of name, title or address