CN102028577B - Intelligent eye vision protection system - Google Patents

Intelligent eye vision protection system Download PDF

Info

Publication number
CN102028577B
CN102028577B CN201010521107A CN201010521107A CN102028577B CN 102028577 B CN102028577 B CN 102028577B CN 201010521107 A CN201010521107 A CN 201010521107A CN 201010521107 A CN201010521107 A CN 201010521107A CN 102028577 B CN102028577 B CN 102028577B
Authority
CN
China
Prior art keywords
module
fatigue
face
eye
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201010521107A
Other languages
Chinese (zh)
Other versions
CN102028577A (en
Inventor
杨琴业
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TPV Display Technology Xiamen Co Ltd
Original Assignee
TPV Display Technology Xiamen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TPV Display Technology Xiamen Co Ltd filed Critical TPV Display Technology Xiamen Co Ltd
Priority to CN201010521107A priority Critical patent/CN102028577B/en
Publication of CN102028577A publication Critical patent/CN102028577A/en
Application granted granted Critical
Publication of CN102028577B publication Critical patent/CN102028577B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention relates to an intelligent eye vision protection system which comprises an image pre-processing module A, a face processing module B, an eye region positioning module C, an eye tracking forecast module D, a fatigue state detection module E, a fatigue degree calculation module F, a display equipment backlight brightness control module G and a prompt menu module H. The intelligent eye vision protection system can detect the degree of fatigue of users, automatically micro-adjust the brightness of a display equipment screen, gives a prompt of the current metal state of the users, and reminds the users of having a rest so as to achieve the effect of eye vision protection.

Description

The eye eyesight intelligent protection system
Technical field
The present invention relates to a kind of eye eyesight intelligent protection system, be applied to liquid crystal display, liquid crystal TV set, mobile phone, all display devices such as game machine.
Background technology
The user of present display device generally all is that hobby, use scene, the result of use according to oneself manually adjusted the screen intensity size through menu; Mental status that can't be current according to user; Like eyestrain; And the brightness of turning down screen automatically realizes the effect of protection eyes to adapt to current eyestrain situation.Therefore, how addressing the above problem is research purpose of the present invention.
Summary of the invention
The object of the present invention is to provide a kind of eye eyesight intelligent protection system, the present invention can realize can protecting the safety of user eyesight to the Based Intelligent Control according to the fatigue strength self adaptation conditioning equipment screen intensity of display device user, again can energy savings.
The invention is characterized in: a kind of eye eyesight intelligent protection system comprises image pre-processing module A, facial processing module B; Eye areas locating module C; Eye tracking prediction module D, fatigue state detection module E calculates degree of fatigue module F; Control display device backlight illumination module G and prompting menu module H; It is characterized in that: gather the coherent image that user uses display device in real time with a photographic head, said image pre-processing module A carries out the image pretreatment, mainly is to carry out illumination compensation for the uneven picture of brightness of image; Said facial processing module B looks for colour of skin part based on the YCbCr color space, utilizes the mode of projection to take out face area; In the face area of new taking-up; Said eye areas locating module C utilizes the geometric distribution in " five in three front yards "; Eye areas is confirmed in projection through level and vertical both direction, carries out detection and location in eye areas, marks eye areas as the eyes template with rectangle; Said eye tracking prediction module D proposes the module of eyes from previous frame, use based on the Unscented kalman filtering method UKF of Kalman filter the eye position of next frame is carried out predicting tracing; Wherein the location of face and tracking are as eyes; Said fatigue state detection module E mainly comprises two aspects: whether the state that detects eyes and face conformance with standard; Wherein the face fatigue detecting is to utilize the ratio of width to height of face and yawning duration T to judge whether user is in fatigue state; And utilize the PERCLOS method to detect eyestrain; Refer to the shared time ratio more than 80% of eyes closed in the unit interval based on the PERCLOS method, detect eyestrain degree; Said calculating degree of fatigue module F is through merging the tired calculation of parameter overall fatigue degree value of face and eyes; Said control display device backlight illumination module G and prompting menu module H control brightness size backlight automatically and show the corresponding prompt message menu according to degree of fatigue, realize protecting the function of eye eyesight and the intelligence system that a kind of detecting real-time user mental attitude is reminded rest automatically.
Advantage of the present invention: the present invention can detect the user degree of fatigue and realize the brightness of automatic fine tuning display device screen, and the current mental status of prompting user, reminds and has a rest, and reaches the effect of protection eye eyesight
Description of drawings
Fig. 1 is the flow chart of the embodiment of the invention.
Fig. 2 is an illumination compensation algorithm flow chart of the present invention.
Fig. 3 is eye location of the present invention and trace flow figure.
Fig. 4 is the present invention testing process figure that yawns.
Fig. 5 opens curve for face of the present invention.
Fig. 6 is a PERCLOS measuring principle of the present invention.
Fig. 7 is relevant for PERCLOS of the present invention and tired grade.
Fig. 8 calculates degree of fatigue for the present invention.
Fig. 9 is a control flow of the present invention.
Figure 10 points out menu for the present invention.
The specific embodiment
With reference to figure 1, Fig. 2, Fig. 3, Fig. 4; Fig. 5, Fig. 6, Fig. 7, Fig. 8; Fig. 9 and Figure 10, a kind of eye eyesight intelligent protection system comprises image pre-processing module A, facial processing module B; Eye areas locating module C, eye tracking prediction module D, fatigue state detection module E calculates degree of fatigue module F; Control display device backlight illumination module G and prompting menu module H gather the coherent image that user uses display device in real time with a photographic head, and said image pre-processing module A carries out the image pretreatment, mainly is to carry out illumination compensation for the uneven picture of brightness of image; Said facial processing module B looks for colour of skin part based on the YCbCr color space, utilizes the mode of projection to take out face area; In the face area of new taking-up; Said eye areas locating module C utilizes the geometric distribution in " five in three front yards "; Eye areas is confirmed in projection through level and vertical both direction, carries out detection and location in eye areas, marks eye areas as the eyes template with rectangle; Said eye tracking prediction module D proposes the module of eyes from previous frame, use based on the Unscented kalman filtering method UKF of Kalman filter the eye position of next frame is carried out predicting tracing; Wherein the location of face and tracking are as eyes; Said fatigue state detection module E mainly comprises two aspects: whether the state that detects eyes and face conformance with standard; Wherein the face fatigue detecting is to utilize the ratio of width to height of face and yawning duration T to judge whether user is in fatigue state; And utilize the PERCLOS method to detect eyestrain; Refer to the shared time ratio more than 80% of eyes closed in the unit interval based on the PERCLOS method, detect eyestrain degree; Said calculating degree of fatigue module F is through merging the tired calculation of parameter overall fatigue degree value of face and eyes; Said control display device backlight illumination module G and prompting menu module H control brightness size backlight automatically and show the corresponding prompt message menu according to degree of fatigue, realize protecting the function of eye eyesight and the intelligence system that a kind of detecting real-time user mental attitude is reminded rest automatically.
On display device, installing or place a photographic head aside, gather the coherent image that user uses display device in real time, carry out the image pretreatment, mainly is to carry out illumination compensation for the uneven picture of brightness of image.
The YCbCr color space information of available this image, and the colour of skin scope of setting suitable CbCr is with the image binaryzation with face's part, and take out face area among the image with the mode of projection.
In the face area of new taking-up, eye areas locating module C utilizes the geometric distribution in " five in three front yards ", confirms eye areas through the projection of level and vertical both direction.Carry out detection and location in eye areas, mark eye areas as the eyes template with rectangle.
Above-mentioned eye tracking prediction module D adopts the Unscented kalman filtering method UKF based on Kalman filter that the user eyes are followed the tracks of.
Above-mentioned fatigue state detection module E mainly comprises two aspects: whether the state that detects eyes and face conformance with standard, and the face fatigue detecting is to utilize the ratio of width to height of face and yawning duration T to judge whether user is in fatigue state; Utilize the PERCLOS method to detect eyestrain, refer to the shared time ratio more than 80% of eyes closed in the unit interval, detect eyestrain degree based on the PERCLOS method.
Aforementioned calculation degree of fatigue module F merges face yawn duration T and eyes PERCLOS value calculating degree of fatigue, refers to the shared time ratio more than 80% of eyes closed in the unit interval based on the PERCLOS method, detects eyestrain degree.
Above-mentioned control display device backlight illumination module G draws G-value according to calculating degree of fatigue module F, the backlight illumination output size of adjustment display device.
The practical implementation process is following:
One, image pre-processing module A
On display device, installing or place a photographic head aside, gather the coherent image that user uses display device in real time, carry out the image pretreatment, mainly is to carry out illumination compensation for the uneven picture of brightness of image, particular flow sheet such as Fig. 2
Two, facial processing module B
Utilize the YCbCr color space information of this image, and the colour of skin scope of setting suitable CbCr is with the image binaryzation with face's part, and takes out face area among the image with the mode of projection.
Three, eye areas locating module C
In the face area of new taking-up, eye areas locating module C utilizes the geometric distribution in " five in three front yards ", confirms eye areas through the projection of level and vertical both direction.Carry out detection and location in eye areas, mark eye areas as the eyes template with rectangle.
Four, eye tracking prediction module D
Employing is followed the tracks of the user eyes based on the Unscented kalman filtering method UKF of Kalman filter.As shown in Figure 3.
Five, fatigue state detection module E
Mainly comprise two aspects: whether the state that detects eyes and face conformance with standard.The face fatigue detecting is to utilize the ratio of width to height of face and yawning duration T to judge whether user is in fatigue state.Utilize the PERCLOS method to detect eyestrain.
1, the face fatigue state detects
According to the architectural feature of people's face, be positioned at 2/3 position of people's face candidate region to the region of search of face, on the basis of face profile, whether the ratio of width to height after opening with face representes to have yawning behavior to occur.If aspect ratio value is excessive, explain that then face is closed state (stretching degree can not reach open degree when yawning when general face was spoken), if the value of being somebody's turn to do is smaller, explains that then face is in open configuration.Write down this and be worth rate over time,, explain that face is once opening action if the value of being somebody's turn to do is descending.Otherwise, explain that then face is carrying out closed action one time.As shown in Figure 4.
Yawning principal character is the open height of face considerably beyond the height of face during normal speaking, and can keep a period of time when surpassing normal face height.The persistent period of yawn can reflect the degree that user is tired.
Persistent period of yawning is expressed as through Fig. 5:
Defining the persistent period of yawning is that yawn began to the time of yawn end: T=t2-t1
If T is big more, the degree of fatigue of expression user is high more.
2, eyestrain detects
Refer to the shared time ratio more than 80% of eyes closed in the unit interval based on PERCLOS (P80) method, detect eyestrain degree.
As shown in Figure 6, measure the value of t1 ~ t4, calculate the PERCLOS value.
PERCLOS?=?(t3-t2)/(t4-t1)*100%
Wherein, T1 is that the eyes maximum is opened the closed used time of 80% pupil aperture; T2 is that the eyes maximum is opened the closed used time of 20% pupil aperture, and t3 is that the eyes maximum is opened the used time of 20% pupil aperture, and t4 is that the eyes maximum close is to opening the used time of 80% pupil aperture.
According to the PERCLOS value, assess tired grade, as shown in Figure 7
Six, calculate degree of fatigue module F
As shown in Figure 8, merge face yawn duration T and eyes PERCLOS value calculating degree of fatigue.
1, calculate the yawn degree of fatigue value G1 of duration T of face:
If T<2s, G1=0 branch; If 2s≤T<3s, G1=1 branch; If 3s≤T<4s, G1=2 branch; If T>=4s, the G1=3 branch;
2, the degree of fatigue value G2 of calculating eyes PERCLOS value:
If PERCLOS 20%, the G2=0 branch; If 20%≤PERCLOS 30%, the G2=1 branch; If 30%≤PERCLOS 50%, the G2=2 branch; If PERCLOS>50%, the G2=3 branch;
3, merge G1 and G2 and draw overall fatigue degree value G.
Seven, control display device backlight illumination module G
Draw G-value according to calculating degree of fatigue module F, the backlight illumination output size of adjustment display device.It is as shown in Figure 9,
Control flow is:
1, if the G=0 branch is explained the current waking state that is in of user, the display device operate as normal;
2, if < G≤2 minute, then a) prompting user: it is tired that you are in shallow degree at present, the suggestion rest in 0 minute;
B) to adjust backlight illumination automatically be original 80% to 5s;
3, if < G≤4 minute, then a) prompting user: you were in moderate fatigue at present, and suggestion is had a rest in 2 minutes;
B) to adjust backlight illumination automatically be original 50% to 5s;
4, if G >=5 minute, then a) prompting user: you are in degree of depth fatigue at present, and suggestion is had a rest;
B) close backlightly behind the 20s automatically, display device gets into power save mode.
Eight, prompting menu module H
Menu design is shown in figure 10.
The above is merely preferred embodiment of the present invention, and all equalizations of doing according to claim of the present invention change and modify, and all should belong to covering scope of the present invention.

Claims (5)

1. an eye eyesight intelligent protection system comprises image pre-processing module A, facial processing module B; Eye areas locating module C; Eye tracking prediction module D, fatigue state detects E, calculates degree of fatigue module F; Control display device backlight illumination module G and prompting menu module H; It is characterized in that: gather the coherent image that user uses display device in real time with a photographic head, said image pre-processing module A carries out the image pretreatment, mainly is to carry out illumination compensation for the uneven picture of brightness of image; Said facial processing module B looks for colour of skin part based on the YCbCr color space, utilizes the mode of projection to take out face area; In the face area of new taking-up; Said eye areas locating module C utilizes the geometric distribution in " five in three front yards "; Eye areas is confirmed in projection through level and vertical both direction, carries out detection and location in eye areas, marks eye areas as the eyes template with rectangle; Said eye tracking prediction module D proposes the module of eyes from previous frame, with UKF the eye position of next frame is carried out predicting tracing; Wherein the location of face and tracking are as eyes; Said fatigue state detection module E mainly comprises two aspects: whether the state that detects eyes and face conformance with standard; Wherein the face fatigue detecting is to utilize the ratio of width to height of face and yawning duration T to judge whether user is in fatigue state, and utilizes the PERCLOS method to detect eyestrain; Said calculating degree of fatigue module F is through merging the tired calculation of parameter Total degree of fatigue of face and eyes; Said control display device backlight illumination module G and prompting menu module H control brightness size backlight automatically and show the corresponding prompt message menu according to degree of fatigue, realize protecting the function of eye eyesight and the intelligence system that a kind of detecting real-time user mental attitude is reminded rest automatically.
2. according to claims 1 described eye eyesight intelligent protection system; It is characterized in that: on display device, install or place a photographic head aside; Gather the coherent image that user uses display device in real time; Carrying out the image pretreatment, mainly is to carry out illumination compensation for the uneven picture of brightness of image.
3. according to claims 1 described eye eyesight intelligent protection system; It is characterized in that: the YCbCr color space information of available this image; And the colour of skin scope of setting suitable CbCr is with the image binaryzation with face's part, and takes out face area among the image with the mode of projection.
, according to claims 1 described eye eyesight intelligent protection system, it is characterized in that: said calculating degree of fatigue module F merges face yawn duration T and eyes PERCLOS value calculating degree of fatigue.
5. according to claims 1 described eye eyesight intelligent protection system, it is characterized in that: said display device backlight control module G draws G-value according to calculating degree of fatigue module F, the backlight illumination output size of adjustment display device.
CN201010521107A 2010-10-27 2010-10-27 Intelligent eye vision protection system Expired - Fee Related CN102028577B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201010521107A CN102028577B (en) 2010-10-27 2010-10-27 Intelligent eye vision protection system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010521107A CN102028577B (en) 2010-10-27 2010-10-27 Intelligent eye vision protection system

Publications (2)

Publication Number Publication Date
CN102028577A CN102028577A (en) 2011-04-27
CN102028577B true CN102028577B (en) 2012-09-05

Family

ID=43882398

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010521107A Expired - Fee Related CN102028577B (en) 2010-10-27 2010-10-27 Intelligent eye vision protection system

Country Status (1)

Country Link
CN (1) CN102028577B (en)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102447858A (en) * 2011-12-28 2012-05-09 彩虹集团公司 LED (Light Emitting Diode) backlight control method based on infrared eye-tracking technology
CN102610184B (en) * 2012-03-20 2015-01-21 华为技术有限公司 Method and device for adjusting display state
US9854159B2 (en) 2012-07-20 2017-12-26 Pixart Imaging Inc. Image system with eye protection
CN103807661A (en) * 2012-11-15 2014-05-21 隆达电子股份有限公司 Intelligent lamp for dynamically adjusting lighting parameters
CN103220583A (en) * 2013-03-28 2013-07-24 四川长虹电器股份有限公司 System and method for detecting user fatigue degree based on smart television
CN103646632B (en) * 2013-12-06 2016-05-18 惠州Tcl移动通信有限公司 Electronic equipment and display methods backlight thereof
CN104182046A (en) * 2014-08-22 2014-12-03 京东方科技集团股份有限公司 Eye control reminding method, eye control image display method and display system
CN104391579A (en) * 2014-12-08 2015-03-04 钟志刚 Interactive eye protecting method of display equipment
WO2016180048A1 (en) 2015-05-13 2016-11-17 京东方科技集团股份有限公司 Display device and drive method therefor
CN106897725A (en) * 2015-12-18 2017-06-27 西安中兴新软件有限责任公司 A kind of method and device for judging user's asthenopia
CN106094256A (en) * 2016-06-01 2016-11-09 宇龙计算机通信科技(深圳)有限公司 Home equipment control method, home equipment control device and intelligent glasses
CN106155319A (en) * 2016-06-28 2016-11-23 广东欧珀移动通信有限公司 Control method, control device and electronic installation
CN106249877A (en) * 2016-07-18 2016-12-21 广东欧珀移动通信有限公司 Control method and control device
CN106774921A (en) * 2016-12-28 2017-05-31 深圳天珑无线科技有限公司 Back light brightness regulating method, device and terminal
CN106991792A (en) * 2017-05-15 2017-07-28 广东小天才科技有限公司 A kind of eye fatigue detection method and device, user equipment
CN107645590A (en) * 2017-08-16 2018-01-30 广东小天才科技有限公司 One kind uses kopiopia based reminding method and user terminal
CN107995364A (en) * 2017-12-01 2018-05-04 庄宿龙 A kind of method for alleviating puerpera's eye fatigue
CN109044375A (en) * 2018-07-30 2018-12-21 珠海格力电器股份有限公司 A kind of control system and its method of real-time tracking detection eyeball fatigue strength
CN109117810A (en) * 2018-08-24 2019-01-01 深圳市国脉畅行科技股份有限公司 Fatigue driving behavioral value method, apparatus, computer equipment and storage medium
CN111699698A (en) * 2019-10-12 2020-09-22 深圳海付移通科技有限公司 Eye fatigue relieving method and intelligent terminal
CN112505930A (en) * 2021-02-05 2021-03-16 宁波圻亿科技有限公司 Optical correction device and wearing device
CN113838411B (en) * 2021-10-12 2023-04-25 深圳市巨融医疗科技有限公司 LED display screen brightness adjusting method, system and equipment based on human-caused illumination
CN114666523B (en) * 2022-03-30 2023-10-27 湖南格为科技有限公司 Energy-saving liquid crystal television capable of automatically adapting to human eye brightness
CN114822423A (en) * 2022-05-20 2022-07-29 湖南星峰科技有限公司 Liquid crystal display television and backlight adjusting method thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998005024A1 (en) * 1996-07-26 1998-02-05 Roger Wagner Anti-eye strain apparatus and method
US20050229294A1 (en) * 2002-10-24 2005-10-20 Basimah Khulusi Multi-purpose goggle
CN101004900A (en) * 2006-01-19 2007-07-25 财团法人工业技术研究院 Device and method for automatic adjusting parameters of display based on visual performance
CN101299807A (en) * 2007-04-30 2008-11-05 深圳Tcl新技术有限公司 Display device capable of automatically regulating display parameter as well as implementation method thereof
CN101551934A (en) * 2009-05-15 2009-10-07 东北大学 Device and method for monitoring fatigue driving of driver
US20100177029A1 (en) * 2009-01-14 2010-07-15 Chris Yeh Hysteresis-type controlling method for backlight of portable electronic device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998005024A1 (en) * 1996-07-26 1998-02-05 Roger Wagner Anti-eye strain apparatus and method
US20050229294A1 (en) * 2002-10-24 2005-10-20 Basimah Khulusi Multi-purpose goggle
CN101004900A (en) * 2006-01-19 2007-07-25 财团法人工业技术研究院 Device and method for automatic adjusting parameters of display based on visual performance
CN101299807A (en) * 2007-04-30 2008-11-05 深圳Tcl新技术有限公司 Display device capable of automatically regulating display parameter as well as implementation method thereof
US20100177029A1 (en) * 2009-01-14 2010-07-15 Chris Yeh Hysteresis-type controlling method for backlight of portable electronic device
CN101551934A (en) * 2009-05-15 2009-10-07 东北大学 Device and method for monitoring fatigue driving of driver

Also Published As

Publication number Publication date
CN102028577A (en) 2011-04-27

Similar Documents

Publication Publication Date Title
CN102028577B (en) Intelligent eye vision protection system
CN101470460B (en) Method for sight protection when using computer, and computer thereof
CN103412647B (en) The page display control method of a kind of recognition of face and mobile terminal
CN106445151B (en) A kind of control method and terminal of screen luminance of terminal
CN203366711U (en) Vehicle-mounted self-adaptive display device
CN105280159B (en) The backlight adjusting method and its display device of a kind of display device
CN107783643A (en) A kind of method and device for protecting user&#39;s eyesight
CN112015265B (en) Eye movement tracking device
CN109257484A (en) A kind of brightness of display screen processing method and terminal device
WO2014094486A1 (en) Device for preventing myopia and cervical spondylosis
WO2006093074A1 (en) Electronic display medium and screen display control method used for electronic display medium
CN205049814U (en) On -vehicle new line display terminal
JP2008111886A (en) Automatic door, screen display apparatus, screen display control program, and computer readable recording medium recorded with the program
WO2015158087A1 (en) Method and apparatus for detecting health status of human eyes and mobile terminal
CN103236249B (en) The method and apparatus that display device regulates automatically
TWI532377B (en) Image sesning system, image sensing method, eye tracking system, eye tracking method
CN108711407B (en) Display effect adjusting method, adjusting device, display equipment and storage medium
CN105867605A (en) Functional menu page-turning method and apparatus for virtual reality helmet, and helmet
JP2008246013A (en) Sleepiness sensor
CN103677215A (en) Power-saving control method for screen of intelligent device
CN101887700A (en) Computer system, display device and backlight control method
CN105845101A (en) Method and apparatus for adjusting display brightness of device
CN111124534A (en) Intelligent eye protection computer
CN109782620A (en) Intelligent curtain and its control method, device and computer readable storage medium
CN113744499B (en) Fatigue early warning method, glasses, system and computer readable storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120905

Termination date: 20161027