WO2013179178A1 - Surveillance de la fatigue oculaire - Google Patents

Surveillance de la fatigue oculaire Download PDF

Info

Publication number
WO2013179178A1
WO2013179178A1 PCT/IB2013/054126 IB2013054126W WO2013179178A1 WO 2013179178 A1 WO2013179178 A1 WO 2013179178A1 IB 2013054126 W IB2013054126 W IB 2013054126W WO 2013179178 A1 WO2013179178 A1 WO 2013179178A1
Authority
WO
WIPO (PCT)
Prior art keywords
intensity
infrared light
eye fatigue
monitoring
interest
Prior art date
Application number
PCT/IB2013/054126
Other languages
English (en)
Inventor
Yalin TI
Guofu Zhou
Original Assignee
Koninklijke Philips N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips N.V. filed Critical Koninklijke Philips N.V.
Publication of WO2013179178A1 publication Critical patent/WO2013179178A1/fr

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4869—Determining body composition
    • A61B5/4875—Hydration status, fluid retention of the body
    • A61B5/4878—Evaluating oedema
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy

Definitions

  • Embodiments of the present invention generally relates to monitoring eye fatigue, and more particularly to a method and system for monitoring eye fatigue based on
  • Eye fatigue has nowadays attracted tremendous public attention as results of the long term eye use and the expanding implementation of visual display terminals. Although people experiencing eye fatigue can usually recover by taking rest in a timely manner, unawareness of eye fatigue and/or unwillingness to take a break till the fatigue upgrades to a severe level could lead to persistent discomfort or even functional problems such as myopia. Therefore, effective means for monitoring the stage of eye fatigue is of great interest for eye care in both clinic and home settings.
  • Eye fatigue is a complex syndrome modulated by multiple factors.
  • Current methods for eye fatigue evaluation are limited at evaluating the physical response of eyes, such as critical flicker fusion threshold assessment and eye movement tracking.
  • these responses are usually the consequence of physiological changes and could be subject to various interferences, such as conscious subjective reluctance to blink. Evaluations of eye fatigue based on these data are still questionable.
  • an eye fatigue index (EFI) model is also provided for eye fatigue level evaluation.
  • a method for monitoring eye fatigue comprises: illuminating periorbital skin with Infrared light having a first intensity; measuring a second intensity of Infrared light reflected from the periorbital skin; and determining a level of eye fatigue based on at least the second intensity of Infrared light. Further, the determining may be further based on the first intensity of Infrared light.
  • the measuring comprises: acquiring one or more images of the periorbital skin by using active IR imaging; extracting a region of interest (ROI) from the periorbital skin within the one or more images; and calculating the second intensity of IR light reflected from the region of interest.
  • ROI region of interest
  • the second intensity I 2 of IR light reflected from the region of interest is indicated by an intensity I monitoring of IR light of the region of interest is calculated as I monitoring , wherein N R0I is the number of pixels of the region of interest, /
  • the illuminating comprises: illuminating a point of interest (POI) on the periorbital skin with the IR light having the first intensity; and the measuring the second intensity I 2 comprises sensing an intensity I monitoring of IR light reflected from the point of interest.
  • POI point of interest
  • the determining comprises calculating a relative intensity
  • I reference is a corresponding intensity measured with a
  • the region of interest is one of the following: part or all of the upper eyelid, part or all of the lower eyelid, and any combinations thereof.
  • the level of eye fatigue is determined according to a predefined Eye Fatigue Index (EFI) reference model, the EFI reference model being created based on magnitude and/or gradient of the second intensity of IR light, or based on magnitude and/or gradient of the relative intensity of the reflected IR light, or based on magnitude and/or gradient of difference of the first intensity and the second intensity of IR light.
  • EFI Eye Fatigue Index
  • the method may further comprise at least one of:
  • a system for monitoring eye fatigue may comprise an Infrared light source unit configured to illuminate periorbital skin with IR light having a first intensity; an IR optical sensor unit configured to measure a second intensity of Infrared (IR) light reflected from the periorbital skin; and a processor configured to determine a level of eye fatigue based on at least the second intensity of IR light.
  • IR Infrared
  • one direct pathophysiological indicator of eye fatigue i.e., the alteration of periorbital edema
  • the monitoring system may be made compact and can be integrated with appliances, such as a pair of glasses, or a cap, to provide a wearable and portable setup and to real-time monitor eye fatigue.
  • appliances such as a pair of glasses, or a cap
  • the imaging system is replaced by a non-contact fiber-optic spectroscopic system.
  • the monitoring system may be made even compact.
  • the proposed system may also be integrated with other appliances, such as mobile phone, desk lamp, computer, TV or mirror, to expand the accessibility of the presented technology. Further, by using an IR light source and an IR sensor, the detection is made invisible and unaffected by the ambient lighting condition. Moreover, a quantified index of pathophysiological response in the eye fatigue process is provided for a more accurate evaluation of the severity of eye fatigue.
  • Fig. 1 schematically illustrates an exemplary monitoring system 100 for monitoring eye fatigue according to a first embodiment of the present invention
  • Fig. 2 schematically illustrates the image processing according to the first embodiment of the present invention
  • Fig. 3 schematically illustrates an eye fatigue curve 300 generated according to embodiments of the present invention
  • Fig. 4 illustrates an exemplary monitoring system 400 for monitoring eye fatigue according to a second embodiment of the present invention.
  • Fig. 5 is a flow chart schematically illustrating an exemplary method 500 for monitoring eye fatigue according to a first embodiment of the present invention.
  • periorbital edema When people experience eye fatigue, one physiological character associated with eye fatigue that can be observed is periorbital edema. Specifically, along with the increasing loads of eye use, the local circulation associated with eyes slows down and hence induces fluid (mainly water) retention around eyes, termed as "periorbital edema," in connective tissue under skin. Since the areas surrounding eyes have the thinnest skin of human body, periorbital edema is easy to be discerned especially in severe condition that swelling around eyes happens.
  • Periorbital edema should be distinguished from another syndrome, eye bag, which also usually causes swelling appearance under eyes especially for aged people.
  • periorbital edema eye puffiness
  • eye bags are often caused by fat accumulation under the eye, and will develop slowly over years.
  • embodiments of the proposed invention look directly into the alteration of the periorbital edema and try to create a new eye fatigue assessment system based on it, so as to provide a more reliable and convenient means for eye fatigue monitoring and evaluation.
  • Periorbital edema developed during an eye fatigue process is primarily led by the water retention under skin. Therefore, by studying the alteration of light absorption due to the change of water concentration, we can create an indicator for the severity of eye fatigue.
  • Infrared sensing technique will be employed to measure an intensity of IR light reflected from periorbital skin, which indirectly indicates the intensity of IR light absorbed by the water under the periorbital skin.
  • IR Infrared
  • the skilled in the art can understand that, the more severe the eye fatigue is, the higher the tissue water concentration in the periorbital skin is, and in turn the more the light is absorbed by the water, and the less the light reflected from the periorbital skin is measured.
  • the measured intensity of the reflected IR light is an indicator of the tissue water concentration in the periorbital skin, and thus the alteration of the light
  • absorption/reflection indicates the severity of eye fatigue.
  • the wavelength for excitation light source is selected in IR/NIR range since the tissue absorption in this range is dominant by water.
  • One preferable choice could be 980 nm, because this is a local absorption peak for water as well as a local absorption trough for fat.
  • a measuring system comprising an IR light source unit and an IR optical sensor unit is employed.
  • the IR light source unit is configured to illuminate periorbital skin with IR light having a first intensity.
  • the IR optical sensor unit is configured to measure a second intensity of IR light reflected from the periorbital skin.
  • Fig. 1 illustrates an exemplary monitoring system 100 for monitoring eye fatigue according to a first embodiment of the present invention.
  • the measuring system is implemented by an active IR imaging system to monitor the relative water concentration alterations under skin in periorbital areas, wherein the IR optical sensor unit may comprise an IR camera unit configured to acquire one or more images of the periorbital skin.
  • imaging processing and eye fatigue assessment algorithms are developed to identify the representative area for water concentration monitoring and define an index representing the level of eye fatigue.
  • the monitoring system 100 may comprise a measuring system and a processor (not shown).
  • the measuring system may comprise an IR light source unit and an IR optical sensor unit.
  • the IR light source unit is configured to illuminate periorbital skin with IR light having a first intensity
  • the IR optical sensor unit is configured to measure a second intensity of IR light reflected from the periorbital skin.
  • the second intensity of the reflected IR light may indicate a tissue water concentration in the periorbital skin, in other words, the alteration of the second intensity of the reflected IR light is an indicator of the change of the tissue water concentration in the periorbital skin.
  • the processor may be configured to determine a level of eye fatigue based on at least the second intensity of the reflected IR light.
  • the level of eye fatigue may be determined further based on the first intensity of IR light, for example, the difference of the first intensity and the second intensity. The determination will be discussed later with reference to Fig. 3.
  • the measuring system may be implemented as an active IR imaging system, which comprises an IR light source unit 111 and an IR camera unit 112.
  • the IR light source unit 111 is configured to illuminate the periorbital skin of the eye 130 to be imaged with a first intensity I x .
  • the IR light source unit 111 may comprise an IR laser diode 113, a beam expander 115, and other components (such as a bracket for supporting the IR laser diode 113 and the beam expander 115) as required by the specific implementation.
  • the IR laser diode 113 may emit IR light of 980 nm.
  • the beam expander 115 is arranged to expand the light emitted from the IR laser diode 113, so as to cover the periorbital skin to be imaged, for example for illuminating the periorbital area including upper and lower eyelids.
  • the IR light source unit 111 may include any one or more of a variety of IR radiation sources, including but not limited to,
  • semiconductor-based sources e.g., LED-based sources
  • incandescent sources e.g., filament lamps
  • gaseous discharge sources e.g., xenon high pressure lamp
  • lasers e.g., lasers
  • the IR camera unit 112 is configured to acquire one or more images (an image 114 is shown in Fig. 1 by way of example) of the periorbital skin of the eye 130.
  • the IR camera unit 112 may be a low-cost charge-coupled device (CCD) micro-camera sensitive to IR.
  • CCD charge-coupled device
  • the IR light source unit 111 is placed at an oblique angle (for example, 30 degrees) to the IR camera unit 112 which may sit on the geometric axis of the eye 130.
  • This setting helps to avoid the specular reflection and insures that the IR camera unit 112 may capture most of the diffused/reflected light from deeper tissue underneath the skin surface.
  • additional holder(s) may be used to implement such arrangement.
  • the specific structure of the measuring system depends on the appliance with which the monitoring system 100 is integrated.
  • the imaging system may further comprise one or more of an IR reflecting unit and an optical fiber (not shown in Fig. 1) depending on the specific structures of the apparatuses.
  • the IR reflecting unit and the optical fiber are configured to direct the IR light beam from the IR light source unit 111 to illuminate the eye 130 to be imaged, and/or direct the IR light beam reflected from the eye 130 to the IR camera unit 112 to form an image.
  • the imaging system may comprise more or less components as set forth in the above description.
  • an active IR imaging system has many advantages. First and the most important, water has very strong absorption in the IR wavelength range. Second, it can acquire images under various lighting conditions, regardless at night or during daytime. Third, the IR illumination is not visible by the user and does not interfere with the normal life of the user, for example, when the user is reading, driving, and etc. Fourth, it provides images of high imaging definition and high contrast, which can advantage the subsequent imaging processing. Upon one or more images of the periorbital skin of the eye 130 has been acquired, the processor will perform further analysis on the image using pre-written digital image processing programs.
  • Fig. 2 schematically illustrates the image processing according to the first embodiment of the present invention.
  • the processor is configured to screen the images based on the extent or degree of the eye closed (in other words, the extent of eye opening).
  • images of fully closed eye are selected for further processing.
  • different extents of the eye closed may be identified, and the image with the same extent as that of a reference image (which will be discussed later) will be selected.
  • the processor is configured to extract a region of interest (ROI) 201 from the periorbital skin within the selected image.
  • the region of interest (ROI) may be one of the following: part or the entire of the upper eyelid, part or the entire of the lower eyelid, and any combinations thereof.
  • the region of interest ROI 201 may be the whole eyelid, as indicated by a white curve 202 which profiles the whole upper eyelid and the whole lower eyelid.
  • the maximal periorbital area can be achieved.
  • the extraction may be implemented by using pattern recognition techniques in image processing.
  • the skilled in the art would appreciate that the extracting may be implemented by using other techniques in computer vision and image processing.
  • the present invention has no limitation in this aspect.
  • the processor is further configured to calculate the second intensity I 2 of IR light reflected from the ROI, which may be indicated by an intensity I monitoring of IR light of the ROI.
  • I monitorin oi ROI may be calculated as:
  • N R0I is the number of pixels of the ROI, / is an intensity of each pixel.
  • the intensity of the pixel on the image varies as the real incoming IR light intensity on the camera, in this example, the second intensity I 2 of the reflected IR light.
  • the relationship between the pixel intensity and the real incoming intensity may vary slightly depending on the IR camera by which the image is acquired, the light source, the reflector, and etc. Thus, the relationship may be predetermined and used to convert the pixel intensity into the real incoming intensity as required. Generally, the relationship may be linear.
  • the measured intensity I monitoring of IR light is an indicator of the tissue water concentration in the periorbital skin.
  • the measured intensity I monitoring will decrease as the eye fatigue becomes more severe.
  • the region of interest may be one of the following: part or the entire of the upper eyelid, part or the entire of the lower eyelid, and any combinations thereof. If only part or the entire of the upper eyelid is specified as ROI, such option can minimize the absorption interference from fat usually accumulated under the eye. If only part or the entire of the lower eyelid is specified as ROI, such option can offer a better image quality due to the stable status of lower eyelid area.
  • I reference is a corresponding intensity measured with a same measuring approach as Imonitoring ⁇ 0 ⁇ under a healthy eye condition, i.e., without eye fatigue.
  • the same measuring approach means that a same IR light source with a same first intensity and a same IR camera are used, an image of the same extent of eye opening is selected (the image may be referred as a reference image), the same ROI is specified, and the same calculation algorithm is employed.
  • the measured intensity I monitoring with various measuring approaches will be normalized as I r .
  • I reference is obtained beforehand during a health eye condition without fatigue. In some embodiments, several I reference corresponding to different extents of eye opening and different ROIs and even different first intensities I x may be obtained and stored for later use. Further, by normalization of I monitoring , the conversion of I monitoring into 7 2 may be omitted, because as previously discussed, the relationship between the pixel intensity and the real incoming intensity may be linear. In the following description, unless otherwise specified, Monitoring an d I 2 ar e interchangeably used, because 7 2 may be derived from I monitoring on demand.
  • an intensity I 3 of IR light absorbed by the water under the periorbital skin may be used to determine the level of eye fatigue.
  • the known or fixed emitted light intensity i.e., the first intensity ⁇ ⁇
  • the first intensity ⁇ ⁇ is equal to sum of the absorbed light intensity I and the reflected light intensity I 2 .
  • the level of eye fatigue may be determined based on I monitoring , I r or I 3 .
  • an Eye Fatigue Index (EFI) reference model may be created based on the calculated I monitoring , I r or I 3 to evaluate the level of eye fatigue.
  • EFI Eye Fatigue Index
  • the EFI reference model may be created based on a plurality of I monitoring , I r or I 3 as monitored during a progress of eye fatigue of a user.
  • the progress of eye fatigue means a progress from a normal state to a highest-grade fatigued state of the user.
  • the user is in a normal state and starts reading, and the monitoring system 100 is initiated to monitor the eye fatigue of the user. The reading lasts a long time until the user feels very fatigued.
  • the monitoring system 100 continues monitoring the eye fatigue and records the calculated I monitoring , I r or I 3 periodically.
  • the monitoring system 100 may take a sample of the eye image of the user every 5 minutes and calculate the
  • the time interval may be set as other values.
  • I monitoring ' or ma Y b e obtained during the entire progress of eye fatigue of the user. Those values may be used to generate an eye fatigue curve.
  • Fig. 3 schematically illustrates an eye fatigue curve 300 generated according to an embodiment of the present invention.
  • the horizontal axis 310 represents the time passed from the beginning of the monitoring, in other words, the time spent on working (e.g., reading, watching TV, etc.) with the eyes.
  • the calculated reflected light intensity I monitoring or I 2 may be converted into an intensity I 3 of IR light absorbed by the water under the periorbital skin, wherein the known emitted light intensity, i.e., the first intensity ⁇ ⁇ , is equal to sum of the absorbed light intensity I and the reflected light intensity I 2 .
  • the vertical axis 320 may represent the converted absorbed light intensity I 3 , which can indicate the level or degree of the eye fatigue directly.
  • the vertical axis 320 may represent other parameters associated with the eye fatigue, such a s I m ochteitorin g ' ' 0 ⁇ 1 " ' s0 mat respective eye fatigue curve can be generated.
  • the eye fatigue curve 300 shows that the magnitude of absorbed light intensity I 3 increases as the time spent working with the eyes becomes longer.
  • the magnitude of I 3 finally goes to a constant (a maximum value of I 3 , theoretically, the upper limit of is I x ), which indicates the highest-grade fatigued state of the user.
  • the EFI reference model may be created based on the magnitude of I .
  • a fatigue threshold of magnitude may be determined as a percentage of the maximum magnitude of I , such as 50%. Specifically, when the value of I 3 is under the fatigue threshold, it indicates a normal state, and when the value of I 3 is over the fatigue threshold, it indicates a fatigued state.
  • the skilled in the art can easily envisage other ways to define the threshold.
  • a plurality of fatigue thresholds may be set to hierarchically indicate the levels of eye fatigue. That is, the EFI reference model may be divided into several levels, each level indicating different degree of eye fatigue. For example, as shown in Fig. 3, two fatigue thresholds (304 and 306) are selected to indicate the levels of eye fatigue.
  • the fatigue threshold 304 may be selected as 50% of the maximum magnitude of I
  • the fatigue threshold 306 may be selected as 75% of the maximum magnitude of I , respectively.
  • the above embodiment needs to monitor the entire progress of eye fatigue, which may take a long time, such as 3 or 4 hours. Additionally, the maximum magnitude of I may vary from user to user, and thus the EFI reference model based on magnitude of I may need calibration (will be discussed below). The inventors also find that, I changes rapidly when the eyes begin to become fatigued, and changes slowly when the eyes have been heavily fatigued. The above changes may be obvious from the eye fatigue curve 300 as shown in Fig. 3.
  • the EFI reference model may be created based on the rate of changes in I 3 (i.e., the gradient of the eye fatigue curve 300) as monitored during a time period. Similarly, during that period, the monitoring system 100 continues monitoring the eye fatigue and records the calculated I monitoring , I r , or I 3 periodically. However, the time period may be less than the period of an entire progress of eye fatigue, because when the gradient of the eye fatigue curve 300 varies slowly but the magnitude of the I monitoring , I r , or I 3 has not yet reached its limit, the monitoring may be stopped and an EFI reference model may be created therefrom. Further, such change trend in I monitoring , I r , or I 3 is almost same for most people, and thus the EFI reference model based on gradient of I monitoring , I r , or I 3 is not necessarily calibrated.
  • the eye fatigue curve 300 shows that the gradient of I 3 decreases as the time spent with the eyes becomes longer.
  • the gradient of the curve 300 is finally approaching to zero, which indicates the highest-grade fatigued state of the user.
  • the EFI reference model may be created based on the gradient of I . Normally, the monitoring would continue for a period of time, and thus the gradient of I may be calculated from the samples taken in that period.
  • the calculating of the gradient may be implemented by any known technique, and thus the detailed description thereof is omitted herein.
  • the EFI reference model based on the gradient of I may be divided into several levels, each level indicating different degree of eye fatigue. The detailed division may reference the above discussion with respect to the EFI reference model based on the magnitude of I 3 , and thus the description thereof is omitted here.
  • the above embodiments may be implemented separately or in combination, such that the monitoring system 100 can be adapted to various scenarios.
  • the EFI reference model based on the magnitude of I may be used to evaluate the level of eye fatigue.
  • the EFI reference model based on the gradient of I 3 may be used.
  • the EFI reference model may be calibrated as the use of the monitoring system 100.
  • the EFI reference model may be initialized according to the statistics of pathophysiological response (in this context, the periorbital edema) to eye fatigue of human beings.
  • pathophysiological response in this context, the periorbital edema
  • the pathophysiological response associated with eye fatigue may vary from user to user, and sometimes it may vary from time to time.
  • calibration may be used to adapt a specific user during a specific period.
  • the plurality of I monitoring , I r , or I 3 as monitored during this period may be used to calibrate the EFI reference model.
  • the monitoring system 100 can determine the level of eye fatigue accurately for its user.
  • the monitoring system 100 may further comprise at least one of a display unit and an alerting unit (not shown).
  • the display unit may be configured to display the level of eye fatigue in real time.
  • the display unit may be a mini screen, which can display the calculated I monitoring , I r , or I 3 in real time in a form of eye fatigue curve.
  • the display unit can only display the level of the eye fatigue, such as Level 1 fatigue, Level 2 fatigue, etc.
  • the display unit may be one or more LED lights, which can indicate the level of eye fatigue by the number or color of the LED light(s). For example, red light can indicate a high-grade eye fatigued state, orange light can indicate a low-grade eye fatigued state, and green light can indicate a normal state.
  • red light can indicate a high-grade eye fatigued state
  • orange light can indicate a low-grade eye fatigued state
  • green light can indicate a normal state.
  • the skilled in the art would easily conceive other display manners to indicate the eye fatigue.
  • the alerting unit may be configured to alert if the monitored level of eye fatigue is beyond a predetermined alarm threshold.
  • the alert can be signals in any form, such as audible, visible, or sensible signals.
  • the predetermined alarm threshold may be determined from the EFI reference model. For example, the alarm threshold may be selected as one of the fatigue threshold(s) in the EFI reference model.
  • multiple alarm thresholds may be selected to indicate different levels of eye fatigue, and different alarm signals may be associated with different alarm thresholds.
  • the display unit and the alerting unit are described in separate components, they can be embodied as a single component.
  • Fig. 4 illustrates another exemplary monitoring system 400 for monitoring eye fatigue according to a second embodiment of the present invention.
  • the measuring system of the monitoring system 400 is implemented by a non- contact fiber-optic spectroscopic system to monitor the water concentration alterations under skin in periorbital areas. Instead of looking at the image from a region of periorbital area, the fiber-optic system investigates the tissue water concentration in local tissue block. Thus, no imaging processing is needed.
  • the EFI reference model may be created similarly as that in the first embodiment.
  • the monitoring system 400 may comprise a measuring system and a processor (not shown).
  • the measuring system may comprise an IR light source unit and an IR optical sensor unit.
  • the IR light source unit is configured to illuminate periorbital skin with IR light having a first intensity
  • the IR optical sensor unit is configured to measure a second intensity of IR light reflected from the periorbital skin.
  • the processor may be configured to determine a level of eye fatigue based on at least the second intensity of IR light.
  • the measuring system may comprise an IR laser diode light source 410 with source fiber coupling lens, a source fiber 412, an IR optical sensor 420, a detector fiber 422, and a fiber holder 414 for holding the two fibers 412 and 422.
  • a micro auto-zoom lens unit 416 coupled with an optical distance detector 418 will be implemented in order to deliver focused excitation light on a point of interest (POI) 430 on the tissue surface (via the source fiber 412) as well as to collect the diffuse reflected light from the POI 430 (via the detector fiber 422).
  • the fiber holder 414 may be further arranged to hold the micro lens unit 416 and the distance detector 418.
  • the IR optical sensor 420 may be configured to measure the second intensity I 2 of IR light reflected from the POI 430, which may be indicated by an intensity
  • a relative intensity of IR light I r may be calculated as:
  • I reference is a corresponding intensity measured with a same measuring approach as I monitoring but under a healthy eye condition, i.e., without eye fatigue.
  • the same measuring approach means that a same IR light source with a same first intensity is used, and the same POI is detected.
  • the measured intensity I monitoring with various measuring approaches will be normalized as I r .
  • the level of eye fatigue may be determined based on I monitoring or l r .
  • an EFI reference model may be created based on the calculated I monitoring or l r to evaluate the level of eye fatigue.
  • the creation of EFI reference model is similar to that in the first embodiment, and thus the description thereof is omitted here.
  • the monitoring system 100/400 thus has been described in detail with reference to Figs. 1-4.
  • Such monitoring system 100/400 may be made wearable by selecting compact units and building them upon a pair of eye glasses.
  • installation on the glasses is a preferred setup for this system which could provide a wearable and real-time monitoring solution for eye fatigue, integration with other apparatus such as a mobile phone, a desk lamp, an ebook, a computer, a TV, a cap or a mirror could also expand the accessibility of such technology.
  • the monitoring system 100/400 may further configured to evaluate the level of eye fatigue based on image(s) of both eyes.
  • the concrete structure of the monitoring system for both eyes may be different due to the apparatus with which the monitoring system integrates.
  • the monitoring system 100 it is only necessary to acquire an image of the surrounding skin of an eye, either fully open, part open, or closed, and thus the monitoring system 100 may be made compact and can be integrated with appliances, such as a pair of glasses, or a cap, to provide a wearable and portable setup and to real-time monitor eye fatigue.
  • the monitoring system 100 with imaging setup provides an area based EFI calculation relying on the changes of water concentration in regional tissue. As the EFI is averaged over an area, the result will be more stable with minimal artifacts incurred if there is slight movement during the monitoring period.
  • the monitoring system 400 Even no image is required, and the imaging system is replaced by a non-contact fiber-optic spectroscopic system. Thus, the monitoring system 400 may be made even compact.
  • the monitoring system 400 with the fiber-optic probe setup provides high measurement sensitivity via the point detection manner, is simple and cheap.
  • Fig. 5 is a flow chart schematically illustrating an exemplary method 500 for monitoring eye fatigue according to a first embodiment of the present invention.
  • the method 500 may start at the step S501 at which IR light with a first intensity is used to illuminate the periorbital skin to be imaged. Then the method 500 proceeds to the step S502 at which one or more images of the periorbital skin of an eye are acquired.
  • the images of the periorbital eye may be acquired by using an active IR imaging.
  • an IR light source unit 111 illuminates the periorbital skin to be imaged
  • an IR camera unit 112 captures the light beam reflected from the periorbital skin to form an image.
  • the acquired one or more images may be transferred to the processor, and the one or more images are processed to obtain a second intensity of IR light reflected from the periorbital skin, wherein the second intensity of IR light indicates a tissue water concentration in the periorbital skin.
  • the processor is configured to screen the images based on the extent or degree of the eye opening (or eye closed). In one embodiment, images of fully closed eye are selected for further processing. In other words, images of fully closed eye are selected for further processing.
  • different extents of the eye closed may be identified, and the image with the same extent as that of a reference image will be selected.
  • the processor is configured to extract a region of interest (ROI) from the periorbital skin within the selected image.
  • the region of interest (ROI) may be one of the following: part or the entire of the upper eyelid, part or the entire of the lower eyelid, and any combinations thereof.
  • the method 500 in turn goes to the step S505, at which, the second intensity of IR light reflected from the ROI may be calculated.
  • the second intensity I 2 of IR light reflected from the ROI may be indicated by an intensity I monitoring of IR light of the ROI, which may be calculated as:
  • N R0I is the number of pixels of the ROI, / is an intensity of each pixel.
  • a relative intensity of the reflected IR light I r may be further calculated as:
  • I reference is a corresponding intensity measured with a same measuring approach as I monitoring but under a healthy eye condition, i.e., without eye fatigue.
  • the same measuring approach means that a same IR light source with a same first intensity and a same IR camera are used, an image of the same extent of eye opening is selected, the same ROI is specified, and the same calculation algorithm is employed.
  • the measured intensity I monitoring with various measuring approaches will be normalized as I r .
  • the absorbed light intensity I 3 may be calculated based on the following equation:
  • I x is the known emitted light intensity, i.e., the first intensity; I 2 may be derived from described above.
  • the level of eye fatigue may be determined based on I monitoring , I r , or I .
  • an Eye Fatigue Index (EFI) reference model may be created based on the calculated I monitoring , I r , or I 3 to evaluate the level of eye fatigue.
  • the EFI reference model may be created based on the magnitudes and/or gradient of I monitoring , I r , or I 3 .
  • the level of eye fatigue may be determined according to the EFI reference model.
  • the method 500 may further comprise a self calibration process.
  • the monitored I monitoring , I r , or I 3 may be recorded along the process of eye fatigue and used to generate an eye fatigue curve, just like the creation of EFI reference model.
  • the EFI reference model may be calibrated or updated according to the newly generated curve, in other words, one or more fatigue thresholds in the EFI reference model may be calibrated. In this way, the monitoring system may be adapted to a specific user.
  • the self calibration process may be omitted when the EFI reference model is created based on the gradient of I monitoring , I r , or I 3 , because normally most people have a same trend in eye fatigue, i.e., first changing rapidly, and then slowly as time goes by.
  • the self calibration process may be activated even when the EFI reference model is created based on the gradient of
  • the method 500 may further comprise the step S507, at which it is determined whether the EFI hits a predetermined alarm threshold. If not, the method 500 may return to the step of S502 of acquiring an image of the periorbital skin of an eye.
  • an alerting system may be activated.
  • the alert can be signals in any form, such as audible, visible, or sensible signals.
  • the predetermined alarm threshold may be determined from the EFI reference model. For example, the alarm threshold may be selected as one of the fatigue threshold(s) in the EFI reference model. Alternatively, multiple alarm thresholds may be selected to indicate different levels of eye fatigue, and different alarm signals may be associated with different alarm thresholds.
  • the method 500 may further comprise the step of displaying the level of eye fatigue (not shown in Fig. 5).
  • Various display techniques may be used to indicate the level of eye fatigue, including but not limited to, graphical display, data display, light display, etc.
  • the monitoring system and method are mainly designed for eye care applications.
  • the technology as presented herein has offered a new solution for eye fatigue evaluation by quantifying the severity of periorbital edema induced by eye fatigue. It can be applied in the field of self health-monitoring devices for eye care.
  • the data collected not only provides personalized guidance on healthy eye use but also has the potential of introducing a new diagnostic parameter for clinical eye fatigue evaluation.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Veterinary Medicine (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Physics & Mathematics (AREA)
  • Public Health (AREA)
  • Pathology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

La présente invention concerne un procédé et un système de surveillance de la fatigue oculaire, qui se base sur la modification de la concentration en eau dans la peau péri-orbitale durant un processus de fatigue oculaire. Le procédé comprend : l'éclairage de la peau péri-orbitale avec une lumière infrarouge ayant une première intensité ; la mesure d'une seconde intensité de lumière infrarouge réfléchie de la peau péri-orbitale ; et la détermination d'un niveau de fatigue oculaire sur la base d'au moins la seconde intensité de lumière infrarouge. La mesure peut être mise en place par un système d'imagerie IR actif ou un système spectroscopique à fibre optique sans contact. Le système peut comprendre une unité source de lumière infrarouge, une unité capteur optique infrarouge, et un processeur. Un modèle de référence d'indice de fatigue oculaire (EFI) est également fourni pour l'évaluation du niveau de fatigue oculaire.
PCT/IB2013/054126 2012-05-30 2013-05-20 Surveillance de la fatigue oculaire WO2013179178A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2012076289 2012-05-30
CNPCT/CN2012/076289 2012-05-30

Publications (1)

Publication Number Publication Date
WO2013179178A1 true WO2013179178A1 (fr) 2013-12-05

Family

ID=48771668

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2013/054126 WO2013179178A1 (fr) 2012-05-30 2013-05-20 Surveillance de la fatigue oculaire

Country Status (1)

Country Link
WO (1) WO2013179178A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3205259A1 (fr) * 2016-02-15 2017-08-16 Universidad Complutense De Madrid Détecteur et méthode de détection du niveau d'aversion du système oculaire à une source de lumière
US11300446B2 (en) * 2019-03-29 2022-04-12 Beijing Boe Optoelectronics Technology Co., Ltd. Optical detection method and optical detection apparatus for fatigue state, and optical detection device

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080081996A1 (en) * 2006-09-29 2008-04-03 Grenon Stephen M Meibomian gland imaging

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080081996A1 (en) * 2006-09-29 2008-04-03 Grenon Stephen M Meibomian gland imaging

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3205259A1 (fr) * 2016-02-15 2017-08-16 Universidad Complutense De Madrid Détecteur et méthode de détection du niveau d'aversion du système oculaire à une source de lumière
US11300446B2 (en) * 2019-03-29 2022-04-12 Beijing Boe Optoelectronics Technology Co., Ltd. Optical detection method and optical detection apparatus for fatigue state, and optical detection device

Similar Documents

Publication Publication Date Title
JP7065361B2 (ja) 生体情報検出装置
AU2016204944B2 (en) Photorefraction ocular screening device and methods
US9436873B2 (en) Method and system for monitoring the skin color of a user
US10893800B2 (en) Binocular measurement device, binocular measurement method, and binocular measurement program
EP3057486B1 (fr) Réglage de caméra automatique pour photopléthysmographie à distance
KR101094766B1 (ko) 시선 위치 추적 장치 및 방법
JP6743129B2 (ja) 心機能測定装置、心機能測定方法および心機能測定プログラム
US20170347938A1 (en) Method and apparatus for use in allergy testing
US8267517B2 (en) Eyeball motion measurement apparatus
JP6535223B2 (ja) 瞬目計測方法、瞬目計測装置、及び瞬目計測プログラム
US10159418B2 (en) Information obtaining apparatus, image capturing apparatus, and method for obtaining information
JP2008301841A (ja) 精神的疲労の検出方法、装置及びプログラム
JP2018508254A (ja) 自動視力診断の方法およびシステム
EP3226765A1 (fr) Dispositif et méthode de détection de peau
CN111465345A (zh) 皮肤传感器
US20180279937A1 (en) Method and system for diagnostic pupillometric assessment of traumatic brain injury
JP6974452B2 (ja) アクセサリ装置及びイメージング装置
JP2010273954A (ja) 瞬目計測装置及び瞬目計測方法
KR101028999B1 (ko) 설진 영상 촬영장치 및 방법
JP5301815B2 (ja) 瞬目計測装置
KR101255146B1 (ko) 비가시광 형광신호의 실시간 가시화를 위한 형광영상의 획득투사장치
WO2013179178A1 (fr) Surveillance de la fatigue oculaire
JP5399777B2 (ja) 瞬目計測装置及び瞬目計測方法
Jansen et al. A torsional eye movement calculation algorithm for low contrast images in video-oculography
CN209437226U (zh) 一种高精准检测率的吸毒人员瞳孔检测仪

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13735074

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13735074

Country of ref document: EP

Kind code of ref document: A1