AU2006279257B2

AU2006279257B2 - Alertness sensing spectacles

Info

Publication number: AU2006279257B2
Application number: AU2006279257A
Authority: AU
Inventors: Aaron Brown; Murray Johns
Original assignee: Sdip Holdings Pty Ltd
Current assignee: Sdip Holdings Pty Ltd
Priority date: 2005-08-11
Filing date: 2006-08-10
Publication date: 2009-08-27
Anticipated expiration: 2026-08-10
Also published as: AU2006279257A1

Description

WO 2007/016739 PCT/AU2006/001131 ALERTNESS SENSING SPECTACLES This invention relates to spectacles used in monitoring eye and eyelid movement. Background to the invention 5 The detection of drowsiness is of importance because drowsiness impairs the ability of operators of a wide range of equipment including motor vehicles, aircraft and boats as well as industrial equipment. The problem of drowsy driving cannot be solved by educating drivers to take remedial action when feeling drowsy. The difficulty is that many people are unaware of their drowsiness before and during 10 the drowsiness even though they may be alert and aware after they rouse. This means one cannot predict when their level of drowsiness will next decrease to the point of danger because the drowsy state involves a loss of awareness of the present; an involuntary lapse of attention. USA patent 5745038 discloses an eye monitor that examines reflected light from 15 the eye to detect blinking behavior as an indicator of drowsiness. USA patent 6097295 discloses a system of image analysis based on eye pupil size. USA patent 6147612 discloses a system of preventing sleep which detects eyelid movement and actuates an alarm when the eyelid movement is indicative of 20 drowsiness. USA patent 6346887 uses a video based eye tracking system which tracks eye activity and pupil diameter and position to produce a signal representing eye activity that can be used to estimate alertness. WO 03/039358 disclosed an alertness monitor that used infra red light to measure 25 the amplitude and velocity of eyelid and eye movements to derive a measure of alertness on a scale that can be related to the scale of blood alcohol levels. This monitor sought to provide a real time alertness monitor that can provide a calibrated measure of the operator's alertness. The quality of the signals received from the light reflected off the eye and eyelid depends in part on the orientation of 30 the emitters and detectors. Adjustable frames for spectacles are known but generally are adjustable to accommodate the distance between the pupils and the distance between the mid point of the eyes and the bridge of the nose.

WO 2007/016739 PCT/AU2006/001131 2 USA patent 5583586 provides a support system for spectacles which spaces the frame from the cheek bones and brow of the wearer. Testing apparatus for examining eyes usually include fittings adjustable in several directions. 5 USA 4448501 discloses trial spectacles with means to vary the lens positions. USA 5499063 discloses an adjustable nose bridge and means to move the lenses. EP 567817discloses trial frames which allow adjustment in the plane parallel to the face and also away from the face. USA patent 4730898 provides a stereoscopic viewer with frames that allow the 10 device to be adjustable in length relative to the ears. USA patent 5971538 discloses a head mounted virtual reality display with an articulated nose bridge that allows the position of the display relative to the eyes to be adjustable. It is an object of this invention to provide spectacles for an eye monitoring system 15 of the type disclosed in WO 03/039358. Brief description of the invention To this end the present invention provides a spectacle frame for use in an eye monitoring system which includes 20 a) a nose bridge connecting a pair of ocular frames b) a sensor unit adjustably attached to said nose bridge said sensor unit incorporating a signal emitter and a signal detector recessed into the surface of the unit to reduce the proportion of signal received by said detector which is not from the signal emitter 25 reflected by the eye or eyelids c) said nose bridge incorporating an adjustment mechanism for adjusting the vertical position of said sensor unit relative to the eye d) a frame arm extending from the outer edge of each ocular frame adapted to fit over the ear of a wearer wherein one of said frame 30 arms incorporates a microprocessor for controlling the sensor unit. This invention is partly predicated on the discovery that the collection of reflected signals from the eye and eyelids depends on the vertical and horizontal spacing of WO 2007/016739 PCT/AU2006/001131 3 the emitter and detector from the eye as well as the arrangement of the emitter and detector relative to one another. The spectacles are preferably designed to be worn by vehicle drivers or machinery operators to measure their level of alertness or fatigue. The spectacles contain one 5 or more clusters of transducers called the sensor unit. The sensor unit is designed into the spectacles and positioned so the sensor signal is reflected from the driver's eyes. The signal emitters may be LED's or the terminal ends of optical fibres connected to a light source such as an LED. The preferred signal is light in the infra red wavelength region but any signal reflected from the eyelid or eye such 10 as ultrasound or another electromagnetic frequency band may be used. Due to the significant differences in human facial structure, the metrics need to be maintained from person to person through a process of fitment which allows the spectacles to be adjusted to a static position on each individual. This allows collection of quality eye movement data (EMD) on a fixed, stable platform whilst 15 being comfortable and unobtrusive to the vision of the user. The noses bridge needs to be adjustable both vertically and horizontally from the eye and this is achieved by adjusting the position of the bridge along the nose and then adjusting the height relative to the nose. This may be achieved by using a support for the bridge which is sized to suit the varying nose and eye positions in 20 the various facial types. In addition fine adjustments can be made to the sensor arm to adjust the sensor position relative to the nose bridge. The ocular frames secured to the nose bridge may contain prescribed optical lenses or sun protection lenses which can be elevated out of the line of sight without having to remove the spectacle frames so that the sensor position is not 25 disturbed while the spectacle frame is in use. In another embodiment this invention provides a spectacle frame for use in an eye monitoring system which includes a) a pair of ocular frames at least one of which carries a sensor unit adapted to be positioned adjacent an eye of the wearer 30 b) a nose bridge connecting said ocular frames and incorporating an adjustment mechanism for adjusting the vertical position of said sensor unit relative to the eye WO 2007/016739 PCT/AU2006/001131 4 c) a frame arm extending from the outer edge of each ocular frame adapted to fit over the ear of a wearer said frame arm being pivotally connected to said ocular member by a hinge that is adjustable d) said sensor unit incorporating a light (preferably infra red ) emitter and a 5 light (preferably infra red ) detector recessed into the surface of the unit to reduce the proportion of signal received by said detector which is not from the signal emitter reflected by the eye or eyelids. The electronics unit which controls the emitters and collects the data from the sensor may be located in the arm of the spectacle frame. This may be connected 10 by cable or wirelessly to a more complex processor and data recording and display unit. Alternatively the processing may be carried out in a processor located on the frame and the display may be an audible signal or voice indicating the wearers fatigue state. This display unit may be a black box type recording unit but may also display the wearer's state of alertness as described in WO 03/039358. 15 The frames of this invention are modified conventional spectacle frames and can incorporate optical lenses to compensate for visual impairment and may incorporate solar lenses for use in situations where conventional sunglasses are useful. They may also be used without any lenses. 20 Detailed Description of the Invention A preferred embodiment of the invention will now be described with reference to the drawings in which: Figure 1 is a rear view of the spectacles according to a first embodiment of the invention; 25 Figure 2 is a schematic view of the connection between the ocular frame and the frame arm; Figure 3 illustrates the relationship between the position of sensor unit and the eye; Figure 4 illustrates one embodiment of the nose bridge of this invention; 30 Figure 5 shows the nose bridge relative to the ocular frames; Figure 6 schematically illustrates the arrangement of the sensor unit; Figure 7 is an exploded view of the frame of this invention in a second embodiment; WO 2007/016739 PCT/AU2006/001131 5 Figure 8 is detailed view of figure 7; Figure 9 illustrates the interchangeability of the ocular lenses; Figure 10 illustrates the pivoting of the ocular lenses in the embodiment shown in figure 7; 5 Figure 11 is a rear view of the frame of figure 7 illustrating the attachment of the sensor arm; Figure 12 is a detail illustrating the sensor arm adjustment mechanism; Figure 13 illustrates the sensor pad unit with cable used in the embodiment of figure 7; 10 Figure 14 is a detailed view of the sensor pad; Figure 15 is a view of the sensor pod incorporating the sensor pad of figure 14; Figure 16 illustrates location of the embodiment of figure 7 relative to the nose and eyes of a wearer; Figures 17 A B and C illustrate 3 views of the frame of this invention incorporating 15 a nose adjustment piece ; Figures 18 A and B illustrates 2 views of the frame of this invention with a second nose adjustment piece ; Figures 19 A and B illustrates 2 views of the frame of this invention with a third nose adjustment piece. 20 The spectacles are part of a system of the type disclosed in patent specification WO 03/039358 the contents of which are incorporated herein by reference. In figure 1 the sensor assembly A is located on the lower portion of one ocular frame member. 25 The nose piece B connects the two ocular frame members and by way of the adjustable nose piece arm C allows the vertical location of the ocular frames. The adjustable frame arm hinge D allows movement of the ocular frames relative to the frame arm. 30 Figure 2 is a side view of frame arm showing hinge point A where arms can be bent and at B where frame arm can be bent up or down if required This invention is based on research which shows that the key metrics vital for good quality of signal (QOS) from the largest portion of the population depends on WO 2007/016739 PCT/AU2006/001131 6 the sensor angle relative to user's eye (Left) sensor position relative to frame (right) as shown in figure 3 in which: A - Angle at which sensor assembly points at eye relative to bottom of the frame B - Angle at which the sensor assembly is adjusted for each user through 5 changing the tilt on the frame C - X Distance between centre of pupil and sensor assembly D - Eye E - Sensor unit F - Distance from centre of frame to centre of sensor unit 10 G - Degree of wrap on frame to provide optimal vision for the user H - Toe in of sensor unit to counteract the wrap on the frame The above metrics (see figure 3) are adjusted to a fixed secure position with the key adjustment metrics: 15 2. Frame Adjust tilt of arm by bending at hinge point (see figure 1, D) a. Adjustment of arms to provide stable latching mechanism to the users head and comfort (As per standard optometrist fitting procedures) 3. Nose piece 20 a. Adjustment of sensor assembly relative to eye up/down to obtain the correct angle at the eye (see figure 3, A) b. Adjustment of sensor assembly relative to eye towards and away (see figure 2, B) 4. Sensor assembly 25 a. 2 different angles are used to obtain the greatest coverage across the population. (see figure 3, A) The frame provides a stable platform for maintaining a fixed static position for the sensor assembly in the correct location relative to the eye (see figure 1). The frame carries'the following key features for good QOS from the largest portion of 30 the population: 1. Tilt of frame (see figures 2 and 3, B) 2. Intraocular spacing of sensor assembly (see figure 3, F) 3. Frame wrap (see figure 3, G) WO 2007/016739 PCT/AU2006/001131 7 4. Adjustable nose piece with fixed locators (see figure 2, A) The nose piece sits in the centre of the frame (see figure 5 A) and provides one of the key fitment metrics. This is achieved through a fixed adjustable range provided by a series of holes on the adjustment plate with screws holding nose piece 5 securely in position (see figure 1, B). As shown in figure 4 the holes A allow adjustable, fixed positions for the adjustable metal nose pad arms B Nose bridge location on frame is shown in figure 4 in which A is a slot for nose piece to provide adjustment in the Y axis. 10 The nose bridge provides key fitment metrics to obtain good QOS from a user: 1 . Adjustment of sensor assembly relative to eye up/down by sliding the plate up and down (see figure 5, A) 2. Adjustment of sensor assembly relative to eye towards and away by bending nose pad arms (see figure 4, B). 15 Alternative systems for adjusting the nose piece are also within the scope of this invention. The sensor assembly is a plastic assembly which encapsulates the sensor S and emitters E in cavities within the frame with the following key features: 1. Creates an aperture for the sensor element S to collect targeted information 20 from the correct region for good QOS 2. The emitters are arranged at 2 angles to cover largest portion of population 3. 3% carbon filled ABS plastic is used to absorb IR light and prevent leakage of IR light from the emitter cavities to sensor cavities. The emitters provide pulses of invisible IR light (wavelength 940 nm) from an LED 25 positioned about 13 +/-3 mm below and 12 +/- 3 mm in front of the eye, housed in a frame that could also hold prescription lenses or sunglasses, if needed (Fig 1). The IR pulses are brief (< 100 microsec) and repeated at a frequency of 500 Hz. They are directed up in a 30 degree beam centered on the lower edge of the upper eyelid. The total IR light reflected back from the eye and eyelids is detected by the 30 matched phototransistor beside the LED. In the embodiment of the invention illustrated in figures 7 to 16 the frame consists of ear stems 11 and 12. These may be of the wrap around type to maintain a , stable position on the wearers head. An elastic strap may also be used to secure WO 2007/016739 PCT/AU2006/001131 8 the frame to the head. The ear stem.12 incorporates an electronics module 13 which includes a microprocessor connected by a cable 29 to the sensor pad 26 shown in detail in figure 14. The ocular frame 14 incorporates a central nose bridge 15. The lenses are secured to lens attachment unit 16. The lenses may be 5 of any type including prescribed lenses or sun protection lenses and may be clear or tinted as shown in figure s 9A and B. The unit 16 incorporates pivot pins 17 cooperating with pin recesses17A that enable the lenses to be flipped up as shown in figure 10. The pins are shaped to provide two stable positions namely parallel to the face and at right angles to the face when flipped up. A nose adjustment piece 10 30 is attached to the unit 16. The attachment piece 30 comes in a range of incrementally changing sizes to suit a range of facial and nose types. The sensor arm 20 has attachment portion 22 at one end which is secured to the unit 16 by screw 19 and the sensor pod 24 at its other end. The slot 18 in unit 16 provides a number of vertical positions for the sensor arm attachment so that the 15 position of the sensor pod 24 can be adjusted relative to the eye. The sensor pad 26 is fitted to the pod 24 so that the sensors are resiliently mounted in the pod. The sensor pad consists of the emitters 27 and the receiver/detector 28. Each emitter 27 and detector 28 is individually mounted on a resilient finger. 20 The sensor pod 24 may be rotated through 100 of arc to further adjust the sensors relative to the eye. The sensor pod 24 or sensor arm 20 may be of variable length to suit a range of eye widths. The position of the frame relative to the face is adjusted by selecting a nose piece 30 from a range of nose pieces. In figures 17 -19 three nose pieces 30 are shown 25 which explain the incremental adjustments which can be made. Figure 17 illustrates a base nose support 30 while figure 18 illustrates a nose support with an incremental vertical adjustment 31. Figure 19 illustrates the nose piece with an incremental horizontal adjustment 32 to place the frame further away from the face. By using combinations of one or more of the incremental vertical and 30 horizontal adjustments a wide range of facial types can be accommodated. In the embodiment shown in figures 7 to 16 a microprocessor 13 housed in the arm 12 of the glasses controls the timing, duration and intensity of IR pulses, and digitizes the analogue output from the sensor (0 to 3.3 volts). The digital output WO 2007/016739 PCT/AU2006/001131 9 from the glasses is sent via a light cable either to a bench-top processing unit for laboratory experiments, or to a unit installed in a vehicle for use while driving. The digitized output from the phototransistor represents the amount of IR light reflected back from the eye and eyelids. This is influenced by several factors, such as the 5 shape and reflectance of the reflecting surface (highly pigmented skin reflects less than white skin). The surface of the cornea is approximately spherical and about 10 mm in diameter. As it rotates with eye movements, the angle of the reflecting surface of the eye changes in relation to the sensor. However, the major factor affecting the amount of reflected light that is measured is the distance between the 10 reflecting surface and the sensor. This changes with corneal movement in any direction, and also with eyelid closure. It is this changing proximity of the reflecting surface in relation to the sensor that forms the basis of the system as described in WO 03/039358 for monitoring eye and eyelid movements. Differences in the reflectance of the cornea, iris, scleral conjunctiva, and the skin of the eyelids are 15 also involved but they are probably less important than previously assumed. Software developed specifically for the system as described in WO 03/039358 uses period-amplitude analysis of both the position and velocity signals to derive a wide range of variables characterizing eye and eyelid movements. In fitting the frames to each user a technician needs to be guided by the quality of 20 the signal received from the detector to ensure that the fitting will ensure that analyzable signals are being received. The technician selects an appropriate nose piece 30 and the adjusts the sensor arm 20 until an optimum signal is received. Those skilled in the art will realize that this invention provides a practical and convenient spectacle frame for collecting eye movement data. Those skilled in the 25 art will also realize that the spectacle frames may be arranged in other embodiments apart from those described without departing from the core teachings of this invention.

Claims

1. A spectacle frame for use in an eye monitoring system of the type having a pair of ocular frames connected by a nose bridge and frame arms 5 extending from the outer edge of each ocular frame adapted to fit over the ear of the wearer and an eyelid sensor unit associated with said spectacle frames characterized in that the sensor unit is designed to detect both eye and eyelid movement and is adjustably attached to said nose bridge which incorporates an adjustment mechanism for adjusting the vertical position of 10 said sensor unit relative to the eye and said sensor unit incorporates a signal emitter and a signal detector recessed into the surface of the unit to reduce the proportion of signal reflected by the eye or eyelids, received by said detector, which is not from the signal emitter. 15

2. A spectacle frame as claimed in claim 1 in which the adjustment mechanism includes a variably sized component that supports the nose bridge on the nose of the wearer.

3. A spectacle frame as claimed in claim 1 in which the sensor unit is 20 mounted on the free end of an arm which is attachable at its other end to a range of locations on the nose bridge to fine tune the positioning of the sensor unit relative to the eye.

4. A spectacle frame as claimed in claim 1 in which one of said frame arms 25 incorporates a microprocessor for controlling the sensor unit and the sensor unit is connected to the microprocessor by a cable located in the ocular frame and frame arm containing the microprocessor.

5. A spectacle frame as claimed in claim 1 in which the sensor unit includes 30 at least one infra red emitter and one collector of reflected infra red light. 11

6. A spectacle frame as claimed in claim 5 in which there are two infra red emitters and one infra red sensor which are set into recesses in the ocular frame. 5

7. A spectacle frame as claimed in claim 6 in which the frame material around the sensor unit absorbs infra red wavelengths. 10