JP2019122459A - Detection device and program - Google Patents

Abstract

To detect a sign on deterioration of a subject's driving ability more easily and accurately.SOLUTION: A detection device includes: an eyeball movement measuring unit for measuring an eyeball movement of a subject driving a mobile body; a head movement measuring unit for measuring a movement of the head of the subject; and a sign detection unit for detecting a sign on deterioration of the subject's driving ability on the basis of the measured eyeball movement and head movement. A program causes a computer to function as a detection device equipped with the eyeball movement measuring unit for measuring an eyeball movement of a subject driving a mobile body, the head movement measuring unit for measuring a movement of the head of the subject, and the sign detection unit for detecting a sign on deterioration of the subject's driving ability on the basis of the measured eyeball movement and head movement.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a detection device and a program.

  In recent years, many devices have been developed to make predictions regarding the motion and condition of a subject. For example, Patent Document 1 discloses a system that determines the awake state of a driver who drives a vehicle based on the measured eye movement or head movement of the driver.

JP, 2010-128649, A

  However, in the system described in Patent Document 1, in order to determine the arousal state, widely collect information related to the driving situation including the inter-vehicle distance with the vehicle ahead as well as the eye movement and head movement of the driver. Is required.

  Therefore, the present invention has been made in view of the above problems, and provides a novel and improved detection device and program capable of detecting a sign related to a decrease in the driving ability of a subject more simply and accurately. It is to provide.

  According to an aspect of the present invention, in order to solve the above problems, an eye movement measurement unit that measures the eye movement of a subject driving a moving body, a head movement measurement unit that measures the head movement of the subject, and A detection apparatus is provided, comprising: a sign detection unit that detects a sign related to a decrease in the driving ability of the subject based on the measured eye movement and the head movement.

  The sign detection unit may detect a sign related to sleepiness of the subject based on the speed of the eye movement and the speed of the head movement.

  Further, the sign detection unit may detect a sign related to the sleepiness of the subject based on the fact that the ratio of the speed of the eye movement to the speed of the head movement falls below a threshold.

  The sign detection unit may detect a sign related to sleepiness of the subject based on the fact that the residual standard deviation related to the ratio of the speed of the eye movement and the speed of the head movement exceeds a threshold. .

  The sign detection unit may detect a sign related to sleepiness of the subject based on the vital sign of the subject.

  Further, in order to solve the above-mentioned problems, according to another aspect of the present invention, a computer is used to measure an eye movement measurement unit for measuring eye movement of a subject driving a moving body, and head movement of the subject. To function as a detection device including a head movement measurement unit, and a sign detection unit that detects a sign related to a decrease in the driving ability of the subject based on the measured eye movement and the head movement Programs are provided.

  As described above, according to the present invention, it is possible to detect a sign related to a decrease in the driving ability of a subject more simply and accurately.

It is a figure for explaining measurement of eye movement and head movement by a sign detection method concerning one embodiment of the present invention. It is a block diagram showing an example of functional composition of a detecting device concerning one embodiment of the present invention. It is a flowchart which shows the flow of drowsiness precursor detection by the detection apparatus which concerns on one Embodiment of this invention. It is a block diagram showing the example of hardware constitutions of the detecting device concerning one embodiment of the present invention.

  The present invention will now be described more fully with reference to the accompanying drawings, in which exemplary embodiments of the invention are shown. In the present specification and the drawings, components having substantially the same functional configuration will be assigned the same reference numerals and redundant description will be omitted.

<1. Embodiment>
<< 1.1. Overview >>
First, the outline of the present invention will be described. As described above, in recent years, a large number of apparatuses for performing prediction relating to the motion or state of a subject have become widespread. Such devices include, for example, devices that predict drowsiness of a subject driving a vehicle. According to the device, it is possible to urge sleepy subjects to take an early break, etc., and the effect of securing the safety of the subjects and their surroundings is expected.

  However, many of the devices for detecting the sleepiness of the subject use the information related to the driving condition of the vehicle by the subject for the determination of sleepiness detection. Examples of the information related to the driving condition include steering angle information, vehicle speed information, accelerator opening information, brake information, and information related to an inter-vehicle distance to a preceding vehicle.

  In addition, drowsiness detection of the subject based on the above information is information on the shape and topography of the road on which the vehicle travels to determine whether the driving situation by the subject is appropriate for the traffic situation. It is required to collect a lot of information, such as information of vehicles traveling around.

  For this reason, in the drowsiness detection by the above apparatus, there has been a tendency that the operation cost for comprehensively processing various information and the cost for arranging a sensor for collecting various information increase.

  The present technical concept is conceived focusing on the above points, and makes it possible to detect a sign related to a decrease in the driving ability of a subject more simply and accurately. To this end, a detection apparatus according to an embodiment of the present invention includes an eye movement measurement unit that measures an eye movement of a subject driving a moving body, a head movement measurement unit that measures a head movement of the subject, and One feature of the present invention is to provide a sign detection unit that detects a sign related to the decrease in the driving ability of the subject based on the eye movement and the head movement that are performed.

  More specifically, the detection device according to the present embodiment may detect a sign related to sleepiness of the subject based on the speed of eye movement and the speed of head movement.

  Here, first, the characteristics of eye movement and head movement which change due to sleepiness will be described. Eye movements of animals including humans include voluntary movements as well as involuntary movements induced by visual and vestibular sensory stimuli. The above involuntary movement includes, for example, vestibular oculoocular reflex (VOR: Vestibulo-Ocular Reflex) induced by head movement.

  VOR is a reflection that causes the eyeball to rotate in the direction opposite to the head rotation based on the information related to the head rotation detected by the semicircular canal of the inner ear. The magnitude and timing of VOR with respect to stimulation are also used for evaluation of a subject's motor control ability.

  Also, VOR is known to exhibit characteristics closely related to sleepiness. As described above, VOR is a type of eye movement induced by head movement, and is defined by the ratio of the rotational angular velocity of head movement to the rotational angular velocity of eye movement in the normal state of human arousal. The VOR gain is approximately 0.8 to 1.0.

  On the other hand, it is known that the VOR gain is gradually reduced from the above range when the subject's motor control ability is reduced due to drowsiness or anesthesia medication. This indicates that the subject's drowsiness can be detected with high accuracy only from head movement and eye movement.

  Therefore, in the sign detection method according to the present embodiment, the subject's head movement and eye movement are measured, the ratio of the speeds of both movements, that is, the VOR gain is calculated and the transition is continuously observed. You may detect signs related to sleepiness.

  FIG. 1 is a diagram for explaining measurement of eye movement and head movement by the sign detection method according to the present embodiment. FIG. 1 shows an arrangement example of a configuration in the case where a sign related to a decrease in driving ability of a subject D driving a vehicle, in particular, a sign related to drowsiness is detected in a noncontact manner.

  As shown in FIG. 1, in the sign detection method according to the present embodiment, the irradiation unit 110 and the light receiving unit 120 for measuring the movement of the eye E of the subject D and the head for measuring the movement of the head H The motion measurement unit 140 is disposed in the vehicle compartment.

  The detection device 10 according to the present embodiment measures the eye movement by imaging the eye E by receiving the near infrared light emitted by the irradiation unit 110 and reflected by the eye E of the subject D by the light receiving unit 120. It is possible. The irradiation unit 110 and the light receiving unit 120 according to the present embodiment may be disposed, for example, in a meter hood provided in a driver's seat or on the top surface of a steering column, as shown in FIG. According to the above arrangement, it is possible to measure the eye movement of the subject D in a noncontact manner, and it is possible to eliminate the troublesomeness associated with the attachment of the contact measurement device.

  In addition, the detection device 10 according to the present embodiment can measure the head motion of the subject D based on, for example, the moving image of the head H of the subject D captured by the head motion measurement unit 140. is there. The head movement measurement unit 140 according to the present embodiment may be disposed, for example, on the ceiling of the driver's seat, as shown in FIG. According to the head movement measurement unit 140 according to the present embodiment, the head movement of the subject D can be measured in a non-contact manner, and it is troublesome to attach the contact type device using a gyro sensor, an acceleration sensor, etc. Can be eliminated.

  As described above, according to the detection device 10 according to the present embodiment, the eye movement and head movement of the subject are measured in a noncontact manner, and the drowsiness of the subject is measured based on the VOR gain defined by the speed ratio of both movements. It is possible to accurately detect the sign related to Further, according to the above-described sign detection method according to the present embodiment, since drowsiness sign can be detected only from the eye movement and the head movement, the arrangement cost of the sensor for acquiring the driving situation, and the acquisition by the sensor It is possible to greatly reduce the calculation cost using the information.

<< 1.2. Functional configuration example of detection device 10 >>
Next, a functional configuration example of the detection device 10 according to an embodiment of the present invention will be described in detail. FIG. 2 is a block diagram showing an example of a functional configuration of the detection device 10 according to the present embodiment. Referring to FIG. 2, the detection device 10 according to the present embodiment includes an irradiation unit 110, a light reception unit 120, an eye movement measurement unit 130, a head movement measurement unit 140, a vital sign measurement unit 150, and a sign detection unit 160. .

(Irradiator 110)
The irradiation part 110 which concerns on this embodiment irradiates near infrared light with respect to a test subject's eyeball. For this reason, the irradiation part 110 which concerns on this embodiment is provided with infrared light LED (Light Emitting Diode) etc. which can irradiate near infrared light.

(Light receiving unit 120)
The light receiving unit 120 according to the present embodiment receives at least a part of near-infrared light emitted by the irradiating unit 110 and reflected by the eyeball of the subject, and captures an image of the eyeball. The light receiving unit 120 according to the present embodiment is realized by an infrared camera or the like.

(Eye movement measurement unit 130)
The eye movement measurement unit 130 according to the present embodiment has a function of measuring the eye movement of the subject based on the image of the eye taken by the light receiving unit 120. The eye movement measurement unit 130 performs image processing on the image, for example, and measures an angular velocity and the like related to the rotation of the eye.

(Head movement measurement unit 140)
The head movement measurement unit 140 according to the present embodiment measures the head movement of the subject. For example, as described with reference to FIG. 1, the head movement measurement unit 140 may perform image processing on the head image of the captured subject and calculate the amount of fluctuation of the head position between the images. In addition, the head movement measurement unit 140 according to the present embodiment may detect head movement of the subject using a distance measurement sensor using infrared light, microwaves, Doppler waves or the like.

(Vital sign measurement unit 150)
The vital sign measurement unit 150 according to the present embodiment detects vital signs such as the pulse, temperature, respiration, and blood pressure of the subject. To this end, the vital signs measurement unit 150 according to the present embodiment includes various sensors for measuring vital signs as described above.

(The sign detection unit 160)
The sign detection unit 160 according to the present embodiment relates to the decrease in the exercise ability of the subject based on the eye movement measured by the eye movement measurement unit 130 and the head movement measured by the head movement measurement unit 140. It has a function of detecting a sign. More specifically, the sign detection unit 160 may particularly detect a sign related to drowsiness based on the eye movement speed and the head movement speed. The details of the function of the sign detection unit 160 according to the present embodiment will be described later separately.

  Heretofore, a functional configuration example of the detection device 10 according to an embodiment of the present invention has been described. The above configuration described with reference to FIG. 2 is merely an example, and the functional configuration of the detection device 10 according to the present embodiment is not limited to such an example. The functional configuration of the detection device 10 according to the present embodiment can be flexibly deformed according to the specification and the operation.

<< 1.3. Details of Sign Detection >>
Next, the detection of the drowsiness predictor by the predictor detection unit 160 according to the present embodiment will be described in detail. As described above, the sign detection unit 160 according to the present embodiment can detect a sign related to drowsiness based on the speed of eye movement and the speed of head movement.

  At this time, the sign detection unit 160 according to the present embodiment continuously calculates, for example, the VOR gain defined by the velocity ratio of the eye movement and the head movement, and based on the VOR gain falling below the threshold, the test subject You may detect signs of sleepiness related to According to the above-described function of the sign detection unit 160 according to the present embodiment, it is possible to detect the sign of sleepiness simply and with high accuracy, using only information related to the eye movement and head movement of the subject.

  Further, the sign detection unit 160 may detect the sleepiness sign of the subject based on data other than the VOR gain. For example, residual standard deviations relating to the ratio of eye movement velocity to head movement velocity can also be used to determine drowsiness predictors. Specifically, it is known that the above-mentioned residual standard deviation increases when the subject's motor control ability is reduced due to sleepiness.

  Therefore, the sign detection unit 160 according to the present embodiment continuously calculates the residual standard deviation related to the ratio of the velocity of eye movement to the velocity of head movement, and the residual standard deviation exceeds the threshold. Based on that, it is possible to detect a sign related to the sleepiness of the subject.

  As described above, the sign detection unit 160 according to the present embodiment can detect the sleepiness sign of the subject based on various indices obtained from the eye movement speed and the head movement speed. In addition, the sign detection unit 160 according to the present embodiment may learn the eye movement and the relationship between head movement and the sleepiness sign using a neural network or the like.

  The sign detection unit 160 is, for example, data obtained by measuring the eye movement and head movement data measured within several minutes to several tens of minutes after the subject starts driving the vehicle without sleepiness. It is also possible to learn for each subject the tendency concerning the transition of the VOR gain and the residual standard deviation after that assuming that there is. According to the learning function of the precursor detection unit 160, an effect of improving robustness related to the detection of the sleepiness precursor is expected.

  In addition to the measurement values related to the eye movement and the head movement, the sign detection unit 160 according to the present embodiment may perform sleepiness sign detection based on the vital sign of the subject measured by the vital sign measurement unit 150. The above vital signs include, for example, the subject's pulse, body temperature, respiration, blood pressure and the like.

  In this case, in addition to the measured values relating to the eye movement and the head movement indicating the subject's drowsiness sign, the sign detection unit 160 detects the drowsiness sign from each or a combination of vital signs. Based on it, it may be determined that the subject is very likely to have drowsiness.

  Further, the sign detection unit 160 may separately perform sleepiness sign detection based on the VOR gain, the residual standard deviation, and each vital sign, and may perform final determination by weighting the result for each item. .

  At this time, since the accuracy of drowsiness precursor detection based on the VOR gain and the residual standard deviation is expected to be very high compared to the accuracy of drowsiness precursor detection based on vital signs, the precursor detection unit 160 The weight of the detection result based on the gain and the residual standard deviation may be set high, and the weight of the detection result based on each vital sign may be set low.

  As described above, according to the sign detection unit 160 according to the present embodiment, it is possible to detect the sleepiness sign of the subject in a simple and highly accurate manner based on the eye movement and the head movement of the subject. Further, the sign detection unit 160 can further improve detection accuracy by performing sleepiness sign detection using a machine learning method and vital signs in combination.

<< 1.4. Flow of operation >>
Next, the flow of drowsiness precursor detection by the detection device 10 according to an embodiment of the present invention will be described in detail. FIG. 3 is a flowchart showing the flow of drowsiness predictor detection by the detection device 10 according to the present embodiment.

  Referring to FIG. 3, first, measurement of eye movement by the eye movement measurement unit 130 and measurement of head movement by the head movement measurement unit 140 are performed in parallel (S1101). At this time, the eye movement measurement unit 130 can control the irradiation unit 110 and the light receiving unit 120, and can measure the speed of eye movement and the like based on the image of the eye of the subject captured by the light receiving unit 120. The head movement measurement unit 140 may also measure the speed of head movement based on a moving image or the like obtained by imaging the subject's head.

  Further, the vital sign measurement unit 150 may detect the vital sign of the subject in parallel with the measurement of the eye movement and the head movement in step S1101 (S1102). Under the present circumstances, vital sign measurement part 150 can measure a test subject's pulse by non-contact type using a Doppler wave etc., for example, and can measure a test subject's body temperature non-contact type by an infrared light sensor etc. is there.

  Next, the sign detection unit 160 according to the present embodiment calculates the VOR gain and the residual standard deviation based on the eye movement and the head movement measured in step S1101 (S1103).

  Subsequently, the sign detection unit 160 detects a sign related to the sleepiness of the subject based on the VOR gain and the residual standard deviation calculated in step S1103 and the vital sign of the subject measured in step S1102 (S1104). At this time, the sign detection unit 160 may detect the drowsiness sign of the subject based on the fact that the VOR gain has fallen below the threshold or that the residual standard deviation has exceeded the threshold.

  In addition, the detection device 10 may continuously execute the processing in steps S1101 to S1104 from the start of the driving of the vehicle by the subject until the end of the driving.

  The flow of drowsiness precursor detection by the detection device 10 according to the present embodiment has been described above in detail. In addition, although the detection apparatus 10 described the case where the sign which concerns on a subject's drowsiness was mainly described in the above, the detection apparatus 10 which concerns on this embodiment becomes a fall factor of a driving ability other than sleepiness. It is possible to perform precursor detection related to various events.

  For example, seizures of chronic diseases such as epilepsy, fainting due to anemia, and cerebral infarction are assumed to be factors of the above-mentioned driving ability. For example, in an epileptic seizure, when the frontal lobe eye movement area has a seizure focal point, it is known that a directed seizure occurs such that the eye and head rotate on the opposite side of a lesion.

  In addition, in the case of fainting due to anemia or the like, characteristic eye movements such as rotation may occur, and in the case of cerebral infarction, symptoms such as paralysis of one eye may appear.

  Therefore, the precursory detection unit 160 according to the present embodiment compares the characteristic behavior of eye movement and head movement related to the above events with the measured behavior of eye movement and head movement. Thus, it is possible to cope with the detection of signs other than sleepiness.

<2. Hardware configuration example>
Next, a hardware configuration example of the detection apparatus 10 according to an embodiment of the present invention will be described. FIG. 4 is a block diagram showing an example of the hardware configuration of the detection apparatus 10 according to the present invention. Referring to FIG. 4, the detection device 10 includes, for example, a CPU 871, a ROM 872, a RAM 873, a host bus 874, a bridge 875, an external bus 876, an interface 877, an input unit 878, and an output unit 879. A storage unit 880, a drive 881, a connection port 882, and a communication unit 883 are included. Note that the hardware configuration shown here is an example, and some of the components may be omitted. In addition, components other than the components shown here may be further included.

(CPU 871)
The CPU 871 functions as, for example, an arithmetic processing unit or a control unit, and controls the overall operation or a part of each component based on various programs recorded in the ROM 872, the RAM 873, the storage unit 880, or the removable recording medium 901. .

(ROM 872, RAM 873)
The ROM 872 is a means for storing a program read by the CPU 871, data used for an operation, and the like. The RAM 873 temporarily or permanently stores, for example, a program read by the CPU 871 and various parameters appropriately changed when the program is executed.

(Host bus 874, bridge 875, external bus 876, interface 877)
The CPU 871, the ROM 872, and the RAM 873 are mutually connected via, for example, a host bus 874 capable of high-speed data transmission. On the other hand, host bus 874 is connected to external bus 876, which has a relatively low data transmission speed, via bridge 875, for example. Also, the external bus 876 is connected to various components via an interface 877.

(Input unit 878)
For the input unit 878, for example, a mouse, a keyboard, a touch panel, a button, a switch, a microphone, a lever, and the like are used. Furthermore, as the input unit 878, a remote controller (hereinafter, remote control) capable of transmitting a control signal using infrared light or other radio waves may be used. Further, the input unit 878 includes an imaging element, and a receiving element related to radar and LIDAR.

(Output unit 879)
The output unit 879 is, for example, a display device (display device) such as a CRT (Cathode Ray Tube), an LCD, or an organic EL, an audio output device such as a speaker or a headphone, a printer, a mobile phone, or a facsimile Can be notified to the user visually or aurally. In addition, the output unit 879 may include various radars as described above, LIDAR, and the like.

(Storage unit 880)
The storage unit 880 is a device for storing various data. As the storage unit 880, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like is used.

(Drive 881)
The drive 881 is a device that reads information recorded on a removable recording medium 901 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, or writes information on the removable recording medium 901, for example.

(Removable recording medium 901)
The removable recording medium 901 is, for example, a DVD medium, a Blu-ray (registered trademark) medium, an HD DVD medium, various semiconductor storage media, and the like. Of course, the removable recording medium 901 may be, for example, an IC card equipped with a non-contact IC chip, an electronic device, or the like.

(Connection port 882)
The connection port 882 is, for example, a port for connecting an externally connected device 902 such as a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface), an RS-232C port, or an optical audio terminal. is there.

(Externally connected device 902)
The external connection device 902 is, for example, a printer, a portable music player, a digital camera, a digital video camera, an IC recorder, or the like.

(Communication unit 883)
The communication unit 883 is a communication device for connecting to the network 903. For example, a communication card for wired or wireless LAN, Bluetooth (registered trademark) or WUSB (Wireless USB), a router for optical communication, ADSL (Asymmetric) It is a router for Digital Subscriber Line, or a modem for various communications. Also, it may be connected to a telephone network such as an extension telephone network or a mobile telephone carrier network.

<3. Summary>
As described above, the detection apparatus according to an embodiment of the present invention includes an eye movement measurement unit that measures eye movement of a subject driving a moving object, a head movement measurement unit that measures head movement of the subject, and One feature of the present invention is the provision of a sign detection unit that detects a sign related to the decrease in the driving ability of the subject based on the measured eye movement and head movement. According to the configuration, it is possible to detect the sign related to the decrease in the driving ability of the subject more simply and with high accuracy.

  Although the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, the present invention is not limited to such examples. It is obvious that those skilled in the art to which the present invention belongs can conceive of various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also fall within the technical scope of the present invention.

  In addition, the effects described in the present specification are merely illustrative or exemplary, and not limiting. That is, the technology according to the present disclosure can exhibit other effects apparent to those skilled in the art from the description of the present specification, in addition to or instead of the effects described above.

  Moreover, each step concerning processing of detection device 10 of this specification does not necessarily need to be processed in chronological order according to the order described in the flowchart. For example, the steps involved in the processing of the detection device 10 may be processed in an order different from the order described in the flowchart, or may be processed in parallel.

  In addition, it is possible to create a program for exerting the same function as the configuration of the detection device 10 in hardware such as CPU, ROM, and RAM built in the computer, and the computer can read the program. Recording media may also be provided.

Reference Signs List 10 detection apparatus 110 irradiation unit 120 light receiving unit 130 eye movement measurement unit 140 head movement measurement unit 150 vital sign measurement unit 160 precursor detection unit

Claims (6)

An eye movement measurement unit which measures eye movement of a subject driving the moving body;
A head movement measurement unit that measures the head movement of the subject;
A sign detection unit that detects a sign related to a decrease in the driving ability of the subject based on the measured eye movement and the head movement;
And a detection device. The sign detection unit detects a sign related to sleepiness of the subject based on the speed of the eye movement and the speed of the head movement.
The detection device according to claim 1. The sign detection unit detects a sign related to sleepiness of the subject based on the fact that the ratio of the speed of the eye movement to the speed of the head movement falls below a threshold.
The detection device according to claim 2. The sign detection unit detects a sign related to sleepiness of the subject based on a residual standard deviation related to a ratio of the speed of the eye movement to the speed of the head movement exceeding a threshold.
The detection device according to claim 2 or 3. The sign detection unit detects a sign related to the sleepiness of the subject based further on the vital sign of the subject.
The detection apparatus according to any one of claims 1 to 4. Computer,
An eye movement measurement unit which measures eye movement of a subject driving the moving body;
A head movement measurement unit that measures the head movement of the subject;
A sign detection unit that detects a sign related to a decrease in the driving ability of the subject based on the measured eye movement and the head movement;
Equipped with
Detection device,
Program to function as.

Images