JP2006096316A - Monitoring device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a cabin monitoring device capable of adequately picking up an image of a driver's face without impairing the driver's visibility while driving a vehicle. <P>SOLUTION: The cabin monitoring device monitors the inside of a cabin by analyzing an image of the inside of the cabin picked up by an image pickup means 3. A reflection unit 2 which allows visible light to be transmitted and invisible light to be reflected is provided on a front side of a driver's seat, and an image pickup means 3 capable of picking up an image of an occupant by the invisible light reflected by the reflection unit 2 is provided. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention analyzes a vehicle interior image captured by an imaging unit, monitors the vehicle interior, and analyzes a user image captured by the imaging unit to monitor the user. Relates to the device.

As a vehicle driving support system, for example, a system that detects obstacles such as vehicles, people, and bicycles around the vehicle and warns the driver when there is a possibility of a collision has been put into practical use. This is useful for reducing In such a driving support system, in order to further improve safety, it is appropriate when the driver has already recognized an obstacle to be aware of and there is no need for an alarm, or when the driver's response is slow due to the physical condition of the driver, etc. In order to cope with this, it is desirable to determine the state of the driver and adjust whether to issue an alarm and the timing of the alarm based on the determined state. In order to prevent an accident due to the driver's falling asleep, it is desirable to detect the driver's falling asleep and issue an alarm.
Conventionally, as a driving support system for determining the state of a driver, a camera is installed in a room mirror for the driver to check the rear of the vehicle, and the state of the driver is determined by performing image processing on an image captured by the camera, There is a driving support system that issues an alarm based on this state (see, for example, Patent Document 1). In this driving support system, since the camera is installed in the rearview mirror, the driver's visibility is not disturbed, and the safety is not lowered by the installation of the camera.

JP 2000-264128 A

The determination of the state of the driver is performed, for example, by analyzing an image captured by the driver to detect the open / closed state of the driver's eyes and monitoring the eye closing time of the driver's eyes. In this case, in order to detect the open / closed state of the driver's eyes appropriately and with high accuracy, it is desirable to photograph the driver's face from the front so that the driver's eyes can be photographed satisfactorily.
However, in the system of Patent Document 1, since the camera is installed in the room mirror, when the driver is looking at the front window or the instrument panel, the driver's face is photographed from an oblique direction. . The driver who is driving has the longest time to look at either the front window or the instrument panel, so from the camera installed in the rearview mirror, the time to shoot the driver's face from the front is short, It becomes difficult to capture an image that can determine the state of the driver. For this reason, there has been a problem that it is difficult to properly and accurately grasp the state of the driver.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a vehicle interior monitoring device that can appropriately photograph a driver's face without impairing the visibility of the driver while driving. It is in.

In order to achieve this object, the vehicle interior monitoring device according to the present invention is characterized in that a vehicle interior monitoring device that analyzes an image of a vehicle interior photographed by a photographing means and monitors the vehicle interior, A reflection part that transmits and reflects invisible light is provided in front of the driver's seat, and is provided with photographing means that can capture an image of the occupant's invisible light reflected by the reflection part.
That is, according to the above-described characteristic configuration, since the reflection part is provided in front of the occupant, particularly the driver, an image from the front of the driver is reflected on the reflection part. You can shoot. Thereby, the state of the driving driver can be appropriately determined. Furthermore, since the reflecting part transmits visible light, the visibility of the driver during driving is not impaired by the installation of the photographing means, and the safety is not lowered. Moreover, since the invisible light reflected by the reflecting part is photographed, the degree of freedom of the place where the photographing means is installed can be increased.

Still another characteristic configuration is a vehicle interior monitoring device that analyzes an image of a vehicle interior imaged by an imaging unit and monitors the vehicle interior, wherein a reflection part that transmits invisible light and reflects visible light is provided at a driver's seat. In addition to being provided on the front, it is provided with photographing means capable of photographing an image of an occupant that has passed through the reflecting portion with invisible light.
That is, according to this characteristic configuration, since the image of the occupant that has passed through the reflection portion is captured by the invisible light, the reflection portion can be provided in front of the occupant. Therefore, such a vehicle interior monitoring apparatus can also photograph the entire face of the driver from the front, and can appropriately determine the state of the driver during driving.

  The vehicle interior monitoring device according to the present invention may be configured such that the photographing unit includes a shielding member that shields visible light. If configured in this way, the shielding member transmits visible light incident on the photographing unit. Since it is shielded, it is possible to improve the image quality of the driver image taken by the photographing means. For this reason, the image can be processed with high accuracy, and the state of the driving driver can be determined more appropriately and with high accuracy.

In order to achieve this object, the characteristic configuration of the monitoring apparatus according to the present invention is a monitoring apparatus that analyzes an image of a user photographed by photographing means and authenticates the user, and transmits visible light and transmits invisible light. And a photographing unit capable of photographing the user's invisible light reflected by the reflecting unit, and analyzing the image photographed by the photographing unit to authenticate the user. The authentication means to perform and the authentication assistance means to guide | indicate the direction of the said user's face to the said reflection part. Moreover, this monitoring apparatus can be applied to a state monitoring apparatus that monitors the state of a user.
That is, according to the above characteristic configuration, the user's face can be photographed from the front when photographing an image for performing user authentication. For this reason, authentication by image processing can be performed more reliably, which is useful for preventing theft of vehicles and authenticating ATM users.

1st Embodiment of the vehicle interior monitoring apparatus which concerns on this invention is described based on drawing.
As shown in FIG. 1, the vehicle interior monitoring apparatus of the present embodiment analyzes an image of the vehicle interior imaged by the imaging means 3, and reflects light that transmits visible light and reflects invisible light in order to monitor the vehicle interior. In addition to providing the unit 2 in front of the driver's seat, the imaging unit 3 includes an imaging unit 3 that can capture an image of an occupant reflected by the reflecting unit 2 using invisible light. Furthermore, the image analysis means (not shown) which performs image processing and determines the driving | running state of a driver, and the alarm means (not shown) which alerts based on the driving | running state of a driver are provided.

The image analysis means is built in the ECU (Electronic Control Unit), and analyzes the image taken by the photographing means 3 while the engine is running, detects the driver's blink, and estimates the driver's consciousness state from the blink. Monitor. Here, as a driver's consciousness state, doze is determined. Specifically, for example, the eyes of the driver are detected from the image photographed by the photographing means 3, and the open / closed state of the eyes is detected. The detection of the open / closed state is performed in comparison with the normal eye state of the driver, such as the eye state of an image taken at the time of boarding. Then, the driver's consciousness state is determined based on the eye closing time and the frequency thereof. For example, when the eye-closing time continues continuously for a predetermined time or more, it is determined that the patient is dozing. In other cases, it is determined that the eye is normal. Further, when the driver wears sunglasses or the like and it is difficult to catch the movement of the eyes, it is determined whether or not the entire face is moving moderately.

  The warning means issues a warning to the driver based on the driver's consciousness state determined by the image analysis means. For example, when it is determined by the image analysis means that the driver is falling asleep, an alarm for raising the driver is issued.

  Here, in a vehicle having a function of performing a collision warning to a driver based on an output from sensors that detect obstacles around the vehicle, the image analysis means responds to the driver's warning as the driver's consciousness state. It is also preferable to determine whether the quality is good or not, and the warning means performs a collision warning based on this. In this case, for example, the image analysis unit determines that the response to the driver's alarm is dull if the ratio of the driver's eye closing time is equal to or greater than a predetermined amount. If it is determined that the driver's response to the alarm is dull, the alarm means sets the timing of the collision alarm earlier than usual and responds to the driver's consciousness state. Furthermore, here, when a dozing and a collision warning are detected at the same time, a collision warning with a high degree of emergency is prioritized.

The reflector 2 is configured to transmit visible light having a wavelength of about 380 nm or more and about 680 nm or less, and to reflect invisible light having a wavelength of about 680 nm or more, that is, near infrared light. Furthermore, the reflection part 2 is provided in the front part of the driver's seat of the front window 1, and can reflect the front image of a driver to the imaging | photography means 3. FIG.
The light source necessary for photographing the vehicle interior may be natural light incident from the front window 1 of the vehicle. In addition, an auxiliary light source that irradiates the driver with near-infrared light of 680 nm or more corresponding to the photographing means 3 at an arbitrary position in the vehicle interior in the case where a sufficient amount of light for photographing the driver at night or the like cannot be obtained. It is good to arrange in.
In the present embodiment, the reflecting portion 2 is provided only in the front portion of the driver's seat of the front window 1. However, when there is a difference in front view at the boundary portion, the entire front window 1 is covered with the reflecting portion. 2 may be used.

  The imaging means 3 is an imaging device capable of capturing near infrared light, for example, a CCD (Charge Coupled Device), and captures an image of the occupant's near infrared light reflected by the reflector 2. Here, the image reflected by the reflecting unit 2 is a mirror image, but in the present embodiment, since the configuration is to detect blinking of the eyes, the mirror image is captured as it is. In addition, it is also a preferable embodiment that the imaging unit 3 is configured to reversely output the mirror image reflected by the reflecting unit 2 to the image analysis unit.

  Next, 2nd embodiment of the vehicle interior monitoring apparatus which concerns on this invention is described based on drawing. As shown in FIG. 2, the vehicle interior monitoring device of the present embodiment includes a visible light cut filter 4 as a shielding member that shields visible light in the photographing unit 3 of the first embodiment.

  The visible light cut filter 4 shields visible light having a wavelength of about 680 nm or less so that sunlight or the like that enters through the front window 1 from outside the vehicle compartment does not enter the photographing unit 3. With this configuration, it is possible to improve the image quality of an image shot by the shooting unit 3.

3rd Embodiment of the vehicle interior monitoring apparatus which concerns on this invention is described based on drawing.
In the first embodiment, the reflection part 2 is provided on the front window 1, but the reflection part 2 of this embodiment is provided on the front surface of the instrument panel 5 as shown in FIG. 3.

  The reflection unit 2 can form an image of the driver by invisible light from the front when the driver turns his face to the instrument panel 5. The photographing means 3 can photograph the driver from the front by photographing this image.

A fourth embodiment of the vehicle interior monitoring apparatus according to the present invention will be described.
The vehicle interior monitoring apparatus according to the present embodiment includes an authentication unit that performs authentication of the occupant by analyzing an image captured by the imaging unit 3 when the occupant gets on the vehicle, in addition to the reflection unit 2 and the imaging unit 3 of the third embodiment. (Not shown) and authentication assisting means (not shown) for directing the occupant's face to the reflecting portion 2 when the occupant takes a picture when the occupant gets on.

  When the occupant gets on the vehicle, for example, when the engine is started by an engine key, the authentication unit acquires an image of the driver's face from the photographing unit 3 and performs image processing on the image to authenticate the driver. If the driver is not authenticated, measures such as not starting the engine are taken to prevent the vehicle from being stolen.

  The authentication assisting unit causes the occupant's face to face the reflecting unit 2 prior to the photographing of the authentication image by the photographing unit 3. In this embodiment, since the reflection part 2 is provided in the instrument panel 5, for example, an LED (Light Emitting Diode) installed on the instrument panel 5 is blinked, or a sound is output using an alarm means. Thus, the occupant's face is directed toward the reflecting portion 2 by, for example, directing attention to the instrument panel 5. Thus, the face of the occupant can be photographed from the front, and the occupant can be authenticated more appropriately and reliably. When the reflection unit 2 is provided on the front window 1, the occupant's face is directed toward the front window 1 by voice guidance or the like. Furthermore, it is also preferable to use a voice prompt to remove sunglasses or the like when performing authentication.

[Other Embodiments]
<1> In the fourth embodiment, the authentication unit and the authentication auxiliary unit are applied to the vehicle. However, it is also a preferable embodiment to apply to an ATM monitoring device or the like.

  The reflection part 2 here is provided in the front surface of the liquid crystal of ATM which a user performs operation according to the transaction content. Since it can be said that the user takes the longest time to face the liquid crystal during the operation of the ATM, the reflection unit 2 is provided in front of the liquid crystal of the ATM so that the user's face can be reliably photographed.

  The photographing means 3 is configured to photograph an image of the user's face that is reflected in the reflection unit 2 when the user comes to a predetermined standing position in front of the ATM. Here, a surveillance camera installed in the ATM is used as the imaging means 3.

  The authentication unit obtains an image of the user's face from the photographing unit 3 and authenticates the user when the user starts using ATM, for example, when inputting a personal identification number. If the user is not authenticated, processing such as transaction stoppage or notification is performed.

  Prior to photographing by the photographing means 3, the authentication assisting means performs a display for prompting the user's attention on the liquid crystal so that the user's face is directed to the reflection unit 2 at the time of photographing, and the orientation of the user's face is indicated. Guide to the reflector 2.

  Note that the authentication assisting means of the present embodiment is a preferred embodiment in which the operation panel is configured to be visible only from the direction in which photographing by the photographing means can be performed appropriately, or may be configured to use audio output or the like. Moreover, you may provide the reflection part 2 in front of a user instead of the liquid crystal of ATM. The photographing means 3 may be a camera that regularly shoots at a predetermined time interval, or a surveillance camera that always shoots.

<2> The reflection unit 2 of the first to fourth embodiments is configured to transmit visible light having a wavelength of about 380 nm to about 680 nm and reflect near infrared light having a wavelength of about 680 nm or more. Further, it may be configured to reflect ultraviolet light of about 380 nm or less. Also in this case, natural light incident from the front window 1 of the vehicle or the like may be used as a light source necessary for photographing the vehicle interior. In addition, when a sufficient amount of light for photographing the driver at night or the like cannot be obtained, or when the window glass cuts ultraviolet rays, an auxiliary light source for irradiating the driver with ultraviolet light of 380 nm or less is provided. It is good to arrange at any position in the room.
In addition, it is also preferable to have a configuration including the reflection unit 2 in which the wavelength of visible light to be transmitted and the range of reflected near infrared light or ultraviolet light are different. In this case, the photographing means 3 capable of photographing the invisible light reflected by the reflecting unit 2 is selected and installed.
With this configuration, the driver's face can be photographed from the front, so that the driver's state can be determined appropriately and with high accuracy.

<3> Further, the reflection unit 2 of the first to fourth embodiments is configured to transmit visible light and reflect near-infrared light. However, as illustrated in FIG. It is also a preferred embodiment to provide the reflecting portion 2 that reflects the light in front of the driver's seat.

  The reflection unit 2 of the present embodiment is configured to transmit invisible light (near infrared light) having a wavelength of about 680 nm or more and to reflect visible light having a wavelength of about 380 nm to about 680 nm. It arrange | positions in the position where the instrument panel 5 is installed. The photographing means 3 is arranged behind the reflection unit 2. Since the reflecting unit 2 does not transmit visible light, the photographing unit 3 does not enter the eyes of the driver.

  The instrument panel 5 is arranged on the lower side of the reflection unit 2 so that the driver can visually recognize an image reflected on the reflection unit 2. In addition, the instrument panel 5 here may be comprised with the liquid crystal. In this case, since a correct image is formed on the reflector 2 as viewed from the occupant only by performing the process of inverting the display, it is necessary to create a display image or the like as a mirror image as in the case of installing an ordinary instrument. No.

  Note that the reflection unit 2 of the present embodiment may be a reflection unit 2 having a different wavelength of invisible light to be transmitted and a range of visible light to be reflected, and photographing means according to the wavelength of invisible light transmitted by the reflection unit 2. Select 3.

The figure which shows the structure of 1st embodiment of the vehicle interior monitoring apparatus which concerns on this invention. The figure which shows the structure of 2nd embodiment of the vehicle interior monitoring apparatus which concerns on this invention. The figure which shows the structure of 3rd embodiment of the vehicle interior monitoring apparatus which concerns on this invention. The figure which shows the structure of other embodiment <3> of the vehicle interior monitoring apparatus which concerns on this invention

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Front window 2 Reflecting part 3 Imaging | photography means 4 Visible light cut filter 5 Instrument panel

Claims (4)

A vehicle interior monitoring device that analyzes an image of a vehicle interior imaged by an imaging means and monitors the vehicle interior,
A reflective part that transmits visible light and reflects invisible light is provided in front of the driver's seat,
A vehicle interior monitoring device provided with photographing means capable of photographing an image of an occupant reflected by the reflecting portion by invisible light. A vehicle interior monitoring device that analyzes an image of a vehicle interior imaged by an imaging means and monitors the vehicle interior,
A reflective part that transmits invisible light and reflects visible light is provided in front of the driver's seat,
A vehicle interior monitoring device provided with photographing means capable of photographing an image of an invisible light of an occupant that has passed through the reflecting portion.   The vehicle interior monitoring device according to claim 1, wherein the photographing unit includes a shielding member that shields visible light. A monitoring device that analyzes an image of a user photographed by a photographing means and authenticates the user,
A reflector that transmits visible light and reflects invisible light;
Photographing means capable of photographing an image of the user reflected by the invisible light reflected by the reflection unit;
Authentication means for analyzing the image photographed by the photographing means and authenticating the user;
A monitoring device comprising authentication assisting means for guiding the orientation of the user's face to the reflecting portion.

Images