JP2013095315A - Inside rear view mirror device with built-in imaging device, and vehicle equipped with the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a compact inside rear view mirror device with a built-in imaging device, configured to detect foreign objects deposited on a windshield of a vehicle and to image surroundings of the vehicle.SOLUTION: The inside rear view mirror device with a built-in imaging device is provided with: a stay member 301 fixed in a vehicle 100; a casing part 302 supported rotatably by the stay member 301 and covering a reflection mirror 303 while exposing a reflecting face 303a; and a casing part 304 fixed by the stay member 301 and housing an imaging device 201. The imaging device 201 has at least two light sources irradiating light toward a windshield 105 of the vehicle 100, an imaging element having a plurality of pixel arrays, an imaging lens condensing incident light from a windshield 105 to the imaging element, and an optical filter disposed between the imaging lens and the imaging element. A focal point of the imaging lens is set farther than a position of an outer wall surface 105b of the windshield 105.

Description

  The present invention relates to a room mirror device with a built-in imaging device that optically detects foreign matter adhering to the surface of a windshield of a vehicle and a vehicle including the same.

  In recent years, raindrop sensors that optically detect the presence or absence of raindrops have been mounted on vehicles such as automobiles (see, for example, Patent Document 1). Such a raindrop sensor is used, for example, in a system that removes raindrops attached to a windshield of a vehicle with a wiper.

  The raindrop sensor disclosed in Patent Document 1 is disposed in close contact with an inner wall surface of a vehicle windshield via a transparent adhesive layer. The raindrop sensor includes a light emitting element and a light receiving element, and optical means (prism and lens) for guiding light from the light emitting element to the windshield and guiding reflected light from the windshield to the light receiving element.

  The raindrop sensor configured as described above can detect raindrops adhering to the outer wall surface of the windshield by measuring a change in the amount of light generated in the light receiving element in accordance with whether or not the raindrop adheres to the outer wall surface of the windshield. It is like that.

  However, since the conventional raindrop sensor disclosed in Patent Document 1 needs to be placed in close contact with the windshield, there is a problem that the detection area of the raindrop is narrow and the detection accuracy is insufficient accordingly. In order to solve such a problem, it is conceivable to increase the detection accuracy by increasing the raindrop detection area. In this case, it is necessary to enlarge the optical system of the raindrop sensor. That is, the detection accuracy and the size of the raindrop sensor are in a trade-off relationship.

  In addition, when the size of the raindrop sensor increases, there is a problem in that the driver's field of view is obstructed or a psychological pressure is felt on the driver's head.

  Furthermore, in recent vehicles, an imaging device is installed in the vicinity of the inner wall surface of the windshield for shooting the vehicle running conditions and obstacle information to warn the driver and to control the vehicle. Yes. For this reason, there exists a problem that it becomes difficult to install a raindrop sensor and said imaging device simultaneously, so that the size of a raindrop sensor becomes large.

  The present invention has been made to solve such a conventional problem, and has a compact size that does not obstruct the driver's view and does not give psychological pressure to the driver. Another object of the present invention is to provide an imaging device built-in room mirror device capable of detecting foreign matter adhering to the front windshield and photographing vehicle peripheral information and a vehicle including the same.

  In order to solve the above-described problems, a room mirror device with a built-in imaging device according to the present invention is supported by a stay member fixed in a vehicle and rotatably by the stay member, and exposes the reflecting surface of the reflecting mirror. An imaging device built-in room mirror device comprising: a first housing portion that covers the first imaging device; and a second housing portion that is fixed by the stay member and accommodates the first imaging device. At least two light sources that irradiate light toward a windshield of the vehicle, an imaging device having a plurality of pixel arrays, light from the light sources reflected by foreign matter attached to an outer wall surface of the windshield, and An imaging lens that collects light transmitted through the windshield from the outside of the vehicle toward the imaging device, and an optical lens disposed between the imaging lens and the imaging device. And the focal point of the imaging lens is set farther than the position of the outer wall surface of the windshield, and the at least two light sources are located above the imaging lens with respect to the vehicle height direction of the vehicle and The at least one light source irradiates light with an optical axis that is substantially parallel to the optical axis of the imaging lens, and the optical filter includes a substrate that is transparent to light in a use band, A first spectral filter layer that is formed on the entire surface of the effective imaging region on the imaging lens side on the substrate and transmits only light having a wavelength component in the range of wavelengths λ1 to λ2, λ3 to λ4 (λ1 <λ2 <λ3 <λ4). And a second spectral filter layer that is formed in a part of the effective imaging region on the imaging element side on the substrate and transmits only light having a wavelength component in the range of wavelengths λ3 to λ4. 2 of the spectral filter layer A surface on the image element side is tightly bonded to the image pickup element, and the second spectral filter layer is formed in two regions above and below the effective image pickup region.

  This configuration eliminates the need to place the optical system in close contact with the inner wall surface of the windshield unlike conventional raindrop sensors, thus preventing the driver's view from being obstructed or causing psychological pressure on the driver. With a compact size, it is possible to detect foreign matter attached to the windshield of the vehicle and to photograph the vehicle periphery information.

  The present invention can detect foreign objects attached to the windshield of a vehicle and can also photograph vehicle periphery information with a compact size that does not block the driver's view and does not give psychological pressure to the driver. An imaging device built-in room mirror device and a vehicle including the same are provided.

Schematic diagram showing the schematic configuration of an in-vehicle device control system including an imaging unit 1 is a schematic diagram showing a schematic configuration of a room mirror device with a built-in imaging device according to a first embodiment. The schematic diagram which looked at the room mirror device with a built-in imaging device concerning a 1st embodiment from the lower surface The schematic diagram which looked at the room mirror device with a built-in imaging device concerning a 1st embodiment from the windshield side Explanatory drawing which shows the structure of the imaging device provided in the room mirror apparatus with a built-in imaging device which concerns on 1st Embodiment. Explanatory drawing which shows the infrared light image data which is the imaged image data for raindrop detection Cross-sectional schematic diagram along the light transmission direction of the optical filter, imaging device, and sensor substrate Front schematic diagram for explaining region division of an effective imaging region of an optical filter having a spectral filter layer and a region-divided spectral filter layer Graph showing spectral characteristics of spectral filter layer and region-divided spectral filter layer Enlarged view of the wire grid structure constituting the polarizing filter layer Explanatory drawing which shows the longitudinal direction of the metal wire of the wire grid structure in a polarizing filter layer Explanatory drawing which shows the optical path of the emitted light from the light source which an imaging device has Explanatory drawing which shows the other example of the optical path of the emitted light from the light source which an imaging device has Explanatory drawing which shows the image of the experiment result which the present inventors conducted The schematic diagram which looked at the room mirror device with a built-in imaging device concerning a 2nd embodiment from the lower surface The schematic diagram which looked at the room mirror device with a built-in imaging device concerning a 2nd embodiment from the windshield side

  Hereinafter, embodiments of a room mirror device with a built-in imaging device and a vehicle including the same according to the present invention will be described with reference to the drawings. In addition, the dimensional ratio of each structure on each drawing does not necessarily correspond with the actual dimensional ratio.

(First embodiment)
FIG. 1 is a schematic diagram illustrating a schematic configuration of an in-vehicle device control system including an imaging unit 101 according to the first embodiment. The in-vehicle device control system uses headlamp light distribution control, wiper drive control, using captured image data of a forward region in the traveling direction of the vehicle 100, which is captured by an imaging device mounted on the vehicle 100 such as an automobile. It controls other in-vehicle devices.

  The imaging device provided in the in-vehicle device control system is provided in the imaging unit 101 and images an area in the traveling direction of the traveling vehicle 100 as an imaging range. In the present embodiment, a configuration in which the imaging unit 101 is built in a rearview mirror is realized. Hereinafter, the imaging unit 101 is referred to as an imaging device built-in room mirror device 101.

  The captured image data captured by the imaging device of the room mirror device 101 with a built-in imaging device is input to the image analysis unit 102. The image analysis unit 102 analyzes the captured image data transmitted from the imaging device, detects foreign matter such as raindrops attached to the windshield 105, or exists in the front of the vehicle 100 in the captured image data. The position, direction, and distance of another vehicle are calculated, and a detection target such as a white line (partition line) on the road surface existing within the imaging range is detected. Hereinafter, information such as the position, direction, distance, and white line (division line) on the road surface of other vehicles in front of the vehicle 100 is also referred to as vehicle peripheral information. In the detection of other vehicles, a preceding vehicle that travels in the same traveling direction as the vehicle 100 is detected by identifying the tail lamp of the other vehicle, and an opposite traveling that travels in the opposite direction to the vehicle 100 by identifying the headlamp of the other vehicle. Detect the vehicle.

  The calculation result of the image analysis unit 102 is sent to the headlamp control unit 103. For example, the headlamp control unit 103 generates a control signal for controlling the headlamp 104 that is an in-vehicle device of the vehicle 100 from the distance data calculated by the image analysis unit 102. Specifically, for example, the driver of the vehicle 100 can avoid the dazzling of the driver of the other vehicle while avoiding the strong light of the headlamp of the vehicle 100 entering the eyes of the driver of the preceding vehicle or the oncoming vehicle. Therefore, the switching of the high beam and the low beam of the headlamp 104 is controlled, or partial light shielding control of the headlamp 104 is performed.

  The calculation result of the image analysis unit 102 is also sent to the wiper control unit 106. The wiper control unit 106 controls the wiper 107 to remove deposits such as raindrops attached to the windshield 105 of the vehicle 100. The wiper control unit 106 receives a foreign object detection result detected by the image analysis unit 102 and generates a control signal for controlling the wiper 107. When the control signal generated by the wiper control unit 106 is sent to the wiper 107, the wiper 107 is operated to ensure the visibility of the driver of the vehicle 100.

  The calculation result of the image analysis unit 102 is also sent to the vehicle travel control unit 108. Based on the white line detection result detected by the image analysis unit 102, the vehicle travel control unit 108 notifies the driver of the vehicle 100 of a warning when the vehicle 100 is out of the lane area defined by the white line. Or driving support control such as controlling the steering wheel and brake of the host vehicle.

  FIG. 2 is a schematic diagram illustrating a schematic configuration of an imaging device built-in room mirror device 101 including an imaging device that performs image capturing for performing the various controls described above.

  That is, the room mirror device 101 with a built-in image pickup device is supported by a stay member 301 fixed in the vehicle 100 and the stay member 301 so as to be rotatable, and the room mirror (reflection mirror) 303 is exposed on the reflection surface 303a. A first housing portion 302 to be covered, a second housing portion 304 that is fixed by the stay member 301 and accommodates the imaging device (first imaging device) 201, and an attachment for fixing the imaging device 201 to the stay member 301 A plate 305. The imaging apparatus built-in room mirror apparatus 101 is installed on the inner wall surface 105 a side of the windshield 105 of the vehicle 100.

  FIG. 3 is a schematic view of the room mirror device 101 with a built-in imaging device as viewed from below. The first housing part 302 is configured to overlap so as to cover a part of the second housing part 304. Further, with respect to the second casing portion 304 fixed to the stay member 301, the first casing portion 302 is configured such that the angle adjustment with the axis a as the rotation center axis can be performed manually by the driver. (FIG. 3B).

  FIG. 4 is a schematic view of the room mirror device 101 with a built-in imaging device as viewed from the windshield 105 side. FIG. 4B is an enlarged view of a part of FIG. The mounting plate 305 is configured to hold the front portion of the imaging device 201 and has vibration resistance. In the attachment plate 305, an opening 306 for the light source 202 included in the imaging device 201 and an opening 307 for an imaging lens (not shown) included in the imaging device 201 are formed. FIG. 4B illustrates a case where the light source 202 includes three light sources 202-1, 202-2, and 202-3. However, the number of light sources 202 is not limited to three. Absent.

  In addition, the imaging device 201 having the light source 202 is disposed on the side closer to the driver's seat of the vehicle 100 with respect to the rotation center axis a of the first casing 302, as shown in FIG. Thus, by installing the imaging device 201 on the driver's seat side, it is possible to make the raindrop detection range, which will be described later, substantially coincide with the driver's field of view.

  FIG. 5 is an explanatory diagram illustrating a configuration of the imaging device 201 provided in the room mirror device 101 with a built-in imaging device according to the present embodiment. In FIG. 5, illustration of the stay member 301, the first housing portion 302, the second housing portion 304, and the attachment plate 305 is omitted.

  The imaging apparatus 201 mainly includes at least two light sources 202-1 and 202-2 that irradiate light toward the windshield 105 of the vehicle 100, and an imaging element 206 having a plurality of pixel arrays arranged two-dimensionally. The light from the light sources 202-1 and 202-2 reflected by the foreign matter attached to the sensor substrate 207 and the outer wall surface 105b of the windshield 105, and the light transmitted through the windshield 105 from the outside of the vehicle 100 are imaged. An imaging lens 204 that condenses toward the element 206, an optical filter 205 disposed between the imaging lens 204 and the imaging element 206, and an analog electrical signal output from the sensor substrate 207 (reception of each light received on the imaging element 206). A signal processing unit 208 that generates and outputs captured image data obtained by converting a received light amount received by the element into a digital electrical signal; It is al configuration.

  The light sources 202-1 and 202-2 are arranged separately on the upper side and the lower side of the imaging lens 204 with respect to the vehicle height direction of the vehicle 100, and the direction of the optical axes 21 and 22 of the light sources 202-1 and 202-2. The direction of the optical axis 23 of the imaging lens 204 is substantially parallel, and the field angle range of the imaging lens 204 and the irradiation area of the light sources 202-1 and 202-2 are arranged to overlap with the inner wall surface 105a of the windshield 105. Yes. As the light sources 202-1 and 202-2, light sources having wavelengths and light amounts in the eye-safe band are used.

  Light from the imaging range including the subject (detection target) passes through the imaging lens 204, passes through the optical filter 205, and is converted into an electrical signal corresponding to the light intensity by the imaging element 206. Here, the subject (detection target) is a foreign object such as a landscape in front of the vehicle 100 or raindrops attached to the outer wall surface 105b of the windshield 105. In the signal processing unit 208, when an electrical signal (analog signal) output from the image sensor 206 is input, the brightness (luminance) of each pixel on the image sensor 206 is shown as captured image data from the electrical signal. The digital signal is output to the subsequent unit together with the horizontal / vertical synchronizing signal of the image.

  In the present embodiment, the light sources 202-1 and 202-2 are for detecting foreign matter attached to the outer wall surface 105 b of the windshield 105 (hereinafter, described as an example where the foreign matter is raindrops). It is. As shown in FIG. 2, when the raindrop 203 is attached to the outer wall surface 105b of the windshield 105, the light emitted from the light sources 202-1 and 202-2 is reflected at the interface between the raindrop 203 and the air. The reflected light is incident on the imaging device 201. On the other hand, when the raindrop 203 is not attached to the outer wall surface 105b of the windshield 105, a part of the light emitted from the light sources 202-1 and 202-2 passes through the windshield 105 and leaks outside. Is reflected at the interface between the inner wall surface 105 a of the windshield 105 or the outer wall surface 105 b and the outside air, and the reflected light enters the imaging device 201.

  Here, in this embodiment, the focal position of the imaging lens 204 is set to infinity or between infinity and the outer wall surface 105 b of the windshield 105. Thereby, not only when detecting the raindrop 203 attached on the windshield 105, but also when detecting the preceding vehicle and the oncoming vehicle and detecting the white line, appropriate information is obtained from the captured image data of the imaging device 201. Can be acquired.

  For example, when the raindrop 203 attached on the windshield 105 is detected, the shape of the raindrop image on the captured image data is often circular, so whether the raindrop candidate image on the captured image data is circular. A shape recognition process is performed to determine whether the raindrop candidate image is a raindrop image. When such a shape recognition process is performed, rather than the focus of the imaging lens 204 on the raindrop 203 on the outer wall surface 105b of the windshield 105, as described above, In the case where the focus is in between, a slight blurring occurs, so that the raindrop shape recognition rate (circular shape) increases and the raindrop detection performance increases.

  FIG. 6 is an explanatory diagram showing infrared light image data that is captured image data for raindrop detection. 6A shows the infrared image data when the imaging lens 204 is focused on the raindrop 203 on the outer wall surface 105b of the windshield 105, and FIG. 6B shows the infrared image data when the imaging lens 204 is focused at infinity. Respectively.

  When the imaging lens 204 is focused on the raindrop 203 on the outer wall surface 105b of the windshield 105, as shown in FIG. 6A, the background image 203a reflected in the raindrop is captured. Such a background image 203 a causes erroneous detection of the raindrop 203. In addition, as shown in FIG. 6 (a), only a part 203b of the raindrop may have a bow-like brightness, and the shape of the large brightness part, that is, the shape of the raindrop image is the direction of sunlight or the position of the streetlight. It changes by things. In order to cope with the shape of such variously changing raindrop images by the shape recognition process, the processing load becomes large and the recognition accuracy is lowered.

  On the other hand, when the focus is at infinity, some blurring occurs as shown in FIG. For this reason, the reflection of the background image 203a is not reflected in the captured image data, and erroneous detection of the raindrop 203 is reduced. In addition, the occurrence of slight blurring reduces the degree to which the shape of the raindrop image changes depending on the direction of sunlight, the position of the streetlight, and the like. The shape of the raindrop image is always substantially circular. Therefore, the load of the raindrop 203 shape recognition process is small, and the recognition accuracy is high.

  However, when focusing at infinity, when identifying the tail lamp of a preceding vehicle traveling far, there may be about one light receiving element that receives the light of the tail lamp on the image sensor 206. In this case, the light from the tail lamp may not be received by the red light receiving element that receives the tail lamp color (red). In this case, the tail lamp cannot be recognized and the preceding vehicle cannot be detected. In order to avoid such a problem, it is preferable that the imaging lens 204 is focused before infinity. As a result, the tail lamp of the preceding vehicle traveling far is out of focus, so that the number of light receiving elements that receive the light of the tail lamp can be increased, the recognition accuracy of the tail lamp is increased, and the detection accuracy of the preceding vehicle is improved.

  A light emitting diode (LED), a semiconductor laser (LD), or the like can be used as the light sources 202-1 and 202-2 of the room mirror device 101 with a built-in imaging device. Moreover, visible light and infrared light can be used for the light emission wavelength of the light sources 202-1 and 202-2, for example. However, in order to avoid dazzling oncoming drivers and pedestrians with the light of the light sources 202-1 and 202-2, the range in which the light receiving sensitivity of the image sensor 206 is longer than the visible light and the imaging element 206 extends. It is preferable to select a wavelength in the infrared light region of, for example, 800 nm to 1000 nm. The light sources 202-1 and 202-2 of this embodiment irradiate light having a wavelength in the infrared light region.

  Here, when imaging the infrared wavelength light from the light sources 202-1 and 202-2 reflected by the windshield 105 with the imaging device 201, the imaging device 206 of the imaging device 201 uses the light sources 202-1 and 202-2. In addition to the infrared wavelength light, a large amount of disturbance light including infrared wavelength light such as sunlight is also received. Therefore, in order to distinguish the infrared wavelength light from the light sources 202-1 and 202-2 from such a large amount of disturbance light, the light emission amount of the light sources 202-1 and 202-2 is sufficiently larger than the disturbance light. Although it is necessary to increase the size, it is often difficult to use the light sources 202-1 and 202-2 having such a large light emission amount.

  Therefore, in the present embodiment, for example, a cut filter that cuts light having a wavelength shorter than the light emission wavelength of the light sources 202-1 and 202-2, or the peak of transmittance is the light sources 202-1 and 202-. The light from the light sources 202-1 and 202-2 is received by the image sensor 206 through a band-pass filter that substantially matches the emission wavelength of 2. As a result, light other than the light emission wavelengths of the light sources 202-1 and 202-2 can be received and received. It becomes relatively large. As a result, it is possible to distinguish the light from the light source from the disturbance without using a light source with a large light emission amount.

  However, in the present embodiment, not only the foreign matter such as the raindrop 203 on the windshield 105 is detected from the captured image data, but also the preceding vehicle and the oncoming vehicle and the white line are detected. Therefore, if the wavelength band other than the infrared wavelength light emitted by the light sources 202-1 and 202-2 is removed for the entire captured image, the light in the wavelength band necessary for detecting the preceding vehicle and the oncoming vehicle and detecting the white line. Cannot be received by the image sensor 206, and these detections are hindered. Therefore, in the present embodiment, the image area of the captured image data is the raindrop detection image area for detecting the raindrop 203 on the windshield 105, and the vehicle periphery for detecting the preceding vehicle and the oncoming vehicle and detecting the white line. It is divided into the information detection image region, and the wavelength band other than the infrared wavelength light irradiated by the light sources 202-1 and 202-2 is removed only for the part corresponding to the raindrop detection image region.

  FIG. 7 is a schematic cross-sectional view of the optical filter 205, the image sensor 206, and the sensor substrate 207 along the light transmission direction.

  The image sensor 206 is an image sensor using a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like, and a photodiode 206A is used as the light receiving element. The photodiodes 206A are two-dimensionally arranged for each pixel, and a microlens 206B is provided on the incident side of each photodiode 206A in order to increase the light collection efficiency of the photodiode 206A. The image sensor 206 is bonded to a PWB (Printed Wiring Board) by a technique such as wire bonding to form a sensor substrate 207.

  As shown in FIG. 7, the optical filter 205 includes a substrate 220 that is transparent with respect to light in a use band (in this embodiment, a visible light region and an infrared light region), and is effective on the imaging lens 204 side on the substrate 220. A spectral filter layer (first spectral filter layer) 221 formed on the entire surface of the imaging region and transmitting only light having a wavelength component in the range of wavelengths λ1 to λ2, λ3 to λ4 (λ1 <λ2 <λ3 <λ4), and a substrate 220, the polarizing filter layer 223 formed on the surface of the imaging element 206 side, the filler 224 filled on the polarizing filter layer 223, and a part of the effective imaging area on the imaging element 206 side of the substrate 220. A region-divided spectral filter layer (second spectral filter layer) 222 that is formed through the polarizing filter layer 223 and the filler 224 and transmits only light having a wavelength component in the wavelength range of λ3 to λ4. Split Surface of the imaging element 206 side of the spectral filter layer 222 is formed by close contact to the image sensor 206.

  That is, the optical filter 205 has a structure in which the spectral filter layer 221 and the region division type spectral filter layer 222 are overlapped in the light transmission direction.

  FIG. 8 is a schematic front view for explaining the region division of the effective imaging region of the optical filter 205 having the spectral filter layer 221 and the region-divided spectral filter layer 222. As shown in FIG. 8, the effective imaging region is divided into a visible light transmission region 211 corresponding to the vehicle surrounding information detection image region and an infrared light transmission region 212 corresponding to the raindrop detection image region. Has been. For example, the visible light transmissive region 211 may be a region in the center half of the effective imaging region, while the infrared light transmissive region 212 may be a region above and below the effective imaging region.

  The headlamp of the oncoming vehicle, the tail lamp of the preceding vehicle, and the white line image are often present mainly in the center of the captured image, and there is usually an image of the nearest road surface in front of the host vehicle at the lower portion of the captured image. It is. Therefore, the information necessary for identifying the headlamp of the oncoming vehicle, the tail lamp of the preceding vehicle, and the white line is concentrated in the center of the captured image, and the information below the captured image is not so important in the identification. On the other hand, since it is normal that the sky appears in the upper part of the captured image, information on the upper part of the captured image is not so important.

  Therefore, when both oncoming vehicle and preceding vehicle or white line detection and raindrop detection are performed simultaneously from a single captured image data, as shown in FIG. The infrared light transmission region 212 for detection is used, the central portion of the remaining effective imaging region is the visible light transmission region 211 for vehicle surrounding information detection, and the region-divided spectral filter layer 222 is divided into regions corresponding thereto. Is preferred. Note that a filter that cuts infrared wavelength light emitted by the light sources 202-1 and 202-2 is formed in an area of the effective imaging region where the region-divided spectral filter layer 222 is not formed on the filler 224. It may be.

  FIG. 9 is a graph showing the spectral characteristics of the spectral filter layer 221 and the region-divided spectral filter layer 222. As shown in FIG. 9A, the spectral filter layer 221 includes light in a so-called visible light region having a wavelength range of 400 nm to 670 nm (here, λ1 = 400 nm, λ2 = 670 nm) and a wavelength range of 940 nm to 970 nm (here, λ3 = 940 nm, λ4 = 970 nm) in the infrared region. The light in the visible light region is used for detecting vehicle peripheral information, and the light in the infrared light region is used for detecting raindrops.

  However, since each light receiving element constituting the image sensor 206 of the present embodiment has sensitivity to light in the infrared wavelength band, it is obtained when the image sensor 206 receives light including the infrared wavelength band. The captured image becomes reddish as a whole. As a result, it may be difficult to identify the red image portion corresponding to the tail lamp. Therefore, in the present embodiment, the spectral filter layer 221 does not transmit infrared light having a wavelength range of 700 nm to 940 nm (a transmittance of 5% or less is desirable). Thereby, since the infrared wavelength band is excluded from the captured image data portion used for identifying the tail lamp, the identification accuracy of the tail lamp is improved.

  Further, as shown in FIG. 9B, the region-divided spectral filter layer 222 has an infrared light region with a wavelength range of 940 nm to 970 nm as a transmission band. Therefore, the optical filter 205 transmits only light in the wavelength range of 940 nm (= λ3) to 970 nm (= λ4) by the combination of the region-divided spectral filter layer 222 and the spectral filter layer 221 described above. . It is desirable that the transmittance peak in this wavelength range λ3 to λ4 and the light emission wavelengths of the light sources 202-1 and 202-2 be substantially equal.

  When the imaging direction of the imaging device 201 is tilted downward, the hood of the host vehicle may enter the lower part of the imaging range. In this case, sunlight reflected by the bonnet of the host vehicle or the tail lamp of the preceding vehicle becomes disturbance light, which is included in the captured image data, which may cause misidentification of the head lamp of the oncoming vehicle, the tail lamp of the preceding vehicle, and the white line. Become. Even in such a case, in the present embodiment, since the spectral filter layer 221 that blocks light in the wavelength range of 700 nm to 940 nm is formed in the entire effective imaging region, the sunlight reflected by the bonnet, the tail lamp of the preceding vehicle, etc. The disturbance light is removed. Therefore, the head lamp of the oncoming vehicle, the tail lamp of the preceding vehicle, and the white line identification accuracy are improved.

  Note that the warp of the optical filter 205 can be suppressed by forming the spectral filter layer 221 and the region-divided spectral filter layer 222 on both surfaces of the substrate 220 of the optical filter 205. For example, when the spectral filter layer is formed only on one surface of the substrate 220, stress is applied to the substrate 220 and warping occurs. However, as shown in FIG. 7, when the spectral filter layers are formed on both surfaces of the substrate 220, warping can be suppressed because the effect of stress is offset.

  Further, as shown in FIGS. 7 and 8, a pattern in which the region-divided spectral filter layer 222 is provided above and below the effective imaging region is desirable. When the infrared light transmission region 212 for raindrop detection is provided only in either the upper part or the lower part of the effective image pickup region, it is difficult to bond the optical filter 205 and the image sensor 206 in parallel. If the optical filter 205 and the image sensor 206 are tilted and bonded, the optical path length changes between the upper and lower parts of the effective image area, and vehicle periphery information, for example, white line coordinate reading errors when white line detection is performed, is recognized. It causes deterioration of accuracy.

  Note that the optical filter 205 and the image sensor 206 are bonded in parallel even if the pixel for detecting raindrops and the pixel for detecting vehicle peripheral information are formed in a checkered pattern or a stripe pattern over the entire effective image pickup area. Is possible. In this case, since the infrared light transmission region 212 can be made large, it is possible to further improve the detection accuracy of raindrops.

  The polarizing filter layer 223 is formed to cut out disturbance light reflected from the inner wall surface 105a of the windshield 105 after being irradiated from the light sources 202-1 and 202-2. In general, it is known that most of the polarization components of such disturbance light are S-polarized components. That is, the polarization axis of the polarizing filter layer 223 is formed so as to shield light having a polarization direction component (S polarization component) orthogonal to the normal line of the inner wall surface 105 a of the windshield 105. In other words, the polarizing filter layer 223 is formed by two optical axes, that is, the optical axis 21 of the light emitted toward the windshield 105 of the light sources 202-1 and 202-2, and the optical axis 23 of the imaging lens 204. It is designed to transmit only the polarization component (P polarization component) parallel to the surface. The polarizing filter layer 223 designed in this way can also block reflected light reflected by a dashboard or the like.

  As described above, the optical filter 205 is disposed close to the surface of the image sensor 206 on the microlens 206B side. Although there may be a configuration in which there is a gap between the optical filter 205 and the image sensor 206, the configuration in which the optical filter 205 is in close contact with the image sensor 206 and the visible light transmission region 211 of the optical filter 205 and the infrared light transmission. It becomes easy to make the boundary of the region 212 coincide with the boundary between the photodiodes 206 </ b> A on the image sensor 206. Thereby, the boundary between the infrared light transmission region 212 and the visible light transmission region 211 becomes clear, and the detection accuracy of raindrops can be increased.

  The optical filter 205 and the image sensor 206 may be bonded with, for example, a UV adhesive, or UV bonding or thermocompression bonding is performed on the four side areas outside the effective pixel range while being supported by the spacer outside the effective pixel range used for imaging. May be.

  Note that the light sources 202-1 and 202-2 may perform continuous light emission (CW light emission) or may emit pulses at specific timing. In particular, a configuration that performs pulsed light emission is preferable because the influence of disturbance light can be further reduced by synchronizing the timing of light emission and the timing of image capturing.

  Further, as in the present embodiment, when there are a plurality of light sources, the plurality of light sources may emit light simultaneously or sequentially. When the light is emitted sequentially, the influence of disturbance light can be reduced by synchronizing the light emission timing and the image capturing timing.

Next, details of each part of the optical filter 205 will be described.
The substrate 220 is made of a transparent material, such as glass, sapphire, or quartz, that can transmit light in a use band (visible light region and infrared light region in the present embodiment). In the present embodiment, glass, particularly quartz glass (refractive index 1.46) and Tempax glass (refractive index 1.51) which are inexpensive and durable can be suitably used.

  The polarizing filter layer 223 formed on the substrate 220 is composed of a polarizer formed with a wire grid structure as shown in FIG. The wire grid structure is a structure in which metal wires (conductor lines) made of metal such as aluminum and extending in a specific direction are arranged at a specific pitch. By making the wire pitch of the wire grid structure a sufficiently small pitch (for example, ½ or less) compared to the wavelength band of incident light (for example, 400 nm to 800 nm), the wire grid structure vibrates in parallel to the longitudinal direction of the metal wire. Therefore, it can be used as a polarizer for producing a single polarized light because it reflects most of the light of the electric field vector component and transmits almost the light of the electric field vector component that vibrates in the direction orthogonal to the longitudinal direction of the metal wire.

  In a wire grid polarizer, the extinction ratio generally increases as the cross-sectional area of the metal wire increases, and the transmittance decreases for metal wires having a predetermined width or more with respect to the period width. Further, when the cross-sectional shape orthogonal to the longitudinal direction of the metal wire is a tapered shape, the wavelength dispersion of the transmittance and the polarization degree is small in a wide band, and a high extinction ratio characteristic is exhibited.

  FIG. 11 is an explanatory diagram showing the longitudinal direction of a metal wire having a wire grid structure in the polarizing filter layer 223 of the optical filter 205. Since the windshield 105 is generally curved, the polarization direction of reflected light from the dashboard changes at each location in the effective imaging region, and therefore the polarizing filter layer 223 has a polarization axis corresponding to the change. Is desirable.

  Specifically, as shown in FIG. 11, in order to realize a polarization axis corresponding to the curvature of the windshield 105, the longitudinal direction (groove direction) of the wire grid structure can be changed at each location of the polarization filter layer 223. That's fine.

  In the present embodiment, the polarizing filter layer 223 is formed in a wire grid structure, and thus has the following effects.

  The wire grid structure can be formed using a widely known semiconductor manufacturing process. Specifically, after depositing an aluminum thin film on the substrate 220, patterning is performed, and the sub-wavelength uneven structure of the wire grid may be formed by a technique such as metal etching. By such a manufacturing process, it becomes possible to adjust the longitudinal direction of the metal wire, that is, the polarization direction (polarization axis) corresponding to the imaging pixel size (several μm level) of the imaging element 206. Therefore, as in the present embodiment, it is possible to create the polarizing filter layer 223 in which the longitudinal direction of the metal wire, that is, the polarization direction (polarization axis) is different for each imaging pixel.

  Further, since the wire grid structure is made of a metal material such as aluminum, there is an advantage that it is excellent in heat resistance and can be suitably used even in a high-temperature environment such as a vehicle interior that is likely to become high temperature.

  The filler 224 used for planarizing the upper surface of the polarizing filter layer 223 in the stacking direction is filled in the recesses between the metal wires of the polarizing filter layer 223. As the filler 224, an inorganic material having a refractive index lower than or equal to that of the substrate 220 can be suitably used. In addition, the filler 224 in this embodiment is formed so as to cover the upper surface in the stacking direction of the metal wire portion of the polarizing filter layer 223.

The specific material of the filler 224 is preferably a low refractive index material whose refractive index is as close as possible to the refractive index of air (refractive index = 1) so as not to deteriorate the polarization characteristics of the polarizing filter layer 223. . For example, a porous ceramic material formed by dispersing fine pores in ceramics is preferable. Specifically, porous silica (SiO ₂ ), porous magnesium fluoride (MgF), porous alumina (Al ₂ O) ₃ ). The degree of these low refractive indexes is determined by the number and size of pores in the ceramic (porosity). When the main component of the substrate 220 is made of silica crystal or glass, porous silica (n = 1.2-1.26) can be preferably used.

As a method for forming the filler 224, an inorganic coating film (SOG: Spin On Glass) method can be suitably used. Specifically, a solvent in which silanol (Si (OH) ₄ ) is dissolved in alcohol is spin-coated on the polarizing filter layer 223 formed on the substrate 220, and then the solvent component is volatilized by heat treatment, whereby the silanol itself Is formed in such a manner as to cause a dehydration polymerization reaction.

  The polarizing filter layer 223 has a sub-wavelength sized wire grid structure, has a low mechanical strength, and a metal wire is damaged by a slight external force. Since it is desired that the optical filter 205 of the present embodiment is placed in close contact with the image sensor 206, there is a possibility that the optical filter 205 and the image sensor 206 come into contact with each other in the manufacturing stage. In the present embodiment, since the upper surface of the polarizing filter layer 223 in the stacking direction, that is, the surface on the imaging element 206 side is covered with the filler 224, the situation where the wire grid structure is damaged when contacting the imaging element 206 is suppressed. The

  Further, by filling the filler 224 into the recesses between the metal wires in the wire grid structure of the polarizing filter layer 223 as in the present embodiment, it is possible to prevent foreign matter from entering the recesses.

  In the present embodiment, the region-divided spectral filter layer 222 laminated on the filler 224 is not provided with a protective layer like the filler 224. According to the experiments by the present inventors, even when the area-divided spectral filter layer 222 is in contact with the image sensor 206, damage that affects the captured image does not occur. Thus, the protective layer is omitted. In addition, the height of the metal wire (convex portion) of the polarizing filter layer 223 is generally as low as half or less of the wavelength used, whereas the height of the region-dividing spectral filter layer 222 increases with the cutoff wavelength as the height (thickness) increases. Since the transmittance characteristic of the filter can be made steep, the height is set to be several times as high as the wavelength used. As the thickness of the filler 224 increases, it becomes more difficult to ensure the flatness of the upper surface, which affects the characteristics of the optical filter 205, so that there is a limit to increasing the thickness of the filler 224. Therefore, in the present embodiment, the region-divided spectral filter layer 222 is not covered with a filler. That is, in this embodiment, since the region-divided spectral filter layer 222 is formed after the polarizing filter layer 223 is covered with the filler 224, the layer of the filler 224 can be stably formed. Further, the region-divided spectral filter layer 222 formed on the upper surface of the layer of the filler 224 can be optimally formed.

  The spectral filter layer 221 and the region-divided spectral filter layer 222 according to the present embodiment are formed in a multilayer film structure in which high refractive index thin films and low refractive index thin films are alternately stacked. If such a multilayer film structure is adopted, the degree of freedom in setting the spectral transmittance is increased by utilizing the interference of light, and the reflection is nearly 100% with respect to a specific wavelength (for example, a wavelength band other than red). It is also possible to realize the rate. In the present embodiment, since the use wavelength range of the captured image data is a wavelength band from substantially visible light to infrared light, the image sensor 206 having sensitivity in the use wavelength range is selected, and the transmission wavelength of the multilayer film portion is selected. The range may be set to 900 nm or more, for example, and a cut filter that reflects other wavelength bands may be formed.

Such a cut filter can be obtained by fabricating a multilayer film having a configuration of “substrate / (0.125L0.25H0.125L) p / medium A” in order from the lower side of the optical filter 205 in the stacking direction. it can. The “substrate” here means the filler 224 described above. Further, “0.125L” is a film thickness marking method of a low refractive index material (for example, SiO ₂ ) in which nd / λ is 1 L. Therefore, the film of “0.125L” has an optical path of 1/8 wavelength. It means that the film is of a low refractive index material having such a long film thickness. “N” is a refractive index, “d” is a thickness, and “λ” is a cutoff wavelength. Similarly, “0.25H” is a film thickness marking method of a high refractive index material (for example, TiO ₂ ) in which nd / λ is set to 1H. Therefore, a film of “0.25H” has a quarter wavelength. It means a film of a high refractive index material having a film thickness that becomes an optical path length. “P” indicates the number of times the combination of films shown in parentheses is repeated (laminated), and as “p” increases, the influence of ripples and the like can be suppressed. The medium A is intended for air or a resin or adhesive for tight bonding with the image sensor 206.

Alternatively, the region-divided spectral filter layer 222 may be a bandpass filter as shown in FIG. 9B having a transmission wavelength range of 940 nm to 970 nm. With such a bandpass filter, it is possible to distinguish the near-infrared region and red region on the longer wavelength side than red. Such a band pass filter is, for example, “substrate / (0.125L0.5M0.125L) p (0.125L0.5H0.125L) q (0.125L0.5M0.125L) r / medium A”. It can be obtained by producing a multilayer film having the structure. As described above, when using titanium dioxide (TiO ₂ ) as a high refractive index material and silicon dioxide (SiO ₂ ) as a low refractive index material, a highly weather-resistant region division type spectral filter layer 222 can be realized. .

  An example of a method for manufacturing the region-divided spectral filter layer 222 according to this embodiment will be described. First, the multilayer film described above is formed on the layer of the filler 224 formed on the substrate 220 and the polarizing filter layer 223. As a method for forming such a multilayer film, a well-known method such as vapor deposition may be used. Subsequently, the multilayer film is removed from the portion corresponding to the non-spectral region. As this removal method, a general lift-off processing method may be used. In the lift-off processing method, a pattern opposite to the target pattern is formed on a layer of the filler 224 in advance with a metal, a photoresist, or the like, a multilayer film is formed thereon, and then non-spectral The multilayer film corresponding to the region is removed together with the metal and photoresist.

  In the present embodiment, since the multi-layer film structure is employed as the region-divided spectral filter layer 222, there is an advantage that the degree of freedom in setting spectral characteristics is high. In general, a color filter used in a color sensor or the like is formed of a resist agent, but it is difficult to control spectral characteristics with such a resist agent as compared with a multilayer film structure. In the present embodiment, since the multilayer filter structure is employed as the spectral filter layer 221 and the region-divided spectral filter layer 222, the wavelengths of the light sources 202-1 and 202-2 and the wavelength band of the infrared light transmission region 212 are substantially reduced. It is possible to match.

  FIG. 12 is an explanatory diagram illustrating an optical path of emitted light from the light sources 202-1 and 202-2 included in the imaging apparatus 201. FIG. FIG. 12 shows an example in which the directions of the optical axes 21 and 22 of the light sources 202-1 and 202-2 and the direction of the optical axis 23 of the imaging lens 204 are substantially parallel. Hereinafter, a function of detecting a foreign matter such as a raindrop attached to the outer wall surface 105b of the windshield 105 by the imaging apparatus built-in room mirror apparatus 101 according to the present embodiment will be described with reference to FIG.

-Optical path A, A '
A part of the light on the optical path A (or A ′) toward the portion where the raindrops on the outer wall surface 105 b of the windshield 105 are not attached leaks to the outside of the vehicle 100 as it is. The remaining part is reflected by the inner wall surface 105a of the windshield 105 (not shown).

-Optical path B, B '
As described above, part of the light emitted from the light sources 202-1 and 202-2 is reflected by the inner wall surface 105 a of the windshield 105. As described above, most of the polarized light components of such reflected light are S-polarized light components. Further, such reflected light is unnecessary light for original raindrop detection, and may cause erroneous detection. In the present invention, since the polarizing filter layer 223 that cuts the S-polarized component is disposed in the optical filter 205, unnecessary light can be removed.

-Optical path C, C '
Among the light emitted from the light sources 202-1 and 202-2, as a component of light that is transmitted through the windshield 105 without being reflected by the inner wall surface 105 a of the windshield 105, the P polarization component is compared with the S polarization component. Become more. When the raindrops are attached to the outer wall surface 105b of the windshield 105, the light incident on the windshield 105 is reflected multiple times inside the raindrop and again passes through the windshield 105 toward the image pickup apparatus 201. Then, the light reaches the optical filter 205 of the imaging device 201.

  Further, the light that reaches the optical filter 205 passes through the spectral filter layer 221, and its P-polarized component passes through the polarizing filter layer 223 having a wire grid structure. Of the P-polarized component light (infrared light) transmitted through the polarizing filter layer 223, the light that has reached the region-divided spectral filter layer 222 in the infrared light transmission region 212 for raindrop detection is the region-divided spectral filter layer. Through 222, the light enters the image sensor 206, and the image analysis unit 102 shown in FIG. 1 recognizes that raindrops are attached to the outer wall surface 105b of the windshield 105. Note that the P-polarized component light that has passed through the polarizing filter layer 223 can also enter the visible light transmission region 211, but a filter that cuts infrared wavelength light irradiated by the light sources 202-1 and 202-2 in this region. Can be prevented from entering the image sensor 206.

・ Optical path D
Of the light that reaches the imaging device 201 by entering from the outer wall surface 105b side of the windshield 105, not the light from the light sources 202-1 and 202-2, the light that reaches the infrared light transmission region 212 is a spectral filter. The layer 221 and the region-divided spectral filter layer 222 are mostly cut. As described above, the infrared light transmission region 212 is configured to be able to cut disturbance light outside the windshield 105.

・ Light path E
Of the light components that enter from the outer wall surface 105 b side of the windshield 105 and pass through the visible light transmission region 211 instead of the light from the light sources 202-1 and 202-2, the infrared light component is caused by the spectral filter layer 221. Blocked.

-Optical path F, F '
Reflected light from the dashboard of the vehicle 100 is an unnecessary component for photographing ahead of the vehicle 100 and detecting raindrops. These lights are reflected by the inner wall surface 105 a of the windshield 105 and become mostly light having a polarization component of the S polarization component, and are cut by the polarization filter layer 223.

・ Optical path G
Of the light components that enter from the outer wall surface 105b side of the windshield 105 and pass through the visible light transmission region 211 instead of the light from the light sources 202-1, 202-2, the visible light component and the light sources 202-1, 202 are included. -2 irradiates only the component in the wavelength band of the infrared wavelength light, passes through the spectral filter layer 221 and becomes only the P-polarized component, reaches the image sensor 206 in a state where unnecessary light is cut, and detects vehicle surrounding information. Detected as a signal.

  The windshield 105 of the light emitted from the light sources 202-1 and 202-2 is captured so that the light emitted from the light sources 202-1 and 202-2 and reflected by the boundary surface between raindrops and air is captured by the image sensor 206. The incident angle to is set. According to the experiment results of the present inventors, an example of the layout in which the reflected light from the raindrop is the strongest is that the imaging lens 204 and the optical axes of the light sources 202-1 and 202-2 are as shown in FIG. An example in which the light sources 202-1 and 202-2 are arranged so as to be substantially parallel is given.

  Further, as another example of the layout in which the reflected light from the raindrop is the strongest, as shown in FIG. 13, the windshield passing through the intersection of the optical axis 23 of the imaging lens 204 and the optical axis 22 of the light source 202-2. An example in which the optical axis 23 of the imaging lens 204 and the optical axis 22 of the light source 202-2 are arranged so as to sandwich the normal line 10 of the outer wall surface 105b of 105. In the example of FIG. 13, the optical axis 21 of the light source 202-1 is substantially parallel to the optical axis 23 of the imaging lens 204, as in the example of FIG.

  When light enters the windshield 105 from the light source 202-1 through an optical path A parallel to the optical axis 23 of the imaging lens 204, and from the light source 202-2 to the windshield 105 through an optical path C ′ from the lower side of the imaging lens 204. Since the multiple reflection state of the raindrop changes depending on the incident light, the shape of the raindrop that can be detected is expanded. In FIG. 13, the optical paths D to G described in FIG. 12 are omitted in order to avoid the drawing from being complicated.

  FIG. 14 is an explanatory view showing an image of a result of an experiment conducted by the present inventors. Raindrop detection image areas are provided at the top and bottom of the image. 14A is an image when raindrops are attached to the windshield 105, and FIG. 14B is an image when raindrops are not attached to the windshield 105. FIG.

  A portion surrounded by a white square in FIG. 14 corresponds to a raindrop detection image region. When raindrops are attached to this region, LED light from the light sources 202-1 and 202-2 is incident on the image sensor 206, The image analysis unit 102 recognizes that raindrops are attached to the outer wall surface 105b of the windshield 105. At this time, it is preferable to display a display such as “Rain detected!” For notifying the driver of the attachment of raindrops in the image.

  On the other hand, when raindrops are not attached to the outer wall surface 105b of the windshield 105, the LED light from the light sources 202-1 and 202-2 does not enter the image sensor 206, so the image analysis unit 102 recognizes the attachment of raindrops. do not do. In this case, it is preferable that a display such as “Rain not detected” for notifying the driver that no raindrops are attached is displayed in the image.

  The above recognition processing by the image analysis unit 102 is based on, for example, a threshold set in advance with respect to the amount of LED light received by the image sensor 206, and recognizes that raindrops have adhered when the amount of received light exceeds the threshold. When the amount of received light is less than or equal to the threshold value, it may be recognized that raindrops are not attached.

  Note that the above threshold value does not have to be a predetermined constant value, and may be sequentially calculated based on exposure adjustment information of the vehicle periphery information detection image. Specifically, at the time of high illuminance such as daytime when the periphery of the vehicle is bright, the light output power of the light sources 202-1 and 202-2 may be increased and the threshold value may be increased. This makes it possible to detect raindrops without the influence of disturbance light.

  In addition, although the image which image | photographed vehicle periphery information and raindrop simultaneously was shown in FIG. 14, vehicle periphery information and raindrop may be image | photographed separately. For example, the imaging device 201 captures a foreign matter such as raindrops attached to the outer wall surface 105b of the windshield 105 in the infrared light transmission region 212 where the region-divided spectral filter layer 222 is formed. And a second exposure time for capturing an image far from the position of the outer wall surface 105b of the windshield 105 in the visible light transmission region 211 where the region-divided spectral filter layer 222 is not formed. An image may be taken.

  Although the visible light transmission region 211 in which only the spectral filter layer 221 is formed and the infrared light transmission region 212 in which the spectral filter layer 221 and the region-divided spectral filter layer 222 are formed, the amount of light required for photographing is different, With the above-described configuration in which two images with different exposure times are captured, it is possible to capture images with optimal exposure for each image.

  Specifically, when shooting a distant image, automatic exposure adjustment is performed while detecting the amount of light passing through the effective imaging region where only the spectral filter layer 221 is formed, and a raindrop image is shot. The automatic exposure adjustment may be performed while detecting the amount of light transmitted through the effective imaging region in which the spectral filter layer 221 and the area-divided spectral filter layer 222 are formed.

  Note that an effective imaging region in which only the spectral filter layer 221 is formed has a large change in light amount. Specifically, since the illuminance around the vehicle changes from tens of thousands of lux in the daytime to 1 lux or less at night, it is necessary to adjust the exposure time according to the shooting scene. For this, known automatic exposure control may be performed. In the imaging apparatus 201 described in the present embodiment, since the subject is in the vicinity of the road surface, it is desirable to perform exposure control based on the image of the road surface area.

  On the other hand, the effective imaging region in which the spectral filter layer 221 and the area-divided spectral filter layer 222 are formed is designed to capture only reflected light from a foreign substance, so that the change in the amount of light due to the surrounding environment is small and fixed. It is also possible to shoot with exposure time.

As described above, the room mirror device with a built-in imaging device according to the present embodiment can detect vehicle peripheral information simultaneously with the detection of foreign matters such as raindrops attached to the windshield of the vehicle.
In addition, the room mirror device with a built-in imaging device according to the present embodiment does not need to be placed in close contact with the inner wall surface of the windshield unlike a conventional raindrop sensor, and thus has a wider foreign object detection area than the conventional one while having a compact size. Can be taken.

(Second Embodiment)
A second embodiment of an imaging device built-in room mirror apparatus 110 according to the present invention will be described with reference to the drawings. Note that the description of the same configuration and operation as in the first embodiment will be omitted as appropriate. The number of imaging devices housed in the room mirror device with a built-in imaging device according to the present invention is not limited to one, and may be two or more.

  FIG. 15 is a schematic view of the room mirror device 110 with a built-in imaging device according to the second embodiment viewed from below. FIG. 16 is a schematic view of the room mirror device 110 with a built-in imaging device as viewed from the windshield side.

  For example, as illustrated in FIG. 15, the room mirror device 110 with a built-in imaging device includes a first imaging device 201-with respect to the rotation center axis a of the first housing portion 302 in the second housing portion 304. 1 may be further provided with a second imaging device 201-2 arranged on the opposite side of the first imaging device 201-2.

  The imaging device built-in room mirror device 110 configured as described above is capable of well-known stereo photography, and is based on the parallax images of the first imaging device 201-1 and the second imaging device 201-2. The distance information to the obstacle ahead of 100 can be detected.

  Note that FIG. 16A illustrates an example in which the imaging device 201-1 has the same configuration as the imaging device 201 in the first embodiment. That is, the imaging device 201-1 has two light sources. On the other hand, the imaging device 201-2 may be an imaging device having a general configuration that does not have a light source therein.

  Accordingly, an opening 306 is formed in the mounting plate 305 so as not to block the optical paths of the emitted light from the two light sources of the imaging device 201-1, and the imaging of the two imaging devices 201-1 and 201-2. Lens openings 307-1 and 307-2 are respectively formed.

  FIG. 16B shows an example in which both of the two imaging devices 201-1 and 201-2 have the same configuration as the imaging device 201 in the first embodiment. That is, each of the imaging devices 201-1 and 201-2 has two light sources.

  Accordingly, openings 306-1 and 306-2 are formed in the mounting plate 305 so as not to block the optical paths of the emitted light from the four light sources, and openings 307-1 and 307-2 for the imaging lens are formed. Each is formed.

  The imaging apparatus built-in room mirror apparatus 110 configured as shown in FIG. 16B can detect a raindrop adhesion state with two imaging apparatuses, thereby making it possible to broaden the raindrop detection region and improve detection accuracy. Can do.

DESCRIPTION OF SYMBOLS 10 Normal 21, 22, 23 Optical axis 100 Vehicle 101, 110 Image pickup apparatus built-in room mirror apparatus (imaging unit)
DESCRIPTION OF SYMBOLS 102 Image analysis unit 103 Headlamp control unit 104 Headlamp 105 Front glass 105a Inner wall surface 105b Outer wall surface 106 Wiper control unit 107 Wiper 108 Vehicle travel control unit 201, 201-1 1st imaging device 201-2 2nd imaging device 202, 202-1, 202-2, 202-3 Light source 203 Raindrop 203a Background image 204 Imaging lens 205 Optical filter 206 Imaging element 206A Photodiode (light receiving element)
206B Microlens 207 Sensor substrate 208 Signal processing unit 211 Visible light transmission region 212 Infrared light transmission region 220 Substrate 221 Spectral filter layer (first spectral filter layer)
222 Region-divided spectral filter layer (second spectral filter layer)
223 Polarizing filter layer 224 Filler 301 Stay member 302 First casing 303 Room mirror (reflection mirror)
303a Reflecting surface 304 Second housing 305 Mounting plate 306, 306-1, 306-2 Opening 307, 307-1, 307-2 Opening

Japanese Patent No. 35673838

Claims (7)

A stay member fixed in the vehicle;
A first housing part rotatably supported by the stay member and covering the reflecting mirror with its reflecting surface exposed;
In an imaging device built-in room mirror device comprising: a second housing portion that is fixed by the stay member and accommodates the first imaging device;
The first imaging device is reflected by at least two light sources that emit light toward the windshield of the vehicle, an imaging element having a plurality of pixel arrays, and a foreign matter attached to an outer wall surface of the windshield. An imaging lens that collects light from the light source and light transmitted through the windshield from the outside of the vehicle toward the imaging device, and optics disposed between the imaging lens and the imaging device A filter, and the focal point of the imaging lens is set farther than the position of the outer wall surface of the windshield,
The at least two light sources are arranged separately on the upper side and the lower side of the imaging lens with respect to the vehicle height direction of the vehicle, and at least one light source irradiates light with an optical axis that is substantially parallel to the optical axis of the imaging lens. And
The optical filter is
A substrate transparent to the light in the use band;
A first spectral filter that is formed on the entire surface of the effective imaging region on the imaging lens side on the substrate and transmits only light having a wavelength component in the range of wavelengths λ1 to λ2 and λ3 to λ4 (λ1 <λ2 <λ3 <λ4). Layers,
A second spectral filter layer that is formed in a part of the effective imaging region on the imaging element side on the substrate and transmits only light having a wavelength component in the range of wavelengths λ3 to λ4. The surface of the spectral filter layer on the image sensor side is tightly bonded to the image sensor,
The second spectral filter layer is formed in two regions, an upper part and a lower part of the effective image pickup region, and the room mirror device with a built-in image pickup device.   2. The first imaging device is disposed in a side closer to a driver's seat of the vehicle with respect to a rotation center axis of the first casing portion in the second casing portion. An imaging device built-in room mirror device described in 1.   The first imaging device captures an image with a first exposure time for capturing the foreign matter attached to the outer wall surface of the windshield in the effective imaging region where the second spectral filter layer is formed, An image is captured at a second exposure time for capturing an image farther than the position of the outer wall surface of the windshield in an effective imaging region other than the effective imaging region where the second spectral filter layer is formed. The room mirror device with a built-in imaging device according to claim 1 or 2. Between the second spectral filter layer and the substrate,
In order from the substrate side, a polarizing filter layer formed of a wire grid, a filler covering the polarizing filter layer is formed,
The said polarizing filter layer has a polarization axis which shields the light of a polarization direction component orthogonal to the normal line of the inner wall face of the said windshield, The Claim 1 characterized by the above-mentioned. The imaging apparatus built-in room mirror apparatus of description. A second imaging device disposed on the opposite side of the first imaging device with respect to a rotation center axis of the first housing portion in the second casing portion;
The distance information to the obstacle ahead of the vehicle is detected based on parallax images of the first imaging device and the second imaging device. The room mirror device with a built-in imaging device according to the item.   The room mirror device with a built-in imaging device according to claim 5, wherein the second imaging device has the same configuration as the first imaging device. An imaging device built-in room mirror device according to any one of claims 1 to 6,
An image analysis unit that analyzes captured image data captured by the room mirror device with the built-in imaging device and detects foreign matter and vehicle peripheral information attached to the windshield;
A vehicle comprising: a wiper control unit that receives a foreign object detection result of the image analysis unit and generates a control signal for controlling the wiper.