JP5179428B2 - Vehicle periphery monitoring device - Google Patents

Description

  The present invention relates to an apparatus for monitoring the periphery of a vehicle using light projection.

  2. Description of the Related Art Conventionally, an image pickup apparatus is mounted on a vehicle, an object such as a pedestrian existing around the vehicle is detected, and driving is supported by notifying the driver of the information.

  Patent Document 1 below includes a traveling projector that projects visible light and near infrared light, and a passing projector that projects visible light. When the night vision device is activated, both projectors are turned on. Then, an image obtained by photographing a near infrared ray reflected by an object with a night vision camera is displayed on a display device while illuminating the vicinity of the vehicle front side. Here, since the visible light from the traveling projector is blocked by the filter, an image can be displayed without dazzling the driver of the oncoming vehicle or the preceding vehicle.

JP-A-2005-29066

  As in the above-mentioned patent document, for example, a Si (silicon) -based image sensor is used in a conventional night vision camera that images near-infrared rays. In the case of a typical Si-based image sensor, in the near infrared region, the sensitivity decreases as the wavelength increases. Therefore, imaging is performed using near-infrared light having a higher sensitivity, that is, a wavelength closer to the visible light region. However, if light having a wavelength close to the visible light region is used, there is a risk of dazzling pedestrians around the vehicle and drivers of other vehicles.

  Further, the sensitivity of the image sensor to near-infrared light is lower than that of visible light, and the sensitivity of the normal CCD camera to near-infrared light may obscure the captured image. In order to avoid this, it may be necessary to use a more expensive imaging device with improved sensitivity to near infrared light.

  Further, a projector such as a headlamp of a vehicle includes near-infrared light as described in Patent Document 1 described above. In the document 1, the near-infrared light is used to perform night vision. Imaging with a camera. However, if the near-infrared light having sensitivity in the image pickup device and the near-infrared light from the vehicle projector have the same wavelength, the near-infrared light from the projector of one system will pass when passing by an oncoming vehicle equipped with the same system. Infrared light is sensed by the imaging device of the other system, which may cause halation or noise.

  Therefore, there is a demand for an apparatus that can detect an object around the vehicle without causing the above-described problems.

  According to one aspect of the present invention, there is provided a vehicle periphery monitoring device that includes an imaging device mounted on a vehicle and detects an object around the vehicle from a captured image captured by the imaging device. A light projecting means for projecting light, the light projecting means configured to project light having a wavelength lower than a predetermined value of the sensitivity of the imaging device of the imaging device, and the sensitivity of the imaging device of the imaging device is a predetermined value A wavelength conversion film for converting the wavelength of the reflected light obtained by reflecting the light having a lower wavelength on the object into light having a sensitivity higher than a predetermined value. The imaging device generates a captured image by receiving the light converted by the wavelength conversion film by the imaging element.

  According to the present invention, the wavelength conversion film converts light having a low sensitivity of the image sensor into light having a high sensitivity of the image sensor, so that the projected light is limited by the sensitivity characteristics of the image sensor. Therefore, it is possible to select light having a wavelength farther from the visible light region as light to be projected. Thereby, it is possible to prevent a pedestrian around the vehicle and a driver of another vehicle from being dazzled by the light projection. In addition, since the wavelength conversion film converts light having a wavelength with a low sensitivity of the imaging element into light having a wavelength with a high sensitivity of the imaging element, the sensitivity of the imaging apparatus can be maintained favorably. In order to improve the sensitivity, it is not necessary to use a more expensive imaging device, and an existing imaging device such as a Si-based imaging device can be used. Furthermore, since light having a wavelength with low sensitivity of the image sensor is projected, even when the same system is mounted on the oncoming vehicle, it is possible to suppress the occurrence of halation and noise in each image pickup apparatus.

  In one embodiment of the present invention, the light having a wavelength lower than the predetermined value of the sensitivity of the image pickup device of the image pickup device is invisible light, and the image pickup device has high sensitivity in a visible light wavelength region. The captured image is generated as a first captured image. Further, based on the second captured image, means for generating a second captured image by receiving reflected light, which is reflected from an object, without using the wavelength conversion film, by the image sensor. And determining whether the output signal of the image sensor is saturated, and if the saturation determination means determines that the output signal of the image sensor is saturated, the first imaging Selection means for selecting an image and selecting the second captured image if the saturation determination means does not determine that the output signal of the image sensor is saturated. The object is detected from the first or second captured image selected by the selection means.

  When the surroundings of the vehicle are bright, for example, when an oncoming vehicle lights up the headlight or when an oncoming vehicle projects near-infrared light, the above saturation may occur. Makes it difficult to detect an object. According to the present invention, in a state where such saturation does not occur, object detection is performed using an image captured by visible light (second captured image). When such saturation occurs When the determination is made, the method is switched to a method of detecting an object using an image (first captured image) captured by converting the wavelength of invisible light. Therefore, it is possible to detect an object suitable for the amount of light around the vehicle, so that the detection accuracy of the object can be maintained well.

  Other features and advantages of the present invention will be apparent from the detailed description that follows.

The block diagram which shows the structure of the vehicle periphery monitoring apparatus according to one Example of this invention. The figure for demonstrating the attachment position of a projector and an imaging device according to one Example of this invention. 1 is a block diagram of an imaging device according to an embodiment of the present invention. The figure which shows the spectral sensitivity characteristic of the image pick-up element according to one Example of this invention. The figure which shows the structure of the wavelength conversion film according to one Example of this invention. The block diagram of the imaging device according to the other Example of this invention. The functional block diagram of the image processing unit according to one Example of this invention. 4 is a flowchart of processing executed by the image processing unit according to one embodiment of the present invention.

  Next, an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of a vehicle periphery monitoring device according to an embodiment of the present invention. The apparatus includes a projector 1 mounted on a vehicle so as to project predetermined light in front of the vehicle, an imaging device 3 mounted on the vehicle so as to image an object existing in front of the vehicle, A driving state detection unit 5 for detecting a driving state, an image processing unit 7 for detecting an object around the vehicle based on image data obtained by the imaging device 3 while using the detected driving state, and the detection A speaker 9 that generates a warning by sound based on the result, and a display device 11 that displays an image obtained by the imaging device and makes the driver recognize an object around the vehicle are provided.

  The image processing unit 7 includes an A / D conversion circuit that converts an input analog signal into a digital signal, an image memory that stores a digitized image signal, a central processing unit (CPU) that performs various arithmetic processing, and a data RAM (Random Access Memory) used to store data, ROM (Read Only Memory) that stores programs to be executed by the CPU and data to be used (including tables and maps), driving signals for the speaker 9, and display for the display device 11 An output circuit for outputting signals and the like is provided. The output signal of the imaging device 3 is converted into a digital signal and input to the CPU.

  Referring to FIG. 2, in this embodiment, as shown as 1R and 1L, the projector 1 is arranged on the front bumper portion of the vehicle 21 one by one on the left and right sides so as to project light in front of the vehicle. It is attached so that the height from the road surface becomes equal. The imaging device 3 is attached to the back side of the room mirror in the passenger compartment so as to capture the front of the vehicle.

  The projector 1 is configured to project light having a wavelength at which the sensitivity of the imaging device of the imaging device 3 is lower than a predetermined value, and preferably projects light having a wavelength at which the sensitivity of the imaging device of the imaging device 3 does not occur. It is configured to As the light source of the projector 1, for example, a halogen lamp, a light emitting diode (LED), a laser, or the like can be used.

  FIG. 3 shows a schematic configuration of the imaging apparatus 3. The imaging device 3 is arranged to transmit the light that has passed through the lens 31, the light that has passed through the lens 31, and is arranged to receive the light that has passed through the filter 33, the filter 33 that blocks light having a specific wavelength, A wavelength conversion film 35 that converts the wavelength, and an image sensor 37 that is arranged to receive the light converted by the wavelength conversion film 35 are provided.

  The filter 33 is configured to block light other than the wavelength of the light projected by the projector 1. Therefore, the filter 33 can pass the reflected light reflected when the light projected by the projector 1 hits the object.

  The wavelength conversion film 35 is configured to convert the wavelength of the light transmitted through the filter 33, that is, the reflected light of the light from the projector 1. The converted wavelength is set to a wavelength at which sensitivity is generated in the image sensor of the image sensor 37, and is preferably set to a wavelength at which the highest sensitivity is generated in the image sensor 37. The wavelength-converted light enters the image sensor 37.

  The image sensor 37 is configured to have an array in which photodiodes that are photoelectric conversion elements that convert received light into electricity are two-dimensionally arranged. For example, a so-called CCD image sensor or CMOS image sensor, which is a Si (silicon) -based solid-state imaging device, can be used. The image sensor 37 generates a captured image by receiving the incident light with each photodiode arrayed two-dimensionally. The higher the luminance of the object to be imaged, the higher the level of the signal output from the image sensor (that is, the higher the gradation value in the captured image).

  Referring now to FIG. 4, the spectral sensitivity characteristics of a Si-based solid-state imaging device that can be used for the image sensor 37 of this embodiment are shown, the horizontal axis represents wavelength (nm), and the vertical axis. Represents the relative sensitivity when the maximum sensitivity is set to the reference value 1. Since visible light has a wavelength of about 380 to 780 nm, it can be seen that the imaging device has high sensitivity in the visible light region. It has the highest sensitivity in the vicinity of a wavelength of about 550 nm. On the other hand, as shown by the spectral sensitivity characteristics, in the near-infrared wavelength region (about 780 nm or more), the sensitivity decreases as the wavelength increases, and no sensitivity occurs in the wavelength region of 1100 nm or more.

  Therefore, in one embodiment, the wavelength of 800 nm or more is selected as the wavelength at which the sensitivity of the image sensor is low, and the projector 1 is configured to project light having the wavelength (for example, near-infrared light having a wavelength of 800 nm). Is done. The filter 33 is configured to block wavelengths other than the wavelength of light from the projector 1, that is, block light having a wavelength smaller than 800 nm. The wavelength conversion film 35 converts received light having a wavelength of 800 nm or more into a wavelength of visible light having a high sensitivity of the image sensor, preferably about 550 nm, which is the wavelength having the highest sensitivity in the spectral sensitivity characteristics of FIG. Composed.

  In another more preferable embodiment, a wavelength of 1100 nm or more is selected as a wavelength at which the sensitivity of the image sensor does not occur, and the projector 1 projects light of the wavelength (for example, near-infrared light having a wavelength of 1100 nm). It is configured as follows. The filter 33 is configured to block wavelengths other than the wavelength of light from the projector 1, that is, block light having a wavelength smaller than 1100 nm. The wavelength conversion film 35 converts received light having a wavelength of 1100 nm or more into a wavelength of visible light having a high sensitivity of the image sensor, preferably about 550 nm, which is the wavelength with the highest sensitivity in the spectral sensitivity characteristics of FIG. Composed.

  As described above, according to the present invention, the wavelength of light projected from the projector 1 can be selected without being limited by the sensitivity of the image sensor 37, and thus is not perceived by the human eye (ie, Light in the wavelength region (invisible light) can be selected. Therefore, it is possible to prevent the pedestrians around the vehicle and the drivers of other vehicles from being dazzled by the light projection.

  When light having a wavelength close to the visible light region, for example, less than 800 nm, is projected, pedestrians around the vehicle and drivers of other vehicles may feel glare even with near infrared light. In particular, in the other embodiments described above, since light in a wavelength region (wavelength of 1100 nm or more) far from the visible light region is projected, such glare can be prevented more reliably.

  In addition, since the wavelength conversion film 35 converts light having a low wavelength of the image sensor 37 into light having a high sensitivity, the detection accuracy of the image sensor 37 can be maintained well. Further, by such wavelength conversion, known image sensors such as CCD and CMOS image sensors can be used, and the cost can be kept low.

  Furthermore, the wavelength of the light projected by the projector 1 is a wavelength at which the sensitivity of the image sensor 37 is low or no sensitivity occurs. Therefore, when passing by an oncoming vehicle equipped with the same system, it is possible to avoid the occurrence of halation and noise in the imaging device of the oncoming vehicle due to the light projected from the own vehicle, and the light is projected from the oncoming vehicle. It is possible to avoid the occurrence of halation or noise in the imaging device 3 of the own vehicle due to the light.

  Moreover, the light from the projector 1 of the present application is applied to the light emitted from the headlight (which may include near-infrared light) of the oncoming vehicle and the light projecting system mounted on the oncoming vehicle by the filter 33. Since it is possible to exclude light having a wavelength that is not included in the light, it is possible to prevent halation and noise from occurring.

  Furthermore, when the object to be detected is a pedestrian, the light of the wavelength selected as described above from the projector 1 has a relatively high reflectance of human clothes and hair, thus improving the detection performance. Can be made.

  The numerical values of 800 nm and 1100 nm described above are examples, and which wavelength is selected as the wavelength of the light to be projected should be adjusted according to the spectral sensitivity characteristics of the image sensor used as the image sensor 37. That is, as the light from the projector 1, light having a wavelength that is non-visible light and the sensitivity of the image sensor is equal to or lower than a predetermined value or zero is selected. The light having such a wavelength is configured to be converted into a wavelength at which the sensitivity of the image sensor is equal to or higher than a predetermined value or the highest sensitivity.

  5A shows a front view of the wavelength conversion film 35, and FIG. 5B shows a cross-sectional view of the wavelength conversion film 35. The wavelength conversion film 35 includes a plurality of spaces 41 that are separated from each other in the vertical direction and the horizontal direction and are two-dimensionally arranged. Each space 41 is filled with a phosphor 43. The wavelength conversion film having such a configuration can be formed by any appropriate technique. For example, each space 41 separated by the partition wall 47 is created on the glass substrate 45 by a well-known pattern transfer technique such as photolithography, and the phosphor is formed in the created space 41 by, for example, screen printing. 43 is applied (printed), and then the open side of the space 41 is sealed with a glass substrate 49.

  The phosphor 43 used here is a so-called up-conversion phosphor that converts (near) infrared light into visible light, and is an element that emits visible light when excited by infrared light (for example, Rare earth elements). As described above, the component (material) used as the phosphor 43 is selected based on the wavelength of the light of the conversion source and the wavelength of the light after the conversion, and when using an imaging device having spectral sensitivity characteristics as shown in FIG. Is selected to convert light having a wavelength of 800 nm or longer, preferably 1100 nm or longer, into light having a wavelength of approximately 550 nm.

  For example, in Japanese Patent Laid-Open Nos. 58-57114, 7-133135, and 2004-292599, near-infrared light having a wavelength of 800 nm or more is obtained using such an up-conversion phosphor. It describes that it is converted into visible light (green) having a wavelength of about 550 nm.

  FIG. 6 shows a schematic configuration of the imaging device 3 according to another embodiment of the present invention. The same components as those in FIG. 3 are denoted by the same reference numerals. The image pickup device 3 in FIG. 3 is picked up by the image sensor 37 by converting the reflected light of the light projected by the projector 1 with the wavelength conversion film 35. In FIG. 6, in addition to this image pickup path, An imaging path is provided in which visible light reflected by the object is directly received by the image sensor. Therefore, in addition to the configuration of the imaging device 3 in FIG. 3, a prism 51 and a further image sensor 53 are provided.

  Here, the image sensor 37 is referred to as a first image sensor, and the image sensor 53 is referred to as a second image sensor. The prism 51 is configured to separate visible light and (near) infrared light, and a known prism can be used.

  The light incident from the lens 31 is separated by the prism 51 into light in the (near) infrared wavelength region and light in the visible wavelength region, as indicated by reference numerals R1 and R2. The light in the infrared wavelength region is processed by the components as described with reference to FIG. That is, the light passes through the filter 33, undergoes wavelength conversion by the wavelength conversion film 35, and then is received by the first image sensor 37. On the other hand, light in the wavelength region of visible light is directly received by the second image sensor 53.

  Here, like the first image sensor 37, the second image sensor 53 is an image sensor in which photodiodes are two-dimensionally arranged, and both image sensors may have the same configuration. Alternatively, a color image may be generated by the second image sensor 53 by providing the second image sensor 53 with a color filter by a known method, for example.

  By adopting such a configuration, it is possible to separately detect both (near) infrared light and visible light with one input through the lens 31. Therefore, in a situation where there is sufficient light around the vehicle, such as daytime, and imaging is possible by directly receiving visible light, an object captured using the image captured by the second image sensor 53 is used. In a situation where sufficient light is not present around the vehicle and cannot be picked up only by visible light, such as at night, the object is detected by using the image picked up by the first image sensor 37. Can be detected, and the detection accuracy of the object can be maintained in any situation.

  FIG. 7 is a functional block diagram of the image processing unit 7 shown in FIG. The outline of the operation of the image processing unit 7 will be described with reference to FIG. In this embodiment, the imaging device 3 shown in FIG. 6 is used.

  The selection unit 61 determines whether the periphery of the vehicle is bright or dark based on the driving state of the vehicle detected by the driving state detection unit 5 (FIG. 1). Here, the light and dark can be determined by any appropriate technique.

  In one example, the driving state detection unit 5 detects whether the headlight of the vehicle is lit. If it is detected that the vehicle is lit, it is determined that the periphery of the vehicle is dark. If it is not detected that the vehicle is lit, it is determined that the periphery of the vehicle is bright.

  In another example, if the illuminance sensor that detects the illuminance around the vehicle is attached to the vehicle as the driving state detection unit 5 and the detected value of the illuminance sensor is equal to or less than a predetermined value (that is, the illuminance is low), Is determined to be dark, otherwise the vehicle surroundings are determined to be bright.

  If it is determined that the selection unit 61 is dark, the first image acquisition unit 63 is activated. The first image acquisition unit 63 activates the projector 1 to project infrared light having a wavelength as described above. The first image acquisition unit 63 receives the output signal of the first image sensor 37 of the imaging device 3 according to the reflected light, A / D converts it, and stores it in a predetermined image memory. The stored image data is referred to as a first captured image.

  On the other hand, if it is determined that the selection unit 61 is bright, the second image acquisition unit 65 is activated. The second image acquisition unit 65 receives the output signal of the second image sensor 53 of the imaging device 3, performs A / D conversion, and stores it in a predetermined image memory. The stored image data is referred to as a second captured image.

  Thus, either the first captured image generated by receiving the infrared light or the second captured image generated by receiving the visible light depending on whether or not the periphery of the vehicle is dark Is acquired.

  The target object detection unit 67 detects a desired target object from the first or second captured image thus acquired. The desired object may be any object, and may include, for example, not only an object such as a pedestrian or a preceding vehicle but also a traveling lane (white line) on a road. Any appropriate detection method can be adopted.

  On the other hand, the saturation determination unit 69 reads out the second captured image from the image memory, creates a histogram of gradation values of the captured image, and indicates that the gradation value is saturated (for example, the gradation value is predetermined). Count the number of pixels that are greater than or equal to the value or indicate a predetermined maximum value. If the number of saturated pixels is larger than a predetermined threshold, it is determined that halation (white light) has occurred in the second captured image, and it is determined that the pixel is saturated. It is difficult to detect an object well from an image in which such halation occurs.

  If the saturation determination unit 69 determines that saturation is detected, the object detection unit 67 prohibits performing object detection using the second captured image and activates the first image acquisition unit 63. Thus, the object detection unit 67 performs object detection using the first captured image acquired by the first image acquisition unit 63 when it is determined to be saturated. As described above, the result of the object detection is notified to the driver via the speaker 9 and / or via the display on the display device 11. In this case, since the surroundings of the vehicle are determined to be bright, no light projection by the projector 1 is required. Even if light projection is not performed, the sunlight includes light in the same wavelength band as the light used for light projection. Therefore, the reflected light reflected by the object is filtered by the filter 33 and the wavelength conversion film 35. By processing through the first image sensor 33, the first captured image can be acquired.

  As described above, when the periphery of the vehicle is dark, the object is detected using the first captured image obtained by performing light projection, and when the periphery of the vehicle is bright, the second captured image (described above). The object can be detected using a color image). Even when the surroundings of the vehicle are bright, for example, when the oncoming vehicle is wearing headlights or when the oncoming vehicle is projecting near-infrared light, the second captured image may be saturated. Based on the second captured image, the number of pixels with saturated gradation is counted, and when the number of saturated pixels is large, object detection is performed using the first captured image. In this way, it is possible to maintain good detection accuracy of the object in both cases where the periphery of the vehicle is bright and dark.

  FIG. 8 is a flow of a process executed by the image processing unit 7. This process can be performed at predetermined time intervals.

  Steps S11 and S12 are steps for determining whether the periphery of the vehicle is dark. In step S11, it is determined whether the headlight is turned on. In step S12, it is determined whether the illuminance around the vehicle (which can be detected by the illuminance sensor as described above) is equal to or less than a predetermined value. If the determinations in both steps S11 and S12 are Yes, it is determined that the periphery of the vehicle is dark, and the process proceeds to step S13. If the determination in any of steps S11 and S12 is No, it is determined that the periphery of the vehicle is bright, and the process proceeds to step S21.

  In step S13, it is determined whether the vehicle speed (for example, can be detected by a vehicle speed sensor attached to the vehicle) is greater than or equal to a predetermined value. This is for prohibiting light projection when the vehicle speed is lower than a predetermined value. Therefore, if the vehicle speed is equal to or higher than the predetermined value, the process proceeds to step S14. If the vehicle speed is lower than the predetermined value, the process proceeds to step S21.

  In step S <b> 14, a signal instructing activation is sent to the projector 1 to activate the projector 1. When the projector 1 is activated, as described above, infrared light having a wavelength with low or no sensitivity of the image sensor is projected, and a first captured image is generated by the first image sensor 37. Is done. In step S15, a first captured image generated by the first image sensor 37 is acquired. In step S16, an object detection process is performed using the acquired first captured image. In step S17, the driver is notified according to the detection result.

  On the other hand, in step S <b> 21, the second captured image generated by the second image sensor 53 is acquired. In step S22, a histogram of gradation values of the second captured image is created, and based on the histogram, the number of pixels whose gradation values are saturated is counted, and the counted number of pixels is equal to or less than a predetermined threshold value. Determine whether or not. If the number of pixels is equal to or less than the predetermined threshold value (Yes in step S22), it can be determined that no halation has occurred, and thus the process proceeds to step S16, and detection of an object is performed using the second captured image. Process. In step S17, the driver is notified according to the detection result.

  In step S22, if the counted number of pixels is larger than the predetermined threshold value, it can be determined that halation has occurred. Therefore, the process proceeds to step S15, and the first image sensor 37 generated by the first image sensor 37 is used. The captured image is acquired. As described above, since the process passes through steps S21 and S22, it is determined that the periphery of the vehicle is bright, and therefore, no light projection from the projector 1 is required. Therefore, if the determination in step S22 is No, the process proceeds to step S15 without executing step S14. In step S16, an object detection process is executed using the first captured image acquired in step S15. In step S17, the driver is notified according to the detection result. Note that the second captured image acquired in step S21 is discarded without being used.

  The timing to turn off the projector 1 activated in step S14 (the timing to stop the projection, for example, the timing to turn off the power of the projector 1) can be arbitrarily set. In one example, if the projector 1 is once activated and light irradiation is started in step S14, the activated state is continuously maintained. In this case, when step S14 is executed again, if the projector 1 is already activated, the state is maintained as it is, and the process proceeds to step S15. Thereafter, when any of the determinations in steps S11 to S13 is No (that is, when it is determined that the periphery of the vehicle is bright or the vehicle speed is lower than a predetermined value), the power of the projector 1 is turned off. can do.

  Further, in this process, it is determined whether or not the periphery of the vehicle is dark based on both the headlight and the illuminance. However, as described above, light and dark may be determined based on only one of them. In addition, in this process, it is determined that the headlight is not turned on, and when the two conditions that the illuminance is equal to or less than a predetermined value are satisfied, it is determined to be dark, thereby improving the accuracy of the determination. Alternatively, it may be determined that the image is dark when one of the conditions is satisfied.

  In the above embodiment, one imaging device is used, but a pair of imaging devices are installed on the left and right with the axle as the center, and the distance to the object of the captured image is calculated by so-called triangulation. You may be able to.

  In FIG. 6, the first image sensor 37 and the second image sensor 53 are separately arranged. However, since both may be image sensors having the same configuration, one image sensor is provided, You may make it make the structure of the imaging device 3 variable in the case where the 1st captured image is acquired, and the case where the 2nd captured image is acquired. For example, only when the first captured image is acquired, the filter 33 and the wavelength conversion so that the filter 33 and the wavelength conversion film 35 are arranged on the light receiving side of the one image sensor as shown in FIG. A moving mechanism for moving the film 35 may be provided.

  Further, the arrangement of optical components for allowing desired light to enter each image sensor is not limited to that shown in FIG. 6, and any appropriate form can be used. For example, in the embodiment of FIG. 6, the visible light and the infrared light are separated by the prism 51 so as to follow separate optical paths, but such separation may be performed by a filter. For example, the light from the lens is branched to the first and second optical paths using any optical component, and a filter that transmits (near) infrared light and a filter that transmits visible light are arranged in each optical path. can do.

  As described above, specific embodiments of the present invention have been described. However, the present invention is not limited to these embodiments.

1 projector 3 imaging device 7 image processing unit 11 display device 35 wavelength conversion film 37 first image sensor 53 second image sensor

Claims (1)

A vehicle periphery monitoring device that includes an imaging device mounted on a vehicle and detects an object around the vehicle from a captured image captured by the imaging device,
Projecting means for projecting light to the periphery of the vehicle, and projecting means configured to project light having a wavelength lower than a predetermined value of sensitivity of the imaging device of the imaging device;
A wavelength conversion film for wavelength-converting reflected light obtained by reflecting light having a wavelength lower than a predetermined value in an imaging device of the imaging device to light having a wavelength higher than the predetermined value.
With
The imaging device generates the captured image by receiving light converted by the wavelength conversion film by the imaging element,
And,
The light having a wavelength lower than the predetermined value of the sensitivity of the imaging device of the imaging device is invisible light, and the imaging device is an imaging device having high sensitivity in a visible light wavelength region,
A captured image generated by receiving the converted light with the image sensor is generated as a first captured image,
further,
Means for generating a second captured image by receiving reflected light, which is reflected from an object, without using the wavelength conversion film, by the imaging element;
Saturation determination means for determining whether an output signal of the image sensor is saturated based on the second captured image;
If it is determined by the saturation determining means that the output signal of the image sensor is saturated, the first captured image is selected, and the output signal of the image sensor is saturated by the saturation determining means. If not determined, selection means for selecting the second captured image;
Bei to give a,
The detection of the object is performed from the first or second captured image selected by the selection unit.
Car both periphery monitoring device.

Images