JP2008126794A - External information display device for vehicle - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a highly practical driving support tool capable of displaying an image selectively out of a plurality of images according to the use of a driver. <P>SOLUTION: This external information display device for a vehicle is provided with a distance image sensor consisting of a source of luminescence and a camera, and a display device receiving information outside the vehicle by this distance image sensor and displaying it as the image inside the vehicle compartment. It is further provided with a selecting means for selecting one image from the plurality of images that can be output from the distance image sensor and showing it on the display device. The output image selected by the driver by using this selecting means is shown on the display device. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an external information display device for a vehicle, and in particular, when displaying information outside a vehicle obtained by a distance image sensor in a vehicle interior by a display device, it enables selective display of an image according to a driver's use. The present invention relates to a vehicle external information display device.

In a vehicle, as a sensor for detecting the distance to an object outside the vehicle, propagation from sending an ultrasonic wave to the target space until receiving a reflected wave reflected by an object in the target space There are ultrasonic sensors that measure the distance to an object based on time.
Such an ultrasonic sensor is used to detect a distance to an obstacle behind the vehicle and an obstacle ahead.
Further, for example, there is an obstacle monitoring device that monitors an obstacle behind the vehicle. In this obstacle monitoring apparatus, an ultrasonic sensor is attached to the rear part of the vehicle body, and an alarm is issued when the distance to the obstacle behind the vehicle is shorter than a predetermined distance.
Furthermore, in the obstacle monitoring device for monitoring obstacles in front of the vehicle, an ultrasonic sensor is attached to the front part of the vehicle body, and the distance between the obstacles in front of the vehicle, for example, another vehicle that travels ahead when traveling is measured. In some cases, when the distance between vehicles becomes shorter than a predetermined distance, an alarm signal is issued to cause the computer that controls the braking device to brake.
However, in the ultrasonic sensor described above, the distance to the object is detected by the ultrasonic sensor based on the ultrasonic wave propagation time, but the ultrasonic wave propagation direction is shifted by the wind or the sound speed changes relatively. As a result, there is a problem that a distance measurement error occurs, and the obstacle monitoring apparatus using such an ultrasonic sensor has a problem that the measurement accuracy of the distance to the obstacle cannot be obtained sufficiently.
In addition, since the sound speed changes depending on the temperature change, there is a problem that a measurement error due to the temperature change occurs.
Furthermore, in a reflection type ultrasonic sensor that transmits and receives with one ultrasonic transducer, the reflected wave cannot be received until a predetermined time elapses after the ultrasonic wave is transmitted. There was a problem that a dead zone occurred in a range from the front surface of the acoustic wave transducer to a certain distance.
For this reason, there is also a vehicle distance image sensor that has no dead zone in the vicinity of the mounting position and can obtain accurate distance information to the target object, and an obstacle monitoring device using the same (see Patent Document 1 described later).

JP 2006-172210 A

By the way, in the conventional external information display device for vehicles, the back camera system having a function of displaying the rear of the vehicle includes a car navigation or the like that displays a camera image that is an image of the rear of the vehicle when the shift lever is switched to the reverse position. It has a function to project on the monitor.
This is a system that supports backward confirmation when the vehicle is moving backward.
That is, the back camera system 103 includes, for example, a back camera 113, a power supply unit 105, and a display device 106 including a car navigation system, as shown in FIG.
Further, it also includes a reverse detection means 107 for detecting a reverse signal and an accessory power source 108.
When the reverse detection means 107 detects the reverse state of the shift lever, a reverse signal from the reverse detection means 107 is transmitted to the power supply unit 105, and the power from the accessory power supply 108 is supplied to the power supply unit 105. And supplied to the display device 106.
At this time, power is supplied to the back camera 113 from the power supply unit 105 to which power is supplied, and an image is transmitted from the back camera 113 to the power supply unit 105.
The video transmitted to the power supply unit 105 is transmitted to the display device 106, and the video is displayed on a monitor (not shown) of the display device 106.
Next, the control operation of the back camera system will be described.
As shown in FIG. 11, the control program is started, and after the accessory power supply is turned on (C01), the process proceeds to reverse ON, that is, the determination whether the reverse detection means detects the reverse state (C02).
If the determination (C02) is NO, the determination (C02) is repeated until this determination (C02) becomes YES.
If the determination (C02) is YES, a process of displaying the video from the back camera on the display device (C03) is performed, and then the reverse ON, that is, the reverse detection means detects the reverse state. The process returns to the determination (C02) of whether or not it has been performed.

The display device also has a function of displaying a guideline for parking on a monitor and a function of displaying a predicted trajectory line linked to the steering angle.
However, on the camera side, it is a function that only displays an image, and the presence of an obstacle is determined by the driver.
In such a case of simply projecting the image of the rear of the vehicle, there is an inconvenience that the driver may not always look at the monitor when the vehicle moves backward, and the driver may miss an obstacle.
In addition, there is an inconvenience that it is difficult to see an obstacle in a dark place such as at night.

  Further, the vehicle external information display device may be provided with a distance image sensor composed of a light emitting source and a camera. However, an improvement in attaching the distance image sensor to the vehicle has been desired.

  An object of the present invention is to provide a highly practical driving support tool that enables selective display of an image according to a driver's use from a plurality of images.

  Therefore, in order to eliminate the above-described disadvantages, the present invention includes a distance image sensor including a light emitting source and a camera. The distance image sensor obtains information outside the vehicle and displays it as an image in the vehicle interior. A vehicle external information display device comprising a display device, comprising: selection means for selecting one image from a plurality of images that can be output from the distance image sensor and projecting the selected image on the display device. An output image selected by the driver using the means is displayed on the display device.

As described above in detail, according to the present invention, a display device that includes a distance image sensor including a light emitting source and a camera, obtains information outside the vehicle by the distance image sensor, and displays the information as an image in the vehicle interior. A vehicle external information display device comprising: selection means for selecting one image from a plurality of images that can be output from the distance image sensor and projecting it on the display device; and driving using the selection means The output image selected by the person is displayed on the display device.
Therefore, by combining the distance image sensor and the selection unit, it is possible to select and display an image according to the use of the driver from a plurality of images.
As a result, it is possible to realize a driving support tool capable of improving safety with a simple system configuration.

  By inventing as described above, when displaying external information using the vehicle external information display device, the selecting means selects one image from a plurality of images that can be output from the distance image sensor. Thus, it is possible to select and display an image according to the use of the driver from a plurality of images simply by projecting it on the display device and combining the distance image sensor and the selection means.

  Embodiments of the present invention will be described below in detail with reference to the drawings.

1 to 4 show a first embodiment of the present invention.
In FIG. 6, 1 is a vehicle, 2 is a compartment of the vehicle 1, and 3 is a vehicle external information display device.
As shown in FIGS. 2 to 4, the vehicle external information display device 3 includes a distance image sensor 4 including an infrared or near-infrared light source 12 and a camera 13, which will be described later, an image processing DSP controller 5, And a display device 6 composed of car navigation (also referred to as “GPS”).
At this time, the distance image sensor 4 is disposed, for example, at the central portion of the back door 1-1 of the vehicle 1 as shown in FIGS. 2 (a) and 2 (b).
The vehicle external information display device 3 also includes a reverse detection means 7 for detecting a reverse signal and an accessory power supply 8.
At this time, the display device 6 obtains information outside the vehicle 1 by the distance image sensor 4 and displays it on the monitor 9 in the passenger compartment 2 as an image as shown in FIG.
Further, the vehicle external information display device 3 selects one image from a plurality of images that can be output from the distance image sensor 4 and includes an image changeover switch for displaying the selected image on the display device 6. Means 10 is provided, and an output image selected by the driver using the selection means 10 is displayed on the display device 6.

Specifically, as shown in FIG. 4, when the reverse detection means 7 detects a reverse state of a shift lever (not shown), the external information display device 3 for a vehicle outputs from the reverse detection means 7. A reverse signal is transmitted to the image processing DSP controller 5, and power from the accessory power supply 8 is supplied to the image processing DSP controller 5 and the display device 6.
At this time, power is supplied from the image processing DSP controller 5 to which power is supplied to the distance image sensor 4, and video is transmitted from the distance image sensor 4 to the image processing DSP controller 5.
The video transmitted to the image processing DSP controller 5 is transmitted to the display device 6, and the video is displayed on the monitor 9 of the display device 6.
That is, the vehicle external information display device 3 has a basic system of a conventional back camera.
The vehicle external information display device 3 is different from the conventional one in that there are a plurality of output images of the distance image sensor 4, and therefore the selection means 10 for selecting a video to be displayed is added. When switching images, an operation of the selection means 10, for example, a switch operation is required.

In addition, as the output image of the distance image sensor 4, as shown in FIGS. 2C to 2E, a “brightness image”, a “distance image”, an “obstacle enhancement image”, and the like can be given. It is done.
The “luminance image” is a normal monochrome image as shown in FIG.
Further, the “distance image” is an image representing distance data for each pixel as shown in FIG. 2D, and can be color-coded according to the distance.
That is, the “distance image” that is one of the plurality of images output from the distance image sensor 4 is an image that can recognize the distance between the obstacle 11 that is the projected object and the vehicle 1.
Therefore, the distance to the obstacle 11 can be recognized without providing a sensor for detecting the distance to the obstacle 11 that is an object, and this is an effective function especially when parking in a narrow space.
Furthermore, as shown in FIG. 2E, the “obstacle-enhanced image” recognizes an object closer to the road surface as the obstacle 11 and highlights only that area on the luminance image (for example, coloring). Or framed frame).

When the driver selects an output image using the selection unit 10, a selection signal is transmitted from the selection unit 10 to the image processing DSP controller 5, and the output image selected by the driver is displayed on the display device 6. It is what
Therefore, by using the distance image sensor 4, it is possible to switch the output image composed of the above “brightness image”, “distance image”, “obstacle enhancement image” and the like according to the driver's preference. It is possible to detect the obstacle 11 that could not be obtained with the camera.
The distance image sensor 4 has an infrared or near-infrared light source 12 so that a bright image close to daytime can be obtained even at night.
Furthermore, by combining the distance image sensor 4 and the selection means 10, it is possible to select and display an image according to the driver's use from a plurality of images.
As a result, it is possible to realize a driving support tool capable of improving safety with a simple system configuration.

The selection means 10 has a determination function for determining whether it is daytime or nighttime, and the displayed image differs depending on the determination result.
That is, when the plurality of output images are switched by the selection means 10, it is common to use a switch. For example, a “brightness image” in the daytime and an “obstacle enhancement image” in the nighttime, Switching is set according to the ambient brightness.
At this time, as a measure to determine whether it is daytime or nighttime, a method to determine the time zone by obtaining the time from the car navigation, a method to determine the night by turning on / off the small light, a separate illuminance sensor A method for determining the brightness by using it can be considered.
Therefore, it is possible to display an optimal image according to the situation outside the vehicle 1 and to realize a highly safe vehicle 1.

Here, the principle of the distance image sensor 4 will be described.
As shown in FIG. 3, the distance image sensor 4 includes the light emission source 12 such as a near infrared LED and a camera 13 such as a CCD camera or a CMOS camera.
The distance image sensor 4 is based on the principle that the projection light is emitted from the light source 12 to the obstacle 11 that is the object, and the reflected light from the obstacle 11 is received by the camera 13.

  Next, the operation will be described along the control flowchart of the vehicle external information display device 3 of FIG.

After the control program of the vehicle external information display device 3 is started and the accessory power source is in the ON state (A01), it is determined whether reverse ON, that is, whether the reverse detection means 7 has detected the reverse state of the shift lever. Move to (A02).
If the determination (A02) is NO, the determination (A02) is repeated until the determination (A02) becomes YES.
If the determination (A02) is YES, the process proceeds to determination (A03) as to whether or not the driver has selected an output image using the selection means 10 including an image changeover switch or the like.

When the determination (A03) is NO in the determination (A03) of whether or not the driver has selected an output image using the selection means 10 including an image changeover switch or the like, the above-described reverse ON, that is, the reverse The process returns to the determination (A02) of whether or not the detection means 7 has detected the reverse state of the shift lever.
If the determination (A03) is YES, the respective image processing is performed.

That is, since the output image includes “luminance image”, “distance image”, “obstacle enhancement image”, and the like, image processing from 1 to n is performed.
First, in the first process (A04), an image process 1 (A05) is performed, and an image display process (A10) on the monitor 9 of the display device 6 is performed.
In the second process (A06), image process 2 (A07) is performed, and an image display process (A10) on the monitor 9 of the display device 6 is performed.
Further, in the n-th process (A08), an image process n (A09) is performed, and an image display process (A10) on the monitor 9 of the display device 6 is performed.
After the image display process (A10), the process returns to the above-described reverse ON, that is, the determination (A02) as to whether or not the reverse detection means 7 has detected the reverse state of the shift lever.

Accordingly, the display device 6 includes a distance image sensor 4 including a light emission source 12 and a camera 13, acquires information outside the vehicle 1 by the distance image sensor 4, and displays the information in the passenger compartment 2 as an image. The vehicle external information display device 3 includes a selection means 10 for selecting one image from a plurality of images that can be output from the distance image sensor 4 and displaying the selected image on the display device 6. An output image selected by the driver using the selection means 10 is displayed on the display device 6.
Therefore, by combining the distance image sensor 4 and the selection means 10, it is possible to select and display an image according to the driver's use from a plurality of images.
As a result, it is possible to realize a driving support tool capable of improving safety with a simple system configuration.

The selection means 10 has a determination function for determining whether it is daytime or nighttime, and the displayed image differs depending on the determination result.
Therefore, it is possible to display an optimal image according to the situation outside the vehicle.
Thereby, a highly safe vehicle can be realized.

Furthermore, one of the plurality of images output from the distance image sensor 4 is an image that can recognize the distance between the obstacle 11 that is a projected object and the vehicle 1.
Accordingly, the distance to the obstacle 11 can be recognized without providing a sensor for detecting the distance to the obstacle 11 that is an object.
This is an effective function especially when parking in a narrow space.

5 to 9 show a second embodiment of the present invention.
In the second embodiment, portions that perform the same functions as those of the first embodiment will be described with the same reference numerals.

  A feature of the second embodiment is that the distance image sensor 21 includes a light emitting source 23 provided in a rear combination lamp (also referred to as a “rear combination lamp”) 22 composed of LEDs of the vehicle 1, and a back surface. The camera 24 provided on the door 1-1 is configured to display the rear information of the vehicle 1 obtained by the distance image sensor 21 on the display device 6.

That is, as shown in FIGS. 6 and 7, the vehicle external information display device 3 includes a distance image sensor 21 including a light source 23 and a camera 24 synchronized with the light source 23, and an image processing DSP controller 5. And a display device 6 composed of car navigation (also referred to as “GPS”).
At this time, the camera 24 of the distance image sensor 21 is disposed, for example, at a central portion of the back door 1-1 of the vehicle 1.
The vehicle external information display device 3 also includes a reverse detection means 7 for detecting a reverse signal and an accessory power supply 8.
The display device 6 obtains information outside the vehicle 1 by the distance image sensor 21 and displays it on a monitor (not shown) in the passenger compartment 2 as an image.

The vehicle external information display device 3 includes an image changeover switch for selecting one image from a plurality of images that can be output from the distance image sensor 21 and displaying the selected image on the display device 6. It is also possible to provide the selection means 10.
The selection means 10 has a function of displaying an output image selected by the driver using the selection means 10 on the display device 6.

When the reverse detection means 7 detects a reverse state of a shift lever (not shown), the vehicle external information display device 3 receives the reverse signal from the reverse detection means 7 as the image processing DSP controller 5. And the power from the accessory power supply 8 is supplied to the image processing DSP controller 5 and the display device 6.
At this time, power is supplied to the distance image sensor 4 from the image processing DSP controller 5 to which power is supplied, and a video is transmitted from the distance image sensor 21 to the image processing DSP controller 5.
The video transmitted to the image processing DSP controller 5 is transmitted to the display device 6, and the video is displayed on the monitor of the display device 6.
That is, the vehicle external information display device 3 has a basic system of a conventional back camera.

  If it adds, the said external information display apparatus 3 for vehicles will connect the said light emission source 23 and the camera 24 synchronized with this light emission source 23 with respect to the obstruction 11 which is a target object on the property of the said distance image sensor 21. Since it is necessary to be located at the same distance, as shown in FIG. 6, the light source 23 is incorporated in the rear combination lamp 22 of the vehicle 1 as described above, and the camera 24 is installed in the center of the back door 1-1 of the vehicle 1. It is the most optimal arrangement state to arrange in the part.

Here, an example in which the light emitting source 23 is incorporated in the rear combination lamp 22 of the vehicle 1 will be described.
As shown in FIG. 8, the rear combination lamp 22 is formed in a circular shape, for example, and four brake lamps 25 are arranged at equal circumferential intervals.
That is, for example, as shown in FIG. 8, the brake lamps 25 are arranged at four locations on the left and right upper and lower parts of the rear combination lamp 22.
Then, the five light emitting sources 23 are arranged in a portion excluding these brake lamps 25, for example, in a cross shape.
Since the near-infrared LED is often used as the light source 23 of the distance image sensor 21, if a LED tail lamp that has been widespread in recent years is adopted, there is no particular sense of incongruity, and the light source within the rear combination lamp 22 is used. 23 can be incorporated.

Further, due to the nature of the distance image sensor 21, the light source 23 and the camera 24 need to be synchronized. However, even when the light source 23 is incorporated in another place as described above, the light source 23 is a camera. 24 and a cable 26, and synchronization is possible.
In other words, the light source control timing chart shown in FIG. 9 will be described. As shown in FIG. 9A, the reverse detection means 7 detects the reverse state of the shift lever, and the reverse detection means 7 outputs a reverse signal. When transmitted to the image processing DSP controller 5, simultaneously with the input of the reverse signal, the camera 24 starts operating as shown in FIG. 9B, and from the camera 24 as shown in FIG. 9C. A synchronization signal is output to the light emission source 23, and the light emission source 23 also starts to operate as shown in FIG. 9 (d).

When the distance image sensor 21 is constituted by the light emitting source 23 provided in the rear combination lamp 22 and the camera 24 provided in the back door 1-1, the vehicle 1 obtained by the distance image sensor 21 is obtained. The backward information is displayed on the display device 6.
At this time, since the light source 23 of the distance image sensor 21 is incorporated in the rear combination lamp 22, only the camera 24 may be newly attached to the back door 1-1, and the sensor can be miniaturized. It is possible to increase the degree of freedom of sensor mounting.

  Next, the operation will be described along the control flowchart of the vehicle external information display device 3 of FIG.

After the control program of the vehicle external information display device 3 is started and the accessory power source is turned on (B01), reverse ON, that is, whether or not the reverse detection means 7 has detected the reverse state of the shift lever is determined. Move on to (B02).
If the determination (B02) is NO, the determination (B02) is repeated until the determination (B02) becomes YES.
If the determination (B02) is YES, a process for operating the distance image sensor 21 including the light emitting source 23 provided in the rear combination lamp 22 and the camera 24 provided in the back door 1-1. The process proceeds to (B03), and then image display processing (B04) is performed.
After the image display process (B04), the process returns to the above-described reverse ON, that is, the determination (B02) as to whether or not the reverse detection means 7 has detected the reverse state of the shift lever.

In other words, the distance image sensor 21 includes a light emission source 23 provided in a rear combination lamp 22 constituted by LEDs of the vehicle 1 and a camera 24 provided on a back door 1-1, and the distance image The rear information of the vehicle 1 obtained by the sensor 21 is displayed on the display device.
Therefore, since the light emission source 23 of the distance image sensor 21 is incorporated in the rear combination lamp 22, only the camera 24 needs to be newly attached to the back door 1-1, so that the sensor can be miniaturized.
This increases the degree of freedom of sensor mounting.

  The present invention is not limited to the first and second embodiments described above, and various application modifications can be made.

For example, in the second embodiment of the present invention, the distance image sensor is used as a back camera. However, when the distance image sensor is not used as a back camera but is used as a distance sensor in front of the vehicle, for example, It is also possible to adopt a special configuration in which the camera is incorporated in the front grille and the light source is incorporated in the headlamp.
Then, the distance image sensor can function as a distance sensor in front of the vehicle, and the light source and the camera synchronized with the light source are positioned at the same distance with respect to the obstacle that is the object. be able to.

It is a flowchart for control of the external information display apparatus for vehicles which shows 1st Example of this invention. It is a figure explaining the system outline | summary of the external information display apparatus for vehicles, (a) is a rear view of a vehicle, (b) is a top view of a vehicle, (c) is "luminance image" of the output image of a distance image sensor. FIG. 6D is a diagram for explaining a “distance image” of the output image of the distance image sensor, and FIG. 9E is a diagram for explaining an “obstacle enhancement image” of the output image of the distance image sensor. It is explanatory drawing which shows the principle of a distance image sensor. It is a system block diagram of the external information display apparatus for vehicles. It is a flowchart for control of the external information display apparatus for vehicles which shows 2nd Example of this invention. It is a figure explaining the system outline | summary of the external information display apparatus for vehicles, (a) is a rear view of a vehicle, (b) is a top view of a vehicle. It is a system block diagram of the external information display apparatus for vehicles. It is a schematic explanatory drawing which shows the example of light source incorporation. FIG. 6 shows an example of a light source control timing chart, where (a) shows a reverse signal, (b) shows a camera power supply, (c) shows a synchronization signal (from the camera to the light source), and (d) shows a light source. The figure shown, (e) is a figure which shows an image | video. It is a system block diagram of the external information display apparatus for vehicles which shows the prior art of this invention. It is a flowchart for control of the external information display device for vehicles.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Vehicle 1-1 Back door 2 Car compartment 3 Vehicle external information display apparatus 4 Distance image sensor 5 Image processing DSP controller 6 Display apparatus 7 Reverse detection means 8 Accessory power supply 9 Monitor 10 Selection means 11 Obstacle 12 Light emission source 13 Camera

Claims (4)

  In a vehicle external information display device including a distance image sensor including a light emitting source and a camera, and a display device that obtains information outside the vehicle by the distance image sensor and displays the information as an image in the vehicle interior. A selection means for selecting one image from a plurality of images that can be output from the distance image sensor and projecting the selected image on the display device, and an output image selected by the driver using the selection means, An external information display device for a vehicle, which is displayed on a display device.   The distance image sensor is composed of a light source provided in a rear combination lamp composed of LEDs of a vehicle and a camera provided on a back door, and the rear information of the vehicle obtained by the distance image sensor is displayed on the display device. The vehicle external information display device according to claim 1, wherein the vehicle external information display device is displayed.   The vehicle external information display device according to claim 1, wherein the selection unit includes a determination function for determining whether it is daytime or nighttime, and an image displayed is different depending on a determination result. 2. The vehicle external information display according to claim 1, wherein one of the plurality of images output from the distance image sensor is an image capable of recognizing a distance between the projected object and the vehicle. apparatus.