JP2007230314A - Video presenting device and video presenting method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video presenting device and a video presenting method capable of presenting the surrounding condition of the vehicle such as a dead angle area without impairing the natural checking action of a driver. <P>SOLUTION: The video presenting device comprises image pickup devices 11L, 11R for picking up images of the surrounding condition, right and left sides, of the vehicle with respect to the vehicle advancing direction, video display devices 13L, 13R for presenting the right and left sides of the image picked-up vehicle on the right and left forward sides of a driver, and a display control device 20 which specifies the checking action position requesting the checking action of the driver, and controls the presentation timing of the circumstance of the vehicle forward of the specified checking action position on the right and left sides of the vehicle to be presented on the right and left front sides of the driver by the video display devices 13L, 13R during the checking action of the driver according to the mode of intersecting roads across the advancing direction of the own vehicle. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a video presenting apparatus that is mounted on a vehicle and presents a driver with an image of a situation outside the vehicle, and more specifically, presents a blind spot area that is a blind spot of the driver to the driver using an image of the situation outside the vehicle. The present invention relates to a video presentation apparatus and a video presentation method.

  Disclosed is a vehicle confirmation device capable of confirming a blind spot area while in a vehicle by capturing an image of the surroundings of the vehicle with an imaging device mounted on the vehicle and displaying the captured image on a monitor in the vehicle. (Patent Document 1). This vehicle confirmation device displays an image of the blind spot area on the left side of the vehicle on the left screen of the monitor and an image of the right blind spot area on the right screen of the same monitor. The consistency between the information and the captured image projected on the monitor is maintained.

JP 2001-45470 A

  However, the technique disclosed in Patent Document 1 described above divides a display screen of a monitor in which an image of the left blind spot area of the vehicle and an image of the right blind spot area are installed in the center of the vehicle into left and right parts. And display them respectively. Therefore, in a so-called right-hand drive vehicle in which the driver's seat is on the right side of the vehicle, the driver moves his / her line of sight toward the monitor installed in the center of the vehicle even when trying to visually recognize the blind spot area on the right side of the vehicle. There was a need.

  Therefore, in a normal vehicle not equipped with such a vehicle confirmation device, it does not coincide with the driver's natural confirmation behavior of moving the line of sight to the right side to be implemented when confirming the blind spot area on the right side of the vehicle. Therefore, there has been a problem that a confirmation action with a sense of incongruity is required.

  In addition, it is not always necessary to present the situation outside the vehicle such as the blind spot area of the vehicle. For example, when a vehicle is entering an intersection, a confirmation action for confirming the driver's safety is required. It becomes effective by presenting with. On the other hand, when a situation outside the vehicle is always presented, or when an appropriate scene is not presented, the driver who is driving the vehicle may feel annoying the video displayed on the monitor.

  Accordingly, the present invention has been proposed in view of the above-described circumstances, and the situation outside the vehicle such as the blind spot area is appropriately positioned and appropriately without hindering the natural confirmation behavior of the driver who drives the vehicle. An object of the present invention is to provide a video presentation device and a video presentation method that can be presented at timing.

  The present invention images the left and right vehicle exterior situations with respect to the traveling direction of the vehicle, and presents the captured left and right vehicle exterior situations to the left front and right front of the driver, respectively. At this time, the confirmation action position where the confirmation action of the driver is required is identified, and the confirmation of the driver is performed according to the road form of the intersection road that intersects the traveling direction of the own vehicle in front of the identified confirmation action position. The above-mentioned problem is solved by controlling the presentation timing of the left and right sides of the vehicle to be presented to the left front and right front of the driver during the action.

  According to the present invention, it is possible to present a situation outside the vehicle such as a blind spot area at an appropriate position and at an appropriate timing without hindering the natural confirmation behavior of the driver who drives the vehicle.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
First, the video presentation apparatus shown as the first embodiment of the present invention will be described with reference to FIG. As shown in FIG. 1, the video presentation device includes imaging devices 11L and 11R, a navigation device 12, video display devices 13L and 13R, a sensor group 14, and a display control device 20. As shown in FIG. 1, the video presentation device is mounted on a vehicle, and the video captured by the imaging devices 11L and 11R is controlled by the display control device 20 to the driver via the video display devices 13L and 13R, respectively. Can be presented.

  Although FIG. 1 shows a state in which the video presentation device is mounted on a vehicle that is assumed to be used mainly on a left-hand traffic road, naturally, the vehicle is assumed to be used on a right-hand traffic road. Can also be installed. In the following, in order to avoid the complexity of the description, the video presentation device will be described as being mounted on a vehicle that is assumed to be used mainly on a left-handed road.

  The imaging devices 11L and 11R are small imaging devices using a solid-state imaging device such as a CCD (Charge Coupled Devices). As shown in FIG. 1, the imaging devices 11L and 11R are installed at the left and right corners of the front end of the vehicle, for example, the left and right corners of the front bumper. Imaging the situation. FIG. 1 shows, as an example, imaging regions FL and FR imaged by the imaging devices 11L and 11R. The imaging areas FL and FR are areas that become blind spots for the driver when the driver is seated in the driver's seat of the vehicle.

  The imaging devices 11L and 11R may include a drive mechanism that can arbitrarily adjust the imaging regions FL and FR according to the physique of the driver, the setting state of the seating seat of the driver's seat, and the like. Before the driver starts driving, the image display device 13L, 13R displays an image picked up by the image pickup devices 11L, 11R and displays a blind spot region that is difficult to see when sitting on the driver's seat. The imaging directions of the imaging devices 11L and 11R are adjusted so as to be FL and FR.

  Further, as shown in FIG. 2, the imaging devices 11L and 11R are installed at the so-called nose position at the front end of the traveling direction of the vehicle so that the blind spot area of the driver seated on the driver's seat is the imaging areas FL and FR. You can also

  As described above, the video presentation device shown as the first embodiment of the present invention is not necessarily limited to the imaging device 11L because it is sufficient for the driver seated in the driver's seat to capture an area that is a blind spot in front of the left and right sides of the vehicle. , 11R does not need to be installed. Therefore, although not shown in the drawing, instead of the imaging devices 11L and 11R, a wide-angle camera with a wide imaging area is used, or an optical system such as a mirror and a prism is devised to provide a vehicle for a driver sitting on the driver's seat with one imaging device. You may make it image the area | region used as the left and right blind spots.

  The navigation device 12 detects the current position of a vehicle that is a moving body, and provides route guidance to a desired destination while displaying a map corresponding to the current position of the vehicle displayed from the map data. The navigation device 12 holds various data necessary for navigation such as map data of a map to be displayed, road data used for map matching, route guidance, and the like.

  The navigation device 12 displays information indicating the current position of the vehicle, road attribute information indicating the type of road, road shape information, information indicating the presence or absence of a sidewalk, intersection position information, and the like according to the travel position of the vehicle. Output to. The display control device 20 uses the information output from the navigation device 12 to control the timing at which the images captured by the imaging devices 11L and 11R are displayed on the video display devices 13L and 13R and presented to the driver. .

  The video display devices 13L and 13R are thin displays such as a liquid crystal display and an EL (Electro Luminescence) display. As shown in FIG. 1, the video display devices 13 </ b> L and 13 </ b> R are provided on the left front and the right front, respectively, when the driver is seated on the driver's seat. Specifically, as shown in FIGS. 3A and 3B, the video display devices 13L and 13R are installed in the instrument panel 21, respectively. As shown in FIG. 3A, the video display device 13R installed on the right side of the driver seated in the driver's seat is installed together with the instruments at a position where the driver inside the steering wheel 22 can visually recognize. Alternatively, as shown in FIG. 3B, it may be installed at a position where the driver outside the steering wheel 22 can visually recognize.

  Under the control of the display control device 20, the video display devices 13L and 13R display images captured by the imaging devices 11L and 11R, that is, images of the imaging regions FL and FR that are blind spots for the driver seated in the driver's seat. Display and present to the driver.

  For comparison with the installation positions of the video display devices 13L and 13R shown in FIGS. 3A and 3B, FIG. 3C shows an example in which the video display device 30 is provided at the front center position in the vehicle. . In the example shown in FIG. 3C, images obtained by imaging a blind spot area on the left side of the vehicle in display areas 31L and 31R that are installed at the front center position in the vehicle and that divide the display screen of the video display device 30 into right and left, right side The images of the blind spot area are displayed. As shown in FIG. 3C, when one video display device 30 is installed, the driver performs an unnatural confirmation action such as moving the line of sight in the left direction, particularly when viewing the blind spot area on the right side. It is necessary to take.

  On the other hand, as shown in FIGS. 3A and 3B, the blind spot area on the left side of the vehicle and the blind spot area on the right side of the vehicle are displayed on the video display devices 13L and 13R installed on the left and right front sides of the driver, respectively. And the driver | operator can visually recognize the area | region used as a blind spot when sitting in a driver's seat with the very natural eyes | visual_axis at the time of a driving | operation.

  1, 2, 3 (a), and (b), the video display devices 13 </ b> L and 13 </ b> R are individual video display devices installed on the left and right sides of the driver, respectively, but FIG. 3 (a). , (B) The display panel of the video display devices 13L and 13R installed as shown in FIG. 5B is used as a display region for displaying video images of the imaging regions FL and FR. You may make it install in. In this case, the instruments incorporated in the instrument panel 21 are also displayed on the video display device, so that the number of parts and the cost can be reduced.

  The sensor group 14 is a plurality of sensors for detecting the running state of the vehicle. As sensors constituting the sensor group 14, for example, a vehicle speed sensor that detects the vehicle speed, a turning angular velocity sensor that detects the turning angular velocity of the steering wheel 22, and a turning angular acceleration that detects the turning angular acceleration of the steering wheel 22. Sensors such as sensors, yaw rate sensors that detect yaw angular velocity, roll rate sensors that detect roll angles, pitching rate sensors that detect pitching angles, engine speed sensors, shift position sensors, accelerator sensors, brake switch sensors, and direction indication sensors is there. A detection signal detected by the sensor group 14 is output to the display control device 20.

  The display control device 20 displays the image of the blind spot area, which is the timing when the images captured by the imaging devices 11L and 11R are displayed on the image display devices 13L and 13R, that is, the blind spot of the driver seated in the driver's seat. The presentation timing at the time of presentation to the driver via the video display devices 13L and 13R is controlled.

  When the display control device 20 controls the presentation timing for presenting the image of the blind spot area to the driver, first, based on the information output from the navigation device 12, the display control device 20 detects the confirmation action position required for the driver's confirmation action. To do. The confirmation action position is a position where the confirmation action of the driver, such as an intersection, a temporary stop position, a parking lot entrance / exit position, and the like, is required to visually confirm the situation of the surroundings of the vehicle.

  The display control device 20 can also estimate the confirmation action position from road attribute information, information indicating the presence / absence of a sidewalk, intersection position information, and the like, in addition to a predetermined confirmation action position such as a temporary stop position. For example, the display control device 20 indicates that, based on the road attribute information output from the navigation device 12, the road on which the vehicle is currently traveling is a narrow road, and the road that intersects in front of the traveling direction is a main road. If recognized, it is determined that the intersecting road is likely to be able to travel preferentially with respect to the narrow road, and it is determined that the vehicle will temporarily stop before entering the intersection. When the vehicle stops temporarily and then restarts and enters the intersection, the driver performs a confirmation action for confirming the left and right of the host vehicle. That is, in this way, the temporary stop point estimated by the display control device 20 is the confirmation action position where the driver's confirmation action is required.

  In addition to this, a location where a confirmation action estimated from the user's experience or the like is necessary may be set as the confirmation action position. In this case, the user sets a location to be a confirmation action position in advance in map data held by the navigation device 12. Thereby, the display control device 20 can detect the confirmation action position from information set in advance output from the navigation device 12.

  When the display control device 20 detects the confirmation action position, the display control device 20 determines the timing for displaying the images captured by the imaging devices 11L and 11R on the video display devices 13L and 13R, respectively, according to the road form ahead of the confirmation action position. To do.

  For example, considering the case where the vehicle enters an intersection that needs to be temporarily stopped as described above, the display control device 20 is triggered by the fact that the host vehicle has reached a predetermined distance from the target intersection. Then, control is performed so that images captured by the imaging devices 11L and 11R are displayed via the video display devices 13L and 13R. At this time, the display control device 20 displays the video display device according to the road form such as whether the intersection road intersecting the road on which the host vehicle is traveling is a vehicle-only road, a sidewalk, or a one-way street. The timing for displaying images on 13L and 13R is controlled.

[Operation of First Embodiment]
Next, the video presentation operation of the video presentation apparatus shown as the first embodiment of the present invention will be described using the flowchart shown in FIG.

  First, in step S1, the display control device 20 acquires various types of information output from the navigation device 12 according to the current position of the host vehicle.

  In step S <b> 2, the display control device 20 detects the latest confirmation action position in the traveling direction from the current position of the host vehicle based on various information output from the navigation device 12. In this flowchart, it is assumed that an intersection with a temporary stop of the vehicle is detected as the confirmation action position.

  In step S3, the display control device 20 determines, based on the information output from the navigation device 12, whether the intersection road that intersects the road on which the host vehicle is traveling at the intersection detected in step S2 is a vehicle-only road. To do. The display control device 20 proceeds to step S4 when the intersection road is not a vehicle-dedicated road, and proceeds to step S5 when the intersection road is a vehicle-only road.

  In step S4, the display control device 20 determines whether there is a sidewalk parallel to the intersection road before the intersection road, that is, on the own vehicle side of the intersection road, based on the information output from the navigation device 12. If there is a sidewalk before the crossing road, the display control device 20 proceeds to step S6. If there is no sidewalk before the crossing road, the display control apparatus 20 proceeds to step S5.

  In step S <b> 5, the display control device 20 determines, based on the information output from the navigation device 12, that the crossing road that intersects the front of the host vehicle defines the traveling direction of the vehicle from the left to the right with respect to the host vehicle. Determine if it is a traffic route. If the display control device 20 is a one-way street from left to right, the process proceeds to step S8. If it is not a one-way path from left to right, that is, if it is a one-way path or two-way path from right to left, the process proceeds to step S7.

  In step S6, the display control device 20 simultaneously displays the images captured by the imaging devices 11L and 11R via the video display devices 13L and 13R, respectively. The timing for simultaneously displaying images from the image display devices 13L and 13R is detected by, for example, the current position information of the vehicle output from the navigation device 12 and the vehicle speed sensor, accelerator sensor, brake switch sensor, etc. of the sensor group 14. Based on the sensor value and the like, it is assumed that a temporary stop is executed near the intersection.

  The display control device 20 advances the processing to step S6 in response to the fact that the intersecting road is not a vehicle-dedicated road but a general road and that there is a sidewalk parallel to the intersecting road on the own vehicle side. Thereby, the presence of a pedestrian or a bicycle traveling toward the own vehicle on the sidewalk that is the left and right blind spot area of the driver seated in the driver's seat is reliably presented via the video display devices 13L and 13R. can do.

  In step S7, the display control device 20 first displays the video imaged by the imaging device 11R via the video display device 13R, and then displays the video imaged by the imaging device 11L via the video display device 13L. Let

  The timing for displaying the video from the video display device 13R is, for example, the current position information of the vehicle output from the navigation device 12 and the sensor value detected by the vehicle speed sensor, accelerator sensor, brake switch sensor, etc. of the sensor group 14. Based on this, it is assumed that a temporary stop is implemented near the intersection.

  In addition, when the intersection road is a one-way road from the right to the left, the timing for displaying the image from the image display device 13L is not much to worry about the left direction, so the image is displayed on the image display device 13R. After an arbitrary time after displaying. When the intersecting road is a two-way road, for example, based on the current position information of the vehicle output from the navigation device 12 and sensor values detected by a vehicle speed sensor, an accelerator sensor, a brake switch sensor, etc. of the sensor group 14. The timing when it is determined that the vehicle has entered the crossing road from the temporarily stopped state.

  For example, in a case where an intersection with a temporary stop of a two-way path as shown in FIG. 5A is set as the confirmation action position, the display control device 20 responds to the fact that the host vehicle has executed a temporary stop at the position A. As shown in FIG. 5B, the video imaged by the imaging device 11R is displayed via the video display device 13R. Subsequently, the display control device 20 displays the video imaged by the imaging device 11L at the position B as shown in FIG. 5C in response to the own vehicle entering the intersection road. To display.

  The display control device 20 determines whether the intersection road is a vehicle-only road and is not a one-way road from left to right, or the intersection road is not a vehicle-only road but a general road, If there is no sidewalk in parallel and it is not a one-way street from left to right, the process proceeds to step S7. As described above, the fact that the intersection road is not a one-way road from the left to the right indicates that the road is a one-way road or a two-way road from the right to the left.

  As a result, when the crossing road is a one-way street from the right to the left, the presence of a vehicle moving left from the blind spot area in the right direction of the driver sitting in the driver's seat is displayed. It can be reliably presented via the device 13R.

  In addition, when the crossing road is a two-way street, an image of the presence of a vehicle traveling leftward from the blind spot area in the right direction of the driver sitting in the driver's seat is displayed. The presence of a vehicle that can be surely presented via the device 13R and then proceeds to the right from the blind spot area of the driver sitting in the driver's seat to the right via the video display device 13L. Can be presented reliably.

  In step S8, the display control device 20 first displays the video imaged by the imaging device 11L via the video display device 13L, and then displays the video imaged by the imaging device 11R via the video display device 13R. Let

  The timing for displaying the video from the video display device 13L is, for example, the current position information of the vehicle output from the navigation device 12, the sensor value detected by the vehicle speed sensor, the accelerator sensor, the brake switch sensor, etc. of the sensor group 14 Based on the above, it is assumed that a temporary stop is implemented near the intersection.

  In addition, when the intersection road is a one-way road from the left to the right, it is not necessary to worry about the right direction so that the video is displayed on the video display 13L. After an arbitrary time after displaying.

  The display control device 20 determines whether the intersection road is a vehicle-only road and is a one-way road from left to right, or the intersection road is not a vehicle-only road but a general road, The process proceeds to this step S8 in response to the fact that there is no sidewalk in parallel with the road and the road is a one-way street from left to right.

  Accordingly, the presence of the vehicle traveling in the right direction from the blind spot area in the left direction of the driver seated in the driver's seat can be reliably presented via the video display device 13L.

  In step S <b> 9, the display control device 20 determines whether or not the vehicle has passed an intersection with a temporary stop, which is a confirmation action position, based on the current position information of the host vehicle output from the navigation device 12. If the display control device 20 has not passed this intersection, the display of the video display devices 13L and 13R is continued until it passes, and if it has passed the intersection, the process proceeds to step S10.

  In step S10, the display control device 20 stops the display of the video display devices 13L and 13R, and ends the presentation of the video to the driver.

  In addition, for example, as shown in FIG. 3A, when the video display device 13R is installed through the steering wheel 22 so that the video can be viewed from the inside of the steering wheel 22, the display control device 20 Then, it is determined whether or not the steering of the steering wheel 22 has been started from the detection result of the turning angular velocity sensor or the turning angular acceleration sensor of the sensor group 14. When the display control device 20 determines that the steering of the steering wheel 22 has been started by the driver, the display control device 20 first presents the situation outside the vehicle from the video display device 13 </ b> R viewed from the inside of the steering wheel 22. The presentation timing may be controlled.

  Thereby, it is possible to avoid the image displayed on the image display device 13R from being blocked before reaching the eyes of the driver due to the position change of the steering wheel 22 due to the steering of the steering wheel 22.

[Effect of the first embodiment]
As described above, the video presentation device shown as the first embodiment of the present invention sits on the driver's seat in the lateral direction of the vehicle imaged by the imaging devices 11L and 11R during the driver's confirmation action. The images are displayed via the video display devices 13L and 13R installed at the left front and right front of the driver. At this time, the display control device 20 that controls the display of the video display devices 13L and 13R causes the video display devices 13L and 13R to display video based on the road form ahead of the confirmation action position where the driver's confirmation behavior is required. The presentation timing to be presented to the driver is controlled.

  Thereby, the video presentation apparatus shown as the first embodiment of the present invention can present a video without hindering the very natural confirmation behavior of the driver when driving the vehicle. Therefore, the driver can visually acquire the information on the blind spot area only by smoothly moving the line of sight without feeling stress during driving.

[Second Embodiment]
Next, the configuration of the video presentation apparatus shown as the second embodiment of the present invention will be described with reference to FIG. As shown in FIG. 6, the video presentation device shown as the second embodiment of the present invention has the presence of a pedestrian or bicycle approaching the vehicle in the video presentation device shown as the first embodiment described above. The obstacle detection devices 15L and 15R to be detected are provided. Therefore, in describing the configuration of the video presentation device shown as the second embodiment of the present invention, the same reference numerals are given to the same portions as those of the video presentation device shown as the first embodiment, and the description thereof is omitted. .

  The obstacle detection devices 15L and 15R are, for example, an ultrasonic sensor that detects an obstacle by using a sound wave generated by a vibrator to an object and uses the bounced sound wave, and a laser beam emitted from a laser diode. It is a scanning laser radar that scans an object and detects an obstacle by receiving reflected scan laser light. The ultrasonic laser and the scanning laser radar can measure the distance to the obstacle by measuring the feedback time of the sound wave and the laser beam, respectively.

  Moreover, you may make it detect presence of the pedestrian approaching a vehicle, a bicycle, etc. by analyzing the image | video imaged with the imaging devices 11L and 11R by image processing. In this case, since it is not necessary to provide the obstacle detection devices 15L and 15R separately, it is possible to reduce the number of parts and the cost. As described above, even when an obstacle is detected by image processing, the magnification at the time of imaging and the distance from the size of the subject in the captured image to the obstacle can be converted.

  The obstacle detection devices 15L and 15R are mainly configured to detect pedestrians, bicycles, and the like existing in the imaging regions FL and FR, which are imaging regions of the imaging devices 11L and 11R, as shown in FIG. It is installed in the vicinity of 11L and 11R.

  The results detected by the obstacle detection devices 15L and 15R are output to the display control device 20 in a predetermined time slot. The display control device 20 performs an analysis process as to whether a pedestrian or a bicycle is approaching the host vehicle from distance information to the obstacle, which is one of the output results from the obstacle detection devices 15L and 15R. Further, based on the analysis processing result, the display control device 20 displays the images captured by the imaging devices 11L and 11R on the video display devices 13L and 13R, respectively, and controls the presentation timing presented to the driver.

[Operation of Second Embodiment]
Next, the video presentation operation of the video presentation apparatus shown as the second embodiment of the present invention will be described using the flowchart of FIG. In the flowchart shown in FIG. 7, processing from step S21 to step S26 is added instead of step S4 in the flowchart shown in FIG. 4 according to the provision of the obstacle detection devices 15L and 15R. Therefore, in the description of the flowchart shown in FIG. 7, the same steps as those in the flowchart shown in FIG.

  In step S21, the display control device 20 determines in step S3 described above that the intersecting road intersecting the road on which the host vehicle is traveling is not a vehicle-only road but a general road that can be used by pedestrians and bicycles. Accordingly, analysis processing is started based on the detection results output from the obstacle detection devices 15L and 15R to determine whether a pedestrian or bicycle that becomes an obstacle is approaching when crossing a crossing road.

  In step S22, the display control device 20 determines from the detection results output from the obstacle detection devices 15L and 15R whether or not a pedestrian or bicycle that becomes an obstacle is approaching from the left-right direction of the host vehicle. If the display control device 20 determines that an obstacle is approaching from the left-right direction of the host vehicle, the display control device 20 proceeds to step S6. If not, the display control device 20 proceeds to step S23.

  When the process proceeds to step S6, the display control device 20 causes the images captured by the imaging devices 11L and 11R to be simultaneously displayed via the image display devices 13L and 13R, respectively. Thus, the obstacle present in the left and right blind spots of the driver sitting in the driver's seat can be reliably presented to the driver.

  In step S23, the display control device 20 determines from the detection results output from the obstacle detection devices 15L and 15R whether or not a pedestrian or bicycle that is an obstacle is approaching from the left direction of the host vehicle. If the display control device 20 determines that an obstacle is approaching from the left side of the host vehicle, the display control device 20 proceeds to step S8. If not, the display control device 20 proceeds to step S24.

  When the process proceeds to step S8, the display control device 20 first displays the video imaged by the imaging device 11L via the video display device 13L. Thereby, the obstacle present in the blind spot area in the left direction of the driver sitting in the driver's seat can be surely presented to the driver.

  In step S24, the display control device 20 determines from the detection results output from the obstacle detection devices 15L and 15R whether a pedestrian or bicycle that is an obstacle is approaching from the right direction of the host vehicle. If the display control device 20 determines that an obstacle is approaching from the right direction of the host vehicle, the display control device 20 proceeds to step S7. If not, the display control device 20 proceeds to step S25.

  When the process proceeds to step S7, the display control device 20 first displays the video imaged by the imaging device 11R via the video display device 13R. Thereby, the obstacle present in the blind spot area in the right direction of the driver sitting in the driver's seat can be surely presented to the driver.

  In step S25, when the display control device 20 determines from the detection results output from the obstacle detection devices 15L and 15R that there is no obstacle approaching the host vehicle, the display control device 20 determines the detection result from the obstacle detection device 15L. It is determined whether or not there is a stationary obstacle such as a side wall that does not approach the host vehicle but has a height approximately equal to the driver's line-of-sight position. When such a stationary obstacle exists, it is determined whether or not the distance between the host vehicle and the obstacle is equal to or less than a predetermined value. The predetermined value used to determine the distance between the host vehicle and the stationary obstacle is such that when there is such a stationary obstacle, the visual field of the driver sitting in the driver's seat is narrowed if the distance is closer than this. This is a distance that significantly reduces the property.

  Here, the display control device 20 uses only the detection result by the obstacle detection device 15L. In the case of left-hand traffic, a stationary obstacle such as a side wall that narrows the driver's field of view exists on the left side. Is due to. Therefore, in the case of right-hand traffic, the display control device 20 determines whether there is a stationary obstacle using the detection result from the obstacle detection device 15R.

  If the distance between the host vehicle and the stationary obstacle is equal to or less than the predetermined value, the display control device 20 proceeds to step S6. If the distance is longer than the predetermined value, the display control device 20 proceeds to step S26. Proceed.

  When the process proceeds to step S6, the display control device 20 causes the images captured by the imaging devices 11L and 11R to be simultaneously displayed via the image display devices 13L and 13R, respectively. Thereby, the stationary obstacle present in the left or right blind spot area of the driver seated in the driver's seat can be surely presented to the driver.

  In step S <b> 26, the display control device 20 changes to a road form of an intersecting road that intersects the front of the host vehicle in accordance with the fact that there is no influence such as an obstacle approaching the vehicle or an obstruction of the driver's visual field due to a stationary obstacle. In order to control the presentation timing of the video accordingly, the traveling direction of the cross road is determined.

  In the display control device 20, based on the information output from the navigation device 12, an intersection road that intersects in front of the host vehicle is a one-way street that defines the traveling direction of the vehicle from left to right with respect to the host vehicle. Determine whether or not. If the display control device 20 is a one-way street from left to right, the process proceeds to step S8. If it is not a one-way road from left to right, that is, if it is a one-way or two-way road from right to left, the process proceeds to step S7.

[Effect of the second embodiment]
In this way, the video presenting apparatus shown as the second embodiment of the present invention displays the vehicle outside situation in the left-right direction of the vehicle imaged by the imaging devices 11L and 11R according to the road configuration ahead of the confirmation action position. When controlling the presentation timing of displaying images on the video display devices 13L and 13R installed on the left front and right front of the driver seated in the driver's seat and presenting them to the driver, obstacles are detected by the obstacle detection devices 15L and 15R. Consider the presence of stationary obstacles such as pedestrians and bicycles that are detected as objects, and side walls.

  As a result, it is possible to quickly and accurately present to the driver the situation outside the vehicle that reflects the presence of an obstacle in the blind spot area of the driver seated in the driver's seat. Therefore, the driver can perform a reliable confirmation action considering the presence of an obstacle in the blind spot area.

[Third Embodiment]
Next, the configuration of the video presentation apparatus shown as the third embodiment of the present invention will be described with reference to FIG. The video presentation apparatus shown as the third embodiment of the present invention has a configuration in which the visual line detection apparatus 16 that detects the driver's visual line position is included in the video presentation apparatus shown as the second embodiment described above. Yes. Therefore, in describing the configuration of the video presentation device shown as the third embodiment of the present invention, the same reference numerals are given to the same parts as those of the video presentation device shown as the second embodiment, and the description thereof is omitted. .

  The line-of-sight detection device 16 can be mounted on the driver's head, such as a device that captures the driver's eyes with a camera and estimates the driver's line-of-sight direction by image processing based on the captured image. For example, the position sensor is attached to the headset, and the direction of the driver's line of sight is determined from the sensor signal from the position sensor. The result detected by the line-of-sight detection device 16 is output to the display control device 20.

  The display control device 20 uses the result detected by the line-of-sight detection device 16 to check whether the driver's line-of-sight direction is the left or right direction where the obstacle exists when the obstacle approaches the host vehicle. Judge whether. Then, when the driver is not turning his / her line of sight in the direction in which the obstacle exists, the display control device 20 is arranged in advance of the image display device 13L or 13R installed in the direction in which the obstacle exists. The presentation timing is controlled so as to display the video imaged at 11L or 11R. At this time, the display control device 20 performs a process of quickly turning the driver's line of sight in the direction in which the obstacle exists, such as blinking the image to be displayed first.

[Operation of Third Embodiment]
Next, the video presentation operation of the video presentation apparatus shown as the third embodiment of the present invention will be described using the flowchart of FIG. In the flowchart shown in FIG. 9, the processes from step S31 to step S33 are added to the flowchart shown in FIG. Therefore, in the description of the flowchart shown in FIG. 9, the same steps as those in the flowchart shown in FIG.

  In step S31, the display control device 20 determines in step S23 that an obstacle such as a pedestrian or bicycle is approaching from the left direction of the own vehicle, or in step S24, from the right direction of the own vehicle. Based on the detection results output from the line-of-sight detection device 16 and the detection results output from the obstacle detection devices 15L and 15R in response to the determination that an obstacle such as a pedestrian or bicycle is approaching. Then, a process of verifying the coincidence between the driver's line-of-sight direction and the direction in which the obstacle is detected is started.

  In step S <b> 32, the display control device 20 determines whether or not the driver's line-of-sight direction detected by the line-of-sight detection device 16 is in a direction in which an obstacle exists. The display control device 20 proceeds to step S6 when the driver's line-of-sight direction is in the direction in which the obstacle is present, and proceeds to step S6 when the driver is in the direction in which the obstacle is present. The process proceeds to S33.

  When the process proceeds to step S6 on the assumption that the driver's line-of-sight direction is in the direction in which the obstacle exists, the display control device 20 displays the images captured by the imaging devices 11L and 11R, respectively. Displayed simultaneously via 13L and 13R. As a result, when the driver's line-of-sight direction is in the direction in which the obstacle exists, the driver sitting in the driver's seat without performing troublesome control such as presenting an image with a time difference By presenting the left and right blind spot areas at the same time, it is possible to inform the driver of the presence of an obstacle very naturally.

  In step S33, based on the result in step S23 or step S24, the display control device 20 advances the process to step S7 when the direction in which the obstacle exists is rightward, and when the direction is leftward. Advances the process to step S8.

  When the process proceeds to step S7 on the assumption that the driver's line-of-sight direction does not face the obstacle present in the right direction of the vehicle, the display control device 20 displays a video image captured by the imaging device 11R. First, display is performed via the device 13R. Further, the display control device 20 performs display control such as blinking the image to be displayed in order to quickly turn the driver's line of sight toward the image display device 13R. Accordingly, it is possible to prompt the driver to recognize the presence of an obstacle present in the blind spot area in the right direction of the driver sitting on the driver's seat.

  Further, when the process proceeds to step S8 on the assumption that the driver's line-of-sight direction does not face the obstacle present in the left direction of the vehicle, the display control device 20 displays the video imaged by the imaging device 11L. First, it is displayed via the video display device 13L. Further, the display control device 20 performs display control such as blinking a video to be displayed in order to quickly turn the driver's line-of-sight direction toward the video display device 13L. As a result, the driver can quickly recognize the presence of an obstacle present in the blind spot area in the left direction of the driver sitting in the driver's seat.

[Effect of the third embodiment]
In this way, the video presentation device shown as the third embodiment of the present invention is configured such that the driver's line-of-sight direction detected by the line-of-sight detection device 16 is an obstacle detected by the obstacle detection devices 15L and 15R. Depending on whether or not it is facing the direction, the video display devices 13L and 13R display and present the video of the vehicle exterior situation in the left-right direction of the vehicle imaged by the imaging devices 11L and 11R, and control the presentation timing.

  Thereby, the line-of-sight direction of the driver seated in the driver's seat can be directed to the video display device 13L or 13R displaying the obstacle. Therefore, the driver can perform a reliable confirmation action considering the presence of an obstacle in the blind spot area.

  Further, when the driver's line-of-sight direction does not face the direction in which the obstacle exists, display control is performed such as blinking an image with an obstacle to be displayed via the video display device 13L or 13R. Thus, the line-of-sight direction of the driver seated in the driver's seat can be quickly directed to the video display device 13L or 13R displaying the obstacle.

  As described above, in the video presentation device shown as the first to third embodiments of the present invention, the host vehicle approaches the confirmation action position when the video display on the video display devices 13L and 13R starts. However, the present invention is not limited to this and may be started manually by a manual operation by the driver. After the video display is once manually performed through the video display devices 13L and 13R, the display control device 20 executes the processing after step S3 shown in the flowchart of FIG. 4, FIG. 7 or FIG. Become.

  In addition, as the first to third embodiments of the present invention, the display control device 20 of the video presentation device uses the imaging devices 11L and 11R as videos to be displayed on the video display devices 13L and 13R at the presentation timing as described above. Although it has been explained that the captured image is used as it is, instead of this, the blind spot area is surely presented to the driver, such as by emphasizing the confirmation operation position such as an intersection or iconifying an obstacle. It is also possible to use a video image that has been subjected to image processing.

  The above-described embodiment is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and various modifications can be made depending on the design and the like as long as the technical idea according to the present invention is not deviated from this embodiment. Of course, it is possible to change.

It is a figure for demonstrating the structure of the video presentation apparatus shown as a 1st Embodiment of this invention. It is a figure for demonstrating another structure of the video presentation apparatus shown as the 1st Embodiment of this invention. It is the figure which showed the installation position of the video display apparatus with which the video presentation apparatus shown as the 1st Embodiment of this invention is provided. It is a flowchart for demonstrating the video presentation operation | movement of the video presentation apparatus shown as the 1st Embodiment of this invention. It is the figure which showed specifically an example of the video presentation operation | movement of the said video presentation apparatus. It is a figure for demonstrating the structure of the video presentation apparatus shown as the 2nd Embodiment of this invention. It is a flowchart for demonstrating the video presentation operation | movement of the video presentation apparatus shown as the 2nd Embodiment of this invention. It is a figure for demonstrating the structure of the image | video presentation apparatus shown as the 3rd Embodiment of this invention. It is a flowchart for demonstrating the video presentation operation | movement of the video presentation apparatus shown as the 3rd Embodiment of this invention.

Explanation of symbols

11L imaging device 11R imaging device 12 navigation device 13L video display device 13R video display device 14 sensor group 15L obstacle detection device 15R obstacle detection device 16 line of sight detection device 20 display control device 21 instrument panel 22 steering wheel

Claims (8)

Imaging means for imaging the situation outside the vehicle on the left side and the right side with respect to the traveling direction of the vehicle;
Presenting means for presenting the left and right vehicle exteriors imaged by the imaging means to the left front and right front of the driver, respectively.
Action position specifying means for specifying the confirmation action position where the driver's confirmation action is required;
According to the road form of the crossing road that intersects the traveling direction of the host vehicle in front of the confirmation action position identified by the action position identification means, the driver means the left front of the driver by the presenting means during the confirmation action of the driver, A video presentation device comprising: control means for controlling the presentation timing of the vehicle outside situation on the left side and the right side of the vehicle respectively presented to the right front. In accordance with the fact that the crossing road is a road form including a sidewalk,
Controlling the presentation timing so as to simultaneously present the vehicle exterior situation on the left side of the vehicle presented to the driver's left front by the presentation means and the vehicle exterior situation on the right side of the vehicle presented to the driver's right front. The video presentation apparatus according to claim 1. The control means, according to the road form determined by the vehicle traveling direction defined in the intersection road,
The presentation timing is controlled so as to first present either the vehicle exterior situation on the left side of the vehicle presented to the driver's left front or the vehicle exterior situation on the right side of the vehicle presented to the driver's right front by the presentation means. The video presentation device according to claim 1, wherein: An obstacle detection means for detecting an obstacle present around the vehicle;
The control means presents the vehicle outside situation on the left side of the vehicle presented to the driver's left front by the presenting means, the vehicle presenting the driver's right front according to the detection result detected by the obstacle detection means. The video presentation apparatus according to claim 1, wherein the presentation timing is controlled so as to first present any of the situations outside the vehicle on the right side of the vehicle. The control means, in response to the distance between the stationary obstacle existing around the vehicle detected by the obstacle detection means and the vehicle has become a predetermined threshold or less,
Controlling the presentation timing so as to simultaneously present the vehicle exterior situation on the left side of the vehicle presented to the driver's left front by the presentation means and the vehicle exterior situation on the right side of the vehicle presented to the driver's right front. The video presentation apparatus according to claim 4. Provided with gaze direction detection means for detecting the gaze direction of the driver,
The control means, according to the driver's line-of-sight direction detected by the line-of-sight direction detection means and the direction in which the obstacle detected by the obstacle detection means exists,
The video presentation device according to claim 4 or 5, wherein the presentation means controls presentation timings of the left and right vehicle external situations presented respectively to the left front and right front of the driver. One of the left and right sides of the vehicle, which is presented to the driver's left front and right front by the presenting means, is visually recognized from the inside of the steering wheel via a steering wheel for steering the vehicle. If
The control means controls the presentation timing so as to present first the outside situation visually recognized from the inside of the steering wheel in response to the start of steering of the steering wheel. The video presentation device according to claim 6. An imaging process for imaging the situation outside the vehicle on the left side and the right side with respect to the traveling direction of the vehicle;
A presentation step of presenting the left and right vehicle exterior situations of the imaged vehicle to the driver's left front and right front, respectively;
An action position identifying step for identifying the confirmation action position where the driver's confirmation action is required;
According to the road form of the crossing road that intersects the traveling direction of the host vehicle in front of the identified confirmation action position, it is presented to the driver's left front and right front by the presenting step during the driver's confirmation action, respectively. A video presentation method comprising: a control step of controlling a presentation timing of a vehicle outside situation on the left side and the right side of the vehicle.

Images