WO2019073598A1

WO2019073598A1 - Vehicle display system

Info

Publication number: WO2019073598A1
Application number: PCT/JP2017/037205
Authority: WO
Inventors: スリバスタバクマーデベシュ
Original assignee: 本田技研工業株式会社
Priority date: 2017-10-13
Filing date: 2017-10-13
Publication date: 2019-04-18

Abstract

This vehicle display system (10) comprises an external camera (15), a composite image generation unit (33), a display device (21), and a display control unit (39). The external camera (15) captures an image of a predefined area outside a vehicle (1). The composite image generation unit (33) combines predefined information with the image captured by the external camera (15) to generate a composite image. The display device (21) is provided at a predefined part of the windshield (27) of the vehicle (1) and can switch between a light transmissive state and a light non-transmissive state. The display control unit (39) causes the display device (21) in the light non-transmissive state to display the composite image generated by the composite image generation unit (33).

Description

Vehicle display system

The present invention relates to a display system for a vehicle.

Conventionally, a vehicle display system has been disclosed that displays an image obtained by superimposing a warning display on an image captured by a camera outside the vehicle at a position where it overlaps an actual position such as a road actually viewed by an occupant by a head-up display. (See, for example, Patent Document 1).

Japanese Patent Application Laid-Open No. 2013-119268

However, according to the display system for a vehicle according to the above-mentioned prior art, there is a problem that the actual visual object and the image displayed on the head-up display may shift depending on the viewpoint of the occupant, making it difficult to secure the visibility. . In addition, when the focal distance differs between the actual visual target and the display image of the head-up display, there is also a problem that the visibility is lowered.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a display system for a vehicle capable of securing appropriate visibility with respect to a display image and a real outside world.

In order to solve the above problems and achieve the object, the present invention adopts the following aspects.
(1) A display system for a vehicle according to an aspect of the present invention generates a composite image by combining predetermined information with a camera that captures an image of a predetermined area in the outside of the vehicle and the image captured by the camera A generation unit, a display which is provided at a predetermined portion of a window glass of the vehicle and is capable of switching between a light transmission state and a non-transmission state, And a control unit configured to display on the display.

(2) In the vehicle display system according to (1), the display may be in the transmission state when power to the display is shut off.

(3) The vehicle display system according to (1) or (2) includes an abnormality detection unit that detects an abnormality in the display or an abnormality in the camera, and the control unit controls the display by the abnormality detection unit. The display may be in the transmissive state when an abnormality of the camera or an abnormality of the camera is detected.

(4) In the vehicle display system according to any one of the above (1) to (3), the predetermined portion may be substantially the entire window glass of the vehicle.

(5) In the vehicle display system according to (4), the window glass of the vehicle is a windshield, and the predetermined area is viewed through the windshield when the driver of the vehicle is seated in the driver's seat You may include the range to do.

(6) In the vehicle display system according to any one of (1) to (5), the predetermined information may be driving support information for supporting the driving of the vehicle.

(7) In the vehicle display system according to (6), at least one of the information amount and the content of the driving support information may be changed according to the driving skill of the driver of the vehicle.

(8) In the vehicle display system according to any one of (1) to (7), the control unit performs calibration of a display range in the predetermined area at a predetermined timing, and After the execution, the change of the display range may be prohibited until the power of the display is shut off.

(9) The display system for a vehicle according to any one of (1) to (7) includes an occupant detection unit for detecting a head position or an eye point of a driver, and the control unit is configured to The display range in the predetermined area may be changed according to the head position or the eye point detected by the detection unit.

According to the vehicle display system according to the aspect described in the above (1), since the composite image obtained by combining the external image and the predetermined information in two dimensions is displayed on the non-transmissive state display, the composite image is It is possible to prevent overlapping and visual recognition in the real world. As a result, it is possible to prevent the occurrence of positional deviation between the real outside world and the composite image due to, for example, the viewpoint position or the vehicle vibration. In addition, since the external world and the focal length of the predetermined information are unified in the composite image, appropriate visibility can be ensured.

Furthermore, in the case of the above (2), since the display is in the transmission state when the power is shut off, it is possible to properly secure the view to the real outside world through the window glass. In addition, power consumption of the display can be reduced by shutting off the power supply of the display when the display of the composite image is unnecessary, and power saving can be achieved.

Furthermore, in the case of (3), since the display is in the transmission state when the display or the camera is abnormal, the composite image can be displayed on the display in the non-transmission state only when the system is normal. Can be improved.

Furthermore, in the case of the above (4), since the transmission state and the non-transmission state of the display are switched over substantially the entire window glass, the state where the real outside can be seen through the window glass and the real outside can not be seen composite video Can be switched between displaying states.
Furthermore, in the case of the above (5), it is possible to display a composite image without a sense of incongruity on the display, as compared with the case where the occupant looks directly at the outside world through the windshield. By making the range of the actual external world that the occupant looks directly over the windshield substantially the same as the range of the external world in the composite image displayed on the display, discomfort occurs when switching between the transmissive state and the non-transmissive state of the display You can prevent.

Furthermore, in the case of (6), when the driving support information related to the real outside world is added to the composite image, etc., the position of the outside world and the driving support information does not shift, so the visibility can be improved.
Furthermore, in the case of the above (7), since it is possible to provide information tailored to the individual driver, it is possible to improve the usefulness of displaying a composite image.
Furthermore, in the case of the above (8), the position of the composite image is fixed with respect to the window frame of the window glass, so that there is no fear that the passenger feels bothersome such as video sickness.
Furthermore, in the case of the above (9), the composite image may be displayed so as to be in a state of being close to nature, so as to actually recognize the actual outside world through the window glass, following the change in posture of the occupant. it can.

It is a block diagram showing an example of functional composition of a display system for vehicles concerning an embodiment of the present invention. In a vehicle equipped with a display system for vehicles concerning an embodiment of the present invention, it is a figure showing an example of a display screen which displays a synthetic picture on a display of a non-transmission state. The vehicle equipped with the display system for vehicles which concerns on embodiment of this invention WHEREIN: It is a figure which shows an example of the external field which a passenger | crew can visually recognize through the display apparatus of a permeation | transmission state and a non-display state, and a windshield.

Hereinafter, an embodiment of a display system for a vehicle according to the present invention will be described with reference to the attached drawings. FIG. 1 is a block diagram showing an example of a functional configuration of a display system for a vehicle according to an embodiment of the present invention.

A vehicle display system 10 according to the present embodiment is mounted on a vehicle 1. For example, as shown in FIG. 1, the vehicle 1 includes a driving operator 11, a vehicle sensor 13, an external camera 15, an occupant camera 17, a display device 21, an information storage unit 23, and an HMI (Human Machine Interface: A human-machine interface) control device 25.

The operating element 11 is an operating element such as an accelerator pedal, a brake pedal, a shift lever, and a steering wheel. For example, the drive operator 11 includes a sensor that detects the amount of operation of each operator or the presence or absence of an operation. Each sensor is connected to the HMI controller 25 and outputs a signal of the detection result to the HMI controller 25.

The vehicle sensor 13 detects a vehicle state amount. The vehicle sensor 13 is a vehicle speed sensor that detects a vehicle speed, an acceleration sensor that detects an acceleration of the vehicle 1, and a yaw rate sensor that detects an angular velocity around the vertical axis of the vehicle 1. Each sensor is connected to the HMI controller 25 and outputs a signal of the detection result to the HMI controller 25.

The external camera 15 images a predetermined area of the external of the vehicle 1 and outputs data of a photographed image. For example, the predetermined area is an area including the area viewed through the windshield 27 when the driver of the vehicle 1 is seated at the driver's seat in the front outside of the vehicle 1. An external camera 15 for imaging an external front of the vehicle 1 is attached to the upper portion of the windshield 27 or the back of the rearview mirror 29 or the like. The external camera 15 is a digital camera provided with a solid-state imaging device such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The external camera 15 can capture an image in the visible light range and the infrared range.

The occupant camera 17 captures an area including the face of the driver sitting on the driver's seat of the vehicle 1 and outputs data of the captured image. For example, the occupant camera 17 is attached to the top of the windshield 27 or an instrument panel or the like. The occupant camera 17 is a digital camera provided with a solid-state imaging device such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The occupant camera 17 can capture images in the visible light region and the infrared region.
The occupant camera 17 may include an imaging light source capable of emitting light such as visible light or infrared light to the face of the driver sitting at the driver's seat. For example, the imaging light source may be disposed at a position shifted from the occupant camera 17 to the left and right.

The display device 21 is provided at a predetermined portion of a window glass of the vehicle 1. For example, the predetermined portion is the entire windshield 27. The display device 21 is a flat panel display having a transparent electrode or a transparent conductive film, and can switch between a light transmission state and a light non-transmission state. The display device 21 is a display such as a liquid crystal, an organic EL, or an inorganic EL. The display device 21 is in a non-transmissive state when power is supplied, and makes it impossible for the passenger in the vehicle compartment to view the outside through the window glass. The display device 21 is in the transmission state when the power is shut off, and enables the occupant in the vehicle compartment to visually recognize the outside through the window glass.

The information storage unit 23 stores predetermined information displayed on the display device 21. For example, the predetermined information is driving support information for supporting the driving of the vehicle 1. The driving support information is information such as the operation timing of the driving operation element 11, alerting, visual field assistance, and route guidance. The driving support information includes the traveling environment and the driving state of the vehicle 1, and the amount and content of information associated with the driving skill of the driver. For example, the traveling environment of the vehicle 1 is information such as a road state, a road type, and a flow of a plurality of vehicles. The driving state of the vehicle 1 is information such as the operation amount of the driving operation element 11 and the vehicle state amount detected by the vehicle sensor 13. The driver's driving skill is information in which the driving skill is quantified based on the consistency or variation degree of the driving operation, or the matching degree between the measured data of the driving pattern and the reference data.

The HMI control device 25 includes an information acquisition unit 31, a composite video generation unit 33, an abnormality detection unit 35, an occupant detection unit 37, and a display control unit 39.
The information acquisition unit 31 acquires predetermined information to be displayed on the display device 21 from the information storage unit 23. The information acquisition unit 31 acquires driving support information from the information storage unit 23 based on the traveling environment and driving state of the vehicle 1 and the driving skill of the driver. For example, the information acquisition unit 31 acquires information on the traveling environment of the vehicle 1 from a navigation device or the like. The information acquisition unit 31 generates information on the driving state of the vehicle 1 based on the operation amount acquired from the driving operator 11 and the vehicle state amount acquired from the vehicle sensor 13. The information acquisition unit 31 generates information of the driving skill of the driver based on the consistency or variation degree of the driving operation, or comparison of measured data of the driving pattern with the reference data. The information acquisition unit 31 generates data of the consistency or variation degree of the driving operation or the measured data of the driving pattern based on the information of the driving state of the vehicle 1. The information acquisition unit 31 stores reference data of the driving pattern in advance. The reference data of the driving pattern is generated in advance based on the type of the vehicle 1, the traveling condition, and the information of the driving state measured by the test drive according to the traveling course and the like.
Since the driving support information stored in the information storage unit 23 includes the traveling environment and the driving state of the vehicle 1 and the information amount and the content corresponding to the driving skill of the driver, the information amount and the information according to the driving skill are At least one of the contents changes.

The composite video generation unit 33 generates composite video by combining predetermined information with the captured video using data of the captured video output from the external camera 15 and the predetermined information acquired by the information acquisition unit 31. Do.

The abnormality detection unit 35 detects an abnormality of the display device 21 and an abnormality of the external camera 15. For example, the abnormality detection unit 35 detects the internal temperature, the power supply current, and the current consumption of each of the display device 21 and the external camera 15, the display abnormality of the display device 21, the abnormality of the output signal of the external camera 15, and the like.

The occupant detection unit 37 detects the head position or eye point of the driver using data of the captured image output from the occupant camera 17. The occupant detection unit 37 performs recognition processing such as feature value calculation and shape discrimination with the head of the driver or left and right eyeballs as detection objects, and based on the processing result of this recognition processing, the head position or eye point To detect. For example, the occupant detection unit 37 uses the center position of the iris or pupil of the eye, the center position of the Purkinje image that is a reflection image of infrared light on the corneal surface, the eye center position, the position of the eyes and eyes, etc. To detect

The display control unit 39 controls the transmission state and the non-transmission state of the display device 21. FIG. 2 is a view showing an example of a display screen for displaying a composite image on the display device 21 in the non-transmissive state in the vehicle 1 equipped with the display system 10 for a vehicle according to the embodiment of the present invention. FIG. 3 shows an example of the external world visible to the occupant through the display device 21 in the transmission state and the non-display state and the windshield 27 in the vehicle 1 equipped with the display system 10 for a vehicle according to the embodiment of the present invention. FIG.

The display control unit 39 appropriately processes the composite video acquired from the composite video generation unit 33 and causes the display device 21 in the non-transmissive state to display the composite video. For example, on the display screen shown in FIG. 2, the composite image displayed on the display device 21 includes the image 41 of the outside world, the arrow indicating the route guidance, and the driving support information 42 such as the maximum speed of the traveling path. The display control unit 39 calibrates the display range in a predetermined area of the external world captured by the external camera 15 at a predetermined timing. For example, the display control unit 39 performs deformation, size change, and trimming of the composite image displayed on the display device 21 in the non-transmissive state according to the head position or the eye point of the driver detected by the occupant detection unit 37. Etc. For example, as shown in FIGS. 2 and 3, the display control unit 39 displays the range of the external world in the composite image displayed on the display device 21 in the non-transmissive state, when the driver is seated in the driver's seat. It matches the range of the real outside world to be viewed through the device 21 and the windshield 27. For example, the predetermined timing is when the ignition switch of the vehicle 1 is turned on. The display control unit 39 prohibits the change of the display range until the power of the display device 21 is shut off after the calibration of the display range is performed.

When displaying the composite image on the display device 21 in the non-transmissive state, the display control unit 39 determines the sensitivity of the external camera 15 and the brightness of the display device 21 according to the brightness of the driving environment that changes with time or weather. And adjust the contrast of each of the external camera 15 and the display device 21. For example, the display control unit 39 controls the sensitivity of the external camera 15, the brightness of the display device 21, and the external camera 15 and the display device in a relatively dark environment such as nighttime or cloudy weather as compared to daytime or fine weather. At least one of the 21 contrasts is increased.
When the abnormality detection unit 35 detects an abnormality in the display device 21 or an abnormality in the external camera 15, the display control unit 39 causes the display device 21 to be in the transmission state and stops the display of the composite image.

As described above, according to the display system 10 for a vehicle according to the present embodiment, the composite image obtained by combining the external image and the predetermined information in two dimensions is displayed by the display device 21 in the non-transmissive state. It is possible to prevent the image from being superimposed and viewed on the real world. As a result, it is possible to prevent the occurrence of positional deviation between the real outside world and the composite image due to, for example, the viewpoint position or the vehicle vibration. In addition, since the external world and the focal length of the predetermined information are unified in the composite image, appropriate visibility can be ensured.

Furthermore, since the display device 21 is in the transmission state when the power is shut off, it is possible to properly secure the view to the real outside world through the window glass of the vehicle 1. In addition, power consumption of the display device 21 can be reduced by shutting off the power supply of the display device 21 when display of a composite image is unnecessary, and power saving can be achieved.
Furthermore, since the display device 21 is in the transmission state when the display device 21 or the external camera 15 is abnormal, the composite image can be displayed by the display device 21 in the non-transmission state only when the system is normal. It is possible to improve the quality.

Furthermore, since the display device 21 is provided on substantially the entire window glass of the vehicle 1, the transmission state and the non-transmission state of the display device 21 can be switched over substantially the entire window glass. As a result, it is possible to switch between a state in which the actual outside world can be viewed through the window glass and a state in which the composite image is displayed with the real outside world invisible.
Furthermore, the display device 21 is provided on substantially the entire windshield 27 of the vehicle 1, and a predetermined region of the external world captured by the external camera 15 is viewed through the windshield 27 when the driver of the vehicle 1 is seated at the driver's seat. Since the range is included, an appropriate composite image can be displayed. Compared with the case where the driver looks directly at the outside world through the windshield 27, it is possible to display on the display device 21 a composite image without a sense of discomfort. Switching the transmission state and the non-transmission state of the display device 21 by making the range of the actual external world viewed directly by the occupant through the windshield 27 substantially the same as the range of the external world in the composite image displayed on the display device 21 It can prevent the occurrence of discomfort at times.
Furthermore, when driving assistance information related to the actual outside world is added to the composite image, etc., the position of the outside world and the driving assistance information does not shift, so that the visibility can be improved.

Further, the driving support information changes at least one of the information amount and the content depending on the driving skill of the driver of the vehicle 1, and therefore information can be provided according to the driver individual, which is advantageous for displaying a composite image Can be improved.
Furthermore, since the change of the display range is prohibited until the power of the display device 21 is shut off after the calibration of the display range is performed, the position of the composite image can be fixed to the window frame of the window glass. it can. As a result, there is no fear that the passenger feels bothersome, such as video sickness.

In the embodiment described above, the display control unit 39 performs calibration of the display range according to the driver's head position or eye point detected by the occupant detection unit 37, but the present invention is not limited to this. .
The display control unit 39 may perform calibration of the display range based on information other than the driver's head position or eye point, or initial information stored in advance. For example, the other information is the seat position of the driver's seat. For example, the initial information stored in advance is information such as the head position or the eye position according to the seat position of the driver of the reference figure.

In the embodiment described above, the display control unit 39 prohibits the change of the display range until the power of the display device 21 is shut off after the calibration of the display range is performed at a predetermined timing. Not limited to this.
The display control unit 39 performs calibration of a display range in a predetermined area of the external world captured by the external camera 15 according to the change in the driver's head position or eye point sequentially detected by the occupant detection unit 37. You may
According to this modified example, it is possible to display the composite image so as to be in a state of being close to nature, so as to actually visually recognize the external world through the window glass, following the driver's posture change or the like. .

In the embodiment described above, the display control unit 39 sets the display device 21 in the transmission state when an abnormality in the display device 21 or an abnormality in the external camera 15 is detected, but the present invention is not limited to this.
Even when data of a captured image is not output from the external camera 15, the display control unit 39 may stop the display by setting the display device 21 in a transparent state by powering off the display device 21 or the like.

The embodiments described above are presented as examples and are not intended to limit the scope of the invention. The above-described novel embodiment can be implemented in other various forms, and various omissions, substitutions, and modifications can be made without departing from the scope of the invention. The above-described embodiments and the modifications thereof are included in the scope and the gist of the invention, and are included in the invention described in the claims and the equivalent scope thereof.

According to the present invention, the composite image obtained by combining the external image and the predetermined information in two dimensions is displayed by the display device 21 in the non-transmissive state, so that the external image and the composite image It is possible to provide a display system for a vehicle capable of preventing a shift.

DESCRIPTION OF SYMBOLS 1 ... Vehicle, 10 ... Display system for vehicles, 11 ... Driving operator, 13 ... Vehicle sensor, 15 ... Outside camera (camera), 17 ... Occupant camera, 21 ... Display apparatus (display), 23 ... Information storage part, 25 ... HMI controller, 27 ... windshield, 29 ... room mirror, 31 ... information acquisition unit, 33 ... composite video generation unit (generation unit), 35 ... abnormality detection unit, 37 ... occupant detection unit, 39 ... display control unit () Control unit)

Claims

A camera for capturing an image of a predetermined area in the outside of the vehicle;
A generation unit that combines predetermined information with the video captured by the camera to generate a composite video;
A display provided at a predetermined portion of a window glass of the vehicle and capable of switching between a light transmission state and a light non-transmission state;
A control unit configured to display the composite image generated by the generation unit on the display in the non-transmissive state;
A display system for a vehicle, comprising:
The vehicle display system according to claim 1, wherein the display is in the transmission state when power to the display is shut off.
And an abnormality detection unit that detects an abnormality of the display or an abnormality of the camera,
The control unit causes the display to be in the transmission state when an abnormality in the display or an abnormality in the camera is detected by the abnormality detection unit.
The display system for vehicles according to claim 1 or 2 characterized by things.
The predetermined portion is substantially the entire window glass of the vehicle.
The display system for vehicles according to any one of claims 1 to 3, characterized in that.
The window glass of the vehicle is a windshield,
The predetermined area includes an area viewed through the windshield when a driver of the vehicle is seated at a driver's seat.
The display system for vehicles according to claim 4 characterized by things.
The predetermined information is driving support information for supporting the driving of the vehicle.
The display system for vehicles according to any one of claims 1 to 5, characterized in that.
In the driving support information, at least one of the information amount and the content changes according to the driving skill of the driver of the vehicle.
The display system for vehicles according to claim 6 characterized by things.
The control unit performs calibration of the display range in the predetermined area at a predetermined timing, and prohibits the change of the display range until the power of the display is shut off after the calibration is performed.
A display system for a vehicle according to any one of claims 1 to 7, characterized in that.
It has an occupant detection unit that detects the driver's head position or eye point,
The control unit changes a display range in the predetermined area according to the head position or the eye point detected by the occupant detection unit.
A display system for a vehicle according to any one of claims 1 to 7, characterized in that.