TWI821689B - Vehicle head-up display device having external image display - Google Patents

Abstract

The present invention relates to a vehicle head-up display device having external image display. The vehicle head-up display device mainly has a microprocessor, an image processing module, at least one light image extractor, a vehicle information connecting interface and a projection display. The microprocessor receives an external image of the vehicle from the light image extractor through the image processing module. The external image may be a vehicle side image or a vehicle rear image. The microprocessor receives the original vehicle information and then may further combine the vehicle information and the external image to a driving image. The microprocessor controls the projector display to project a display including the driving image. Since the vehicle head-up display device of the present invention projects the display including the driving image, the present invention may reduce driving blind spots and improve driving safety.

Description

Automotive head-up display integrating rear view images

The present invention relates to a vehicle head-up display device, and in particular, to a vehicle head-up display that integrates rear view images.

The vehicle head-up display device directly projects vehicle information within the driver's visual range, allowing the driver to learn the vehicle's driving status more quickly and easily. This prevents the driver from ignoring the vehicle conditions ahead by moving his eyes to confirm the information on the dashboard while driving, thereby affecting driving. Safety.

In order to further improve driving safety, vehicle head-up displays have begun to incorporate augmented reality functions, which can detect traffic signals on the roads where vehicles are traveling and reinforce reminders on the projection screen. It can also further identify obstacles that endanger driving (such as pedestrians and animals). or falling objects, etc.), and provide advance warning on the projection screen; however, these expanded functions are all based on the judgment of the vehicle conditions ahead when the vehicle is moving, and have not yet considered the possible harm to the safety of the moving vehicle from the side or rear of the vehicle, so It is necessary to further improve it.

In view of the fact that most current projection screens of heads-up displays display vehicle information or driving assistance of augmented reality front-of-car images, the main purpose of the present invention is to provide a vehicle head-up display that integrates rear-view images.

The main technical means used to achieve the above purpose is that the vehicle head-up display integrating rear view images includes: at least one optical image capture device, which continuously outputs multiple exterior images of the vehicle; wherein the exterior images are the vehicle side images or a vehicle rear image; an image processing module electrically connected to the optical image capturer to obtain and process the vehicle exterior images; a vehicle information connection interface to obtain vehicle information; a microprocessor electrically connected to the The image processing module and the vehicle information connection interface are used to obtain the exterior vehicle images and the vehicle information, and the microprocessor generates a driving image, the driving image includes the exterior vehicle image or includes the exterior vehicle image and the vehicle information; and A projection display is electrically connected to the microprocessor, and the microprocessor controls the projection display to project a projection screen containing the driving image based on the driving image.

As can be seen from the above description, the present invention mainly includes a light image capture device, which can be installed on the side or rear of the car to obtain the exterior image of the side or rear of the vehicle. After being processed by the image processing module and the microprocessor, the image is obtained. The microprocessor can choose to separate the vehicle exterior image or further integrate the vehicle information into a driving image, and then control the output to the projection display to project the driving image in the driver's visible range; in this way, the driver can watch the front and sides of the car at the same time or the situation behind the car, saving the time of turning around to check the rearview mirror, reducing the driving blind area, and obtaining a safer driving experience.

10, 11: First light image capture device

12: Second light image capture device

13:Third light image capture device

20:Image processing module

21:Artificial intelligence processing module

30:Vehicle information connection interface

40:Microprocessor

50:Projection display

51:Projection screen

511:Vehicle information image

512, 513: Car side image

514, 514’: Rear image of the car

60: Graphics processor

61, 61’, 62, 63: symbols

70:Vehicle

70a, 70b: Transportation

71, 72: Rearview mirror

73:Front windshield

74: Steering wheel

80:lane

81:Left lane

82:Right lane

90:Parking space

Figure 1A: A functional block diagram of the first embodiment of the vehicle head-up display device of the present invention.

Figure 1B: A functional block diagram of the second embodiment of the vehicle head-up display device of the present invention.

Figure 2: A schematic diagram of a location where the vehicle head-up display device of the present invention is installed in a vehicle.

Figure 3A: A schematic diagram of a lane situation where the head-up display device of the present invention is installed on a preceding vehicle.

Figure 3B: A schematic diagram of the projection screen of the present invention in the lane situation of Figure 3A.

Figure 4A: A schematic diagram of the projection screen of the present invention projected on the front windshield of a vehicle.

Figure 4B: Another schematic diagram of the projection screen of the present invention projected on the front windshield of a vehicle.

Figure 4C: Another schematic diagram of the projection screen of the present invention projected on the front windshield of a vehicle.

The present invention is aimed at improving the vehicle head-up display. The technical contents of the present invention will be described in detail below using multiple embodiments and drawings.

First, please refer to FIG. 1A . The first embodiment of the vehicle head-up display device of the present invention includes at least two first light image capture devices 10 and 11, an image processing module 20, a vehicle information connection interface 30, A microprocessor 40 and a projection display 50.

As shown in Figure 2, the above-mentioned first optical image capture devices 10 and 11 are arranged on two opposite outer sides of a vehicle 70; in this embodiment, the first optical image capture devices 10 and 11 are It is installed on the left and right rearview mirrors 71 and 72 of the vehicle 70 to capture images corresponding to the vehicle side and a certain rear view angle outward from the vehicle side, so as to continuously output the left vehicle side image and the right vehicle side image.

The above-mentioned image processing module 20 is electrically connected to the first optical image capture devices 10 and 11, and receives and processes the vehicle side images of the first optical image capture devices 10 and 11; in this embodiment, the image processing The module 20 can process each vehicle side image into a certain size and format and then output it according to the settings. In another embodiment, the image processing module may include a plurality of image processing units, respectively integrated in the corresponding first optical image capturer.

The above-mentioned vehicle information connection interface 30 is used to connect multiple different vehicle information detectors inside the vehicle 70, or is electrically connected to a corresponding interface of a driving computer module that also has vehicle information, such as a Controller Area Network bus (Controller Area Network). bus; CAN bus) to obtain real-time vehicle information of the vehicle; in this embodiment, the vehicle information at least includes vehicle dashboard display information, such as: vehicle speed, gear, direction lights, headlights, tire pressure, steering wheel steering and angle. ..etc., but not limited to the above.

The above-mentioned microprocessor 40 is electrically connected to the image processing module 20 and the vehicle information connection interface 30 to obtain the two-vehicle side images and the vehicle information. Several or all vehicle information can be selected and generated simultaneously according to the settings. The two vehicle side images are integrated into one driving image, or one of the two vehicle side images and the vehicle information can be individually selected as the driving image according to the settings.

The above-mentioned projection display 50 is electrically connected to the microprocessor 40, and the microprocessor 40 controls the projection display 50 according to the driving image, and projects a projection screen 51 containing the driving image toward the front windshield 73, as shown in Figure 3B As shown, it is projected in the field of view in front of the driver, allowing the driver to directly understand the current vehicle information and the environment on the side of the vehicle; in this embodiment, the projection display 50 can be a laser beam scanning projection display controlled by the microprocessor 40 The red, green and blue laser diodes and micro-electromechanical scanning mirrors generate image laser light corresponding to the vehicle information and the image of the second vehicle side, and project the projection screen outward, that is, the second vehicle side image. Images 512 and 513 are respectively displayed on the left and right relative positions of the projection screen 51 with the driver as the center, that is, the left vehicle side image 512 is displayed on the left side of the projection screen 51 Position, the right vehicle side image 513 is displayed on the right side of the projection screen 51 , and the vehicle information image 511 is displayed in the middle of the projection screen 51 , that is, between the two vehicle side images 512 and 513 .

In this embodiment, a second optical image capture device 12 can be further added and electrically connected to the image processing module 20. As shown in FIG. 2, the second optical image capture device 12 is disposed at the rear of the vehicle 70. side to continuously capture images of the rear of the vehicle 70 , and receive post-processing by the image processing module 20 , and output the images of the rear of the vehicle to the microprocessor 40 . The microprocessor 40 obtains the gear status in the vehicle information through the vehicle information connection interface 30 and determines that the current gear of the vehicle 70 is the reverse gear, then integrates the received vehicle rear image 514 into the driving image. , and then control the projection display 50 to project the projection screen 51 of the driving image including the rear image 514 of the car in the field of view in front of the driver, as shown in Figure 4A, to assist the driver in reversing without having to shift his sight. Clearly view the side and rear images of the car and complete the reversing maneuver smoothly and safely.

Taking Figure 4A as an example again, although the rear image 514 in the figure is displayed directly in front, because the reversing direction is opposite to the forward direction, for some drivers who are unable to grasp how to turn the steering wheel in the correct direction when reversing, It is still difficult to intuitively view the rear image of the car in Figure 4A to successfully complete the reversing. That is, if you want to correctly back into the parking space 90 shown in Figure 4A, the steering wheel 74 should be turned clockwise, but this will be different from the direction shown in Figure 4A. Inconsistent; therefore, as shown in FIG. 1 and FIG. 4A, the present invention allows the image processing module 20 or the microprocessor 40 to further perform horizontal mirror image processing on the vehicle rear image 514 according to settings or instructions, and then integrate it. In the driving image, the rear image 514' of the car can be adjusted left and right as shown in Figure 4B, and then the projection display 50 is controlled to be projected in the driver's front field of view; in this way, the driver can intuitively follow the car's rear image 514'. The rear image turns the steering wheel 74 in the correct direction, as shown in Figure 4C, to align the vehicle with the parking space 90.

Please refer to FIG. 1B again, the second embodiment of the vehicle head-up display device of the present invention is substantially the same as the first embodiment shown in FIG. 1A, but further includes an artificial intelligence processing module 21 and a graphics processor. 60; wherein the artificial intelligence processing module 21 is electrically connected between the image processing module 20 and the graphics processor 60, and the graphics processor 60 is electrically connected to the microprocessor 40. In another embodiment, the artificial intelligence processing module 21 , the graphics processor 60 and the microprocessor 40 can be integrated into a system-in-package (SIP) integrated circuit device, but the present invention is not limited thereto.

The above-mentioned artificial intelligence processing module 21 learns characteristics of different roads, pedestrians, traffic signs, vehicles, etc., and when obtaining each vehicle side image through the image processing module 20, as shown in Figure 3A and Figure 3B, determines Whether there are moving vehicles 70a and 70b in the current lane 80 and its left and right lanes 81 and 82, and determine the coordinate position and estimated vehicle speed of the vehicles 70a and 70b in the vehicle side images 512 and 513, and then process it through the drawing The processor 60 generates corresponding marking symbols and outputs them to the microprocessor 40. The microprocessor 40 adds the marking symbols and the estimated vehicle speed to the corresponding vehicle side images 512 and 513, and then integrates the vehicle side images into the driving vehicle. In the image, the projection display 50 is controlled to project a driving image in the driver's field of view in front of the driver, thereby reminding the driver of the status of oncoming vehicles in the left and right lanes 81 and 82 . In addition, please refer to FIG. 1B and FIG. 2 together. This embodiment further includes a third light image capture device 13 for being disposed in front of the vehicle 70 to continuously acquire multiple front images and process them with the artificial intelligence. Module 21 is electrically connected. The artificial intelligence processing module 21 can determine the characteristics of lanes, pedestrians, traffic signs, vehicles and other objects from the image in front of the vehicle based on the learned features. As shown in Figure 3A, the artificial intelligence processing module 21 takes the driving situation as an example. Group 21 determines the vehicles 70a and 70b located in front of the vehicle 70 and in the left lane 81, and generates a vehicle position symbol 61 by the graphics processor 60, and then outputs the vehicle position symbol 61 and its coordinates to the The microprocessor 40 can be integrated into the driving image according to the coordinates of the vehicles 70a and 70b, and then controls the projection display 50 to be projected in the field of view in front of the driver, as shown in Figure 3B, corresponding to the front The vehicle position symbol 61 is superimposed on the actual position of the vehicle 70a to complete the augmented reality display. At the same time, the vehicle position symbol 61' is displayed at the position of the vehicle 70b in the vehicle side image 512; the same time Processing, when the microprocessor 40 confirms that the left turn signal of the current vehicle information is activated, it notifies the artificial intelligence processing module 21 to determine the left lane 81 and its coordinates in the image in front of the vehicle, and the graphics processor 60 generates a The left overtaking guidance symbol 62 is also sent back to the microprocessor 40, and then the microprocessor 40 is integrated into the driving image, and controls the projection display 50 to project the left overtaking guidance symbol 62 in the driver's field of vision. The symbol 62 is superimposed between the actual vehicle lane 80 and the left lane 81 to complete the augmented reality assisted overtaking function.

In addition, as shown in FIG. 1B , FIG. 4A and FIG. 4B , when the microprocessor 40 determines that the gear in the current vehicle information is the reverse gear, the microprocessor 40 notifies the graphics processor 60 and the artificial intelligence The processing module 21 determines the orientation and coordinates of the parking space 90 in the image behind the vehicle, and generates a reverse direction guidance symbol 63, which is also sent back to the microprocessor, and then the microprocessor 40 determines the reverse direction according to the coordinates. The guidance symbol 63 is added to the rear image of the car, and then the rear image of the vehicle is integrated into the driving image, and the projection display 50 is controlled to be projected in the driver's front field of view. The reversing direction guidance symbol 63 is superimposed on the lane and the parking space 90 to complete the auxiliary reversing function.

As can be seen from the above description, the present invention mainly includes at least one optical image capture device, which is disposed on the side or rear of the vehicle to obtain the image outside the vehicle (i.e., the image of the side or rear of the vehicle). The image processing module and the microprocessor After processing, the microprocessor can integrate and output the vehicle exterior image and the vehicle information image to the projection display, and project the vehicle exterior image and the vehicle information image together into a projection screen; because the projection screen is visible to the driver. Within the range, the driver can view the situation in front of and on the side of the car at the same time, saving the time of turning his head to confirm the left and right rearview mirrors, reducing the driving blind area, and obtaining a safer driving experience.

The above are only embodiments of the present invention, and do not limit the present invention in any form. Although the present invention has been disclosed in the embodiments above, they are not used to limit the present invention. Anyone with ordinary knowledge in the technical field, Without departing from the scope of the technical solution of the present invention, the technical content disclosed above can be used to make some changes or modifications to equivalent embodiments with equivalent changes. Without departing from the content of the technical solution of the present invention, any simple modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention still fall within the scope of the technical solution of the present invention.

51:Projection screen

511:Vehicle information

512, 513: Car side image

61, 61’, 62: symbols

70a, 70b: Vehicles

73:Front windshield

81:Left lane

Claims (10)

A vehicle head-up display that integrates rear-view images, including: at least one light image capture device, which continuously outputs multiple exterior images of the vehicle; wherein the exterior images of the vehicle are a vehicle side image, a vehicle rear image, or a vehicle front image; an image processing module A set is electrically connected to the optical image capture device to obtain and process the vehicle exterior images; an artificial intelligence processing module is electrically connected to the image processing module to obtain the vehicle side images and the vehicle front images. , and further identify the vehicles and their coordinate positions in each vehicle side image or each vehicle front image; a vehicle information connection interface to obtain vehicle information; a microprocessor electrically connected to the image processing module and The vehicle information connection interface is used to obtain the external vehicle images and the vehicle information, and the microprocessor generates a driving image, and the driving image includes the external vehicle images or includes the external vehicle images and the vehicle information; wherein the microprocessor generates a driving image through When the image processing module obtains the rear image of the vehicle, it also confirms that the gear in the vehicle information is the reverse gear, and then integrates the rear image of the vehicle into the driving image, in which the rear image of the vehicle in the driving image is processed horizontal mirror image processing; and a projection display that is electrically connected to the microprocessor, and the microprocessor controls the projection display to project a projection screen containing the driving image based on the driving image. The vehicle head-up display as claimed in claim 1, wherein the at least one light image capture device includes: 2. The first light image capture device is electrically connected to the image processing module to continuously output multiple left and right vehicle side images. The microprocessor acquires the vehicle side images through the image processing module. , integrating the simultaneously obtained vehicle information into the driving image; and a second light image capture device, electrically connected to the image processing module to continuously output multiple rear-vehicle images, and the microprocessor uses the image When the processing module obtains the rear images of the vehicle, it also confirms that the gear in the vehicle information is the reverse gear, and then integrates the vehicle information and the rear images obtained at the same time into the driving image. The vehicle head-up display as described in claim 2, wherein the two left and right images are displayed on the left and right sides of the projection screen respectively, and the vehicle information is displayed on the two left and right sides of the projection screen. between silhouettes. The vehicle head-up display as described in claim 2, wherein the two left and right vehicle side images are displayed on the left and right sides of the projection screen respectively, and the vehicle rear image and the vehicle information are displayed on the projection screen. Between the two left and right car side images. The vehicle head-up display as described in claim 4, wherein the image processing module or the microprocessor processes the vehicle rear image through horizontal mirroring and then integrates the microprocessor into the driving image. The vehicle head-up display as described in any one of claims 1 to 5 further includes a third-light image capture device that is electrically connected to the image processing module to continuously output multiple images of the front of the vehicle. The vehicle head-up display as described in claim 6 further includes a graphics processor electrically connected to the artificial intelligence processing module and the microprocessor; wherein After the artificial intelligence processing module identifies the coordinate position of the vehicle in the side image of the vehicle, the graphics processor will generate a vehicle position symbol based on the coordinate position and output it to the microprocessor. The microprocessor will The position symbol is added to the corresponding vehicle side image; and after the artificial intelligence processing module identifies the coordinate position of the vehicle in the front image of the vehicle, the graphics processor will generate a vehicle position symbol based on the coordinate position and output it to the microcomputer. A processor that integrates the vehicle location symbol into the driving image. The vehicle head-up display as described in claim 2, 4 or 5, wherein the artificial intelligence processing module is electrically connected to the image processing module to obtain and identify the parking spaces and their coordinate positions in the images behind the vehicle. The vehicle head-up display as described in claim 8 further includes a graphics processor electrically connected to the artificial intelligence processing module and the microprocessor; wherein the artificial intelligence processing module identifies each of the images behind the vehicle. After determining the coordinate position of the parking grid, the graphics processor will generate a reversing direction guidance symbol based on the coordinate position and output it to the microprocessor. The microprocessor will add the reversing direction guidance symbol to the rear image of the car based on the coordinate position. . For example, the vehicle head-up display as described in claim 7, wherein the microprocessor notifies the graphics processor and the artificial intelligence processing module to determine the corresponding lane of the activated direction light after confirming that the direction light of the vehicle information is activated. and its coordinates, and generates an overtaking guidance symbol, which is then sent back to the microprocessor, which is then integrated into the driving image.

Images