JP2023104972A - Display device - Google Patents

Abstract

To provide a display device capable of favorably suppressing a real image and a virtual image being superposed with each other.SOLUTION: A real image display control part 13 generates a first image ImR which is displayed on a transparent display 5 provided on a wind shield 25. A virtual image display control part 11 displays a second image ImV as a virtual image which is visually recognized farther than the wind shield 25 by a driver by projecting light for configuring the second image ImV on the wind shield 25. A display region calculation part 12 calculates a display possible region R corresponding to a direction in which the driver visually recognizes the virtual image on the basis of an eye point. Then, in the case where the display possible region R and a display position of the first image ImR are determined to be superposed with each other, the real image display control part 13 moves the first image ImR to a position which is not superposed on the display possible region R, or deletes display of the first image ImR.SELECTED DRAWING: Figure 4

Description

The present invention relates to technology for displaying a real image and a virtual image at the same time.

BACKGROUND Conventionally, there has been known a technique of displaying information about route guidance on a windshield (windshield). For example, Patent Literature 1 discloses a technique for displaying guidance information on a transparent display provided on the windshield. Further, in Patent Document 2, a head-up display that displays guidance information as a virtual image is provided with a movement mechanism that can adjust the position of an optical unit so that the incident angle of image display light on the windshield can be changed. , a technique for suitably displaying a virtual image even when the height of the observer's viewpoint (that is, the eye point) is changed. Further, Patent Document 2 also discloses that an optical path correction member that performs different distortion correction processing of a virtual image according to the incident position and incident angle of image display light is provided between the light source unit and the windshield.

JP-A-2005-227208 JP 2010-197493 A

In the head-up display disclosed in Patent Document 2 and the like, the position on the windshield where the observer sees the virtual image changes depending on the observer's eyepoint. In addition, in the transparent display disclosed in Patent Document 1, etc., an image (that is, a real image) formed on the surface of the windshield is displayed, so that the observer can visually recognize the image regardless of the observer's eye point. The position on the windshield to be driven does not change. Therefore, in contrast to a head-up display that allows an observer to visually recognize a virtual image so that it can be seen in the distance, a transparent display that allows an observer to visually recognize an image on the display surface is applied, and the real image and the virtual image are simultaneously displayed in the direction of the windshield. Depending on the height of the eyepoint of the person, the real image displayed by the transparent display and the virtual image displayed by the head-up display may overlap.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and a main object of the present invention is to provide a display device capable of suitably suppressing overlapping of a real image and a virtual image.

According to a claim of the invention, there is provided a display device comprising: first display means provided in a moving object; first display control means for causing the first display means to display a first image; and display a second image. and a second display means, wherein when the positions where the second image and the first image should be displayed overlap, the first display control means displays the first image at a position not overlapping the second image. It is characterized by displaying or erasing the first image.

1 shows a configuration example of a head-up display system; It is a block diagram of the control part of a head up display system. 3 shows positions of concave mirrors corresponding to an eye point when the driver is relatively tall and an eye point when the driver is relatively short. 7 is a flowchart showing a procedure of overlap avoidance processing; A display example when the overlap avoidance process is not executed is shown. A display example when overlapping avoidance processing is executed is shown. A configuration example of a head-up display system in a modified example is shown.

In one preferred embodiment of the present invention, the display device is a display surface provided on a windshield of a mobile object, and a display surface that transmits the scenery in front of the mobile object. First display control means for displaying a first image on a first display means for displaying an image to be visually recognized as a real image; second display control means for displaying a second image to be visually recognized as a virtual image on a second display means for displaying an image to be visually recognized as a virtual image farther than the windshield; and calculating means for calculating an area on the display surface to be displayed, and the first display control means, when the position where the first image should be displayed overlaps the area on the display surface, the first image is displayed at a position not overlapping the area on the display surface, or the first image is erased.

The display device includes first display control means, second display control means, and calculation means. The first display control means generates a first image to be displayed on the first display means. Here, the first display means displays the first image as a real image on a display surface provided on the windshield of the moving object, through which the scenery in front of the moving object is transmitted. The second display control means displays the second image as a virtual image that is visually recognized farther than the windshield by an occupant of the moving object by projecting light that constitutes the second image onto the windshield. The calculation means calculates a region on the display surface of the windshield corresponding to the direction in which the passenger views the virtual image. Then, when the position where the first image should be displayed overlaps the area on the display surface, the first display control means displays the first image at a position not overlapping the area on the display surface, or Erase the first image. By doing so, even when the display position of the virtual image on the windshield changes according to the position of the passenger's eyes, the display device displays the first image as a real image and the virtual image as a virtual image. It is possible to suitably suppress the overlapping of the second image to be visually recognized.

In one aspect of the display device, the second display control means corrects the shape of the second image based on the eye position of the passenger, and the calculation means causes the second display control means to correct the shape of the second image. A region on the display surface where the corrected second image is viewed as a virtual image is calculated. As described above, even when the shape of the second image is corrected for the purpose of correcting the distortion of the virtual image, the display device does not allow the first image displayed as the real image and the second image displayed as the virtual image to overlap. It is possible to suitably suppress the visual recognition of the

In another aspect of the display device, the calculation means calculates a region on the display surface corresponding to a range in which the second display control means can display the virtual image. With this aspect, the display device can reliably prevent the first image and the second image from being superimposed and visually recognized.

In another aspect of the display device, the calculation means calculates a region on the display surface where the second image is viewed as a virtual image. In this aspect, the display device performs processing such as moving or erasing the first image only when the first image and the second image actually overlap. This also allows the display device to reliably prevent the first image and the second image from being superimposed and visually recognized.

In another aspect of the display device, the first display means includes a projector that projects light constituting the first image toward the windshield, and a projector that is installed on the windshield and projects the light from the projector. and a transparent screen film that reflects toward the vehicle interior, and the first display control means supplies the generated first image to the projector. Also according to this aspect, the display device can suitably display the first image as a real image.

In another preferred embodiment of the present invention, in a control method executed by a display device, a display surface provided on a windshield of a moving object, the display surface transmitting the scenery in front of the moving object, a first display control step of displaying a first image on a first display means for displaying an image visually recognized as a real image by an occupant of the moving body; a second display control step of displaying a second image to be visually recognized as a virtual image on a second display means for displaying an image to be visually recognized as a virtual image to a passenger of a mobile object at a distance farther than the windshield; and a calculating step of calculating an area on the display surface corresponding to a viewing direction of the virtual image, wherein the first display control step determines a position where the first image is to be displayed on the area on the display surface. If it overlaps, the first image is displayed at a position not overlapping the area on the display surface, or the first image is erased. By executing this control method, the display device can preferably prevent the first image displayed as a real image and the second image displayed as a virtual image from overlapping and being visually recognized.

In still another embodiment of the present invention, there is provided a program executed by a computer, wherein a display surface provided on a windshield of a moving object, wherein the moving object is displayed on a display surface through which a scene in front of the moving object is transmitted. a first display control means for displaying a first image on a first display means for displaying an image visually recognized as a real image by a passenger; a second display control means for displaying a second image to be visually recognized as a virtual image on a second display means for displaying an image to be visually recognized as a virtual image by a passenger farther than the windshield; and a second display control means for causing the passenger to visually recognize the virtual image. The computer functions as calculation means for calculating an area on the display surface corresponding to the direction, and the first display control means causes the position where the first image is to be displayed overlaps the area on the display surface. displays the first image at a position not overlapping the area on the display surface, or erases the first image. By executing this program, the computer can preferably prevent the first image displayed as a real image and the second image displayed as a virtual image from being superimposed and visually recognized. Preferably, the program is stored in a storage medium.

Preferred embodiments of the present invention will be described below with reference to the drawings.

[System configuration]
FIG. 1 is a configuration example of a head-up display system 2 according to an embodiment. As shown in FIG. 1, the head-up display system 2 according to this embodiment can simultaneously display a real image and a virtual image, and mainly includes a virtual image projection unit 4, a transparent display 5, and a vehicle interior. It includes a photographing camera 6, a concave mirror 8, and a later-described control unit (not shown). The head-up display system 2 is attached to a vehicle including a windshield 25, a ceiling 27, a bonnet 28, and a dashboard 29.

The virtual image projection unit 4 is provided in the dashboard 29 and is a liquid crystal display that displays an image to be displayed as a virtual image. The image displayed by the virtual image projection unit 4 (also referred to as “first image ImR”) is, for example, facility information, route guidance information, traveling speed information, and other information that assists driving. The virtual image projection unit 4 is also directed toward a concave mirror 8 provided in the dashboard 29 , and light emitted from the virtual image projection unit 4 (also referred to as “virtual image display light”) enters the concave mirror 8 . In this case, the light reflected by the concave mirror 8 reaches the windshield 25 through the opening 89 provided in the dashboard 29, and is further reflected by the windshield 25. ) is reached. As a result, the virtual image projection unit 4 causes the display light to reach the driver's eye point, thereby allowing the driver to visually recognize the virtual image indicated by the arrow 70 .

The virtual image projection unit 4 may be a projector or the like having a screen on which an image is formed instead of the liquid crystal display. The virtual image projection unit 4 is an example of "second display means" in the present invention.

The transparent display 5 is a transparent EL display attached to the indoor side of the windshield 25 . An image displayed by the transparent display 5 (also referred to as a “second image ImV”) is drawn on the display surface of the transparent display 5 , so that it is visible on the windshield 25 . Here, since the second image ImV is displayed as a real image, the display position of the second image ImV does not depend on the eyepoint. Note that the transparent display 5 may be sandwiched between the pair of glasses that constitute the windshield 25 . The transparent display 5 is an example of "first display means" in the present invention.

The vehicle interior photographing camera 6 is a camera for photographing the interior of the vehicle, and is installed so that the face of the driver sitting in the driver's seat is within the photographing range. An image captured by the vehicle interior camera 6 (also referred to as a “captured image ImC”) is used to detect an eye point. The vehicle interior photographing camera 6 transmits the generated photographed image ImC to the control unit 10 . Various sensors such as a distance sensor may be provided as eye point detection means in place of or in addition to the vehicle interior photographing camera 6 . In this case, each installed sensor transmits a detection signal to a control unit (not shown).

The concave mirror 8 reflects the virtual image display light emitted from the virtual image projection unit 4 toward the opening 89 provided in the dashboard 29 to reach the windshield 25 . In this case, the concave mirror 8 magnifies and reflects the image indicated by the virtual image display light. Further, the concave mirror 8 has an angle adjustment mechanism that can adjust the installation angle of the concave mirror 8 based on a control signal sent from the control unit.

Although the case where the driver is the observer will be described below, another passenger may be the observer. Even in this case, the vehicle interior photographing camera 6 is directed so that the observer's face is within the photographing range.

[Function configuration]
The head-up display system 2 has a control unit that controls the head-up display system 2 at an arbitrary position inside the vehicle. FIG. 2 is a block diagram showing the functional configuration of the control section 10 of the head-up display system 2. As shown in FIG. As shown in FIG. 2, the control unit 10 is electrically connected to the virtual image projection unit 4, the transparent display 5, and the vehicle interior photography camera 6, the virtual image display control unit 11, the display area calculation unit 12, and the real image display unit. and a control unit 13 . Note that the virtual image display control unit 11, the display area calculation unit 12, and the real image display control unit 13 may be configured integrally, or may be installed at separate locations while being electrically connected. good. The control unit 10 is an example of a computer that executes programs according to the present invention.

The virtual image display control unit 11 generates a second image ImV to be displayed on the virtual image projection unit 4 and supplies the generated second image ImV to the virtual image projection unit 4 . At this time, the virtual image display control unit 11 detects an eye point based on the photographed image ImC supplied from the vehicle interior photographing camera 6, and generates a virtual image so that distortion of the virtual image visually recognized at the detected eye point is reduced. Correct the shape of the two images ImV.

Furthermore, the virtual image display control unit 11 transmits a control signal for adjusting the installation angle of the concave mirror 8 to the concave mirror 8 based on the detected eye point. Thereby, the virtual image display control unit 11 displays the virtual image at substantially the same position regardless of the eye point. Angular adjustment of the concave mirror 8 is described in detail in the section Angular Adjustment of Concave Mirror Based on Eyepoint. The virtual image display control unit 11 supplies the detected eyepoint information to the real image display control unit 13 . The virtual image display controller 11 is an example of the "second display controller" in the present invention.

The display area calculator 12 calculates an area on the windshield 25 where the virtual image may be displayed (also referred to as "displayable area R") based on the calculated eyepoint. The display area calculation unit 12 then supplies information on the calculated displayable area R to the real image display control unit 13 . The display area calculator 12 is an example of the "calculator" in the present invention.

The real image display control unit 13 generates a first image ImR to be displayed on the transparent display 5 and supplies an image signal corresponding to the generated first image ImR to the transparent display 5 . Thereby, the real image display control unit 13 causes the transparent display 5 to display the first image ImR as a real image. At this time, if the real image display control unit 13 determines that the displayable area R notified from the display area calculation unit 12 and the display position of the first image ImR overlap, processing for avoiding the overlap ("overlap Also referred to as "avoidance processing"). Specifically, as overlap avoidance processing, the real image display control unit 13 moves the first image ImR that overlaps the displayable region R to a position that does not overlap the displayable region R, or stops displaying the first image ImR. (i.e. erase). The real image display controller 13 is an example of the "first display controller" in the present invention.

[Angle adjustment of concave mirror based on eye point]
Next, angle adjustment of the concave mirror 8 based on the eyepoint will be described.

FIG. 3 shows the positions of the concave mirror 8 corresponding to the eye point "PH" when the driver is relatively tall and the eye point "PL" when the driver is relatively short. In FIG. 3, the solid line indicates the position of the concave mirror 8 and the optical axis of the virtual image display light for the eye point PH, and the broken line indicates the position of the concave mirror 8 and the optical axis of the virtual image display light for the eye point PL.

As shown in FIG. 3, the virtual image display control unit 11 changes the installation angle of the concave mirror 8 according to the height of the detected eye point, so that the position indicated by the arrow 70 is displayed regardless of the height of the eye point. A virtual image is displayed on the In this case, for example, the virtual image display control unit 11 stores in advance a map or the like indicating an appropriate installation angle of the concave mirror 8 according to the height of the eye point, and refers to the map to determine the height of the detected eye point. Then, the installation angle of the concave mirror 8 is determined.

Further, as shown in FIG. 3, the displayable area R on the windshield 25 changes according to the installation angle of the concave mirror 8. As shown in FIG. Specifically, the displayable region R (also called “displayable region RH”) for the eye point PH is larger than the displayable region R (also called “displayable region RL”) for the eyepoint PL. are also arranged above the windshield 25 .

As described above, the displayable area R on the windshield 25 changes according to the installation angle of the concave mirror 8. Therefore, when the installation angle of the concave mirror 8 is changed according to the height of the detected eye point, The displayable area R moves. As a result, depending on the eyepoint, the displayable region R may overlap the display position of the first image ImR. Taking the above into consideration, the control unit 10 executes overlap avoidance processing, which will be described later.

[Overlapping avoidance processing]
Next, the overlap avoidance processing will be specifically described.

(1) Processing Flow FIG. 4 is a flow chart showing the procedure of overlap avoidance processing in this embodiment. The control unit 10 repeatedly executes the processing of the flowchart shown in FIG.

First, the virtual image display control unit 11 detects the driver's eye point based on the photographed image ImC photographed by the vehicle interior photographing camera 6 (step S101). Then, the display area calculator 12 recognizes the displayable area R on the windshield 25 based on the eyepoint detected by the virtual image display controller 11 (step S102). Specifically, the display area calculator 12 recognizes the displayable area R according to the installation angle of the concave mirror 8 adjusted based on the detected eye point. In this case, for example, the display area calculator 12 stores in advance a map showing the displayable area R corresponding to each installation angle of the concave mirror 8, or a map showing the displayable area R corresponding to each position of the eye point. Then, the displayable area R is recognized by referring to the map or the like.

Next, after generating the first image ImR to be displayed, the real image display control unit 13 determines whether or not the display position of the generated first image ImR overlaps the displayable region R recognized in step S102 (step S103). . Then, when the display position of the first image ImR overlaps the displayable region R recognized in step S102 (step S103; Yes), the real image display control unit 13 causes the overlapping first image ImR position or erase the first image ImR (step S104). Thereby, the real image display control unit 13 can reliably prevent the virtual image and the real image from being superimposed and visually recognized.

On the other hand, if the display position of the first image ImR does not overlap the displayable region R (step S103; No), the real image display control unit 13 displays the first image ImR without changing the display position of the first image ImR. It is displayed on the transparent display 5 (step S105).

(2) Display Example Next, a display example based on each appointment PH and PL shown in FIG. 3 will be described.

FIG. 5 shows a display example of the front scenery through the windshield 25 when the overlap avoidance process is not executed. Specifically, FIG. 5(A) shows the forward scenery through the windshield 25 visually recognized by the driver at eye point PH, and FIG. 5(B) shows the windshield visually recognized by the driver at eye point PL. 25 shows the forward view through 25. FIG.

In FIGS. 5A and 5B, the virtual image display control unit 11 causes the virtual image projection unit 4 to display the route image 21 corresponding to the road in the landscape as a virtual image. In addition, the real image display control unit 13 provides, as real images, arrow images 31 and 32 respectively indicating the direction of travel at the two nearest guidance points, and the relative position of the vehicle to the destination and the elapsed time from departure. A running information image 33 is displayed on the transparent display 5 .

Here, the displayable area RL is arranged below the windshield 25 than the displayable area RH, as described with reference to FIG. Therefore, in the example of FIG. 5B, the displayable area RL overlaps the travel information image 33, which is a real image. As a result, the route image 21, which is a virtual image, and the travel information image 33, which is a real image, partially overlap. In this way, when the displayable region R and the display position of the first image ImR overlap, there is a high possibility that the observer will feel uncomfortable and the visibility will be reduced.

FIG. 6(A) shows a first display example of the front scenery through the windshield 25 visually recognized by the driver at the eye point PL when the overlap avoidance process is executed. Also, FIG. 6B shows a second display example of the front scenery through the windshield 25 visually recognized by the driver at the eye point PL when the overlap avoidance process is executed.

In the first display example shown in FIG. 6A, the real image display control unit 13 erases the display of the travel information image 33, which is the first image ImR overlapping the displayable region R. FIG. As a result, the real image display control unit 13 can suitably prevent display from becoming complicated due to overlapping of the real image and the virtual image. On the other hand, in a second display example shown in FIG. It is moved to the upper left of the windshield 25 . Also in this aspect, the real image display control section 13 can suitably prevent display from becoming complicated due to overlapping of the real image and the virtual image.

As described above, the real image display control unit 13 of the head-up display 2 according to the present embodiment is provided on the windshield 25, and is a transparent display that displays the first image ImR as a real image on the display surface through which the scenery in front of the vehicle is transmitted. 5 to generate a first image ImR to be displayed. The virtual image display control unit 11 projects the light forming the second image ImV onto the windshield 25 to display the second image ImV as a virtual image that is visually recognized farther than the windshield 25 by the driver. The display area calculator 12 calculates a displayable area R corresponding to the direction in which the driver views the virtual image based on the detected eye point. When determining that the displayable area R and the display position of the first image ImR overlap, the real image display control unit 13 moves the first image ImR that overlaps the displayable area R to a position that does not overlap the displayable area R. or stop (delete) the display of the first image ImR. As a result, even when the head-up display 2 displays the real image and the virtual image at the same time, it is possible to suitably suppress the decrease in visibility and the occurrence of discomfort due to the overlapping of the real image and the virtual image.

[Modification]
Modifications suitable for the above embodiment will be described below. The following modifications may be applied to the above embodiments in any combination.

(Modification 1)
The control unit 10 calculates a region on the windshield 25 where the second image ImV is actually viewed as a virtual image (also referred to as a “virtual image display region”). , the display position of the overlapping first image ImR may be moved or the first image ImR may be erased.

In this case, the virtual image display control unit 11 provides the display area calculation unit 12 with information on the shape of the second image ImV after correction for reducing distortion of the virtual image has been applied, in addition to information on the detected eye point. Send. Then, the display area calculation unit 12 calculates the windshield where the second image ImV is visually recognized based on the eye point and the information on the shape of the second image ImV after the correction for reducing the distortion of the virtual image is applied. 25 is calculated as a virtual image display area. At this time, when there are multiple second images ImV displayed as virtual images at the same time, the display area calculation unit 12 calculates areas corresponding to the respective second images ImV as virtual image display areas. Then, when the calculated virtual image display area overlaps the first image ImR, the real image display control unit 13 moves the display position of the overlapping first image ImR or erases the first image ImR.

According to this modification, the head-up display system 2 moves the display position of the overlapping first image ImR or displays the first image ImR only when the first image ImR and the second image ImV actually overlap. erasure can be performed.

In the case of Modification 1, instead of the concave mirror 8 having the angle adjustment mechanism, the displayable region R is set sufficiently wide so that the second image ImV can be displayed at a position corresponding to an arbitrary eye point. may be In this case, the virtual image display control unit 11 changes the display position of the second image ImV within the displayable region R according to the detected eye point instead of changing the installation angle of the concave mirror 8 . Then, when the virtual image display area calculated by the display area calculation unit 12 overlaps the first image ImR, the real image display control unit 13 moves the display position of the overlapping first image ImR or erases the first image ImR. do.

(Modification 2)
Transparent display 5 is not limited to a transparent EL display.

FIG. 7 shows a schematic configuration of a head-up display system 2 according to a modification. In the example of FIG. 7, the head-up display system 2 has a transparent screen film 5A attached to the windshield 25 and a projector 5B provided within the dashboard 29. In the example of FIG. Then, the projector 5B projects the first image ImR toward the windshield 25 under the control of the real image display control unit 13, and the transparent screen film 5A reflects the light from the projector 5B toward the interior of the vehicle. In this case, the projected first image ImR forms an image on the windshield 25 and is viewed by the driver as a real image.

(Modification 3)
Instead of deforming the second image ImV to correct the distortion of the virtual image, the virtual image display control unit 11 transmits a control signal to the concave mirror 8 and adjusts the installation angle of the concave mirror 8 so that the distortion of the virtual image is reduced. By doing so, the distortion of the virtual image may be corrected.

2 head-up display system 4 virtual image projection unit 6 in-vehicle camera 8 concave mirror 10 control unit 11 virtual image display control unit 12 display area calculation unit 13 real image display control unit 25 windshield 28 bonnet 29 dashboard

Claims (1)

a first display means provided on the mobile body;
a first display control means for displaying a first image on the first display means;
a second display means for displaying a second image;
with
When the positions where the second image and the first image should be displayed overlap, the first display control means causes the first image to be displayed at a position not overlapping the second image, or displays the first image. A display device characterized by erasing.