JP7238739B2 - display controller - Google Patents

Description

The disclosure according to this specification relates to the display of virtual images.

The head-up display of Patent Literature 1 displays a virtual image having an image plane that is inclined so that the distance increases from the bottom to the top.

JP 2017-219755 A

In viewing a virtual image, the viewer's head movement may change the viewpoint from which the virtual image is viewed. As described above, in a virtual image with a tilted image plane, there is a tendency that the change in distortion on the long distance side is small and the change in distortion on the short distance side is large with respect to the displacement of the viewpoint in the horizontal direction. For this reason, display content using a virtual image, for example, a rectangular display content on the original image, is distorted like a parallelogram with respect to the displacement of the viewpoint in the horizontal direction, and furthermore, the direction of distortion and the rate of deformation change. can.

One of the purposes of the disclosure of this specification is to provide a display control device that improves the visibility of display content using a virtual image.

One of the aspects disclosed herein is a head-up display (10, 510), a display control device for controlling the virtual image original image (OI) output from the image output unit (21),
a viewpoint specifying unit (61) that specifies the viewer's viewpoint (RVP, LVP) of the virtual image;
a content placement unit (63) that places display content (DC) on the original image;
a content transformation unit (64, 564) that provides the original image to the image output unit after performing correction processing for transforming the display content into a transformation mode according to the viewpoint ,
The content transformation unit transforms the transformation mode so as to cancel the distortion of the display content expected in the virtual image viewed from the correction reference point (CRP) set based on the right-eye viewpoint and the left-eye viewpoint as viewpoints. decide and
The correction reference point is located at a position decentered from the binocular center (BM) between the right and left eye viewpoints to the side of the viewpoint where the virtual image can be visually recognized with higher luminance among the right and left eye viewpoints. set .
In addition, another one of the disclosed aspects is a head-up display ( 10, 510), a display control device for controlling the virtual original image (OI) output from the image output unit (21),
a viewpoint specifying unit (61) that specifies the viewer's viewpoint (RVP, LVP) of the virtual image;
a content placement unit (63) that places display content (DC) on the original image;
a content transformation unit (64, 564) that provides the original image to the image output unit after performing correction processing for transforming the display content into a transformation mode according to the viewpoint,
The virtual image becomes visible to a viewer whose viewpoint is positioned within the viewing area (EB),
Define a central region (CA) including the center (BC) of the visible region and a pair of lateral regions (RSA, LSA) sandwiching the central region from both left and right sides as regions that virtually divide the visible region. Then,
The content transformation unit transforms the transformation mode so as to cancel the distortion of the display content expected in the virtual image viewed from the correction reference point (CRP) set based on the right-eye viewpoint and the left-eye viewpoint as viewpoints. decide and
The correction reference point is set based on different conditions depending on which of the center region and the pair of side regions the binocular center of the right eye viewpoint and the left eye viewpoint is located.
In addition, another one of the disclosed aspects is a head-up display ( 10, 510), a display control device for controlling the virtual original image (OI) output from the image output unit (21),
a viewpoint specifying unit (61) that specifies the viewer's viewpoint (RVP, LVP) of the virtual image;
a content placement unit (63) that places display content (DC) on the original image;
a content transformation unit (64, 564) that provides the original image to the image output unit after performing correction processing for transforming the display content into a transformation mode according to the viewpoint,
The content transforming unit cancels the distortion of the display content expected in the virtual image viewed from the correction reference point (CRP) set based on the dominant eye viewpoint of the right eye viewpoint and the left eye viewpoint as viewpoints. , determines the variant,
The virtual image becomes visible to a viewer whose viewpoint is positioned within the viewing area (EB),
As areas that virtually divide the visual recognition area, a dominant eye whole visible area (DA1) where the entire virtual image can be visually recognized from the dominant eye viewpoint, and a dominant eye whole visible area excluding the dominant eye whole visible area (DA2). , is defined as
The correction reference point is
When the dominant eye viewpoint is located in the dominant eye whole visual recognition area, it is set to match the dominant eye viewpoint,
When the dominant eye viewpoint is positioned in the region where the entire dominant eye cannot be visually recognized, the dominant eye viewpoint is set to a position that is decentered toward the anti-dominant eye viewpoint side between the right eye viewpoint and the left eye viewpoint.
In addition, another one of the disclosed aspects is a head-up display ( 510), a display control device for controlling the virtual image original image (OI) output from the image output unit (21),
a viewpoint specifying unit (61) that specifies the viewer's viewpoint (RVP, LVP) of the virtual image;
a content placement unit (63) that places display content (DC) on the original image;
A content transformation unit (564) that provides the original image to the image output unit after performing correction processing for transforming the display content into a transformation mode according to the viewpoint,
further comprising an angle specifying unit (565) that acquires information about the angular posture of a movable optical member that is provided in the head-up display and changes the angle at which the image plane is tilted, and specifies the angle;
The content transformation unit determines a transformation mode according to the viewpoint and the angular orientation.

According to these aspects, the original image controlled by the display control device is provided to the head-up display after performing correction processing for deforming the display content into a deformation mode according to the viewpoint. Based on the original image output from the image output unit of the head-up display, the display content on the virtual image that forms the tilted image plane has the distortion according to the viewpoint corrected by correction processing. Therefore, the distortion of the displayed content due to the virtual image viewed from the viewpoint is reduced, and the visibility is improved.

It should be noted that the reference numerals in parentheses exemplarily indicate the correspondence with the portions of the embodiment described later, and are not intended to limit the technical scope.

1 is a block diagram showing an overview of an HMI system; FIG. It is a figure which shows the mounting state to the vehicle of HUD and DSM. It is a figure which shows the relationship between a visual recognition area and luminance distribution. It is a figure which shows the schematic structure of HCU. FIG. 4 is a diagram for explaining a correction reference point; FIG. 4 is a graph showing the relationship between the left and right positions of the center of both eyes and the left and right positions of a correction reference point; FIG. 4 is a diagram showing an example of the relationship between an original image and a virtual image with respect to viewpoint displacement. 6 is a flowchart of display control processing by the HCU; It is a figure corresponding to FIG. 3 in 2nd Embodiment. It is a figure corresponding to FIG. 6 in 2nd Embodiment. It is a figure corresponding to FIG. 6 in 3rd Embodiment. It is a figure corresponding to FIG. 6 in 4th Embodiment. It is a figure which shows the relationship between the movable mirror and image plane in 5th Embodiment. It is a figure corresponding to FIG. 4 in 5th Embodiment. It is a figure corresponding to FIG. 8 in 5th Embodiment. It is a figure corresponding to FIG. 4 in 6th Embodiment. It is a figure corresponding to FIG. 7 in 6th Embodiment. It is a figure corresponding to FIG. 8 in 6th Embodiment.

A plurality of embodiments will be described below with reference to the drawings. Note that redundant description may be omitted by assigning the same reference numerals to corresponding components in each embodiment. When only a part of the configuration is described in each embodiment, the configurations of other embodiments previously described can be applied to other portions of the configuration. In addition, not only the combinations of the configurations specified in the description of each embodiment, but also the configurations of a plurality of embodiments can be partially combined even if they are not specified unless there is a particular problem with the combination. .

(First embodiment)
As shown in FIG. 1, the display control device according to the first embodiment is an HCU (Human Machine Interface Control Unit) 50 . The HCU 50 configures an HMI (Human Machine Interface) system 9 used in the vehicle 1 together with a Head Up Display (HUD) 10 . The HCU 50 controls the original image OI of the virtual image VRI to be output to the image output unit 21 of the HUD 10 .

The HMI system 9 further includes a driver status monitor (DSM) 40 and the like. The HMI system 9 has an input interface function for accepting user operations by a passenger (eg, driver) of the vehicle 1 and an output interface function for presenting information to the driver.

The HUD 10 is configured to be mounted on a vehicle 1 and accommodated within an instrument panel 2 of the vehicle 1, as shown in FIG. The HUD 10 projects display light toward a projection section 3 a provided on the windshield 3 of the vehicle 1 . The HUD 10 causes the display light to reach the visual recognition area EB by reflecting the display light at the projection unit 3a. As a result, the driver as a viewer who positions the viewpoints RVP and LVP within the visual recognition area EB perceives the display light as a virtual image VRI.

Hereinafter, unless otherwise specified, front, rear, up, down, right, and left directions are described with respect to the vehicle 1 on the horizontal plane HP.

The windshield 3 of the vehicle 1 is a transmissive member made of, for example, glass or synthetic resin and formed into a translucent plate. The windshield 3 is arranged above the instrument panel 2 . The windshield 3 is slanted so as to be further away from the instrument panel 2 as it goes from the front to the rear. The windshield 3 forms a projection portion 3a onto which display light is projected in a smooth concave or planar shape. Such a projection unit 3a is configured to surface-reflect the display light.

The projection unit 3a is configured such that the display light is reflected toward the visual recognition area EB by diffraction reflection due to interference fringes instead of surface reflection by providing a reflective holographic optical element on the windshield 3. may have been Moreover, the projection part 3 a may not be provided on the windshield 3 . For example, a combiner that is separate from the vehicle 1 may be installed in the vehicle 1 and the combiner may be provided with the projection unit 3a.

The visible area EB is defined as a spatial area in which the virtual image VRI displayed by the HUD 10 is visible so as to satisfy a predetermined standard (for example, a spatial area in which the entire virtual image VRI is visible to at least one of the right eye and the left eye). Defined. The visible area EB is an area corresponding to a general eyebox or an area conforming to the eyebox. The visual recognition area EB is typically set so as to overlap the eyelip set on the vehicle 1 . An eyelip is set for each eye, and is set as an ellipsoidal virtual space based on an eye range that statistically represents the spatial distribution of the positions of the driver's eyes. The visual recognition area EB is set, for example, ahead of the headrest of the driver seated on the seat.

Specific configurations of the HUD 10, DSM 40, and HCU 50 in the HMI system 9 will be described in order below. The HUD 10 includes a housing 11 , an image output section 21 and a light guide section 31 . The housing 11 is made of synthetic resin or metal, for example, and has a hollow shape to accommodate the image output section 21 and the like, and is installed in the instrument panel 2 . The housing 11 has an optically open window portion 12 on its upper surface facing the projection portion 3a in the vertical direction. The window portion 12 is covered with, for example, a dustproof sheet 13 capable of transmitting display light.

The image output unit 21 is a projection device that emits display light of the original image OI of the virtual image VRI to be finally formed as the virtual image VRI toward the light guide unit 31 and outputs the display light. The image output unit 21 includes a type that displays the original image OI on the display screen, a type that draws the original image OI on the screen, and the like. Specifically, the image output unit 21 includes a liquid crystal display using a transmissive or reflective liquid crystal panel, a micro LED type display in which self-emitting micro LEDs are arranged, a laser scanner type display, a DMD (Digital A DLP (Digital Light Processing; registered trademark) type display using a Micromirror Device or the like can be adopted. The image output unit 21 can appropriately rewrite and output the original image OI to be output based on the video signal from the HCU 50 .

The light guide section 31 guides the display light emitted from the image output section 21 toward the projection section 3 a of the windshield 3 . As the light guide section 31, various configurations can be adopted, such as a configuration consisting of one concave mirror, a configuration combining one plane mirror and one concave mirror, and a configuration combining one convex mirror and one concave mirror. . Here, the light guide section 31 preferably has a function of enlarging the virtual image VRI visually recognized by the driver with respect to the original image OI formed by the image output section 21 .

The display light guided to the light guide portion 31 is emitted to the outside of the HUD 10 by passing through the window portion 12, and enters the projection portion 3a. When the display light reflected by the projection unit 3a reaches the viewpoints RVP and LVP, the driver can visually recognize the virtual image VRI in the space outside the vehicle on the opposite side of the visual recognition area EB with the projection unit 3a interposed therebetween. Here, since the projection unit 3a is provided on the windshield 3 as a transparent member, the virtual image VRI is displayed superimposed on the scenery outside the vehicle.

By appropriately setting the orientations of the image output unit 21 and the light guide unit 31, the image plane IP of the virtual image VRI is inclined so that the distance from the driver increases from the bottom to the top. By tilting the image plane IP, for example, the angle formed by the image plane IP and the road surface (for example, the horizontal plane HP) on the visual recognition area EB side becomes small. can be realized by Further, by tilting the image plane IP, it is possible to selectively display the display distance of the display content DC according to the situation, for example. A line-of-sight reference tilt angle θgi, which is an upward angle formed by the image plane IP from the viewpoints RVP and LVP and the line-of-sight direction toward the center of the image plane IP, is an obtuse angle larger than 90 degrees.

As shown in FIG. 3, the visual recognition area EB in which the virtual image VRI is visible has an illuminance distribution in which the illuminance of the display light decreases from the center BC toward the left and right ends BRE and BLE. In other words, the visual recognition area EB has a luminance distribution in which the average luminance of the virtual image VRI visually recognized from the viewpoints RVP and LVP decreases as the viewpoints RVP and LVP move from the center BC toward the left and right ends BRE and BLE. have The average brightness of the virtual image VRI in this embodiment is the average value of the brightness of each pixel of the virtual image VRI when all the pixels of the original image OI are displayed in white with the maximum brightness that the image output unit 21 can realize. be. This illuminance distribution and luminance distribution have a Gaussian distribution whose half value width is sufficiently larger than the distance between the right-eye viewpoint RVP and the left-eye viewpoint LVP in a cross section along the front-rear direction and the left-right direction of the visual recognition area EB. Present.

The DSM 40 shown in FIG. 2 photographs a photographing range including the visual recognition area EB, and analyzes the photographed image to detect the position of the driver's eyes, more specifically, both the positions of the right and left eyes. , and even monitor driver drowsiness and distractions. The DSM 40 includes a near-infrared light source, a near-infrared camera, and a control unit for controlling them.

The DSM 40 is installed, for example, on the upper surface of the steering column or the upper surface of the instrument panel 2 with the near-infrared camera facing the headrest of the driver's seat. The DSM 40 uses a near-infrared camera to photograph the driver's head irradiated with near-infrared light by the near-infrared light source. An image captured by the near-infrared camera is image-analyzed by the control unit. The control unit can extract information such as the position of the right eye and the position of the left eye from the captured image and sequentially provide the extracted information to the HCU 50 .

As shown in FIG. 1 , the HCU 50 is an electronic control unit that integrally controls display by an in-vehicle display device including the HUD 10 . The HCU 50 mainly includes a computer including a processing unit 51, a RAM (random access memory) 52, a storage unit 53, an input/output interface 54, and a bus connecting them. The processing unit 51 is hardware for arithmetic processing coupled with the RAM 52 . The processing unit 51 includes at least one arithmetic core such as a CPU (Central Processing Unit), a GPU (Graphical Processing Unit), and a RISC (Reduced Instruction Set Computer). The processing unit 51 may be configured to further include an IP core or the like having an FPGA and other dedicated functions. The RAM 52 may be configured to include a video RAM for image generation. The processing unit 51 accesses the RAM 52 to execute various processes for realizing the functions of each functional unit, which will be described later.

The storage unit 53 is configured to include a nonvolatile storage medium. The storage unit 53 stores various programs (display control program, etc.) executed by the processing unit 51 . Also, the HCU 50 is communicably connected to the vehicle system 4, the DSM 40, the HUD 50, and the like via an input/output interface 54. FIG.

The vehicle system 4 includes, for example, an in-vehicle driving support ECU that supervises automatic driving or advanced driving support of the vehicle 1, a peripheral monitoring sensor that monitors the external world (surroundings) of the vehicle 1, and a sensor that is fixed on the road and necessary for driving the vehicle 1. Various configurations suitable for the vehicle 1 may be employed, such as a traffic information center that provides such information or remotely controls the vehicle 1, and combinations thereof.

The HCU 50 has a plurality of functional units for controlling display by the HUD 10 by causing the processing unit 51 to execute the display control program stored in the storage unit 53 . Specifically, as shown in FIG. 4, functional units such as a viewpoint specifying unit 61, a content information acquisition unit 62, a content placement unit 63, and a content transformation unit 64 are constructed.

The viewpoint specifying unit 61 specifies the viewpoint of the driver viewing the virtual image VRI (more specifically, the right eye viewpoint RVP and the left eye viewpoint LVP) based on the position information of the right eye and left eye acquired from the DSM 40 . The viewpoint specifying unit 61 defines the right-eye viewpoint RVP and the left-eye viewpoint LVP in a coordinate system based on the visual recognition area EB, and distributes the coordinate information generated by these regulations to the content placement unit 63 and the content transformation unit 64. provided sequentially to

The content information acquisition unit 62 acquires content information from the vehicle system 4 or the like. The content information includes information of a command to display a predetermined display content DC, information of the display content to be displayed by the display content DC, and information of the external world of the vehicle 1 necessary for displaying the display content DC superimposed on the scenery. etc. are included. The content information acquisition section 62 provides the acquired content information to the content placement section 63 .

The content placement unit 63 selects the display content DC to be displayed, and places it on the original image OI before correction processing (hereinafter referred to as pre-correction image). The content placement section 63 has a content selection function and a layout function.

The content selection function is a function of selecting display content DC to be displayed based on the content information provided from the content information acquisition unit 62 . The selected display content DC may be one, may be two or more, or may not be selected depending on the case.

The layout function is a function of arranging the display content DC selected to be displayed on the pre-correction image. The content placement unit 63 determines whether the display content DC selected as the display target is to be displayed as the follow-up content or as the non-follow-up content, that is, the follow-up mode of the display content DC.

Following content is an AR display used for Augmented Reality (AR) display. The display position of the follow-up content is associated with a specific superimposed object existing outside the vehicle 1, such as a road surface, another vehicle, a pedestrian, and a road sign. The superimposition target may be visible to the driver or may be hidden in a blind spot and invisible to the driver. The follow-up content is superimposed and displayed on a specific superimposition target, and follows the superimposition target so as to be fixed relative to the superimposition target, and the apparent display position from the driver's viewpoint RVP, LVP can be moved. is. That is, the superimposition state of the follow-up content with the superimposition target is continuously maintained as the vehicle 1 moves or the superimposition target moves.

The non-following content is a non-AR display object other than the following content among the objects superimposed on the external world of the vehicle 1 . Unlike the follow-up content, the non-follow-up content is superimposed and displayed on the outside of the vehicle 1 in a non-superimposed state on a specific superimposition target. Non-following content is displayed as if it is relatively fixed to the vehicle configuration, such as the windshield 3, without following a specific superimposition target. Depending on the positional relationship between the vehicle 1 and the object to be superimposed, even non-following content may be superimposed on a pedestrian or the like accidentally or temporarily.

The content placement unit 63 places the non-following content out of the display content DC selected as the display target in a predetermined area on the pre-correction image. The content placement unit 63 simulates a virtual three-dimensional space (hereinafter referred to as virtual space) in order to determine the placement of the follow-up content among the display content DCs selected as display targets. The content placement unit 63 reproduces the current surrounding environment of the vehicle 1 in the virtual space based on the information provided by the viewpoint specifying unit 61, the vehicle system 4, and the like. Based on the relative positions of the viewpoint and the superimposition target in the virtual space, the content placement unit 63 places the follow-up content in a region superimposed on the superimposition target among the regions on the image plane in the virtual space.

The content transformation unit 64 outputs the original image OI to the image output unit 21 after executing correction processing for transforming the display content DC into a transformation mode according to the viewpoints RVP and LVP. The content transformation unit 64 has a correction reference point setting function and a correction processing function.

The correction reference point setting function is a function of setting the correction reference point CRP based on the right eye viewpoint RVP and the left eye viewpoint LVP. The content transformation unit 64 sets the correction reference point CRP based on the coordinates of the right-eye viewpoint RVP and the coordinates of the left-eye viewpoint LVP that indicate the relative position with respect to the visual recognition area EB. The correction reference point CRP is specified by the coordinates of one point within the range between the right-eye viewpoint RVP and the left-eye viewpoint LVP including both viewpoints RVP and LVP.

As shown in FIGS. 5 and 6, in order to set the correction reference point CRP, the visual recognition area EB of the present embodiment consists of a central area CA including the central portion BC, and right lateral areas sandwiching the central area CA from both left and right sides. It is virtually divided into RSA and left side area LSA. In setting the correction reference point CRP, the conditions are changed according to the areas CA, RSA, and LSA in which the midpoint between the right-eye viewpoint RVP and the left-eye viewpoint LVP (that is, the binocular center BM) is located. .

When the binocular center BM is located in the central area CA, the content transforming unit 64 substantially matches the correction reference point CRP with the binocular center BM. In the central area CA, the amount of change in the illuminance distribution and the luminance distribution with respect to displacement in the left-right direction is smaller than in the side areas RSA and LSA. Therefore, the difference between the luminance of the virtual image VRI visually recognized from the right-eye viewpoint RVP and the luminance of the virtual image VRI visually recognized from the left-eye viewpoint LVP is also small. Therefore, the correction reference point CRP is set so as to reduce discomfort when viewing the virtual image VRI with both eyes.

When the binocular center BM is located in the right side area RSA, the content transformation unit 64 sets the correction reference point CRP to a position that is decentered from the binocular center BM toward the left eye viewpoint LVP side. When the binocular center BM is located in the left side area LSA, the content transformation unit 64 sets the correction reference point CRP to a position that is decentered from the binocular center BM toward the right eye viewpoint RVP. In summary, when the binocular center BM is located in the side areas RSA and LSA, the content transformation unit 64 sets the correction reference point CRP to the right eye viewpoint RVP and the left eye viewpoint LVP with respect to the binocular center BM. Among them, it is set at a position eccentric to the viewpoint side closer to the center BC.

In the side areas RSA and LSA, the amount of change in the illuminance distribution and the luminance distribution with respect to the lateral displacement is larger than that in the central area CA. Therefore, there is a large difference between the luminance of the virtual image VRI viewed from the right-eye viewpoint RVP and the luminance of the virtual image VRI viewed from the left-eye viewpoint LVP. Specifically, the luminance of the virtual image VRI viewed from a viewpoint closer to the center BC of the right-eye viewpoint RVP and the left-eye viewpoint LVP is higher than the luminance of the virtual image VRI viewed from a viewpoint farther from the center BC. big. Therefore, the correction reference point CRP is set so as to reduce discomfort when viewing the virtual image VRI with one of the right eye and the left eye, which can visually recognize the virtual image VRI with high brightness and is less likely to partially miss the virtual image VRI. be done.

Then, the amount of eccentricity of the correction reference point CRP from the binocular center BM gradually increases as the binocular center BM moves away from the center BC. If the viewpoint farther from the center BC out of the right-eye viewpoint RVP and the left-eye viewpoint LVP is outside the visual recognition area EB, and only the viewpoint closer to the center BC is located within the visual recognition area EB, the content transformation unit 64 The correction reference point CRP is made substantially coincident with a viewpoint near the center BC. The thick line in FIG. 6 indicates the correspondence relationship between the binocular center MG and the correction reference point CRP.

The correction processing function is a function of determining a deformation mode according to the correction reference point CRP, and performing image processing for deforming each display content DC arranged on the pre-correction image, ie correction processing. As shown in FIG. 7, in the virtual image VRI with the tilted image plane IP, the change in distortion on the long distance side is small with respect to the horizontal displacement of the viewpoints RVP and LVP, and the change in distortion on the short distance side is small. tends to increase. For example, the rectangular display content DC on the pre-correction image is distorted like a parallelogram with respect to the lateral displacement of the viewpoint.

Therefore, the content transformation unit 64 transforms the display content DC on the original image OI in advance so as to cancel out the distortion assumed in the virtual image VRI viewed from the correction reference point CRP, thereby providing the driver with a This makes it difficult to recognize the occurrence of the distortion. For example, the content transforming unit 64 transforms the rectangular display content DC on the pre-correction image in advance into a parallelogram that tilts in the opposite direction to the tilt direction of the parallelogram assumed as the distortion. As a result, the display content DC in the virtual image VRI is displayed as if it were standing upright in a rectangular shape.

The association between the correction reference point CRP and the deformation mode is stored in the storage unit 53 of the HCU 50 in the form of deformation data 66, for example. The deformation data 66 is provided by, for example, a data table (also referred to as a correction table) in which correction reference points CRP and parameters in mathematical formulas in image processing for deforming the display content DC are paired. As another example, the deformation data 66 is given by a parameter in a formula in image processing for deforming the display content DC being a function of the correction reference point CRP. ``The parameter is a function of the corrected reference point CRP'' includes the meaning that, for example, in the program, this parameter is given by the return value of a subroutine that includes the corrected reference point CRP or a physical quantity based on this as an argument. .

The deformation data 66 is constructed in advance based on the result of simulating the distortion of the virtual image VRI by the ray tracing method or the like, or the result of confirmation by experiment.

The content transformation unit 64 accesses the transformation data 66 to determine the transformation mode, and applies correction processing based on the transformation mode to the pre-correction image. The original image OI after application of the correction processing (hereinafter referred to as post-correction image OIA) is sequentially provided to the HUD 10 as a video signal. Upon receiving this video signal, the image output unit 21 of the HUD 10 displays or projects the post-correction image OIA to output it as display light. If the displayed content DC on the post-correction image OIA were to be directly visible, it would be recognized as being distorted accordingly.

Next, the details of the display control method for controlling the original image OI of the virtual image VRI output from the image output unit 21 of the HUD 10 based on the display control program stored in the storage unit 53 of the HCU 50 will be described with reference to the flowchart of FIG. to explain. A series of display control processing based on each step of the flowchart of FIG. 8 is repeatedly performed at an appropriate start timing, for example, in a state where the vehicle 1 is powered on and power is being supplied to the HCU 50 and HUD 10. be done. This repetition is performed, for example, in synchronization with the frame rate period of the virtual image VRI.

First, in S11, data is acquired from the outside. A content information acquisition unit 62 acquires content information from the vehicle system 4 . Along with this, the viewpoint specifying unit 61 specifies the right eye viewpoint RVP and the left eye viewpoint LVP based on the information from the DSM 40 . After the processing of S11, the process proceeds to S12.

In S12, the content placement unit 63 selects the display content DC and places the selected display content DC on the pre-correction image. After the processing of S12, the process proceeds to S13.

In S13, the content transformation unit 64 sets a correction reference point CRP that serves as a reference for correction processing. After the processing of S13, the process proceeds to S14.

In S14, the content transformation unit 64 transforms the display content DC based on the correction reference point CRP to generate the post-correction image OIA. After the processing of S14, the process proceeds to S15.

In S15, the content transformation unit 64 transmits the video signal of the post-correction image OIA to the image output unit 21 of the HUD 10, and the image output unit 21 outputs the post-correction image OIA. A series of processing ends with S15.

(Effect)
The effects of the first embodiment described above will be described again below.

In the first embodiment, the original image OI controlled by the HCU 50 as the display control device is provided to the HUD 10 after performing correction processing for deforming the display content DC into a deformation mode according to the viewpoints RVP and LVP. Then, based on the original image OI output from the image output unit 21 of the HUD 10, the display content DC on the virtual image VRI forming the tilted image plane IP is corrected for distortion corresponding to the viewpoints RVP and LVP by correction processing. It becomes a thing. Therefore, the distortion of the display content DC due to the virtual image VRI viewed from the viewpoints RVP and LVP is reduced, and the visibility is improved.

Further, in the first embodiment, the correction reference point CRP is set at a position decentered from the binocular center BM toward the viewpoint side where the virtual image VRI can be visually recognized with high brightness. Then, among the virtual image VRI viewed from the right-eye viewpoint RVP and the virtual image VRI viewed from the left-eye viewpoint LVP, the distortion is corrected by the correction processing that emphasizes the virtual image VRI that is viewed with higher sensitivity. Therefore, the distortion or discomfort perceived in the display content DC is reduced, and the visibility of the display content DC is improved.

Further, in the first embodiment, the correction reference point CRP is determined in which region, out of the central region CA and the pair of lateral regions RSA and LSA, the binocular center BM of the right-eye viewpoint RVP and the left-eye viewpoint LVP is positioned. It is set based on different conditions depending on where you live. As a result, correction processing is realized in consideration of differences in brightness conditions, illuminance conditions, and the like in each of the areas CA, RSA, and LSA, so that the visibility of the display content DC is improved.

Further, in the first embodiment, the correction reference point CRP is set so as to coincide with the binocular center BM when the binocular center BM is located in the central area CA. In the central area CA, since the difference between the luminance of the virtual image VRI viewed from the right-eye viewpoint RVP and the luminance of the virtual image VRI viewed from the left-eye viewpoint LVP is small, correction processing is performed to avoid bias toward one eye. be. This makes it possible to reduce the distortion or discomfort perceived in the display content DC in the binocular vision of the virtual image VRI. On the other hand, when the binocular center BM is located in the side areas RSA and LSA, the correction reference point CRP is a viewpoint closer to the central part BC than the right eye viewpoint RVP or the left eye viewpoint LVP with respect to the binocular center BM. It is set in a position eccentric to the side. In the side areas RSA and LSA, the brightness of the virtual image VRI viewed from a viewpoint closer to the center BC is higher than the brightness of the virtual image VRI viewed from a viewpoint farther from the center BC. Correction processing is carried out for intensive correction. By doing so, it is possible to reduce the distortion or discomfort perceived in the display content DC from a viewpoint with high sensitivity.

(Second embodiment)
As shown in FIGS. 9 and 10, the second embodiment is a modification of the first embodiment. The second embodiment will be described with a focus on points different from the first embodiment.

The illuminance distribution and luminance distribution in the visual recognition area EB by the HUD 10 of the second embodiment are peaky distributions as shown in FIG. Specifically, the illuminance distribution and the luminance distribution are distributions in which, for example, the half-value width is smaller than the distance between the right-eye viewpoint RVP and the left-eye viewpoint LVP in cross sections along the front-rear direction and left-right direction of the visual recognition area EB. there is

In the HCU 50 of the second embodiment, the content transformation unit 64 sets a correction reference point CRP different from that of the first embodiment, as shown in FIG. 10, in accordance with the peaky illuminance distribution and luminance distribution. When the binocular center BM is positioned in the central area CA, and particularly when positioned in the central part BC, the content transformation unit 64 substantially matches the correction reference point CRP with the binocular center BM. When the binocular center BM is located in the central area CA and deviates to the left and right from the central area BC, the content transformation unit 64 shifts the correction reference point CRP from the binocular center BM to the right eye viewpoint. Of the RVP and the left-eye viewpoint LVP, it is set to a position decentered toward the viewpoint closer to the center BC. The amount of eccentricity of the correction reference point CRP from the binocular center BM gradually increases as the binocular center BM moves away from the center BC.

When the binocular center BM is located in the right lateral area RSA, the content transformation unit 64 substantially matches the correction reference point CRP with the left eye viewpoint LVP. When the binocular center BM is located in the left side area LSA, the content transformation unit 64 substantially matches the correction reference point CRP with the right eye viewpoint RVP. In summary, when the binocular center BM is positioned in the side areas RSA and LSA, the content transforming unit 64 sets the correction reference point CRP to a viewpoint closer to the central part BC, out of the right eye viewpoint RVP and the left eye viewpoint LVP. is matched with

According to the second embodiment described above, the correction reference point CRP is set at a position eccentric to the viewpoint side closer to the center BC even in the central area CA. Since the brightness of the virtual image VRI viewed from a viewpoint closer to the center BC is higher than the brightness of the virtual image VRI viewed from a viewpoint farther from the center BC, correction processing is performed to focus on correcting one eye closer to the center BC. be implemented. By doing so, it is possible to reduce the distortion or discomfort perceived in the display content DC from a viewpoint with high sensitivity.

Further, according to the second embodiment, the correction reference point CRP is set so as to match a viewpoint closer to the center BC in the side areas RSA and LSA. Since the brightness of the virtual image VRI viewed from a viewpoint closer to the center BC is higher than the brightness of the virtual image VRI viewed from a viewpoint farther from the center BC, correction processing is performed to correct one eye closer to the center BC as a reference. be done. By doing so, it is possible to remarkably reduce the distortion or discomfort perceived in the display content DC from a viewpoint with high sensitivity.

(Third embodiment)
As shown in FIG. 11, the third embodiment is a modification of the first embodiment. The third embodiment will be described with a focus on points different from the first embodiment.

Human beings have a dominant eye as well as a dominant hand and a dominant foot. In the HCU 50 of the third embodiment, the content transformation unit 64 sets the correction reference point CRP in consideration of the dominant eye of the driver. The driver's dominant eye information is acquired by the HCU 50 and stored in the storage unit 53 by being set by the driver using an operation device (switch, touch panel, etc.) provided in the HMI system 9 or by being detected by the DSM 40. It is

The content transformation unit 64 of the third embodiment sets the correction reference point CRP to the dominant eye viewpoint (hereinafter referred to as the dominant eye viewpoint) out of the right eye viewpoint RVP and the left eye viewpoint LVP, regardless of the position of the binocular center BM. substantially match. For example, in the example of FIG. 10, the right eye viewpoint RVP is the dominant eye viewpoint. The driver views the virtual image VRI mainly with the dominant eye and with the non-dominant eye as an auxiliary eye. Therefore, by performing the correction process in accordance with the viewpoint of the dominant eye, it is possible to reduce discomfort in viewing the virtual image VRI.

(Fourth embodiment)
As shown in FIG. 12, the fourth embodiment is a modification of the third embodiment. The fourth embodiment will be described with a focus on points different from the third embodiment.

The visual recognition area EB of the fourth embodiment is virtually divided into an entire dominant-eye visible area DA1 and an entire dominant-eye invisible area DA2 in order to set the correction reference point CRP. The dominant eye entire visible area DA1 is an area where the entire virtual image VRI can be visually recognized from the dominant eye viewpoint. The entire dominant eye invisible area DA2 is an area where the entire virtual image VRI cannot be visually recognized from the viewpoint of the dominant eye, and the virtual image VRI is partially visible or not visible at all. For example, when the driver with the center BM of both eyes positioned at the center BC of the visual recognition area EB moves toward the dominant eye of the left and right, the dominant eye viewpoint becomes the viewpoint of the non-dominant eye (hereinafter referred to as the anti-dominant eye viewpoint). The end BRE or BLE of the visible area EB is reached earlier. As a result, the virtual image VRI viewed from the viewpoint of the dominant eye is partially missing.

When the dominant eye viewpoint of the right eye viewpoint RVP and the left eye viewpoint LVP is located in the dominant eye whole visible area DA1, the content transformation unit 64 of the fourth embodiment substantially sets the correction reference point CRP to the dominant eye viewpoint. to match On the other hand, when the dominant eye viewpoint is located in the dominant eye whole invisible region DA2, the content transformation unit 64 sets the correction reference point CRP at a position shifted to the anti-dominant eye viewpoint side with respect to the dominant eye viewpoint. The positional deviation amount of the correction reference point CRP from the dominant eye viewpoint gradually increases as the dominant eye viewpoint moves away from the dominant eye whole visible area DA1.

According to the fourth embodiment described above, in setting the correction reference point CRP in the dominant-eye whole invisible region DA2, correction processing is performed in which the weight of the anti-dominant eye viewpoint is increased. By doing so, it is possible to reduce the distortion or discomfort perceived in the display content DC arranged in a portion invisible from the viewpoint of the dominant eye in the virtual image VRI, and improve the visibility of the display content DC.

(Fifth embodiment)
As shown in FIGS. 13-15, the fifth embodiment is a modification of the first embodiment. The fifth embodiment will be described with a focus on points different from the first embodiment.

The light guide section 531 of the fifth embodiment includes a movable mirror 532 shown in FIG. 13 as a movable optical member. Specifically, the light guide section 531 is configured by one movable mirror 532 that is rotatable around a rotation axis extending in the left-right direction. In this embodiment, the movable mirror 532 is a concave mirror that enlarges the virtual image VRI with respect to the original image OI. Such a movable mirror 532 rotates by operating an actuator such as an electric motor according to a user's operation by a driver, for example, so that the angle of the reflecting surface 533 can be adjusted.

With the rotation of the movable mirror 532, the position of the visual recognition area EB moves downward in an angular posture in which the reflecting surface 533 faces upward (that is, the movable mirror 532 lies down). Along with this, the line-of-sight reference tilt angle θgi of the image plane IP of the virtual image VRI viewed from the viewpoint within the visual recognition area EB is reduced. On the other hand, in an angular posture in which the reflecting surface 533 faces downward (that is, the movable mirror 532 stands up), the position of the visual recognition area EB moves upward. Along with this, the line-of-sight reference tilt angle θgi increases.

Corresponding to the HUD 510 having the movable mirror 532, in the HCU 550 of the fifth embodiment shown in FIG. 14, an angle specifying section 565 is further constructed as a plurality of functional sections for controlling display. The angle identification unit 565 identifies the angle at which the image plane IP is tilted by acquiring information about the angular posture of the movable mirror 532 in the light guide unit 531 . For example, in the present embodiment, as the angle at which the image plane IP is tilted, the line-of-sight reference tilt angle θgi with reference to the central portion BC (the central portion with respect to the left-right direction and the vertical direction) of the visual recognition area EB is specified.

Further, the deformation data 566 in the fifth embodiment changes the deformation mode according to the line-of-sight reference tilt angle θgi. Since the difference in distance between the short distance side and the long distance side in the virtual image VRI changes depending on the tilt angle θgi, the distortion of the virtual image VRI itself also changes. In the fifth embodiment, the deformation mode is determined according to how the virtual image VRI is distorted.

As an example, when the deformation data 566 is given by a data table (correction table), a plurality of correction tables are provided according to the sight line reference tilt angle θgi. When the content transformation unit 564 determines the transformation mode by accessing the transformation data 566, the content transformation unit 564 selects from among a plurality of correction tables corresponding to the line-of-sight reference tilt angle θgi acquired by the angle identification unit 565. Select one correction table.

As another example, if the deformation data 566 is given by parameters in a formula in image processing for deforming the display content DC, the parameters in the formula are functions of the correction reference point CRP and the line-of-sight reference tilt angle θgi. .

The deformation amount in the correction process is increased as the line-of-sight reference tilt angle θgi increases. In other words, strong correction is performed in the angular orientation in which the movable mirror 532 stands up.

Next, details of the display control method for controlling the original image OI of the virtual image VRI output from the image output unit 21 of the HUD 510 based on the display control program stored in the storage unit 53 of the HCU 550 will be described with reference to the flowchart of FIG. to explain. The following shows the case where deformation data 566 is given by a correction table.

First, in S51, data is acquired from the outside. A content information acquisition unit 62 acquires content information from the vehicle system 4 . Along with this, the viewpoint specifying unit 61 specifies the right eye viewpoint RVP and the left eye viewpoint LVP based on the information from the DSM 40 . Furthermore, the angle specifying unit 565 specifies the angle of the image plane IP based on information from the HUD 510 . After the processing of S51, the process proceeds to S52.

S52 and S53 are the same as S12 and S13 of the first embodiment. After the processing of S53, the process proceeds to S54.

In S54, the content transformation unit 564 transforms the display content DC using a correction table corresponding to the angle of the image plane IP to generate the corrected image OIA. After the processing of S54, the process proceeds to S55.

S55 is the same as S15 in the first embodiment. A series of processing ends with S55.

According to the fifth embodiment described above, the content transformation section 564 determines the transformation mode according to the angular orientation of the movable mirror 532 . Therefore, it is possible to provide the HCU 510 that can maintain the effect of reducing the distortion or discomfort perceived in the display content DC even when the angle of the image plane IP is changed by the movable mirror 532 .

(Sixth embodiment)
As shown in FIGS. 16-18, the sixth embodiment is a modification of the first embodiment. The sixth embodiment will be described with a focus on the differences from the first embodiment.

In the sixth embodiment, the HMI system 9 does not include a DSM. Along with this, the HCU 650 does not have a viewpoint specifying function by a viewpoint specifying unit, as shown in FIG. 16 . The content transformation unit 664 of the sixth embodiment has a character content extraction function instead of the correction reference point setting function. The character content extraction function is a function for extracting character content TC that displays characters from display content DC that is selected as a display target and arranged on the pre-correction image.

The character content TC may belong to non-following content as a non-AR display object, or may belong to following content as an AR display object. In addition, when the display content DC is a composite form of a character portion and a figure portion, it is not necessary to extract it as the character content TC, and if a predetermined ratio (for example, 50%) or more of the area is occupied by characters, The character content TC may be extracted, or the character portion may be separated from the graphic portion and only the character portion may be extracted as the character content TC.

In the correction processing function by the content transforming unit 664 of the fifth embodiment, it is determined whether or not the correction processing is performed depending on whether the display content DC is the character content TC. For example, in the present embodiment, the text content TC is subject to the correction processing, and none of the display content DC other than the text content TC is subject to the correction processing.

The content transformation unit 664 applies a uniform transformation mode to the character content TC to be subjected to correction processing. The content transforming unit 664 transforms the character content TC into a deformation mode in which the character content TC is tilted to the right in an italic font style. The right-tilted deformation in the italic font style is a deformation in which the character is tilted so that the upper end of the character is shifted to the right with respect to the lower end of the character on the original image OI. .

As shown in FIG. 17, the deformation rate (specifically, the tilt angle) in the right tilt is the state in which the character content TC is upright or the right tilt when the virtual image VRI is viewed from the viewpoint located at the left end BLE of the visual recognition area EB. It is preferably set so that it can be visually recognized as it is. By doing so, it is avoided that the character content TC is viewed in a left-leaning state in the entire viewing area EB.

Next, the details of the display control method for controlling the original image OI of the virtual image VRI output from the image output unit 21 of the HUD 10 based on the display control program stored in the storage unit 53 of the HCU 650 will be described with reference to the flowchart of FIG. to explain.

First, in S61, data is acquired from the outside. A content information acquisition unit 62 acquires content information from the vehicle system 4 . After the processing of S61, the process proceeds to S62.

In S62, the content placement unit 63 selects the display content DC and places the selected display content DC on the pre-correction image. After the processing of S62, the process proceeds to S63.

In S63, the content transforming unit 664 extracts the character content TC to be subjected to correction processing. After the processing of S63, the process proceeds to S64.

In S64, the content transforming unit 664 transforms the text content TC to the right tilt to generate the post-correction image OIA. After the processing of S64, the process proceeds to S65.

In S65, the content transformation unit 664 transmits the video signal of the post-correction image OIA to the image output unit 21 of the HUD 10, and the image output unit 21 outputs the post-correction image OIA. A series of processing ends with S65.

According to the sixth embodiment described above, the original image OI controlled by the HCU 650 as the display control device is provided to the HUD 10 after the character content TC is deformed into a right tilted form in an italic font style. Based on the original image OI output from the image output unit 21 of the HUD 10, the character content TC on the virtual image VRI forming the tilted image plane IP is biased to the right. Therefore, it is possible to reduce the possibility that the character content TC will be viewed in a left-leaning state with respect to changes in the viewpoints RVP and LVP.

In general character display, it is rare that the character is tilted to the left as compared to the character that is tilted to the right. Therefore, if a character that is tilted to the left is visually recognized, it may be difficult to read the character. In this respect, in the present embodiment, since the visibility in the left-leaning state is reduced, the possibility of reading characters increases, and the visibility of the display content DC can be improved.

(Other embodiments)
Although a plurality of embodiments have been described above, the present disclosure is not to be construed as being limited to those embodiments, and can be applied to various embodiments and combinations within the scope of the present disclosure. can be done.

Specifically, as a modification 1, the image plane IP of the virtual image VRI may be inclined so that the distance becomes longer from the top to the bottom.

As a modification 2 of the first to fifth embodiments, instead of accessing the modification data 66, the content modification unit 64 simulates the distortion of the virtual image VRI at the correction reference point CRP one by one using a ray tracing method or the like. and may determine the modification mode.

As a modification 3 related to the first to fifth embodiments, the correction processing function of the content transformation unit 64 performs a convolution operation or the like when the viewpoints RVP, LVP (or the correction reference point CRP) and the pre-correction image are input. Alternatively, it may be realized by a trained model mainly composed of a neural network that outputs the post-correction image OIA.

As a fourth modification of the sixth embodiment, in a configuration in which the HMI system 9 includes the DSM 40, the HCU 650 may not specify the viewpoints RVP and LVP.

As Modified Example 5, each function provided by the HCU 650 can be provided by software and hardware for executing it, only software, only hardware, or a complex combination thereof. Furthermore, if such functions are provided by electronic circuits as hardware, each function can also be provided by digital circuits, including numerous logic circuits, or analog circuits.

As a sixth modification, the form of a storage medium that stores a program or the like capable of implementing the display control method described above may be changed as appropriate. For example, the storage medium is not limited to being provided on a circuit board, and may be provided in the form of a memory card or the like, inserted into a slot, and electrically connected to the control circuit of the HCU 50. good. Furthermore, the storage medium may be an optical disk, hard disk, or the like, which is the basis for copying the program to the HCU 50 .

As a seventh modification, the HCU 50 and an electronic control device having other functions of the vehicle system 4 may be integrated to form one electronic control device functioning as a display control device.

As an eighth modification, the display control device may be an electronic control device provided inside the housing 11 of the HUD 10 and specialized for controlling the HUD 10 .

As a ninth modification, the display control device may not be mounted on the vehicle 1 on which the HUD 10 to be subject to display control is mounted. When the display control device is not mounted on the vehicle 1 but fixedly arranged outside the vehicle 1 or mounted on another vehicle, the HUD 10 may be remotely controlled by wireless communication.

As a modification 10, the vehicle 1 using the display control device is not limited to a general private passenger car, but may be a rental car vehicle, a manned taxi vehicle, a ride-sharing vehicle, a freight vehicle, a bus, or the like. may Furthermore, the vehicle may be an unmanned vehicle used for mobility services.

As an eleventh modification, the vehicle 1 using the display control device may be optimized according to the road traffic laws of each country and region.

The controller and techniques described in this disclosure may be implemented by a special purpose computer comprising a processor programmed to perform one or more functions embodied by a computer program. Alternatively, the apparatus and techniques described in this disclosure may be implemented by dedicated hardware logic circuitry. Alternatively, the apparatus and techniques described in this disclosure may be implemented by one or more special purpose computers configured in combination with a processor executing a computer program and one or more hardware logic circuits. The computer program may also be stored as computer-executable instructions on a computer-readable non-transitional tangible recording medium.

10, 510: HUD, 21: Image output unit, 50, 550, 650: HCU (display control unit), 61: Viewpoint specifying unit, 63: Content placement unit, 64, 564, 664: Content transformation unit, DC: Display Content, IP: image plane, LVP: left eye viewpoint (viewpoint), OI: original image, RVP: right eye viewpoint (viewpoint), TC: text content, VRI: virtual image

Claims (8)

From the image output unit (21) of the head-up display (10, 510) that displays a virtual image (VRI) having an image plane (IP) that is tilted so that the distance increases from one to the other of the bottom and top A display control device for controlling the original image (OI) of the virtual image to be output,
a viewpoint specifying unit (61) that specifies the viewer's viewpoint (RVP, LVP) of the virtual image;
a content placement unit (63) that places display content (DC) on the original image;
a content transformation unit (64, 564) that provides the original image to the image output unit after performing correction processing for transforming the display content into a transformation mode according to the viewpoint ,
The content transformation unit cancels the distortion of the display content expected in the virtual image viewed from a correction reference point (CRP) set based on the right-eye viewpoint and the left-eye viewpoint as the viewpoints. , determining said variant,
The correction reference point is the viewpoint at which the virtual image can be visually recognized with higher brightness from the right eye viewpoint and the left eye viewpoint with respect to the binocular center (BM) of the right eye viewpoint and the left eye viewpoint. Display controller set to side eccentric position . From the image output unit (21) of the head-up display (10, 510) that displays a virtual image (VRI) having an image plane (IP) that is tilted so that the distance increases from one to the other of the bottom and top A display control device for controlling the original image (OI) of the virtual image to be output,
a viewpoint specifying unit (61) that specifies the viewer's viewpoint (RVP, LVP) of the virtual image;
a content placement unit (63) that places display content (DC) on the original image;
a content transformation unit (64, 564) that provides the original image to the image output unit after performing correction processing for transforming the display content into a transformation mode according to the viewpoint ,
The virtual image becomes visible from the viewer who positions the viewpoint within the viewing area (EB),
As areas that virtually divide the visible area, a central area (CA) including the central portion (BC) of the visible area, and a pair of side areas (RSA, LSA) sandwiching the central area from both left and right sides. , is defined as
The content transformation unit cancels the distortion of the display content expected in the virtual image viewed from a correction reference point (CRP) set based on the right-eye viewpoint and the left-eye viewpoint as the viewpoints. , determining said variant,
The correction reference point is set based on different conditions depending on which of the central region and the pair of lateral regions the binocular centers of the right eye viewpoint and the left eye viewpoint are positioned. display controller. The correction reference point is
When the center of both eyes is located in the central region, it is set to match the center of both eyes,
3. When the center of both eyes is located in the side area, the center of the two eyes is set to a position eccentric to the side of the viewpoint closer to the center of the viewpoint of the right eye or the left eye with respect to the center of the both eyes. 3. The display control device according to 2 . The correction reference point is
When the center of both eyes is located in the central region and is located in the center part, it is set to match the center of both eyes,
When the center of both eyes is located in the central region and is located laterally shifted from the center, the center of the right-eye viewpoint and the left-eye viewpoint with respect to the center of both eyes 3. The display control device according to claim 2 , which is set at a position eccentric to a closer viewpoint side. The correction reference point is
5. When the center of both eyes is located in the lateral region, the center of the eyes is set to match the closer one of the viewpoints of the right eye and the left eye to the center. The display control device according to . From the image output unit (21) of the head-up display (10, 510) that displays a virtual image (VRI) having an image plane (IP) that is tilted so that the distance increases from one to the other of the bottom and top A display control device for controlling the original image (OI) of the virtual image to be output,
a viewpoint specifying unit (61) that specifies the viewer's viewpoint (RVP, LVP) of the virtual image;
a content placement unit (63) that places display content (DC) on the original image;
a content transformation unit (64, 564) that provides the original image to the image output unit after performing correction processing for transforming the display content into a transformation mode according to the viewpoint ,
The content transforming unit adjusts the distortion of the display content expected in the virtual image viewed from a correction reference point (CRP) set based on a dominant eye viewpoint out of a right eye viewpoint and a left eye viewpoint as the viewpoints. determining the deformation mode to offset;
The virtual image becomes visible from the viewer who positions the viewpoint within the viewing area (EB),
As areas that virtually divide the visual recognition area, a dominant eye whole visible area (DA1) in which the entire virtual image can be visually recognized from the dominant eye viewpoint, and a dominant eye whole visible area excluding the dominant eye whole visible area ( If we define DA2) and
The correction reference point is
is set to match the dominant eye viewpoint when the dominant eye viewpoint is located in the dominant eye whole visible region,
When the dominant eye viewpoint is located in the region where the entire dominant eye cannot be visually recognized, the dominant eye viewpoint is set at a position eccentric to the anti-dominant eye viewpoint, out of the right eye viewpoint and the left eye viewpoint. Display controller. an angle specifying unit (565) that acquires information about the angular posture of a movable optical member that is provided in the head-up display and changes the angle at which the image plane is tilted, and specifies the angle;
The display control device according to any one of claims 1 to 6, wherein the content transformation unit determines the transformation mode according to the viewpoint and the angular orientation. Output from the image output unit (21) of the head-up display (510 ) displaying a virtual image (VRI) having an image plane (IP) tilted so that the distance increases from one to the other of the bottom and top A display control device that controls the original image (OI) of the virtual image that is
a viewpoint specifying unit (61) that specifies the viewer's viewpoint (RVP, LVP) of the virtual image;
a content placement unit (63) that places display content (DC) on the original image;
a content transformation unit (5 64) that provides the original image to the image output unit after performing correction processing for transforming the display content into a transformation mode according to the viewpoint ,
an angle specifying unit (565) that acquires information about the angular posture of a movable optical member that is provided in the head-up display and changes the angle at which the image plane is tilted, and specifies the angle;
The content transformation unit is a display control device that determines the transformation mode according to the viewpoint and the angular orientation .

Images