JP2018103697A - Display device for vehicle - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device for vehicle by which information presentation with less discomfort is possible by maintaining position relation between a virtual image and a background object of AR content even in a situation in which a viewpoint position in a vertical direction of a user varies.SOLUTION: A display device 10 for vehicle is provided with: a viewpoint position acquisition part 40; a front information acquisition part 60; an image generation part 30; an image display part 20 having a display surface 21; and a projection part 50 which projects an image toward a translucent member 2 of a vehicle 1, in which a display region 240 of AR content on the display surface 21 of the image display part 20 is divided into lattice regions of m stages in a longitudinal direction and n columns in a lateral direction, length in the longitudinal direction in m lattice regions lining up in the longitudinal direction is set to unequal intervals so as to be wider as going from an upper stage to a lower stage, and a position and size of the AR content 250 are varied according to a viewpoint position of a user in the vertical direction by extending and contracting the display region 240 of the AR content in the longitudinal direction.SELECTED DRAWING: Figure 11

Description

  The present invention relates to a vehicular display device, and more particularly to a vehicular display device capable of providing appropriate information to a user without being affected by a change in the position of the user's viewpoint.

  As a display device for a vehicle, by projecting a display image onto a translucent member such as a front window shield of a vehicle, a virtual image is visually recognized by a user sitting in the driver's seat using the light of the display image reflected by the translucent member. There is a so-called head-up display (HUD). In such a vehicle display device, the virtual image is visually recognized by the user sitting in the driver's seat so that the virtual image is formed on the vehicle traveling direction side (the vehicle front side) with reference to the front window shield of the vehicle, for example. Is done.

  A user sitting in a driver's seat of a vehicle equipped with a display device for a vehicle visually recognizes a virtual image that gives information on the presence of other vehicles, obstacles, etc. on the road ahead of the vehicle, together with the scenery seen through the front window shield. be able to.

  Here, the position of the viewpoint of the user sitting in the driver's seat is not constant depending on the sitting height of the user, the sitting posture of the user, and the like. For example, when the position at which the display image is projected is fixed, the virtual image becomes more closely related to the scenery on the near side of the scenery seen through the front window shield as the position of the viewpoint of the user sitting in the driver's seat increases. Superimposed. As described above, since the position of the viewpoint of the user sitting in the driver's seat changes, the range of the object (background object) in the landscape corresponding to the virtual image is shifted, so that the user may feel uncomfortable.

  As a countermeasure, for example, Patent Document 1 discloses a head-up display device (vehicle that adjusts a projection direction of an optical system including a concave mirror of a projection unit in accordance with a position in a vertical direction of a viewpoint of a user sitting in a driver's seat of a vehicle. Display device).

  The vehicle display device disclosed in Patent Document 1 projects a display image on the upper side in the vertical direction of the front window shield when the position of the viewpoint of the user sitting in the driver's seat of the vehicle acquired by the viewpoint detection camera is high. In this manner, the concave mirror actuator is controlled. On the other hand, the display device for a vehicle shown in Patent Document 1 displays a display image vertically below the front window shield when the position of the viewpoint of the user sitting in the driver's seat of the vehicle acquired by the viewpoint detection camera is low. The concave mirror actuator is controlled so that it is projected to the side. Therefore, in the vehicle display device disclosed in Patent Document 1, the range of the background object in the landscape that can be seen through the front window shield is large even when the position of the viewpoint of the user sitting in the driver's seat of the vehicle changes. Shifting is prevented.

JP 2014-210537 A

  However, the present inventor has recognized that the vehicle display device described in Patent Document 1 may give the user a sense of discomfort when the position of the user's viewpoint changes. This point will be described below with reference to FIG. FIG. 16 shows the vehicle display device described in Patent Document 1, where the viewpoint position of the user, the virtual image visually recognized by the user, and the distance range of the road surface as the background object corresponding to the virtual image It is a schematic diagram which shows a relationship. In the coordinate axes shown in FIG. 16, the z-axis positive direction represents the vehicle front direction, the y-axis positive direction represents the upper vertical direction (vertically upward), and the x-axis positive direction (vertically upward with respect to the drawing). ) Represents the left direction toward the front of the vehicle (that is, the vehicle left direction).

  FIG. 16 shows three viewpoint positions of a user viewpoint position 101u, a user viewpoint position 101r, and a user viewpoint position 101d as examples of the viewpoint positions of the user sitting in the driver's seat of the vehicle. Virtual images 331u, 331r, and 331d shown in FIG. 16 are virtual images obtained as a result of adjusting the height positions corresponding to the user viewpoint positions 101u, 101r, and 101d, respectively.

  In Patent Document 1, the height of the virtual image is adjusted according to the viewpoint position of the user, but the size of the virtual image is not changed. Therefore, as shown in FIG. 16, the virtual image 331u, the virtual image 331r, and the virtual image 331d have the same vertical size.

  As can be seen from FIG. 16, the length of the distance range 401u on the road surface that is the background object at the user viewpoint position 101u that is higher than the user viewpoint position 101r is the distance range 401r at the user viewpoint position 101r. Smaller than the length of. Further, the length of the distance range 401d at the user viewpoint position 101d that is lower than the user viewpoint position 101r is larger than the length of the overlapping distance range 401r at the user viewpoint position 101r.

  As described above, in the vehicle display device described in Patent Document 1, the distance on the road surface of the scenery where the virtual image is superimposed among the scenery seen through the front window shield by changing the position of the viewpoint of the user sitting in the driver's seat. The range of changes. That is, the size of the virtual image does not change, but the size of the background road surface changes according to the viewpoint position of the user. As a result, a change occurs in the relative sizes of the virtual image and the background. This can be a factor that makes the user feel uncomfortable.

  It is desirable to take measures against this inconvenience. Further, when taking such measures, it is preferable to adopt a method in which image processing is simplified and the processing load on the display device is small.

  One object of the present invention is to provide information with less sense of incongruity while maintaining the positional relationship between augmented reality (AR) content and a background object, for example, even in a situation where the viewpoint position of the user in the vertical direction has changed. The object is to provide a display device for a vehicle. Other objects of the present invention will become apparent to those skilled in the art by referring to the aspects and preferred embodiments exemplified below and the accompanying drawings.

In the following, in order to easily understand the outline of the present invention, embodiments according to the present invention will be exemplified.
In the first aspect, the vehicle display device includes:
A viewpoint position acquisition unit that acquires the position of the viewpoint of the user sitting in the driver's seat of the vehicle;
A forward information acquisition unit that acquires forward information that is forward information of the vehicle;
An image generation unit that generates an image reflecting the front information included in a predetermined area among the front information acquired by the front information acquisition unit;
An image display unit having a display surface capable of displaying the image generated by the image generation unit;
The image is displayed so that the user sitting in the driver's seat can visually recognize the virtual image by reflecting light of the image displayed on the display surface by a translucent member disposed in the vehicle in front of the user. A projection unit for projecting the light toward the translucent member;
With
A direction corresponding to a vertical direction on the display surface of the image display unit is a vertical direction, a direction orthogonal to the vertical direction and a direction corresponding to a left-right direction toward the front of the vehicle is a horizontal direction, and the image In the situation where the image generated by the generation unit includes augmented reality (AR) content, and the AR content is visually recognized by the user as the virtual image by the projection by the projection unit.
The display area of the AR content on the display surface of the image display unit is partitioned into a grid area of m stages (m is a natural number of 2 or more) in the vertical direction and n columns (n is a natural number of 2 or more) in the horizontal direction. And the lengths in the vertical direction of the m lattice regions arranged in the vertical direction are set at non-uniform intervals so as to increase from the upper level to the lower level,
The image generation unit
Even in a situation where the viewpoint position of the user in the vertical direction has changed, the correspondence between the virtual image visually recognized by the user by projection of the AR content and the background object visually recognized by the user as the background of the virtual image is maintained. As
Depending on the viewpoint position of the user in the vertical direction, the display area of the AR content on the display surface of the image display unit is elongated or contracted in the vertical direction, and the AR content on the display surface of the image display unit is Change position and size.

  In the first aspect, the position and size (size) of the AR content are not individually adjusted, but the AR content display area on the display surface is expanded or contracted in the vertical direction, thereby indirectly adjusting the AR content. Change position and size. In other words, the change process is simplified and the burden on the image generation unit is reduced as compared with the case where the position and size of the AR content are directly changed. In addition, for example, even when there are a plurality of AR contents to be displayed, the position and size of each AR content can be changed at once, and the burden on the image generation unit can be reduced in this respect as well. In addition, in the first aspect, the AR content display area is partitioned into a plurality of grid areas of m rows in the vertical direction and n columns in the horizontal direction, and the vertical length of the m grid areas arranged in the vertical direction. Are set at non-equal intervals so as to increase from the upper level to the lower level. When the lengths of the lattice areas arranged in the vertical direction (the height of the lattice areas) are equally spaced, the background that is visually recognized by the user as the background of the virtual image of the AR content with only a slight change in the viewpoint position of the user in the vertical direction Although the range of the object (for example, the road surface of the road) changes greatly, if the viewpoint position in the vertical direction of the user changes, the change in the range of the background object is suppressed if the distance is uneven. Thus, by changing the position and size of the AR content, the correspondence between the virtual image of the AR content and the background object can be restored to the original. In other words, the correspondence between the virtual image of the AR content and the background object can be maintained, and the user is prevented from feeling uncomfortable.

In a second aspect dependent on the first aspect,
The image generation unit extends the display area of the AR content upward in the vertical direction as the viewpoint position in the vertical direction of the user moves upward from the reference position, and thereby the position in the vertical direction of the AR content. In such a way that is higher on the display surface and the size of the AR content is further increased,
As the viewpoint position in the vertical direction of the user moves downward from the reference position, the display area of the AR content is contracted downward in the vertical direction, whereby the vertical position of the AR content is displayed in the display. You may control so that it may become a lower side in a surface and the size of the said AR content may be reduced more.

  In the second aspect, the image generation unit performs control so that the position of the AR content on the display surface is increased and the size is increased as the viewpoint position is moved upward from the reference position. Control is performed so that the position of the AR content on the display surface is on the lower side and the size is reduced toward the lower side from the reference position. In other words, it is possible to maintain the correspondence between the virtual image of the AR content and the background object, and it is possible to present information with less discomfort.

In a third aspect subordinate to the first or second aspect,
The ratio of the unequal intervals in the vertical direction of the display area of the AR content is
The background object corresponding to the length in the vertical direction of each of the m grid areas arranged in the vertical direction in the display area of the AR content when the viewpoint position in the vertical direction of the user is at the reference position The road surface of the road may be determined so that the distances on the road surface are equally spaced.

  In the third aspect, the ratio of the unequal intervals in the vertical direction of the AR content display area corresponds to the vertical length of each of the m lattice areas arranged in the vertical direction in the AR content display area. It determines so that each distance on the road surface of the road surface as a target object may become equal intervals. In other words, when each length on the road surface is equally spaced, the change in the range of the road surface when the viewpoint position in the user's vertical direction changes is the most suppressed compared to when the length is not evenly spaced. By changing the display position and size of the AR content, it is possible to restore the correspondence between the virtual image of the AR content and the background object. In other words, it is possible to maintain the correspondence between the virtual image of the AR content and the background object, and thus it is possible to present information with less sense of discomfort.

In a fourth aspect subordinate to any one of the first to third aspects,
The display area of the AR content may be a warping grid area for correcting the AR content so that the virtual image visually recognized by the user is not distorted.

  In the fourth aspect, as the AR content display area on the display surface, a warping grid area for correcting the AR content is used so that the virtual image visually recognized by the user is not distorted, thereby changing the position and size of the AR content. Processing and warping processing can be performed on a common area, and efficient processing is realized.

In a fifth aspect depending on any one of the first to fourth,
The AR content on the display surface of the image display unit is expanded or reduced in the vertical direction according to the vertical expansion rate or contraction rate of the display area of the AR content, and is not expanded or reduced in the horizontal direction. It may be.

  In the fifth aspect, the AR content is enlarged or reduced in the vertical direction, but is not enlarged and reduced in the horizontal direction. Here, if enlargement or reduction is also performed in the horizontal direction, the horizontal size itself, which is the basis of the aspect ratio (ratio of the vertical and horizontal dimensions of the figure), changes, which causes the shape of the figure to be distorted. The size is not changed. In other words, the aspect ratio of the AR content visually recognized by the user as a virtual image can be maintained, and information can be presented with less sense of incongruity.

In a sixth aspect depending on any one of the first to fifth aspects,
In addition to the AR content that the virtual image needs to be superimposed on the superimposed object, non-superimposed AR content that does not require the virtual image to be superimposed on the superimposed object is included,
The display area of the display surface of the image display unit is divided into a display area for the AR content and a display area for the non-superimposed AR content.
The image generation unit may not perform expansion and contraction in the vertical direction according to a change in the viewpoint position of the user in the vertical direction with respect to the display area of the non-overlapping AR content.

  In the sixth aspect, the image generation unit does not perform expansion and contraction in the vertical direction according to the change in the viewpoint position in the vertical direction of the user for the display area of the non-overlapping AR content. In other words, since the non-superimposed AR content is displayed for a long period of time, information that does not cause a sense of incongruity is presented to the user by not expanding or reducing the area according to the viewpoint position of the user.

In a seventh aspect subordinate to the sixth aspect,
The display area of the non-overlapping AR content on the display surface of the image display unit is a lattice area of p rows in the vertical direction (p is a natural number of 2 or more) and q columns (q is a natural number of 2 or more) in the horizontal direction. The lengths in the vertical direction of the p lattice regions that are partitioned and arranged in the vertical direction may be set at equal intervals.

  In the seventh aspect, the display area of the non-overlapping AR content is also divided into a plurality of lattice areas in the same manner as the display area of the AR content, but the vertical length of the P lattice areas arranged in the vertical direction is It is set at equal intervals. In other words, since it is not necessary to consider the relationship with the background object for non-superimposed AR content, a non-superimposed grid region is used for non-superimposed AR content that is constantly displayed for a long time. Display the outline of AR content accurately.

  Those skilled in the art will readily understand that the illustrated embodiments according to the present invention can be further modified without departing from the spirit of the present invention.

It is a block diagram which shows the example of a structure of the display apparatus for vehicles of this invention. It is a figure which shows the example of a structure of the image display part shown by FIG. It is sectional drawing of the example of the projection part shown by FIG. An example of a landscape (including a vehicle in front of a superimposed object and a road surface of a road that is a background object) and a virtual image of AR content that can be seen by a user sitting in a driver's seat of the vehicle including the vehicle display device shown in FIG. FIG. It is a figure which shows the display position and size of AR content on the display surface of a display part in the condition where a user's viewpoint is a reference | standard viewpoint position. It is a figure which shows the display position and size of AR content on the display surface of a display part in the condition where a user's viewpoint is above a reference viewpoint position. It is a figure which shows the display position and size of AR content in the display surface of a display part in the condition where a user's viewpoint is below a reference viewpoint position. FIG. 4 is a schematic diagram showing a relationship between a viewpoint position in a vertical direction of a user, a virtual image visually recognized by the user, and a distance range of a road surface that is a background object corresponding to the virtual image in the vehicle display device of the present invention. It is. The scenery (including the vehicle in front of the superimposed object, the road surface of the road that is the background object) and the virtual image of the AR content that can be seen by the user sitting in the driver's seat of the vehicle including the vehicle display device shown in FIG. It is a figure which shows an example. It is a figure which shows the other example of a structure of the image display part shown by FIG. 11A is a diagram showing an example of image display on the display surface of the image display unit shown in FIG. 1, and FIGS. 11B to 11D show the display image of FIG. It is a figure for demonstrating a mode that changes according to a user's viewpoint position. It is a figure which shows the suitable example of the ratio of an unequal interval in the case of making the length of the vertical direction (height of each lattice area) of each lattice area | region arranged in a vertical direction into an unequal interval. FIG. 13A shows a background object corresponding to the user's viewpoint position when the vertical lengths (heights of the respective lattice regions) of the respective lattice regions arranged in the vertical direction are set at non-uniform intervals. FIG. 13B is a diagram showing the range of the road surface of the road, and FIG. 13B is a diagram illustrating a case where the vertical lengths (heights of the respective grid areas) of the respective grid areas arranged in the vertical direction are equally spaced. It is a figure which shows the range of the road surface of the road as a background target object according to a viewpoint position. FIG. 14A shows a warping grid area (also used as a display area) before the warping process, and FIG. 14B shows a warping grid area after the warping process. It is a figure which shows a mode that AR content (attention mark superimposed on the vehicle ahead) as a standing image is enlarged or reduced in the vertical direction but not enlarged or reduced in the horizontal direction. In the vehicle display device disclosed in Patent Document 1 (Japanese Patent Application Laid-Open No. 2014-210537), the viewpoint position of the user, the virtual image visually recognized by the user, and the distance on the road surface as the background object corresponding to the virtual image It is a schematic diagram for demonstrating the relationship with a range.

  The preferred embodiments described below are used to facilitate an understanding of the present invention. Accordingly, those skilled in the art should note that the present invention is not unduly limited by the embodiments described below.

  In the present embodiment, both the position and size (size) of displaying augmented reality (AR) content (hereinafter referred to as AR content) are changed according to the change in the viewpoint position of the user in the vertical direction. In the change, the AR content display area on the display surface of the image display unit is indirectly expanded or contracted in the vertical direction which is a direction corresponding to the vertical direction in the real space, so that the AR on the AR content display area is indirectly Change the position and size of content (single or plural) at once. At this time, the AR content display area is composed of a plurality of lattice areas arranged in the vertical direction and the horizontal direction (a direction orthogonal to the vertical direction and corresponding to the left-right direction toward the front of the vehicle (the left-right direction of the vehicle)). The length in the vertical direction of the plurality of lattice regions arranged in the vertical direction (the height of each lattice region) is set to be non-uniformly spaced (non-uniform). Therefore, before and after the change of the viewpoint position in the vertical direction of the user, the correspondence relationship between the AR content (for example, the warning mark 350 for the preceding vehicle) and the background object (for example, the road surface of the road) is maintained, Information presentation with less discomfort is possible.

  In the following, description will be given in order. First, with reference to FIG. 1 thru | or FIG. 3, the example of the whole structure of the display apparatus 10 for vehicles of this invention is demonstrated. As shown in FIG. 1, in real space, for example, the z axis is defined in the vehicle front-rear direction with the traveling direction of the vehicle 1 as the vehicle front direction, the y axis is defined in the vertical direction, and the vehicle front direction is pointed. The x axis is defined in the left-right direction (that is, the vehicle left-right direction). At this time, the x-axis positive direction represents the left direction of the vehicle, the y-axis positive direction represents the upper side in the vertical direction (vertically upward in real space), and the z-axis positive direction represents the front of the vehicle (front direction of the vehicle).

  As shown in FIG. 1, the vehicle display device 10 includes an image display unit 20, an image generation unit 30, a viewpoint position acquisition unit 40, a projection unit 50, and a front information acquisition unit 60.

  The viewpoint position acquisition unit 40 includes, for example, a vehicle interior image acquisition unit 41 and a vehicle interior image analysis unit 42. The viewpoint position acquisition unit 40 acquires information on the viewpoint position 100 of the user sitting in the driver's seat of the vehicle 1. The viewpoint position acquisition unit 40 is configured to be able to acquire the user viewpoint position 100 in at least the y-axis direction (vertical direction).

  The vehicle interior image acquisition unit 41 is, for example, a vehicle camera that captures an image of the vehicle interior. The vehicle interior image acquisition unit 41 may be, for example, a common vehicle camera attached for the purpose of preventing vehicle theft or the like, or a vehicle camera dedicated to the vehicle display device 10. The vehicle interior image acquisition unit 41 preferably captures the user's viewpoint position 100 from the lower side in the vertical direction than the user's viewpoint position 100, and may be attached to the dashboard 4 or the like, for example. The vehicle interior image acquisition unit 41 is preferably capable of infrared imaging so that the user viewpoint position 100 can be acquired even when the vehicle interior is dark. The vehicle interior image acquisition unit 41 outputs the acquired vehicle interior image to the vehicle interior image analysis unit 42, for example.

  The vehicle interior image analysis unit 42 analyzes the input image of the vehicle interior using, for example, known image processing, a pattern matching method, or the like. The vehicle interior image analysis unit 42 analyzes the input image in front of the vehicle, and if the input image in the vehicle interior includes the face of the user sitting in the driver's seat, for example, the real space of the user's viewpoint position 100 By identifying the coordinates (y) at, information on the viewpoint position 100 of the user is obtained. The vehicle interior image analysis unit 42 outputs the acquired information of the viewpoint position 100 of the user to the image generation unit 30 via the bus 5 such as CAN (Controller Area Network) bus communication, for example. Here, the vehicle interior image analysis unit 42 may be provided, for example, in a vehicle camera, and the image generation unit 30 may include the function of the vehicle interior image analysis unit 42. Further, the image generation unit 30 may directly input information on the user's viewpoint position 100 from the vehicle interior image analysis unit 42 without using the bus 5.

  The front information acquisition unit 60 includes, for example, a front image acquisition unit 61 and a front image analysis unit 62. The forward information acquisition unit 60 is, for example, the position information on the road lane in the forward direction of the vehicle, the position information of other vehicles and obstacles existing in the forward direction of the vehicle, the information on the road sign in the forward direction of the vehicle, etc. Get information.

  The front image acquisition unit 61 is, for example, a camera outside the vehicle that captures an image in front of the vehicle. The front image acquisition unit 61 may be, for example, a shared vehicle camera used for a drive recorder or the like, or a vehicle camera dedicated to the vehicle display device 10. In addition, the camera outside the vehicle may be a monocular camera, but it is preferable that the camera outside the vehicle is a stereo camera in order to accurately acquire the distance between the object existing ahead of the vehicle and the host vehicle 1. Further, the camera outside the vehicle may be capable of infrared imaging so that an image ahead of the vehicle can be taken even when the vehicle front is dark. The front image acquisition unit 61 outputs, for example, the acquired front image of the vehicle to the front image analysis unit 62.

  The front image analysis unit 62 analyzes the input image ahead of the vehicle using, for example, known image processing, a pattern matching method, or the like. The forward image analysis unit 62 analyzes the input image in front of the vehicle to obtain forward information about the road shape ahead of the vehicle (lane, white line, stop line, pedestrian crossing, road width, number of lanes, intersection, curve, branch) Road).

  Further, the front image analysis unit 62 analyzes the input image in front of the vehicle, so that the position and size of other vehicles and obstacles existing in front of the vehicle, the distance from the own vehicle 1, the own vehicle 1 and Get forward information such as relative speed. For example, the front image analysis unit 62 outputs the acquired front information to the image generation unit 30 via the bus 5. Here, the front image analysis unit 62 may be provided, for example, in a camera outside the vehicle, and the image generation unit 30 may include the function of the front image analysis unit 62. Further, the image generation unit 30 may directly input the front information from the front image analysis unit 62 without using the bus 5.

  Further, the front information acquisition unit 60 includes a laser radar, a millimeter wave radar, an ultrasonic sensor, or other known sensors instead of the front image acquisition unit 61 or in combination with the front image acquisition unit 61. Also good. At this time, the front image analysis unit 62 inputs data output from a laser radar, a millimeter wave radar, an ultrasonic sensor, a known sensor, or the like instead of the image in front of the vehicle or in combination with the image in front of the vehicle. The forward information as described above may be acquired by analyzing the above.

  In FIG. 1, the vehicle interior image acquisition unit 41 and the front image acquisition unit 61 are illustrated as being attached to another place of the vehicle 1, but this is not necessarily the case, and the vehicle interior image acquisition unit is not necessarily limited thereto. 41 and the front image acquisition part 61 may be attached to the same place of the vehicle 1. Moreover, the vehicle interior image acquisition part 41 and the front image acquisition part 61 may be provided in one same housing | casing.

  The image generation unit 30 includes a processing unit 31 and a storage unit 32. The processing unit 31 includes, for example, one or a plurality of microprocessors, a microcontroller, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), and any other IC (Integrated Circuit). The storage unit 32 is, for example, a rewritable RAM (Random Access Memory), a read-only ROM (Read Only Memory), an erasable program read-only EEPROM (Electrically Erasable Programmable Read-Only Memory), or a nonvolatile memory. It has one or a plurality of memories capable of storing programs and / or data such as a flash memory.

  The image generation unit 30 generates an image to be displayed by the image display unit 20 when the processing unit 31 executes a program stored in the storage unit 32, for example. The image generation unit 30 can include the AR content in the generated image.

  The AR content is transferred by the projection unit 50 to the translucent member 2 (for example, a front window shield, which may be the windshield itself, or a material having both translucency and reflectivity). By the projection, it is visually recognized as a virtual image 330 by the user. The AR content is, for example, a caution mark that alerts the user by alerting the user that there is a notification object such as another vehicle or an obstacle on the road ahead of the vehicle.

  Here, the notification object can also be referred to as an AR content superimposition object, and the road surface or the like can be referred to as a background object. A mark representing route guide information input from a navigation device (not shown) included in the vehicle 1 can also be AR content. The number of AR contents may be singular or plural.

  The image generation unit 30 also displays one or more AR contents included in the generated image on the display surface of the image display unit 20 in accordance with the user's viewpoint position 100 in the vertical direction input from the viewpoint position acquisition unit 40. Change the display position and size. For example, the storage unit 32 of the image generation unit 30 associates the user viewpoint position 100 with parameters for determining the display position and display size of the AR content on the display area 210 corresponding to the user viewpoint position 100. Stored table is stored. For example, when the processing unit 31 refers to the table, the image generation unit 30 changes the display position and display size of the AR content on the display area 210 corresponding to the viewpoint position 100 of the user.

  Further, for example, the storage unit 32 of the image generation unit 30 stores an arithmetic expression for determining the display position and display size of the AR content on the display surface of the display unit 20 corresponding to the user viewpoint position 100. The image generation unit 30 changes the display position and display size of the AR content on the display surface of the display unit 20 according to the input user viewpoint position 100, for example, when the processing unit 31 calculates the arithmetic expression. The relationship between the user viewpoint position in the vertical direction and the position and size at which the AR content is displayed will be described later.

  The projection unit 50 projects the image displayed by the image display unit 20 toward the light transmissive member 2 such as the front window shield 2 of the vehicle 1. The light 80 constituting the projected image is reflected by the translucent member (front window shield or the like) 2 into the vehicle interior. Hereinafter, the light 80 constituting the image is also referred to as image light 80. The projection unit 50 projects an image so that the image light 80 reflected by the front window shield 2 enters toward the user viewpoint position 100. Further, the light transmissive member 2 of the vehicle 1 may be a combiner provided in the vehicle 1.

  A user sitting in the driver's seat can visually recognize a virtual image 330 formed on the front side of the vehicle with respect to the translucent member 2 when the image light 80 enters the user viewpoint position 100. For example, the user can visually recognize the virtual image 330 in a state in which at least a part of the scenery seen through the translucent member 2 and the virtual image 330 are superimposed. The virtual image 330 includes the virtual image of the AR content described above.

  Next, the image display unit will be described with reference to FIG. As shown in FIG. 2, the image display unit 20 includes a display surface 21 that can display an image. The display surface 21 has a display area 210 that can display an image. As the image display unit 20, for example, a liquid crystal panel module including a display surface 21 including a plurality of pixels and a drive circuit 26 provided in the vicinity of the display surface 21 can be used. The image display unit 20 may be a self-luminous display panel module such as an organic EL (Electro Luminescence) element, a reflective display panel module, a scanning display device that scans with laser light, or the like.

  For example, when a signal representing an image generated by the image generation unit 30 is input, the image display unit 20 includes at least one of the display surfaces 21 in the display area 210 of the display surface 21 according to the input signal. The image is displayed using the area of the part.

  In order to facilitate the following description, as shown in FIG. 2, for example, the Ix axis is defined in the horizontal direction of the display surface 21 at the viewpoint when the display surface 21 of the image display unit 20 is viewed from the front, and the display is performed. An Iy axis is defined in the vertical direction of the surface 21. The vertical direction corresponds to the vertical direction in real space. The horizontal direction is a direction orthogonal to the vertical direction and corresponding to the left-right direction (that is, the vehicle left-right direction) toward the front of the vehicle in real space. At this time, the positive direction of the Ix axis represents the left direction of the display surface 21, and the positive direction of the Iy axis represents the upward direction of the display surface 21. Further, the Ix-axis positive direction on the display surface 21 corresponds to, for example, the above-described x-axis positive direction, that is, the vehicle left direction in real space. Similarly, the Iy-axis positive direction on the display surface 21 corresponds to, for example, the above-described y-axis positive direction, that is, the vertical direction upper side (vertically upward) in the real space.

  Next, an example of the structure of the projection unit will be described with reference to FIG. The projection unit 50 houses, for example, an optical system such as a plane mirror 54 and a concave mirror 55 and a concave mirror actuator 56 inside the housing 51. The casing 51 includes, for example, an upper case 52 and a lower case 53 that are arranged in the dashboard 4 of the vehicle 1 and are formed of a black light-shielding synthetic resin or the like. An upper case opening 52a is provided substantially in the middle of the upper case 52 in the z-axis direction. The upper case opening 52a is covered with a transparent cover 57 formed of, for example, a transparent translucent synthetic resin. On the vehicle rear side of the lower case 53, for example, a lower case opening 53a is provided. The lower case opening 53 a is provided in the lower case 53 so that, for example, image light 80 emitted from the display surface 21 of the image display unit 20 attached to the outside of the housing 51 can enter.

  The flat mirror 54 is attached to the vehicle rear side of the lower case 53 via an attachment member (not shown), for example. The mounting position and the mounting angle of the flat mirror 54 are fixed so that, for example, the image light 80 emitted from the display surface 21 incident from the lower case opening 53a is reflected toward the front of the vehicle.

  The concave mirror 55 is attached to the front side of the vehicle from the flat mirror 54 of the lower case 53 via a concave mirror actuator 56, for example. The mounting angle of the concave mirror 55 can be rotated by the concave mirror actuator 56, for example, with the x axis as a rotation axis. The concave mirror 55 is attached so that, for example, the position is fixed so that the image light 80 reflected by the plane mirror 54 is incident, and the incident image light 80 is reflected toward the translucent member (front window shield or the like) 2. The angle is finely adjusted. Depending on the attachment angle, for example, the user's viewpoint position 100 stored in the storage unit 32 of the image generation unit 30 and the display position and display size of the AR content on the display area 210 corresponding to the user's viewpoint position 100 are displayed. The table or arithmetic expression for changing is corrected.

  The concave mirror actuator 56 includes, for example, a motor, a speed reduction mechanism, a concave mirror rotating member, and a support member for the concave mirror 55, all not shown. The concave mirror actuator 56 is attached to the lower case 53, for example, on the lower side in the vertical direction of the concave mirror 55 via an attachment member (not shown). The concave mirror actuator 56 rotates the motor in accordance with a signal input from an actuator control unit (not shown), decelerates the rotation of the motor by a speed reduction mechanism, transmits the rotation to the concave mirror rotating member, and rotates the concave mirror 55. The concave mirror actuator 56 is not necessarily provided.

  Further, in the upper case 52 of the casing 51 in FIG. 3, a light shielding part 52 b is provided between the upper case opening 52 a and the plane mirror 54. The light shielding unit 52b is provided, for example, to prevent light from the outside of the housing 51 that enters from the upper case opening 52a from traveling to the image display unit 20. The example of the structure of the projection unit 50 described with reference to FIG. 3 is merely an example, and does not limit the structure of the projection unit 50 of the vehicle display device 10 at all.

  FIG. 4 shows an example of a landscape and a virtual image that a user sitting in the driver's seat of the vehicle 1 can see through the front window shield 2. In the example shown in FIG. 4, as an example of the scenery seen through the translucent member (front window shield or the like) 2, a three-lane road or the like extending in front of the vehicle and another vehicle (front vehicle) 90 existing in front of the vehicle are shown. Has been. In the example of the scenery seen through the translucent member (front window shield or the like) 2 shown in FIG. 4, the notification object is the forward vehicle 90. That is, the preceding vehicle becomes a superimposition target of the virtual image 350 of the AR content. In FIG. 4, a warning mark 350 is shown as a virtual image 350 of the AR content. The attention mark 350 is superimposed on the forward vehicle 90 and visually recognized by the user. In addition, when there are a plurality of front vehicles or the like, a warning mark 350 may be superimposed on each front vehicle.

  In the example illustrated in FIG. 4, the region 310 is a region in real space corresponding to the display region 210 of the display surface 21 of the image display unit 20. Hereinafter, the area 310 corresponding to the display area 210 of the display surface 21 of the image display unit 20 is also referred to as a virtual image display area 310. That is, the virtual image display area 310 is an area where the user can visually recognize the virtual image.

  Therefore, the image generation unit 30 generates an image reflecting forward information included in a region that overlaps the virtual image display region 310 in a landscape that can be seen through the translucent member (front window shield or the like) 2. That is, the image generation unit 30 includes one or a plurality of notification objects (AR content superimposition objects) included in an area that overlaps the virtual image display area 310 in a landscape that can be seen through the translucent member (front window shield or the like) 2. An image including one or a plurality of AR contents for informing the user is generated.

  Next, the relationship between the user viewpoint position 100 in the vertical direction and the position and size at which the AR content 250 is displayed will be described with reference to FIGS. 5, 6, and 7. In FIG. 5, the viewpoint position of the user in the vertical direction of the real space is shown on the left side, and the display position and size (size) of the AR content in the display area 210 of the display surface 21 of the image display unit 20 are shown on the right side. The y axis shown on the left side of FIG. 5 is the vertical axis, the Iy axis shown on the right side is the vertical axis on the display surface 21 corresponding to the vertical direction, and the Ix axis is the display surface. 21 is a horizontal axis (that is, an axis in a direction orthogonal to the vertical direction and corresponding to the left-right direction of the vehicle in real space). The same applies to FIGS. 6 and 7.

  In FIG. 5, the user's viewpoint is at the reference position. The viewpoint position of the user at the reference position, that is, the reference viewpoint position is indicated by reference numeral 100r in the figure. Also, the AR content corresponding to the reference viewpoint position 100r is indicated with a reference numeral 250r. The AR content 250r is a reminder mark. In FIG. 5, for the sake of convenience, only the outer shape of a triangle is shown (this is the same in FIGS. 6 and 7). The length of the triangle indicating the AR content 250r in the vertical direction (that is, the height of the triangle) is h1.

  Reference is now made to FIG. FIG. 6 shows the position and size of the AR content on the display surface 21 when the user's viewpoint position moves to the upper side in the vertical direction from the reference position. The upward direction in the vertical direction is the positive direction of the Iy axis, and corresponds to the upward direction in the vertical direction in real space. In FIG. 6, the viewpoint position above the reference position, that is, the upper viewpoint position is indicated by reference numeral 100u. The AR content (attention mark) corresponding to the upper viewpoint position 100u is indicated by a broken line with a reference numeral 250u. The length in the vertical direction of the triangle indicating the AR content 250u (that is, the height of the triangle) is h3 (> h1). That is, the size of the AR content 250u is larger than that of the AR content 250r, and the vertical position of the AR content 250u on the display surface 21 is higher than the vertical position of the AR content 250r (that is, Higher position).

  Reference is now made to FIG. FIG. 7 shows the position and size of the AR content on the display surface 21 when the user's viewpoint position moves downward in the vertical direction from the reference position. The downward direction in the vertical direction is the negative direction of the Iy axis, and corresponds to the downward direction in the vertical direction in real space. In FIG. 7, the viewpoint position below the reference position, that is, the lower viewpoint position is indicated by reference numeral 100 d. The AR content (attention mark) corresponding to the lower viewpoint position 100d is indicated by a broken line with a reference numeral 250d. The length in the vertical direction of the triangle indicating the AR content 250d (that is, the height of the triangle) is h2 (<h1). That is, the size of the AR content 250d is smaller than that of the AR content 250r, and the vertical position of the AR content 250d on the display surface 21 is lower than the vertical position of the AR content 250r ( In other words, the position is lower).

  Reference is now made to FIG. FIG. 8 shows the viewpoint position of the user in the vertical direction, the virtual image of the AR content (virtual image AR content), and the road surface range (distance range on the road surface) as a background object corresponding to each virtual image AR content. And their mutual correspondence is shown.

  As is apparent from FIG. 8, the display positions and sizes of the virtual image AR contents 350u, 350r, and 350d in the vertical direction are changed according to the user viewpoint positions 100u, 100r, and 100d. That is, the display position of the virtual image AR content 350 is increased in the vertical direction and the size is increased as the user's viewpoint position is higher than the reference position. Similarly, the user's viewpoint position is the reference position. As the position is lower than the position, the display position of the virtual image AR content is changed to be lower in the vertical direction and smaller in size. Thereby, the virtual image AR contents 350u, 350r, and 350d and the road surface distance (length of the distance range) 400u, 400r, and 400d of the road surface as the background object coincide with each other (including substantially coincidence). Yes. That is, the correspondence relationship between the virtual image AR contents 331u, 331r, and 331d generated in accordance with the change of the viewpoint position shown in FIG. 16 and the distance 401u, 401r, and 401d on the road surface of the road surface as the background object. This solves the problem of the difference between the two. Therefore, it is possible to present information with less discomfort.

  Reference is now made to FIG. FIG. 9 shows another example of a landscape and a virtual image that can be seen by a user sitting in a driver's seat of a vehicle equipped with a vehicle display device, and parts that are the same as those in FIG. 4 are given the same reference numerals. In FIG. 9, the user sitting in the driver's seat of the vehicle 1 is not only the virtual image 350 of the AR content (warning mark) that needs to be superimposed on the front vehicle 90 that is the superimposition target, but also the front that is the superimposition target. The virtual images 370-1 and 370-2 of the non-superimposed AR content (here, additional information such as the traveling speed of the vehicle 1) that does not need to be superimposed on the vehicle 90 are also made visible.

  In FIG. 9, in addition to FIG. 4, a virtual image (first virtual image non-AR content) 370-1 representing the speed limit of the road on which the vehicle 1 is currently traveling, and the current traveling speed of the vehicle 1. A virtual image (second virtual image non-AR content) of the non-AR content 370-2 that represents is shown below the region 300.

  Here, the virtual image non-AR contents 370-1 and 370-2 do not need to be superimposed on the vehicle 90 in front of the superimposition target in the scenery seen through the translucent member (front window shield or the like) 2. It is desirable that they are constantly displayed at the same position as possible. If the display position of the virtual image non-AR contents 370-1 and 370-2 is changed according to the viewpoint position of the user, the relative positional relationship with the virtual image AR content 350 changes, which causes the user to feel uncomfortable. Let For the same reason, it is not necessary to change the size (size) of the virtual image non-AR contents 370-1 and 370-2 according to the viewpoint position of the user.

  Next, the display position and size of the AR content 250 on the display surface 21 of the image display unit 20 are changed according to the viewpoint position in the vertical direction of the user so that both the example of FIG. 4 and the example of FIG. 9 can be handled. The method of making it explain.

  Although the display position and size of the AR content 250 can be directly adjusted individually, in the present embodiment, this individual and direct adjustment method is not adopted, and the image display unit 20 of the AR content 250 is used. The AR content display area 210 on the display surface 21 (in the example of FIG. 9, the area excluding the display area of the non-overlapping AR content in the display area 210) is expanded or contracted in the vertical direction, thereby indirectly AR. The position and size of the content 250 are changed. Compared with the case where the position and size of the AR content 250 are directly changed, the change process is simplified, the burden on the image generation unit 30 is reduced, and each AR is displayed even when there are a plurality of AR contents to be displayed. The position and size of the content can be changed at once, and the burden on the image generation unit 30 can be reduced in this respect as well.

  The above points will be specifically described with reference to FIGS. 10, parts that are the same as those in FIG. 2 are given the same reference numerals. Description of common parts is omitted. In FIG. 10, the display area 210 of the display surface 21 of the image display unit 20 is an AR content display area (first area) in which AR content that needs to be superimposed on an object to be superimposed (for example, a vehicle ahead) is displayed. 240 and a display area (second area) 260 of non-overlapping AR content in which non-overlapping AR content that does not need to be superimposed on the superimposition target is displayed. Is provided with a space area SP.

  Reference is now made to FIG. FIG. 11A shows an example of image display in the display area 210 of the display surface 21 of the image display unit 20, and FIGS. 11B to 11D show the display image of FIG. It shows how it changes according to the viewpoint position of the user. As shown in FIG. 11A, in the display area 210 of the display surface 21 of the image display unit 20, the display area (first area) 240 of the AR content 250 and the display area (second area) of the non-superimposed AR content 270 are displayed. (Region) 260 is provided separately. Note that the display area (second area) 260 of the non-superimposed AR content 270 is provided as necessary, and need not be provided if unnecessary.

  In addition, the display area 240 (first area) of the AR content 250 has m columns in the vertical direction and n columns in the horizontal direction (m and n are natural numbers of 2 or more. In the example of FIG. 11, m and n are The vertical lengths (L10, L20, L30, and L40) of the m lattice regions GR that are partitioned into a plurality of lattice regions GR that are both in the vertical direction are longer from the upper level toward the lower level. Are set at non-equal intervals (L10 <L20 <L30 <L40). This point will be described later.

  On the other hand, the display area (second area) 260 of the non-superimposed AR content 270 has p rows in the vertical direction (q columns in the horizontal direction (p, q are natural numbers of 2 or more, p in the example of FIG. q is 4), and the vertical lengths of the p lattice areas arranged in the vertical direction are set at equal intervals (L50, L50). It is not necessary to superimpose on the object, and it is not necessary to consider the correspondence with the background object so much, and it is desirable that the object is constantly displayed at the same position as possible. In consideration of the vertical length of each grid area (the height of each grid area), the non-superimposed AR content 270 has a vertical position of the user in the vertical direction for the same reason. Display position corresponding to change and It does not change the size.

  11B, 11 </ b> C, and 11 </ b> D, respectively, are an image example when the viewpoint position of the user in the vertical direction is the reference position, an image example when the user is at a position higher than the reference position, and lower than the reference position. The example of an image when it exists in a position is shown. FIG. 11 (b) is the same as FIG. 11 (a), except that AR content is denoted by reference numeral 250r, non-superimposed AR content is denoted by reference numeral 270r, and the AR content display area (first area). Is denoted by reference numeral 240r, and the display area (second area) of the non-overlapping AR content is denoted by reference numeral 260r.

  In FIG. 11 (c), the AR content is denoted by reference numeral 250u, the non-superimposed AR content is denoted by reference numeral 270u, the AR content display area (first area) is denoted by reference numeral 240u, and the non-superimposed AR is denoted. The content display area (second area) is denoted by reference numeral 260u. As shown in FIG. 11C, the AR content display area (first area) 240u is extended upward in the vertical direction as compared with the example of FIG. 11B, and according to the expansion rate. The AR content 250u is stretched, whereby the AR content 250u is positioned above the AR content 250r in FIG. 11B and the size thereof is enlarged. In FIG. 11C, L11 <L21 <L31 <L41 is established with respect to the length in the vertical direction (height of each lattice region) of the lattice regions arranged in the vertical direction. The non-overlapping AR content display area (second area) 260u is the same as the non-overlapping AR content display area (second area) 260r of FIG.

  In FIG. 11 (d), the AR content is denoted by reference numeral 250d, the non-overlapping AR content is denoted by reference numeral 270d, the AR content display area (first area) is denoted by reference numeral 240d, and the non-overlapping AR is denoted. The content display area (second area) is denoted by reference numeral 260d. As shown in FIG. 11D, the AR content display area (first area) 240d is shrunk downward in the vertical direction as compared with the example of FIG. Thus, the AR content 250d is compressed, whereby the AR content 250d is positioned below the AR content 250r in FIG. 11B and the size thereof is reduced. In FIG. 11D, L12 <L22 <L32 <L42 is established with respect to the length in the vertical direction of each lattice region arranged in the vertical direction (the height of each lattice region). The non-overlapping AR content display area (second area) 260d is the same as the non-overlapping AR content display area (second area) 260r of FIG.

  In FIGS. 11C and 11D, after the AR content display areas (first areas) 240u and 240d are expanded / contracted, the expansion ratio / contraction ratio is maintained and the AR content is maintained. The display areas (first areas) 240u and 240d of the AR are shifted along the vertical direction by using the space area SP to adjust the display position of the AR contents 250u and 250d as appropriate. Can do. Such a modification is also included in the technical scope of the present embodiment. In the example of FIG. 11 (c), the AR content display area (first area) 240u and the non-overlapping AR content display area (second area) 260u are shifted upward as compared to the example of FIG. As a result, the lower space SP is enlarged as compared with the example of FIG. In the example of FIG. 11D, the AR content display area (first area) 240d and the non-overlapping AR content display area (second area) 260d are lower than in the example of FIG. 11B. As a result, the lower space SP is reduced as compared with the example of FIG.

  Next, with reference to FIG. 12, an example of a preferable ratio of the unequal intervals of the lattice areas arranged in the vertical direction in the AR content display area (first area) 240 will be described. For example, as shown in FIG. 12, the ratio of the non-uniform intervals between the lattice areas arranged in the vertical direction in the AR content display area (first area) 240 is when the user's vertical viewpoint position is at the reference position. (In the case of FIG. 11B), this corresponds to the length in the vertical direction of each of the m (m = 4 in this case) lattice areas arranged in the vertical direction in the display area (first area) of the AR content 250r. The distances on the road surface 70 of the road as the background object are determined to be equal intervals d. The reason for this will be described with reference to FIG.

  As shown in FIG. 13B, when the lengths of the lattice areas arranged in the vertical direction (height of the lattice areas) are equally spaced, when the viewpoint position of the user in the vertical direction is the reference viewpoint position 100r, the vertical direction The distances on the road surface of the road surface 70 of the road as the background object corresponding to the vertical lengths of the m (here, m = 4) grid regions are da, db, dc, dd ( da> db> dc> dd) and non-equal intervals. The range of the road surface 70 of the road as the background object is ZA2, and the front end of the road surface range ZA2 is at the position α2.

  In this state, when the viewpoint position of the user changes to the lower viewpoint position 100d, the range of the road surface 70 of the road as the background object is greatly expanded to ZB2, and the front end of the road surface range ZB2 is greatly increased to the position β2. Shift. It is not easy to change the display position and size of the AR content 250 following such a large shift, and a correction error may occur. In this case, accurate correction as shown in FIG. 8 can be performed. Absent. As shown in FIG. 9, the virtual image AR mark 350 is indirectly superimposed on the road surface of the road that is the background object via the vehicle 90 ahead, and when the distance range of the road surface of the road that is the background changes, The mutual positional relationship between the virtual image AR mark 350 and the road surface changes, which gives the user a sense of discomfort. Further, in this case, the positional relationship between the virtual image AR content 350 and the forward vehicle 90 that is the superimposition target also shifts, and the superimposition of the virtual image AR content 350 with respect to the front vehicle 90 that is the superimposition target. Also decreases.

  On the other hand, as shown in FIG. 13A, if the vertical lengths (heights of the respective lattice regions) of m lattice regions (m = 4) arranged in the vertical direction are not equal, When the viewpoint position of the user in the vertical direction is the reference position 100r, the road surface 70 of the road as a background object corresponding to the length in the vertical direction of each of the m (m = 4) grid regions arranged in the vertical direction. The distances on the road surface are all d and are equally spaced. The range of the road surface 70 of the road as the background object is ZA1, and the front end of the road surface range ZA1 is at the position α1. In this state, when the viewpoint position of the user changes to the lower viewpoint position 100d, the road surface range of the road as a background object is slightly larger than ZB1, but the change is compared to the example of FIG. 13B. It is suppressed. As a result, the front end of the road surface range ZB1 is at the position β1, and the positional shift amount (deviation amount) is considerably smaller than that in the example of FIG. Therefore, by changing the display position and size of the AR content 250, it is easy to perform correction that follows the change, no correction error occurs, and the user is prevented from feeling uncomfortable. Moreover, the mutual positional relationship between the virtual image AR content 350 and the preceding vehicle 90 that is the superimposition target is also maintained, and the superimposition of the virtual image AR content 350 with respect to the front vehicle 90 that is the superimposition target does not deteriorate.

  Next, referring to FIG. 14, using a warping grid area for correcting the AR content 250 so that the virtual image visually recognized by the user is not distorted as the display area 210 of the display surface 21 of the image display unit 20. explain.

  When the AR content 250 displayed on the display surface 21 of the image display unit 20 is projected onto a translucent member (also referred to as a translucent reflective member) 2 such as a curved front window shield by the projection unit 50, a virtual image 330 is displayed. (See FIG. 1) distortion occurs. The warping process is a correction process that prevents the virtual image 330 on the curved translucent member 2 from being distorted by giving a display image with a reverse distortion in advance according to the curvature of the curved surface of the translucent member 2. It is. For this warping process, a warping grid region WGR as shown in FIGS. 14A and 14B is used. In the warping grid region WGR, coordinate points Dt are arranged at the four corners of a plurality of lattice regions arranged in the vertical direction and the horizontal direction. The coordinate point Dt corresponds to a pixel on the display surface 21, for example. FIG. 14A shows the warping grid area WGR before the warping process, and FIG. 14B shows the warping grid area WGR after the warping process.

  By using the warping grid area for correcting the AR content so that the virtual image visually recognized by the user is not distorted as the AR content display area, the AR content position and size changing process and the warping process can be performed in common. It can be performed on the area, and efficient processing is realized.

  Next, with reference to FIG. 15, the expansion or reduction of the size of the AR content in the horizontal direction will be described. As described above, the AR content 250 is enlarged or reduced in the vertical direction, but is not enlarged or reduced in the horizontal direction in the present embodiment. Here, if enlargement or reduction is also performed in the horizontal direction, the horizontal size itself, which is the basis of the aspect ratio (ratio of the vertical and horizontal dimensions of the figure), changes, which causes the shape of the figure to be distorted. The size is not changed. Therefore, the aspect ratio of the virtual image 350 of the AR content 250 visually recognized by the user can be maintained, and information can be presented with less sense of incongruity.

  As shown in FIG. 15, the vertical lengths of AR contents 250r, 250u, and 250d (the heights of the outer triangles) are L0, L1, and L2 (L2 <L) in accordance with the viewpoint position in the vertical direction of the user. L0 <L1), but the length in the horizontal direction (the length of the base of the outer triangle) is W0 and does not change according to the viewpoint position.

  Further, as shown in the upper left of FIG. 15, the virtual image 330 visually recognized by the user is based on a surface e1 on the display surface 21 of the image display unit 20 corresponding to a surface parallel to the road surface in the real space. A standing image standing at an angle of at least 45 degrees (preferably a standing image in the range of 80 degrees (θ1 in the figure) to 90 degrees (θ2 in the figure)). By maintaining the aspect ratio of the external shape, it is possible to suppress the user from feeling uncomfortable. In addition, when the angle formed by the virtual image 330 and the surface e1 is small and the virtual image 330 is not a standing image, the horizontal length W0 of the AR contents 250r, 250u, and 250d is considered in consideration of the relationship with the width of the road. That is, there is a possibility that the horizontal size of the AR content is changed.

  As described above, according to the embodiment of the present invention, even when the viewpoint position of the user in the vertical direction is changed, the positional relationship between the virtual image of the AR content and the background object is maintained, and information presentation with less discomfort is presented. It is possible to provide a display device for a vehicle that can be used.

  The present invention is not limited to the above-described exemplary embodiments, and those skilled in the art will be able to easily modify the above-described exemplary embodiments to the extent included in the claims. .

DESCRIPTION OF SYMBOLS 1 ... Vehicle, 2 ... Front window shield, 10 ... Display apparatus for vehicles, 2
DESCRIPTION OF SYMBOLS 0 ... Image display part, 21 ... Display surface, Liquid crystal panel, 30 ... Image generation part, 40 ... Viewpoint position acquisition part, 41 ... Car interior image acquisition part, 42 ... Car Indoor image analysis unit, 62 ... forward image analysis unit, 70 ... road surface of road as background object, 80 ... image light, 90 ... forward vehicle (notification object, virtual image of AR content (Superimposition object), 100... User viewpoint position, 210... Display area on the display surface, 240... AR content display area (first area), 250... AR content, 260. Non-overlapping AR content display area (second area), 270 ... non-AR content, 330 ... virtual image range, 350 ... virtual image of AR content (virtual image AR content), 370 ... non-overlapping AR content Virtual image (virtual image non-AR Content).

Claims (7)

A viewpoint position acquisition unit that acquires the position of the viewpoint of the user sitting in the driver's seat of the vehicle;
A forward information acquisition unit that acquires forward information that is forward information of the vehicle;
An image generation unit that generates an image reflecting the front information included in a predetermined area among the front information acquired by the front information acquisition unit;
An image display unit having a display surface capable of displaying the image generated by the image generation unit;
The image is displayed so that the user sitting in the driver's seat can visually recognize the virtual image by reflecting light of the image displayed on the display surface by a translucent member disposed in the vehicle in front of the user. A projection unit for projecting the light toward the translucent member;
With
A direction corresponding to a vertical direction on the display surface of the image display unit is a vertical direction, a direction orthogonal to the vertical direction and a direction corresponding to a left-right direction toward the front of the vehicle is a horizontal direction, and the image In the situation where the image generated by the generation unit includes augmented reality (AR) content, and the AR content is visually recognized by the user as the virtual image by the projection by the projection unit.
The display area of the AR content on the display surface of the image display unit is partitioned into lattice areas of m stages (m is a natural number of 2 or more) in the vertical direction and n columns (n is a natural number of 2 or more) in the horizontal direction. And the lengths in the vertical direction of the m lattice regions arranged in the vertical direction are set at non-uniform intervals so as to increase from the upper level to the lower level,
The image generation unit
Even in a situation where the viewpoint position of the user in the vertical direction has changed, the correspondence between the virtual image visually recognized by the user by projection of the AR content and the background object visually recognized by the user as the background of the virtual image is maintained. As
Depending on the viewpoint position of the user in the vertical direction, the display area of the AR content on the display surface of the image display unit is elongated or contracted in the vertical direction, and the AR content on the display surface of the image display unit is A vehicle display device characterized by changing a position and a size. The image generation unit extends the display area of the AR content upward in the vertical direction as the viewpoint position in the vertical direction of the user moves upward from the reference position, and thereby the position in the vertical direction of the AR content. In such a way that is higher on the display surface and the size of the AR content is further increased,
As the viewpoint position in the vertical direction of the user moves downward from the reference position, the display area of the AR content is contracted downward in the vertical direction, whereby the vertical position of the AR content is displayed in the display. The vehicular display device according to claim 1, wherein control is performed so that the AR content is further down on the surface and the size of the AR content is further reduced. The ratio of the unequal intervals in the vertical direction of the display area of the AR content is
The background object corresponding to the length in the vertical direction of each of the m grid areas arranged in the vertical direction in the display area of the AR content when the viewpoint position in the vertical direction of the user is at the reference position The vehicle display device according to claim 1, wherein the distance of the road surface of the road is determined such that the distances on the road surface are equally spaced.   The display area of the AR content is a warping grid area for correcting the AR content so that the virtual image visually recognized by the user is not distorted. Vehicle display device.   The AR content on the display surface of the image display unit is enlarged or reduced in the vertical direction according to the expansion rate or contraction rate in the vertical direction of the display area of the AR content, while being enlarged and reduced in the horizontal direction. The vehicle display device according to claim 1, wherein the display device is not reduced. In addition to the AR content that the virtual image needs to be superimposed on the superimposed object, non-superimposed AR content that does not require the virtual image to be superimposed on the superimposed object is included,
The display area of the display surface of the image display unit is divided into a display area for the AR content and a display area for the non-superimposed AR content.
6. The image generation unit according to claim 1, wherein the display area of the non-overlapping AR content does not perform expansion and contraction in a vertical direction according to a change in a viewpoint position of the user in the vertical direction. The vehicle display device according to any one of the preceding claims.   The display area of the non-overlapping AR content on the display surface of the image display unit is a lattice area of p rows in the vertical direction (p is a natural number of 2 or more) and q columns (q is a natural number of 2 or more) in the horizontal direction. The vehicular display device according to claim 6, wherein the lengths in the vertical direction of each of the p lattice regions that are partitioned and arranged in the vertical direction are set at equal intervals.

Images