WO2020171045A1 - Dispositif d'affichage tête haute, dispositif de commande d'affichage et programme de commande d'affichage - Google Patents

Dispositif d'affichage tête haute, dispositif de commande d'affichage et programme de commande d'affichage Download PDF

Info

Publication number
WO2020171045A1
WO2020171045A1 PCT/JP2020/006188 JP2020006188W WO2020171045A1 WO 2020171045 A1 WO2020171045 A1 WO 2020171045A1 JP 2020006188 W JP2020006188 W JP 2020006188W WO 2020171045 A1 WO2020171045 A1 WO 2020171045A1
Authority
WO
WIPO (PCT)
Prior art keywords
virtual image
information
display
vehicle
image display
Prior art date
Application number
PCT/JP2020/006188
Other languages
English (en)
Japanese (ja)
Inventor
勇希 舛屋
Original Assignee
日本精機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本精機株式会社 filed Critical 日本精機株式会社
Publication of WO2020171045A1 publication Critical patent/WO2020171045A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/26—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view to the rear of the vehicle
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/38—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory with means for controlling the display position

Definitions

  • the present invention relates to a head-up display (HUD) device, a display control device, a display control program, and the like mounted on a vehicle such as an automobile.
  • HUD head-up display
  • a virtual image can be superimposed on a real scene (foreground) in front of the driver of the vehicle and various information can be presented to the driver.
  • HUD head-up display
  • the HUD device is generally unsuitable for displaying information behind the vehicle (including not only directly behind but also laterally behind). This is because it is difficult for the driver to determine the directionality of information (determine whether it is information about the front or information about the rear). However, in recent years, even HUD devices have been attempted to be able to present information behind the vehicle.
  • Patent Document 1 the display area is divided into two areas, an upper area and a lower area, and information behind the vehicle is always displayed in the lower area to make it easier to recognize the directionality of the information. It is described that the discomfort is reduced.
  • Patent Document 2 describes that a combiner is divided into a transparent display area and an opaque display area, and an image obtained by photographing the space behind the vehicle is always displayed in the opaque display area. There is.
  • Patent Documents 1 and 2 What is common to Patent Documents 1 and 2 is that the information behind the vehicle is displayed only in one of the divided (divided) display areas (in other words, display processing based on division of the display area). Point).
  • Patent Documents 1 and 2 each disclose a useful display technique, a driver or the like needs to confirm whether the display position of the presented information is on the upper side or the lower side, and the upper and lower sides of the viewpoint. It is undeniable that the movements of are likely to occur. This point is considered to be disadvantageous in terms of intuitively grasping information.
  • One object of the present invention is to provide a HUD device capable of displaying information behind the vehicle without impairing the intuitive graspability.
  • a heads up display (HUD) device is Information of non-superimposed content that is mounted on a vehicle and allows a user to visually recognize a virtual image of the image by projecting the image on a projection target member provided in the vehicle, and the virtual image does not need to be superimposed on the actual scene.
  • HUD heads up display
  • the head-up display device including: A rear information acquisition unit that acquires the rear information, A non-overlapping content information acquisition unit that acquires information about the non-overlapping content, An image generation unit that generates a first image of the non-superimposed content and a second image of the backward information; An image display unit having a display surface for displaying the first and second images; An optical system including an optical member which reflects the display light showing the first and second images and projects the display light onto the projection target member; A virtual image display control unit for controlling display of the first and second virtual images, Have The virtual image display control unit, When the distance from the reference point set on the user or the vehicle to the virtual image is the virtual image display distance, controlling the virtual image display distance for at least one of the first and second virtual images, as well as, Performing control for performing a depth sensation imparting process that imparts a depth sensation during image generation in the image generation unit, At least one of the first and second virtual images is displayed such that the second virtual
  • the “second virtual image of information behind the vehicle (rear information)” is more user than the “first virtual image of non-superimposed content (for example, vehicle speed display)”.
  • the virtual image display control unit controls the display of the first and second virtual images so that the virtual image is visually recognized as being close to.
  • the vehicle speed display for example, 55 km/h
  • a display device such as meters (instruments) installed in the vehicle
  • the user driver etc.
  • the vehicle speed display and the like are generally displayed at a fixed position on the front side, unlike the mark or the like superimposed on the vehicle in front, and the user (driving) who is used to it
  • the display should be integrated with the host vehicle. Strongly aware.
  • the information is about the rear side, and it is possible to identify the "direction" of the information (here, it is not the information about the "front side” but the information about the "back side” Discrimination power, distinctiveness) can be given to the “rear information” itself. Therefore, the user can intuitively and quickly recognize (become aware of) the “rear information” without causing unnecessary movement of the viewpoint.
  • a method of directly changing the virtual image display distance for at least one of the virtual images can be used.
  • a so-called 3D HUD device can be used to variably control the virtual image display distance for the first virtual image or for each of the first and second virtual images.
  • a method of variably controlling the optical path length and controlling the distance freely (for example, stepwise) can be adopted.
  • the virtual image display surface is tilted at a predetermined angle (90 degrees or less) with respect to the direction perpendicular to the road surface, and the “image position on the display surface” of the image display unit is controlled to display the virtual image display.
  • a method of adjusting the distance can be adopted. For example, when an image is arranged on the upper side of the virtual image display surface (the side away from the road surface), the image is arranged on the back side (or the front side), and the depth (virtual image display) is changed according to the distance from the center of the virtual image display surface. The distance) can be adjusted.
  • a virtual image of the first and second virtual images is obtained by at least one of changing the optical path length from the image display unit to the projection target member and changing the display positions of the first and second images on the display surface. It is possible to perform control to change the display distance.
  • a normal 2D HUD device for example, for a generated image, the size of the image is reduced, or a perspective icon or the like is used to draw “depth”. It is also possible to realize a pseudo 3D image by performing a “depth feeling imparting process for imparting a sense (perspective feeling)” and thereby obtaining the above-described effect.
  • a technique for obtaining the above special effect by using the 2D HUD device may be referred to as a “pseudo 3D HUD” in a broad term. This technique may be used in combination with the change control of the virtual image display distance by the above-mentioned 3D HUD device, and therefore, "it is possible to perform the change control of the virtual image display distance by at least one method".
  • the virtual image display distance of the virtual image (first virtual image) of the non-superimposed content is “L1”
  • “L1” is changed to “L2 (L2>L1)”
  • the first virtual image from the user's viewpoint. I.e., the space on the user side (front side) of the first virtual image
  • the virtual image of the rear information (second virtual image) is arranged in the widened space.
  • the virtual image display distance of the second virtual image is L3, L3 is smaller than the distance L2 of the first virtual image after being changed, so that L3 ⁇ L2.
  • the virtual image display distance L3 of the second virtual image may be set to be equal to or smaller than the first virtual image display distance L1 before being changed, and in this case, it is represented as L3 ⁇ L1.
  • the range in which the display position of the second virtual image can be arranged can be widened, and the degree of freedom in arranging the virtual image is improved.
  • the difference between the virtual image display distances of the first and second virtual images can be increased to enhance the perspective.
  • a viewpoint position acquisition unit that acquires information on the viewpoint position of the user, A visibility determination unit that determines whether or not the user can visually recognize the second virtual image based on the information on the viewpoint position;
  • the virtual image display control unit may control the display of the first and second virtual images only when the visibility determination unit determines that the virtual image display is visible.
  • the virtual image display control is performed only when the user can visually recognize the second virtual image (in other words, when the virtual image displayable area is within the visual field range of the user).
  • the virtual image display control described above utilizes the fact that the first virtual image relating to the non-superimposed content is integrally sensed with the host vehicle, so that the second virtual image is visually (and psychologically) forward. It is characterized by making people aware of it. Therefore, when the user's viewpoint is considerably deviated from the display position of the second virtual image and the second virtual image cannot be seen, the above control has no effect and is wasteful.
  • the virtual image display control unit A control for changing the virtual image display distance is performed, and the first and second virtual image display surfaces that display the first and second virtual images are relative to a direction perpendicular to a road surface on which the vehicle travels. And is tilted at an angle of 90° or less (however, it does not matter whether the tilt angles of the first and second virtual image display surfaces are the same).
  • the first and second virtual images on the first and second virtual image display surfaces do not overlap each other so that the first and second virtual images do not overlap each other.
  • the virtual image display distance of each virtual image may be controlled.
  • a representative point (for example, the center point) is set in one virtual image, and the distance between the representative point and the user's viewpoint is the virtual image display distance.
  • the first virtual image is arranged at the distance L2 and the second virtual image is arranged at the distance L3 (L3 ⁇ L2).
  • L3 ⁇ L2 holds for the representative point of each virtual image.
  • the end portions of the respective virtual images that are tilted and arranged overlap in plan view (plan view as seen from the direction perpendicular to the road surface) (partial overlap occurs). It has not happened).
  • the user may not be able to recognize the difference in the virtual image display distance of each virtual image and may not be able to obtain the above-mentioned effect.
  • the virtual image display distance is controlled. Therefore, even when the virtual image is displayed while being tilted, the above effect can be reliably obtained.
  • the information of the non-overlapping content is vehicle speed information indicating the traveling speed of the vehicle, information on the engine speed, intake pressure information, hydraulic pressure information, fuel pressure information, oil temperature information indicating the traveling state of the vehicle. It may include at least one of water temperature information, exhaust temperature information, throttle opening information, and intake air temperature information.
  • Vehicle information such as vehicle speed, engine speed, intake pressure, hydraulic pressure, fuel pressure, oil temperature, water temperature, exhaust temperature, throttle opening, intake temperature, etc.
  • Vehicle information is useful to the user as information indicating the running state. It has the property that you can feel it with a sense of unity. Therefore, when the non-overlapping content including at least one of the exemplified information described above is displayed together with the rear information, the virtual image display control described above is performed.
  • a competitive vehicle for example, when various vehicle information is displayed using the HUD device, it is possible to effectively display the information while reducing the movement of the user's viewpoint and focus adjustment.
  • the above virtual image display control is also used, the rear information can be intuitively and quickly presented to the user.
  • the above virtual image display control is also suitable for application to competitive vehicles and the like.
  • the width direction of the vehicle is the left-right direction
  • the direction perpendicular to the left-right direction is the up-down direction
  • the direction away from the road surface is the up direction
  • the approaching direction is the down direction
  • the first and second virtual images are the projected images.
  • the second virtual image is located at the lower left of the first virtual image in the virtual image displayable area.
  • the arrangement control may be performed.
  • the user operates the turn signal (with the turn signal to the right) to change the lane to the overtaking lane, and at that time, the rear vehicle (an example of a moving body) is located on the right rear side. It can be assumed that the person is approaching. At this time, the icon of the rear vehicle or the like is displayed on the "lower right" of the vehicle speed display or the like that is felt integrally with the host vehicle. The fact that it is displayed in the "lower right” (or diagonally lower right) also means that it is easy to intuitively understand that "it is the right rear of the vehicle.” The user can understand this intuitively.
  • the display control device is A display control device as the virtual image display control unit, which is mounted on the head-up display device according to any one of the first to sixth aspects and is realized by using a computer.
  • the computer By implementing the computer as the virtual image display control unit as, for example, a CPU or MPU, it is possible to reduce the size, and it is also applicable to a small HUD device mounted on a vehicle.
  • the display control program is a display control program that causes a computer to operate as the display control device according to the seventh aspect.
  • FIG. 1A shows a display example of a virtual image of non-superimposed content (vehicle speed display) and a virtual image of rear information in a driving scene in which a vehicle is traveling on a straight road (however, a table before application of the present invention.
  • FIG. 1(B) to FIG. 1(H) are views showing a display example of the rear information.
  • 2A to 2C are diagrams showing display examples of a virtual image of superimposed content (vehicle speed display) and a virtual image of rear information in the embodiment of the present invention.
  • FIG. 3A is a diagram showing an example in which the virtual image display distances of the first and second virtual images are controlled using the HUD device, and FIG.
  • FIG. 3B is a diagram showing a sense of depth imparted using the HUD device. It is a figure which shows an example at the time of performing a pseudo 3D display by performing a process.
  • FIG. 4 is a diagram showing an example of control of a virtual image display distance (a control example for eliminating duplication in plan view) when a virtual image (virtual image display surface) is inclined with respect to a direction perpendicular to a road surface.
  • FIG. 5A is a diagram for explaining control of the virtual image display distance using the HUD device
  • FIG. 5B is a diagram showing a configuration example of a main part of the HUD device.
  • FIG. 6A is a diagram showing an example of the main configuration of the road surface HUD device, and FIG.
  • FIG. 6B is a diagram showing an example of controlling the virtual image display distance by the road surface HUD device.
  • FIG. 7 is a figure which shows an example of the whole structure of the HUD apparatus which can control a virtual image display distance.
  • FIG. 8A is a diagram showing an example of a configuration for acquiring information on the rear of the vehicle (rear information).
  • FIG. 8B is a diagram for explaining the visual field range of the user.
  • FIG. 9 is a flowchart showing an example of a main operation procedure of the HUD device according to the embodiment of the present invention.
  • FIG. 1A is a display example of a virtual image of non-superimposed content (vehicle speed display) and a virtual image of rear information in a driving scene in which a vehicle is traveling on a straight road (however, in the present invention, FIG. 1(B) to FIG. 1(H) are views showing a display example before application), and FIGS.
  • a vehicle (own vehicle) 10 is traveling on a straight paved road (road surface) 2 at a speed of 55 km/h.
  • the vehicle 10 is provided with a windshield (front windshield) 6 as a projection target member.
  • the projected member may be a combiner or the like.
  • HUD head-up display
  • the virtual image SP1 (first virtual image) of the vehicle speed display (“55 km”) as the non-superimposed content that does not need to be superimposed on the actual scene, and the rear information (here, the icon image of the rear vehicle).
  • Virtual image BP1 (second virtual image).
  • FIGS. 1(B) to 1(H) are examples and are not limited to these.
  • the display control of the present invention is not performed, and here, the virtual images SP1 and BP1 have the same virtual image display distance and are displayed on the left and right sides. They are arranged side by side along the direction (width direction of the vehicle 10). Further, the virtual images SP1 and BP1 are equivalent in terms of perspective and both are displayed on the front side.
  • the user (driver) 1 is driving the vehicle (own vehicle) 10 while holding the steering wheel 3, and the visual field range (visible range) at that time is the range indicated by the symbol FD in the figure. is there.
  • the oncoming vehicle 15 is shown in the upper right.
  • the oncoming vehicle 15 is within the visual field range of the user (driver) 1, and when viewed from the user (driver) 1, the vehicle icon image BP1 which is rear information is superimposed on the oncoming vehicle 15.
  • the virtual image BP1 that is visible and displayed may be illusion as if it were intended for the oncoming vehicle 15. It is not preferable from the viewpoint of safe driving.
  • the user (driver) 1 to intuitively and instantly identify the directionality of the presented information (that the information by the virtual image BP1 is behind the vehicle). Is extremely important, and this also helps prevent accidents.
  • FIG. 2A to 2C are diagrams showing display examples of a virtual image of superimposed content (vehicle speed display) and a virtual image of rear information in the embodiment of the present invention.
  • vehicle speed display vehicle speed display
  • FIG. 2 the same parts as those in FIG. 1 are designated by the same reference numerals (this point also applies to other drawings).
  • first and second virtual images in order to distinguish before and after the application of the present invention, what is written as SP1 and BP2 in FIG. 1 is displayed as SP2 and BP2 in FIG. There is.
  • the driving scene in Fig. 2(A) is the same as that in Fig. 1(A).
  • the second virtual image BP2 for the rear information is closer to the user (driver) (front side) than the first virtual image SP1 for the non-superimposed content (vehicle speed display).
  • the virtual image display distance of each virtual image is controlled so as to be visually recognized.
  • the display of "55 km/h" looks far, and the icon of the rear vehicle (second virtual image BP2) looks close.
  • the user (driver) 1 can intuitively understand that the second virtual image BP2 indicates rear information. The reason is as follows.
  • a vehicle speed display for example, 55 km/h
  • a display device such as meters (measuring instruments) installed in the vehicle
  • the user generally indicates that the vehicle is displaying the vehicle speed.
  • the vehicle speed display and the like are generally displayed at a fixed position on the front side, unlike the mark or the like superimposed on the vehicle in front, and the user (driving) who is used to it
  • the display should be integrated with the host vehicle. Strongly aware.
  • the “rear” of the rear of the own vehicle 10 is on the front side of the information (“55 km/h”) of the “non-overlapping content” that is integrally grasped with the vehicle (the own vehicle) 10. Since the icon of the rear vehicle is displayed (arranged) as "information”, the user 1 intuitively feels that "rear information” is information about an object or the like located behind the host vehicle 10. It is possible to (recognize).
  • the reference position when determining the front or the rear is, for example, the position of the viewpoint A of the user (driver) 1 (however, it is an example and not limited to this).
  • the information is about the rear side, and the "direction" of the information (discrimination power for identifying not the information about the "front side” but the information about the "rear side", The distinctiveness) can be given to the "rear information” itself. Therefore, the user can intuitively and quickly recognize (sense) that the second virtual image BP2 indicates “rear information” without causing unnecessary movement of the viewpoint.
  • FIG. 2B shows one of preferable display examples.
  • the “non-overlapping content” is displayed on the upper side of the virtual image displayable area, and the “virtual image BP2 of rear information" seen on the front side is displayed on the lower side.
  • the upper and lower sides of the reference are drawn by a chain line in the figure.
  • the rear vehicle is approaching to the right rear.
  • the icon BP2 of the rear vehicle is displayed with a sense of realism at the "lower right" of the vehicle speed display SP2 that is felt integrally with the host vehicle 10. Displaying on the "lower right” (or diagonally lower left) means that it is easy to intuitively understand that "the vehicle is on the right rear side". The user can understand this intuitively.
  • the position of the image in the up-down direction (the height direction of the vehicle or the direction perpendicular to the road surface 2)
  • the rear vehicle icon BP2 is displayed at "lower left” (or diagonally lower right) of the vehicle speed display SP2.
  • the effect obtained is the same.
  • By performing such placement control of each virtual image it is possible to display a virtual image with excellent intuitiveness and a sense of realism (in particular, display of information about the rear vehicle, which is useful when changing lanes, etc.). Will be realized.
  • FIG. 2B adopts a rule that the virtual image displayable area is divided and rear information is arranged only in the lower area, as in Patent Documents 1 and 2. is not. Therefore, it is essentially different from Patent Documents 1 and 2.
  • the size of the generated image is reduced or the perspective method is used. Even if it is possible to achieve pseudo 3D by performing "a feeling of depth (perspective feeling), processing of giving a feeling of depth” such as drawing an icon or the like, thereby achieving the above effect. Good.
  • Figure 2(C) shows an example.
  • the vehicle speed information of “55 km/h” is displayed using a three-dimensional icon. Since the three-dimensional icon is displayed by the perspective method, the virtual image SP2' of the vehicle speed display is on the far side even if the virtual image display distances of the two virtual images (SP2', BP2) are equal. It is more distant).
  • the pseudo 3D method can be used together with the method of directly changing the virtual image display distance.
  • vehicle speed information indicating the traveling speed of the vehicle
  • engine speed information indicating the traveling speed of the vehicle
  • intake pressure information hydraulic pressure information
  • fuel pressure information oil temperature information
  • water temperature information water temperature information
  • exhaust temperature information throttle opening information.
  • At least one of the intake air temperature information may be included.
  • Vehicle information such as vehicle speed, engine speed, intake pressure, oil pressure, fuel pressure, oil temperature, water temperature, exhaust temperature, throttle opening, intake temperature, etc.
  • Vehicle information is useful for the user as information indicating the running state.
  • it is provided through, for example, the instruments of the own vehicle, and has the property that it can be sensed with a sense of unity with the vehicle. Therefore, when the non-overlapping content including at least one of the exemplified information described above is displayed together with the rear information, the virtual image display control described above is performed.
  • a competitive vehicle if various vehicle information is displayed using a HUD device, it is possible to effectively display it while reducing the movement of the user's viewpoint and focus adjustment.
  • the above virtual image display control is also used, the rear information can be intuitively and quickly presented to the user.
  • the above virtual image display control is also suitable for application to competitive vehicles and the like.
  • FIG. 3A is a diagram showing an example in which the virtual image display distances of the first and second virtual images are controlled using the HUD device
  • FIG. 3B is a diagram showing a sense of depth imparted using the HUD device. It is a figure which shows an example at the time of performing a pseudo 3D display by performing a process.
  • FIG. 3A it is necessary to display a virtual image of “rear information” while a virtual image of “non-superimposed content (vehicle speed display, etc.)” is displayed, and at this time, “virtual image display distance It is assumed that display control with "change” is performed.
  • the virtual image display distance of the virtual image (first virtual image) SP1 of the non-superimposed content is "L1", and SP1 is displayed on the virtual image display surface PS1.
  • the virtual image display surface is a virtual surface provided along a direction (Y direction) perpendicular to the road surface 2 extending in the Z direction here.
  • L1 is changed to “L2 (L2>L1)”, and the virtual image display surface PS1 moves to PS2.
  • the first virtual image SP1 moves to SP2 and is controlled such that the first virtual image SP2 can be seen slightly far from the viewpoint A of the user 1.
  • the space from the viewpoint A of the user 1 to the first virtual image SP2 (in other words, the space on the user 1 side (front side) of the first virtual image SP2) is enlarged and widened.
  • a virtual image (second virtual image) BP2 of rear information is arranged in the space.
  • BP2 is displayed on the virtual image display surface PS3 at the position of the virtual image display distance L3.
  • L3 Since the third virtual image display distance “L3” is smaller than the changed first virtual image distance L2, L3 ⁇ L2. Further, “L3” may be the same as the first virtual image display distance “L1” before being changed, or may be set smaller than that (see FIG. 3A), and thus L3 ⁇ L1. Can be represented. In other words, L3 ⁇ L2 or L3 ⁇ L1.
  • the range in which the display position of the second virtual image can be arranged can be widened, and the degree of freedom in arranging the virtual image can be increased. Further, it is possible to obtain the effect of improving the perspective and further enhancing the sense of perspective by increasing the difference between the virtual image display distances of the first and second virtual images.
  • the virtual image display surface PS1 is set at the position of, for example, the first virtual image display distance (this is the standard distance) L1 as in the initial setting.
  • the virtual image display distance is not changed.
  • the virtual image SP1-D of the "non-superimposed content” and the virtual image BP-D of the "rear information" are used as the virtual image J based on the pseudo 3D image, and the user 1 can perceive the difference in the distance between the virtual images. In this way, pseudo 3D display is realized.
  • FIG. 4 is a diagram showing an example of control of a virtual image display distance (a control example for eliminating duplication in plan view) when a virtual image (virtual image display surface) is inclined with respect to a direction perpendicular to a road surface.
  • the virtual image display surfaces PS5 and PS6 are inclined at a predetermined angle (90 degrees or less) with respect to the direction (Y direction) perpendicular to the road surface 2.
  • the virtual image display surface can be tilted by tilting a part of the optical system at a predetermined angle with respect to the optical axis (described later with reference to FIG. 6).
  • the virtual image display distance can be adjusted (finely adjusted) by controlling the “image position on the display surface” during image generation.
  • the technique of finely adjusting the virtual image display distance by utilizing the inclination of the virtual image display surface may be used together with the technique of directly controlling the virtual image display distance described above. In other words, the control of the virtual image display distance can be realized by using at least one of the above two techniques.
  • a representative point (for example, the center point) is set in one virtual image, and the distance between the representative point and the user's viewpoint is the virtual image display distance.
  • the reference position is the reference point from the viewpoint A of the user 1 with the center position of the first and second virtual images SP2 and BP2 (the center position of the widths W2 and W3 in the Z direction of each virtual image) as the reference point.
  • the distance to the point is the virtual image display distance.
  • the reference point may be provided at a predetermined position on the vehicle 10. The reference points are not limited to these and should be interpreted in a broad sense.
  • the width W2 is the distance between the points Q1 and Q2
  • the width W3 is the distance between the points Q3 and Q4.
  • the virtual image display distance of the virtual image (first virtual image) SP2 of the non-superimposed content is the second virtual image display distance “L2”
  • the virtual image display distance of the virtual image (second virtual image) BP2 of the rear information is the third virtual image display distance.
  • the virtual image display distance is “L3 (L3 ⁇ L2)”.
  • L3 ⁇ L2 holds for the representative point of each virtual image.
  • the difference in distance (interval W1 in FIG. 4) is small, the ends of the virtual images that are inclined are overlapped in plan view (plan view viewed from the Y direction perpendicular to the road surface 2). In some cases (partially overlapping), it can be said that.
  • the user 1 may not be able to recognize the difference between the virtual image display distances of the virtual images SP2 and WP2 and may not be able to obtain the above effect, so that such duplication does not occur.
  • the virtual image display distances of the virtual images SP2 and BP2 are controlled. Therefore, even when the virtual image is displayed while being tilted, the above effect can be reliably obtained.
  • the second and third virtual image display distances L2 and L3 are adjusted such that a space W1 is provided between the virtual images SP2 and BP2.
  • FIG. 5A is a diagram for explaining control of the virtual image display distance using the HUD device
  • FIG. 5B is a diagram showing a configuration example of a main part of the HUD device.
  • the virtual image display distance is changed in two steps using a two-sided (two-layer) HUD device.
  • the two-plane (two-layer) HUD device 100 has three virtual image display surfaces PS1 (virtual image display distance L1), PS2 (virtual image display distance L2), and PS3 (virtual image).
  • the display distance can be set to L3).
  • the virtual image display surface PS1 is the reference surface, PS2 is the far side surface, and PS3 is the near side surface.
  • PS1 and PS2 the virtual image display distance of the vehicle speed display (expressed as "55 km/h", the code is SP1 or SP2) as non-superimposed content is switched between L1 and L2.
  • the virtual image BP2 of the rear information is displayed on the virtual image display surface PS3.
  • the virtual images SP1 and SP2 for displaying the vehicle speed are displayed light K1 projected (projected) from the two-sided (two-layer) HUD device 100 onto the projection target member (windshield, combiner, etc.) 6, and the user's 1 viewpoint (eyes). ) It is visually recognized by being incident on A. Further, the virtual image BP2 of the rear information is visually recognized when the display light K2 projected (projected) from the two-sided (two-layer) HUD device 100 onto the projection target member 6 is incident on the viewpoint (eye) A of the user 1. To be done.
  • the two-sided (two-layer) HUD device 100 includes a light source unit 25 (a laser light source 34 and an optical system 37 that divides a laser beam into two and generates and outputs two beams. And), a mirror 39, a lens 44, screens 46a and 46b as image display units, a virtual image display distance control unit 24 (including a lens drive unit 51 and a screen drive unit 53), and a mirror. 71, a reflecting mirror (concave mirror) 72, a housing 81, and a light emitting window 83.
  • the emitted light of the image Ma displayed on the image display surface 47 of the screen 46a as the image display unit generates the display light K1, and the emitted light of the image Mb displayed on the image display surface 47 of the screen 46b as the image display unit.
  • the display light K2 is generated by.
  • the virtual image display distance control unit 24 (lens driving unit 51, screen driving unit 53) causes the positions of the lens 44 and the screen 46a to be along the optical path, in other words, along the optical axis of the lens 44 (and the screen 46a). By moving, for example, the optical path length from (the surface of) the screen 46a as the image display unit to the projection target member 6 is changed, whereby the virtual image display distances L1 and L2 in FIG. , Can be switched.
  • FIG. 6A is a diagram showing an example of the main configuration of the road surface HUD device
  • FIG. 6B is a diagram showing an example of controlling the virtual image display distance by the road surface HUD device.
  • the same parts as those in FIG. 5 are designated by the same reference numerals.
  • the road surface HUD device includes a control unit (virtual image display control unit) 30 including a virtual image display distance (depth) control unit 31, an image generation unit 33, and a light projection control unit 36, and a projection unit. It has a light section 42, a screen 46 as an image display section, and a concave mirror 72.
  • the virtual image display distance (depth) control unit 31 issues a command to the image generation unit 33 to adjust the position of the image of the superimposed content or the image of the rear information.
  • the road surface superimposing HUD device includes a screen 46 that is inclined by a predetermined angle with reference to the Y direction that is a direction vertical to the road surface (vertical direction if the road surface is horizontal). ing.
  • the road surface superposition HUD device usually does not have a mechanism for moving the inclined screen 46 as an image display unit. Therefore, in this case, the virtual image display distance is changed by changing the position of the image M on the display surface 47 of the screen 46 in the direction corresponding to the Y direction (herein referred to as the vertical direction).
  • the virtual image display distance can be changed by moving the screen 46 in the direction along the optical axis P, as in the example of FIG. 5B.
  • the virtual image display distance can be changed also by moving the screen 46 and changing the position of the image M on the display surface 47.
  • K indicates display light.
  • a change in the vertical position of the image M on the display surface 47 of the inclined screen 46 is indicated by a dashed double-headed arrow.
  • the virtual image SP moves to the position of the virtual image SP′ on the virtual image display surface PS10 set on the road surface 2 shown in FIG. 6B.
  • the virtual image display distance L4 is changed to the virtual image display distance L5.
  • FIG. 7 is a figure which shows an example of the whole structure of the HUD apparatus which can control a virtual image display distance.
  • a two-sided (two-layer) HUD device is used.
  • the HUD device 100 includes mirrors 70 and 71, a concave mirror 72, screens 46 a and 46 b forming an image forming unit, a lens 44 for controlling light distribution, and a control device 301.
  • the screen 46a and the light distribution control lens 44 are movable.
  • the display light K1 is generated by the emitted light of the image Ma displayed on the image display surface 47a of the screen 46a
  • the display light K2 is generated by the emitted light of the image Mb displayed on the image display surface 47b of the screen 46b.
  • a display device such as a liquid crystal display device may be used as the image display unit.
  • the display lights K1 and K2 are projected onto the windshield 6 (in other words, an image is projected) as a member to be projected, and part of the display lights K1 and K2 are reflected by the windshield 6. , A viewpoint (eye) A of the user (driver, etc.) 1 is incident.
  • the virtual image display surfaces PS1 and PS2 can be switched.
  • the virtual image display distance of the virtual image display surface PS1 is set to the first display distance "L1”
  • PS2 is set to the second display distance "L2”
  • PS3 is set to the third display distance "L3”.
  • the control device 301 includes a virtual image display control unit 302, an image analysis unit 314, a driving scene determination unit 316, a viewpoint information acquisition unit 318, and a viewpoint position detection unit 320.
  • the virtual image display control unit 302 includes a depth feeling imparting processing unit 304, a virtual image display distance (depth) control unit 306, and a visibility determination unit 308.
  • the virtual image display control unit 302 is also a display control device which is mounted on the head-up display (HUD) device described above and is realized by using a computer.
  • the virtual image display control unit can be realized by a display control program that causes a computer to operate as the virtual image display control unit (display control device). In this case, since it can be constructed by software, realization becomes easy.
  • the image analysis unit 314 analyzes a captured image sent from a camera (for example, an infrared stereo camera) 200 that is provided in the vehicle (own vehicle) 10 and captures a real scene around the vehicle including the rear. By this analysis, when there is an object of interest (or attention) in the rear, the type and movement of the object are specified.
  • a camera for example, an infrared stereo camera
  • the driving scene determination unit 316 determines the driving scene based on the vehicle information or the like sent from the vehicle information acquisition unit 312 included in the vehicle 10. For example, in the case of the example in FIG. 2A, it is determined that the driving scene is that the vehicle is traveling on a straight road and there is an approaching rear vehicle in the rear overtaking lane.
  • the viewpoint information acquisition unit 318 acquires viewpoint information by inputting viewpoint information from a viewpoint imaging camera (pupil camera) 202 provided in the vehicle 10 (details will be described later).
  • the viewpoint position detection unit detects movement of the viewpoint of the user (driver, etc.) 1.
  • the detected viewpoint position information is sent to the visibility determination unit 308 in the virtual image display control unit 302.
  • the visibility determination unit 308 determines whether or not the user 1 can visually recognize the virtual image (second virtual image) BP2 of the rear information based on the input viewpoint position information, in other words, for example, virtual image display. It is determined whether or not the possible area 7 (see FIG. 2A) is within the visual field range of the user 1.
  • the virtual image display distance (depth) control unit 306 allows the user 1 to visually recognize the virtual image (second virtual image) BP2 of the rear information (when the virtual image displayable region 7 is within the visual field range of the user 1). ) Only, the virtual image display distance switching control is performed. It is also possible to control the virtual image display distance in multiple stages.
  • the second virtual image is visually (and psychologically) frontally utilized by utilizing the fact that the first virtual image relating to the non-superimposed content is integrally sensed with the vehicle.
  • the feature is to make them conscious of (recognize). Therefore, when the user's viewpoint is considerably deviated from the display position of the second virtual image and the second virtual image cannot be seen, the above control has no effect and is wasteful.
  • the depth sensation imparting processing unit 304 gives decoration to the original image so as to give a sense of depth (see FIG. 2C), non-superimposed content, or the like.
  • the size of each image of the rear information is appropriately changed.
  • the vehicle 10 includes a wireless communication unit 309 that wirelessly communicates with the driving support system 402, the road-vehicle communication system 404, and the like to obtain various types of information, an ECU 310, a bus BUS, and a vehicle. And an information acquisition unit (or a vehicle information input unit) 312.
  • Vehicle speed information, direction indicator information, etc. are input to the ECU 310. These pieces of information are supplied to the virtual image display control unit 302 via the driving scene determination unit 316. For example, in the driving scene shown in FIG. 2A, when the user 1 operates the turn signal to change the course to the overtaking lane, the turn signal information is used as a trigger to display the rear information. Is carried out. At this time, when the rear vehicle is approaching, the virtual image SP2 of the non-superimposed content and the virtual image BP2 of the rear information are displayed as shown in FIG. 2(A).
  • FIG. 8A is a diagram showing an example of a configuration for acquiring information on the rear of the vehicle (rear information).
  • FIG. 8B is a diagram for explaining the visual field range of the user.
  • a front imaging camera 210 and a rear imaging camera 200 are attached to the center of the roof of the vehicle 10.
  • cameras 15a and 15b are attached to the positions of the rear-view mirrors in order to image the left rear and the right rear.
  • the shaded range indicates the range in which images can be taken by the cameras 15a and 15b.
  • the left-right direction can be restated as the vehicle width direction.
  • the visual field range of the user 1 is divided into two left and right regions S1 and S2 with the traveling direction (Z direction) of the vehicle 10 as a reference.
  • ⁇ 1 is, for example, 15°.
  • the visibility determination unit 308 of FIG. 7 determines that the virtual image of the rear information is not visible when the line of sight of the user 1 deviates to the left of the region S1 (however, this is an example and is not a limitation. Not what is done).
  • FIG. 9 is a flowchart showing an example of a main operation procedure of the HUD device according to the embodiment of the present invention.
  • step S1 the necessity of displaying the vehicle rear information (rear information) is determined (step S1). If N in step 1, the process ends. In the case of Y, the line-of-sight direction (line-of-sight position) is detected (step S2), and subsequently, it is determined whether or not the second virtual image (virtual image of rear information) can be visually recognized (step S3).
  • step S3 it is determined whether or not the information presentation period for backward information has expired (step S4). If N, the process returns to step S2, and if Y, the process ends.
  • step S3 it is determined whether or not an image (virtual image) of non-superimposed content (non-superimposed information) is being displayed (step S5). If N, an image of "non-overlapping content (for example, current vehicle speed information)" is generated (step S6), and the process proceeds to step S7. If Y in step S5, subsequently, in step S7, an image of rear information is generated.
  • step S8 the virtual image display control process of the present invention (FIGS. 2 to 4, etc.) is executed. It can be said that these are processes for displaying an image that emphasizes perspective. Basically, a display is provided in which the image of the non-superimposed content is arranged on the back side and the image of the vehicle rear information is arranged on the front side.
  • the virtual image display distance control when the virtual image display distance control is performed and the non-superimposed content is being displayed, the virtual image display distance control for increasing the virtual image display distance of the image of the non-superimposed content is performed, and then the smaller virtual image display distance is performed. Displays an image of vehicle rear information.
  • the virtual image display distance of the image of the non-superimposed content generated in step S6 is set to be large, and the virtual image display distance of the image of the vehicle rear information is set. Is set small and a predetermined display process is performed.
  • pseudo 3D image processing is performed to generate an image with perspective, and predetermined display processing is performed.
  • the HUD device capable of displaying the information behind the vehicle without impairing the intuitive graspability.
  • the present invention has been described above based on the embodiments, but the present invention is not limited to these embodiments, and various modifications and applications are possible.
  • the present invention can be applied to a HUD device (multilayer 3DHUD device) that can set more virtual image display surfaces with different virtual image display distances.
  • the virtual image position change control implemented in the present invention can also be applied to a vehicle driving simulator or the like.
  • vehicle can be broadly interpreted as “vehicle” or "moving body”.
  • Virtual image display distance (depth) control unit 308... Visibility determination unit, 314... Image analysis unit, 316... Driving Scene determination unit, 318... Viewpoint information acquisition unit, 320... Viewpoint position detection unit, SP1, SP2... Vehicle speed display as non-overlapping content, BP1, BP2... Rear vehicle icon as rear information , FD... Field of view, PS1 to PS3, PS5, PS6, PS10... Virtual image display surface, L1, L2, L3... First, second and third virtual image display distances.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Optics & Photonics (AREA)
  • Chemical & Material Sciences (AREA)
  • Instrument Panels (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

La présente invention concerne un dispositif d'affichage tête haute apte à afficher des informations sur une zone à l'arrière d'un véhicule sans compromettre la facilité de compréhension intuitive. Lors de l'affichage d'une première image virtuelle SP2 qui se rapporte à des informations sur un contenu non superposé qui n'a pas besoin d'être superposé sur une scène réelle et d'une seconde image virtuelle BP2 qui se rapporte à des informations (informations arrière) sur une zone à l'arrière d'un véhicule (10), une unité de commande d'affichage d'image virtuelle (302) met en œuvre une commande pour changer la distance d'affichage d'image virtuelle d'au moins une des images virtuelles et/ou une commande pour exécuter une détection de processus de profondeur pour communiquer une sensation de profondeur, ce qui permet de commander l'affichage des première et seconde images virtuelles SP2, BP2 de telle sorte que la seconde image virtuelle BP2 qui se rapporte aux informations arrière soit vue comme étant plus proche d'un utilisateur (1) que la première image virtuelle SP2 qui se rapporte au contenu non superposé.
PCT/JP2020/006188 2019-02-21 2020-02-18 Dispositif d'affichage tête haute, dispositif de commande d'affichage et programme de commande d'affichage WO2020171045A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019-029206 2019-02-21
JP2019029206 2019-02-21

Publications (1)

Publication Number Publication Date
WO2020171045A1 true WO2020171045A1 (fr) 2020-08-27

Family

ID=72144279

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/006188 WO2020171045A1 (fr) 2019-02-21 2020-02-18 Dispositif d'affichage tête haute, dispositif de commande d'affichage et programme de commande d'affichage

Country Status (1)

Country Link
WO (1) WO2020171045A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014229997A (ja) * 2013-05-20 2014-12-08 日本精機株式会社 車両用表示装置
WO2016052186A1 (fr) * 2014-09-29 2016-04-07 矢崎総業株式会社 Dispositif d'affichage pour véhicule
JP2016210212A (ja) * 2015-04-30 2016-12-15 株式会社リコー 情報提供装置、情報提供方法及び情報提供用制御プログラム
JP2017213935A (ja) * 2016-05-30 2017-12-07 マツダ株式会社 車両用表示装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014229997A (ja) * 2013-05-20 2014-12-08 日本精機株式会社 車両用表示装置
WO2016052186A1 (fr) * 2014-09-29 2016-04-07 矢崎総業株式会社 Dispositif d'affichage pour véhicule
JP2016210212A (ja) * 2015-04-30 2016-12-15 株式会社リコー 情報提供装置、情報提供方法及び情報提供用制御プログラム
JP2017213935A (ja) * 2016-05-30 2017-12-07 マツダ株式会社 車両用表示装置

Similar Documents

Publication Publication Date Title
JP6413207B2 (ja) 車両用表示装置
WO2017138297A1 (fr) Dispositif d'affichage d'image et procédé permettant l'affichage d'image
US20160209647A1 (en) Vehicle vision system with light field monitor
JP6741029B2 (ja) 情報表示装置
JP7041851B2 (ja) ヘッドアップディスプレイ装置
JP4367212B2 (ja) 虚像表示装置およびプログラム
JP2019116229A (ja) 表示システム
CN111727399B (zh) 显示系统、移动体以及设计方法
JP2016109645A (ja) 情報提供装置、情報提供方法及び情報提供用制御プログラム
WO2022209439A1 (fr) Dispositif d'affichage d'image virtuelle
JP4929768B2 (ja) 視覚情報呈示装置及び視覚情報呈示方法
JP4682664B2 (ja) 周辺監視システム
JP2022084266A (ja) 表示制御装置、表示装置、及び画像の表示制御方法
JP2021135933A (ja) 表示方法、表示装置及び表示システム
JP2021067909A (ja) 立体表示装置及びヘッドアップディスプレイ装置
KR20180046567A (ko) 차량용 헤드 업 디스플레이 제어 장치 및 방법
WO2020171045A1 (fr) Dispositif d'affichage tête haute, dispositif de commande d'affichage et programme de commande d'affichage
JP2019083385A (ja) ヘッドアップディスプレイ装置
JP7130688B2 (ja) 車両用表示装置
JP7354846B2 (ja) ヘッドアップディスプレイ装置
JP7223283B2 (ja) 画像処理ユニット及びそれを備えるヘッドアップディスプレイ装置
JP2022083609A (ja) 表示制御装置、ヘッドアップディスプレイ装置、及び画像の表示制御方法
JPWO2020090187A1 (ja) 虚像表示装置、およびヘッドアップディスプレイ装置
JP2020158014A (ja) ヘッドアップディスプレイ装置、表示制御装置、及び表示制御プログラム
JP6726412B2 (ja) 画像表示装置、移動体、画像表示方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20758437

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20758437

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP