EP3685213A1 - Procédé, dispositif et support d'enregistrement lisible par ordinateur doté d'instructions de commande d'un dispositif d'affichage d'un dispositif d'affichage tête-haute à réalité augmentée pour un véhicule - Google Patents

Procédé, dispositif et support d'enregistrement lisible par ordinateur doté d'instructions de commande d'un dispositif d'affichage d'un dispositif d'affichage tête-haute à réalité augmentée pour un véhicule

Info

Publication number
EP3685213A1
EP3685213A1 EP18759927.9A EP18759927A EP3685213A1 EP 3685213 A1 EP3685213 A1 EP 3685213A1 EP 18759927 A EP18759927 A EP 18759927A EP 3685213 A1 EP3685213 A1 EP 3685213A1
Authority
EP
European Patent Office
Prior art keywords
display
motor vehicle
augmented reality
display device
reality head
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP18759927.9A
Other languages
German (de)
English (en)
Inventor
Vitalij SADOVITCH
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Volkswagen AG
Original Assignee
Volkswagen AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Volkswagen AG filed Critical Volkswagen AG
Publication of EP3685213A1 publication Critical patent/EP3685213A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/37—Details of the operation on graphic patterns
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/213—Virtual instruments
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/23—Head-up displays [HUD]
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/166—Navigation
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/167—Vehicle dynamics information
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/177—Augmented reality
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/21—Optical features of instruments using cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/33—Illumination features
    • B60K2360/334—Projection means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/33—Illumination features
    • B60K2360/347—Optical elements for superposition of display information
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0183—Adaptation to parameters characterising the motion of the vehicle
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00—Specific applications
    • G09G2380/10—Automotive applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras

Definitions

  • a method, apparatus and computer readable storage medium having instructions for controlling a display of an augmented reality head-up display apparatus for a computer
  • the present invention relates to a method, a device and a computer-readable storage medium with instructions for controlling a display of an augmented reality head-up display device for a motor vehicle.
  • the invention further relates to a motor vehicle in which a method according to the invention or a device according to the invention is used.
  • Augmented reality is the enrichment of the real world by virtue of virtual elements that are registered in three-dimensional space in the correct location and allow real-time interaction. Augmented reality "has prevailed over the term” augmented reality "is used in the following the former.
  • HUD Head-Up-Display
  • the light rays of a built-in dashboard display are folded over several mirrors and lenses and mirrored through a projection screen in the eye of the driver so that he perceives a virtual image outside the vehicle.
  • the front screen whose curved shape must be taken into account in the illustration, often serves as the projection surface.
  • an additional disc made of glass or plastic is used in part, which is arranged between the driver and the windshield on the dashboard. Due to the optical overlay of the display and the driving scene, fewer head and eye movements are required to read the information.
  • DE 10 2014 214 516 A1 discloses a device, in particular a data glasses or a head-up display, for reproducing data in an augmented reality for an occupant of a vehicle.
  • the device is set up to display data, in particular visual media contents, in an image section of the field of view of the occupant, which currently and probably also in the future does not contain any environmental information essential for traffic around the vehicle.
  • Augmented Reality offers a wide range of possible applications to support the driver by contact-analogous marking of lanes and objects.
  • DE 10 2014 221 608 A1 describes a method for
  • the above approach ensures that the virtual image is perceived as relatively stable, but with the mandatory restriction that no contact-analogous representation occurs during larger vehicle movements.
  • Another approach to reducing the problem described is to reduce the latencies occurring by optimizing the hardware or software.
  • the tracking method can be optimized by increasing the temporal and spatial sampling rate or by synchronization methods [1].
  • Predictive Tracking [2] Late Latching [3] and Image Deflection [4] should be mentioned.
  • the approaches mentioned are associated with a significant cost.
  • a method for controlling a display of an augmented reality head-up display device for a motor vehicle comprises the steps of:
  • a computer-readable storage medium includes instructions that, when executed by a computer, cause the computer to perform the following steps to control a display of an augmented reality head-up display device for a motor vehicle:
  • a graphic generator for generating a marker for display by the
  • An augmented reality head-up display device configured to generate the tag with a dynamic design
  • An output for outputting the mark for display by the augmented reality head-up display device is provided.
  • the label is a contact analog label. Inappropriate movements of the marking are particularly noticeable in contact-analogous markings, since the user has a reference object available, for example a vehicle or traffic sign highlighted by the marking.
  • the application of the solution according to the invention is therefore particularly advantageous for contact-analogous labels.
  • the dynamic design of the marking comprises a design as a running light or a pulsation of the marking.
  • a running direction of the running light preferably corresponds to a direction of disturbing movements of
  • the marker only has a dynamic design when jamming movements of the motor vehicle are detected. Because a dynamic display can have a higher deflection potential, it is
  • the marking has a dynamic design only if the disturbing movements of the motor vehicle exceed a threshold value. In this way, too frequent a change between a static configuration of the marking and a dynamic embodiment of the marking is prevented, which could otherwise be perceived by the user as disturbing.
  • the jamming motions are around
  • Disturbing movements of the display mainly from pitching movements of the vehicle in combination with a relatively high system latency.
  • the disturbing movements of the motor vehicle are detected with an acceleration sensor or derived from a road condition. Since the latency is almost constant, the strength of the display movement can be derived directly from the vehicle movements. These can be detected relatively easily by means of a gyroscope. Movements of the vehicle body are not only excited by dynamic processes such as acceleration and braking, but also by the nature of the road surface. Therefore, preferably also an analytical evaluation of the road condition for the purpose of an intelligent application of dynamic display elements is provided.
  • the roadway condition by means of a
  • Components are used.
  • Device according to the invention in a vehicle, in particular a motor vehicle used.
  • Fig. 1 shows schematically a method for controlling a display of an augmented reality head-up display device for a motor vehicle
  • FIG. 2 shows a first embodiment of a device for controlling a display of an augmented reality head-up display device for a motor vehicle
  • Fig. 3 shows a second embodiment of a device for controlling a
  • FIG. 4 schematically illustrates a motor vehicle in which a solution according to the invention is realized
  • Fig. 5 shows schematically the general structure of a head-up display device for a motor vehicle
  • Fig. 6 shows an example of an augmented reality representation of a head-up display device
  • Fig. 7 shows a system design of the inventive solution for controlling a
  • Fig. 8 shows a first example of a dynamic embodiment of a marker
  • Fig. 9 shows a second example of a dynamic embodiment of a marker.
  • FIG. 1 schematically shows a method for controlling a display of an augmented reality head-up display device for a motor vehicle.
  • interference movements of the motor vehicle are detected 10, in particular pitching movements of the motor vehicle.
  • the disturbing movements of the motor vehicle can be detected with an acceleration sensor or derived from a road condition.
  • the road condition can be detected by means of a laser scanner or a stereo camera or removed from map material.
  • a graphics generator generates a marker for display by the augmented reality head-up display device, wherein the marker has a dynamic design.
  • the dynamic embodiment may include an embodiment as a running light or a pulsation of the marking.
  • the marking may be, for example, a contact-analogous marking.
  • the generated tag is finally displayed by the augmented reality head-up display device to a controller of the Augmented reality head-up display device output 12.
  • the mark has only a dynamic design, when jamming movements of the motor vehicle are detected. It can be provided that the interference movements must also exceed a threshold.
  • only one instruction may be issued to the controller to generate a tag with a dynamic design. It is also possible that the described method is carried out completely by the control unit of the augmented reality head-up display device.
  • FIG. 2 shows a simplified schematic representation of a first embodiment of a device 20 for controlling a display of an augmented reality head-up display device for a motor vehicle.
  • the device 20 has an input 21, via which information on movements of the motor vehicle or on a road surface can be received by a sensor system 44 or by a navigation system 45.
  • the sensor system 44 may include an acceleration sensor.
  • Movements of the motor vehicle can alternatively be derived from the road condition.
  • the sensor system 44 may comprise a laser scanner or a stereo camera for detecting the road condition.
  • Road condition can also be taken from map material.
  • the device 20 also has an analysis unit 22 for detecting jamming movements of the motor vehicle, in particular pitching movements of the motor vehicle.
  • Graphics generator 23 generates a marker for display by the augmented reality head-up display device, the marker having a dynamic design. Via an output 26 of the device 20, the generated marking is output to a control unit 42 of the augmented reality head-up display device. Alternatively, only one instruction may be output to the controller 42 to generate a tag with a dynamic design. The controller 42 may then insert the generated tag into a display of the augmented reality head-up display device.
  • the marker has a dynamic design only if jamming movements of the motor vehicle are detected. It can be provided that the interference movements must also exceed a threshold.
  • the analysis unit 22 and the graphics generator 23 can be controlled by a control unit 24. If necessary, settings of the analysis unit 22, the graphics generator 23 or the control unit 24 can be changed via a user interface 27. If required, the data accumulating in the device 20 can be stored in a memory 25 of the device 20, for example for later evaluation or for use by the components of the device 20.
  • Graphics generator 23 and the control unit 24 can be implemented as dedicated hardware, for example as integrated circuits. Of course, they may also be partially or fully combined or implemented as software running on a suitable processor, such as a GPU.
  • the input 21 and the output 26 may be implemented as separate interfaces or as a combined bidirectional interface.
  • the device 20 is a separate component. However, it can also be integrated in the control unit 42 of the augmented reality head-up display device.
  • FIG. 3 shows a simplified schematic representation of a second embodiment of a device 30 for controlling a display of an augmented reality head-up display device for a motor vehicle.
  • the device 30 has a processor 32 and a memory 31.
  • device 30 is a computer or controller.
  • instructions are stored, which cause the device 30 when executed by the processor 32, the steps according to one of
  • the processor 32 may include one or more processing units, such as microprocessors, digital signal processors, or combinations thereof.
  • the memories 25, 31 of the described embodiments can have both volatile and non-volatile memory areas and a wide variety of memory devices and
  • Storage media include, for example, hard disks, optical storage media or semiconductor memory.
  • Fig. 4 schematically illustrates a motor vehicle 40 in which a solution according to the invention is realized.
  • the motor vehicle 40 has an augmented reality head-up display device 41 with an associated control unit 42.
  • the motor vehicle 40 a device 20 for controlling a display of the augmented reality head-up display device 41 on.
  • the device 20 may also be integrated in the augmented reality head-up display device 41 or in the control device 42 of the augmented reality head-up display device 41.
  • Other components of the motor vehicle 40 include a camera 43, a sensor system 44 for detecting vehicle movements, a navigation system 45, a data transmission unit 46 and a number of
  • Data transmission unit 46 can be set up a connection to service providers, for example for retrieving map data.
  • a memory 48 is present for storage of data.
  • the data exchange between the various components of the motor vehicle 40 takes place via a network 49.
  • FIG. 5 schematically shows an augmented reality head-up display device 41 for a motor vehicle 40, with the aid of which contents can be displayed on a projection surface 52 of the motor vehicle 40, for example on the windshield or on an additional pane of glass or Plastic, which is arranged between the driver and the windshield on the dashboard.
  • the displayed contents are generated by an imaging unit 50 and projected on the projection surface 52 by means of an optical module 51.
  • the projection takes place in an area of the windshield above the steering wheel.
  • the imaging unit 50 may be, for example, an LCD TFT display.
  • the augmented reality head-up display device 41 is usually installed in a dashboard of the motor vehicle 40.
  • FIG. 6 shows an example of an augmented reality representation of an augmented reality head-up display device.
  • the actual environment is superimposed, by way of example, on a contact-analogue representation 60, which is a preceding vehicle 61 for visualizing an ACC system status (ACC: Adaptive Cruise Control;
  • FIG. 7 shows a system design of the solution according to the invention for controlling a display of an augmented reality head-up display device for a motor vehicle.
  • On Sensor system 44 transmits sensor data to the device 20 for controlling the display of the augmented reality head-up display device 41.
  • a navigation system 45 provides map data or information about
  • An analysis unit 22 detects interference movements by means of this information. Information on the occurrence of interference movements are passed on by the analysis unit 22 to a graphics generator 23, which then generates a dynamic marking. This is output to a controller 42 of the augmented reality head-up display device 41, which in turn generates the head-up display for the augmented reality head-up display device 41. Alternatively, an instruction can also be output to the control unit 42, in turn generating a dynamic marking.
  • the device 20 may also be part of the
  • Control unit 42 be.
  • Fig. 8 shows a first example of a dynamic embodiment of a marker 60.
  • the contact-analogous marker 60 of the preceding vehicle 61 is configured as a running light. Shown is the temporal evolution of the marker 60 on the basis of three consecutive times. The density of the filling of the marker 60 indicates approximately the perceptibility of the marker 60 at the corresponding position. The visibility can be controlled for example via a luminous intensity.
  • the movement of the running light is from top to bottom, i. along the z-axis of the motor vehicle. The running light thus generates a basic dynamic in the same direction in which the virtual image also moves in front of the stable background. The image movement becomes less visible.
  • FIG. 9 shows a second example of a dynamic embodiment of a marker 60.
  • the contact-analogous marker 60 of the preceding vehicle 61 is designed to be pulsating.
  • the temporal development of the mark 60 is shown on the basis of three successive times.
  • the density of the filling of the marking 60 again indicates the perceptibility of the marking 60 at the corresponding position. While dynamic is not associated with a direction of motion in this form of dynamic design, the fade-and-fade-out of the marker 60 distracts the viewer to some degree from the relative motion of the virtual image against the stable background.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Chemical & Material Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • Instrument Panels (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Traffic Control Systems (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

L'invention concerne un procédé, un dispositif et un support d'enregistrement lisible par ordinateur doté d'instructions de commande d'un affichage d'un dispositif d'affichage tête-haute à réalité augmentée pour un véhicule. Par une méthode appropriée, des mouvements perturbateurs du véhicule sont détectés (10). De plus, un générateur de graphique génère (11) un repère pour l'affichage par le dispositif d'affichage tête-haute à réalité augmentée, le repère présentant une conception dynamique. Le repère généré est finalement envoyé (12) aux fins d'affichage par le dispositif d'affichage tête-haute à réalité augmentée.
EP18759927.9A 2017-09-21 2018-08-23 Procédé, dispositif et support d'enregistrement lisible par ordinateur doté d'instructions de commande d'un dispositif d'affichage d'un dispositif d'affichage tête-haute à réalité augmentée pour un véhicule Withdrawn EP3685213A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102017216774.2A DE102017216774B4 (de) 2017-09-21 2017-09-21 Verfahren, Vorrichtung, computerlesbares Speichermedium und Kraftfahrzeug mit Instruktionen zur Steuerung einer Anzeige einer Augmented-Reality-Head-up-Display-Vorrichtung für ein Kraftfahrzeug
PCT/EP2018/072830 WO2019057439A1 (fr) 2017-09-21 2018-08-23 Procédé, dispositif et support d'enregistrement lisible par ordinateur doté d'instructions de commande d'un dispositif d'affichage d'un dispositif d'affichage tête-haute à réalité augmentée pour un véhicule

Publications (1)

Publication Number Publication Date
EP3685213A1 true EP3685213A1 (fr) 2020-07-29

Family

ID=63405210

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18759927.9A Withdrawn EP3685213A1 (fr) 2017-09-21 2018-08-23 Procédé, dispositif et support d'enregistrement lisible par ordinateur doté d'instructions de commande d'un dispositif d'affichage d'un dispositif d'affichage tête-haute à réalité augmentée pour un véhicule

Country Status (5)

Country Link
US (1) US11250816B2 (fr)
EP (1) EP3685213A1 (fr)
CN (1) CN111095078A (fr)
DE (1) DE102017216774B4 (fr)
WO (1) WO2019057439A1 (fr)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017220268B4 (de) 2017-11-14 2024-03-21 Volkswagen Aktiengesellschaft Erkennung und Visualisierung von Systemunsicherheit bei der Darstellung augmentierter Bildinhalte in Head-Up-Displays
DE102018200312B4 (de) 2018-01-10 2023-11-30 Volkswagen Aktiengesellschaft Verfahren, Vorrichtung und Computerlesbares Speichermedium mit Instruktionen zur Steuerung einer Anzeige einer Augmented-Reality-Head-Up-Display-Vorrichtung für ein Kraftfahrzeug sowie Kraftfahrzeug mit einer solchen Vorrichtung
FR3087029B1 (fr) * 2018-10-08 2022-06-24 Aptiv Tech Ltd Systeme de detection faciale d’un conducteur et methode associee
JP7196683B2 (ja) * 2019-02-25 2022-12-27 トヨタ自動車株式会社 情報処理システム、プログラム、及び制御方法
DE102019206749A1 (de) * 2019-05-09 2020-11-12 Volkswagen Aktiengesellschaft Mensch-Maschine-Interaktion in einem Kraftfahrzeug
DE102019209016A1 (de) * 2019-06-20 2020-12-24 Volkswagen Aktiengesellschaft Verfahren zur Erzeugung einer lagerichtigen Einblendung einer Zusatzinformation auf einer Anzeigeeinheit für ein Fahrzeug, Vorrichtung zur Durchführung des Verfahrens sowie Fahrzeug
DE102020209971A1 (de) 2020-08-06 2022-02-10 Volkswagen Aktiengesellschaft Intelligentes Head-Up-Display
DE102020214843A1 (de) 2020-11-26 2022-06-02 Volkswagen Aktiengesellschaft Verfahren zur Darstellung eines virtuellen Elements
WO2023150285A1 (fr) * 2022-02-04 2023-08-10 Elixirgen Therapeutics, Inc. Systèmes et méthodes de protocole de thérapie cellulaire

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6738697B2 (en) 1995-06-07 2004-05-18 Automotive Technologies International Inc. Telematics system for vehicle diagnostics
US6542077B2 (en) 1993-06-08 2003-04-01 Raymond Anthony Joao Monitoring apparatus for a vehicle and/or a premises
JPH0876050A (ja) * 1994-09-05 1996-03-22 Fujitsu Ten Ltd 車両用表示装置
JP4887980B2 (ja) * 2005-11-09 2012-02-29 日産自動車株式会社 車両用運転操作補助装置および車両用運転操作補助装置を備えた車両
CN1967147B (zh) * 2005-11-09 2011-08-17 日产自动车株式会社 车辆用驾驶操作辅助装置及具有该装置的车辆
JP4475308B2 (ja) * 2007-09-18 2010-06-09 株式会社デンソー 表示装置
US8009024B2 (en) 2008-01-25 2011-08-30 Denso Corporation Automotive display device showing virtual image spot encircling front obstacle
JP2010070066A (ja) 2008-09-18 2010-04-02 Toshiba Corp ヘッドアップディスプレイ
JP4905516B2 (ja) 2009-07-23 2012-03-28 株式会社デンソー ハイブリッド車両の駆動制御装置
JP5278292B2 (ja) * 2009-11-27 2013-09-04 株式会社デンソー 情報提示装置
US9994228B2 (en) 2010-05-14 2018-06-12 Iarmourholdings, Inc. Systems and methods for controlling a vehicle or device in response to a measured human response to a provocative environment
JP5987791B2 (ja) * 2013-06-28 2016-09-07 株式会社デンソー ヘッドアップディスプレイ及びプログラム
US20150298654A1 (en) 2013-08-19 2015-10-22 Raymond Anthony Joao Control, monitoring, and/or security, apparatus and method for premises, vehicles, and/or articles
US20170151994A1 (en) * 2013-08-28 2017-06-01 Vision Works Ip Corporation Absolute acceleration sensor for use within moving vehicles
DE102014214516A1 (de) 2014-07-24 2016-01-28 Bayerische Motoren Werke Aktiengesellschaft Vorrichtung und Verfahren zur Wiedergabe von Daten in einer erweiterten Realität für einen Insassen eines Fahrzeugs
DE102014221608A1 (de) 2014-10-24 2016-04-28 Bayerische Motoren Werke Aktiengesellschaft Aktivierung von kontaktanalogen Darstellung abhängig von Fahrzeugbewegungen
DE102014118191A1 (de) 2014-12-09 2016-06-09 Valeo Schalter Und Sensoren Gmbh Anzeigevorrichtung für ein Kraftfahrzeug mit Lagesensor, Kraftfahrzeug sowie Justageverfahren
JP6520668B2 (ja) * 2015-02-09 2019-05-29 株式会社デンソー 車両用表示制御装置及び車両用表示ユニット
JP2016159656A (ja) * 2015-02-26 2016-09-05 日本精機株式会社 車両用表示装置
EP3093194B1 (fr) * 2015-04-24 2021-09-22 Ricoh Company, Ltd. Dispositif de fourniture d'informations
KR102309316B1 (ko) 2015-06-02 2021-10-05 엘지전자 주식회사 차량용 디스플레이 장치 및 이를 구비한 차량
US20160364621A1 (en) * 2015-06-11 2016-12-15 Garmin Switzerland Gmbh Navigation device with integrated camera
KR101714185B1 (ko) 2015-08-05 2017-03-22 엘지전자 주식회사 차량 운전 보조장치 및 이를 포함하는 차량
RU2675760C1 (ru) * 2015-09-28 2018-12-24 Ниссан Мотор Ко., Лтд. Устройство отображения транспортного средства и способ отображения для транспортного средства
JP6629889B2 (ja) 2016-02-05 2020-01-15 マクセル株式会社 ヘッドアップディスプレイ装置
DE102016009667A1 (de) 2016-08-09 2017-04-06 Daimler Ag Verfahren zur Positionsbestimmung eines virtuellen Obiektes in einer Anzeige mit erweiterter Realität in einem Fahrzeug

Also Published As

Publication number Publication date
DE102017216774A1 (de) 2019-03-21
US11250816B2 (en) 2022-02-15
CN111095078A (zh) 2020-05-01
WO2019057439A1 (fr) 2019-03-28
DE102017216774B4 (de) 2019-07-04
US20210110791A1 (en) 2021-04-15

Similar Documents

Publication Publication Date Title
DE102017216774B4 (de) Verfahren, Vorrichtung, computerlesbares Speichermedium und Kraftfahrzeug mit Instruktionen zur Steuerung einer Anzeige einer Augmented-Reality-Head-up-Display-Vorrichtung für ein Kraftfahrzeug
EP3454013B1 (fr) Procédé, dispositif et support d'enregistrement lisible par ordinateur pourvu d'instructions de commande d'un affichage d'un dispositif d'affichage à réalité augmentée pour un véhicule automobile
EP3765324B1 (fr) Procédé, dispositif et support d'enregistrement lisible par ordinateur doté d'instructions pour la commande d'un affichage d'un dispositif d'affichage à réalité augmentée pour un véhicule automobile
DE102014019579B4 (de) System und Verfahren zum Betreiben einer Anzeigeeinrichtung
DE102017220268B4 (de) Erkennung und Visualisierung von Systemunsicherheit bei der Darstellung augmentierter Bildinhalte in Head-Up-Displays
DE102015109027A1 (de) Head-Up Display mit situationsbasierter Anpassung der Darstellung von virtuellen Bildinhalten
WO2019057452A1 (fr) Procédé, dispositif et support de mémoire lisible par un ordinateur pourvu d'instructions de commande d'un affichage d'un dispositif d'affichage à tête haute en réalité augmentée pour un véhicule automobile
DE102018201768B4 (de) Verfahren zum Anzeigen von Informationen in einem Head-Up-Display eines Fahrzeugs, Anzeigesystem für ein Fahrzeug und Fahrzeug mit einem Anzeigesystem
WO2019233687A1 (fr) Concept pour fournir des valeurs de correction pour l'affichage de contenus à réalité augmentée sur un affichage tête haute pour un véhicule automobile
EP3922501A1 (fr) Commande d'un affichage d'un dispositif d'affichage tête haute de réalité augmentée pour un moyen de déplacement
EP3983252A1 (fr) Génération d'un affichage pour un affichage tête haute à réalité augmentée d'un véhicule à moteur
DE102015222844A1 (de) Verfahren und Steuergerät zum Betreiben eines Sichtfeldanzeigegeräts für ein Fahrzeug
DE102012220100A1 (de) Verfahren und Informationsgerät zum Darstellen von einer Fahrerinformation auf einer Blickfeldanzeige für ein Fahrzeug
EP3749541A1 (fr) Procédé, dispositif et support d'enregistrement lisible par ordinateur doté d'instructions pour la commande d'un affichage d'un dispositif d'affichage tête haute à réalité augmentée d'un véhicule à moteur
DE102020212412B3 (de) Verfahren zum Betreiben einer Head-Up-Displayeinrichtung und Head-Up-Displayeinrichtung
EP3361355A1 (fr) Procédé, dispositif et support d'enregistrement lisible par ordinateur pourvu d'instructions de commande d'un écran d'affichage tête haute en réalité augmentée
EP3296795A1 (fr) Procédé d'affichage d'un objet image dans un véhicule sur des affichages perçus intérieur et extérieur du véhicule
EP3959647B1 (fr) Insertion à la position correcte d'une information supplémentaire sur une unité d'affichage d'un véhicule
EP4005894A1 (fr) Procédé de représentation d'un élément virtuel
WO2020249367A1 (fr) Commande d'un affichage d'un dispositif d'affichage tête haute à réalité augmentée pour un véhicule automobile
DE102018200312B4 (de) Verfahren, Vorrichtung und Computerlesbares Speichermedium mit Instruktionen zur Steuerung einer Anzeige einer Augmented-Reality-Head-Up-Display-Vorrichtung für ein Kraftfahrzeug sowie Kraftfahrzeug mit einer solchen Vorrichtung
DE102017215023B4 (de) Verfahren, Vorrichtung und computerlesbares Speichermedium mit Instruktionen zum Bereitstellen von Informationen zur Steuerung einer Anzeige einer Head-Up-Display-Vorrichtung für ein Kraftfahrzeug, sowie zugehöriges System zur Steuerung und Kraftfahrzeug damit
DE102017215024A1 (de) Verfahren, Vorrichtung und computerlesbares Speichermedium mit Instruktionen zum Bereitstellen von Informationen für eine Head-Up-Display-Vorrichtung für ein Kraftfahrzeug
DE102015006105A1 (de) Verfahren und Vorrichtung zur bildlichen Darstellung statischer Inhalte
WO2023093952A1 (fr) Procédé, programme informatique et appareil de commande d'un dispositif d'affichage à réalité augmentée

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200421

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20210520

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20220714

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20221125