EP3017437A1 - Affichage d'avertissements de collision sur un visiocasque - Google Patents

Affichage d'avertissements de collision sur un visiocasque

Info

Publication number
EP3017437A1
EP3017437A1 EP14730537.9A EP14730537A EP3017437A1 EP 3017437 A1 EP3017437 A1 EP 3017437A1 EP 14730537 A EP14730537 A EP 14730537A EP 3017437 A1 EP3017437 A1 EP 3017437A1
Authority
EP
European Patent Office
Prior art keywords
data
collision
display
data glasses
warning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP14730537.9A
Other languages
German (de)
English (en)
Inventor
Felix Schwarz
Felix Lauber
Wolfgang Spiessl
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bayerische Motoren Werke AG
Original Assignee
Bayerische Motoren Werke AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bayerische Motoren Werke AG filed Critical Bayerische Motoren Werke AG
Publication of EP3017437A1 publication Critical patent/EP3017437A1/fr
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • G08G1/161—Decentralised systems, e.g. inter-vehicle communication
    • G08G1/163—Decentralised systems, e.g. inter-vehicle communication involving continuous checking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type

Definitions

  • the invention relates to a method for issuing a warning on a data bank and a device for the same purpose.
  • data glasses sometimes called head-mounted displays
  • a display which comprise a display.
  • Data glasses are worn on the head by a user similar to ordinary glasses used as a visual aid.
  • the display of the data is in the field of view of the wearer.
  • Some data glasses include a single-eye display, other data glasses include two partial displays, with each eye being associated with a partial display.
  • data glasses can comprise a semi-transparent display. Such an indication allows the wearer to recognize both displayed information and the environment behind the display. This type of display is particularly well suited for contact-analog presentation of information.
  • the information to be displayed is assigned a location in the environment of the wearer and the information is displayed assigned to this location, sometimes also referred to as a location-correct display. This can be done by an overlaying of the information about the assigned location, which is apparent to the wearer, or a representation of the information in spatial proximity to the assigned location, possibly with a symbol such as a line, in order to interpret the assigned location.
  • the information itself may also be a symbol, an image, text or the like.
  • the contact-analogous representation is sometimes called augmented reality.
  • data glasses which comprise a non-transparent display. Even with these, a contact analog representation is possible, for which a video image or at least a camera image of the environment is made, in which then the contact analog representation is incorporated, so usually the recorded image is superimposed.
  • mobile devices for data and voice communication via the mobile radio standard 3G or LTE which are often called smartphones, are widely used today.
  • Data and voice communication can also be achieved via data communica- tion according to the Bluetooth standard or via infrared connections.
  • These mobile devices are also often suitable for determining their position, for example by means of GPS, GLONASS or Galileo.
  • DE 10 2011 118 966 A1 discloses a communication device for a traffic participant, in particular for a pedestrian, in order to avoid collisions between the road user and another road user.
  • Other road users are displayed on a map on the display of the communication device and marked in color according to their degree of danger.
  • the object on which the invention is based is to improve the visibility of warnings generated by a mobile device for a road user.
  • a method for issuing a warning on a data pad comprising a display, wherein a road user carries a mobile device and carries the data pad, the mobile device is adapted for position determination and wireless data communication: determining the position of the mobile device; Detecting an imminent collision of the mobile user carrying the mobile device with another road user by the mobile device; Recognizing the direction from which the collision threatens the accompanying road user; Display a warning on the data goggles, taking into account the direction of the collision. It is therefore proposed to display the indication of a collision on the display of data glasses, depending on the direction from which the collision threatens.
  • the road user can perceive the warning regardless of his current viewing direction and whether he is looking at the display of the mobile device.
  • This form of presentation is superior to auditory or haptic indications because they are often not perceived due to road noise or lack of physical contact of the mobile device with the road user.
  • the direction-dependent display eg pointing arrow to the right gives the road user intuitive information that is important for avoiding the collision. This would not be the case with a map-based representation of the position of the hazard and the road user.
  • the warning can be particularly effective, since even with relatively late notice of the danger of a collision, this can be avoided because of its ability to change directions of movement quickly. For example, at the last moment the pedestrian can avoid stepping onto the road. The same is true to a slightly reduced extent for cyclists or inline skaters.
  • each or at least some of the road users carry a smartphone involved in a collision avoidance system.
  • the smartphones each classify their wearer as a vehicle, pedestrian, cyclist, etc. and calculate their position, their movement trajectory for the near future (for example, 1 s, 2 s, or 5 s), and optionally their position at some point in the future , These data are shared by the smartphones.
  • Smartphones of the system with each other infrastructurally and determine hereby imminent collisions.
  • the method further comprises: determining the orientation of the data glasses in comparison to the direction from which the collision threatens; Displaying the warning so that it appears to the wearer of the data glasses in the direction from which the collision threatens, provided that the display of the data glasses for the wearer of the data glasses can indicate an indication in that direction.
  • the data glasses have sensors that can determine the orientation of the data glasses. For example, a (laser) gyroscope, an inertial sensor or a compass. These sensors can be used to determine in which direction the data glasses are located in relation to the direction (from the road user) from which the collision threatens.
  • the location at which the indication on the display is displayed can be determined so as to indicate (from the road user) the direction in which danger threatens.
  • the warning may be displayed on one of the edges of the display of the data glasses, depending on the direction from which the collision threatens, provided that the display of the data glasses for the wearer of the data glasses can not indicate an indication in this direction. In such a case, therefore, the area of the field of vision of the wearer of the data glasses is not covered by the display in which the reference should be displayed. This case can also occur if the notice would have to be displayed outside the field of vision of the wearer of the data glasses.
  • the method further comprises: In response to the detection of an imminent collision: Delete the previously displayed content on the display of data glasses and displaying only the warning or covering the previously displayed content on the display of data glasses with the warning. In this way, the display is cleared and only the warning is displayed, so that the road user is not distracted by other information on the display.
  • the method further comprises: recording the orientation of the data glasses; Recognizing that the wearer of the data glasses did not notice the impending collision, based on the recorded orientation of the data glasses; Where the display of the warning is only in response to the recognition that the wearer of the data glasses did not notice the imminent collision is made. If, for example, the orientation of the data glasses was for a certain time head-on in the direction from which the collision threatens, then so can be assumed that the wearer of the data glasses has noticed the danger. It can also be concluded from movement patterns of the data glasses, that is, a quick alignment of the data glasses with the direction from which the collision threatens, that the danger has been noticed.
  • a device for issuing a warning on smart glasses comprises: a mobile device comprising means for wireless data communication, positioning and computing means; the data glasses, comprising an indicator; the apparatus being arranged to carry out one of the methods according to any one of the preceding claims.
  • Fig. 1 shows an exemplary traffic situation.
  • FIG. 2 shows the display of a data goggle for the traffic situation according to FIG. 1 according to one exemplary embodiment.
  • Fig. 1 shows an exemplary traffic situation.
  • a pedestrian 1 is at an intersection and wants to cross the street as indicated by the arrow.
  • a vehicle 2 approaches the intersection and wants to turn right, as shown by the arrow.
  • Both the pedestrian 1, ais and the driver of the vehicle 2 carry a smartphone with him, each participating in a system for collision avoidance.
  • Each smartphone determines its position using GPS and GLONASS and calculates its future trajectory for the next 2 s.
  • advanced algorithms are used for trajectory calculation.
  • each smartphone determines the risk of collision and in which direction the road user is located, with which a collision threatens, ie the direction from which the collision threatens.
  • the pedestrian 1 carries a data glasses with display (not shown in Fig. 1).
  • the data glasses include sensors with half of which the orientation of the data glasses can be determined.
  • the alignment of the data glasses is transmitted to the smartphone. This determines, based on a comparison with the direction from which a collision threatens, at which location on the display of the data glasses the indication should be displayed in order to appear to the road user in the direction from which the collision threatens, in the example 1, this reference would be displayed in a head alignment of the pedestrian 1 in the direction of movement outside the field of view (and accordingly also outside the display of the data glasses). Consequently, the indication is displayed at the edge of the display of the data glasses closest to the direction, in this case the right edge.
  • an arrow 4 on the display he data glasses 3 is displayed as an indication, as shown in Fig. 2.
  • a red dot or a red bar or the like can be displayed.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Traffic Control Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

L'invention concerne un procédé permettant de fournir un avertissement sur des lunettes à réalité augmentée, les lunettes à réalité augmentée comportant un affichage et sont portées ainsi qu'un dispositif mobile par un usager de la voie publique. Le dispositif mobile est conçu pour la détermination de la position et pour la communication de données sans fil. Ledit procédé consiste à : déterminer la position du dispositif mobile ; détecter par le dispositif mobile une collision semblant inévitable de l'usager de la voie publique portant le dispositif mobile avec un autre usager de la voie publique ; détecter la direction dans laquelle la collision semble inévitable pour l'usager de la voie publique portant le dispositif mobile ; afficher un avis de danger sur les lunettes à réalité augmentée en tenant compte de la direction dans laquelle la collision semble inévitable.
EP14730537.9A 2013-07-03 2014-06-17 Affichage d'avertissements de collision sur un visiocasque Ceased EP3017437A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102013212916.5A DE102013212916A1 (de) 2013-07-03 2013-07-03 Einblendung von Kollisionswarnungen auf einem Head-mounted Display
PCT/EP2014/062648 WO2015000693A1 (fr) 2013-07-03 2014-06-17 Affichage d'avertissements de collision sur un visiocasque

Publications (1)

Publication Number Publication Date
EP3017437A1 true EP3017437A1 (fr) 2016-05-11

Family

ID=50943322

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14730537.9A Ceased EP3017437A1 (fr) 2013-07-03 2014-06-17 Affichage d'avertissements de collision sur un visiocasque

Country Status (3)

Country Link
EP (1) EP3017437A1 (fr)
DE (1) DE102013212916A1 (fr)
WO (1) WO2015000693A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10916117B2 (en) 2017-08-24 2021-02-09 Hewlett-Packard Development Company, L.P. Collison avoidance for wearable apparatuses

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102015218947A1 (de) 2015-09-30 2017-03-30 Carl Zeiss Smart Optics Gmbh Datenbrille zur visuellen Anzeige verkehrsbedingt generierter Ereignismeldungen im Straßenverkehr
DE102017215406A1 (de) 2017-09-04 2019-03-07 Bayerische Motoren Werke Aktiengesellschaft Verfahren, mobiles Anwendergerät, Computerprogramm zum Erzeugen einer visuellen Information für zumindest einen Insassen eines Fahrzeugs
DE102019217752B4 (de) * 2019-11-18 2022-09-29 Volkswagen Aktiengesellschaft Verfahren, Computerprogramm mit Instruktionen und Vorrichtung zum Erfassen von Informationen zu einer Person
US20230054771A1 (en) * 2021-08-23 2023-02-23 Gm Cruise Holdings Llc Augmented reality for providing autonomous vehicle personnel with enhanced safety and efficiency

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100240988A1 (en) * 2009-03-19 2010-09-23 Kenneth Varga Computer-aided system for 360 degree heads up display of safety/mission critical data
US20120302289A1 (en) * 2011-05-27 2012-11-29 Kang Heejoon Mobile terminal and method of controlling operation thereof
US20120306663A1 (en) * 2011-06-01 2012-12-06 GM Global Technology Operations LLC Fast Collision Detection Technique for Connected Autonomous and Manual Vehicles
DE102011118966A1 (de) * 2011-11-19 2013-05-23 Valeo Schalter Und Sensoren Gmbh Kommunikationsgerät für einen Verkehrsteilnehmer, Kraftfahrzeug, Verfahren zur Vermeidung einer Kollision und Computerprogramm
US20130141576A1 (en) * 2011-12-01 2013-06-06 Richard T. Lord Determining threats based on information from road-based devices in a transportation-related context

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19625435A1 (de) * 1996-06-25 1998-01-02 Klaus Dr Ing Schlueter Brille mit Dateneinblendung (Datenbrille)
DE19802220A1 (de) * 1998-01-22 1999-07-29 Bosch Gmbh Robert Anzeigevorrichtung
DE19844301A1 (de) * 1998-09-17 2000-03-23 Hertz Inst Heinrich Tragbares multifunktionales Breitbandkommunikationsgerät
DE10013478A1 (de) * 2000-03-18 2001-09-20 Volkswagen Ag Fahrerassistenzsystem mit einer durchsichtigen Anzeigenfläche
DE102006029847A1 (de) * 2006-06-27 2008-01-03 Siemens Ag Nightvisionsystem
US20110080289A1 (en) * 2009-10-05 2011-04-07 Sony Ericsson Mobile Communications Ab Output device detection
US8947219B2 (en) * 2011-04-22 2015-02-03 Honda Motors Co., Ltd. Warning system with heads up display
US8223024B1 (en) * 2011-09-21 2012-07-17 Google Inc. Locking mechanism based on unnatural movement of head-mounted display
DE102013212359A1 (de) 2013-06-27 2014-12-31 Bayerische Motoren Werke Aktiengesellschaft Vorhersage von Fahrpfaden eines Fahrzeugs

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100240988A1 (en) * 2009-03-19 2010-09-23 Kenneth Varga Computer-aided system for 360 degree heads up display of safety/mission critical data
US20120302289A1 (en) * 2011-05-27 2012-11-29 Kang Heejoon Mobile terminal and method of controlling operation thereof
US20120306663A1 (en) * 2011-06-01 2012-12-06 GM Global Technology Operations LLC Fast Collision Detection Technique for Connected Autonomous and Manual Vehicles
DE102011118966A1 (de) * 2011-11-19 2013-05-23 Valeo Schalter Und Sensoren Gmbh Kommunikationsgerät für einen Verkehrsteilnehmer, Kraftfahrzeug, Verfahren zur Vermeidung einer Kollision und Computerprogramm
US20130141576A1 (en) * 2011-12-01 2013-06-06 Richard T. Lord Determining threats based on information from road-based devices in a transportation-related context

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2015000693A1 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10916117B2 (en) 2017-08-24 2021-02-09 Hewlett-Packard Development Company, L.P. Collison avoidance for wearable apparatuses

Also Published As

Publication number Publication date
DE102013212916A1 (de) 2015-01-08
WO2015000693A1 (fr) 2015-01-08

Similar Documents

Publication Publication Date Title
EP2720929B1 (fr) Procédé et dispositif pour assister un conducteur lors d'un guidage d'un véhicule sur une bande de circulation
EP3762684A1 (fr) Incrustation d'informations additionnelles sur une unité d'affichage
EP3765324B1 (fr) Procédé, dispositif et support d'enregistrement lisible par ordinateur doté d'instructions pour la commande d'un affichage d'un dispositif d'affichage à réalité augmentée pour un véhicule automobile
EP3164756B1 (fr) Localisation d'un visiocasque dans un véhicule
DE102018104801A1 (de) Unterstützen von fahrern bei fahrbahnspurwechseln
EP2986225B1 (fr) Methode permettant de determiner si l'occupant d'un vehicule a conscience des objects importants aux environs du vehicule
EP3718097A1 (fr) Procédé d'affichage du tracé d'une zone de sécurité devant un véhicule ou un objet avec une unité d'affichage, dispositif pour la mise en uvre du procédé ainsi que véhicule automobile et programme informatique
DE102017212367B4 (de) Vorrichtung zur Anzeige des Verlaufs einer Trajektorie vor einem Fahrzeug oder einem Objekt mit einer Anzeigeeinheit sowie Kraftfahrzeug
DE102012218837A1 (de) Anzeigen von Darstellungen auf einem Head-Up Display und einem Head-mounted Display
DE112015000502T5 (de) Detektion von abnormalen Verhalten in einem Fahrzeug
EP3017437A1 (fr) Affichage d'avertissements de collision sur un visiocasque
DE102014208310A1 (de) Fahrerassistenzsystem zur Darstellung einer erweiterten Realität
WO2015135621A1 (fr) Procédé et dispositif d'assistance au conducteur pendant la conduite d'un véhicule
DE102015223248A1 (de) Verfahren für ein Fahrerassistenzsystem
DE102011118966A1 (de) Kommunikationsgerät für einen Verkehrsteilnehmer, Kraftfahrzeug, Verfahren zur Vermeidung einer Kollision und Computerprogramm
DE102012213466A1 (de) Verfahren und Vorrichtung zum Überwachen eines Fahrzeuginsassens
DE102014105374B4 (de) Fahrerassistenzsystem
DE102010003851A1 (de) Verfahren und Informationssystem zum Markieren eines Zielorts für ein Fahrzeug
EP3759694A1 (fr) Procédé servant au calcul d'une incrustation à réalité augmentée d'informations supplémentaires pour un affichage sur une unité d'affichage, dispositif servant à mettre en oeuvre le procédé, ainsi que véhicule automobile et programme informatique
EP3955046A1 (fr) Procédé de fonctionnement d'un agencement d'affichage dans un véhicule automobile
DE112016005798T5 (de) Fahrzeuginternes system und verfahren zur bereitstellung von informationen in bezug auf punkte von interesse
DE102014207398A1 (de) Objektassoziation zur kontaktanalogen Anzeige auf einem HMD
DE102012220100A1 (de) Verfahren und Informationsgerät zum Darstellen von einer Fahrerinformation auf einer Blickfeldanzeige für ein Fahrzeug
WO2014095304A1 (fr) Dispositif de représentation élargie d'une zone de l'environnement d'un véhicule
DE102015222844A1 (de) Verfahren und Steuergerät zum Betreiben eines Sichtfeldanzeigegeräts für ein Fahrzeug

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20151211

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20190314

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20200921