WO2011051009A1 - System for providing notification of positional information - Google Patents

System for providing notification of positional information Download PDF

Info

Publication number
WO2011051009A1
WO2011051009A1 PCT/EP2010/062178 EP2010062178W WO2011051009A1 WO 2011051009 A1 WO2011051009 A1 WO 2011051009A1 EP 2010062178 W EP2010062178 W EP 2010062178W WO 2011051009 A1 WO2011051009 A1 WO 2011051009A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
user
data
notification
orientation
Prior art date
Application number
PCT/EP2010/062178
Other languages
German (de)
French (fr)
Inventor
Roland Haring
Original Assignee
Siemens Aktiengesellschaft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Aktiengesellschaft filed Critical Siemens Aktiengesellschaft
Priority to CN2010800484283A priority Critical patent/CN102573542A/en
Priority to EP10749628A priority patent/EP2493344A1/en
Publication of WO2011051009A1 publication Critical patent/WO2011051009A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/033—Headphones for stereophonic communication
    • A—HUMAN NECESSITIES
    • A42—HEADWEAR
    • A42B—HATS; HEAD COVERINGS
    • A42B3/00—Helmets; Helmet covers ; Other protective head coverings
    • A42B3/04—Parts, details or accessories of helmets
    • A42B3/30—Mounting radio sets or communication systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/07—Use of position data from wide-area or local-area positioning systems in hearing devices, e.g. program or information selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2460/00—Details of hearing devices, i.e. of ear- or headphones covered by H04R1/10 or H04R5/033 but not provided for in any of their subgroups, or of hearing aids covered by H04R25/00 but not provided for in any of its subgroups
    • H04R2460/13—Hearing devices using bone conduction transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Definitions

  • the invention relates to a system for the notification or announcement of located information, that is to say information which is assigned to a specific location or can be addressed by it.
  • the invention described here mainly relates to
  • Location-based services as a mobile, location-based Informa ⁇ tion services that provide selective information on mobile devices, such as. PDA, Tablet PC or mobile phone, with the help of position-, time- and person-dependent data to the end user.
  • mobile devices such as. PDA, Tablet PC or mobile phone
  • Notiquessmecha ⁇ mechanisms are the requirements of a mobile, and constantly changing environmental factors, such as. Noise, light, danger zones, protective clothing, etc., exposed user not fair. Disturb or hinder beyond previous Noti ⁇ fikationstechnologien the user and his environment into his workflow.
  • An auditive notification is done so far by means of warning or advisory tone through the loudspeaker of a terminal.
  • the disadvantages here are that a reasonable volume and intelligibility depending on ambient noise, the distance of the speaker to the ear and the attenuation of Clothes etc. is. Too soft notification can either be overheard or not understood. Too loud NOTIFi ⁇ cation is perceived by the user or his environment as annoying and intrusive. While wearing earphones and headphones allows a perfect and looking Au ⁇ diowiedergabe, but poses a security risk because ⁇ To dicasge Hursche can no longer be adequately perceived. Information about spatial proximity / distance or
  • Direction for information can in turn not be sufficiently conveyed through speakers on a mobile device.
  • a visual notification has so far taken place by means of a message on a display.
  • the disadvantage here is that the terminal is not always in the field of view of the user or that reading the display in many situations endangers the safety of the user, such as Gabelstaplerfah ⁇ rer in a warehouse, on a scaffolding, etc.
  • a notification in the form of a vibration alarm, ie with ⁇ means of vibration of the terminal, has the disadvantage that vibration is only noticeable when the terminal is worn by the user directly on the body or under protective and working clothes. Information about spatial proximity / distance or direction for information can not be conveyed herewith.
  • AR augmented reality
  • Bone sound refers to the transmission of sound vibrations or vibrations through the skull bone surrounding the auditory organ, bypassing the middle ear. By attaching two speakers directly to the skull bone tones can be stereoscopically reproduced. This achieves a spatial perception effect.
  • stereoscopic bone sound compare Walker et al .: Evaluation of bone conduction headsets for use in multitalk communication environments.
  • the SWAN System for Wearable Audio Navigation
  • the system is designed to guide people through auditory information generated in real time based on sensor data. It uses visual sensor information from four head mounted cameras to generate auditory signals. Essentially, an attempt is made to replace a non-existent or impaired body sense, that is, seeing here, with another, ie hearing here.
  • the object underlying the invention now consists in ⁇ specify a system for the notification of localized information, in which the above-mentioned disadvantages are avoided as possible.
  • the invention consists essentially in a protective helmet to expand bone sound speakers and directional sensors, so that the carrier via auditory signals spatially directed - relative to the orientation of the skull - verorte ⁇ te information in his environment can be pointed.
  • the user notification is via Various ⁇ ne contextual in real time from the position of Benut ⁇ dec, the orientation of his head as well as the position of the information calculated auditory signals which are output through this bone ⁇ chenschalllaut Maschinener, wherein the perceived sound source while the position the information ent ⁇ speaks.
  • a PDA, Tablet PC or portable computer with him he shall be notified in different ways to a än ⁇ -reducing state of the software or system.
  • the signal for the notification can be inde ⁇ gig perceived by ambient noise.
  • the invention is expected to find its main application in the domains of Location Based Services, Augmented Reality, Human Machine Interfaces (HMI) and Industry.
  • HMI Human Machine Interfaces
  • FIG. 1 shows a diagram for explaining the invention with regard to the position of the loudspeakers and the direction sensor in a protective helmet
  • Figure 2 is a schematic representation of the inventive one embodiment of the overall system and Figure 3 is a schematic diagram for explaining the notification using the example of a control system.
  • Figure 1 shows in two views a conventional protective helmet with three cross straps and an adjustable peripheral belt.
  • a bone sound loudspeaker unit L is provided in each case in the area above the ears of the protective helmet wearer on the left and right in the adjustable peripheral belt
  • a directional sensor RS is installed in the area between the helmet roof and the transverse belts.
  • the direction sensor RS includes a digital compass and a tilt sensor and provides the aid of the earth magnetic field ⁇ the alignment of the helmet.
  • the inclination sensor is necessary, since otherwise the orientation of the head can not be calculated unambiguously from the measured geomagnetic field.
  • FIG. 2 shows a schematic representation of an exporting ⁇ approximately example of the overall system according to the invention with a helmet typical arrangement of the Knochenschall- speaker units L and the direction sensor are connected either via a cable or via radio RS with a wearable computer unit D, wherein Knochenschall- speaker units L in the case of a radio link includes a radio receiver and an amplifier or these components are also housed between the helmet roof and the cross straps. From the direction sensor RS, sensor data thus arrive at the arithmetic unit D and 2-channel audio data 2 to the bone sound loudspeaker units L.
  • the arithmetic unit D may be a mobile phone, a PDA (Personal Digital Assistant) or even a Wrist Computing Device worn on the wrist or in the
  • the arithmetic unit D has to fulfill the following tasks:
  • further information about the audio signal is transmitted in addition to the direction to a localized information.
  • the distance to an information is not only about the volume of the audio signal, especially in the industrial environment with corresponding environmental noise is not effective, but also on the pitch or the frequency of a repeating signal, that is analogous to a Geiger counter, shown.
  • various categories of Informationska ⁇ such as warnings, virtual barriers or general information, different sound patterns are zugeord ⁇ net.
  • the user can be directed to a specific point in the room or even be kept away with warnings from restricted areas / danger areas.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)
  • Navigation (AREA)
  • Emergency Alarm Devices (AREA)
  • Helmets And Other Head Coverings (AREA)
  • Alarm Systems (AREA)

Abstract

The invention substantially consists of improving a safety helmet around bone conduction speakers and directional sensors such that the carrier can be alerted of positional information in the surroundings thereof via spatially directed auditive signals - relative to the orientation of the scull. The notification of the user is carried out via different context-dependent auditive signals calculated in real time from the position of the user, the orientation of the head and the position of the information, these signals being output via said bone conduction speakers, wherein the perceived sound source equals the position of the information. Depending on whether the user carries a mobile phone, a PDA, table PC or other handheld computer, the user is notified in different ways about a changing state of the software or the system. The bone conduction transmission ensures that the notification signal can be perceived independently of ambient noise. The invention is intended to be mainly used in the domains of location based services, augmented reality, human machine interface (HMI) and industry.

Description

Beschreibung description
System zur Notifikation verorteter Information Die Erfindung betrifft ein System zur Notifikation bzw. Bekanntmachung verorteter Information, also Informationen, die einem bestimmten Ort zugewiesen sind bzw. durch diesen adressierbar sind. Die hier beschriebene Erfindung bezieht sich vor allem aufThe invention relates to a system for the notification or announcement of located information, that is to say information which is assigned to a specific location or can be addressed by it. The invention described here mainly relates to
Location Based Services als mobile, standortbezogene Informa¬ tionsdienste, die unter Zuhilfenahme von positions-, zeit- und personenabhängigen Daten dem Endbenutzer selektive Informationen auf mobilen Endgeräten, wie bspw. PDA, Tablet PC oder Handy, bereitstellen. Solche Informationen können etwaLocation-based services as a mobile, location-based Informa ¬ tion services that provide selective information on mobile devices, such as. PDA, Tablet PC or mobile phone, with the help of position-, time- and person-dependent data to the end user. Such information can be about
Benutzerhandbücher zu komplexen Anlagen, Wartungsauf-träge zu Maschinen, Pläne oder auch Warnhinweise sein, die erst am mo¬ bilen Endgerät sichtbar werden, wenn man sich tatsächlich in deren Nähe befindet. Denkbare Einsatzgebiete einer solchen Technologie sind neben Großindustrieanlagen, auch Baustellen, Bergwerke, usw. User manuals for complex systems, maintenance orders for machines, plans or even warnings that only become visible on the mo ¬ bile terminal when you are actually in their vicinity. Conceivable applications of such technology are in addition to large-scale industrial plants, construction sites, mines, etc.
Aufgrund des sich ändernden Position bzw. des zeitlichen und räumlichen Kontexts des Endbenutzers ist es notwendig, diesen über die neue und aktualisierte Informationen in seinem Umfeld zu notifizieren. Zurzeit angewendete Notifikationsmecha¬ nismen werden den Anforderungen eines mobilen, sowie ständig wechselnden Umwelteinflüssen, wie bspw. Lärm, Licht, Gefahrenzonen, Schutzkleidung usw., ausgesetzten Anwenders nicht gerecht. Darüber hinaus stören oder behindern bisherige Noti¬ fikationstechnologien den Anwender und sein Umfeld in seinem Arbeitsablauf . Due to the changing position or the temporal and spatial context of the end user, it is necessary to notify the user about the new and updated information in his environment. Currently applied Notifikationsmecha ¬ mechanisms are the requirements of a mobile, and constantly changing environmental factors, such as. Noise, light, danger zones, protective clothing, etc., exposed user not fair. Disturb or hinder beyond previous Noti ¬ fikationstechnologien the user and his environment into his workflow.
Eine auditive Notifikation erfolgt bislang mittels Warn- oder Hinweiston über Lautsprecher eines Endgeräts. Die Nachteile bestehen hierbei darin, dass eine angemessene Lautstärke und Verständlichkeit abhängig von Umgebungsgeräuschen, der Entfernung des Lautsprechers zum Ohr sowie der Dämpfung durch Kleidung usw. ist. Eine zu leise Notifikation kann entweder überhört, oder nicht verstanden werden. Eine zu laute Notifi¬ kation wird vom dem Anwender oder seinem Umfeld als störend und aufdringlich empfunden. Das Tragen von Kopfhörern oder Headsets ermöglicht zwar eine einwandfreie und gerichtete Au¬ diowiedergabe, stellt aber ein Sicherheitsrisiko dar, da Um¬ gebungsgeräusche nicht mehr ausreichend wahrgenommen werden können. Information über räumliche Nähe/ Entfernung bzw. An auditive notification is done so far by means of warning or advisory tone through the loudspeaker of a terminal. The disadvantages here are that a reasonable volume and intelligibility depending on ambient noise, the distance of the speaker to the ear and the attenuation of Clothes etc. is. Too soft notification can either be overheard or not understood. Too loud NOTIFi ¬ cation is perceived by the user or his environment as annoying and intrusive. While wearing earphones and headphones allows a perfect and looking Au ¬ diowiedergabe, but poses a security risk because ¬ To gebungsgeräusche can no longer be adequately perceived. Information about spatial proximity / distance or
Richtung zur Information kann wiederum über Lautsprecher an einem mobilen Geräte nicht ausreichend vermittelt werden. Direction for information can in turn not be sufficiently conveyed through speakers on a mobile device.
Eine visuelle Notifikation erfolgt bisher mittels einer Nachricht auf einem Display. Nachteilig ist hierbei, dass sich das Endgerät nicht immer im Sichtfeld des Benutzers befindet bzw. dass das Lesen des Displays in vielen Situationen die Sicherheit des Anwenders gefährdet, etwa als Gabelstaplerfah¬ rer in einer Lagerhalle, auf einem Baugerüst, etc. A visual notification has so far taken place by means of a message on a display. The disadvantage here is that the terminal is not always in the field of view of the user or that reading the display in many situations endangers the safety of the user, such as Gabelstaplerfah ¬ rer in a warehouse, on a scaffolding, etc.
Eine Notifikation in Form eines Vibrationsalarms, also mit¬ tels Vibration des Endgeräts, hat den Nachteil, dass eine Vibration nur spürbar ist, wenn Endgerät vom Anwender unmittelbar am Körper oder unter Schutz- bzw. Arbeitskleidung getragen wird. Information über räumliche Nähe/Entfernung bzw. Richtung zur Information kann hiermit nicht vermittelt werden . A notification in the form of a vibration alarm, ie with ¬ means of vibration of the terminal, has the disadvantage that vibration is only noticeable when the terminal is worn by the user directly on the body or under protective and working clothes. Information about spatial proximity / distance or direction for information can not be conveyed herewith.
Bei der Visualisierung innerhalb von Augmented Reality (AR) Displays, also wenn entweder in dem Bild einer Videokamera zusätzliche Information zu sichtbaren Objekten angezeigt oder mithilfe von speziellen See-Through Displays der Blick auf die Realität direkt augmentiert wird, tritt nachteiliger Wei¬ se eine physische und visuelle Einschränkung durch Tra¬ gen/Benutzen eines AR Displays auf. In the visualization within augmented reality (AR) displays, so if displayed additional information on visible objects either in the image of a video camera or by using special see-through displays of view of reality is augmented directly enters adverse Wei ¬ se a physical and visual restriction by tracing / using an AR display.
Wenn eine Luftschallübertragung nicht möglich oder zweckmäßig ist, wird zur Übertragung von Schall häufig Knochenschall eingesetzt. Dies ist etwa der Fall, wenn ein Gehörschutz ge¬ tragen wird oder aber auch bei Einsätzen unter Wasser sowie wenn es notwendig ist auch Umgebungsgeräusche einwandfrei wahrzunehmen. Bei Schwerhörigen mit einer Schädigung des Mittelohrs finden entsprechende Hörgeräte ebenfalls Einsatz. Knochenschall bezeichnet die Weiterleitung von Schall- Schwingungen bzw. Vibrationen durch den das Gehörorgan umgebenden Schädelknochen unter Umgehung des Mittelohrs. Durch das Anbringen von zwei Lautsprechern direkt am Schädelknochen können Töne stereoskopisch wiedergegeben werden. Damit wird ein räumlicher Wahrnehmungseffekt erreicht. Zum Einsatz von stereoskopischen Knochenschall vergleiche insbesondere Walker et.al.: Evaluation of bone-conduction headsets for use in multitalker communication environments . If airborne sound transmission is not possible or appropriate, bone sound is often used to transmit sound. This is the case when a hearing protection is ge ¬ wear, or also when operating in water, and if it is necessary to also perceive ambient noise properly. In the hearing impaired with damage to the middle ear, appropriate hearing aids are also used. Bone sound refers to the transmission of sound vibrations or vibrations through the skull bone surrounding the auditory organ, bypassing the middle ear. By attaching two speakers directly to the skull bone tones can be stereoscopically reproduced. This achieves a spatial perception effect. For the use of stereoscopic bone sound compare Walker et al .: Evaluation of bone conduction headsets for use in multitalk communication environments.
1ht.tp : / ,/sonify .psych . gatech . edu/publications/pdfs/2005HFE5- WalkerStanleylyer . df 1 ht.tp: /, / sonify .psych. gatech. edu / publications / pdfs / 2005HFE5- WalkerStanleylyer. df
Darüber hinausgehend wurde am Georgia Institute of Technology das SWAN (System for Wearable Audio Navigation) System entwickelt. Dabei handelt es sich um ein prototypisches, auditives Guidance System für blinde bzw. visuell eingeschränkte Perso- nen, wie z.B. Feuerwehrleute im Rauch. Das System ist dafür ausgelegt Personen durch auditive Informationen, die Echtzeit aufgrund von Sensordaten generiert werden, zu führen. Dazu werden visuelle Sensorinformationen von vier am Kopf montierten Kameras genutzt, um auditive Signale zu erzeugen. Im We- sentlichen wird versucht einen nicht vorhandenen oder beeinträchtigten Körpersinn, also hier Sehen, durch einen anderen, also hier Hören, zu ersetzen. In addition, the SWAN (System for Wearable Audio Navigation) system was developed at the Georgia Institute of Technology. It is a prototypical auditory guidance system for blind or visually impaired persons, such as Firefighters in the smoke. The system is designed to guide people through auditory information generated in real time based on sensor data. It uses visual sensor information from four head mounted cameras to generate auditory signals. Essentially, an attempt is made to replace a non-existent or impaired body sense, that is, seeing here, with another, ie hearing here.
http : / ,/sonify .psych . gatech . edu/publications/pdfs/2005ICAD- WalkerLindsay . pdf http: /, / sonify .psych. gatech. edu / publications / pdfs / 2005ICAD- WalkerLindsay. pdf
Die der Erfindung zu Grunde liegende Aufgabe besteht nun dar¬ in, ein System zur Notifikation verorteter Information anzugeben, bei dem die oben genannten Nachteile möglichst vermieden werden. The object underlying the invention now consists in ¬ specify a system for the notification of localized information, in which the above-mentioned disadvantages are avoided as possible.
Diese Aufgabe wird durch die Merkmale des Patentanspruchs 1 erfindungsgemäß gelöst. Die weiteren Ansprüche betreffen be¬ vorzugte Ausgestaltungen der Erfindung. Die Erfindung besteht im Wesentlichen darin einen Schutzhelm um Knochenschalllautsprecher und Richtungssensoren zu erweitern, sodass der Träger über auditive Signale räumlich ge- richtet - relativ zur Ausrichtung des Schädels - auf verorte¬ te Informationen in seinem Umfeld hingewiesen werden kann. Die Notifikation des Benutzers erfolgt dabei über verschiede¬ ne kontextabhängige in Echtzeit aus der Position des Benut¬ zers, die Orientierung seines Kopfes sowie der Position der Information berechnete auditive Signale, die über diese Kno¬ chenschalllautsprecher ausgegeben werden, wobei die wahrgenommene Schallquelle dabei der Position der Information ent¬ spricht. Je nachdem ob der Anwender ein Mobiltelefon, einen PDA, Tablet PC oder sonstigen tragbaren Computer mit sich führt, wird er auf unterschiedliche Weise über einen sich än¬ dernden Zustand der Software oder des Systems notifiziert. Durch die Knochenschallübertragung This object is achieved by the features of claim 1 according to the invention. The other claims relate to ¬ preferred embodiments of the invention. The invention consists essentially in a protective helmet to expand bone sound speakers and directional sensors, so that the carrier via auditory signals spatially directed - relative to the orientation of the skull - verorte ¬ te information in his environment can be pointed. The user notification is via Various ¬ ne contextual in real time from the position of Benut ¬ dec, the orientation of his head as well as the position of the information calculated auditory signals which are output through this bone ¬ chenschalllautsprecher, wherein the perceived sound source while the position the information ent ¬ speaks. Depending on whether the user performs a mobile phone, a PDA, Tablet PC or portable computer with him, he shall be notified in different ways to a än ¬-reducing state of the software or system. By the bone sound transmission
ist gewährleistet, dass das Signal zur Notifikation unabhän¬ gig von Umgebungsgeräuschen wahrgenommen werden kann. it is ensured that the signal for the notification can be inde ¬ gig perceived by ambient noise.
Die Erfindung findet voraussichtlich in den Domänen Location Based Services, Augmented Reality, Mensch Maschine Interfaces (HMI) und Industrie ihre Hauptanwendung. The invention is expected to find its main application in the domains of Location Based Services, Augmented Reality, Human Machine Interfaces (HMI) and Industry.
Nachfolgend wird die Erfindung anhand von in der Zeichnung dargestellten Ausführungsbeispielen näher erläutert. The invention will be explained in more detail with reference to embodiments shown in the drawing.
Dabei zeigt It shows
Figur 1 eine Darstellung zur Erläuterung der Erfindung bezüglich der Lage der Lautsprecher und des Richtungssensor in einem Schutzhelm, FIG. 1 shows a diagram for explaining the invention with regard to the position of the loudspeakers and the direction sensor in a protective helmet,
Figur 2 eine schematische Darstellung des erfindungsgemäßen eines Ausführungsbeispiels des Gesamtsystems und Figur 3 eine Prinzipdarstellung zur Erläuterung der Notifikation am Beispiel einer Steuerungsanlage. Figur 1 zeigt in zwei Ansichten einen üblichen Schutzhelm mit drei Quergurten und einem einstellbaren Umfangsgurt. Erfindungsgemäß ist im Bereich oberhalb der Ohren Schutzhelmträ- gers links und rechts im einstellbaren Umfangsgurt jeweils ein Knochenschall-Lautsprechereinheiten L und im Bereich zwischen dem Helmdach und den Quergurten ist ein Richtungssensor RS eingebaut. Der Richtungssensor RS enthält einen Digitalkompass und einen Neigungssensor und stellt unter Zuhilfenahme des Erdmagnet¬ feldes die Ausrichtung des Helmes fest. Der Neigungssensor ist notwendig, da ansonsten aus dem gemessenen Erdmagnetfeld nicht eindeutig die Ausrichtung des Kopfes errechenbar ist. Figure 2 is a schematic representation of the inventive one embodiment of the overall system and Figure 3 is a schematic diagram for explaining the notification using the example of a control system. Figure 1 shows in two views a conventional protective helmet with three cross straps and an adjustable peripheral belt. According to the invention, a bone sound loudspeaker unit L is provided in each case in the area above the ears of the protective helmet wearer on the left and right in the adjustable peripheral belt, and a directional sensor RS is installed in the area between the helmet roof and the transverse belts. The direction sensor RS includes a digital compass and a tilt sensor and provides the aid of the earth magnetic field ¬ the alignment of the helmet. The inclination sensor is necessary, since otherwise the orientation of the head can not be calculated unambiguously from the measured geomagnetic field.
Mittels der Knochenschalllautsprecher, die direkt am Schädel getragen werden, ist es möglich dem Anwender räumlich über ortsgebundene Informationen in seinem Umfeld zu informieren. Figur 2 zeigt eine schematische Darstellung eines Ausfüh¬ rungsbeispiels des erfindungsgemäßen Gesamtsystems mit einer helmtypischen Anordnung aus den Knochenschall- Lautsprechereinheiten L und dem Richtungssensor RS die mit einer am Körper tragbaren Recheneinheit D entweder über ein Kabel oder über Funk verbunden sind, wobei Knochenschall- Lautsprechereinheiten L im Falle einer Funkverbindung einen Funkempfänger und eine Verstärker miteinschließt oder diese Komponenten auch zwischen dem Helmdach und den Quergurten untergebracht sind. Vom Richtungssensor RS gelangen so Sensor- daten zu Recheneinheit D und 2-Kanal-Audiodaten 2 zu den Knochenschall-Lautsprechereinheiten L . By means of the bone sound speakers, which are worn directly on the skull, it is possible to spatially inform the user about local information in his environment. Figure 2 shows a schematic representation of an exporting ¬ approximately example of the overall system according to the invention with a helmet typical arrangement of the Knochenschall- speaker units L and the direction sensor are connected either via a cable or via radio RS with a wearable computer unit D, wherein Knochenschall- speaker units L in the case of a radio link includes a radio receiver and an amplifier or these components are also housed between the helmet roof and the cross straps. From the direction sensor RS, sensor data thus arrive at the arithmetic unit D and 2-channel audio data 2 to the bone sound loudspeaker units L.
Bei der Recheneinheit D kann es sich um ein Mobiltelefon, einen PDA (Personal Digital Assistant) oder auch um eine am Armgelenk getragene (Wrist Computing Device) bzw. in derThe arithmetic unit D may be a mobile phone, a PDA (Personal Digital Assistant) or even a Wrist Computing Device worn on the wrist or in the
Kleidung eingearbeitete (Wearable Computing Device) Einrich¬ tung handeln. Die Recheneinheit D hat dabei folgende Aufgaben zu erfüllen: Clothes act incorporated (Wearable Computing Device) Einrich ¬ tung. The arithmetic unit D has to fulfill the following tasks:
• Ermitteln der absoluten Position des Benutzers, z. B. im Freien mittels GPS-Daten 4 oder in Gebäuden mit WLAN• Determine the absolute position of the user, eg. For example, outdoors using GPS data 4 or in buildings with Wi-Fi
Triangulation triangulation
• Auslesen des Richtungssensors, also Neigung und Kompass, im Schutzhelm  • Reading the direction sensor, so tilt and compass, in the helmet
• Errechnen der tatsächlichen absoluten Ausrichtung des Kopfes  • Calculate the actual absolute orientation of the head
• Beziehen von Daten 3 für verortete Informationen über eine Datenfunkverbindung zu einem Geoinformationssystem, etwa über UMTS oder WLAN  Obtaining data 3 for localized information via a data radio connection to a geoinformation system, for example via UMTS or WLAN
• Anzeigen von verorteten Informationen wie bspw. Dokumen- ten und Karten am Display  • Display of localized information such as documents and maps on the display
• Interaktion des Benutzers etwa über Touchdisplay, z. B. eine Bestätigung von Meldungen, ein Abrufen von Information  • User interaction, eg via touch display, eg. As confirmation of messages, retrieval of information
• Ausgeben eines Stereo-Audiosignals an die Knochenschall- Lautsprechereinheiten L im Schutzhelm. Ggf. ist noch eine Audioverstärker-Einheit vorzuschalten, da Knochen¬ schallautsprecher einen 40 bis 50 dB höheren Audiopegel als Luftschallautsprecher benötigen. • Output a stereo audio signal to the bone sound speaker units L in the helmet. Possibly. is still an audio amplifier unit vorzuschalten because bone ¬ loudspeakers need a 40 to 50 dB higher audio level than airborne loudspeakers.
• Erzeugung des Audiosignals. Dieses wird abhängig von der Position des Benutzers und der Ausrichtung seines Kopfes in Echtzeit relativ zu der virtuellen Soundquelle am Ort der zu notifizierenden verorteten Information räumlich richtig berechnet. Mit Hilfe dieses generierten 3D Audio Sounds wird die Orientierung des Trägers gewährleistet.  • Generation of the audio signal. This is spatially correctly calculated depending on the position of the user and the orientation of his head in real time relative to the virtual sound source at the location of the located information to be notified. This generated 3D audio sound ensures the orientation of the wearer.
Diese Signale werden in Echtzeit berechnet, um einen räumlich richtig wahrgenommenen Audioeindruck zu erzeugen. These signals are calculated in real time to produce a spatially correctly perceived audio impression.
Optional werden neben der Richtung zu einer verorteten Infor- mation noch weitere Informationen über das Audiosignal übertragen. So wird beispielsweise die Entfernung zu einer Information nicht nur über die Lautstärke des Audiosignals, was v. a. im industriellen Umfeld mit entsprechendem Umgebungslärm nicht zielführend ist, sondern auch über dessen Tonhöhe oder die Frequenz eines sich wiederholenden Signals, also analog zu einem Geigerzähler, dargestellt. Darüber hinaus werden optional verschiedenen Informationska¬ tegorien, wie etwa Warnhinweise, virtuelle Absperrungen oder allgemeine Informationen, verschiedene Soundmuster zugeord¬ net . Exemplarisch sind im Folgenden noch einige vorteilhafte Anwendungsbeispiele der Erfindung dargestellt: Optionally, further information about the audio signal is transmitted in addition to the direction to a localized information. For example, the distance to an information is not only about the volume of the audio signal, especially in the industrial environment with corresponding environmental noise is not effective, but also on the pitch or the frequency of a repeating signal, that is analogous to a Geiger counter, shown. In addition, optional various categories of Informationska ¬ such as warnings, virtual barriers or general information, different sound patterns are zugeord ¬ net. By way of example, some advantageous examples of application of the invention are shown below:
• Als Erweiterung bestehender Interfaces : • As an extension of existing interfaces:
Da die Position eines Anwenders dem System bekannt und dieser dem eindeutig identifiziert ist, können bestehende Steueran¬ lagen um virtuelle Interfaces erweitert werden. Der Anwender bedient eine Steuerung auch über seinen tragbaren Computer. Über das erfinderische System zur Notifikation kann er darauf aufmerksam gemacht werden, dass eine Zustandsänderung auf seinen mobilen Computer, etwa ausgelöst durch eine vorgenommene Regelung, seine Eingabe erfordert, dass weiterführende virtuelle Steuerelemente vorhanden, sowie Informationen, Hand- oder Wartungsbücher verortet sind, etc., siehe Figur 3. · Als Auditive Ergänzung zu Warnvorrichtungen: Since the position of a user of the uniquely identified known to the system and existing Steueran can ¬ were to be extended by virtual interfaces. The user also operates a controller via his portable computer. Through the inventive system for notification, he can be made aware that a change of state on his mobile computer, such as triggered by a scheme, requires his input that further virtual controls are present, and information, manuals or maintenance books are located, etc. , see Figure 3. · As an auditory supplement to warning devices:
Bestehende Warn- und Hinweislampen können durch ein gerichtetes, auditives Signal erweitert werden. Da eine solche Noti¬ fikation räumlich richtig wiedergegeben wird, kann die Aufmerksamkeit des Anwenders zielgerichtet gesteuert werden. Existing warning and information lamps can be extended by a directional, audible signal. Since such a Noti ¬ fication is reproduced spatially correct, the attention of the user can be controlled in a targeted manner.
• In Auditiven Navigations- und Leitsystemen: • In auditive navigation and guidance systems:
Mittels auditiven räumlichen gerichteten Signalen kann der Anwender zu einem bestimmten Punkt im Raum geleitet werden bzw. auch mit Warnhinweisen von Sperrgebieten/ Gefahrenberei- chen ferngehalten werden.  By means of auditory, spatially directed signals, the user can be directed to a specific point in the room or even be kept away with warnings from restricted areas / danger areas.
• Zur Notifikation für Location Based Services: Der Anwender wird über das Vorhandensein verorteter Information notifiziert, wenn er sich in deren Einflussbereich, also bspw. innerhalb eines definierter Radius um eine Information, befindet. Dadurch können Nachrichten und Informationen an einem bestimmten Ort hinterlassen und wieder aufgefunden werden . • For notification for location based services: The user is notified of the presence of located information when he is in their sphere of influence, that is, for example, within a defined radius to an information. This allows messages and information to be left in a specific location and retrieved.

Claims

Patentansprüche claims
1. System zur Notifikation verorteter Information, 1. System for the notification of located information,
mit einen Schutzhelm der zwei Knochenschalllautsprecher (L) und einen Richtungssensor (RS) beinhaltet und mit einer Re¬ cheneinheit (D) , durch die Daten (3) für verortete Informati¬ onen, Positionsdaten (4) eines Benutzers und Sensordaten (1) empfangbar und Stereo-Audiosignale (2) an die Knochenschall¬ lautsprecher (L) sendbar sind und with a protective helmet of the two bone - operated loudspeakers (L) and a direction sensor (RS) and with a Re ¬ cheneinheit (D), by the data (3) for localized information ¬ onen, position data (4) of a user and sensor data (1) receivable and stereo audio signals (2) to the bone sound ¬ speakers (L) are sendable and
bei dem eine Notifikation über verschiedene kontextabhängige aus der Position des Benutzers, der Orientierung seines Kop¬ fes sowie der Position der Information berechnete Stereo- Audiosignale (2) über die Knochenschalllautsprecher so ausgegeben werden, dass die wahrgenommene Schallquelle dabei der Position der Information entspricht. in which a notification about different context-dependent from the user's position, the orientation of his Kop ¬ fes and the position of the information calculated stereo audio signals (2) are output via the bone sound speakers so that the perceived sound source corresponds to the position of the information.
2. System nach Anspruch 1, 2. System according to claim 1,
bei dem die Recheneinheit (D) derart vorhanden ist, in which the arithmetic unit (D) is present in such a way
- dass aus empfangenen GPS-Daten (4) und/oder durch WLAN- Triangulation die absolute Position eines Benutzers ermit¬ telt wird, - that, from the received GPS data (4) and / or the absolute position of a user is ¬ telt by wireless triangulation ermit,
- dass aus Sensordaten (1) des Richtungssensors (RS) eine tatsächliche absolute Ausrichtung des Kopfes des Benutzers berechnet wird,  that an actual absolute alignment of the head of the user is calculated from sensor data (1) of the direction sensor (RS),
- dass Daten (3) für verortete Informationen über eine Datenfunkverbindung zu einem Geoinformationssystem empfangbar und auf einer Anzeige darstellbar sind, - That data (3) for localized information via a data radio link to a geographic information system can be received and displayed on a display,
- dass mindestens eine Interaktion des Benutzers bezüglich der verorteten Information durchführbar ist und  - That at least one user interaction with respect to the located information is feasible and
- dass die Stereo-Audiosignale (2) erzeugbar und an die Kno¬ chenschall-Lautsprechereinheiten (L) ausgebbar sind, wobei dies in Echtzeit abhängig von der Position des Benutzers und der Ausrichtung seines Kopfes relativ zu der virtuellen Schallquelle am Ort der zu notifizierenden verorteten In- formation berechnet wird. - That the stereo audio signals (2) can be generated and to the Kno ¬ chenschall speaker units (L) can be output, this in real time depending on the position of the user and the orientation of his head relative to the virtual sound source at the location of the notified localized Information is calculated.
3. System nach Anspruch 1 oder 2, 3. System according to claim 1 or 2,
bei dem die Recheneinheit (D) derart vorhanden ist, in which the arithmetic unit (D) is present in such a way
dass die Stereo-Audiosignale (2) eine Information über die Entfernung zwischen dem Benutzer und der zu notifizierenden Information in Form der Tonhöhe eines akustischen Signals oder die Frequenz eines sich wiederholenden akustischen Signals erzeugbar ist. that the stereo audio signals (2) information about the distance between the user and the information to be notified in the form of the pitch of an acoustic signal or the frequency of a repeating acoustic signal can be generated.
4. System nach Anspruch 1 oder 2, 4. System according to claim 1 or 2,
bei dem die Recheneinheit (D) derart vorhanden ist, in which the arithmetic unit (D) is present in such a way
dass verschiedenen Informationskategorien verschiedene Soundmuster zuordenbar sind. that different information categories can be assigned different sound patterns.
5. System nach einem der vorhergehenden Ansprüche, 5. System according to one of the preceding claims,
bei dem die Recheneinheit (D) derart vorhanden ist, in which the arithmetic unit (D) is present in such a way
dass der Benutzer automatisch über das Vorhandensein verorte ter Information notifiziert, wenn er sich in deren Einflussbereich um eine Information befindet. the user automatically notifies of the presence of information located if he is within the sphere of influence of information.
PCT/EP2010/062178 2009-10-26 2010-08-20 System for providing notification of positional information WO2011051009A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN2010800484283A CN102573542A (en) 2009-10-26 2010-08-20 System for providing notification of positional information
EP10749628A EP2493344A1 (en) 2009-10-26 2010-08-20 System for providing notification of positional information

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE200910050667 DE102009050667A1 (en) 2009-10-26 2009-10-26 System for the notification of localized information
DE102009050667.5 2009-10-26

Publications (1)

Publication Number Publication Date
WO2011051009A1 true WO2011051009A1 (en) 2011-05-05

Family

ID=42797235

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2010/062178 WO2011051009A1 (en) 2009-10-26 2010-08-20 System for providing notification of positional information

Country Status (4)

Country Link
EP (1) EP2493344A1 (en)
CN (1) CN102573542A (en)
DE (1) DE102009050667A1 (en)
WO (1) WO2011051009A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013114831A1 (en) * 2012-02-03 2013-08-08 Sony Corporation Information processing device, information processing method, and program
WO2013171255A1 (en) * 2012-05-15 2013-11-21 Eberhard Karls Universität Tübingen Head-tracking headset and device
US9002020B1 (en) 2012-10-22 2015-04-07 Google Inc. Bone-conduction transducer array for spatial audio
AU2015404090B2 (en) * 2015-07-29 2018-12-20 Dongguan Yuanfeng Technology Co., Ltd. Cycling helmet capable of switching sound production guidance mode based on bone conduction earphone
US20190273990A1 (en) * 2016-11-17 2019-09-05 Samsung Electronics Co., Ltd. System and method for producing audio data to head mount display device

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL2006997C2 (en) * 2011-06-24 2013-01-02 Bright Minds Holding B V Method and device for processing sound data.
CN102980554B (en) * 2012-10-26 2016-09-21 中国人民解放军空军航空医学研究所 A kind of directional surveillance system
KR102127640B1 (en) 2013-03-28 2020-06-30 삼성전자주식회사 Portable teriminal and sound output apparatus and method for providing locations of sound sources in the portable teriminal
EP2977857A1 (en) * 2014-07-25 2016-01-27 Rovio Entertainment Ltd Device-specific control
CN104489990A (en) * 2014-12-26 2015-04-08 贵阳美安心科技有限公司 Safety helmet for coal mine enterprise
DE102016208584A1 (en) 2016-05-19 2017-11-23 Rti Sports Gmbh Bicycle communication system and method for operating a bicycle communication system
IL271810A (en) * 2020-01-02 2021-07-29 Anachoic Ltd System and method for spatially projected audio communication

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002227025A (en) * 2001-01-30 2002-08-14 Asia Guroobu:Kk Helmet
JP2004032340A (en) * 2002-06-26 2004-01-29 Temuko Japan:Kk Bone conduction speaker unit for head mounting means
US20040030491A1 (en) * 2002-08-06 2004-02-12 Hewlett-Packard Development Company, L.P. Method and arrangement for guiding a user along a target path
US20090060231A1 (en) * 2007-07-06 2009-03-05 Thomas William Buroojy Bone Conduction Headphones
US20090262946A1 (en) * 2008-04-18 2009-10-22 Dunko Gregory A Augmented reality enhanced audio

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030223602A1 (en) * 2002-06-04 2003-12-04 Elbit Systems Ltd. Method and system for audio imaging
US9342459B2 (en) * 2002-08-06 2016-05-17 Qualcomm Incorporated Cache management in a mobile device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002227025A (en) * 2001-01-30 2002-08-14 Asia Guroobu:Kk Helmet
JP2004032340A (en) * 2002-06-26 2004-01-29 Temuko Japan:Kk Bone conduction speaker unit for head mounting means
US20040030491A1 (en) * 2002-08-06 2004-02-12 Hewlett-Packard Development Company, L.P. Method and arrangement for guiding a user along a target path
US20090060231A1 (en) * 2007-07-06 2009-03-05 Thomas William Buroojy Bone Conduction Headphones
US20090262946A1 (en) * 2008-04-18 2009-10-22 Dunko Gregory A Augmented reality enhanced audio

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
ANONYMOUS: "SWAN System to Help Blind Navigate Environment", 15 August 2006 (2006-08-15), XP002603826, Retrieved from the Internet <URL:http://sonify.psych.gatech.edu/presscoverage/2006/GeorgiaTechNewsRoom-2006-08-15-SWAN.pdf> [retrieved on 20101006] *
ANONYMOUS: "SWAN: System for Wearable Audio Navigation", 21 May 2008 (2008-05-21), XP002603829, Retrieved from the Internet <URL:http://web.archive.org/web/20080521220254/sonify.psych.gatech.edu/research/swan/> [retrieved on 20101006] *
DELLEART, FRANK; WALKER, BRUCE: "A System for Wearable Audio Navigation (SWAN)", 1 September 2006 (2006-09-01), XP002603830, Retrieved from the Internet <URL:http://web.archive.org/web/20060901193524/sonify.psych.gatech.edu/publications/pdfs/2006-SWAN-long.ppt.pdf> [retrieved on 20101006] *
WALKER, BRUCE N.; LINDSAY, JEFFREY: "Navigation performance in a virtual environment with bonephones", PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AUDITORY DISPLAY, 6 July 2005 (2005-07-06) - 9 July 2005 (2005-07-09), Limerick, Ireland, pages 260 - 263, XP002603827 *
WALKER, BRUCE N.; LINDSAY, JEFFREY: "Navigation Performance With a Virtual Auditory Display: Effects of Beacon Sound, Capture Radius, and Practice", HUMAN FACTORS, vol. 48, no. 2, June 2006 (2006-06-01), pages 265 - 278, XP002603828, DOI: 10.1518/001872006777724507 *

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013114831A1 (en) * 2012-02-03 2013-08-08 Sony Corporation Information processing device, information processing method, and program
CN104067633A (en) * 2012-02-03 2014-09-24 索尼公司 Information processing device, information processing method, and program
CN104067633B (en) * 2012-02-03 2017-10-13 索尼公司 Message processing device and information processing method
US9898863B2 (en) 2012-02-03 2018-02-20 Sony Corporation Information processing device, information processing method, and program
WO2013171255A1 (en) * 2012-05-15 2013-11-21 Eberhard Karls Universität Tübingen Head-tracking headset and device
US9002020B1 (en) 2012-10-22 2015-04-07 Google Inc. Bone-conduction transducer array for spatial audio
AU2015404090B2 (en) * 2015-07-29 2018-12-20 Dongguan Yuanfeng Technology Co., Ltd. Cycling helmet capable of switching sound production guidance mode based on bone conduction earphone
US10517348B2 (en) 2015-07-29 2019-12-31 Dongguang Yuanfeng Technology Co., Ltd. Cycling helmet capable of switching sound production guidance mode based on bone conduction earphone
US20190273990A1 (en) * 2016-11-17 2019-09-05 Samsung Electronics Co., Ltd. System and method for producing audio data to head mount display device
US11026024B2 (en) * 2016-11-17 2021-06-01 Samsung Electronics Co., Ltd. System and method for producing audio data to head mount display device

Also Published As

Publication number Publication date
DE102009050667A1 (en) 2011-04-28
CN102573542A (en) 2012-07-11
EP2493344A1 (en) 2012-09-05

Similar Documents

Publication Publication Date Title
WO2011051009A1 (en) System for providing notification of positional information
EP3426366B1 (en) Determining a position, aligning a virtual reality headset, and an amusement ride with a virtual reality headset
US10032387B2 (en) Wireless immersive simulation system
US20090033736A1 (en) Wireless Video Audio Data Remote System
JP2016186786A (en) Wearable smart device for hazard detection and warning based on image and audio data
US20110268300A1 (en) Tactile-based guidance system
CN101491116A (en) Method and apparatus for creating a multi-dimensional communication space for use in a binaural audio system
JP2010512693A (en) System and method for data addition, recording and communication
EP3117632B1 (en) Mobile device for immersive sound experiences
US20150055784A1 (en) Headset Hearing Protection with Integrated Transceiver and Siren Alert Device
EP2620923B1 (en) System and method for displaying information relevant to escape routes
EP1215509B1 (en) Universal communication system and corresponding mobile terminal
Barde et al. Attention redirection using binaurally spatialised cues delivered over a bone conduction headset
Barde et al. The use of spatialised auditory and visual cues for target acqusition in a search task
US10818292B2 (en) Method for term-dependent output of information based on a voice input to a specific group, and system
JP6931009B2 (en) Lamp service control system and method
Begault Virtual acoustics, aeronautics, and communications
EP3649538A1 (en) Assembly and method for communicating by means of two visual output devices
DE102016104482A1 (en) Presentation of orientation information by a lighting system
DE10157114A1 (en) Device, such as a helmet, incorporates a distance measurement system for determination of the distance of objects from the wearer and alerting the wearing of said distances and is for use in aerosol contaminated environments
AU2015100797A4 (en) Vehicle training system
CN211653603U (en) Image processing system
JP6922461B2 (en) Location information providing device and location information providing system
Barde et al. Binaural Spatialization over a Bone Conduction Headset: The Perception of Elevation
DE102011050668B4 (en) Method and device for generating directional audio data

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201080048428.3

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10749628

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2010749628

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE