DE102011050668A1 - Device for generating direction-dependent audio data of e.g. traffic warning signs, installed in motor vehicles, transmits positional information and additional information of object as audio signals to the listener using loudspeakers - Google Patents

Abstract

The device has a determination module for determining the real position of an object (1). The additional information (16) with respect to object is transmitted to the virtual monitoring unit (5) from the data receiver (3). The loudspeakers are provided in the space in the audio signal receiver such that the three-dimensional positional information (12) of the object and additional information of object are transmitted as audio signals to the listener. An independent claim is included for method for generating direction-dependent audio data.

Description

The invention relates to a device and a method for generating direction-dependent audio data.

Such devices and methods are used, for example, to give the driver of motor vehicles, which is largely shielded from acoustic influences of the environment in a passenger compartment, a spatial impression of objects and information from outside the passenger compartment by audio data in the broader sense to give in traffic be able to respond appropriately.

Further fields of application of the invention are the application in the field of consumer electronics in the artificial positioning of audio sources in a room, whereby a special three-dimensional impression is created for the listener. Another field of application of the invention are computer games applications in which participants interact purely acoustically, for example with their eyes closed, with other acoustically projected participants or objects in a virtual space.

Various approaches to the realization of auditory positioning effects are known in the art.

For example, goes from the US 2009/0316939 A1 a stereophonic device in which an improvement of the positioning of the sound effect is realized by means of various specially placed speakers for the driver of a motor vehicle.

After US 2005/0280519 A1 For example, there is disclosed an alarm signal output device for vehicles and a method thereof. This alarm signals are connected to the position of the associated objects and output via speakers in the passenger compartment.

After US 2002/0105418 A1 a vehicle alarm system is disclosed, which determines the relative position of vehicles to each other by means of GPS and navigation data and transmits this information by means of speakers to the driver as an alarm signal.

From the US 6,087,961 A goes out a warning system for the detection of emergency and emergency vehicles, which warns the driver of a motor vehicle in time and spatially assignable to these approaching vehicles.

The solutions of the prior art had the disadvantage that comprehensive information about objects located outside the passenger compartment can not yet be given to the driver due to auditory signals and thus a reaction of the driver to objects located outside the passenger compartment is not always present reasonably possible.

The object of the invention is to efficiently present acoustically information about objects present in the environment to a human listener, in particular a driver of a motor vehicle.

The object is solved by the subject matters of the independent claims. Further developments are specified in the dependent claims.

The invention is achieved in particular by a device for generating directionally dependent audio data, the device having a module for determining the real position of an object, in particular a triangulation unit, a data receiver, a position database, a virtual monitoring unit and an audio signal generator with connected loudspeakers, wherein the Loudspeakers are arranged in a room and that the listener located in this room is given a three-dimensional acoustic impression and additional information about an object outside the room.

According to an advantageous embodiment of the invention, the space is formed as a vehicle cabin of a motor vehicle, in which the driver is largely acoustically decoupled from the outside world, or the environment outside the passenger compartment.

A development of the invention consists in that smartphones are provided as components of the device for generating the direction-dependent audio data as a communication node and data source.

• – Positionsdaten eines Objektes, beispielsweise aus einer Triangulationseinheit, zu einer Knotenidentifikationsposition verarbeitet und
• – mit einer Knotenidentifikation vom Datenempfänger in einer Positionsdatenbank abgeglichen und Positionsdaten erzeugt werden, die
• – in einer virtuellen Überwachungseinheit gemeinsam mit Zusatzinformationen überprüft und gefiltert werden, wonach
• – die Positionsdaten und die Zusatzinformationen im Audiosignalerzeuger derart zu Audiosignalen verarbeitet und
• – an Lautsprecher in einem Raum ausgegeben werden, dass für einen Hörer im Raum ein dreidimensionaler Eindruck von der Position des Objektes entsteht und Zusatzinformationen über Eigenschaften des Objektes über die Audiosignale an den Hörer übermittelt werden.

The object is further achieved by a method for generating directional audio data, wherein

• - Position data of an object, for example, from a triangulation unit, processed to a node identification position and
• - Matched with a node identification from the data receiver in a position database and position data are generated, the
• - be checked and filtered in a virtual monitoring unit together with additional information, according to which
• - The position data and the additional information in the audio signal generator processed in such a way to audio signals and
• - Are output to speakers in a room that creates a three-dimensional impression of the position of the object for a listener in the room and additional information about properties of the object via the audio signals are transmitted to the listener.

An advantageous development of the invention consists in that the audio signals are synthesized by phase shifting.

It is particularly preferable to use voice information as additional information. Alternatively or cumulatively, as additional information, traffic warning signals, fleet commands for vehicles within a fleet, track information for the navigation of vehicles or recognition sounds for restaurants and other local objects may be provided.

According to a further advantageous embodiment of the invention, the checking and filtering in the virtual monitoring unit for sources and destination identifiers and for group identifiers and individual identifiers.

It is particularly advantageous if a radio identifier is used as the single identifier for the destination identifier, which enables the sparking, or the transmission of information to a part of the group or individual group members.

A further advantageous embodiment of the invention is that a radio identifier is used as a group identifier as the destination identifier, which allows the spark to the entire group.

The group identifier is advantageously structured hierarchically.

A preferred embodiment of the invention is made possible by the fact that the source identifier allows the response to the voice message of a sender.

A further advantageous embodiment of the invention is that for the filtering of the position data of the assumption angle for the triangulation in the detection of the position data of the objects is selectable.

Furthermore, a negative list of identifiers can preferably be selected for the filtering, so that a user-controlled reduction of the data input is possible.

A further advantageous embodiment of the method according to the invention is that the source and destination identifiers are used to enable two-way communication of inter-related spaces.

According to the concept, a node in the sense of the invention is to be understood as a data source which has a known relative position to the data receiver. For example, audio data from a communication partner, warning signals from other autonomous units or geographical or navigation map data from a database are regarded as data. Based on the known coordinates of the data source, signals are synthesized and output by phase differences in the loudspeaker system. In this way, the receiver has a natural acoustic impression of the location of the data source.

This ensures that the listener receives with a sound impression information about the direction of an audio source and its distance to the listener.

Particularly advantageous is the invention applicable in closed environments, such as in passenger compartments of motor vehicles of various kinds, which are optimized to shield ambient noise. Therefore, the generated acoustic waves are less superimposed by interference with ambient noise.

Thus, a device is provided which makes it possible to generate a spatial audio signal relative to an object position and possibly associated data. The synthetic spatial audio signal triggers an idea of the position and type of the object in the listener. The object is related to the data stream which forms the basis for the acoustic content. Specifically, the object data includes a source identification identifying the object, an optional target identification identifying the handset, a type describing the content of the data, and a data content itself.

The synthesis of the audio data is based on the object data stream, which consists of various data or information, and is realized in the audio signal generator. The audio signal generator is able to mix the data streams from different objects to corresponding audio signals. A filter or control element is capable of affecting the audio signal generator to select only specific, restricted data based on, for example, location, source identification, destination identification, type or data content.

The audio signal is output through several speakers, which output the sounds out of phase. This simulates a virtual location of the data source.

Examples of additional information output to the listener together with positional data include voice information from other communication nodes, traffic warning signals, fleet commands for fleet vehicles, traffic guidance information at, for example, motorway exits and intersections, and restaurant tune and other local object recognition melodies.

The device can be used in any environment where it is sufficiently quiet. Such an environment is for example the vehicle cabin and the application for motor vehicles is therefore of particular importance. In such a chamber, or in such a room or even a passenger compartment, the listener can benefit from the sound synthesis in a special way, since he is able to experience the position of the object relative to its own position by the presented sound.

In the context of the treatment of the data, various characteristics of the data or the information are of particular importance.

The source and destination identifiers are divisible into two fields, the group identifiers and the global single identifiers. For the destination identifier, it is advantageous to use a radio identifier to ensure that the vehicle can communicate with a group or with the part of a group. As a destination identifier, no group restriction is used as an alternative, so that the widest possible connection to other objects can be established.

Group identifiers may be organized hierarchically, for example a group "Help" could include a subgroup "Police", "Fire Department" and "Ambulance".

The source identifier is used, for example, to respond to a sender by means of voice information and to reply.

The position of objects in the vicinity of the vehicle is detected by triangulation. The filtering is based on the position data of the objects in the environment, for example, a touch screen can be used to select the detection angle.

The filter allows the creation of blacklists or exclusion lists, whereby the information of the transmitters is not processed due to their transmitter identification.

The source and destination identifiers can be used to realize duplex (2-way) communication between connected chambers.

The advantages of the invention are very diverse.

The spatial representation of information has the advantage that the listener does not have to spend any effort to locate the object. For example, it is not necessary to look at a display and locate an object by name on a map. Also, multiple pieces of information can be projected to different virtual locations to make them easier to distinguish. Due to the invention spontaneous communications between drivers of different vehicles are possible, in which the driver knows without much effort who speaks to him. The invention provides a clear defined interface for the system, with the help of which information is represented spatially acoustically. The filters allow the listener and user to operate the system safely and adapted to their needs. In the case of driver-to-driver communication, vehicles can be placed on an exclusive list, with which they are exclusively communicated. Disturbing communication partners can be hidden by the negative list. The filtering can alternatively or cumulatively be made based on direction and distance. For the purposes of the invention, the process of filtering is also to be understood as meaning that audio signals can subsequently be assigned to virtual positions in a room.

It is thus possible to specifically address a grouping of sender and recipient identifiers. This makes it possible, on the one hand, to send radio messages addressed to all subscribers. On the other hand, it is possible to define groups that, for example, can not be blocked, such as the police or the emergency service. This structure makes it possible to regulate the communication in the virtual acoustic space.

By the invention, all signals perceived in a limited space can be controlled by a single unit. When used in a vehicle thereby reduces the necessary effort when multiple acoustic systems are used simultaneously.

When standardizing the interfaces, the development effort is required for the manufacturers reduced by coordination components. Thus, the development is reduced to the inputs and outputs of the audio signal generator, which leads to higher efficiency on the part of the component manufacturers.

Further details, features and advantages of embodiments of the invention will become apparent from the following description of exemplary embodiments with reference to the accompanying drawings. Show it:

1 : Block diagram of the data processing by means of triangulation and virtual monitoring unit;

2 : Schematic diagram of a room with speakers and

3 : Schematic diagram with audio signal generator and room.

In 1 is shown a schematic diagram of the device and the feasible with this device method for the generation of directional audio data. The position data 12 an object 1 for example, by means of a triangulation unit 2 determined and the node identification position 13 gets to a location database 4 transmitted. In parallel with this are the object 1 Further information 16 to a data receiver 3 transmitted. About the node identification 14 are using the node identification position 13 in the position database 4 the verified position data 15 determined. The additional information 16 arrive from the data receiver 3 to the virtual monitoring unit 5 and will be there in terms of their properties together with the verified position data 15 checked and to the audio signal generator 6 passed.

In 2 is the room 8th with the handset 9 shown. In the room 8th are three speakers 7.1 . 7.2 . 7.3 arranged in the audio signal generator 6 synthesized audio signals 17 output. This creates a projected location of the data source for the listener 9 by the projection of the data source, caused by acoustic phase shift. By using at least three speakers 7.1 . 7.2 . 7.3 arises at the listener 9 a very strong three-dimensional impression. However, alternative embodiments also have more speakers in order to work out this impression even more realistically.

In 3 is the audio signal generator 6 and the room 8th the device of the invention shown as a schematic diagram in the overview again, the filter, or the controller 10 , directly on the audio signal generator 6 acts. In the audio mixer 11 , a component of the audio signal generator 6 , the various audio signals consisting of voice signals, music signals and other signals are synthesized into the audio signal 17 which is over the speakers 7 in the room 8th to the listener 9 is output, whereby the object 1 a spatial and three-dimensional impression on the listener 9 is taught.

Particularly advantageous applications arise in the driver-to-driver communication, such as a Kolonnenkommunikation. The filtering allows to prevent certain unwanted communication. As advantageous in the data part of the signals connection data for a follow-up communication can be transmitted. As a result, the communication can be continued via conventional networks when removing the vehicles.

Another application is in the driver notification system, regarding the traffic situations in the immediate vicinity. Nearby but not visible road users can be represented by the signals.

Another application is network information in that the listener and motor vehicle driver can be guided to a sought-after communication partner who identifies himself, for example, by his smartphone.

A further advantageous application consists in the improvement of the guidance systems for navigation in unclear geographical arrangements, such as motorway junctions, motorway exits and narrow streets. The virtual position of signal sources indicates, for example, an exit to be taken.

Another field of application is a training system for racers who can get an impression of how an ideal line can be maintained or whether it should be braked or accelerated. For example, a virtual acceleration signal and a virtual signal at the rear represent braking. A signal to the right would mean to the right and to the left corresponding to the left to strike. The volume of the audio signals can be used to convey the intensity of the corresponding reactions. Thus, this information can be perceived without distracting the driver's gaze from the road.

LIST OF REFERENCE NUMBERS

1

object

2

triangulation

3

data receiver

4

Position database

5

virtual monitoring unit

6

Audio signal generator

7

speaker

7.1

speaker

7.2

speaker

7.3

speaker

8th

Room, passenger compartment

9

Handset, driver, audio signal receiver

10

Filter, controller

11

Audio mixer

12

position data

13

Node identification position

14

node identification

15

relative verified position data

16

Further information

17

Audio signals

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• US 2009/0316939 A1 [0005]
• US 2005/0280519 A1 [0006]
• US 2002/0105418 A1 [0007]
• US 6087961 A [0008]

Claims (19)

Device for generating direction-dependent audio data, comprising a module for determining the real position of an object ( 1 ) as well as a data receiver ( 3 ), a position database ( 4 ), a virtual monitoring unit ( 5 ), an audio signal generator ( 6 ) with connected speakers ( 7.1 . 7.2 . 7.3 ), where the speakers ( 7.1 . 7.2 . 7.3 ) in a room ( 8th ) and in this room ( 8th ) ( 9 ) a three-dimensional acoustic impression and additional information ( 16 ) to an object ( 1 ) outside the room ( 8th ) convey. Apparatus according to claim 1, characterized in that the module for determining the real position of an object as a triangulation unit ( 2 ) is trained. Device according to claim 1 or 2, characterized in that the space ( 8th ) is designed as a vehicle cabin. Device according to one of claims 1 to 3, characterized in that are provided as a communication node and data source smartphones. Method for generating directional audio data, wherein - position data ( 12 ) of an object ( 1 ) in the triangulation unit ( 2 ) to a node identification position ( 13 ) and - with a node identification ( 14 ) from the data receiver ( 3 ) in a position database ( 4 ) and position data ( 15 ), which - in a virtual monitoring unit ( 5 ) together with additional information ( 16 ) and filtered, after which - the position data ( 15 ) and the additional information ( 16 ) in the audio signal generator ( 6 ) to audio signals ( 17 ) and - to loudspeakers ( 7 ) in a room ( 8th ) that for a listener ( 9 ) in the room ( 8th ) a three-dimensional impression of the position of the object ( 1 ) and additional information ( 16 ) about properties of the object ( 1 ) via the audio signals ( 17 ) to the listener ( 9 ). Method according to Claim 5, characterized in that the audio signals ( 17 ) are synthesized by phase shifting. Method according to claim 5 or 6, characterized in that the additional information ( 16 ) Are language information. Method according to one of claims 5 to 7, characterized in that the additional information ( 16 ) Are traffic warning signals. Method according to one of claims 5 to 8, characterized in that the additional information ( 16 ) Fleet commands for vehicles within a fleet. Method according to one of claims 5 to 9, characterized in that the additional information ( 16 ) Track information for the navigation of vehicles are. Method according to one of claims 5 to 10, characterized in that the additional information ( 16 ) Are sounds of recognition for restaurants and other local objects. Method according to one of Claims 5 to 11, characterized in that the checking and filtering in the virtual monitoring unit ( 5 ) by source and destination identifiers and by group identifiers and single identifiers. Method according to one of claims 5 to 12, characterized in that as a target identifier, a radio identifier is applicable as a single identifier that allows the spark to a part of the group or individual group members. Method according to one of claims 5 to 12, characterized in that as the destination identifier, a radio identifier is applicable as a group identifier that allows the spark to the entire group. A method according to claim 14, characterized in that the group identifier is hierarchical. Method according to one of claims 5 to 15, characterized in that the source identifier allows the response to the voice message of a transmitter. Method according to one of claims 5 to 16, characterized in that for the filtering of the position data ( 12 ) the acceptance angle is selectable. Method according to one of Claims 5 to 17, characterized in that a negative list of identifiers can be selected for the filtering. Method according to one of claims 5 to 18, characterized in that the source and Destination identifiers used to provide two-way communication of rooms ( 8th ).

Images