DE102011050668B4 - Method and device for generating directional audio data - Google Patents

Abstract

Device for generating direction-dependent audio data, comprising a module for determining the real position of an object (1) outside a room (8), wherein the module for determining the real position of the object (1) is designed as a triangulation unit (2), and a Data receiver (3), a position database (4), a virtual monitoring unit (5), an audio signal generator (6) with at least three connected speakers (7.1, 7.2, 7.3), wherein the speakers (7.1, 7.2, 7.3) in the room ( 8) and impart a three-dimensional acoustic impression and additional information (16) to the object (1) outside the room (8) to the listener (9) located in this room (8), the node identification position (13) being sent to the position database (8). 4) is transmittable and parallel to the object (1) additional information (16) to the data receiver (3) can be transmitted, wherein via a node identification (14) with the help of Kn otenidentifikationsposition (13) in the position database (4) verified position data (15) can be determined and wherein the additional information (16) from the data receiver (3) to the virtual monitoring unit (5) can be conducted and in the virtual monitoring unit (5) together with the verified position data (15) are checked and forwarded to the audio signal generator (6), wherein in the audio signal generator (6) data streams of different objects (1) are miscible to corresponding audio signals, wherein the audio signals are synthesized by phase shift in the audio signal generator (6), ...

Description

The invention relates to a device and a method for generating direction-dependent audio data.

Such devices and methods are used, for example, to give the driver of motor vehicles, which is largely shielded from acoustic influences of the environment in a passenger compartment, a spatial impression of objects and information from outside the passenger compartment by audio data in the broader sense to give in traffic be able to respond appropriately.

Further fields of application of the invention are the application in the field of consumer electronics in the artificial positioning of audio sources in a room, whereby a special three-dimensional impression is created for the listener. Another field of application of the invention are computer games applications in which participants interact purely acoustically, for example with their eyes closed, with other acoustically projected participants or objects in a virtual space.

Various approaches to the realization of auditory positioning effects are known in the art.

For example, goes from the US 2009/0316939 A1 a stereophonic device in which an improvement of the positioning of the sound effect is realized by means of various specially placed speakers for the driver of a motor vehicle.

After US 2005/0280519 A1 For example, there is disclosed an alarm signal output device for vehicles and a method thereof. This alarm signals are connected to the position of the associated objects and output via speakers in the passenger compartment.

After US 2002/0105418 A1 a vehicle alarm system is disclosed, which determines the relative position of vehicles to each other by means of GPS and navigation data and transmits this information by means of speakers to the driver as an alarm signal.

From the US 6,087,961 A goes out a warning system for the detection of emergency and emergency vehicles, which warns the driver of a motor vehicle in time and spatially assignable to these approaching vehicles.

In the US 7,274,288 B2 For example, a vehicle alarm system noise output device will be described.

In the US 2009/0262946 A1 a phone enhanced by an augmented reality is described.

The US 2010/0329489 A1 describes a system in which the position of a listener in a room is determined and a (surround) sound system is aligned to this position in order to allow the person an optimal Klagergebnis.

Furthermore, in the EP 1 431 120 A1 describes a monitoring device for moving objects in the vicinity of a vehicle.

In the WO 2006/059201 A2 a device and a method for the detection of objects, in particular of moving objects in front of a vehicle are described.

In addition, M. Cohen and J. Villegas describe enhanced augmented audio reality for position perception services (Cohen, M. et al .: "From Whereware to Whence and Whitherware: Augmented Audio Reality for Position-Aware Services"; IEEE International Symposium on Virtual Reality Innovation, March 19-20, 2011, Singapore).

Furthermore, in the JP 2007 215 228 A a noise data distribution system is described.

The solutions of the prior art had the disadvantage that comprehensive information about objects located outside the passenger compartment can not yet be given to the driver due to auditory signals and thus a reaction of the driver to objects located outside the passenger compartment is not always present reasonably possible.

The object of the invention is to efficiently present acoustically information about objects present in the environment to a human listener, in particular a driver of a motor vehicle.

The object is solved by the subject matters of the independent claims. Further developments are specified in the dependent claims.

The invention is achieved in particular by a device for generating direction-dependent audio data, wherein the device comprises a module for determining the real position of an object outside a room, wherein the module for Determining the real position of the object is designed as a triangulation unit, and a data receiver, a position database, a virtual monitoring unit, an audio signal generator having at least three connected speakers, the speakers are arranged in the room and the listener located in this room a three-dimensional acoustic impression and provide additional information about the object outside the room,
wherein the node identification position can be transmitted to the position database and, in parallel thereto, additional information can be transmitted from the object to the data receiver,
wherein via a node identification using the node identification position in the position database verified position data can be determined, and
wherein the additional information from the data receiver to the virtual monitoring unit can be conducted and checked in the virtual monitoring unit together with the verified position data and can be forwarded to the audio signal generator,
wherein in the audio signal generator data streams of different objects are miscible to corresponding audio signals,
wherein the audio signals can be synthesized by phase shifting in the audio signal generator,
wherein, with a controller acting directly on the audio signal generator and an audio mixer which is a component of the audio signal generator, different audio signals consisting of voice signals, music signals and other signals are synthesizable to the audio signal transmitted to the listener via the speakers in the room are dispensable.

According to an advantageous embodiment of the invention, the space is formed as a vehicle cabin of a motor vehicle, in which the driver is largely acoustically decoupled from the outside world, or the environment outside the passenger compartment.

A development of the invention consists in that smartphones are provided as components of the device for generating the direction-dependent audio data as a communication node and data source.

• – Positionsdaten eines Objektes in der Triangulationseinheit zu einer Knotenidentifikationsposition verarbeitet und parallel dazu von dem Objekt Zusatzinformationen an einen Datenempfänger übermittelt werden, und
• – mit einer Knotenidentifikation vom Datenempfänger in einer Positionsdatenbank abgeglichen und Positionsdaten erzeugt werden, die
• – in einer virtuellen Überwachungseinheit gemeinsam mit den Zusatzinformationen überprüft und gefiltert werden, wonach
• – die Positionsdaten und die Zusatzinformationen von verschiedenen Objekten im Audiosignalerzeuger derart zu korrespondierenden Audiosignalen gemischt werden und ein Controller unmittelbar auf den Audiosignalerzeuger wirkt und ein Audiomischer, der eine Komponente des Audiosignalerzeugers ist, die verschiedenen Audiosignale zu den Audiosignalen verarbeitet, die an mindestens drei Lautsprecher in einem Raum ausgegeben werden, dass für einen Hörer im Raum ein dreidimensionaler Eindruck von der Position des Objektes, verursacht durch akustische Phasenverschiebung, entsteht und Zusatzinformationen über Eigenschaften des Objektes über die Audiosignale an den Hörer übermittelt werden.

The object is further achieved by a method for generating directional audio data, wherein

• - Position data of an object in the triangulation unit is processed to a node identification position and transmitted in parallel from the object additional information to a data receiver, and
• - Matched with a node identification from the data receiver in a position database and position data are generated, the
• - be checked and filtered in a virtual monitoring unit together with the additional information, according to which
• The position data and the additional information of different objects in the audio signal generator are mixed into corresponding audio signals and a controller acts directly on the audio signal generator and an audio mixer, which is a component of the audio signal generator, processes the different audio signals to the audio signals which are transmitted to at least three loudspeakers in a space is output that creates a three-dimensional impression of the position of the object caused by acoustic phase shift for a listener in the room and additional information about properties of the object via the audio signals are transmitted to the listener.

The audio signals are synthesized by phase shifting.

It is particularly preferable to use voice information as additional information. Alternatively or cumulatively, as additional information, traffic warning signals, fleet commands for vehicles within a fleet, track information for the navigation of vehicles or recognition sounds for restaurants and other local objects may be provided.

According to a further advantageous embodiment of the invention, the checking and filtering in the virtual monitoring unit for sources and destination identifiers and for group identifiers and individual identifiers.

It is particularly advantageous if a radio identifier is used as the single identifier for the destination identifier, which enables the sparking, or the transmission of information to a part of the group or individual group members.

A further advantageous embodiment of the invention is that a radio identifier is used as a group identifier as the destination identifier, which allows the spark to the entire group.

The group identifier is advantageously structured hierarchically.

A preferred embodiment of the invention is made possible by the fact that the source identifier allows the response to the voice message of a sender.

A further advantageous embodiment of the invention is that for the filtering of the position data of the acceptance angle for the Triangulation when capturing the position data of the objects is selectable.

Furthermore, a negative list of identifiers can preferably be selected for the filtering, so that a user-controlled reduction of the data input is possible.

A further advantageous embodiment of the method according to the invention is that the source and destination identifiers are used to enable two-way communication of inter-related spaces.

According to the concept, a node in the sense of the invention is to be understood as a data source which has a known relative position to the data receiver. For example, audio data from a communication partner, warning signals from other autonomous units or geographical or navigation map data from a database are regarded as data. Based on the known coordinates of the data source, signals are synthesized and output by phase differences in the loudspeaker system. In this way, the receiver has a natural acoustic impression of the location of the data source.

This ensures that the listener receives with a sound impression information about the direction of an audio source and its distance to the listener. Particularly advantageous is the invention applicable in closed environments, such as in passenger compartments of motor vehicles of various kinds, which are optimized to shield ambient noise. Therefore, the generated acoustic waves are less superimposed by interference with ambient noise.

Thus, a device is provided which makes it possible to generate a spatial audio signal relative to an object position and possibly associated data. The synthetic spatial audio signal triggers an idea of the position and type of the object in the listener. The object is related to the data stream which forms the basis for the acoustic content. Specifically, the object data includes a source identification identifying the object, an optional target identification identifying the handset, a type describing the content of the data, and a data content itself.

The synthesis of the audio data is based on the object data stream, which consists of various data or information, and is realized in the audio signal generator. The audio signal generator is able to mix the data streams from different objects to corresponding audio signals. A filter or control element is capable of affecting the audio signal generator to select only specific, restricted data based on, for example, location, source identification, destination identification, type or data content.

The audio signal is output through several speakers, which output the sounds out of phase. This simulates a virtual location of the data source.

Examples of additional information output to the listener together with positional data include voice information from other communication nodes, traffic warning signals, fleet commands for fleet vehicles, traffic guidance information at, for example, motorway exits and intersections, and restaurant tune and other local object recognition melodies.

The device can be used in any environment where it is sufficiently quiet. Such an environment is for example the vehicle cabin and the application for motor vehicles is therefore of particular importance. In such a chamber, or in such a room or even a passenger compartment, the listener can benefit in a special way from the sound synthesis, since he is able to experience the position of the object relative to its own position by the presented sound.

In the context of the treatment of the data, various characteristics of the data or the information are of particular importance.

The source and destination identifiers are divisible into two fields, the group identifiers and the global single identifiers. For the destination identifier, it is advantageous to use a radio identifier to ensure that the vehicle can communicate with a group or with the part of a group. As a destination identifier, no group restriction is used as an alternative, so that the widest possible connection to other objects can be established.

Group identifiers may be organized hierarchically, for example a group "Help" could include a subgroup "Police", "Fire Department" and "Ambulance". The source identifier is used, for example, to respond to a sender by means of voice information and to reply.

The position of objects in the vicinity of the vehicle is detected by triangulation. The filtering is based on the position data of the objects in the environment, for example, a touch screen can be used to select the detection angle.

The filter allows the creation of blacklists or exclusion lists, whereby the information of the transmitters is not processed due to their transmitter identification.

The source and destination identifiers can be used to realize duplex (2-way) communication between connected chambers.

The advantages of the invention are very diverse.

The spatial representation of information has the advantage that the listener does not have to spend any effort to locate the object. For example, it is not necessary to look at a display and locate an object by name on a map. Also, multiple pieces of information can be projected to different virtual locations to make them easier to distinguish. Due to the invention spontaneous communications between drivers of different vehicles are possible, in which the driver knows without much effort who speaks to him. The invention provides a clear defined interface for the system, with the help of which information is represented spatially acoustically. The filters allow the listener and user to operate the system safely and adapted to their needs. In the case of driver-to-driver communication, vehicles can be placed on an exclusive list, with which they are exclusively communicated. Disturbing communication partners can be hidden by the negative list.

The filtering can alternatively or cumulatively be made based on direction and distance. For the purposes of the invention, the process of filtering is also to be understood as meaning that audio signals can subsequently be assigned to virtual positions in a room.

It is thus possible to specifically address a grouping of sender and recipient identifiers. This makes it possible, on the one hand, to send radio messages addressed to all subscribers. On the other hand, it is possible to define groups that, for example, can not be blocked, such as the police or the emergency service. This structure makes it possible to regulate the communication in the virtual acoustic space.

By the invention, all signals perceived in a limited space can be controlled by a single unit. When used in a vehicle thereby reduces the necessary effort when multiple acoustic systems are used simultaneously.

Standardization of the interfaces reduces the effort for the development of coordination components for manufacturers. Thus, the development is reduced to the inputs and outputs of the audio signal generator, which leads to higher efficiency on the part of the component manufacturers.

Further details, features and advantages of embodiments of the invention will become apparent from the following description of exemplary embodiments with reference to the accompanying drawings. Show it:

1 : Block diagram of the data processing by means of triangulation and virtual monitoring unit;

2 : Schematic diagram of a room with speakers and

3 : Schematic diagram with audio signal generator and room.

In 1 is shown a schematic diagram of the device and the feasible with this device method for the generation of directional audio data. The position data 12 an object 1 for example, by means of a triangulation unit 2 determined and the node identification position 13 gets to a location database 4 transmitted. In parallel with this are the object 1 Further information 16 to a data receiver 3 transmitted. About the node identification 14 are using the node identification position 13 in the position database 4 the verified position data 15 determined. The additional information 16 arrive from the data receiver 3 to the virtual monitoring unit 5 and will be there in terms of their properties together with the verified position data 15 checked and to the audio signal generator 6 passed.

In 2 is the room 8th with the handset 9 shown. In the room 8th are three speakers 7.1 . 7.2 . 7.3 arranged in the audio signal generator 6 synthesized audio signals 17 output. This creates a projected location of the data source for the listener 9 by the projection of the data source, caused by acoustic phase shift. By using at least three speakers 7.1 . 7.2 . 7.3 arises at the listener 9 a very strong three-dimensional impression. However, alternative embodiments also have more speakers in order to work out this impression even more realistically.

In 3 is the audio signal generator 6 and the room 8th the device of the invention shown as a schematic diagram in the overview again, the filter, or the controller 10 , directly on the audio signal generator 6 acts. In the audio mixer 11 , a component of the audio signal generator 6 , the various audio signals consisting of voice signals, music signals and other signals are synthesized into the audio signal 17 which is over the speakers 7 in the room 8th to the listener 9 is output, whereby the object 1 a spatial and three-dimensional impression on the listener 9 is taught.

Particularly advantageous applications arise in the driver-to-driver communication, such as a Kolonnenkommunikation. The filtering allows to prevent certain unwanted communication. As advantageous in the data part of the signals connection data for a follow-up communication can be transmitted. As a result, the communication can be continued via conventional networks when removing the vehicles.

Another application is in the driver notification system, regarding the traffic situations in the immediate vicinity. Nearby but not visible road users can be represented by the signals.

Another application is network information in that the listener and motor vehicle driver can be guided to a sought-after communication partner who identifies himself, for example, by his smartphone.

A further advantageous application consists in the improvement of the guidance systems for navigation in unclear geographical arrangements, such as motorway junctions, motorway exits and narrow streets. The virtual position of signal sources indicates, for example, an exit to be taken.

Another field of application is a training system for racers who can get an impression of how an ideal line can be maintained or whether it should be braked or accelerated. For example, a virtual acceleration signal and a virtual signal at the rear represent braking. A signal to the right would mean to the right and to the left corresponding to the left to strike. The volume of the audio signals can be used to convey the intensity of the corresponding reactions. Thus, this information can be perceived without distracting the driver's gaze from the road.

Claims (17)

Device for generating direction-dependent audio data, comprising a module for determining the real position of an object ( 1 ) outside of a room ( 8th ), wherein the module for determining the real position of the object ( 1 ) as a triangulation unit ( 2 ), and a data receiver ( 3 ), a position database ( 4 ), a virtual monitoring unit ( 5 ), an audio signal generator ( 6 ) with at least three connected speakers ( 7.1 . 7.2 . 7.3 ), where the speakers ( 7.1 . 7.2 . 7.3 ) in the room ( 8th ) and in this room ( 8th ) ( 9 ) a three-dimensional acoustic impression and additional information ( 16 ) to the object ( 1 ) outside the room ( 8th ), the node identification position ( 13 ) to the position database ( 4 ) is transmittable and parallel to the object ( 1 ) Further information ( 16 ) to the data receiver ( 3 ), whereby via a node identification ( 14 ) using the node identification position ( 13 ) in the position database ( 4 ) verified position data ( 15 ) and where the additional information ( 16 ) from the data receiver ( 3 ) to the virtual monitoring unit ( 5 ) and in the virtual monitoring unit ( 5 ) together with the verified position data ( 15 ) and to the audio signal generator ( 6 ), wherein in the audio signal generator ( 6 ) Data streams from different objects ( 1 ) are miscible to corresponding audio signals, wherein the audio signals by phase shift in the audio signal generator ( 6 ) are synthesized, with a controller ( 10 ) directly to the audio signal generator ( 6 ) and an audio mixer ( 11 ), which is a component of the audio signal generator ( 6 ), different audio signals, consisting of speech signals, music signals and other signals, to the audio signal ( 17 ) which can be synthesized via the loudspeakers ( 7.1 . 7.2 . 7.3 ) in the room ( 8th ) to the listener ( 9 ) is dispensable. Device according to claim 1, characterized in that the space ( 8th ) is designed as a vehicle cabin. Apparatus according to claim 1 or 2, characterized in that are provided as a communication node and data source smartphones. Method for generating directional audio data, wherein - position data ( 12 ) of an object ( 1 ) in the triangulation unit ( 2 ) to a node identification position ( 13 ) and in parallel from the object ( 1 ) Further information ( 16 ) to a data receiver ( 3 ), and - with a node identification ( 14 ) from the data receiver ( 3 ) in a position database ( 4 ) and position data ( 15 ), which - in a virtual monitoring unit ( 5 ) together with the additional information ( 16 ) and filtered, after which - the position data ( 15 ) and the additional information ( 16 ) of different objects ( 1 ) in the audio signal generator ( 6 ) are mixed to corresponding audio signals and a controller ( 10 ) directly on the audio signal generator ( 6 ) and an audio mixer ( 11 ), which is a component of the audio signal generator ( 6 ) is the different audio signals to the audio signals ( 17 ) on at least three speakers ( 7 ) in a room ( 8th ) that for a listener ( 9 ) in the room ( 8th ) a three-dimensional impression of the position of the object ( 1 ), caused by acoustic phase shift, arises and additional information ( 16 ) about properties of the object ( 1 ) via the audio signals ( 17 ) to the listener ( 9 ). Method according to claim 4, characterized in that the additional information ( 16 ) Are language information. Method according to one of claims 4 to 5, characterized in that the additional information ( 16 ) Are traffic warning signals. Method according to one of claims 4 to 6, characterized in that the additional information ( 16 ) Fleet commands for vehicles within a fleet. Method according to one of claims 4 to 7, characterized in that the additional information ( 16 ) Track information for the navigation of vehicles are. Method according to one of claims 4 to 8, characterized in that the additional information ( 16 ) Are sounds of recognition for restaurants and other local objects. Method according to one of Claims 4 to 9, characterized in that the checking and filtering in the virtual monitoring unit ( 5 ) by source and destination identifiers and by group identifiers and single identifiers. Method according to one of claims 4 to 10, characterized in that as a target identifier, a radio identifier is applicable as a single identifier that allows the spark to a part of the group or individual group members. Method according to one of claims 4 to 10, characterized in that as the destination identifier, a radio identifier is applicable as a group identifier that allows the spark to the entire group. A method according to claim 12, characterized in that the group identifier is hierarchical. Method according to one of claims 4 to 13, characterized in that the source identifier allows the response to the voice message of a sender. Method according to one of claims 4 to 14, characterized in that for the filtering of the position data ( 12 ) the acceptance angle is selectable. Method according to one of claims 4 to 15, characterized in that a negative list of identifiers can be selected for the filtering. A method according to any one of claims 4 to 16, characterized in that the source and destination identifiers are used to provide two-way communication of inter-related spaces ( 8th ).

Images