DE102011003450A1 - Generation of user-adapted signal processing parameters - Google Patents

Abstract

A mobile phone (100) comprises an interface (112) for receiving individual hearing system information from a user of the mobile phone, a parameter adjustment device (114) for providing at least one signal processing parameter adapted to the user with regard to the individual hearing system information, an audio data source (116) for providing Audio data and an audio signal processor (118) for receiving the audio data from the audio data source (116) and the at least one signal processing parameter adapted to the user. The audio signal processor (118) is provided for processing the audio data in accordance with the at least one signal processing parameter and for providing an output signal resulting therefrom that gives the user a spatial auditory impression.

Description

The present invention relates to mobile telephones having a capability of reproducing surround sound, and more particularly to a user-related adaptation of the mobile phone for the reproduction of surround sound. The present invention further relates to a server interacting with the mobile telephone for user-related adaptation, to a method for generating an audio signal on a mobile telephone, to a method for providing signal processing parameters and to a computer program with program code for carrying out at least one of the methods.

For several decades, pieces of music and other sound performances that offered stereo sound or recorded in stereo were, at least to the general public, the closest technology to real surround sound. In the late 1990s, the first SACDs (Super Audio Compact Discs) and DVD-A (Digital Versatile Disk Audio) were marketed, which also represented a significant development in terms of surround sound to stereo recordings. However, neither the SACD nor the DVD-A was a commercial success, which is due to the opinion of many professionals that on the one hand special players were required and on the other short time later other formats for distribution of music or sound performances came up, especially in the Combination of highly compressed audio files and distribution of these audio files over appropriate communication networks such as the Internet.

On the other hand, films with surround sound or "surround sound" are becoming increasingly popular. In the US, by the end of 2008, 50% of homes had home theater equipment, which typically includes a speaker set that includes five or more speakers. These speaker sets are known as 5.0, 5.1 or 7.1 speaker systems, depending on their size. Modern data media such as DVD or Blu-ray discs often contain corresponding audio data that can be reproduced with such speaker equipment to allow a realistic listening experience.

In recent years, the applicant has carried out research with the aim of providing a realistic spatial sound experience even at relatively low data transmission rates or low memory requirements. The results of this research are summarized as audio coders, audio decoders and other products under the name "MP3 Surround" (see "An Introduction to MP3 Surround" by Jürgen Herre et al., Fraunhofer Institute for Integrated Circuits IIS, 91058 Erlangen, Germany, and by Christof Faller, Agere Systems, Allentown, PA 18109, USA).

Man's capacity for spatial hearing is based on a number of phenomena, such as: B. phase and transit time differences between the two ears, shading effects by the head and the body, reflection effects on z. As the shoulders, other body parts and objects in the environment, directivity of the pinna and a location-dependent frequency response of the human ear (caused, inter alia, by the structure of the auricle). These influences affect a scattering process, over which sounds from a sound source reaches the ear of the listener. This scattering process, which may include a component radiated directly from the sound source to the ear, may be modeled as a filter. The Fourier transform of this filter is called the "Head-related Transfer Function (HRTF)". By means of the HRTF, a spatial sense of sound can be simulated for a listener who wears a headset and receives it via these sounds. Although the form of HRTF is broadly similar for most people, there are significant differences from one individual to another, especially in the higher frequency range. Decisive for this are u. a. different head shapes and different shapes of the auricle. Over time, as the listener's brain adjusts to the individual HRTF'n of the listener, the ability to hear in space is degraded when a generic HRTF or another individual's HRTF is used for that listener. In order to achieve the best possible spatial sound experience, it is therefore necessary, in particular when using headphones, to use an HRTF (or several HRTF'n) which comes as close as possible to the natural HRTF of the corresponding individual. For this purpose, the natural HRTF of the individual is usually measured, which is relatively expensive and requires special measuring equipment.

The article "Limitations of 3D Audio to Improve Auditory Cues in Aircraft Cockpits" by CW Johnson and W. Dell; Dept of Computing Science, Univ. of Glasgow, Scotland describes the results of a spatial hearing test performed using generic HRTF'n. The authors suggest that individualized HRTF'n would have improved the test results. For an aviation application, they suggest using biometric data of the flight crew to load the appropriate individual HRTF's prior to the flight. Nevertheless, this requires that for each pilot the individual HRTF must be measured in advance. For a larger number of individuals, such. B. Mobile phone users or home cinema owners would require a correspondingly high number of individual measurements, which would mean a high outlay and high costs.

The object of the present invention is to provide for a mobile phone user an HRTF that comes as close as possible to the natural HRTF of the user, but without necessarily having to determine the user's HRTF by a measurement.

This object is achieved by a mobile telephone according to claim 1, a parameterization server according to claim 7, a method for generating an audio signal output by a mobile telephone according to claim 13, a method for providing at least one signal processing parameter according to claim 18 or a computer program according to claim 24.

In accordance with the teachings herein, a mobile telephone includes an interface for receiving individual hearing system information of a user of the mobile phone, parameter adjusting means for providing at least one signal processing parameter customized to the individual hearing system information to the user, an audio data source for providing audio data, and an audio signal processor for receiving the audio data from the audio data source and the at least one user-adapted signal processing parameter from the parameter adjustment means. The audio signal processor is furthermore provided for processing the audio data in accordance with the at least one signal processing parameter and for providing a resulting output signal which gives the user a spatial hearing impression.

The at least one signal processing parameter may, for example, reflect a property of the HRTF, such as a frequency response. The individual hearing system information may be data of different types that characterize the hearing system of the mobile phone user, in particular with regard to a spatial sound perception capability of the mobile phone user. The mobile telephone saves the user from carrying out an expensive measurement for determining a complete HRTF, by determining the at least one signal processing parameter from the individual hearing system information that is easier to determine. This determination can be made on the basis of empirical knowledge. In particular, two individuals may not have identical, but at least similar HRTF'n, which can be determined by a suitable choice of the individual hearing system information. There is thus a correlation between suitably selected individual hearing system information and the at least one signal processing parameter or the complete HRTF.

According to embodiments, the mobile telephone may further comprise a radio interface configured to receive the individual hearing system information from the interface for the individual hearing system information and to transmit it to a server. The radio interface may be further configured to receive the user-adapted, at least one signal processing parameter from the server and to pass it to the audio signal processor. In this way, an actual assignment of the at least one signal processing parameter to the individual hearing system information is shifted from the mobile telephone to the server. When associating the individual hearing system information with the at least one signal processing parameter, a comparison of the individual hearing system information with a relatively extensive database may be necessary. Such a comparison with the extensive database could make high demands on a storage capacity and a computing power of the mobile phone. However, today's mobile phones often offer both a large storage capacity and a high computing power.

In embodiments, the mobile telephone may further include an image capture device. The imaging device may be configured to provide at least a portion of the individual hearing system information in the form of an image at least partially displaying the user for the parameter adjustment device. The image may show the hearing system of the mobile phone user or parts thereof (eg auricle). The image capture device may be in communication with the interface for receiving individual hearing system information and / or the parameter adjustment device. Image processing for extracting reusable individual hearing system information from the image may be provided either in the parameter adjustment means or as a stand-alone image processing device. Such image processing may, for example, provide numerical values such as dimensions or classification results (for example with regard to the shape of the auricle).

According to embodiments of the teachings disclosed herein, the audio data source may be configured to provide pattern audio signals to the user for display. The interface for receiving the individual hearing system information may be configured to evaluate the pattern audio signals by the user with respect to the user spatial hearing impression to receive. The evaluation of the pattern audio signals may constitute part of the individual hearing system information or even the complete individual hearing system information. By means of suitable pattern audio signals it can be checked in which pattern audio signals the mobile phone user, for example, observes a particularly clear spatial sound sensation and in which other pattern audio signals no remarkable spatial sound sensation is offered. By a suitable structuring of the pattern audio signals, for. B. as a (binary) tree, successively better tuned to him pattern audio signals can be played back for the mobile phone user, so that a relatively rapid collection of the individual hearing system information is made possible. The reproduction of the pattern audio signals and the evaluation of the pattern audio signals by the user may be interactive. Specifically, the pattern audio signals may be specially prepared stereo audio signals that are reproduced from the mobile phone in a conventional manner via a headset. It is not necessary for the audio signal processor to be involved in the reproduction of the pattern audio signals, although this is also possible. If the audio signal processor is involved in the reproduction of the pattern audio signals, pattern signal processing parameters may be provided for use by the audio signal processor in addition to the pattern audio signals. By rendering and evaluating the pattern audio signals, a rough-to-fine search can be used to determine an HRTF for the mobile phone user that is relatively similar to the natural HRTF of the mobile phone user and allows them a sufficiently realistic spatial listening experience.

In embodiments of the mobile phone disclosed herein, the audio signal processor may be configured to process at least two audio data streams of different origin such that the user perceives the at least two audio data streams as spaced from one another in accordance with the spatial audio impression. In this way, the user typically can better separate the audio streams, which often increases the intelligibility of the audio streams. For example, the user may be in a telephone conference with two call partners and the audio signals coming in from the two call partners are processed by the audio signal processor to give the user the impression that Caller # 1 would be to the left of him, whereas Caller No 2 would be closer to the right of him. The audio data streams may be of different origin, in particular telephone connections, music playback, radio or television transmissions of z. As sports events, speech synthesis computers or podcasts.

Similarly, in embodiments of the teachings disclosed herein, the audio data source may include at least one of a mobile receiving part, an internal memory of the mobile phone, a removable medium, a computer connected via an online connection, and a streaming media connection.

A parameterization server according to the teachings disclosed herein includes a parameter generator and a mobile radio interface. The parameter generator is for providing a signal processing parameter adapted to a user based on individual hearing system information. The mobile radio interface serves to receive the individual hearing system information from a mobile phone relating to the user of the mobile phone or its hearing system. The mobile radio network interface is also used for transmitting the signal processing parameter adapted to the user to the mobile telephone for processing audio data by the mobile telephone in accordance with the at least one signal processing parameter and for providing a resulting output signal which gives the user a spatial hearing impression.

The parameterization server can shift the possibly computation-intensive and memory-intensive determination of the user-adapted signal processing parameter on the basis of the individual hearing system information from the mobile telephone to hardware which is more suitable for this purpose. It is exploited that a mobile phone is suitable for data communication with a remote computer, such as the parameterization server via a mobile network.

In embodiments of the parameterization server disclosed herein, the parameter generation may include a database having records that include predetermined individual hearing system information and the at least one signal processing parameter associated with the predetermined individual hearing instrument information of the respective record. The parameter generation can be designed to select at least one data record whose individual hearing system information is similar or identical to the individual hearing system information received via the mobile radio interface. Furthermore, the parameter generator can be designed to transmit the at least one assigned signal processing parameter to the mobile telephone via the mobile radio network interface.

The parameterization server may further comprise image processing means configured to receive an image of the image at least partially displaying the user Mobile interface. The image processing device is configured to analyze the image with regard to at least a portion of the user's individual hearing system information and to provide at least the portion of the individual hearing system information to the parameter generator.

The parameterization server, in embodiments of the teachings disclosed herein, may further include a pattern audio collection with pattern audio signals. The mobile radio interface can then be designed to transmit at least one of the pattern audio signals to the mobile telephone and to receive from the mobile telephone a user evaluation of the at least one sample audio signal with respect to the spatial audio impression as at least a part of the individual hearing system information. The pattern audio signals can be assigned HRTF'n of individuals in which the sample audio signals have given a nearly true-to-original spatial hearing impression. If a mobile phone user observes a similar spatial sense in playing one of the pattern audio signals, then this may be taken as an indication that the mobile phone user has an HRTF similar to the HRTF of the individual to whom this pattern audio signal is associated.

In embodiments of the parameterization server according to the teaching disclosed herein, the parameter generator may be configured to evaluate a function in which at least part of the individual hearing system information received by the mobile radio interface is received as an input variable and which supplies the at least one signal processing parameter as an output variable.

According to embodiments of the teaching disclosed herein, the parameterization server may further comprise a billing unit configured to generate billing information regarding a successful generation or transmission of the at least one signal processing parameter to the mobile telephone. The generation of the billing information is typically linked to the successful generation or determination of the at least one signal processing parameter to the mobile phone, so that a reliable billing for the use of the Parametrisierungsservers is possible. The term Parametrisierungsservers is not limited to a single computer in terms of information and communication technology, but may also relate to a server complex or a data center or the entire infrastructure of a corresponding service provider.

A method for generating an audio signal output from a mobile telephone in accordance with the teachings disclosed herein comprises: receiving individual user's hearing instrument information; Determining at least one signal processing parameter adapted to the user with respect to the individual hearing system information; Preparing audio data; Processing the audio data according to the at least one signal processing parameter; and outputting the resulting audio signal to be output from the mobile telephone, which gives the user a spatial auditory impression.

The processing of the audio data according to the at least one signal processing parameter results in the resulting audio signal output from the mobile telephone, possibly after further signal processing steps such as digital-to-analog conversion or amplification, but which do not fundamentally alter the audio signal.

The method may further include transmitting the individual hearing system information via a radio link to a server and receiving the user-adapted, at least one signal processing parameter via the radio link from the server.

In embodiments of the method, it may further include capturing an image at least partially displaying the user that forms at least a portion of the individual hearing system information.

In further embodiments of the method according to the teachings disclosed herein, the method may further include: displaying pattern audio signals to the user; Receiving an evaluation of the pattern audio signals by the user regarding the spatial audio impression; and adding the score to the individual hearing system information.

In embodiments of the method, the processing of the audio data may occur according to a first spatial sound source position. The method may further comprise processing further audio data according to the user-adapted, at least one signal processing parameter and a second spatial sound source position, such that the user perceives the further spatial sound impression data at a distance from the (first) audio data.

By such a spatial separation in the auditory impression of the user of the (first) audio data and the other audio data, the user is typically at the mental separation or Processing of the (first) audio data and the other audio data supported, since he can easily assign the audio data or the other audio data to their respective sources.

A method of providing at least one signal processing parameter adapted to a user such that an output signal processed by the at least one signal processing parameter conveys a spatial audio impression to the user comprises: receiving individual hearing system information from a mobile telephone over a cellular network, the individual hearing system information refer to the user; Generating the at least one signal processing parameter based on the individual hearing system information; and transmitting the customized signal processing parameter to the mobile telephone over the mobile network.

In embodiments in accordance with the teachings disclosed herein, the method may further include: querying a database comprising data sets that include predetermined individual hearing system information and at least one associated signal processing parameter; Selecting at least one record whose individual hearing system information is similar or identical to the individual hearing system information received over the mobile network; and transmitting the at least one associated signal processing parameter to the mobile telephone.

In embodiments of the teachings disclosed herein, the method may further include evaluating a function in which at least a portion of the individual hearing system information received from the mobile interface is received as an input, and which provides the at least one signal processing parameter as an output.

In embodiments according to the teachings disclosed herein, the method may further include: receiving an image at least partially displaying the user via the mobile network; Analyzing the image for at least a portion of the individual hearing system information; and using at least the portion of the individual hearing system information to generate the at least one signal processing parameter.

The method may further include transmitting at least one sample audio signal to the mobile phone via the mobile network and receiving a user rating of the at least one sample audio signal regarding the spatial audio impression as at least a portion of the individual hearing system information.

The method may further include generating accounting information relating to a successful generation of the at least one signal processing parameter or its transmission to the mobile telephone.

Preferred embodiments of the present invention will be subsequently extended with reference to the accompanying drawings. Show it:

1 a schematic block diagram of a mobile phone of an embodiment of the disclosed teaching with a focus on some of the relevant components of the mobile phone;

2 a schematic block diagram of another embodiment of the disclosed teaching;

3 a schematic block diagram of a mobile phone according to another embodiment of the disclosed teaching;

4 a schematic block diagram of a mobile phone according to another embodiment of the disclosed teaching;

5 a schematic representation of a perceived by a user, for example, during a telephone conference spatial sound impression;

6 a schematic block diagram with components of a mobile phone, suitable for implementing the in 5 shown concept;

7 a schematic block diagram of a Parametrisierungsservers according to an embodiment of the disclosed teaching;

8th a schematic block diagram of a Parametrisierungsservers according to another embodiment;

9 a schematic flow diagram of a method for generating an output from a mobile phone audio signal according to the disclosed teaching;

10 a schematic flow diagram of a method for providing at least one signal processing parameter by the Parametrisierungsserver;

11 an illustration of a speaker assembly to achieve so-called surround sound; and

12 a schematic block diagram for user-adapted conversion of a 5-channel audio signal into a 2-channel signal or a headphone signal.

1 FIG. 12 is a schematic block diagram of a cellular phone, showing substantially those components of the cellular phone that are useful in understanding the teachings disclosed herein. A user of the mobile phone 100 gives over an interface 112 individual hearing system information. The individual hearing system information may include general information about the user such as age, sex, height and / or body weight. Alternatively or additionally, the individual hearing system information may include more specific information regarding the user's hearing system, such as a head circumference measured at the ears, a distance of the ears, or dimensions of the pinna (s). This information, which is focused on the user's hearing system, may require the user to take measurements with e.g. B. performs a tape measure or a ruler or can be performed by an assistant. However, these measurements can be relatively easy to carry out and require no further measuring equipment apart from the mentioned household standard measuring devices.

From the interface 112 the individual hearing system information is sent to a parameter adjustment device 114 transmitted. The parameter adjustment device 114 uses the individual hearing system information to determine at least one signal processing parameter, but typically a data set of a plurality of signal processing parameters, that best suits the user. Typically, a signal processing parameter set determined in this manner represents an estimate of a user's HRTF. The signal processing parameter set may also include multiple estimates for multiple HRTF's of the user. The plurality of HRTF'n may be provided, for example, for each one space sector of a user-centered coordinate system, so that the user can make a spatial allocation of an audio signal according to the respective space sector, if the signal processing parameter set has a sufficient match with the natural HRTF of the user.

The signal processing parameter (s) are provided by the parameter adjustment means 114 to an audio signal processor 118 transmitted. The audio signal processor 118 also receives audio data from an audio data source 116 , The from the audio data source 116 provided audio data may either be a pure mono signal, a conventional stereo signal or an audio signal containing surround sound information, such. A 5.0 signal, a 5.1 signal, a 7.1 signal or an MP3 surround signal. If the audio data is a mono signal, the audio signal processor 118 specify a fictitious standard sound source position that can be used for a so-called binaural rendering. For example, this standard sound source position can be assumed to be directly in front of the user in about 2 m distance. Similarly, standard positions can be assumed for the left and right channels of a stereo signal. Special HRTFs may be provided for these standard positions, so that corresponding mono or stereo signals can be binaurally rendered as faithfully as possible for these standard positions. If the audio data is in a format that already contains extensive surround sound information, such as: B. a 5.1 signal, then the individual channels are basically assigned to different speakers, which are positioned in a particular arrangement around the user. The positions of the individual loudspeakers are described in various standards of the ITU (International Telecommunication Union). However, playback of a 5.1 signal via speakers in accordance with the ITU standard is primarily intended for home theater applications and is impractical in connection with mobile phones or other portable devices. The user of the mobile phone is therefore typically on a headset 122 To fall back on. In connection with the reproduction of z. B. 5.1 audio data, it is therefore necessary, the five or six channels so on the headphone 122 that the user experiences substantially the same sound impression as if the 5.1 audio signal were being reproduced through, for example, a suitable home cinema speaker system. Typically, for each of the loudspeaker positions specified in accordance with the ITU standard, at least one HRTF is obtained from the parameter adjustment device 114 provided as faithful as possible a faithful reproduction of the 5.1 signal on the headphones 21 is desired.

2 shows a schematic block diagram of a mobile phone 100 another. Embodiment. the interface 112 , the audio data source 116 and the audio signal processor 118 are already out 1 are known and perform essentially the same functions as in connection with 1 described. The parameter adjustment device 214 from 2 differs from the parameter adjustment device 114 of the 1 , In the 2 shown parameter adjustment device 214 is with a radio interface 215 connected. The parameter adjustment device 214 can be the one from the interface 112 received individual hearing system information to the radio interface 215 hand off. In the opposite direction, the parameter adjustment device 214 the at least one signal processing parameter from the radio interface 215 received and to the audio signal processor 118 pass on. The radio interface 215 in turn is over an antenna with a mobile network 216 in connection. A server 700 is also connected to the mobile network 216 connected. The radio interface 215 sends the individual hearing system information over the mobile network 216 to the server 700 , The server 700 then performs a determination of the at least one signal processing parameter that matches the individual hearing system information. The at least one signal processing parameter is provided by the server 700 over the mobile network 216 to the radio interface 215 of the mobile phone 100 Posted. In particular, if the generation of the at least one signal processing parameter contains the query of a database in which the data records which are best matched to the individual hearing system information are searched, it makes sense to maintain this database on a central server, as this results in a shipment of large amounts of data via the mobile network 216 or another medium can be avoided. Instead, only small amounts of information in the form of the individual hearing system information and the user-adapted signal processing parameter over the mobile network 216 sent. Also eliminates the need to use the database on the mobile phone 100 save. The parameter adjustment device 214 typically serves mainly as a connection between the interface 112 , the radio interface 215 and the audio signal processor 118 , The parameter adjustment device 214 However, it can also perform other tasks, such as: B. a user profile management for the signal processing parameters, if the mobile phone 100 used by several different users. By a user profile management, the previously generated signal processing parameters can be loaded for this user in a user change, without the more complex re-determination of the signal processing parameters is necessary. Also in 1 shown signal processing device 114 can have a corresponding functionality. In addition, other tasks are conceivable, the parameter adjustment device 114 . 214 can perceive.

3 shows a schematic block diagram of a mobile phone 100 according to another embodiment. The individual hearing system information can also be obtained in part from images that represent the user or his hearing system. For example, in particular, the shape and size of the pinnae can provide clues to how an individual perceives sounds, since the three-dimensional shape of the pinna acts on incoming sound waves as an acoustic filter, which vaporizes certain frequencies while allowing others to pass unchanged. Furthermore, conclusions about the hearing system can be obtained from a portrait of the user, such. As the distance of the ears and their positioning relative to the head. In order to be able to use the individual hearing system information contained in an image recording, the mobile telephone can use an image recording device 311 include, with which an image of the user or of his ears can be recorded. Alternatively, the image pickup device may also be external to the mobile phone 100 present, as indicated by the dashed line. One from the image capture device 311 taken picture 301 gets to the interface 312 forwarded. If necessary, further individual hearing system information is added, as in relation to the 1 have been described. the interface 312 gives the individual hearing system information, ie the picture 301 and the further individual hearing system information collected to the parameter adjustment device 314 further. The parameter adjustment device 314 directs the picture 301 to an image processing device 317 further. The image processing device 317 does not necessarily have to be part of the mobile phone 100 but may, for example, be executed on a user's universal computer with appropriate software. The image processing device 317 analyzes the picture 301 for features contained therein that may be used as individual hearing system information. The way out of the picture 301 extracted individual hearing system information is sent to the parameter adjustment means 314 returned.

When taking the picture 301 through the image capture device 311 For example, the user may be instructed to position a reference measurement item in the image pickup area such that the image 301 also contains an illustration of the comparison measure element. As a comparative measure, a ruler can be used or certain normalized objects of everyday life, such. For example, certain coins. By in the picture 301 contained image of the comparison measure element, the image processing device 317 normalize the image independently of an image acquisition geometry and thus relatively accurate readings for in the image 301 determine the dimensions shown. Accordingly, the image processing device 317 include a size normalization module. The method for generating an audio signal output from a mobile telephone may include a step of having the in the image 301 contained image of the comparison measure element is detected and measured, so that a subsequent step of normalizing the image 301 can be carried out.

Notwithstanding the in 3 illustrated arrangement of parameter adjustment means 314 and image processing equipment 317 can the image processing device 317 be associated with other of the components shown. For example, the image processing device 317 directly with the image pickup device 311 be connected and the result of image processing can be to the interface 312 be handed over.

Further processing by the parameter adjustment means 314 provided signal processing parameter corresponds substantially to that of 1 ,

4 shows a block diagram of a mobile phone 100 according to another embodiment of the teaching disclosed herein. In order to determine the signal processing parameters adapted to the user, the user is presented with sample audio signals which are to be evaluated by the user with regard to a spatial sound impression. The pattern audio signals are, for example, in a database or a memory area 425 stored from where they are sent to the audio data source 416 be transmitted. The audio data source 416 can now play the pattern audio either directly, for example, as a stereo signal through the headphones 122 , In this case they are in the memory 425 stored sample audio signals already mixed or processed as a stereo signal so that for some listeners a strong spatial sound impression is created. In this case, the audio data source indicates 416 the pattern audio signal directly to the headphones 122 out, ie bypassing the audio signal processor 118 , Another possibility is to generate generic pattern audio signals in conjunction with prepared signal processing parameters using the audio signal processor 118 to play (dashed arrows in 4 ). The from the database 425 The prepared, prepared signal processing parameters can be varied so that different spatial sound impressions result for the user when reproducing one and the same generic pattern audio signal.

Regardless of the method used to render the sample audio signals, the user may assess the respective spatial sound impressions across the interface 112 from where they are sent to the parameter adjuster 414 be transmitted. The parameter adjustment device 414 receives from the database of sample audio signals 425 also an identification number (ID) of the last reproduced sample audio signal or a set of prepared signal processing parameters. The evaluations of the pattern audio signals, together with the associated identification numbers, form the individual hearing system information by means of which the user-adapted signal processing parameter (s) can be determined.

In the case where the pattern audio signals are formatted as stereo signals so mixed that the spatial sound impression (at least for some listeners) is inherently contained in the pattern audio signal, the pattern audio signals can be obtained as follows. Performing a pattern matching based on sample audio signals typically requires reference data from individuals for whom a conventional measurement, such as HRTF, has been performed. The pattern audio signals can now be obtained by providing the reference individual with microphones, preferably miniature microphones, placed at the inputs of the respective auditory canals of the reference individual. The microphones at the inputs of the auditory canal of the reference individual then record sound signals as they are also essentially perceived by the reference individual. Thus, various pattern audio signals can be generated by playing different sounds from different relative positions to the reference individual. The pattern audio signals generated in this way are stored with reference to the HRTF associated with the reference individual (possibly also several HRTF'n), so that an assignment is possible if a user rates the pattern audio signals as particularly expressive with respect to a spatial sound impression.

5 illustrates a possible application of a mobile phone according to the teachings disclosed herein. For example, suppose the user is a participant in a four-party conference call. A typical problem with telephone conferences is that it is often difficult for the individual subscribers to assign which of the other subscribers has said something, since the signals all arrive as a mono audio signal to the user. The teaching disclosed herein enables each of the other subscribers 1 to 3 to have a particular spatial position for the purposes of audio signal processing by the audio signal processor 118 is assigned. So the participant 1 is in a position 1, which is at + 45 ° in front of the user. Participant 2 is at position 2, which is directly in front of the user (0 °). The participant 3 is at a position 3, which is at an angle of 45 °. The user can then distinguish the participants 1 to 3 better due to the direction from which the user perceives the respective participant acoustically.

If the audio signals of the participants 1 to 3 arrive at the user via a common channel, for example from one Telephone conference service providers, additional, inaudible signals can be added to the audio signals, which provide information about the origin of the audio signals.

6 shows a schematic block diagram, with the in 5 Functionality shown can be implemented. The mobile phone includes a cellular module 610 which is designed to support multiple voice connections simultaneously (three voice connections in the example shown). The three signals are sent to the audio signal processor 618 transmitted. In addition, the mobile module transmits 610 also information about the voice connections to the parameter adjustment device 614 , such as As the number of existing voice connections. The parameter adjustment device 614 then generates a corresponding number. of position parameter sets, which are also sent to the audio signal processor 618 be transmitted. The audio signal processor 618 performs binaural rendering of the three signals using the three position parameter sets so that the output signal sounds to the user as if it came from a direction of + 45 °, whereas the output signals 2 and 3 from the directions 0 ° and 45 ° seems to come.

7 shows a schematic block diagram of a parameterization server 700 according to the teaching disclosed herein. The server 700 is via a mobile network 216 with a mobile phone 100 in connection. For this purpose, the server comprises a mobile radio interface 715 , The mobile radio interface 715 is not necessarily to be understood as hardware that is necessary for mobile communication (in the sense of transmit-receive part, antenna, etc.). Rather, the mobile interface 715 a general connection to the mobile network 216 however, it may include several intermediate stations as appropriate. In particular, the server may be with one or more base stations of the mobile network 216 be connected, which establish the radio connection with the mobile phone.

The mobile phone 100 sends individual hearing system information over the cellular network 216 to the server 700 , The individual hearing system information meet at the mobile radio interface 715 and are sent to a parameter generator 714 passed in its function with the parameter adjustment means 114 . 314 and 414 is comparable. The parameter generator 714 determines signal processing parameters adapted to the user based on the individual hearing system information. The user-adapted signal processing parameters are transmitted via the mobile radio interface 715 and the mobile network 216 back to the mobile phone 100 Posted. The mobile phone 100 uses the transmitted signal processing parameters to process audio signals for each user in such a way that a realistic spatial sound impression is created for this user.

8th shows a schematic block diagram of another embodiment of the parameterization server 800 , The parameter generator 814 now includes a database 840 and a function evaluation 850 , Database 840 and the function evaluation 850 however, they do not have to be both at the same time. Furthermore, the parameterization server includes 800 a database for sample audio signals 825 and an image processing device 817 , Again, the database of pattern audio signals 825 and the image processing device 817 may be optional, but need not be present. In this respect shows 8th an embodiment in which several optional components are combined without this being the only possible combination.

As for 7 described, receives the Parametrisierungsserver 800 individual hearing system information from the mobile phone 100 over the mobile network 216 , The individual hearing system information meet at the mobile radio interface 815 of the parameterization server 800 and are sent to the parameter generator 814 forwarded. Database 840 of the parameter generator 814 typically includes data sets containing hearing system information from reference individuals as well as signal processing parameters determined for those reference individuals. By querying the database 840 Using the individual hearing system information records from the database 840 in which the hearing system information is similar to the individual hearing system information provided by the mobile phone 100 were transmitted. Unless the database 840 sufficiently dense and evenly filled with data sets of different reference individuals, can usually be a. Record whose signal processing parameters come close enough to the HRTF of the mobile phone user.

Additionally or alternatively to the query of the database 840 A function can also be evaluated, which can be done with the help of the function evaluation device 850 happens. Merely for ease of illustration, the function that maps a two-dimensional input to a one-dimensional output is shown. In general, the function will be a mapping from the R ⁿ into the R ^m . For example, the function may be based on a mathematical model, interpolate between empirically determined vertices, or a combination of both.

Another way to determine the user-adapted signal processing parameters is to have the user evaluate pattern audio signals as described in connection with FIG 4 was explained. In contrast to the embodiment according to 4 Here are the sample audio signals in the sample audio signal database 825 of the parameterization server 800 saved. Thus, the pattern audio signals are transmitted via the mobile radio interface 815 and the mobile network 216 to the mobile phone 100 transferred to be played there for the user.

The user evaluates the pattern audio signals from the mobile phone 100 back to the parameterization server 800 Posted. From this point on, the determination of the signal processing parameters broadly corresponds to those relating to 4 was explained.

The image processing device 817 of the parameterization server 800 may be used when at least a portion of the individual hearing system information is in the form of an image of the user or their hearing system. The picture is taken from the mobile phone 100 to the parameterization server 800 via mobile network 216 transmitted. Within the parameterization server 800 becomes the image of the image processing device 817 which extracts from the image features. These features may then be provided by the parameter generator 814 be used to determine the best possible signal processing parameters to the user. By and large, here too, the processing of the picture corresponds to those relating to the 3 was explained.

Database 840 , the function evaluation device 850 , the database of sample audio signals 825 and the image processing device 817 typically require access to a large enough database to perform their tasks. A transmission of a database via the mobile network 216 to the mobile phone 100 is typically undesirable because of the large amount of data to be transferred. In addition, such a database is relatively valuable because it required many elaborate HRTF determinations with reference individuals to create them. For this reason one will strive to be the database of the database 840 , the function evaluation device 850 , the pattern audio signals 825 and the image processing device 817 to protect against alien, unauthorized access as much as possible.

The parameterization server 800 also includes an optional billing unit 830 that with the mobile radio interface 815 and / or the parameter generator 814 is in communication and receives from this information about whether a generation of a user-adapted signal processing parameter has occurred. For this purpose, an identification number of the mobile phone 100 or the SIM card used in it. The billing information may then be communicated to a mobile service provider using the mobile phone 100 or the SIM card is registered.

9 FIG. 12 is a schematic flow diagram of the method for generating an audio signal output from a mobile telephone in accordance with the teachings disclosed herein. After the start of the procedure will be at 902 first receive individual user's system information. The individual hearing system information of the user may be of different types as described above with respect to e.g. B. the 1 to 4 , At the with 904 at least one signal processing parameter adapted to the user with regard to the individual hearing system information is determined. In many cases this can be done by comparison with reference data. With 902 and 904 typically called actions are once for each user of the mobile phone 100 executed. Thereafter, the signal processing parameters adapted to the user are generally permanently available to the mobile telephone and are stored by the mobile telephone for later use. The actions described below 906 . 908 and 910 can be run every time when the user of the mobile phone 100 a surround-sound-faithful reproduction of audio data wishes. To be at 906 the audio data is first provided. at 908 The audio data is then processed according to the user-adapted signal processing parameters. The resulting output signal is then included in the action 910 output to the user, typically via a headphone.

10 FIG. 12 shows a schematic flowchart for the method of providing at least one signal processing parameter according to the teachings disclosed herein. After the start of the procedure will be at 1002 receive individual hearing system information of the user via a mobile network. at 1004 At least one signal processing parameter adapted to the user is generated. Typically, a whole set of user-adapted signal processing parameters are generated which allow an audio signal processor of the mobile phone to process an audio signal in such a way as to give the user, to whom the signal processing parameters are adapted, the most realistic spatial sound impression. The at least one user-adapted signal processing parameter is transmitted back to the user or the mobile telephone via the mobile radio network 100 transmitted as in 1006 of in 10 to see flowchart shown. The method then ends for providing the at least one signal processing parameter. The method can be over the in 10 activities shown 1002 . 1004 and 1006 include other activities, such as For example, performing image processing, providing pattern audio or generating billing information.

11 shows a speaker assembly with respect to a user according to the standard referred to as 5.1. The 5.1 standard is used for realistic reproduction of surround sound audio in cinemas and home theaters. He also finds application in the playback of music recordings that are encoded in the required format. According to the 5.1 standard, five equal speakers are placed on a circle around the listener. In front of the listener are a left speaker L, a center speaker C and a right speaker R. Left and right laterally offset from the listener and slightly to the rear are a left surround speaker LS and a right surround speaker RS. A woofer or subwoofer (SUB) completes the 5.1 speaker system. The woofer or LFE loudspeaker (low frequency effect) is primarily intended for low-frequency portions of the audio signal, which are poor or impossible to locate by humans. Therefore, the woofer can be positioned at an arbitrary position near the listener. If the woofer is omitted, you get a 5.0 speaker system, where the low-frequency audio signal components are played back via the five main speakers.

With a speaker system like it in 11 Realistic surround sound inventions can be achieved at the listener located at the designated location. The DVDs or Blu-ray discs used in home theater applications often have 5.0 or 5.1 soundtracks, which can be played back via a like in 11 shown speaker system are provided to achieve the desired Raumklang effect.

In connection with a mobile phone, however, often only playback via either an internal speaker of the mobile phone or a headphone is possible. When playing back via the internal speaker of the mobile phone, you usually have to make major cuts in terms of sound quality and surround sound. Frequently, only one mono playback is possible via the internal loudspeaker of the mobile phone. When playing via a headphone, on the other hand, a good to very good sound quality as well as a spatial sense of sound in the listener can be achieved. However, the latter requires that the signals for the left earphone and the right earphone be processed so that they simulate the HRTF of the respective user. For example, if there is a 5.0-format or 5.1-format audio signal for playback through the headphones 122 is to be processed, this requires that an audio signal component usually radiated from the left speaker L must be converted into a left earphone signal component and a right earphone signal component. It must be taken into account that the sound propagates from the left speaker L to the left ear of the listener differently than to the right ear of the listener (see 11 ). The effects of sound propagation from the left speaker L to the two ears must be taken into account when converting a 5.0 or 5.1 audio signal into a headphone signal.

12 shows a schematic block diagram that allows such a conversion. With L, R, C, LS and RS are in 12 denotes the individual subchannels of a 5.0 signal that are to be converted for playback via headphones. This will be explained by way of example with reference to the signal L provided for the left main loudspeaker. The signal L is input to a function block 1202 transmitted. The function block 1202 calculates an output signal resulting from the input signal L and the user-adjusted HRTF _L , where the HRTF _{L is} the head-related transfer function between the left speaker L and the ears of the listener (see 11 ). The function block 1202 has two outputs, one for the left earphone and one for the right earphone. The output signal of the function block 1202 for the left earphone is connected to a signal adder or combiner 1222 transmitted. The output signal of the function block 1202 for the right earphone is to a signal adder or combiner 1224 transmitted. At the signal adders or combiners 1222 and 1224 also become the respective output signals of the function blocks 1204 . 1206 . 1208 and 1210 transmitted to the corresponding headphone (left or right), so that at the outputs of the signal adder 1222 and 1224 each one overlay signal for the left earphone and the right earphone results.

The functional blocks 1202 to 1210 are provided with the appropriate head-related transfer functions (HRTF _L , HRTF _R , HRTF _C , HRTF _LS and HRTF _RS ). These customized HRTF'n are provided by the parameter customizer 114 of the mobile phone 100 to the function blocks 1202 to 1210 transmitted.

Although some aspects have been described in the context of a device, it will be understood that these aspects also constitute a description of the corresponding method, so that a block or a component of a device is also to be understood as a corresponding method step or as a feature of a method step. Similarly, aspects described in connection with or as a method step also represent a description of a corresponding block or detail or feature of a corresponding device. Some or all of the method steps may be performed by a hardware device (or using a hardware device). Apparatus), such as a microprocessor, a programmable computer or an electronic circuit. In some embodiments, some or more of the most important method steps may be performed by such an apparatus.

A signal such as an audio signal, a video signal or a data signal may be stored on a digital storage medium or may be stored on a transmission medium such as a wireless transmission medium or a wired transmission medium, e.g. As the Internet, are transmitted.

Depending on particular implementation requirements, embodiments of the invention may be implemented in hardware or in software. The implementation may be performed using a digital storage medium, such as a floppy disk, a DVD, a Blu-ray Disc, a CD, a ROM, a PROM, an EPROM, an EEPROM or FLASH memory, a hard disk, or other magnetic disk or optical memory are stored on the electronically readable control signals that can cooperate with a programmable computer system or cooperate such that the respective method is performed. Therefore, the digital storage medium can be computer readable.

Thus, some embodiments according to the invention include a data carrier having electronically readable control signals capable of interacting with a programmable computer system such that one of the methods described herein is performed.

In general, embodiments of the present invention may be implemented as a computer program product having a program code, wherein the program code is operable to perform one of the methods when the computer program product runs on a computer.

The program code can also be stored, for example, on a machine-readable carrier.

Other embodiments include the computer program for performing any of the methods described herein, wherein the computer program is stored on a machine-readable medium.

In other words, an embodiment of the method according to the invention is thus a computer program which has a program code for performing one of the methods described herein when the computer program runs on a computer.

A further embodiment of the inventive method is thus a data carrier (or a digital storage medium or a computer-readable medium) on which the computer program is recorded for carrying out one of the methods described herein.

A further embodiment of the method according to the invention is thus a data stream or a sequence of signals, which represent the computer program for performing one of the methods described herein. The data stream or the sequence of signals may be configured, for example, to be transferred via a data communication connection, for example via the Internet.

Another embodiment includes a processing device, such as a computer or a programmable logic device, that is configured or adapted to perform one of the methods described herein.

Another embodiment includes a computer on which the computer program is installed to perform one of the methods described herein.

Another embodiment according to the invention comprises a device or system adapted to transmit a computer program for performing at least one of the methods described herein to a receiver. The transmission can be done for example electronically or optically. The receiver may be, for example, a computer, a mobile device, a storage device or a similar device. For example, the device or system may include a file server for transmitting the computer program to the recipient.

In some embodiments, a programmable logic device (eg, a field programmable gate array, an FPGA) may be used to perform some or all of the functionality of the methods described herein. In some embodiments, a field programmable gate can interact with a microprocessor to perform any of the methods described herein. In general, in some embodiments, the methods are performed by any hardware device. This may be a universal hardware such as a computer processor (CPU) or hardware specific to the process, such as an ASIC.

The embodiments described above are merely illustrative of the principles of the present invention. It will be understood that modifications and variations of the arrangements and details described herein will be apparent to others of ordinary skill in the art. Therefore, it is intended that the invention be limited only by the scope of the appended claims and not by the specific details presented in the description and explanation of the embodiments herein.

Claims (23)

Mobile phone ( 100 ), comprising: an interface ( 112 ) for receiving individual hearing system information of a user of the mobile phone; a parameter adjustment device ( 114 ) for providing at least one signal processing parameter adapted to the individual hearing system information to the user; an audio data source for providing audio data; an audio signal processor ( 118 ) for receiving the audio data from the audio data source ( 116 ) and the at least one user-adapted signal processing parameter, for processing the audio data in accordance with the at least one signal processing parameter and for providing a resulting output signal, which gives the user a spatial hearing impression. Mobile phone ( 100 ) according to claim 1, further comprising a radio interface, the individual hearing system information from the interface ( 112 ) for the individual hearing system information and to transmit to a server, and further adapted to receive the adapted to the user, at least one signal processing parameter from the server and to the audio signal processor ( 118 ) to hand over. Mobile phone ( 100 ) according to claim 1 or 2, further comprising: an image pickup device ( 311 ), forms at least part of the individual hearing system information in the form of an image, which at least partially shows the user, for the parameter adjustment device ( 114 ). Mobile phone ( 100 ) according to one of claims 1 to 3, wherein the audio data source ( 116 ) is adapted to provide pattern audio signals for reproduction to the user, and wherein the interface ( 112 ) for receiving the individual hearing system information is configured to receive an evaluation of the pattern audio signals by the user with respect to the spatial audio impression as at least a part of the individual hearing system information. Mobile phone ( 100 ) according to one of claims 1 to 4, wherein the audio signal processor ( 118 ) is configured to process at least two audio data streams of different origin such that the user perceives the at least two audio data streams spaced from each other in accordance with the spatial hearing impression. Mobile phone ( 100 ) according to one of claims 1 to 5, wherein the audio data source ( 116 ) at least one of: a mobile receiving part, an internal memory of the mobile phone, a removable medium, a computer connected via an online connection, and a streaming media connection. Parameterization server ( 700 . 800 ) comprising: a parameter generator ( 714 ) for providing a signal processing parameter adapted to a user based on individual hearing system information; a mobile network interface ( 715 ) for receiving the individual hearing system information from a mobile phone ( 100 ) relating to the user of the mobile telephone and for transmitting the user-adapted signal processing parameter to the mobile telephone ( 100 ) for processing audio data by the mobile phone ( 100 ) in accordance with the at least one signal processing parameter and for providing a resulting output signal which gives the user a spatial hearing impression. Parameterization server according to claim 7, wherein the parameter generator ( 714 ) a database ( 840 ) comprising data sets which comprise previously determined individual hearing system information and at least one associated signal processing parameter, and wherein the parameter generator ( 714 ) is configured to select at least one record whose individual Hearing system information is similar or identical to the received via the mobile interface individual hearing system information, and the at least one associated signal processing parameters to the mobile phone ( 100 ). Parameterization server according to claim 7 or 8, wherein the parameter generator ( 714 ) is configured to evaluate a function, in which at least part of the received from the mobile interface, individual hearing aid information is received as an input, and which provides the at least one signal processing parameter as an output variable. Parameterization server according to one of claims 7 to 9, further comprising: an image processing device ( 817 ) adapted to receive an at least partially displayed image from the mobile radio interface and to analyze the image with respect to at least a portion of the individual hearing system information, and to provide at least the portion of the individual hearing system information to the parameter generator ( 714 ). Parameterization server according to one of claims 7 to 10, further comprising: a sample audio signal collection ( 825 ) with pattern audio signals; wherein the mobile radio interface is formed, at least one of the pattern audio signals to the mobile phone ( 100 ) and from the mobile phone ( 100 ) receive a user rating of the at least one sample audio signal with respect to the spatial audio impression as at least a portion of the individual hearing system information. Parameterization server according to one of claims 7 to 11, further comprising a billing unit ( 830 ) configured to generate billing information relating to a successful generation or transmission of the at least one signal processing parameter to the mobile telephone ( 100 ). Method for generating a mobile telephone ( 100 ) audio signal, comprising: receiving individual hearing system information from the user; Determining at least one signal processing parameter adapted to the user with respect to the individual hearing system information; Providing audio data; Processing the audio data according to the at least one signal processing parameter; Output the resulting, from the mobile phone ( 100 ) output audio signal that gives the user a spatial hearing. The method of claim 13, further comprising: transmitting the individual hearing system information via a radio link to a server ( 700 . 800 ); Receiving the at least one signal processing parameter adapted to the user via the radio link from the server. The method of claim 13 or 14, further comprising: Capturing an image at least partially displaying the user that forms at least a portion of the individual hearing system information. The method of any one of claims 13 to 15, further comprising: Playing pattern audio signals to the user; Receiving an evaluation of the pattern audio signals by the user regarding the spatial audio impression; Add the rating to the individual hearing system information. A method according to any one of claims 13 to 16, wherein the processing of the audio data is according to a first spatial sound source position, and wherein the method further comprises: Processing further audio data according to the user-adapted, at least one signal processing parameter and a second spatial sound source position, such that the user perceives the further audio data with respect to the spatial audio impression at a distance from the audio data. A method for providing at least one signal processing parameter adapted to a user so that an output signal processed by the at least one signal processing parameter conveys a spatial audio impression to the user, the method comprising: receiving individual hearing system information from a mobile telephone ( 100 ) via a mobile network, wherein the individual hearing system information relates to the user; Generating the at least one signal processing parameter based on the individual hearing system information; Transmission of the user-adapted signal processing parameter to the mobile telephone via the mobile radio network ( 100 ). The method of claim 18, further comprising: querying a database comprising records that have predetermined individual ones Comprise hearing system information and at least one associated signal processing parameter, selecting at least one data set whose individual hearing system information is similar or identical to the individual hearing system information received via the mobile radio network; Transmitting the at least one associated signal processing parameter to the mobile telephone ( 100 ). The method of claim 18 or 19, further comprising: Evaluating a function, in which at least part of the received from the mobile interface, individual hearing aid information is received as an input, and which provides the at least one signal processing parameter as an output variable. The method of any one of claims 18 to 20, further comprising: Receiving an image at least partially displaying the user via the mobile network; Analyzing the image with regard to at least a portion of the individual hearing system information, Use at least the portion of the individual hearing system information for generating the at least one signal processing parameter. Method according to one of claims 18 to 21, further comprising: transmitting at least one sample audio signal over the mobile radio network to the mobile telephone ( 100 ); Receiving a user rating of the at least one sample audio signal with respect to the spatial audio impression as at least a portion of the individual hearing system information. Method according to one of claims 18 to 22, further comprising: generating billing information relating to a successful generation or transmission of the at least one signal processing parameter to the mobile telephone ( 100 ).

Images