EP2182744B1 - Replaying a sound field in a target sound area - Google Patents

Replaying a sound field in a target sound area Download PDF

Info

Publication number
EP2182744B1
EP2182744B1 EP08167919A EP08167919A EP2182744B1 EP 2182744 B1 EP2182744 B1 EP 2182744B1 EP 08167919 A EP08167919 A EP 08167919A EP 08167919 A EP08167919 A EP 08167919A EP 2182744 B1 EP2182744 B1 EP 2182744B1
Authority
EP
European Patent Office
Prior art keywords
sound field
reproduced
decomposition
drive signal
desired position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP08167919A
Other languages
German (de)
French (fr)
Other versions
EP2182744A1 (en
Inventor
Jens Ahrens
Sascha Spors
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Deutsche Telekom AG
Original Assignee
Deutsche Telekom AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Deutsche Telekom AG filed Critical Deutsche Telekom AG
Priority to AT08167919T priority Critical patent/ATE524029T1/en
Priority to EP08167919A priority patent/EP2182744B1/en
Publication of EP2182744A1 publication Critical patent/EP2182744A1/en
Application granted granted Critical
Publication of EP2182744B1 publication Critical patent/EP2182744B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/302Electronic adaptation of stereophonic sound system to listener position or orientation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2420/00Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/13Application of wave-field synthesis in stereophonic audio systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/302Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303Tracking of listener position or orientation

Definitions

  • the present invention relates to the reproduction or reconstruction of a sound field in a target sound area with the aid of a plurality of loudspeakers.
  • the technique of wave field synthesis can be used.
  • This technique uses a large number of loudspeakers and thereby avoids the problem that in an area within the loudspeaker arrangement, the so-called "sweet spot", the reconstruction of the desired sound field is significantly more accurate than in the rest of the listening area, as is the case for example with the stereo.
  • Technique in stereo, however, a soundfield is not physically reconstructed, but two speakers create an illusion that sounds very similar to the natural model, but has very different physical properties.
  • stereo there is a sweet spot in that the illusion sounds most authentic at this point).
  • the speaker drive signals for each speaker are calculated analytically.
  • Ambisonics Another known technique for reconstruction of a sound field is called Ambisonics and is for example in the WO 2005/015954 A2 described.
  • This technique requires circular or spherical arrangements of loudspeakers, where the loudspeaker signals are generated using numerical algorithms.
  • the limitation of the spatial bandwidth of the drive signals necessary in the calculation path causes the reconstruction of the desired sound field in the center of the loudspeaker arrangement to be most accurate. In the center of the loudspeaker arrangement is therefore a sweet spot. With increasing distance from the center of the loudspeaker arrangement, the deviations in the reconstructed sound field become larger.
  • the arrangement of the loudspeakers should be subject to as few restrictions as possible.
  • the present invention provides a method and a device for reproducing a sound field in a target sound area.
  • electroacoustic transducers ie loudspeakers
  • a drive signal for the electroacoustic transducer is determined analytically.
  • a resulting sound field which corresponds exactly in an area around the center of the contour, the sweet spot, the sound field to be reproduced.
  • the greater the distance from the center the greater the deviations from the sound field to be reproduced, which is inherent in the analytical determination.
  • the analytical determination can be achieved according to a known method by analytically solving an integral equation describing the sound field to be reproduced.
  • the components of the integral equation can be decomposed into orthogonal basis functions, for example by Fourier decomposition.
  • the desired sound field is thus decomposed into basic functions which are orthogonal on the contour on which the loudspeakers are located.
  • the desired sound field is then tape-bound with respect to the decomposition around the desired sweet spot.
  • the desired sound field is band-limited with respect to the decomposition around the center of the loudspeaker arrangement.
  • the connection between the two decompositions represents mathematical translation theorems.
  • the starting point is in any case an integral equation.
  • the loudspeaker drive signals can be obtained via the relationships of the Kirchhoff-Helmholtz integral (as in wave field synthesis).
  • the detected drive signal is changed such that the area where the resulting sound field corresponds to the sound field to be reproduced is shifted from the center of the contour to a desired position within the target sound area.
  • This can be done for example by means of mathematical translation theorems.
  • the desired position can be predetermined at a fixed position, but it can also be shifted depending on the position of a receiver. In the latter case, the change of the drive signal then preferably takes place in real time. For example, this method can then be used to determine a position of a receiver within the target sounding area and then to change the control signal in such a way that the desired position is adjusted accordingly.
  • the changed drive signal is supplied to the electroacoustic transducers.
  • the converters convert the input electrical signals into sound signals, and emit them into the target PA range.
  • the present invention also provides an apparatus for reproducing a sound field in a target sound area.
  • the device has a plurality of electroacoustic transducers arranged on a contour surrounding the target sound area, and a processing module.
  • the processing module is able to analytically determine from signals about the desired position and audio input signals a drive signal for the electroacoustic transducers and to change the drive signal such that the sweet spot, ie the area in which the resulting sound field corresponds to the sound field to be reproduced, is moved to the desired position.
  • the drive signals can be amplified by means of an amplifier unit and supplied to the electroacoustic transducers.
  • the area where the reconstruction of the desired sound field is most accurate can be shifted to a desired position.
  • the playback can be optimized to any location within the Zielbeschallungs Kunststoffs. This shift or translation can be performed in real time, so that the playback can be tracked, for example, to a moving receiver.
  • the determination of the location of the receiver can be carried out here by means of sensors, for example a camera.
  • the invention can be used to reproduce audio signals, in particular multi-channel audio signals.
  • the audio signals can be provided by a variety of devices, such as CD, DVD or Blu-ray Disc devices, MP3 devices, computers or the like.
  • the reproduced audio signals may be MPEG2 or MPEG4 signals, for example, or be in a Dolby format.
  • Fig. 1 schematically a device according to an embodiment of the present invention is shown.
  • On a contour 11 to a target PA range 10 more speakers 20 are arranged.
  • the drive signals for the speakers 20 are in a processing module 30 determined and supplied via an amplifier unit 31 to the speakers 20.
  • the processing module 30 is fed with information 1 about the current location for which the sound reconstruction is to be optimized, ie the so-called sweet spot or the sweet area, and audio input signals 2.
  • the sweet spot should be located within the target PA area 10.
  • the processing module 30 receives a third input signal 3 which carries information about the desired sound field (eg position of the virtual sound source).
  • the drive signal is first of all calculated analytically, for example according to the method described in the above-mentioned publication by J. Ahrens and S. Spors.
  • the integral here is a surface or line integral, depending on whether the calculation is to take place in three dimensions or only in one plane.
  • the continuous drive function can be described as follows: P v and G v the decomposition coefficients of the sound field and the transfer function are in this case. Again, this is just one example of the description of the continuous drive function. This example applies to the two-dimensional viewing of circular loudspeaker arrangements.
  • the center of the decomposition is shifted in the loudspeaker drive signal D equation shown above. This can be done for example by means of various mathematical translation theorems.
  • the playback can be optimized to any location within the speaker assembly.
  • the inherent sweet spot may be constrained by limiting the spatial bandwidth of the sound field to be reproduced P, which is a function of the location and the frequency, are shifted with respect to the center of the decomposition different from the center of the speaker arrangement.
  • the sweet spot or the sweet area is then arranged around this new center of decomposition.
  • the decomposition of the sound field around any center x c with a restricted bandwidth 2M + 1 can be represented as follows:
  • r 'and ⁇ ' denote the location coordinates with respect to a local coordinate system whose origin is at x c
  • J ⁇ denotes the ⁇ -th order Bessel function
  • P denotes the decomposition coefficients of the sound field.
  • the decomposition coefficients are required with respect to the decomposition around the origin of the global coordinate system whose axes are parallel to those of the local coordinate system.
  • theorem for harmonic cylinder functions can be used in the above equation:
  • Such a translation of the decomposition center can be carried out in real time, so that the reproduction can be tracked, for example, to a moving receiver.
  • a camera can be used to determine the position of the receiver and then optimize the playback to that position.
  • the determination of the position of the receiver can also be done by a sensor that the listener carries, for example, in his pocket with it.
  • Fig. 2 is shown the sound field generated by the speakers.
  • the loudspeakers are located on the circular contour indicated by dashed lines, which surrounds the target PA range.
  • Fig. 2a the sound field is shown to result from the analytical determination by the method described above.
  • the sweet spot shown by the marked point is at the center of the contour.
  • the present invention allows the sweet spot inherent in the system to track so that the sound field reproduction is optimal for the selected receiver.
  • the corresponding sound field is in Fig. 2b shown, the only shifted sweet spot in turn marked with a cross.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The method involves determining control signal for electro-acoustic transducer in an analytical manner, so that resulting sound field corresponds in an area around the center of the contour of the reproduced sound field. The control signal is changed so that the area, in which the resulting sound field reproduces sound field, is moved to a desired position within acoustic target area (10). The amended control signal is supplied to electro-acoustic transducer. An independent claim is included for a device for reproducing a sound field in a target area.

Description

Die vorliegende Erfindung betrifft die Wiedergabe beziehungsweise die Rekonstruktion eines Schallfeldes in einem Zielbeschallungsbereich mit Hilfe mehrerer Lautsprecher.The present invention relates to the reproduction or reconstruction of a sound field in a target sound area with the aid of a plurality of loudspeakers.

Zur authentischen physikalischen Rekonstruktion eines Schallfeldes über einen ausgedehnten Bereich kann die Technik der Wellenfeldsynthese verwendet werden. Diese Technik verwendet eine große Anzahl von Lautsprechern und vermeidet dadurch das Problem, dass in einen Bereich innerhalb der Lautsprecheranordnung, dem sogenannten "Sweet Spot", die Rekonstruktion des gewünschten Schallfeldes signifikant genauer ist als im Rest des Hörbereichs, wie es beispielsweise bei der Stereo-Technik auftritt (Bei Stereoverfahren wird allerdings nicht ein Schallfeld physikalisch rekonstruiert. Es wird vielmehr mit zwei Lautsprechern eine Illusion erzeugt, die sich dem natürlichen Vorbild sehr ähnlich anhört jedoch ganz andere physikalische Eigenschaften hat. Bei Stereoverfahren gibt es einen Sweet Spot insofern, als dass sich die Illusion an diesem Punkt am authentischsten anhört). Die Lautsprecheransteuerungssignale für die einzelnen Lautsprecher werden analytisch berechnet. In der praktischen Realisierung kommt es jedoch zu großen Abweichungen vom gewünschten Schallfeld über den gesamten potentiellen Hörbereich. Die Technik der Wellenfeldsynthese ist beispielsweise in der Veröffentlichung von S. Spors, R. Rabenstein und J. Ahrens, "The Theory of Wave Field Synthesis Revisited", in: Proceedings of the 124th Convention of the Audio Engineering Society, May 17-20, Amsterdam, The Netherlands, 2008 beschrieben.For the authentic physical reconstruction of a sound field over a wide range, the technique of wave field synthesis can be used. This technique uses a large number of loudspeakers and thereby avoids the problem that in an area within the loudspeaker arrangement, the so-called "sweet spot", the reconstruction of the desired sound field is significantly more accurate than in the rest of the listening area, as is the case for example with the stereo. Technique (in stereo, however, a soundfield is not physically reconstructed, but two speakers create an illusion that sounds very similar to the natural model, but has very different physical properties.) In stereo, there is a sweet spot in that the illusion sounds most authentic at this point). The speaker drive signals for each speaker are calculated analytically. In the practical implementation, however, there are large deviations from the desired sound field over the entire potential listening area. The technique of wave field synthesis is, for example, in the publication of S. Spors, R. Rabenstein and J. Ahrens, "The Theory of Wave Field Synthesis Revisited", in: Proceedings of the 124th Convention of the Audio Engineering Society, May 17-20, Amsterdam, The Netherlands, 2008 described.

Eine andere bekannte Technik zur Rekonstruktion eines Schallfeldes wird mit Ambisonics bezeichnet und ist beispielsweise in der WO 2005/015954 A2 beschrieben. Diese Technik erfordert kreisförmige bzw. kugelförmige Anordnungen von Lautsprechern, wobei die Lautsprechersignale mithilfe von numerischen Algorithmen generiert werden. Die im Rechenweg notwendige Beschränkung der räumlichen Bandbreite der Ansteuerungssignale bewirkt, dass die Rekonstruktion des gewünschten Schallfeldes im Zentrum der Lautsprecheranordnung am genauesten ist. Im Zentrum der Lautsprecheranordnung befindet sich daher ein Sweet Spot. Mit zunehmendem Abstand vom Zentrum der Lautsprecheranordnung werden die Abweichungen im rekonstruierten Schallfeld größer. In der Veröffentlichung von J. Hannemann und K. D. Donohue, "Virtual Sound Source Rendering Using a Multipole-Expansion and Method-of-Moments Approach", J. Audio Eng. Soc., Bd. 56, Nr. 6, Juni 2008 , wird ein dem Ambisonics-Verfahren verwandtes Verfahren beschrieben, das es ermöglicht, die Anordnung der Lautsprecher und den Ort des Sweet Spot relativ frei zu wählen. Auch hier werden die Lautsprechersignale mit numerischen und somit sehr rechenintensiven Algorithmen berechnet.Another known technique for reconstruction of a sound field is called Ambisonics and is for example in the WO 2005/015954 A2 described. This technique requires circular or spherical arrangements of loudspeakers, where the loudspeaker signals are generated using numerical algorithms. The limitation of the spatial bandwidth of the drive signals necessary in the calculation path causes the reconstruction of the desired sound field in the center of the loudspeaker arrangement to be most accurate. In the center of the loudspeaker arrangement is therefore a sweet spot. With increasing distance from the center of the loudspeaker arrangement, the deviations in the reconstructed sound field become larger. In the publication of J. Hannemann and KD Donohue, "Virtual Sound Source Rendering Using a Multipole Expansion and Method-of-Moments Approach, J. Audio Eng. Soc., Vol. 56, No. 6, June 2008 , a procedure related to the Ambisonics method is described, which makes it possible to choose relatively freely the arrangement of the loudspeakers and the location of the sweet spot. Again, the loudspeaker signals are calculated using numerical and thus very computationally intensive algorithms.

Mit Erweiterungen von Ambisonics, beispielsweise der als Higher Order Ambisonics bezeichneten Technik, kann in Verbindung mit einer analytischen Berechnung der Lautsprecheransteuerungssignale ein effizienteres Verfahren bereitgestellt werden. Ein solches Verfahren ist beispielsweise in der Veröffentlichung von J. Ahrens und S. Spors, "Analytical driving functions for higher order ambisonics", in: IEEE International Conference on Acoustics, Speech, and Signal Processing, Las Vegas, Nevada, 30. März bis 4. April 2008 beschrieben. Auch gemäß dem dort beschriebenen Verfahren stimmt jedoch das resultierende wiedergegebene Schallfeld umso schlechter mit dem gewünschten Schallfeld überein, je weiter man sich vom Zentrum der Anordnung entfernt. Es existiert also wiederum ein Sweet Spot im Zentrum der Lautsprecheranordnung.With enhancements by Ambisonics, such as the technique called Higher Order Ambisonics, a more efficient method can be provided in conjunction with analytic calculation of the speaker drive signals. Such a method is for example in the publication of J. Ahrens and S. Spors, "Analytical driving functions for higher order ambisonics", in: IEEE International Conference on Acoustics, Speech, and Signal Processing, Las Vegas, Nevada, March 30 to April 4, 2008 described. However, according to the method described there, the resulting reproduced sound field agrees even worse with the desired sound field, the further one moves away from the center of the arrangement. So again there is a sweet spot in the center of the loudspeaker arrangement.

Es ist daher eine Aufgabe der vorliegenden Erfindung, ein effizientes Verfahren und eine Vorrichtung zur Wiedergabe eines Schallfeldes bereitzustellen, wobei ein Sweet Spot innerhalb einer Lautsprecheranordnung frei gewählt werden kann. Die Anordnung der Lautsprecher soll hierbei möglichst wenig Einschränkungen unterliegen.It is therefore an object of the present invention to provide an efficient method and apparatus for reproducing a sound field wherein a sweet spot within a loudspeaker array can be freely selected. The arrangement of the loudspeakers should be subject to as few restrictions as possible.

Diese Aufgabe wird mit den Merkmalen der Patentansprüche gelöst.This object is achieved with the features of the claims.

Mit der vorliegenden Erfindung wird ein Verfahren und eine Vorrichtung zur Wiedergabe eines Schallfeldes in einem Zielbeschallungsbereich bereitgestellt. Hierfür werden auf einer den Zielbeschallungsbereich umgebenden Kontur elektroakustische Wandler, also Lautsprecher, angeordnet. Zunächst wird ein Ansteuersignal für die elektroakustischen Wandler analytisch bestimmt. Bei dieser analytischen Bestimmung ergibt sich ein resultierendes Schallfeld, das in einem Bereich um das Zentrum der Kontur, dem Sweet Spot, dem wiederzugebenden Schallfeld genau entspricht. Je größer der Abstand vom Zentrum wird, desto größer werden die Abweichungen vom wiederzugebenden Schallfeld, was der analytischen Bestimmung inhärent ist. Die analytische Bestimmung kann gemäß einem bekannten Verfahren durch analytisches Lösen einer Integralgleichung erreicht werden, die das wiederzugebende Schallfeld beschreibt. Zur Lösung dieser Integralgleichung, die ein Oberflächen- oder Linienintegral über das Ansteuerungssignal der elektroakustischen Wandler und die Übertragungsfunktion der elektroakustischen Wandler ist, können die Komponenten der Integralgleichung in orthogonale Basisfunktionen zerlegt werden, beispielsweise mittels einer Fourierzerlegung.The present invention provides a method and a device for reproducing a sound field in a target sound area. For this purpose, electroacoustic transducers, ie loudspeakers, are arranged on a contour surrounding the target sound area. First, a drive signal for the electroacoustic transducer is determined analytically. In this analytical determination results in a resulting sound field, which corresponds exactly in an area around the center of the contour, the sweet spot, the sound field to be reproduced. The greater the distance from the center, the greater the deviations from the sound field to be reproduced, which is inherent in the analytical determination. The analytical determination can be achieved according to a known method by analytically solving an integral equation describing the sound field to be reproduced. To the solution In this integral equation, which is a surface or line integral via the drive signal of the electroacoustic transducers and the transfer function of the electroacoustic converters, the components of the integral equation can be decomposed into orthogonal basis functions, for example by Fourier decomposition.

Das gewünschte Schallfeld wird also in Basisfunktionen zerlegt, die auf der Kontur, auf der sich die Lautsprecher befinden orthogonal sind. Das gewünschte Schallfeld ist dann bezüglich der Zerlegung um den gewünschten Sweet Spot bandzubegrenzen. Ferner ist das gewünschte Schallfeld bezüglich der Zerlegung um das Zentrum der Lautsprecheranordnung bandzubegrenzen. Die Verbindung zwischen beiden Zerlegungen stellen mathematische Translationstheoreme dar. Der Ausgangspunkt ist in jedem Fall eine Integralgleichung. Dabei ist es erfindungsgemäß möglich, die Lautsprecheransteuerungssignale dann über die explizite Lösung der Integralgleichung (wie im folgenden detailliert beschrieben) zu gewinnen. Alternativ können die Lautsprecheransteuerungssignale über die Zusammenhänge des Kirchhoff-Helmholtz-Integrals (wie bei Wellenfeldsynthese) gewonnen werden.The desired sound field is thus decomposed into basic functions which are orthogonal on the contour on which the loudspeakers are located. The desired sound field is then tape-bound with respect to the decomposition around the desired sweet spot. Furthermore, the desired sound field is band-limited with respect to the decomposition around the center of the loudspeaker arrangement. The connection between the two decompositions represents mathematical translation theorems. The starting point is in any case an integral equation. In this case, it is possible according to the invention to obtain the loudspeaker activation signals by way of the explicit solution of the integral equation (as described in detail below). Alternatively, the loudspeaker drive signals can be obtained via the relationships of the Kirchhoff-Helmholtz integral (as in wave field synthesis).

Das ermittelte Ansteuerungssignal wird derart geändert, dass der Bereich, in dem das resultierende Schallfeld dem wiederzugebenden Schallfeld entspricht, aus dem Zentrum der Kontur zu einer gewünschten Position innerhalb des Zielbeschallungsbereichs verschoben wird. Dies kann beispielsweise mittels mathematischer Translationstheoreme erfolgen. Die gewünschte Position kann an einer festen Position vorbestimmt werden, sie kann aber auch je nach Position eines Empfängers verschoben werden. Im letzteren Fall erfolgt die Änderung des Ansteuerungssignals dann vorzugsweise in Echtzeit. Beispielsweise kann mit diesem Verfahren dann eine Position eines Empfängers innerhalb des Zielbeschallungsbereichs bestimmt werden und das Ansteuerungssignal dann derart geändert werden, dass die gewünschte Position entsprechend nachgeführt wird.The detected drive signal is changed such that the area where the resulting sound field corresponds to the sound field to be reproduced is shifted from the center of the contour to a desired position within the target sound area. This can be done for example by means of mathematical translation theorems. The desired position can be predetermined at a fixed position, but it can also be shifted depending on the position of a receiver. In the latter case, the change of the drive signal then preferably takes place in real time. For example, this method can then be used to determine a position of a receiver within the target sounding area and then to change the control signal in such a way that the desired position is adjusted accordingly.

Das geänderte Ansteuerungssignal wird den elektroakustischen Wandlern zugeführt. Die Wandler wandeln die eingespeisten elektrischen Signale in Schallsignale um, und strahlen diese in den Zielbeschallungsbereich ab.The changed drive signal is supplied to the electroacoustic transducers. The converters convert the input electrical signals into sound signals, and emit them into the target PA range.

Ferner wird mit der vorliegenden Erfindung auch eine Vorrichtung zur Wiedergabe eines Schallfeldes in einem Zielbeschallungsbereich bereitgestellt. Die Vorrichtung weist mehrere, auf einer den Zielbeschallungsbereich umgebenden Kontur angeordnete elektroakustische Wandler, und ein Verarbeitungsmodul auf. Das Verarbeitungsmodul ist in der Lage, aus Signalen über die gewünschte Position und Audioeingangssignalen ein Ansteuerungssignal für die elektroakustischen Wandler analytisch zu bestimmen und das Ansteuerungssignal derart zu ändern, dass der Sweet Spot, also der Bereich, in dem das resultierende Schallfeld dem wiederzugebenden Schallfeld entspricht, zu der gewünschten Position verschoben wird. Die Ansteuerungssignale können mittels einer Verstärkereinheit verstärkt werden und den elektroakustischen Wandlern zugeführt werden.Furthermore, the present invention also provides an apparatus for reproducing a sound field in a target sound area. The device has a plurality of electroacoustic transducers arranged on a contour surrounding the target sound area, and a processing module. The processing module is able to analytically determine from signals about the desired position and audio input signals a drive signal for the electroacoustic transducers and to change the drive signal such that the sweet spot, ie the area in which the resulting sound field corresponds to the sound field to be reproduced, is moved to the desired position. The drive signals can be amplified by means of an amplifier unit and supplied to the electroacoustic transducers.

Mit der vorliegenden Erfindung kann der Bereich, an dem die Rekonstruktion des gewünschten Schallfeldes am genauesten ist, zu einer gewünschten Position hin verschoben werden. Somit kann die Wiedergabe auf einen beliebigen Ort innerhalb des Zielbeschallungsbereichs optimiert werden. Diese Verschiebung oder Translation kann in Echtzeit ausgeführt werden, so dass die Wiedergabe zum Beispiel einem sich bewegenden Empfänger nachgeführt werden kann. Die Bestimmung des Ortes des Empfängers kann hierbei mittels Sensoren, beispielsweise einer Kamera, durchgeführt werden.With the present invention, the area where the reconstruction of the desired sound field is most accurate can be shifted to a desired position. Thus, the playback can be optimized to any location within the Zielbeschallungsbereichs. This shift or translation can be performed in real time, so that the playback can be tracked, for example, to a moving receiver. The determination of the location of the receiver can be carried out here by means of sensors, for example a camera.

Die Erfindung kann zur Wiedergabe von Audiosignalen, insbesondere Mehrkanalton-Audiosignalen verwendet werden. Die Audiosignale können durch verschiedenste Geräte bereitgestellt werden, wie beispielsweise CD-, DVD- oder Blu-ray Disc-Geräte, MP3-Geräte, Computer oder ähnliches. Die wiedergegebenen Audiosignale können dabei beispielsweise MPEG2- oder MPEG4-Signale sein oder in einem Dolby-Format vorliegen.The invention can be used to reproduce audio signals, in particular multi-channel audio signals. The audio signals can be provided by a variety of devices, such as CD, DVD or Blu-ray Disc devices, MP3 devices, computers or the like. The reproduced audio signals may be MPEG2 or MPEG4 signals, for example, or be in a Dolby format.

Die Erfindung wird im Folgenden unter Bezugnahme auf die beigefügten Figuren näher beschrieben, wobei

  • Fig. 1 schematisch eine Vorrichtung gemäß der vorliegenden Erfindung zeigt und
  • Fig. 2 ein erzeugtes Schallfeld zeigt, wobei in Fig. (a) der Sweet Spot im Zentrum der Lautsprecheranordnung ist und in Fig. (b) zu einem anderen Punkt innerhalb der Lautsprecheranordnung verschoben wurde.
The invention will be described in more detail below with reference to the accompanying figures, wherein
  • Fig. 1 schematically shows an apparatus according to the present invention and
  • Fig. 2 shows a generated sound field, wherein in Fig. (a) the sweet spot is in the center of the loudspeaker arrangement and has been shifted to another point within the loudspeaker arrangement in Fig. (b).

In Fig. 1 ist schematisch eine Vorrichtung gemäß einer Ausführungsform der vorliegenden Erfindung gezeigt. Auf einer Kontur 11 um einen Zielbeschallungsbereich 10 sind mehrere Lautsprecher 20 angeordnet. Die Ansteuerungssignale für die Lautsprecher 20 werden in einem Verarbeitungsmodul 30 bestimmt und über eine Verstärkereinheit 31 den Lautsprechern 20 zugeführt. Dem Verarbeitungsmodul 30 werden hierfür Informationen 1 über den momentanen Ort, für den die Schallrekonstruktion optimiert werden soll, also den sogenannten Sweet Spot oder die Sweet Area, und Audioeingangssignale 2 eingespeist. Der Sweet Spot sollte sich hierbei innerhalb des Zielbeschallungsbereichs 10 befinden. Außerdem erhält das Verarbeitungsmodul 30 ein drittes Eingangssignal 3, das Information über das gewünschte Schallfeld trägt (z.B. Position der virtuellen Schallquelle).In Fig. 1 schematically a device according to an embodiment of the present invention is shown. On a contour 11 to a target PA range 10 more speakers 20 are arranged. The drive signals for the speakers 20 are in a processing module 30 determined and supplied via an amplifier unit 31 to the speakers 20. For this purpose, the processing module 30 is fed with information 1 about the current location for which the sound reconstruction is to be optimized, ie the so-called sweet spot or the sweet area, and audio input signals 2. The sweet spot should be located within the target PA area 10. In addition, the processing module 30 receives a third input signal 3 which carries information about the desired sound field (eg position of the virtual sound source).

Zur Berechnung der Ansteuerungssignale für die Lautsprecher 20 wird zunächst das Ansteuerungssignal analytisch, beispielsweise gemäß dem in der oben bereits angesprochenen Veröffentlichung von J. Ahrens und S. Spors durchgeführten Verfahren, berechnet.To calculate the drive signals for the loudspeakers 20, the drive signal is first of all calculated analytically, for example according to the method described in the above-mentioned publication by J. Ahrens and S. Spors.

In dem dort beschriebenen Verfahren, das hier lediglich als Beispiel beschrieben ist, wird von einer Beschreibung des wiederzugebenden Schallfeldes P durch ein Integral über das Ansteuerungssignal D der Lautsprecher, die auf einer Kontur um den Zielbeschallungsbereich herum angeordnet sind, und die räumliche Übertragungsfunktion G der Lautsprecher dargestellt: P = D Gd Ω

Figure imgb0001
In the method described there, which is described here by way of example only, from a description of the sound field P to be reproduced by an integral over the driving signal D of the loudspeakers arranged on a contour around the target sounding area, and the spatial transfer function G of the loudspeakers shown: P = D Gd Ω
Figure imgb0001

Das Integral ist hierbei ein Oberflächen- oder Linienintegral, je nachdem ob die Berechnung in drei Dimensionen oder lediglich in einer Ebene erfolgen soll.The integral here is a surface or line integral, depending on whether the calculation is to take place in three dimensions or only in one plane.

Diese Integralgleichung wird durch eine Zerlegung der involvierten Größen in orthogonale Basisfunktionen B und Bestimmung der jeweiligen Zerlegungskoeffizienten gelöst Entsprechend kann das Schallfeld P dargestellt werden durch P = P B

Figure imgb0002

wobei die entsprechenden Zerlegungskoeffizienten bezeichnet. Dies kann beispielsweise durch eine Fourierzerlegung erfolgen. Das Lautsprecheransteuerungssignal D kann somit folgendermaßen berechnet werden: D = P G B
Figure imgb0003
This integral equation is solved by decomposing the variables involved into orthogonal basis functions B and determining the respective decomposition coefficients. Accordingly, the sound field P can be represented by P = Σ P B
Figure imgb0002

where P̊ denotes the corresponding decomposition coefficients . This can be done for example by a Fourier decomposition. The loudspeaker drive signal D can thus be calculated as follows: D = Σ P G B
Figure imgb0003

Im Falle einer Fourierzerlegung bezeichnen die Größen P und G also die entsprechenden Fourierkoeffizienten.In the case of a Fourier decomposition, the quantities P and G thus denote the corresponding Fourier coefficients.

Diese Summe hat theoretisch unendlich viele Summanden. Da dies in der Praxis im Allgemeinen nicht implementierbar ist, und auch um übermäßiges räumliches Aliasing zu vermeiden, wird die Summation begrenzt. Dies hat jedoch zur Folge, dass das resultierende wiedergegebene Schallfeld umso schlechter mit dem gewünschten Schallfeld übereinstimmt, je weiter man sich vom Zentrum der Zerlegung entfernt. Der sogenannte Sweet Spot beziehungsweise die Sweet Area, also der Bereich der optimalen Wiedergabe, befindet sich also bei dieser analytischen Bestimmung im Zentrum der Lautsprecheranordnung, da die Position des Zentrums der Zerlegung mit dem Zentrum der Lautsprecheranordnung übereinstimmt.This sum theoretically has infinite summands. Since this is generally not implementable in practice, and also to avoid excessive spatial aliasing, the summation is limited. However, this has the consequence that the farther one moves away from the center of the decomposition, the worse the resulting reproduced sound field agrees with the desired sound field. The so-called sweet spot or the sweet area, ie the region of the optimal reproduction, is thus at the center of the loudspeaker arrangement in this analytical determination, since the position of the center of the decomposition coincides with the center of the loudspeaker arrangement.

Als Ergebnis dieser Berechnung kann die kontinuierliche Ansteuerungsfunktion folgendermaßen beschrieben werden:

Figure imgb0004
P v und G v sind hierbei die Zerlegungskoeffizienten des Schallfeldes und der Übertragungsfunktion. Auch dies ist lediglich ein Beispiel für die Beschreibung der kontinuierlichen Ansteuerungsfunktion. Dieses Beispiels gilt für die zweidimensionale Betrachtung kreisförmiger Lautsprecheranordnungen.As a result of this calculation, the continuous drive function can be described as follows:
Figure imgb0004
P v and G v the decomposition coefficients of the sound field and the transfer function are in this case. Again, this is just one example of the description of the continuous drive function. This example applies to the two-dimensional viewing of circular loudspeaker arrangements.

Um den Ort, wo die Rekonstruktion des gewünschten Schallfeldes am genauesten ist, zu einem gewünschten Ort zu verschieben, wird gemäß der Erfindung das Zentrum der Zerlegung in der oben gezeigten Gleichung für das Lautsprecheransteuerungssignal D verschoben. Dies kann beispielsweise mittels verschiedener mathematischer Translationstheoreme erfolgen. Somit kann die Wiedergabe auf einen beliebigen Ort innerhalb der Lautsprecheranordnung optimiert werden.In order to shift the place where the reconstruction of the desired sound field is most accurate to a desired location, according to the invention, the center of the decomposition is shifted in the loudspeaker drive signal D equation shown above. This can be done for example by means of various mathematical translation theorems. Thus, the playback can be optimized to any location within the speaker assembly.

Beispielsweise kann auf der Basis der oben beschriebenen analytischen Berechnung der inhärente Sweet Spot durch Einschränken der räumlichen Bandbreite des wiederzugebenden Schallfeldes P, das eine Funktion des Ortes und der Frequenz ist, in Bezug auf das Zentrum der Zerlegung, das sich vom Zentrum der Lautsprecheranordnung unterscheidet, verschoben werden. Der Sweet Spot oder die Sweet Area ist dann um dieses neue Zentrum der Zerlegung angeordnet. Die Zerlegung des Schallfelds um ein beliebiges Zentrum xc mit einer eingeschränkten Bandbreite 2M+1 kann folgendermaßen dargestellt werden:

Figure imgb0005
For example, based on the analytical calculation described above, the inherent sweet spot may be constrained by limiting the spatial bandwidth of the sound field to be reproduced P, which is a function of the location and the frequency, are shifted with respect to the center of the decomposition different from the center of the speaker arrangement. The sweet spot or the sweet area is then arranged around this new center of decomposition. The decomposition of the sound field around any center x c with a restricted bandwidth 2M + 1 can be represented as follows:
Figure imgb0005

In dieser Gleichung bezeichnen r' und α' die Ortskoordinaten bezüglich einem lokalen Koordinatensystem, dessen Ursprung bei xc ist, J µ bezeichnet die Besselfunktion µ-ter Ordnung, P bezeichnet die Zerlegungskoeffizienten des Schallfelds. Zur Berechnung des Ansteuerungssignals werden jedoch die Zerlegungskoeffizienten benötigt bezüglich der Zerlegung um den Ursprung des globalen Koordinatensystems, dessen Achsen parallel zu denen des lokalen Koordinatensystems liegen. Hierzu kann das Additionstheorem für harmonische Zylinderfunktionen in die obige Gleichung eingesetzt werden:

Figure imgb0006
In this equation, r 'and α ' denote the location coordinates with respect to a local coordinate system whose origin is at x c , J μ denotes the μ-th order Bessel function, P denotes the decomposition coefficients of the sound field. However, to calculate the drive signal, the decomposition coefficients are required with respect to the decomposition around the origin of the global coordinate system whose axes are parallel to those of the local coordinate system. For this purpose, the addition theorem for harmonic cylinder functions can be used in the above equation:
Figure imgb0006

Hierbei wird mit rc und αc die Position des lokalen Koordinatensystems im globalen Koordinatensystem beschreiben. Um PM wiederzugeben, werden die Zerlegungskoeffizienten P v,M (ω) in die obigen Gleichung zur Berechnung des Lautsprecheransteuerungssignals D eingesetzt. Es werden also zwei Bandbreitenbeschränkungen deutlich: zum einen ist PM bezüglich der Zerlegung um xc bandbreitenbegrenzt, wobei diese Begrenzung mit M bezeichnet wird. PM weist dennoch eine unendliche räumliche Bandbreite bezüglich der Zerlegung um den Koordinatenursprung auf. Weiterhin ist das Ansteuerungssignal bandbreitenbegrenzt in Bezug auf die Zerlegung um den Koordinatenursprung. Diese Beschränkung ist mit N bezeichnet. Die erwünschte Komponente des wiedergegebenen Schallfeldes ist also zweifach bandbreitenbegrenzt.Here, r c and α c describe the position of the local coordinate system in the global coordinate system. To reproduce P M , the decomposition coefficients become P v, M (ω) is substituted into the above equation for calculating the speaker driving signal D. Thus, two bandwidth limitations become clear: on the one hand, P M is bandwidth-limited with respect to the decomposition by x c , this limitation being denoted by M. Nevertheless, P M has an infinite spatial bandwidth with respect to the decomposition around the coordinate origin. Furthermore, the drive signal is bandwidth limited with respect to the decomposition around the origin of coordinates. This restriction is denoted by N. The desired component of the reproduced sound field is thus limited twice the bandwidth.

Eine solche Translation des Zerlegungszentrums kann in Echtzeit ausgeführt werden, so dass die Wiedergabe beispielsweise einem sich bewegendem Empfänger nachgeführt werden kann. In einem solchen System kann beispielsweise eine Kamera verwendet werden, um die Position des Empfängers zu bestimmen und die Wiedergabe dann auf diese Position zu optimieren. Die Bestimmung der Position des Empfängers kann auch durch einen Sensor erfolgen, den der Hörer beispielsweise in der Hosentasche mit sich führt.Such a translation of the decomposition center can be carried out in real time, so that the reproduction can be tracked, for example, to a moving receiver. In such a system, for example, a camera can be used to determine the position of the receiver and then optimize the playback to that position. The determination of the position of the receiver can also be done by a sensor that the listener carries, for example, in his pocket with it.

In Fig. 2 ist das durch die Lautsprecher erzeugte Schallfeld gezeigt. Die Lautsprecher befinden sich hierbei auf der gestrichelt angedeuteten, kreisförmigen Kontur, die den Zielbeschallungsbereich umgibt. In Fig. 2a ist das Schallfeld gezeigt, dass sich durch die analytische Bestimmung durch das oben beschriebene Verfahren ergibt. Hierbei ist der Sweet Spot, der durch den markierten Punkt gezeigt ist, im Zentrum der Kontur.In Fig. 2 is shown the sound field generated by the speakers. The loudspeakers are located on the circular contour indicated by dashed lines, which surrounds the target PA range. In Fig. 2a the sound field is shown to result from the analytical determination by the method described above. Here, the sweet spot shown by the marked point is at the center of the contour.

Bewegt sich jedoch ein Empfänger zu dem in Fig. 2b markierten Punkt innerhalb des Zielbeschallungsbereichs, erlaubt es die vorliegende Erfindung, den dem System inhärenten Sweet Spot so nachzuführen, dass die Schallfeldwiedergabe für den ausgewählten Empfänger optimal ist. Das entsprechende Schallfeld ist in Fig. 2b gezeigt, der nur verschobene Sweet Spot wiederum mit einem Kreuz markiert.However, if a recipient moves to the in Fig. 2b marked point within the target PA range, the present invention allows the sweet spot inherent in the system to track so that the sound field reproduction is optimal for the selected receiver. The corresponding sound field is in Fig. 2b shown, the only shifted sweet spot in turn marked with a cross.

Claims (10)

  1. Method for reproducing a sound field in a target region for acoustic irradiation by means of multiple electroacoustic transducers arranged on a contour surrounding the target region for acoustic irradiation, having the steps:
    - analytical determination of a drive signal for the electroacoustic transducers through orthogonal decomposition of the sound field to be reproduced about the center of the contour and spatial band limiting of the sound field to be reproduced with respect to the decomposition in such a manner that the resulting sound field corresponds to the sound field to be reproduced in a region about the center of the contour;
    - alteration of the drive signal by displacing the center of the decomposition to a desired position and spatial band limiting of the sound field to be reproduced with respect to the decomposition displaced to the desired position by means of a mathematical translation theorem so that the region where the resulting sound field corresponds to the sound field to be reproduced is displaced to the desired position within the target region for acoustic irradiation; and
    - delivery of the altered control signal to the electroacoustic transducers.
  2. Method according to claim 1, wherein the drive signal is determined by analytical solution of an integral equation describing the sound field to be reproduced.
  3. Method according to claim 2, wherein the integral equation is a surface or line integral over the control signal for the electroacoustic transducers and the spatial transfer function.
  4. Method according to claim 3, wherein the solution of the integral equation is accomplished through a decomposition of the sound field, the drive signal, and the transfer function into orthogonal basis functions.
  5. Method according to claim 1, wherein the drive signal is determined through the relationships of the Kirchhoff-Helmholtz integral.
  6. Method according to any one of the preceding claims, wherein the displacement to a desired position takes place in real time.
  7. Method according to claim 6, wherein the desired position corresponds to the position of a moving receiver, wherein the desired position follows the position of the receiver.
  8. Device for reproducing a sound field in a target region for acoustic irradiation (10), in particular by means of a method according to any one of the preceding claims, having multiple electroacoustic transducers (20) and a processing module (30) for delivering a drive signal to the electroacoustic transducers (20), wherein the processing module (30) is adapted to determine the drive signal analytically through orthogonal decomposition of the sound field to be reproduced about the center of the contour and through spatial band limiting of the sound field to be reproduced with regard to the decomposition in such a manner that the resulting sound field in a region about the center of the contour (11) corresponds to the sound field to be reproduced and to alter the drive signal by displacing the center of the decomposition to a desired position and spatial band limiting of the sound field to be reproduced with respect to the decomposition displaced to the desired position by means of a mathematical translation theorem in such a manner that the region where the resulting sound field corresponds to the sound field to be reproduced is displaced to the desired position within the target region for acoustic irradiation (10).
  9. Device according to claim 8, further having an amplifier unit (31) for amplifying the altered drive signal determined by the processing module (30) and for delivering the amplified signals to the electroacoustic transducers (20).
  10. Device according to claim 8 or 9, further having an audio reproduction device for providing an audio signal describing the sound field.
EP08167919A 2008-10-30 2008-10-30 Replaying a sound field in a target sound area Not-in-force EP2182744B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AT08167919T ATE524029T1 (en) 2008-10-30 2008-10-30 REPRODUCTION OF A SOUND FIELD IN A TARGET SOUND AREA
EP08167919A EP2182744B1 (en) 2008-10-30 2008-10-30 Replaying a sound field in a target sound area

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP08167919A EP2182744B1 (en) 2008-10-30 2008-10-30 Replaying a sound field in a target sound area

Publications (2)

Publication Number Publication Date
EP2182744A1 EP2182744A1 (en) 2010-05-05
EP2182744B1 true EP2182744B1 (en) 2011-09-07

Family

ID=40202003

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08167919A Not-in-force EP2182744B1 (en) 2008-10-30 2008-10-30 Replaying a sound field in a target sound area

Country Status (2)

Country Link
EP (1) EP2182744B1 (en)
AT (1) ATE524029T1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2469892A1 (en) * 2010-09-15 2012-06-27 Deutsche Telekom AG Reproduction of a sound field in a target sound area
EP2503799B1 (en) 2011-03-21 2020-07-01 Deutsche Telekom AG Method and system for calculating synthetic head related transfer functions by means of virtual local sound field synthesis
ES2480284T3 (en) 2011-09-15 2014-07-25 Deutsche Telekom Ag Local synthesis of an acoustic field through a virtual diffusion body
US9268522B2 (en) 2012-06-27 2016-02-23 Volkswagen Ag Devices and methods for conveying audio information in vehicles
EP3209036A1 (en) 2016-02-19 2017-08-23 Thomson Licensing Method, computer readable storage medium, and apparatus for determining a target sound scene at a target position from two or more source sound scenes

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10305820B4 (en) * 2003-02-12 2006-06-01 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for determining a playback position
FR2858512A1 (en) 2003-07-30 2005-02-04 France Telecom METHOD AND DEVICE FOR PROCESSING AUDIBLE DATA IN AN AMBIOPHONIC CONTEXT
DE102005003431B4 (en) * 2005-01-25 2009-01-15 Institut für Rundfunktechnik GmbH Arrangement for reproducing binaural signals (artificial head signals) by a plurality of loudspeakers

Also Published As

Publication number Publication date
ATE524029T1 (en) 2011-09-15
EP2182744A1 (en) 2010-05-05

Similar Documents

Publication Publication Date Title
DE60304358T2 (en) METHOD FOR PROCESSING AUDIO FILES AND DETECTION DEVICE FOR THE APPLICATION THEREOF
DE69726262T2 (en) SOUND RECORDING AND PLAYBACK SYSTEMS
DE69525163T2 (en) SOUND RECORDING AND PLAYBACK SYSTEMS
DE68922885T2 (en) Method and device for generating sound images.
DE69935974T2 (en) METHOD AND SYSTEM FOR THE TREATMENT OF DIRECTED SOUND IN AN ACOUSTIC-VIRTUAL ENVIRONMENT
DE102012208825A1 (en) 3D AUDIO DEVICE
EP2182744B1 (en) Replaying a sound field in a target sound area
DE102014210215A1 (en) Identification and use of hearing room optimized transfer functions
EP3044972B1 (en) Device and method for the decorrelation of loudspeaker signals
EP2891334B1 (en) Producing a multichannel sound from stereo audio signals
EP1972181B1 (en) Device and method for simulating wfs systems and compensating sound-influencing wfs characteristics
DE112021003592T5 (en) Information processing apparatus, output control method and program
Lokki et al. Subjective evaluation of auralization of physics-based room acoustics modeling
Romigh et al. Do you hear where I hear?: Isolating the individualized sound localization cues
JP5000297B2 (en) System and method for determining a representation of a sound field
DE102011082310A1 (en) Apparatus, method and electroacoustic system for reverberation time extension
EP2425270B1 (en) Apparatus and method for the binaural reproduction of audio sonar signals
WO2015193196A1 (en) Apparatus and method for producing and playing back a copy-protected wave field synthesis audio rendition
EP2373054B1 (en) Playback into a mobile target sound area using virtual loudspeakers
EP3375208B1 (en) Method and apparatus for generating from a multi-channel 2d audio input signal a 3d sound representation signal
EP0484354B1 (en) Stereo headphone for the "in front" location of auditory events generated by stereo headphones
DE112019006727T5 (en) AUDIO SYSTEM, AUDIO PLAYBACK DEVICE, SERVER DEVICE, AUDIO PLAYBACK METHOD AND AUDIO PLAYBACK PROGRAM
DE102018102743A1 (en) Real Sound Transmission
DE3512155C2 (en)
EP2469892A1 (en) Reproduction of a sound field in a target sound area

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20091209

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

17Q First examination report despatched

Effective date: 20100823

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502008004764

Country of ref document: DE

Effective date: 20111124

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20110907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20111207

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

LTIE Lt: invalidation of european patent or patent extension

Effective date: 20110907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20111208

REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

BERE Be: lapsed

Owner name: DEUTSCHE TELEKOM A.G.

Effective date: 20111031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120107

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120109

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111031

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111031

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

26N No opposition filed

Effective date: 20120611

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502008004764

Country of ref document: DE

Effective date: 20120611

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20111218

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111030

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20111207

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121031

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 524029

Country of ref document: AT

Kind code of ref document: T

Effective date: 20131030

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20131030

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

PLAA Information modified related to event that no opposition was filed

Free format text: ORIGINAL CODE: 0009299DELT

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

R26N No opposition filed (corrected)

Effective date: 20120611

RIN2 Information on inventor provided after grant (corrected)

Inventor name: AHRENS, JENS

Inventor name: SPORS, SASCHA

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20211022

Year of fee payment: 14

Ref country code: DE

Payment date: 20211020

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20211021

Year of fee payment: 14

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502008004764

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20221030

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221031

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230503

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221030