EP2373054A1 - Playback into a mobile target sound area using virtual loudspeakers - Google Patents

Playback into a mobile target sound area using virtual loudspeakers Download PDF

Info

Publication number
EP2373054A1
EP2373054A1 EP10155873A EP10155873A EP2373054A1 EP 2373054 A1 EP2373054 A1 EP 2373054A1 EP 10155873 A EP10155873 A EP 10155873A EP 10155873 A EP10155873 A EP 10155873A EP 2373054 A1 EP2373054 A1 EP 2373054A1
Authority
EP
European Patent Office
Prior art keywords
sound sources
target
focused
drive signals
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP10155873A
Other languages
German (de)
French (fr)
Other versions
EP2373054B1 (en
Inventor
Sascha Spors
Jens Ahrens
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Deutsche Telekom AG
Original Assignee
Technische Universitaet Berlin
Deutsche Telekom AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Technische Universitaet Berlin, Deutsche Telekom AG filed Critical Technische Universitaet Berlin
Priority to EP10155873.2A priority Critical patent/EP2373054B1/en
Publication of EP2373054A1 publication Critical patent/EP2373054A1/en
Application granted granted Critical
Publication of EP2373054B1 publication Critical patent/EP2373054B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/403—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers loud-speakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/12—Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/13—Application of wave-field synthesis in stereophonic audio systems

Definitions

  • the present invention relates to the reproduction of a sound field in a limited area using multiple speakers.
  • stereophonic techniques For generating a spatial sound impression stereophonic techniques can be used. These techniques use two or more loudspeakers to produce a spatial sound impression in natural hearing through level differences and / or differences in propagation time. However, the desired spatial hearing impression arises only within a limited range, the so-called "sweet spot" within the speaker assembly. Furthermore, there are various approaches to tracking or enlargement of the sweet spot in stereophonic playback, as for example in the DE-A-10 125 229 , or the DE-A-10 2005 052 904 are described. In stereo, however, a soundfield is not physically reconstructed, but creates an illusion that sounds very similar to the natural model, but has very different physical properties. Also, with the stereophonic only the impression of a sound source can be taught that has at least the distance to the nearest speakers.
  • the technique of wave field synthesis can be used for the authentic physical reconstruction of a sound field over a wide range.
  • This technique uses a large number of loudspeakers, thereby avoiding the problem that in a sweet spot within the loudspeaker arrangement, the reconstruction of the desired sound field is significantly more accurate than in the rest of the listening area, as occurs, for example, in stereo technology
  • the loudspeaker drive signals for the individual Speakers are calculated analytically. In the practical implementation, however, there are large deviations from the desired sound field over the entire potential listening area.
  • the technique of wave field synthesis is, for example, in the publication of S. Spors, R. Rabenstein and J.
  • Wave field synthesis can also be used to generate so-called virtual focused sound sources. This is the physical re-synthesis of a sound source located between the listener and the speakers. Focused sound sources in wave field synthesis and their properties are described, for example, in the publication of S. Spors, H. Wierstorf, N. Geier, and J. Ahrens, “Physical and Perceptual Properties of Focused Sources in Wave Field Synthesis," which are convention papers of the 127th Convention of the Audio Engineering Society, New York, USA, 9 .-12. October 2009, is published ,
  • Ambisonics Another known technique for reconstruction of a sound field is called Ambisonics and is for example in the WO 2005/0195954 A2 described.
  • This technique requires circular arrays of loudspeakers, with the loudspeaker signals typically being generated using numerical algorithms.
  • the limitation of the spatial bandwidth of the drive signals necessary in the calculation path causes the reconstruction of the desired sound field in the center of the loudspeaker arrangement to be most accurate. In the center of the loudspeaker arrangement is therefore a sweet spot. With increasing distance from the center of the loudspeaker arrangement, the deviations in the reconstructed sound field become larger.
  • J. Hannemann and KD Donohue "Virtual Sound Source Rendering Using a Multipole Expansion and Method-of-Moments Approach," J.
  • the loudspeaker arrangement for the reconstruction of the sound field should be freely selectable and the desired display area should be freely selectable within or in front of the loudspeaker arrangement.
  • the present invention provides a method and an apparatus for reproducing a sound field in a target sound area by means of a plurality of electroacoustic transducers. It is a basic idea of the present invention to use focused sources as virtual sound sources for the reproduction in the spatially limited target sound area.
  • the focused sources are generated by the electroacoustic transducers.
  • the activation of the virtual sound sources takes place in accordance with real speakers at the corresponding position in order to generate a desired sound field within the target sounding area.
  • control signals for the virtual focused sound sources are determined, which are arranged on a contour around the target PA range.
  • drive signals are determined for the actually arranged electro-acoustic transducers, by which the virtual sources and the output signals desired by them are generated. These drive signals are supplied to the electroacoustic transducers.
  • the virtual sound sources are closer to the target sound area and / or spatially denser than the electroacoustic transducers. Thereby, the accuracy of the reproduction within the target sounding area can be increased.
  • the result is a sweet spot, so a limited target sound area with improved playback properties.
  • a physical reconstruction of a sound field in a limited area is achieved by means of several loudspeakers or electroacoustic transducers. This can be done by means of a closed, preferably convex arrangement of the electroacoustic transducer. However, it is also a non-closed, for example, linear arrangement of the electro-acoustic transducer possible. Furthermore, the desired display area can be placed dynamically and freely within or in front of the loudspeaker arrangement and thus, for example, adapted dynamically to a listener position.
  • the calculation of the control of the virtual sound sources and the actually existing electroacoustic transducer can be done by various methods, in a particularly efficient manner, for example, with the wave field synthesis.
  • the invention can be advantageously applied to sonicating a moving listener or to sonicating a listener at a fixed position with electro-acoustic transducers disposed on the walls of a room. It is also possible to sonicate several listeners by generating focused sound sources that are arranged on contours surrounding several target PA areas. For this it may be necessary to compensate for the influence of the virtual sound sources among each other.
  • a device for reproducing a sound field in a target PA 3 is shown, with which the inventive method can be technically realized.
  • the electroacoustic transducers 16 are located on a contour 15, which in the in Fig. 1 embodiment shown encloses the potential target PA 3.
  • a closed arrangement is not absolutely necessary;
  • the electroacoustic transducers 16 convert the input electrical signals into sound signals.
  • virtual secondary sources (virtual loudspeakers) 14 are generated by the electroacoustic transducers 16, which in turn are arranged on a contour 13 which surrounds the target sound area 3.
  • These virtual loudspeakers 14 are generated as focused sound sources and driven according to real speakers at their position to produce the desired sound field corresponding to a desired virtual sound source 1 within the area 3.
  • the focused sound sources 14 are preferably arranged spatially denser than the electroacoustic transducers 16, since thereby the accuracy of the reproduction within the sounding area 3 is higher and in this way a "sweet spot" with improved reproduction properties arises.
  • the loudspeaker drive signals 12 for generating the focused sound sources 14 on the contour 13 are generated in a signal processing unit 4.
  • the positions 6 and the orientations 7 of the sound sources 14 are generally required.
  • a signal processing unit 5 is provided, which calculates the drive signals 11 for the virtual loudspeakers 14 within the target sonication area 3.
  • the positions 8 and 9 alignments of the virtual speakers 14 are needed.
  • the method according to the present invention is independent of the method used for resynthesis of the sound field within the target sounding area 3 and regardless of the method used to generate the virtual loudspeakers 14 by the electroacoustic transducers 16 by means of acoustic focusing.
  • the methods of wave field synthesis or ambisonics are suitable for this and can be selected independently of one another according to the requirements.
  • a particularly efficient implementation of the method according to the invention results from the use of wave field synthesis.
  • the signal processing units 4 and 5 can be realized as follows.
  • the driving signals of the virtual focused sound sources 14 corresponding to the positions of the electroacoustic transducers 16 and the virtual speakers 14 are generated.
  • the required electroacoustic transducers 16 are initially selected according to the position of the focused sound sources 14 and their emission direction.
  • a method can be used, as is known from the document of S. Spors, "Extension of Analytical Secondary Source Criterion for Wave Field Synthesis", in: 123rd Audio Engineering Society (AES) Convention, New York, USA, October 2007 is described.
  • the wavefronts converge towards the focal point, ie the position of the focused sound source, and diverge behind it like a point source at the focal point.
  • the direction of the wavefronts is equal to that of a point source in the focal point only in a half-space.
  • This half-space can be controlled according to the invention by appropriate methods, in the wave field synthesis, this is done for example by the selection of the active electroacoustic transducer.
  • the selected active electroacoustic transducer can then, for example, according to the focus operator, as in the thesis of E. Verheijen, "Sound Reproduction by Wave Field Synthesis", Delft University of Technology, 1997 , the input signals of the signal processing unit 4 are weighted and time-delayed.
  • Fig. 2 is shown schematically the arrangement and structure of the signal processing units, with which the electro-acoustic transducer 16 can be controlled.
  • the loudspeaker signals can be obtained by prefiltering in prefilter 18, weighting and delaying the signal from virtual source 10.
  • the output signals of the signal processing unit 5 thus arise by time delay and weighting of the source signal according to the theory of wave field synthesis (see the above-mentioned thesis by E. Verheijen) for the reproduction of virtual point sources and plane waves or other complex sound fields.
  • the signal processing unit 4 it is also possible to proceed for the focused sources in wave field synthesis, but here the delays are negative and the pre-filter 17 has a different characteristic.
  • the efficiency of realization by wave field synthesis lies in the fact that delays and weights of an input signal can be converted very efficiently. Furthermore, the necessary time delays and weights can be obtained by simple formulas from the geometry and the desired source. However, the use of other methods is also possible. Thus, the focused sound sources can be realized not only by the wave field synthesis, but it is also the use of higher order Ambisonics possible, as well as by AJ Berkhout, D. de Vries and P. Vogel, "Acoustic control by wave field synthesis", Journal of the Acoustical Society of America, Volume 93 (5): 2764-2778, May 1993 , is described. Furthermore, a Spectral Division Method (see the above-mentioned publication by S. Spors, R. Rabenstein and J. Ahrens) or the application of modified time reversal focusing approaches is also conceivable.
  • the control of the focused sound sources in addition to the above-described wave field synthesis, which may be model- or data-based, also be done by time and amplitude delay techniques, such as stereophony or VBAP, by Higher-order Ambisonics, a Spectral Division method, for example according to the doctoral thesis of J. Daniel, "Representation of champs acoustics, application à la transmission and reproduction of scenes sonorous complexes dans un contexte multimedia", united Paris 6, 2001 , or numerical (least-squares) approaches.
  • any combinations of the techniques for the realization and control of the virtual focused sound sources are conceivable.
  • FIGS. 3 to 5 Examples of the sound fields produced by various arrangements of electroacoustic transducers are disclosed in U.S. Pat FIGS. 3 to 5 shown.
  • Fig. 3 a circular listening area is surrounded by 56 electroacoustic transducers.
  • the aim is to reproduce a plane wave.
  • Such a plane wave reproduction is shown in (a) and (b) for a frequency of 1 kHz and 4 kHz, respectively. It can clearly be seen in (b) that artifacts occur due to spatial aliasing. These extend over almost the entire listening area.
  • FIGS. 3 (c) and (d) show the generation of a focused source by wave field synthesis, again for a frequency of 1 kHz and 4 kHz, respectively.
  • (d) shows that there is an area around the focused source that is almost free of artifacts. This can be exploited in the process according to the present invention.
  • Fig. 3 (e) shows the reproduction using the method according to the present invention.
  • Fig. 3 (e) It is shown that from the 56 electroacoustic transducers 56 are generated focused sources which are arranged circularly with a diameter of 40 cm around the center and which are driven for the reproduction of a 4 kHz level wave according to the method according to the invention. It is clear that resynthesis takes place without artifacts within the target sonication range.
  • Fig. 3 (f) the same scenario is shown, except that the target PA was moved here. Again, it is clear that resynthesis occurs without significant artifacts.
  • FIGS. 4 (a) and (b) shown Sound fields similar to those in Fig. 3 (e) and (f) are shown in FIGS. 4 (a) and (b) shown, except that instead of the circular arrangement of the electro-acoustic transducer, a rectangular arrangement is used. Such an arrangement is typically used in practical systems.
  • Fig. 4 (a) the reproduction of a plane wave with 4 kHz and a (circular) target PA in the middle
  • Fig. 4 (b) the situation in which the target PA is shifted. Again, it is shown that the resynthesis takes place without significant artifacts.
  • FIGS. 5 (a) and (b) considered a linear speaker assembly, as used in part in practical systems.
  • corresponding Fig. 3 and 4 also shows the Fig. 5 the reproduction of a plane wave with 4 kHz, wherein in (a) the target sound area is located in the middle.
  • Fig. 5 (b) is changed from (a) the angle of incidence of the plane wave in the target sound area.

Landscapes

  • Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

The method involves determining control signals (11) for virtual sound sources i.e. loudspeakers (14), for playback of sound fields at a mobile target sound area (3), where the sound sources are focused to a contour (13) surrounding the mobile target sound area. Loudspeaker control signals (12) for an electroacoustic transducer (16) are determined for producing the focused sound sources and for controlling the focused sound sources with the former control signals for the sound sources. The loudspeaker control signals are supplied to the electroacoustic transducer. An independent claim is also included for a device for playback of sound fields into a mobile target sound area.

Description

Die vorliegende Erfindung betrifft die Wiedergabe bzw. Rekonstruktion eines Schallfelds in einem begrenzten Bereich mithilfe mehrerer Lautsprecher.The present invention relates to the reproduction of a sound field in a limited area using multiple speakers.

Zur Erzeugung eines räumlichen Schalleindrucks können stereophonische Techniken eingesetzt werden. Bei diesen Techniken wird mithilfe von zwei oder mehr Lautsprechern durch Pegeldifferenzen und/oder Laufzeitdifferenzen ein räumlicher Schalleindruck beim natürlichen Hören erzeugt. Der gewünschte räumliche Höreindruck entsteht dabei jedoch nur innerhalb eines begrenzten Bereichs, dem sogenannten "Sweet Spot", innerhalb der Lautsprecheranordnung. Weiterhin gibt es verschiedene Ansätze zur Nachführung bzw. Vergrößerung des Sweet Spot bei stereophonischer Wiedergabe, wie sie beispielsweise in der DE-A-10 125 229 , oder der DE-A-10 2005 052 904 beschrieben sind. Bei Stereoverfahren wird ein Schallfeld allerdings nicht physikalisch rekonstruiert, sondern es wird eine Illusion erzeugt, die sich dem natürlichen Vorbild sehr ähnlich anhört, jedoch ganz andere physikalische Eigenschaften hat. Auch kann mit der Stereophonie nur der Eindruck einer Schallquelle vermittelt werden, die mindestens den Abstand zu den nächstgelegenen Lautsprechern hat.For generating a spatial sound impression stereophonic techniques can be used. These techniques use two or more loudspeakers to produce a spatial sound impression in natural hearing through level differences and / or differences in propagation time. However, the desired spatial hearing impression arises only within a limited range, the so-called "sweet spot" within the speaker assembly. Furthermore, there are various approaches to tracking or enlargement of the sweet spot in stereophonic playback, as for example in the DE-A-10 125 229 , or the DE-A-10 2005 052 904 are described. In stereo, however, a soundfield is not physically reconstructed, but creates an illusion that sounds very similar to the natural model, but has very different physical properties. Also, with the stereophonic only the impression of a sound source can be taught that has at least the distance to the nearest speakers.

Zur authentischen physikalischen Rekonstruktion eines Schallfeldes über einen ausgedehnten Bereich kann die Technik der Wellenfeldsynthese verwendet werden. Diese Technik verwendet eine große Anzahl von Lautsprechern und vermeidet dadurch das Problem, dass in einem Sweet Spot innerhalb der Lautsprecheranordnung die Rekonstruktion des gewünschten Schallfeldes signifikant genauer ist als im Rest des Hörbereichs, wie es beispielsweise bei der Stereo-Technik auftritt Die Lautsprecheransteuerungssignale für die einzelnen Lautsprecher werden analytisch berechnet. In der praktischen Realisierung kommt es jedoch zu großen Abweichungen vom gewünschten Schallfeld über den gesamten potenziellen Hörbereich. Die Technik der Wellenfeldsynthese ist beispielsweise in der Veröffentlichung von S. Spors, R. Rabenstein und J. Ahrens, "The Theory of Wave Field Synthesis Revisited", in: Proceedings of the 124th Convention of the Audio Engineering Society, May 17-20, Amsterdam, The Netherlands, 2008 beschrieben. Mittels der Wellenfeldsynthese kann auch eine Erzeugung sogenannter virtueller fokussierter Schallquellen erreicht werden. Darunter versteht man die physikalische Re-Synthese einer Schallquelle, die sich zwischen dem Zuhörer und den Lautsprechern befindet. Fokussierte Schallquellen in der Wellenfeldsynthese und deren Eigenschaften sind beispielsweise in der Veröffentlichung von S. Spors, H. Wierstorf, N. Geier und J. Ahrens, "Physical and Perceptual Properties of Focused Sources in Wave Field Synthesis" beschrieben, die als Convention Paper der 127. Convention der Audio Engineering Society, New York, USA, 9.-12. Oktober 2009, veröffentlicht ist .For the authentic physical reconstruction of a sound field over a wide range, the technique of wave field synthesis can be used. This technique uses a large number of loudspeakers, thereby avoiding the problem that in a sweet spot within the loudspeaker arrangement, the reconstruction of the desired sound field is significantly more accurate than in the rest of the listening area, as occurs, for example, in stereo technology The loudspeaker drive signals for the individual Speakers are calculated analytically. In the practical implementation, however, there are large deviations from the desired sound field over the entire potential listening area. The technique of wave field synthesis is, for example, in the publication of S. Spors, R. Rabenstein and J. Ahrens, "The Theory of Wave Field Synthesis Revisited", in: Proceedings of the 124th Convention of the Audio Engineering Society, May 17-20, Amsterdam, The Netherlands, 2008 described. Wave field synthesis can also be used to generate so-called virtual focused sound sources. This is the physical re-synthesis of a sound source located between the listener and the speakers. Focused sound sources in wave field synthesis and their properties are described, for example, in the publication of S. Spors, H. Wierstorf, N. Geier, and J. Ahrens, "Physical and Perceptual Properties of Focused Sources in Wave Field Synthesis," which are convention papers of the 127th Convention of the Audio Engineering Society, New York, USA, 9 .-12. October 2009, is published ,

Eine andere bekannte Technik zur Rekonstruktion eines Schallfeldes wird mit Ambisonics bezeichnet und ist beispielsweise in der WO 2005/0195954 A2 beschrieben. Diese Technik erfordert kreisförmige bzw. kugelförmige Anordnungen von Lautsprechern, wobei die Lautsprechersignale typischerweise mithilfe von numerischen Algorithmen generiert werden. Die im Rechenweg notwendige Beschränkung der räumlichen Bandbreite der Ansteuerungssignale bewirkt, dass die Rekonstruktion des gewünschten Schallfeldes im Zentrum der Lautsprecheranordnung am genauesten ist. Im Zentrum der Lautsprecheranordnung befindet sich daher ein Sweet Spot. Mit zunehmendem Abstand vom Zentrum der Lautsprecheranordnung werden die Abweichungen im rekonstruierten Schallfeld größer. In der Veröffentlichung von J. Hannemann und K. D. Donohue, "Virtual Sound Source Rendering Using a Multipole-Expansion and Method-of-Moments Approach", J. Audio Eng. Soc., Bd. 56, Nr. 6, Juni 2008 , wird ein dem Ambisonics-Verfahren verwandtes Verfahren beschrieben, das es ermöglicht, die Anordnung der Lautsprecher und den Ort des Sweet Spot relativ frei zu wählen. Auch hier werden die Lautsprechersignale mit numerischen und somit sehr rechenintensiven Algorithmen berechnet.Another known technique for reconstruction of a sound field is called Ambisonics and is for example in the WO 2005/0195954 A2 described. This technique requires circular arrays of loudspeakers, with the loudspeaker signals typically being generated using numerical algorithms. The limitation of the spatial bandwidth of the drive signals necessary in the calculation path causes the reconstruction of the desired sound field in the center of the loudspeaker arrangement to be most accurate. In the center of the loudspeaker arrangement is therefore a sweet spot. With increasing distance from the center of the loudspeaker arrangement, the deviations in the reconstructed sound field become larger. In the publication of J. Hannemann and KD Donohue, "Virtual Sound Source Rendering Using a Multipole Expansion and Method-of-Moments Approach," J. Audio Eng. Soc., Vol. 56, No. 6, June 2008 , a procedure related to the Ambisonics method is described, which makes it possible to choose relatively freely the arrangement of the loudspeakers and the location of the sweet spot. Again, the loudspeaker signals are calculated using numerical and thus very computationally intensive algorithms.

Mit Erweiterungen von Ambisonics, beispielsweise der als Higher Order Ambisonics bezeichneten Technik, kann in Verbindung mit einer analytischen Berechnung der Lautsprecheransteuerungssignale ein effizienteres Verfahren bereitgestellt werden. Ein solches Verfahren ist beispielsweise in der Veröffentlichung von J. Ahrens und S. Spors, "Analytical driving functions for higher order Ambisonics", in: IEEE International Conference on Acoustics, Speech, and Signal Processing, Las Vegas, Nevada, 30. März bis 4. April 2008 beschrieben. Auch gemäß dem dort beschriebenen Verfahren stimmt jedoch das resultierende wiedergegebene Schallfeld umso schlechter mit dem gewünschten Schallfeld überein, je höher die Frequenz ist und je weiter man sich vom Zentrum der Anordnung entfernt. Es existiert also wiederum ein Sweet Spot im Zentrum der Lautsprecheranordnung.With enhancements by Ambisonics, such as the technique called Higher Order Ambisonics, a more efficient method can be provided in conjunction with analytic calculation of the speaker drive signals. Such a method is for example in the publication of J. Ahrens and S. Spors, "Analytical driving functions for higher order Ambisonics", in: IEEE International Conference on Acoustics, Speech, and Signal Processing, Las Vegas, Nevada, March 30 to April 4, 2008 described. However, according to the method described there, too, the higher the frequency and the further one moves away from the center of the arrangement, the worse does the resulting reproduced sound field coincide with the desired sound field. So again there is a sweet spot in the center of the loudspeaker arrangement.

Es ist eine Aufgabe der vorliegenden Erfindung, ein Verfahren und eine Vorrichtung zur effizienten physikalischen Rekonstruktion eines Schallfelds in einem begrenzten Bereich mithilfe von mehreren Lautsprechern bereitzustellen, wobei der begrenzte Wiedergabebereich dynamisch und frei platziert bzw. dynamisch verschoben werden kann. Die Lautsprecheranordnung zur Rekonstruktion des Schallfelds soll frei wählbar sein und der gewünschte Wiedergabebereich soll frei innerhalb bzw. vor der Lautsprecheranordnung ausgewählt werden können.It is an object of the present invention to provide a method and apparatus for efficient physical reconstruction of a sound field in a limited area using multiple speakers, wherein the limited display area can be dynamically and freely placed or dynamically shifted. The loudspeaker arrangement for the reconstruction of the sound field should be freely selectable and the desired display area should be freely selectable within or in front of the loudspeaker arrangement.

Diese Aufgaben werden mit den Merkmalen der Patentansprüche gelöst.These objects are achieved with the features of the claims.

Mit der vorliegenden Erfindung werden ein Verfahren und eine Vorrichtung zur Wiedergabe eines Schallfelds in einem Zielbeschallungsbereich mittels mehrerer elektroakustischer Wandler bereitgestellt. Es ist eine Grundidee der vorliegenden Erfindung, fokussierte Quellen als virtuelle Schallquellen für die Wiedergabe in dem räumlich begrenzten Zielbeschallungsbereich zu nutzen. Die fokussierten Quellen werden hierbei durch die elektroakustischen Wandler erzeugt. Die Ansteuerung der virtuellen Schallquellen erfolgt entsprechend realer Lautsprecher an der entsprechenden Position, um ein gewünschtes Schallfeld innerhalb des Zielbeschallungsbereichs zu erzeugen. So werden zum Einen Ansteuerungssignale für die virtuellen fokussierten Schallquellen bestimmt, die auf einer Kontur um den Zielbeschallungsbereich angeordnet sind. Weiterhin werden Ansteuerungssignale für die tatsächlich angeordneten elektroakustischen Wandler bestimmt, durch die die virtuellen Quellen und die von diesen erwünschten Ausgangssignale erzeugt werden. Diese Ansteuerungssignale werden den elektroakustischen Wandlern zugeführt.The present invention provides a method and an apparatus for reproducing a sound field in a target sound area by means of a plurality of electroacoustic transducers. It is a basic idea of the present invention to use focused sources as virtual sound sources for the reproduction in the spatially limited target sound area. The focused sources are generated by the electroacoustic transducers. The activation of the virtual sound sources takes place in accordance with real speakers at the corresponding position in order to generate a desired sound field within the target sounding area. Thus, on the one hand control signals for the virtual focused sound sources are determined, which are arranged on a contour around the target PA range. Furthermore, drive signals are determined for the actually arranged electro-acoustic transducers, by which the virtual sources and the output signals desired by them are generated. These drive signals are supplied to the electroacoustic transducers.

Zur Resynthese des Schallfelds innerhalb des Zielbeschallungsbereichs und zur Erzeugung der virtuellen Schallquellen durch die elektroakustischen Wandler mittels akustischer Fokussierung können bekannte Verfahren eingesetzt werden. Insbesondere können die Verfahren der Wellenfeldsynthese oder Ambisonics unabhängig voneinander entsprechend den Anforderungen gewählt werden. Die Verwendung der Wellenfeldsynthese ist jedoch bevorzugt.For resynthesis of the sound field within the target sonication area and for generating the virtual sound sources by the electroacoustic transducer by means of acoustic focusing known methods can be used. In particular, the methods of wave field synthesis or ambisonics can be independently selected according to the requirements. However, the use of wave field synthesis is preferred.

Es ist weiterhin bevorzugt, die virtuellen Schallquellen näher am Zielbeschallungsbereich und/oder räumlich dichter anzuordnen als die elektroakustischen Wandler. Dadurch kann die Genauigkeit der Wiedergabe innerhalb des Zielbeschallungsbereichs erhöht werden. So entsteht ein Sweet Spot, also ein begrenzter Zielbeschallungsbereich mit verbesserten Wiedergabeeigenschaften. Durch zeitliches Verschieben der virtuellen Schallquellen kann dieser Sweet Spot, also der begrenzte Zielbeschallungsbereich, dynamisch nachgeführt werden, z.B. einem Zuhörer folgend, der sich bewegt.It is further preferred to arrange the virtual sound sources closer to the target sound area and / or spatially denser than the electroacoustic transducers. Thereby, the accuracy of the reproduction within the target sounding area can be increased. The result is a sweet spot, so a limited target sound area with improved playback properties. By temporally shifting the virtual sound sources, this sweet spot, so the limited Zielbeschallungsbereich be dynamically tracked, for example, following a listener who moves.

Mit der vorliegenden Erfindung wird eine physikalische Rekonstruktion eines Schallfelds in einem begrenzten Bereich mithilfe mehrerer Lautsprecher bzw. elektroakustischer Wandler erreicht. Dies kann mittels einer geschlossenen, vorzugsweise konvexen Anordnung der elektroakustischen Wandler geschehen. Es ist jedoch auch eine nicht geschlossene, beispielsweise lineare Anordnung der elektroakustischen Wandler möglich. Weiterhin kann der gewünschte Wiedergabebereich dynamisch und frei innerhalb bzw. vor der Lautsprecheranordnung platziert werden und so beispielsweise dynamisch an eine Hörerposition angepasst werden. Die Berechnung der Ansteuerung der virtuellen Schallquellen und der tatsächlich vorhandenen elektroakustischen Wandler kann durch verschiedene Verfahren geschehen, in besonders effizienter Weise beispielsweise mit der Wellenfeldsynthese.With the present invention, a physical reconstruction of a sound field in a limited area is achieved by means of several loudspeakers or electroacoustic transducers. This can be done by means of a closed, preferably convex arrangement of the electroacoustic transducer. However, it is also a non-closed, for example, linear arrangement of the electro-acoustic transducer possible. Furthermore, the desired display area can be placed dynamically and freely within or in front of the loudspeaker arrangement and thus, for example, adapted dynamically to a listener position. The calculation of the control of the virtual sound sources and the actually existing electroacoustic transducer can be done by various methods, in a particularly efficient manner, for example, with the wave field synthesis.

Die Erfindung kann vorteilhaft zur Beschallung eines sich bewegenden Zuhörers oder zur Beschallung eines Zuhörers an einer festen Position mit elektroakustischen Wandlern, die an den Wänden eines Raums angeordnet sind, angewendet werden. Auch ist eine Beschallung mehrerer Zuhörer möglich, indem fokussierte Schallquellen erzeugt werden, die auf mehreren Zielbeschallungsbereichen umgebenen Konturen angeordnet sind. Dazu ist es unter Umständen nötig den Einfluss der virtuellen Schallquellen untereinander zu kompensieren.The invention can be advantageously applied to sonicating a moving listener or to sonicating a listener at a fixed position with electro-acoustic transducers disposed on the walls of a room. It is also possible to sonicate several listeners by generating focused sound sources that are arranged on contours surrounding several target PA areas. For this it may be necessary to compensate for the influence of the virtual sound sources among each other.

Die Erfindung wird im Folgenden unter Bezugnahme auf die beigefügten Figuren näher beschrieben, wobei

  • Fig. 1 eine erfindungsgemäße Vorrichtung zur Wiedergabe eines Schallfelds zeigt,
  • Fig. 2 schematisch eine Vorrichtung zur Erzeugung der Ansteuerungssignale für die erfindungsgemäße Vorrichtung zeigt,
  • Fig. 3(a) bis (f) durch eine kreisförmige Lautsprecheranordnung erzeugte Schallfelder,
  • Fig. 4(a) und (b) durch eine rechteckige Lautsprecheranordnung erzeugte Schallfelder und
  • Fig. 5(a) und (b) durch eine lineare Lautsprecheranordnung erzeugte Schallfelder zeigen.
The invention will be described in more detail below with reference to the accompanying figures, wherein
  • Fig. 1 shows a device according to the invention for reproducing a sound field,
  • Fig. 2 schematically shows a device for generating the drive signals for the device according to the invention,
  • 3 (a) to (f) sound fields generated by a circular loudspeaker arrangement,
  • 4 (a) and (b) sound fields generated by a rectangular loudspeaker arrangement and
  • Fig. 5 (a) and (b) show sound fields generated by a linear loudspeaker arrangement.

In Fig. 1 ist eine Vorrichtung zur Wiedergabe eines Schallfelds in einem Zielbeschallungsbereich 3 gezeigt, mit der das erfindungsgemäße Verfahren technisch realisiert werden kann. Die elektroakustischen Wandler 16 befinden sich auf einer Kontur 15, die in der in Fig. 1 gezeigten Ausführungsform den potentiellen Zielbeschallungsbereich 3 umschließt. Eine solche geschlossene Anordnung ist jedoch nicht zwingend notwendig; es ist beispielsweise auch eine lineare Anordnung der elektroakustischen Wandler möglich. Die elektroakustischen Wandler 16 wandeln die eingespeisten elektrischen Signale in Schallsignale um. Durch die den elektroakustischen Wandlern 16 zugeführten Signale werden durch die elektroakustischen Wandler 16 virtuelle Sekundärquellen (virtuelle Lautsprecher) 14 erzeugt, die wiederum auf einer Kontur 13 angeordnet sind, die den Zielbeschallungsbereich 3 umgibt. Diese virtuellen Lautsprecher 14 werden als fokussierte Schallquellen erzeugt und entsprechend realer Lautsprecher an deren Position angesteuert, um das gewünschte Schallfeld entsprechend einer gewünschten virtuellen Schallquelle 1 innerhalb des Bereichs 3 zu erzeugen.In Fig. 1 a device for reproducing a sound field in a target PA 3 is shown, with which the inventive method can be technically realized. The electroacoustic transducers 16 are located on a contour 15, which in the in Fig. 1 embodiment shown encloses the potential target PA 3. However, such a closed arrangement is not absolutely necessary; For example, a linear arrangement of the electroacoustic transducers is also possible. The electroacoustic transducers 16 convert the input electrical signals into sound signals. By virtue of the signals supplied to the electroacoustic transducers 16, virtual secondary sources (virtual loudspeakers) 14 are generated by the electroacoustic transducers 16, which in turn are arranged on a contour 13 which surrounds the target sound area 3. These virtual loudspeakers 14 are generated as focused sound sources and driven according to real speakers at their position to produce the desired sound field corresponding to a desired virtual sound source 1 within the area 3.

Die fokussierten Schallquellen 14 werden vorzugsweise räumlich dichter angeordnet als die elektroakustischen Wandler 16, da dadurch die Genauigkeit der Wiedergabe innerhalb des Beschallungsbereichs 3 höher ist und auf diese Weise ein "Sweet Spot" mit verbesserten Wiedergabeeigenschaften entsteht.The focused sound sources 14 are preferably arranged spatially denser than the electroacoustic transducers 16, since thereby the accuracy of the reproduction within the sounding area 3 is higher and in this way a "sweet spot" with improved reproduction properties arises.

Die Lautsprecheransteuerungssignale 12 zum Erzeugen der fokussierten Schallquellen 14 auf der Kontur 13 werden in einer Signalverarbeitungseinheit 4 erzeugt. Hierfür werden im Allgemeinen die Positionen 6 und die Ausrichtungen 7 der Schallquellen 14 benötigt. Weiterhin ist eine Signalverarbeitungseinheit 5 vorgesehen, die die Ansteuerungssignale 11 für die virtuellen Lautsprecher 14 innerhalb des Zielbeschallungsbereichs 3 berechnet. Hierzu werden wiederum im Allgemeinen die Positionen 8 und Ausrichtungen 9 der virtuellen Lautsprecher 14 benötigt.The loudspeaker drive signals 12 for generating the focused sound sources 14 on the contour 13 are generated in a signal processing unit 4. For this purpose, the positions 6 and the orientations 7 of the sound sources 14 are generally required. Furthermore, a signal processing unit 5 is provided, which calculates the drive signals 11 for the virtual loudspeakers 14 within the target sonication area 3. For this purpose, in turn, generally the positions 8 and 9 alignments of the virtual speakers 14 are needed.

Prinzipiell ist das Verfahren gemäß der vorliegenden Erfindung unabhängig vom verwendeten Verfahren zur Resynthese des Schallfelds innerhalb des Zielbeschallungsbereichs 3 und unabhängig vom verwendeten Verfahren zur Erzeugung der virtuellen Lautsprecher 14 durch die elektroakustischen Wandler 16 mittels akustischer Fokussierung. Insbesondere sind die Verfahren der Wellenfeldsynthese oder Ambisonics hierfür geeignet und können unabhängig voneinander entsprechend den Anforderungen gewählt werden. Eine besonders effiziente Umsetzung des erfindungsgemäßen Verfahrens ergibt sich bei der Verwendung der Wellenfeldsynthese.In principle, the method according to the present invention is independent of the method used for resynthesis of the sound field within the target sounding area 3 and regardless of the method used to generate the virtual loudspeakers 14 by the electroacoustic transducers 16 by means of acoustic focusing. In particular, the methods of wave field synthesis or ambisonics are suitable for this and can be selected independently of one another according to the requirements. A particularly efficient implementation of the method according to the invention results from the use of wave field synthesis.

Bei Anwendung der Wellenfeldsynthese können die Signalverarbeitungseinheiten 4 und 5 folgendermaßen realisiert werden.When using the wave field synthesis, the signal processing units 4 and 5 can be realized as follows.

In der Signalverarbeitungseinheit 4 werden die Ansteuerungssignale der virtuellen fokussierten Schallquellen 14 entsprechend der Positionen der elektroakustischen Wandler 16 und der virtuellen Lautsprecher 14 erzeugt. Hierzu werden zunächst die benötigten elektroakustischen Wandler 16 entsprechend der Position der fokussierten Schallquellen 14 und deren Abstrahlrichtung ausgewählt. Für die Auswahl der elektroakustischen Wandler 16 kann beispielsweise ein Verfahren benutzt werden, wie es aus der Dokument von S. Spors, "Extension of an Analytic Secondary Source Selection Criterion for Wave Field Synthesis", in: 123. Convention der Audio Engineering Society (AES), New York, USA, Oktober 2007 beschrieben wird. Eine wichtige Eigenschaft einer fokussierten Quelle ist, dass die Wellenfronten vor dem Fokuspunkt, also der Position der fokussierten Schallquelle, zu diesem hin konvergieren und dahinter wie eine Punktquelle am Fokuspunkt divergieren. Damit ist die Laufrichtung der Wellenfronten nur in einem Halbraum gleich der einer Punktquelle im Fokuspunkt. Dieser Halbraum kann gemäß der Erfindung durch entsprechende Verfahren gesteuert werden, bei der Wellenfeldsynthese geschieht dies beispielsweise durch die Auswahl der aktiven elektroakustischen Wandler. Für die ausgewählten aktiven elektroakustischen Wandler kann dann beispielsweise entsprechend des Fokusoperators, wie er in der Doktorarbeit von E. Verheijen, "Sound Reproduction by Wave Field Synthesis", Delft University of Technology, 1997 , beschrieben ist, die Eingangssignale der Signalverarbeitungseinheit 4 gewichtet und zeitverzögert werden.In the signal processing unit 4, the driving signals of the virtual focused sound sources 14 corresponding to the positions of the electroacoustic transducers 16 and the virtual speakers 14 are generated. For this purpose, the required electroacoustic transducers 16 are initially selected according to the position of the focused sound sources 14 and their emission direction. For the selection of the electro-acoustic transducers 16, for example, a method can be used, as is known from the document of S. Spors, "Extension of Analytical Secondary Source Criterion for Wave Field Synthesis", in: 123rd Audio Engineering Society (AES) Convention, New York, USA, October 2007 is described. An important feature of a focused source is that the wavefronts converge towards the focal point, ie the position of the focused sound source, and diverge behind it like a point source at the focal point. Thus, the direction of the wavefronts is equal to that of a point source in the focal point only in a half-space. This half-space can be controlled according to the invention by appropriate methods, in the wave field synthesis, this is done for example by the selection of the active electroacoustic transducer. For the selected active electroacoustic transducer can then, for example, according to the focus operator, as in the thesis of E. Verheijen, "Sound Reproduction by Wave Field Synthesis", Delft University of Technology, 1997 , the input signals of the signal processing unit 4 are weighted and time-delayed.

In Fig. 2 ist schematisch die Anordnung und der Aufbau der Signalverarbeitungseinheiten gezeigt, mit denen die elektroakustischen Wandler 16 angesteuert werden können. Gemäß der in Fig. 2 gezeigten Ausführungsform können unter Verwendung der modelbasierten Wellenfeldsynthese die Lautsprechersignale durch Vorfilterung im Vorfilter 18, Gewichtung und Verzögerung des Signals von der virtuellen Quelle 10 gewonnen werden. Die Ausgangssignale der Signalverarbeitungseinheit 5 entstehen also durch Zeitverzögerung und Gewichtung des Quellensignals entsprechend der Theorie der Wellenfeldsynthese (siehe die oben genannte Doktorarbeit von E. Verheijen) für die Wiedergabe von virtuellen Punktquellen und ebenen Wellen oder anderer komplexer Schallfelder. In der Signalverarbeitungseinheit 4 kann für die fokussierten Quellen bei der Wellenfeldsynthese ebenso verfahren werden, wobei jedoch hier die Verzögerungen negativ sind und der Vorfilter 17 eine andere Charakteristik aufweist.In Fig. 2 is shown schematically the arrangement and structure of the signal processing units, with which the electro-acoustic transducer 16 can be controlled. According to the in Fig. 2 In the embodiment shown, using model-based wave field synthesis, the loudspeaker signals can be obtained by prefiltering in prefilter 18, weighting and delaying the signal from virtual source 10. The output signals of the signal processing unit 5 thus arise by time delay and weighting of the source signal according to the theory of wave field synthesis (see the above-mentioned thesis by E. Verheijen) for the reproduction of virtual point sources and plane waves or other complex sound fields. In the signal processing unit 4, it is also possible to proceed for the focused sources in wave field synthesis, but here the delays are negative and the pre-filter 17 has a different characteristic.

Es ist weiterhin möglich, Vorfilterungen, Gewichtungen und Verzögerungen auch in einer einzigen Signalverarbeitungseinheit zusammenzufassen bzw. zu kombinieren. Das Signal eines spezifischen elektroakustischen Wandlers entsteht dann durch eine kombinierte Vorfilterung und mehrfache Gewichtung/Verzögerung des Signals 10 der virtuellen Quelle 10.It is also possible to combine or combine pre-filtering, weightings and delays in a single signal processing unit. The signal of a specific electroacoustic transducer is then produced by a combined pre-filtering and multiple weighting / delay of the signal 10 of the virtual source 10.

Die Effizienz der Realisierung mittels Wellenfeldsynthese liegt darin, dass Verzögerungen und Gewichtungen eines Eingangssignals sehr effizient umgesetzt werden können. Weiterhin können die notwendigen Zeitverzögerungen und Gewichtungen mittels einfacher Formeln aus der Geometrie und der gewünschten Quelle gewonnen werden. Hierbei ist jedoch auch die Verwendung von anderen Verfahren möglich. So können die fokussierten Schallquellen nicht nur durch die Wellenfeldsynthese realisiert werden, sondern es ist auch die Verwendung von Higher-Order Ambisonics möglich, wie sie auch von A.J. Berkhout, D. de Vries und P. Vogel, "Acoustic control by wave field synthesis", Journal of the Acoustical Society of America, Volume 93(5): 2764-2778, Mai 1993 , beschrieben wird. Weiterhin ist auch eine Spectral Division Method (siehe die oben genannte Veröffentlichung von S. Spors, R. Rabenstein und J. Ahrens) oder die Anwendung von modifizierten "time reversal focusing"-Ansätzen denkbar.The efficiency of realization by wave field synthesis lies in the fact that delays and weights of an input signal can be converted very efficiently. Furthermore, the necessary time delays and weights can be obtained by simple formulas from the geometry and the desired source. However, the use of other methods is also possible. Thus, the focused sound sources can be realized not only by the wave field synthesis, but it is also the use of higher order Ambisonics possible, as well as by AJ Berkhout, D. de Vries and P. Vogel, "Acoustic control by wave field synthesis", Journal of the Acoustical Society of America, Volume 93 (5): 2764-2778, May 1993 , is described. Furthermore, a Spectral Division Method (see the above-mentioned publication by S. Spors, R. Rabenstein and J. Ahrens) or the application of modified time reversal focusing approaches is also conceivable.

Die Ansteuerung der fokussierten Schallquellen kann, neben der oben dargestellten Wellenfeldsynthese, die model- oder datenbasiert sein kann, auch durch Time- und Amplitude Delay-Techniken erfolgen, wie Stereophonie oder VBAP, durch Higher-Order Ambisonics, einer Spectral Division-Methode, beispielsweise gemäß der Doktorarbeit von J. Daniel, "Représentation de champs acoustiques, application à la transmission et à la reproduction de scenes sonores complexes dans un contexte multimedia", Université Paris 6, 2001 , oder numerische (Least-Squares)-Ansätze erfolgen. Hierbei sind auch beliebige Kombinationen der Techniken für die Realisation und Ansteuerung der virtuellen fokussierten Schallquellen denkbar.The control of the focused sound sources, in addition to the above-described wave field synthesis, which may be model- or data-based, also be done by time and amplitude delay techniques, such as stereophony or VBAP, by Higher-order Ambisonics, a Spectral Division method, for example according to the doctoral thesis of J. Daniel, "Representation of champs acoustics, application à la transmission and reproduction of scenes sonorous complexes dans un contexte multimedia", Université Paris 6, 2001 , or numerical (least-squares) approaches. In this case, any combinations of the techniques for the realization and control of the virtual focused sound sources are conceivable.

Beispiele für die Schallfelder, die durch verschiedene Anordnungen von elektroakustischen Wandlern erzeugt werden, sind in den Figuren 3 bis 5 gezeigt. In Fig. 3 ist ein kreisförmiger Hörbereich von 56 elektroakustischen Wandlern umgeben. Es wird die Wiedergabe einer ebenen Welle angestrebt. Eine solche Wiedergabe einer ebenen Welle ist in (a) und (b) für eine Frequenz von 1 kHz bzw. 4 kHz gezeigt. Hierbei ist in (b) deutlich zu sehen, dass Artefakte aufgrund der räumlichen Abtastung (spatial aliasing) auftreten. Diese erstrecken sich über nahezu den gesamten Hörbereich.Examples of the sound fields produced by various arrangements of electroacoustic transducers are disclosed in U.S. Pat FIGS. 3 to 5 shown. In Fig. 3 a circular listening area is surrounded by 56 electroacoustic transducers. The aim is to reproduce a plane wave. Such a plane wave reproduction is shown in (a) and (b) for a frequency of 1 kHz and 4 kHz, respectively. It can clearly be seen in (b) that artifacts occur due to spatial aliasing. These extend over almost the entire listening area.

Figuren 3(c) und (d) zeigen die Erzeugung einer fokussierten Quelle mittels Wellenfeldsynthese, wiederum für eine Frequenz von 1 kHz bzw. 4 kHz. In (d) zeigt sich, dass es einen Bereich um die fokussierte Quelle gibt, der nahezu frei von Artefakten ist. Dies kann im Verfahren gemäß der vorliegenden Erfindung ausgenutzt werden. Fig. 3(e) zeigt die Wiedergabe unter Verwendung des Verfahrens gemäß der vorliegenden Erfindung. In Fig. 3(e) wird gezeigt, dass aus den 56 elektroakustischen Wandlern 56 fokussierte Quellen erzeugt werden, die kreisförmig mit einem Durchmesser von 40 cm um das Zentrum angeordnet sind und die für die Wiedergabe einer ebenen Welle mit 4 kHz entsprechend dem Verfahren gemäß der Erfindung angesteuert werden. Es ist klar ersichtlich, dass innerhalb des Zielbeschallungsbereichs eine Resynthese ohne Artefakte erfolgt. In Fig. 3(f) ist das gleiche Szenario gezeigt, nur wurde hier der Zielbeschallungsbereich verschoben. Auch hier ist klar zu sehen, dass die Resynthese ohne wesentliche Artefakte erfolgt. FIGS. 3 (c) and (d) show the generation of a focused source by wave field synthesis, again for a frequency of 1 kHz and 4 kHz, respectively. In (d) shows that there is an area around the focused source that is almost free of artifacts. This can be exploited in the process according to the present invention. Fig. 3 (e) shows the reproduction using the method according to the present invention. In Fig. 3 (e) It is shown that from the 56 electroacoustic transducers 56 are generated focused sources which are arranged circularly with a diameter of 40 cm around the center and which are driven for the reproduction of a 4 kHz level wave according to the method according to the invention. It is clear that resynthesis takes place without artifacts within the target sonication range. In Fig. 3 (f) the same scenario is shown, except that the target PA was moved here. Again, it is clear that resynthesis occurs without significant artifacts.

Schallfelder ähnlich denen, die in Fig. 3(e) und (f) gezeigt sind, sind in Figuren 4(a) und (b) gezeigt, nur dass hier statt der kreisförmigen Anordnung der elektroakustischen Wandler eine rechteckige Anordnung verwendet wird. Eine solche Anordnung wird typischerweise bei praktischen Systemen benutzt. Wiederum zeigt Fig. 4(a) die Wiedergabe einer ebenen Welle mit 4 kHz und einem (kreisförmigen) Zielbeschallungsbereich in der Mitte, Fig. 4(b) die Situation, in der der Zielbeschallungsbereich verschoben ist. auch hier ist gezeigt, dass die Resynthese ohne wesentliche Artefakte erfolgt.Sound fields similar to those in Fig. 3 (e) and (f) are shown in FIGS. 4 (a) and (b) shown, except that instead of the circular arrangement of the electro-acoustic transducer, a rectangular arrangement is used. Such an arrangement is typically used in practical systems. Again shows Fig. 4 (a) the reproduction of a plane wave with 4 kHz and a (circular) target PA in the middle, Fig. 4 (b) the situation in which the target PA is shifted. Again, it is shown that the resynthesis takes place without significant artifacts.

Schließlich wird gemäß den Figuren 5(a) und (b) eine lineare Lautsprecheranordnung betrachtet, wie dies zum Teil bei praktischen Systemen genutzt wird. entsprechend Fig. 3 und 4 zeigt auch die Fig. 5 die Wiedergabe einer ebenen Welle mit 4 kHz, wobei in (a) der Zielbeschallungsbereich in der Mitte angeordnet ist. In Fig. 5(b) ist gegenüber (a) der Einfallswinkel der ebenen Welle im Zielbeschallungsbereich geändert. Auch hier ist deutlich zu sehen, dass die Resynthese ohne Artefakte erfolgt.Finally, according to the FIGS. 5 (a) and (b) considered a linear speaker assembly, as used in part in practical systems. corresponding Fig. 3 and 4 also shows the Fig. 5 the reproduction of a plane wave with 4 kHz, wherein in (a) the target sound area is located in the middle. In Fig. 5 (b) is changed from (a) the angle of incidence of the plane wave in the target sound area. Again, it can be seen clearly that the resynthesis takes place without artifacts.

Claims (12)

Verfahren zur Wiedergabe eines Schallfelds in einem Zielbeschallungsbereich (3) mittels mehrerer elektroakustischer Wandler (16), mit den Schritten: - Bestimmen von Ansteuerungssignalen (11) für mehrere virtuelle, auf einer den Zielbeschallungsbereich (3) umgebenden Kontur (13) angeordnete fokussierte Schallquellen (14) zur Wiedergabe des Schallfelds im Zielbeschallungsbereich (3); - Bestimmen von Ansteuerungssignalen (12) für die elektroakustischen Wandler (16) zum Erzeugen der fokussierten Schallquellen (14) und zum Ansteuern der fokussierten Schallquellen (14) mit den Ansteuerungssignalen (11) für die fokussierten Schallquellen (14); - Zuführen der Ansteuerungssignale (12) an die elektroakustischen Wandler (16). Method for reproducing a sound field in a target sound area (3) by means of a plurality of electroacoustic transducers (16), comprising the steps of: - Determining drive signals (11) for a plurality of virtual, on a the target sonicating area (3) surrounding contour (13) arranged focused sound sources (14) for reproducing the sound field in the target sonicating (3); - determining drive signals (12) for the electroacoustic transducers (16) for generating the focused sound sources (14) and for driving the focused sound sources (14) with the drive signals (11) for the focused sound sources (14); - Supplying the drive signals (12) to the electroacoustic transducer (16). Verfahren nach Anspruch 1, wobei die Ansteuerungssignale (11) für die fokussierten Schallquellen (14) auf der Basis der Positionen und/oder der Ausrichtungen der fokussierten Schallquellen (14) bestimmt werden.The method of claim 1, wherein the driving signals (11) for the focused sound sources (14) are determined based on the positions and / or orientations of the focused sound sources (14). Verfahren nach Anspruch 1 oder 2, wobei die Ansteuerungssignale (12) für die elektroakustischen Wandler (16) zur Erzeugung der fokussierten Schallquellen (14) auf der Basis der Positionen und/oder der Ausrichtungen der elektroakustischen Wandler (16) und/oder der fokussierten Schallquellen (14) bestimmt werden.The method of claim 1 or 2, wherein the drive signals (12) for the electroacoustic transducers (16) for generating the focused sound sources (14) based on the positions and / or orientations of the electroacoustic transducers (16) and / or the focused sound sources (14). Verfahren nach einem der vorstehenden Ansprüche, wobei die Ansteuerungssignale (11) für die fokussierten Schallquellen (14) durch Wellenfeldsynthese, ein Ambisonics- oder Higher-Order-Ambisonics-Verfahren, eine Time- und Amplitude-Delay-Technik, ein Spectral-Division-Verfahren oder ein numerisches Verfahren bestimmt werden.Method according to one of the preceding claims, wherein the drive signals (11) for the focused sound sources (14) by wave field synthesis, an Ambisonics or Higher Order Ambisonics method, a time and amplitude delay technique, a Spectral Division Method or a numerical method. Verfahren nach einem der vorstehenden Ansprüche, wobei die Ansteuerungssignale für die elektroakustischen Wandler (16) zur Erzeugung der fokussierter Schallquellen (14) durch Wellenfeldsynthese, ein Ambisonics- oder Higher-Order-Ambisonics-Verfahren, ein Spectral-Division-Verfahren oder ein einen modifizierten "time-reversal focusing"-Ansatz bestimmt werden.Method according to one of the preceding claims, wherein the drive signals for the electroacoustic transducers (16) for generating the focused sound sources (14) by wave field synthesis, an Ambisonics or higher order Ambisonics method, a Spectral Division method or a modified time-reversal focusing approach. Verfahren nach einem der vorstehenden Ansprüche, wobei die fokussierten Schallquellen (14) näher am Zielbeschallungsbereich (3) und/oder räumlich dichter als die elektroakustischen Wandler (16) angeordnet sind.Method according to one of the preceding claims, wherein the focused sound sources (14) are arranged closer to the target sound area (3) and / or spatially denser than the electroacoustic transducer (16). Verfahren nach einem der vorstehenden Ansprüche, wobei die Position des Zielbeschallungsbereichs (3) durch zeitliches Verändern der Positionen der fokussierten Schallquellen (14) zeitlich verändert wird.Method according to one of the preceding claims, wherein the position of the Zielbeschallungsbereichs (3) by temporally changing the positions of the focused sound sources (14) is changed over time. Verfahren nach einem der vorstehenden Ansprüche, wobei Ansteuerungssignale (11) für fokussierte Schallquellen (14) bestimmt werden, die auf mehrere Zielbeschallungsbereiche (3) umgebenden Konturen (13) angeordnet sind, so dass das Schallfelds in den mehreren Zielbeschallungsbereiche (3) wiedergegeben wird.Method according to one of the preceding claims, wherein drive signals (11) are determined for focused sound sources (14) which are arranged on a plurality of target sonication areas (3) surrounding contours (13), so that the sound field is reproduced in the plurality of target sonicating areas (3). Vorrichtung zur Wiedergabe eines Schallfelds in einem Zielbeschallungsbereich (3) insbesondere durch ein Verfahren gemäß einem der vorstehenden Ansprüche, mit mehreren elektroakustischen Wandlern (16),
einer ersten Signalverarbeitungseinheit (5) zum Bestimmen von Ansteuerungssignalen (11) für mehrere virtuelle, auf einer den Zielbeschallungsbereich (3) umgebenden Kontur (13) angeordnete fokussierte Schallquellen (14) zur Wiedergabe des Schallfelds im Zielbeschallungsbereich (3) und
einer zweiten Signalverarbeitungseinheit (4) zum Bestimmen von Ansteuerungssignalen (12) für die elektroakustischen Wandler (16) zum Erzeugen der fokussierten Schallquellen (14) und zum Ansteuern der fokussierten Schallquellen (14) mit den Ansteuerungssignalen (11) für die fokussierten Schallquellen (14).Device for reproducing a sound field in a target sound area (3), in particular by a method according to one of the preceding claims, comprising a plurality of electroacoustic transducers (16),
a first signal processing unit (5) for determining drive signals (11) for a plurality of virtual focused sound sources (14) arranged on a contour (13) surrounding the target sonicating area (3) for reproducing the sound field in the target sonicating area (3) and
a second signal processing unit (4) for determining drive signals (12) for the electroacoustic transducers (16) for generating the focused sound sources (14) and for driving the focused sound sources (14) with the drive signals (11) for the focused sound sources (14) , Vorrichtung nach Anspruch 9, wobei die elektroakustischen Wandler (16) auf einer den Zielbeschallungsbereich (3) umgebenden Kontur (15), insbesondere einem Kreis oder einem Rechteck, angeordnet sind.Apparatus according to claim 9, wherein the electroacoustic transducers (16) are arranged on a contour (15) surrounding the target sonicating area (3), in particular a circle or a rectangle. Vorrichtung nach Anspruch 9, wobei die elektroakustischen Wandler (16) auf einer offenen Kontur, insbesondere eine Linie, angeordnet sind.Apparatus according to claim 9, wherein the electroacoustic transducers (16) are arranged on an open contour, in particular a line. Vorrichtung nach Anspruch 9, 10 oder 11, wobei die fokussierten Schallquellen (14) näher am Zielbeschallungsbereich (3) und/oder räumlich dichter als die elektroakustischen Wandler (16) angeordnet sind.Apparatus according to claim 9, 10 or 11, wherein the focused sound sources (14) closer to the target sound area (3) and / or spatially denser than the electro-acoustic transducer (16) are arranged.
EP10155873.2A 2010-03-09 2010-03-09 Playback into a mobile target sound area using virtual loudspeakers Active EP2373054B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP10155873.2A EP2373054B1 (en) 2010-03-09 2010-03-09 Playback into a mobile target sound area using virtual loudspeakers

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP10155873.2A EP2373054B1 (en) 2010-03-09 2010-03-09 Playback into a mobile target sound area using virtual loudspeakers

Publications (2)

Publication Number Publication Date
EP2373054A1 true EP2373054A1 (en) 2011-10-05
EP2373054B1 EP2373054B1 (en) 2016-08-17

Family

ID=42483441

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10155873.2A Active EP2373054B1 (en) 2010-03-09 2010-03-09 Playback into a mobile target sound area using virtual loudspeakers

Country Status (1)

Country Link
EP (1) EP2373054B1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013167164A1 (en) * 2012-05-07 2013-11-14 Imm Sound S.A. Method and apparatus for layout and format independent 3d audio reproduction
US9268522B2 (en) 2012-06-27 2016-02-23 Volkswagen Ag Devices and methods for conveying audio information in vehicles
CN106017837A (en) * 2016-06-30 2016-10-12 北京空间飞行器总体设计部 Simulation method of equivalent sound simulation source
CN106664480A (en) * 2014-04-07 2017-05-10 哈曼贝克自动系统股份有限公司 Sound wave field generation
CN114422713A (en) * 2022-03-29 2022-04-29 湖南航天捷诚电子装备有限责任公司 Image acquisition and intelligent interpretation processing device and method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10125229A1 (en) 2001-05-22 2002-11-28 Thomson Brandt Gmbh Audio system with virtual loudspeakers that are positioned using processor so that listener is at sweet spot
WO2005019595A1 (en) 2003-08-19 2005-03-03 Crp Group Limited Fairing for a riser
DE102005052904A1 (en) 2004-11-04 2006-06-29 Schlenker, Berthold, Dipl.-Ing. System for reproducing audio signals
DE102005003431A1 (en) * 2005-01-25 2006-08-03 Institut für Rundfunktechnik GmbH Binaural signal e.g. dummy head microphone signal, reproducing arrangement for e.g. theme park, has virtual transauralization source with constant position relative to ears, and filter unit filtering signal portions for all directions
DE102007032272A1 (en) * 2007-07-11 2009-01-22 Institut für Rundfunktechnik GmbH Method for simulation of headphone reproduction of audio signals, involves calculating dynamically data set on geometric relationships between speakers, focused sound sources and ears of listener
WO2009124772A1 (en) * 2008-04-09 2009-10-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for generating filter characteristics

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10125229A1 (en) 2001-05-22 2002-11-28 Thomson Brandt Gmbh Audio system with virtual loudspeakers that are positioned using processor so that listener is at sweet spot
WO2005019595A1 (en) 2003-08-19 2005-03-03 Crp Group Limited Fairing for a riser
DE102005052904A1 (en) 2004-11-04 2006-06-29 Schlenker, Berthold, Dipl.-Ing. System for reproducing audio signals
DE102005003431A1 (en) * 2005-01-25 2006-08-03 Institut für Rundfunktechnik GmbH Binaural signal e.g. dummy head microphone signal, reproducing arrangement for e.g. theme park, has virtual transauralization source with constant position relative to ears, and filter unit filtering signal portions for all directions
DE102007032272A1 (en) * 2007-07-11 2009-01-22 Institut für Rundfunktechnik GmbH Method for simulation of headphone reproduction of audio signals, involves calculating dynamically data set on geometric relationships between speakers, focused sound sources and ears of listener
WO2009124772A1 (en) * 2008-04-09 2009-10-15 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for generating filter characteristics

Non-Patent Citations (11)

* Cited by examiner, † Cited by third party
Title
A.J. BERKHOUT; D. DE VRIES; P. VOGEL: "Acoustic control by wave field synthesis", JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, vol. 93, no. 5, May 1993 (1993-05-01), pages 2764 - 2778
E. VERHEIJEN: "Sound Reproduction by Wave Field Synthesis", DELFT UNIVERSITY OF TECHNOLOGY, 1997
J. AHRENS; S. SPORS: "Analytical driving functions for higher order Ambisonics", IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 30 March 2008 (2008-03-30)
J. DANIEL, REPRESENTATI- ON DE CHAMPS ACOUSTIQUES, APPLICATION Ä LA TRANSMISSION ET Ä LA REPRODUCTION DE SCENES SONORES COMPLEXES DANS UN CONTEXTE MULTIMEDIA, 2001
J. HANNEMANN; K. D. DONOHUE: "Virtual Sound Source Rendering Using a Multipole-Expansion and Method-of-Moments Approach", J. AUDIO ENG. SOC., vol. 56, no. 6, June 2008 (2008-06-01)
MENZE, D.; WITTEK, H.; FASTL, H.;THEILE, G.: "Binaurale Raumsynthese mittels Wellenfeldsynthese - Realisierung und Evaluierung", 23 March 2006 (2006-03-23), XP002596282, Retrieved from the Internet <URL:http://www.mmk.ei.tum.de/publ/pdf/06/06men1.pdf> [retrieved on 20100812] *
MENZEL, D.; WITTEK, H.; THEILE, G.; FASTL, H.: "The Binaural Sky: A Virtual Headphone for Binaural Room Synthesis", 2 November 2005 (2005-11-02), XP002596281, Retrieved from the Internet <URL:http://www.tonmeister.de/symposium/2005/np_pdf/R04.pdf> [retrieved on 20100812] *
S. SPORS: "Extension of an Analytic Secondary Source Selection Criterion for Wave Field Synthesis", CONVENTION DER AUDIO ENGINEERING SOCIETY (AES), October 2007 (2007-10-01)
S. SPORS; H. WIERSTORF; N. GEIER; J. AHRENS: "Physical and Perceptual Properties of Focused Sources in Wave Field Synthesis", CONVENTION PAPER DER 127. CONVENTION DER AUDIO ENGINEERING SOCIETY, 9 October 2009 (2009-10-09)
S. SPORS; R. RABENSTEIN; J. AHRENS: "The Theory of Wave Field Synthesis Revisited", PROCEEDINGS OF THE 124TH CONVENTION OF THE AUDIO ENGINEERING SOCIETY, 17 May 2008 (2008-05-17)
THEILE G: "Neue Anwendung der Wellenfeldsynthese: Binaural Sky", FKT FERNSEH UND KINOTECHNIK, FACHVERLAG SCHIELE & SCHON GMBH., BERLIN, DE, vol. 61, no. 10, 1 October 2007 (2007-10-01), pages 539 - 542, XP001545649, ISSN: 1430-9947 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013167164A1 (en) * 2012-05-07 2013-11-14 Imm Sound S.A. Method and apparatus for layout and format independent 3d audio reproduction
CN104303522A (en) * 2012-05-07 2015-01-21 杜比国际公司 Method and apparatus for layout and format independent 3d audio reproduction
US9378747B2 (en) 2012-05-07 2016-06-28 Dolby International Ab Method and apparatus for layout and format independent 3D audio reproduction
CN104303522B (en) * 2012-05-07 2017-04-19 杜比国际公司 Method and apparatus for layout and format independent 3d audio reproduction
US9268522B2 (en) 2012-06-27 2016-02-23 Volkswagen Ag Devices and methods for conveying audio information in vehicles
US10070242B2 (en) 2012-06-27 2018-09-04 Volkswagen Ag Devices and methods for conveying audio information in vehicles
CN106664480A (en) * 2014-04-07 2017-05-10 哈曼贝克自动系统股份有限公司 Sound wave field generation
CN106664480B (en) * 2014-04-07 2021-06-15 哈曼贝克自动系统股份有限公司 System and method for acoustic field generation
CN106017837A (en) * 2016-06-30 2016-10-12 北京空间飞行器总体设计部 Simulation method of equivalent sound simulation source
CN114422713A (en) * 2022-03-29 2022-04-29 湖南航天捷诚电子装备有限责任公司 Image acquisition and intelligent interpretation processing device and method
CN114422713B (en) * 2022-03-29 2022-06-24 湖南航天捷诚电子装备有限责任公司 Image acquisition and intelligent interpretation processing device and method

Also Published As

Publication number Publication date
EP2373054B1 (en) 2016-08-17

Similar Documents

Publication Publication Date Title
EP2080411B1 (en) Device and method for generating a number of loudspeaker signals for a loudspeaker array which defines a reproduction area
DE60304358T2 (en) METHOD FOR PROCESSING AUDIO FILES AND DETECTION DEVICE FOR THE APPLICATION THEREOF
Spors et al. Physical and perceptual properties of focused virtual sources in wave field synthesis
EP3044972B1 (en) Device and method for the decorrelation of loudspeaker signals
JP2013510481A (en) Apparatus and method for calculating speaker drive coefficient of speaker equipment for audio signal related to virtual sound source
EP2373054B1 (en) Playback into a mobile target sound area using virtual loudspeakers
Ahrens et al. Local sound field synthesis by virtual secondary sources
De Sena et al. Analysis and design of multichannel systems for perceptual sound field reconstruction
DE102006010212A1 (en) Apparatus and method for the simulation of WFS systems and compensation of sound-influencing WFS properties
DE102005003431B4 (en) Arrangement for reproducing binaural signals (artificial head signals) by a plurality of loudspeakers
EP3677053B1 (en) Loudspeaker system for surround sound with rejection of undesirable direct sound
DE102011082310A1 (en) Apparatus, method and electroacoustic system for reverberation time extension
DE102021203632A1 (en) Loudspeaker, signal processor, method for manufacturing the loudspeaker or method for operating the signal processor using dual-mode signal generation with two sound generators
DE102021203640A1 (en) Device and method for generating a first control signal and a second control signal using linearization and/or bandwidth expansion
DE102015008000A1 (en) Method for reproducing sound in reflection environments, in particular in listening rooms
Geng et al. Movable virtual sound source construction based on wave field synthesis using a linear parametric loudspeaker array
DE102021205545A1 (en) Device and method for generating a control signal for a sound generator or for generating an extended multi-channel audio signal using a similarity analysis
DE102011108788B4 (en) Method for processing an audio signal, audio reproduction system and processing unit for processing audio signals
WO2007110087A1 (en) Arrangement for the reproduction of binaural signals (artificial-head signals) by a plurality of loudspeakers
EP2503799A1 (en) Method and system for calculating synthetic head related transfer functions by means of virtual local sound field synthesis
EP2571290B1 (en) Local sound field synthesis with a virtual scattering body
DE102021200553B4 (en) Device and method for controlling a sound generator with synthetic generation of the differential signal
DE102018108852B3 (en) Method for influencing an auditory sense perception of a listener
DE3233990A1 (en) METHOD FOR INFLUENCING THE EXPANSION AND LOCATION OF A PHANTOMIC SOUND SOURCE IN MULTI-CHANNEL SPEAKER PLAYBACK
WO2023052555A2 (en) Loudspeaker system, control circuit for a loudspeaker system having one tweeter and two mid-range drivers or woofers, and corresponding method

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

AX Request for extension of the european patent

Extension state: AL BA ME RS

17P Request for examination filed

Effective date: 20120220

17Q First examination report despatched

Effective date: 20130422

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20160309

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: DEUTSCHE TELEKOM AG

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 822081

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160915

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502010012198

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160817

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161117

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161118

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161219

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502010012198

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161117

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20170518

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170309

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170309

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20170331

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 822081

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170309

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170309

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20100309

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160817

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161217

PLAA Information modified related to event that no opposition was filed

Free format text: ORIGINAL CODE: 0009299DELT

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

R26N No opposition filed (corrected)

Effective date: 20170518

RIN2 Information on inventor provided after grant (corrected)

Inventor name: SPORS, SASCHA

Inventor name: AHRENS, JENS

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20231213

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231212

Year of fee payment: 15

Ref country code: GB

Payment date: 20240322

Year of fee payment: 15