EP2373054A1 - Playback into a mobile target sound area using virtual loudspeakers - Google Patents
Playback into a mobile target sound area using virtual loudspeakers Download PDFInfo
- Publication number
- EP2373054A1 EP2373054A1 EP10155873A EP10155873A EP2373054A1 EP 2373054 A1 EP2373054 A1 EP 2373054A1 EP 10155873 A EP10155873 A EP 10155873A EP 10155873 A EP10155873 A EP 10155873A EP 2373054 A1 EP2373054 A1 EP 2373054A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- sound sources
- target
- focused
- drive signals
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 50
- 238000003786 synthesis reaction Methods 0.000 claims description 26
- 230000015572 biosynthetic process Effects 0.000 claims description 25
- 238000013459 approach Methods 0.000 claims description 5
- 238000000527 sonication Methods 0.000 claims description 4
- 230000003595 spectral effect Effects 0.000 claims description 4
- 235000009508 confectionery Nutrition 0.000 description 9
- 230000001934 delay Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000001914 filtration Methods 0.000 description 2
- 238000011045 prefiltration Methods 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000005405 multipole Effects 0.000 description 1
- 230000000704 physical effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
- H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
- H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
- H04R1/403—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers loud-speakers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/12—Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
- H04S2420/13—Application of wave-field synthesis in stereophonic audio systems
Definitions
- the present invention relates to the reproduction of a sound field in a limited area using multiple speakers.
- stereophonic techniques For generating a spatial sound impression stereophonic techniques can be used. These techniques use two or more loudspeakers to produce a spatial sound impression in natural hearing through level differences and / or differences in propagation time. However, the desired spatial hearing impression arises only within a limited range, the so-called "sweet spot" within the speaker assembly. Furthermore, there are various approaches to tracking or enlargement of the sweet spot in stereophonic playback, as for example in the DE-A-10 125 229 , or the DE-A-10 2005 052 904 are described. In stereo, however, a soundfield is not physically reconstructed, but creates an illusion that sounds very similar to the natural model, but has very different physical properties. Also, with the stereophonic only the impression of a sound source can be taught that has at least the distance to the nearest speakers.
- the technique of wave field synthesis can be used for the authentic physical reconstruction of a sound field over a wide range.
- This technique uses a large number of loudspeakers, thereby avoiding the problem that in a sweet spot within the loudspeaker arrangement, the reconstruction of the desired sound field is significantly more accurate than in the rest of the listening area, as occurs, for example, in stereo technology
- the loudspeaker drive signals for the individual Speakers are calculated analytically. In the practical implementation, however, there are large deviations from the desired sound field over the entire potential listening area.
- the technique of wave field synthesis is, for example, in the publication of S. Spors, R. Rabenstein and J.
- Wave field synthesis can also be used to generate so-called virtual focused sound sources. This is the physical re-synthesis of a sound source located between the listener and the speakers. Focused sound sources in wave field synthesis and their properties are described, for example, in the publication of S. Spors, H. Wierstorf, N. Geier, and J. Ahrens, “Physical and Perceptual Properties of Focused Sources in Wave Field Synthesis," which are convention papers of the 127th Convention of the Audio Engineering Society, New York, USA, 9 .-12. October 2009, is published ,
- Ambisonics Another known technique for reconstruction of a sound field is called Ambisonics and is for example in the WO 2005/0195954 A2 described.
- This technique requires circular arrays of loudspeakers, with the loudspeaker signals typically being generated using numerical algorithms.
- the limitation of the spatial bandwidth of the drive signals necessary in the calculation path causes the reconstruction of the desired sound field in the center of the loudspeaker arrangement to be most accurate. In the center of the loudspeaker arrangement is therefore a sweet spot. With increasing distance from the center of the loudspeaker arrangement, the deviations in the reconstructed sound field become larger.
- J. Hannemann and KD Donohue "Virtual Sound Source Rendering Using a Multipole Expansion and Method-of-Moments Approach," J.
- the loudspeaker arrangement for the reconstruction of the sound field should be freely selectable and the desired display area should be freely selectable within or in front of the loudspeaker arrangement.
- the present invention provides a method and an apparatus for reproducing a sound field in a target sound area by means of a plurality of electroacoustic transducers. It is a basic idea of the present invention to use focused sources as virtual sound sources for the reproduction in the spatially limited target sound area.
- the focused sources are generated by the electroacoustic transducers.
- the activation of the virtual sound sources takes place in accordance with real speakers at the corresponding position in order to generate a desired sound field within the target sounding area.
- control signals for the virtual focused sound sources are determined, which are arranged on a contour around the target PA range.
- drive signals are determined for the actually arranged electro-acoustic transducers, by which the virtual sources and the output signals desired by them are generated. These drive signals are supplied to the electroacoustic transducers.
- the virtual sound sources are closer to the target sound area and / or spatially denser than the electroacoustic transducers. Thereby, the accuracy of the reproduction within the target sounding area can be increased.
- the result is a sweet spot, so a limited target sound area with improved playback properties.
- a physical reconstruction of a sound field in a limited area is achieved by means of several loudspeakers or electroacoustic transducers. This can be done by means of a closed, preferably convex arrangement of the electroacoustic transducer. However, it is also a non-closed, for example, linear arrangement of the electro-acoustic transducer possible. Furthermore, the desired display area can be placed dynamically and freely within or in front of the loudspeaker arrangement and thus, for example, adapted dynamically to a listener position.
- the calculation of the control of the virtual sound sources and the actually existing electroacoustic transducer can be done by various methods, in a particularly efficient manner, for example, with the wave field synthesis.
- the invention can be advantageously applied to sonicating a moving listener or to sonicating a listener at a fixed position with electro-acoustic transducers disposed on the walls of a room. It is also possible to sonicate several listeners by generating focused sound sources that are arranged on contours surrounding several target PA areas. For this it may be necessary to compensate for the influence of the virtual sound sources among each other.
- a device for reproducing a sound field in a target PA 3 is shown, with which the inventive method can be technically realized.
- the electroacoustic transducers 16 are located on a contour 15, which in the in Fig. 1 embodiment shown encloses the potential target PA 3.
- a closed arrangement is not absolutely necessary;
- the electroacoustic transducers 16 convert the input electrical signals into sound signals.
- virtual secondary sources (virtual loudspeakers) 14 are generated by the electroacoustic transducers 16, which in turn are arranged on a contour 13 which surrounds the target sound area 3.
- These virtual loudspeakers 14 are generated as focused sound sources and driven according to real speakers at their position to produce the desired sound field corresponding to a desired virtual sound source 1 within the area 3.
- the focused sound sources 14 are preferably arranged spatially denser than the electroacoustic transducers 16, since thereby the accuracy of the reproduction within the sounding area 3 is higher and in this way a "sweet spot" with improved reproduction properties arises.
- the loudspeaker drive signals 12 for generating the focused sound sources 14 on the contour 13 are generated in a signal processing unit 4.
- the positions 6 and the orientations 7 of the sound sources 14 are generally required.
- a signal processing unit 5 is provided, which calculates the drive signals 11 for the virtual loudspeakers 14 within the target sonication area 3.
- the positions 8 and 9 alignments of the virtual speakers 14 are needed.
- the method according to the present invention is independent of the method used for resynthesis of the sound field within the target sounding area 3 and regardless of the method used to generate the virtual loudspeakers 14 by the electroacoustic transducers 16 by means of acoustic focusing.
- the methods of wave field synthesis or ambisonics are suitable for this and can be selected independently of one another according to the requirements.
- a particularly efficient implementation of the method according to the invention results from the use of wave field synthesis.
- the signal processing units 4 and 5 can be realized as follows.
- the driving signals of the virtual focused sound sources 14 corresponding to the positions of the electroacoustic transducers 16 and the virtual speakers 14 are generated.
- the required electroacoustic transducers 16 are initially selected according to the position of the focused sound sources 14 and their emission direction.
- a method can be used, as is known from the document of S. Spors, "Extension of Analytical Secondary Source Criterion for Wave Field Synthesis", in: 123rd Audio Engineering Society (AES) Convention, New York, USA, October 2007 is described.
- the wavefronts converge towards the focal point, ie the position of the focused sound source, and diverge behind it like a point source at the focal point.
- the direction of the wavefronts is equal to that of a point source in the focal point only in a half-space.
- This half-space can be controlled according to the invention by appropriate methods, in the wave field synthesis, this is done for example by the selection of the active electroacoustic transducer.
- the selected active electroacoustic transducer can then, for example, according to the focus operator, as in the thesis of E. Verheijen, "Sound Reproduction by Wave Field Synthesis", Delft University of Technology, 1997 , the input signals of the signal processing unit 4 are weighted and time-delayed.
- Fig. 2 is shown schematically the arrangement and structure of the signal processing units, with which the electro-acoustic transducer 16 can be controlled.
- the loudspeaker signals can be obtained by prefiltering in prefilter 18, weighting and delaying the signal from virtual source 10.
- the output signals of the signal processing unit 5 thus arise by time delay and weighting of the source signal according to the theory of wave field synthesis (see the above-mentioned thesis by E. Verheijen) for the reproduction of virtual point sources and plane waves or other complex sound fields.
- the signal processing unit 4 it is also possible to proceed for the focused sources in wave field synthesis, but here the delays are negative and the pre-filter 17 has a different characteristic.
- the efficiency of realization by wave field synthesis lies in the fact that delays and weights of an input signal can be converted very efficiently. Furthermore, the necessary time delays and weights can be obtained by simple formulas from the geometry and the desired source. However, the use of other methods is also possible. Thus, the focused sound sources can be realized not only by the wave field synthesis, but it is also the use of higher order Ambisonics possible, as well as by AJ Berkhout, D. de Vries and P. Vogel, "Acoustic control by wave field synthesis", Journal of the Acoustical Society of America, Volume 93 (5): 2764-2778, May 1993 , is described. Furthermore, a Spectral Division Method (see the above-mentioned publication by S. Spors, R. Rabenstein and J. Ahrens) or the application of modified time reversal focusing approaches is also conceivable.
- the control of the focused sound sources in addition to the above-described wave field synthesis, which may be model- or data-based, also be done by time and amplitude delay techniques, such as stereophony or VBAP, by Higher-order Ambisonics, a Spectral Division method, for example according to the doctoral thesis of J. Daniel, "Representation of champs acoustics, application à la transmission and reproduction of scenes sonorous complexes dans un contexte multimedia", united Paris 6, 2001 , or numerical (least-squares) approaches.
- any combinations of the techniques for the realization and control of the virtual focused sound sources are conceivable.
- FIGS. 3 to 5 Examples of the sound fields produced by various arrangements of electroacoustic transducers are disclosed in U.S. Pat FIGS. 3 to 5 shown.
- Fig. 3 a circular listening area is surrounded by 56 electroacoustic transducers.
- the aim is to reproduce a plane wave.
- Such a plane wave reproduction is shown in (a) and (b) for a frequency of 1 kHz and 4 kHz, respectively. It can clearly be seen in (b) that artifacts occur due to spatial aliasing. These extend over almost the entire listening area.
- FIGS. 3 (c) and (d) show the generation of a focused source by wave field synthesis, again for a frequency of 1 kHz and 4 kHz, respectively.
- (d) shows that there is an area around the focused source that is almost free of artifacts. This can be exploited in the process according to the present invention.
- Fig. 3 (e) shows the reproduction using the method according to the present invention.
- Fig. 3 (e) It is shown that from the 56 electroacoustic transducers 56 are generated focused sources which are arranged circularly with a diameter of 40 cm around the center and which are driven for the reproduction of a 4 kHz level wave according to the method according to the invention. It is clear that resynthesis takes place without artifacts within the target sonication range.
- Fig. 3 (f) the same scenario is shown, except that the target PA was moved here. Again, it is clear that resynthesis occurs without significant artifacts.
- FIGS. 4 (a) and (b) shown Sound fields similar to those in Fig. 3 (e) and (f) are shown in FIGS. 4 (a) and (b) shown, except that instead of the circular arrangement of the electro-acoustic transducer, a rectangular arrangement is used. Such an arrangement is typically used in practical systems.
- Fig. 4 (a) the reproduction of a plane wave with 4 kHz and a (circular) target PA in the middle
- Fig. 4 (b) the situation in which the target PA is shifted. Again, it is shown that the resynthesis takes place without significant artifacts.
- FIGS. 5 (a) and (b) considered a linear speaker assembly, as used in part in practical systems.
- corresponding Fig. 3 and 4 also shows the Fig. 5 the reproduction of a plane wave with 4 kHz, wherein in (a) the target sound area is located in the middle.
- Fig. 5 (b) is changed from (a) the angle of incidence of the plane wave in the target sound area.
Landscapes
- Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Description
Die vorliegende Erfindung betrifft die Wiedergabe bzw. Rekonstruktion eines Schallfelds in einem begrenzten Bereich mithilfe mehrerer Lautsprecher.The present invention relates to the reproduction of a sound field in a limited area using multiple speakers.
Zur Erzeugung eines räumlichen Schalleindrucks können stereophonische Techniken eingesetzt werden. Bei diesen Techniken wird mithilfe von zwei oder mehr Lautsprechern durch Pegeldifferenzen und/oder Laufzeitdifferenzen ein räumlicher Schalleindruck beim natürlichen Hören erzeugt. Der gewünschte räumliche Höreindruck entsteht dabei jedoch nur innerhalb eines begrenzten Bereichs, dem sogenannten "Sweet Spot", innerhalb der Lautsprecheranordnung. Weiterhin gibt es verschiedene Ansätze zur Nachführung bzw. Vergrößerung des Sweet Spot bei stereophonischer Wiedergabe, wie sie beispielsweise in der
Zur authentischen physikalischen Rekonstruktion eines Schallfeldes über einen ausgedehnten Bereich kann die Technik der Wellenfeldsynthese verwendet werden. Diese Technik verwendet eine große Anzahl von Lautsprechern und vermeidet dadurch das Problem, dass in einem Sweet Spot innerhalb der Lautsprecheranordnung die Rekonstruktion des gewünschten Schallfeldes signifikant genauer ist als im Rest des Hörbereichs, wie es beispielsweise bei der Stereo-Technik auftritt Die Lautsprecheransteuerungssignale für die einzelnen Lautsprecher werden analytisch berechnet. In der praktischen Realisierung kommt es jedoch zu großen Abweichungen vom gewünschten Schallfeld über den gesamten potenziellen Hörbereich. Die Technik der Wellenfeldsynthese ist beispielsweise in der Veröffentlichung von
Eine andere bekannte Technik zur Rekonstruktion eines Schallfeldes wird mit Ambisonics bezeichnet und ist beispielsweise in der
Mit Erweiterungen von Ambisonics, beispielsweise der als Higher Order Ambisonics bezeichneten Technik, kann in Verbindung mit einer analytischen Berechnung der Lautsprecheransteuerungssignale ein effizienteres Verfahren bereitgestellt werden. Ein solches Verfahren ist beispielsweise in der Veröffentlichung von
Es ist eine Aufgabe der vorliegenden Erfindung, ein Verfahren und eine Vorrichtung zur effizienten physikalischen Rekonstruktion eines Schallfelds in einem begrenzten Bereich mithilfe von mehreren Lautsprechern bereitzustellen, wobei der begrenzte Wiedergabebereich dynamisch und frei platziert bzw. dynamisch verschoben werden kann. Die Lautsprecheranordnung zur Rekonstruktion des Schallfelds soll frei wählbar sein und der gewünschte Wiedergabebereich soll frei innerhalb bzw. vor der Lautsprecheranordnung ausgewählt werden können.It is an object of the present invention to provide a method and apparatus for efficient physical reconstruction of a sound field in a limited area using multiple speakers, wherein the limited display area can be dynamically and freely placed or dynamically shifted. The loudspeaker arrangement for the reconstruction of the sound field should be freely selectable and the desired display area should be freely selectable within or in front of the loudspeaker arrangement.
Diese Aufgaben werden mit den Merkmalen der Patentansprüche gelöst.These objects are achieved with the features of the claims.
Mit der vorliegenden Erfindung werden ein Verfahren und eine Vorrichtung zur Wiedergabe eines Schallfelds in einem Zielbeschallungsbereich mittels mehrerer elektroakustischer Wandler bereitgestellt. Es ist eine Grundidee der vorliegenden Erfindung, fokussierte Quellen als virtuelle Schallquellen für die Wiedergabe in dem räumlich begrenzten Zielbeschallungsbereich zu nutzen. Die fokussierten Quellen werden hierbei durch die elektroakustischen Wandler erzeugt. Die Ansteuerung der virtuellen Schallquellen erfolgt entsprechend realer Lautsprecher an der entsprechenden Position, um ein gewünschtes Schallfeld innerhalb des Zielbeschallungsbereichs zu erzeugen. So werden zum Einen Ansteuerungssignale für die virtuellen fokussierten Schallquellen bestimmt, die auf einer Kontur um den Zielbeschallungsbereich angeordnet sind. Weiterhin werden Ansteuerungssignale für die tatsächlich angeordneten elektroakustischen Wandler bestimmt, durch die die virtuellen Quellen und die von diesen erwünschten Ausgangssignale erzeugt werden. Diese Ansteuerungssignale werden den elektroakustischen Wandlern zugeführt.The present invention provides a method and an apparatus for reproducing a sound field in a target sound area by means of a plurality of electroacoustic transducers. It is a basic idea of the present invention to use focused sources as virtual sound sources for the reproduction in the spatially limited target sound area. The focused sources are generated by the electroacoustic transducers. The activation of the virtual sound sources takes place in accordance with real speakers at the corresponding position in order to generate a desired sound field within the target sounding area. Thus, on the one hand control signals for the virtual focused sound sources are determined, which are arranged on a contour around the target PA range. Furthermore, drive signals are determined for the actually arranged electro-acoustic transducers, by which the virtual sources and the output signals desired by them are generated. These drive signals are supplied to the electroacoustic transducers.
Zur Resynthese des Schallfelds innerhalb des Zielbeschallungsbereichs und zur Erzeugung der virtuellen Schallquellen durch die elektroakustischen Wandler mittels akustischer Fokussierung können bekannte Verfahren eingesetzt werden. Insbesondere können die Verfahren der Wellenfeldsynthese oder Ambisonics unabhängig voneinander entsprechend den Anforderungen gewählt werden. Die Verwendung der Wellenfeldsynthese ist jedoch bevorzugt.For resynthesis of the sound field within the target sonication area and for generating the virtual sound sources by the electroacoustic transducer by means of acoustic focusing known methods can be used. In particular, the methods of wave field synthesis or ambisonics can be independently selected according to the requirements. However, the use of wave field synthesis is preferred.
Es ist weiterhin bevorzugt, die virtuellen Schallquellen näher am Zielbeschallungsbereich und/oder räumlich dichter anzuordnen als die elektroakustischen Wandler. Dadurch kann die Genauigkeit der Wiedergabe innerhalb des Zielbeschallungsbereichs erhöht werden. So entsteht ein Sweet Spot, also ein begrenzter Zielbeschallungsbereich mit verbesserten Wiedergabeeigenschaften. Durch zeitliches Verschieben der virtuellen Schallquellen kann dieser Sweet Spot, also der begrenzte Zielbeschallungsbereich, dynamisch nachgeführt werden, z.B. einem Zuhörer folgend, der sich bewegt.It is further preferred to arrange the virtual sound sources closer to the target sound area and / or spatially denser than the electroacoustic transducers. Thereby, the accuracy of the reproduction within the target sounding area can be increased. The result is a sweet spot, so a limited target sound area with improved playback properties. By temporally shifting the virtual sound sources, this sweet spot, so the limited Zielbeschallungsbereich be dynamically tracked, for example, following a listener who moves.
Mit der vorliegenden Erfindung wird eine physikalische Rekonstruktion eines Schallfelds in einem begrenzten Bereich mithilfe mehrerer Lautsprecher bzw. elektroakustischer Wandler erreicht. Dies kann mittels einer geschlossenen, vorzugsweise konvexen Anordnung der elektroakustischen Wandler geschehen. Es ist jedoch auch eine nicht geschlossene, beispielsweise lineare Anordnung der elektroakustischen Wandler möglich. Weiterhin kann der gewünschte Wiedergabebereich dynamisch und frei innerhalb bzw. vor der Lautsprecheranordnung platziert werden und so beispielsweise dynamisch an eine Hörerposition angepasst werden. Die Berechnung der Ansteuerung der virtuellen Schallquellen und der tatsächlich vorhandenen elektroakustischen Wandler kann durch verschiedene Verfahren geschehen, in besonders effizienter Weise beispielsweise mit der Wellenfeldsynthese.With the present invention, a physical reconstruction of a sound field in a limited area is achieved by means of several loudspeakers or electroacoustic transducers. This can be done by means of a closed, preferably convex arrangement of the electroacoustic transducer. However, it is also a non-closed, for example, linear arrangement of the electro-acoustic transducer possible. Furthermore, the desired display area can be placed dynamically and freely within or in front of the loudspeaker arrangement and thus, for example, adapted dynamically to a listener position. The calculation of the control of the virtual sound sources and the actually existing electroacoustic transducer can be done by various methods, in a particularly efficient manner, for example, with the wave field synthesis.
Die Erfindung kann vorteilhaft zur Beschallung eines sich bewegenden Zuhörers oder zur Beschallung eines Zuhörers an einer festen Position mit elektroakustischen Wandlern, die an den Wänden eines Raums angeordnet sind, angewendet werden. Auch ist eine Beschallung mehrerer Zuhörer möglich, indem fokussierte Schallquellen erzeugt werden, die auf mehreren Zielbeschallungsbereichen umgebenen Konturen angeordnet sind. Dazu ist es unter Umständen nötig den Einfluss der virtuellen Schallquellen untereinander zu kompensieren.The invention can be advantageously applied to sonicating a moving listener or to sonicating a listener at a fixed position with electro-acoustic transducers disposed on the walls of a room. It is also possible to sonicate several listeners by generating focused sound sources that are arranged on contours surrounding several target PA areas. For this it may be necessary to compensate for the influence of the virtual sound sources among each other.
Die Erfindung wird im Folgenden unter Bezugnahme auf die beigefügten Figuren näher beschrieben, wobei
-
Fig. 1 eine erfindungsgemäße Vorrichtung zur Wiedergabe eines Schallfelds zeigt, -
Fig. 2 schematisch eine Vorrichtung zur Erzeugung der Ansteuerungssignale für die erfindungsgemäße Vorrichtung zeigt, -
Fig. 3(a) bis (f) durch eine kreisförmige Lautsprecheranordnung erzeugte Schallfelder, -
Fig. 4(a) und (b) durch eine rechteckige Lautsprecheranordnung erzeugte Schallfelder und -
Fig. 5(a) und (b) durch eine lineare Lautsprecheranordnung erzeugte Schallfelder zeigen.
-
Fig. 1 shows a device according to the invention for reproducing a sound field, -
Fig. 2 schematically shows a device for generating the drive signals for the device according to the invention, -
3 (a) to (f) sound fields generated by a circular loudspeaker arrangement, -
4 (a) and (b) sound fields generated by a rectangular loudspeaker arrangement and -
Fig. 5 (a) and (b) show sound fields generated by a linear loudspeaker arrangement.
In
Die fokussierten Schallquellen 14 werden vorzugsweise räumlich dichter angeordnet als die elektroakustischen Wandler 16, da dadurch die Genauigkeit der Wiedergabe innerhalb des Beschallungsbereichs 3 höher ist und auf diese Weise ein "Sweet Spot" mit verbesserten Wiedergabeeigenschaften entsteht.The focused sound sources 14 are preferably arranged spatially denser than the
Die Lautsprecheransteuerungssignale 12 zum Erzeugen der fokussierten Schallquellen 14 auf der Kontur 13 werden in einer Signalverarbeitungseinheit 4 erzeugt. Hierfür werden im Allgemeinen die Positionen 6 und die Ausrichtungen 7 der Schallquellen 14 benötigt. Weiterhin ist eine Signalverarbeitungseinheit 5 vorgesehen, die die Ansteuerungssignale 11 für die virtuellen Lautsprecher 14 innerhalb des Zielbeschallungsbereichs 3 berechnet. Hierzu werden wiederum im Allgemeinen die Positionen 8 und Ausrichtungen 9 der virtuellen Lautsprecher 14 benötigt.The loudspeaker drive signals 12 for generating the focused sound sources 14 on the
Prinzipiell ist das Verfahren gemäß der vorliegenden Erfindung unabhängig vom verwendeten Verfahren zur Resynthese des Schallfelds innerhalb des Zielbeschallungsbereichs 3 und unabhängig vom verwendeten Verfahren zur Erzeugung der virtuellen Lautsprecher 14 durch die elektroakustischen Wandler 16 mittels akustischer Fokussierung. Insbesondere sind die Verfahren der Wellenfeldsynthese oder Ambisonics hierfür geeignet und können unabhängig voneinander entsprechend den Anforderungen gewählt werden. Eine besonders effiziente Umsetzung des erfindungsgemäßen Verfahrens ergibt sich bei der Verwendung der Wellenfeldsynthese.In principle, the method according to the present invention is independent of the method used for resynthesis of the sound field within the target sounding area 3 and regardless of the method used to generate the
Bei Anwendung der Wellenfeldsynthese können die Signalverarbeitungseinheiten 4 und 5 folgendermaßen realisiert werden.When using the wave field synthesis, the
In der Signalverarbeitungseinheit 4 werden die Ansteuerungssignale der virtuellen fokussierten Schallquellen 14 entsprechend der Positionen der elektroakustischen Wandler 16 und der virtuellen Lautsprecher 14 erzeugt. Hierzu werden zunächst die benötigten elektroakustischen Wandler 16 entsprechend der Position der fokussierten Schallquellen 14 und deren Abstrahlrichtung ausgewählt. Für die Auswahl der elektroakustischen Wandler 16 kann beispielsweise ein Verfahren benutzt werden, wie es aus der Dokument von
In
Es ist weiterhin möglich, Vorfilterungen, Gewichtungen und Verzögerungen auch in einer einzigen Signalverarbeitungseinheit zusammenzufassen bzw. zu kombinieren. Das Signal eines spezifischen elektroakustischen Wandlers entsteht dann durch eine kombinierte Vorfilterung und mehrfache Gewichtung/Verzögerung des Signals 10 der virtuellen Quelle 10.It is also possible to combine or combine pre-filtering, weightings and delays in a single signal processing unit. The signal of a specific electroacoustic transducer is then produced by a combined pre-filtering and multiple weighting / delay of the
Die Effizienz der Realisierung mittels Wellenfeldsynthese liegt darin, dass Verzögerungen und Gewichtungen eines Eingangssignals sehr effizient umgesetzt werden können. Weiterhin können die notwendigen Zeitverzögerungen und Gewichtungen mittels einfacher Formeln aus der Geometrie und der gewünschten Quelle gewonnen werden. Hierbei ist jedoch auch die Verwendung von anderen Verfahren möglich. So können die fokussierten Schallquellen nicht nur durch die Wellenfeldsynthese realisiert werden, sondern es ist auch die Verwendung von Higher-Order Ambisonics möglich, wie sie auch von
Die Ansteuerung der fokussierten Schallquellen kann, neben der oben dargestellten Wellenfeldsynthese, die model- oder datenbasiert sein kann, auch durch Time- und Amplitude Delay-Techniken erfolgen, wie Stereophonie oder VBAP, durch Higher-Order Ambisonics, einer Spectral Division-Methode, beispielsweise gemäß der Doktorarbeit von
Beispiele für die Schallfelder, die durch verschiedene Anordnungen von elektroakustischen Wandlern erzeugt werden, sind in den
Schallfelder ähnlich denen, die in
Schließlich wird gemäß den
Claims (12)
einer ersten Signalverarbeitungseinheit (5) zum Bestimmen von Ansteuerungssignalen (11) für mehrere virtuelle, auf einer den Zielbeschallungsbereich (3) umgebenden Kontur (13) angeordnete fokussierte Schallquellen (14) zur Wiedergabe des Schallfelds im Zielbeschallungsbereich (3) und
einer zweiten Signalverarbeitungseinheit (4) zum Bestimmen von Ansteuerungssignalen (12) für die elektroakustischen Wandler (16) zum Erzeugen der fokussierten Schallquellen (14) und zum Ansteuern der fokussierten Schallquellen (14) mit den Ansteuerungssignalen (11) für die fokussierten Schallquellen (14).Device for reproducing a sound field in a target sound area (3), in particular by a method according to one of the preceding claims, comprising a plurality of electroacoustic transducers (16),
a first signal processing unit (5) for determining drive signals (11) for a plurality of virtual focused sound sources (14) arranged on a contour (13) surrounding the target sonicating area (3) for reproducing the sound field in the target sonicating area (3) and
a second signal processing unit (4) for determining drive signals (12) for the electroacoustic transducers (16) for generating the focused sound sources (14) and for driving the focused sound sources (14) with the drive signals (11) for the focused sound sources (14) ,
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP10155873.2A EP2373054B1 (en) | 2010-03-09 | 2010-03-09 | Playback into a mobile target sound area using virtual loudspeakers |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP10155873.2A EP2373054B1 (en) | 2010-03-09 | 2010-03-09 | Playback into a mobile target sound area using virtual loudspeakers |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2373054A1 true EP2373054A1 (en) | 2011-10-05 |
EP2373054B1 EP2373054B1 (en) | 2016-08-17 |
Family
ID=42483441
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP10155873.2A Active EP2373054B1 (en) | 2010-03-09 | 2010-03-09 | Playback into a mobile target sound area using virtual loudspeakers |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP2373054B1 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013167164A1 (en) * | 2012-05-07 | 2013-11-14 | Imm Sound S.A. | Method and apparatus for layout and format independent 3d audio reproduction |
US9268522B2 (en) | 2012-06-27 | 2016-02-23 | Volkswagen Ag | Devices and methods for conveying audio information in vehicles |
CN106017837A (en) * | 2016-06-30 | 2016-10-12 | 北京空间飞行器总体设计部 | Simulation method of equivalent sound simulation source |
CN106664480A (en) * | 2014-04-07 | 2017-05-10 | 哈曼贝克自动系统股份有限公司 | Sound wave field generation |
CN114422713A (en) * | 2022-03-29 | 2022-04-29 | 湖南航天捷诚电子装备有限责任公司 | Image acquisition and intelligent interpretation processing device and method |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE10125229A1 (en) | 2001-05-22 | 2002-11-28 | Thomson Brandt Gmbh | Audio system with virtual loudspeakers that are positioned using processor so that listener is at sweet spot |
WO2005019595A1 (en) | 2003-08-19 | 2005-03-03 | Crp Group Limited | Fairing for a riser |
DE102005052904A1 (en) | 2004-11-04 | 2006-06-29 | Schlenker, Berthold, Dipl.-Ing. | System for reproducing audio signals |
DE102005003431A1 (en) * | 2005-01-25 | 2006-08-03 | Institut für Rundfunktechnik GmbH | Binaural signal e.g. dummy head microphone signal, reproducing arrangement for e.g. theme park, has virtual transauralization source with constant position relative to ears, and filter unit filtering signal portions for all directions |
DE102007032272A1 (en) * | 2007-07-11 | 2009-01-22 | Institut für Rundfunktechnik GmbH | Method for simulation of headphone reproduction of audio signals, involves calculating dynamically data set on geometric relationships between speakers, focused sound sources and ears of listener |
WO2009124772A1 (en) * | 2008-04-09 | 2009-10-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for generating filter characteristics |
-
2010
- 2010-03-09 EP EP10155873.2A patent/EP2373054B1/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE10125229A1 (en) | 2001-05-22 | 2002-11-28 | Thomson Brandt Gmbh | Audio system with virtual loudspeakers that are positioned using processor so that listener is at sweet spot |
WO2005019595A1 (en) | 2003-08-19 | 2005-03-03 | Crp Group Limited | Fairing for a riser |
DE102005052904A1 (en) | 2004-11-04 | 2006-06-29 | Schlenker, Berthold, Dipl.-Ing. | System for reproducing audio signals |
DE102005003431A1 (en) * | 2005-01-25 | 2006-08-03 | Institut für Rundfunktechnik GmbH | Binaural signal e.g. dummy head microphone signal, reproducing arrangement for e.g. theme park, has virtual transauralization source with constant position relative to ears, and filter unit filtering signal portions for all directions |
DE102007032272A1 (en) * | 2007-07-11 | 2009-01-22 | Institut für Rundfunktechnik GmbH | Method for simulation of headphone reproduction of audio signals, involves calculating dynamically data set on geometric relationships between speakers, focused sound sources and ears of listener |
WO2009124772A1 (en) * | 2008-04-09 | 2009-10-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for generating filter characteristics |
Non-Patent Citations (11)
Title |
---|
A.J. BERKHOUT; D. DE VRIES; P. VOGEL: "Acoustic control by wave field synthesis", JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, vol. 93, no. 5, May 1993 (1993-05-01), pages 2764 - 2778 |
E. VERHEIJEN: "Sound Reproduction by Wave Field Synthesis", DELFT UNIVERSITY OF TECHNOLOGY, 1997 |
J. AHRENS; S. SPORS: "Analytical driving functions for higher order Ambisonics", IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 30 March 2008 (2008-03-30) |
J. DANIEL, REPRESENTATI- ON DE CHAMPS ACOUSTIQUES, APPLICATION Ä LA TRANSMISSION ET Ä LA REPRODUCTION DE SCENES SONORES COMPLEXES DANS UN CONTEXTE MULTIMEDIA, 2001 |
J. HANNEMANN; K. D. DONOHUE: "Virtual Sound Source Rendering Using a Multipole-Expansion and Method-of-Moments Approach", J. AUDIO ENG. SOC., vol. 56, no. 6, June 2008 (2008-06-01) |
MENZE, D.; WITTEK, H.; FASTL, H.;THEILE, G.: "Binaurale Raumsynthese mittels Wellenfeldsynthese - Realisierung und Evaluierung", 23 March 2006 (2006-03-23), XP002596282, Retrieved from the Internet <URL:http://www.mmk.ei.tum.de/publ/pdf/06/06men1.pdf> [retrieved on 20100812] * |
MENZEL, D.; WITTEK, H.; THEILE, G.; FASTL, H.: "The Binaural Sky: A Virtual Headphone for Binaural Room Synthesis", 2 November 2005 (2005-11-02), XP002596281, Retrieved from the Internet <URL:http://www.tonmeister.de/symposium/2005/np_pdf/R04.pdf> [retrieved on 20100812] * |
S. SPORS: "Extension of an Analytic Secondary Source Selection Criterion for Wave Field Synthesis", CONVENTION DER AUDIO ENGINEERING SOCIETY (AES), October 2007 (2007-10-01) |
S. SPORS; H. WIERSTORF; N. GEIER; J. AHRENS: "Physical and Perceptual Properties of Focused Sources in Wave Field Synthesis", CONVENTION PAPER DER 127. CONVENTION DER AUDIO ENGINEERING SOCIETY, 9 October 2009 (2009-10-09) |
S. SPORS; R. RABENSTEIN; J. AHRENS: "The Theory of Wave Field Synthesis Revisited", PROCEEDINGS OF THE 124TH CONVENTION OF THE AUDIO ENGINEERING SOCIETY, 17 May 2008 (2008-05-17) |
THEILE G: "Neue Anwendung der Wellenfeldsynthese: Binaural Sky", FKT FERNSEH UND KINOTECHNIK, FACHVERLAG SCHIELE & SCHON GMBH., BERLIN, DE, vol. 61, no. 10, 1 October 2007 (2007-10-01), pages 539 - 542, XP001545649, ISSN: 1430-9947 * |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013167164A1 (en) * | 2012-05-07 | 2013-11-14 | Imm Sound S.A. | Method and apparatus for layout and format independent 3d audio reproduction |
CN104303522A (en) * | 2012-05-07 | 2015-01-21 | 杜比国际公司 | Method and apparatus for layout and format independent 3d audio reproduction |
US9378747B2 (en) | 2012-05-07 | 2016-06-28 | Dolby International Ab | Method and apparatus for layout and format independent 3D audio reproduction |
CN104303522B (en) * | 2012-05-07 | 2017-04-19 | 杜比国际公司 | Method and apparatus for layout and format independent 3d audio reproduction |
US9268522B2 (en) | 2012-06-27 | 2016-02-23 | Volkswagen Ag | Devices and methods for conveying audio information in vehicles |
US10070242B2 (en) | 2012-06-27 | 2018-09-04 | Volkswagen Ag | Devices and methods for conveying audio information in vehicles |
CN106664480A (en) * | 2014-04-07 | 2017-05-10 | 哈曼贝克自动系统股份有限公司 | Sound wave field generation |
CN106664480B (en) * | 2014-04-07 | 2021-06-15 | 哈曼贝克自动系统股份有限公司 | System and method for acoustic field generation |
CN106017837A (en) * | 2016-06-30 | 2016-10-12 | 北京空间飞行器总体设计部 | Simulation method of equivalent sound simulation source |
CN114422713A (en) * | 2022-03-29 | 2022-04-29 | 湖南航天捷诚电子装备有限责任公司 | Image acquisition and intelligent interpretation processing device and method |
CN114422713B (en) * | 2022-03-29 | 2022-06-24 | 湖南航天捷诚电子装备有限责任公司 | Image acquisition and intelligent interpretation processing device and method |
Also Published As
Publication number | Publication date |
---|---|
EP2373054B1 (en) | 2016-08-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2080411B1 (en) | Device and method for generating a number of loudspeaker signals for a loudspeaker array which defines a reproduction area | |
DE60304358T2 (en) | METHOD FOR PROCESSING AUDIO FILES AND DETECTION DEVICE FOR THE APPLICATION THEREOF | |
Spors et al. | Physical and perceptual properties of focused virtual sources in wave field synthesis | |
EP3044972B1 (en) | Device and method for the decorrelation of loudspeaker signals | |
JP2013510481A (en) | Apparatus and method for calculating speaker drive coefficient of speaker equipment for audio signal related to virtual sound source | |
EP2373054B1 (en) | Playback into a mobile target sound area using virtual loudspeakers | |
Ahrens et al. | Local sound field synthesis by virtual secondary sources | |
De Sena et al. | Analysis and design of multichannel systems for perceptual sound field reconstruction | |
DE102006010212A1 (en) | Apparatus and method for the simulation of WFS systems and compensation of sound-influencing WFS properties | |
DE102005003431B4 (en) | Arrangement for reproducing binaural signals (artificial head signals) by a plurality of loudspeakers | |
EP3677053B1 (en) | Loudspeaker system for surround sound with rejection of undesirable direct sound | |
DE102011082310A1 (en) | Apparatus, method and electroacoustic system for reverberation time extension | |
DE102021203632A1 (en) | Loudspeaker, signal processor, method for manufacturing the loudspeaker or method for operating the signal processor using dual-mode signal generation with two sound generators | |
DE102021203640A1 (en) | Device and method for generating a first control signal and a second control signal using linearization and/or bandwidth expansion | |
DE102015008000A1 (en) | Method for reproducing sound in reflection environments, in particular in listening rooms | |
Geng et al. | Movable virtual sound source construction based on wave field synthesis using a linear parametric loudspeaker array | |
DE102021205545A1 (en) | Device and method for generating a control signal for a sound generator or for generating an extended multi-channel audio signal using a similarity analysis | |
DE102011108788B4 (en) | Method for processing an audio signal, audio reproduction system and processing unit for processing audio signals | |
WO2007110087A1 (en) | Arrangement for the reproduction of binaural signals (artificial-head signals) by a plurality of loudspeakers | |
EP2503799A1 (en) | Method and system for calculating synthetic head related transfer functions by means of virtual local sound field synthesis | |
EP2571290B1 (en) | Local sound field synthesis with a virtual scattering body | |
DE102021200553B4 (en) | Device and method for controlling a sound generator with synthetic generation of the differential signal | |
DE102018108852B3 (en) | Method for influencing an auditory sense perception of a listener | |
DE3233990A1 (en) | METHOD FOR INFLUENCING THE EXPANSION AND LOCATION OF A PHANTOMIC SOUND SOURCE IN MULTI-CHANNEL SPEAKER PLAYBACK | |
WO2023052555A2 (en) | Loudspeaker system, control circuit for a loudspeaker system having one tweeter and two mid-range drivers or woofers, and corresponding method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA ME RS |
|
17P | Request for examination filed |
Effective date: 20120220 |
|
17Q | First examination report despatched |
Effective date: 20130422 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20160309 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: DEUTSCHE TELEKOM AG |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 822081 Country of ref document: AT Kind code of ref document: T Effective date: 20160915 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502010012198 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20160817 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161117 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161118 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161219 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 8 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502010012198 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161117 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20170518 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170309 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170331 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170309 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170331 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20170331 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 822081 Country of ref document: AT Kind code of ref document: T Effective date: 20170309 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170309 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20100309 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160817 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160817 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161217 |
|
PLAA | Information modified related to event that no opposition was filed |
Free format text: ORIGINAL CODE: 0009299DELT |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
R26N | No opposition filed (corrected) |
Effective date: 20170518 |
|
RIN2 | Information on inventor provided after grant (corrected) |
Inventor name: SPORS, SASCHA Inventor name: AHRENS, JENS |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20231213 Year of fee payment: 15 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20231212 Year of fee payment: 15 Ref country code: GB Payment date: 20240322 Year of fee payment: 15 |