EP2182744A1 - Retransmission d'un champ sonore dans une zone de sonorisation ciblée - Google Patents

Retransmission d'un champ sonore dans une zone de sonorisation ciblée Download PDF

Info

Publication number
EP2182744A1
EP2182744A1 EP08167919A EP08167919A EP2182744A1 EP 2182744 A1 EP2182744 A1 EP 2182744A1 EP 08167919 A EP08167919 A EP 08167919A EP 08167919 A EP08167919 A EP 08167919A EP 2182744 A1 EP2182744 A1 EP 2182744A1
Authority
EP
European Patent Office
Prior art keywords
sound field
drive signal
area
reproduced
sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP08167919A
Other languages
German (de)
English (en)
Other versions
EP2182744B1 (fr
Inventor
Jens Ahrens
Sascha Spors
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Technische Universitaet Berlin
Deutsche Telekom AG
Original Assignee
Technische Universitaet Berlin
Deutsche Telekom AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Technische Universitaet Berlin, Deutsche Telekom AG filed Critical Technische Universitaet Berlin
Priority to AT08167919T priority Critical patent/ATE524029T1/de
Priority to EP08167919A priority patent/EP2182744B1/fr
Publication of EP2182744A1 publication Critical patent/EP2182744A1/fr
Application granted granted Critical
Publication of EP2182744B1 publication Critical patent/EP2182744B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/13—Application of wave-field synthesis in stereophonic audio systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation

Definitions

  • the present invention relates to the reproduction or reconstruction of a sound field in a target sound area with the aid of a plurality of loudspeakers.
  • the technique of wave field synthesis can be used.
  • This technique uses a large number of loudspeakers and thereby avoids the problem that in an area within the loudspeaker arrangement, the so-called "sweet spot", the reconstruction of the desired sound field is significantly more accurate than in the rest of the listening area, as is the case, for example with the stereo.
  • Technique in stereo, however, a soundfield is not physically reconstructed, but two speakers create an illusion that sounds very similar to the natural model, but has very different physical properties.
  • stereo there is a sweet spot in that the illusion sounds most authentic at this point).
  • the speaker drive signals for each speaker are calculated analytically.
  • Ambisonics Another known technique for reconstruction of a sound field is called Ambisonics and is for example in the WO 2005/0195954 A2 described.
  • This technique requires circular or spherical arrangements of loudspeakers, where the loudspeaker signals are generated using numerical algorithms.
  • the limitation of the spatial bandwidth of the drive signals necessary in the calculation path causes the reconstruction of the desired sound field in the center of the loudspeaker arrangement to be most accurate. In the center of the loudspeaker arrangement is therefore a sweet spot. With increasing distance from the center of the loudspeaker arrangement, the deviations in the reconstructed sound field become larger.
  • the arrangement of the loudspeakers should be subject to as few restrictions as possible.
  • the present invention provides a method and a device for reproducing a sound field in a target sound area.
  • electroacoustic transducers ie loudspeakers
  • a drive signal for the electroacoustic transducer is determined analytically.
  • a resulting sound field which corresponds exactly in an area around the center of the contour, the sweet spot, the sound field to be reproduced.
  • the greater the distance from the center the greater the deviations from the sound field to be reproduced, which is inherent in the analytical determination.
  • the analytical determination can be achieved according to a known method by analytically solving an integral equation describing the sound field to be reproduced.
  • the components of the integral equation can be decomposed into orthogonal basis functions, for example by Fourier decomposition.
  • the desired sound field is thus decomposed into basic functions which are orthogonal on the contour on which the loudspeakers are located.
  • the desired sound field is then tape-bound with respect to the decomposition around the desired sweet spot.
  • the desired sound field is band-limited with respect to the decomposition around the center of the loudspeaker arrangement.
  • the connection between the two decompositions represents mathematical translation theorems.
  • the starting point is in any case an integral equation.
  • the loudspeaker drive signals can be obtained via the relationships of the Kirchhoff-Helmholtz integral (as in wave field synthesis).
  • the detected drive signal is changed so that the area where the resulting sound field corresponds to the sound field to be reproduced is shifted from the center of the contour to a desired position within the target sound area.
  • This can be done for example by means of mathematical translation theorems.
  • the desired position can be predetermined at a fixed position, but it can also be shifted depending on the position of a receiver. In the latter case, the change of the drive signal then preferably takes place in real time. For example, this method can then be used to determine a position of a receiver within the target sounding area and then to change the control signal in such a way that the desired position is adjusted accordingly.
  • the changed drive signal is supplied to the electroacoustic transducers.
  • the converters convert the input electrical signals into sound signals, and emit them into the target PA range.
  • the present invention also provides an apparatus for reproducing a sound field in a target sound area.
  • the device has a plurality of electroacoustic transducers arranged on a contour surrounding the target sound area, and a processing module.
  • the processing module is able to analytically determine from signals about the desired position and audio input signals a drive signal for the electroacoustic transducers and to change the drive signal such that the sweet spot, ie the area in which the resulting sound field corresponds to the sound field to be reproduced, is moved to the desired position.
  • the drive signals can be amplified by means of an amplifier unit and supplied to the electroacoustic transducers.
  • the area where the reconstruction of the desired sound field is most accurate can be shifted to a desired position.
  • the playback can be optimized to any location within the Zielbeschallungs Kunststoffs. This shift or translation can be performed in real time, so that the playback can be tracked, for example, to a moving receiver.
  • the determination of the location of the receiver can be carried out here by means of sensors, for example a camera.
  • the invention can be used to reproduce audio signals, in particular multi-channel audio signals.
  • the audio signals can be provided by a variety of devices, such as CD, DVD or Blu-ray Disc devices, MP3 devices, computers or the like.
  • the reproduced audio signals may be MPEG2 or MPEG4 signals, for example, or be in a Dolby format.
  • Fig. 1 schematically a device according to an embodiment of the present invention is shown.
  • On a contour 11 to a target PA range 10 more speakers 20 are arranged.
  • the drive signals for the speakers 20 are in a processing module 30 determined and supplied via an amplifier unit 31 to the speakers 20.
  • the processing module 30 is fed with information 1 about the current location for which the sound reconstruction is to be optimized, ie the so-called sweet spot or the sweet area, and audio input signals 2.
  • the sweet spot should be located within the target PA area 10.
  • the processing module 30 receives a third input signal 3 which carries information about the desired sound field (eg position of the virtual sound source).
  • the drive signal is first of all calculated analytically, for example according to the method described in the above-mentioned publication by J. Ahrens and S. Spors.
  • the integral here is a surface or line integral, depending on whether the calculation is to take place in three dimensions or only in one plane.
  • P ⁇ P ° G ° ⁇ B
  • the center of the decomposition is shifted in the loudspeaker drive signal D equation shown above. This can be done for example by means of various mathematical translation theorems.
  • the playback can be optimized to any location within the speaker assembly.
  • the inherent sweet spot may be constrained by limiting the spatial bandwidth of the sound field to be reproduced P , which is a function of the location and the frequency, are shifted with respect to the center of the decomposition different from the center of the speaker arrangement.
  • the sweet spot or the sweet area is then arranged around this new center of decomposition.
  • the decomposition of the sound field around any center x c with a restricted bandwidth 2M + 1 can be represented as follows:
  • r 'and ⁇ ' denote the location coordinates with respect to a local coordinate system whose origin is at x c
  • J ⁇ denotes the ⁇ -th order Bessel function
  • the decomposition coefficients are required with respect to the decomposition around the origin of the global coordinate system whose axes are parallel to those of the local coordinate system.
  • the addition theorem for harmonic cylinder functions can be used in the above equation:
  • Such a translation of the decomposition center can be carried out in real time, so that the reproduction can be tracked, for example, to a moving receiver.
  • a camera can be used to determine the position of the receiver and then optimize the playback to that position.
  • the determination of the position of the receiver can also be done by a sensor that the listener carries, for example, in his pocket with it.
  • Fig. 2 is shown the sound field generated by the speakers.
  • the loudspeakers are located on the circular contour indicated by dashed lines, which surrounds the target PA range.
  • Fig. 2a the sound field is shown to result from the analytical determination by the method described above.
  • the sweet spot shown by the marked point is at the center of the contour.
  • the present invention allows the sweet spot inherent in the system to track so that the sound field reproduction is optimal for the selected receiver.
  • the corresponding sound field is in Fig. 2b shown, the only shifted sweet spot in turn marked with a cross.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)
  • Circuit For Audible Band Transducer (AREA)
EP08167919A 2008-10-30 2008-10-30 Retransmission d'un champ sonore dans une zone de sonorisation ciblée Not-in-force EP2182744B1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AT08167919T ATE524029T1 (de) 2008-10-30 2008-10-30 Wiedergabe eines schallfeldes in einem zielbeschallungsbereich
EP08167919A EP2182744B1 (fr) 2008-10-30 2008-10-30 Retransmission d'un champ sonore dans une zone de sonorisation ciblée

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP08167919A EP2182744B1 (fr) 2008-10-30 2008-10-30 Retransmission d'un champ sonore dans une zone de sonorisation ciblée

Publications (2)

Publication Number Publication Date
EP2182744A1 true EP2182744A1 (fr) 2010-05-05
EP2182744B1 EP2182744B1 (fr) 2011-09-07

Family

ID=40202003

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08167919A Not-in-force EP2182744B1 (fr) 2008-10-30 2008-10-30 Retransmission d'un champ sonore dans une zone de sonorisation ciblée

Country Status (2)

Country Link
EP (1) EP2182744B1 (fr)
AT (1) ATE524029T1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2469892A1 (fr) * 2010-09-15 2012-06-27 Deutsche Telekom AG Reproduction d'un champ sonore dans une zone de sonorisation ciblée
EP2503799A1 (fr) 2011-03-21 2012-09-26 Deutsche Telekom AG Procédé et système de calcul de fonctions HRTF par synthèse locale virtuelle de champ sonore
EP2571290A1 (fr) 2011-09-15 2013-03-20 Deutsche Telekom AG Synthèse de champ sonore locale par l'intermédiaire d'un corps diffusant virtuel
US9268522B2 (en) 2012-06-27 2016-02-23 Volkswagen Ag Devices and methods for conveying audio information in vehicles
EP3209038A1 (fr) * 2016-02-19 2017-08-23 Thomson Licensing Procédé, support de stockage lisible par ordinateur et appareil pour determiner une scène sonore cible à une position cible de deux ou plusieurs scènes sonores source

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004073352A1 (fr) * 2003-02-12 2004-08-26 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Dispositif et procede pour determiner une position de reproduction
WO2005015954A2 (fr) 2003-07-30 2005-02-17 France Telecom Procede et dispositif de traitement de donnees sonores en contexte ambiophonique
DE102005003431A1 (de) * 2005-01-25 2006-08-03 Institut für Rundfunktechnik GmbH Anordnung zum Wiedergeben von binauralen Signalen (Kunstkopfsignalen) durch mehrere Lautsprecher

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004073352A1 (fr) * 2003-02-12 2004-08-26 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Dispositif et procede pour determiner une position de reproduction
WO2005015954A2 (fr) 2003-07-30 2005-02-17 France Telecom Procede et dispositif de traitement de donnees sonores en contexte ambiophonique
DE102005003431A1 (de) * 2005-01-25 2006-08-03 Institut für Rundfunktechnik GmbH Anordnung zum Wiedergeben von binauralen Signalen (Kunstkopfsignalen) durch mehrere Lautsprecher

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
GEIER, M. ET AL.: "The SoundScape Renderer: A Unified Spatial Audio Reproduction Framework for Arbitrary Rendering Methods", AUDIO ENGINEERING SOCIETY, CONVENTION PAPER, 20 May 2008 (2008-05-20), pages 1 - 6, XP002510679, Retrieved from the Internet <URL:http://www.aes.org/tmpFiles/elib/20090116/14460.pdf> [retrieved on 20090116] *
JENS AHRENS ET AL: "Analytical driving functions for higher order Ambisonics", ACOUSTICS, SPEECH AND SIGNAL PROCESSING, 2008. ICASSP 2008. IEEE INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 31 March 2008 (2008-03-31), pages 373 - 376, XP031250566, ISBN: 978-1-4244-1483-3 *
VON J. AHRENS; S. SPORS: "Analytical driving functions for higher order ambisonics", IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 30 March 2008 (2008-03-30)
VON J. HANNEMANN; K. D. DONOHUE: "Virtual Sound Source Rendering Using a Multipole-Expansion and Method-of-Moments Approach", J. AUDIO ENG. SOC., vol. 56, no. 6, June 2008 (2008-06-01), XP040508482
VON S. SPORS; R. RABENSTEIN; J. AHRENS: "The Theory of Wave Field Synthesis Revisited", PROCEEDINGS OF THE 124TH CONVENTION OF THE AUDIO ENGINEERING SOCIETY, 17 May 2008 (2008-05-17)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2469892A1 (fr) * 2010-09-15 2012-06-27 Deutsche Telekom AG Reproduction d'un champ sonore dans une zone de sonorisation ciblée
EP2503799A1 (fr) 2011-03-21 2012-09-26 Deutsche Telekom AG Procédé et système de calcul de fonctions HRTF par synthèse locale virtuelle de champ sonore
EP2571290A1 (fr) 2011-09-15 2013-03-20 Deutsche Telekom AG Synthèse de champ sonore locale par l'intermédiaire d'un corps diffusant virtuel
US9268522B2 (en) 2012-06-27 2016-02-23 Volkswagen Ag Devices and methods for conveying audio information in vehicles
US10070242B2 (en) 2012-06-27 2018-09-04 Volkswagen Ag Devices and methods for conveying audio information in vehicles
EP3209038A1 (fr) * 2016-02-19 2017-08-23 Thomson Licensing Procédé, support de stockage lisible par ordinateur et appareil pour determiner une scène sonore cible à une position cible de deux ou plusieurs scènes sonores source
EP3209036A1 (fr) * 2016-02-19 2017-08-23 Thomson Licensing Procédé, support de stockage lisible par ordinateur et appareil pour determiner une scène sonore cible à une position cible de deux ou plusieurs scènes sonores source
CN107197407A (zh) * 2016-02-19 2017-09-22 汤姆逊许可公司 用于确定处于目标位置的目标声音场景的方法及装置
US10623881B2 (en) 2016-02-19 2020-04-14 Interdigital Ce Patent Holdings Method, computer readable storage medium, and apparatus for determining a target sound scene at a target position from two or more source sound scenes
CN107197407B (zh) * 2016-02-19 2021-08-10 交互数字Ce专利控股公司 用于确定处于目标位置的目标声音场景的方法及装置

Also Published As

Publication number Publication date
EP2182744B1 (fr) 2011-09-07
ATE524029T1 (de) 2011-09-15

Similar Documents

Publication Publication Date Title
DE69726262T2 (de) Tonaufnahme- und -wiedergabesysteme
DE60304358T2 (de) Verfahren zur verarbeitung von audiodateien und erfassungsvorrichtung zur anwendung davon
Avendano et al. A frequency-domain approach to multichannel upmix
EP3005737B1 (fr) Pupitre de mixage, procédé et programme informatique de fourniture d&#39;un signal audio
EP2182744B1 (fr) Retransmission d&#39;un champ sonore dans une zone de sonorisation ciblée
DE69935974T2 (de) Verfahren und system zur behandlung von gerichtetem schall in einer akustisch-virtuellen umgegung
DE102012208825A1 (de) 3d-audiogerät
EP1972181B1 (fr) Dispositif et procédé de simulation de systèmes wfs et de compensation de propriétés wfs influençant le son
DE102012017296B4 (de) Erzeugung von Mehrkanalton aus Stereo-Audiosignalen
DE102019107302A1 (de) Verfahren zum Erzeugen und Wiedergeben einer binauralen Aufnahme
Lokki et al. Subjective evaluation of auralization of physics-based room acoustics modeling
WO2015036845A1 (fr) Système à synthèse de front d&#39;ondes
JP5000297B2 (ja) 音場の表現を求めるためのシステムおよび方法
Romigh et al. Do you hear where I hear?: Isolating the individualized sound localization cues
WO2015193196A1 (fr) Dispositif et procédé de génération et de lecture d&#39;une représentation audio de synthèse de champs d&#39;ondes protégée contre la copie
EP2425270B1 (fr) Dispositif et procédé de restitution binaurale de signaux sonar audio
DE112021003592T5 (de) Informationsverarbeitungsvorrichtung, Ausgabesteuerverfahren und Programm
DE112019006727T5 (de) Audiosystem, audiowiedergabeeinrichtung, servereinrichtung, audiowiedergabeverfahren und audiowiedergabeprogramm
WO1991001616A2 (fr) Systeme pour la localisation en avant de phases auditives generees par un casque stereo
EP3375208B1 (fr) Procédé et appareil de génération, à partir d&#39;un signal d&#39;entrée audio 2d multicanal, d&#39;un signal de représentation du son en 3d
DE102018102743A1 (de) Real Sound Transmission
EP2469892A1 (fr) Reproduction d&#39;un champ sonore dans une zone de sonorisation ciblée
DE102011108788B4 (de) Verfahren zur Verarbeitung eines Audiosignals, Audiowiedergabesystem und Verarbeitungseinheit zur Bearbeitung von Audiosignalen
Lim et al. An approach to immersive audio rendering with wave field synthesis for 3D multimedia content
EP2503799B1 (fr) Procédé et système de calcul de fonctions HRTF par synthèse locale virtuelle de champ sonore

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20091209

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

17Q First examination report despatched

Effective date: 20100823

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502008004764

Country of ref document: DE

Effective date: 20111124

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20110907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20111207

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

LTIE Lt: invalidation of european patent or patent extension

Effective date: 20110907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20111208

REG Reference to a national code

Ref country code: IE

Ref legal event code: FD4D

BERE Be: lapsed

Owner name: DEUTSCHE TELEKOM A.G.

Effective date: 20111031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120107

Ref country code: IE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120109

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111031

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111031

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

26N No opposition filed

Effective date: 20120611

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502008004764

Country of ref document: DE

Effective date: 20120611

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20111218

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111030

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20111207

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121031

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121031

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110907

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 524029

Country of ref document: AT

Kind code of ref document: T

Effective date: 20131030

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20131030

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

PLAA Information modified related to event that no opposition was filed

Free format text: ORIGINAL CODE: 0009299DELT

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

R26N No opposition filed (corrected)

Effective date: 20120611

RIN2 Information on inventor provided after grant (corrected)

Inventor name: AHRENS, JENS

Inventor name: SPORS, SASCHA

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20211022

Year of fee payment: 14

Ref country code: DE

Payment date: 20211020

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20211021

Year of fee payment: 14

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502008004764

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20221030

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221031

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230503

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221030