EP2304721B1 - Raumsynthese mehrkanaliger tonsignale - Google Patents

Raumsynthese mehrkanaliger tonsignale Download PDF

Info

Publication number
EP2304721B1
EP2304721B1 EP09794018A EP09794018A EP2304721B1 EP 2304721 B1 EP2304721 B1 EP 2304721B1 EP 09794018 A EP09794018 A EP 09794018A EP 09794018 A EP09794018 A EP 09794018A EP 2304721 B1 EP2304721 B1 EP 2304721B1
Authority
EP
European Patent Office
Prior art keywords
signal
synthesis
coefficients
decorrelated
spatialization
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP09794018A
Other languages
English (en)
French (fr)
Other versions
EP2304721A1 (de
Inventor
Florent Jaillet
David Virette
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Orange SA
Original Assignee
France Telecom SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by France Telecom SA filed Critical France Telecom SA
Publication of EP2304721A1 publication Critical patent/EP2304721A1/de
Application granted granted Critical
Publication of EP2304721B1 publication Critical patent/EP2304721B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic
    • H04S3/008Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic
    • H04S3/02Systems employing more than two channels, e.g. quadraphonic of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2420/00Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/03Application of parametric coding in stereophonic audio systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Mathematical Physics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Human Computer Interaction (AREA)
  • Algebra (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Stereophonic System (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Claims (9)

  1. Verfahren zur räumlichen Synthese eines Summensignals, um mindestens zwei digitale Ausgangs-Audiosignale zu erhalten, wobei das Summensignal sowie Verräumlichungsparameter aus einer parametrischen Codierung durch Matrizierung eines ursprünglichen digitalen Mehrkanal-Audiosignals stammen, wobei das Verfahren die folgenden Schritte aufweist:
    - Dekorrelierung (Decorr.) des Summensignals (s), um ein dekorreliertes Signal (d) zu erhalten;
    - Anwendung (Synth.) einer Synthesematrix (M Minq), deren Koeffizienten von den Verräumlichungsparametern (R, I) abhängen, an das dekorrelierte Signal und an das Summensignal, um die Ausgangssignale zu erhalten,
    dadurch gekennzeichnet, dass für mindestens einen Wertebereich mindestens eines Verräumlichungsparameters die Koeffizienten der Synthesematrix gemäß einem Minimierungskriterium einer quantitativen Funktion (q) bestimmt werden, die sich auf die dekorrelierte Signalmenge in jedem der durch den Anwendungsschritt der Synthesematrix erhaltenen Ausgangssignale bezieht, wobei die quantitative Funktion so ist, dass die Erhöhung des Absolutwerts der an das dekorrelierte Signal angewendeten Koeffizienten der Synthesematrix den Wert der an diese gleichen Koeffizienten angewendeten Funktion erhöht.
  2. Verfahren nach Anspruch 1, dadurch gekennzeichnet, dass die quantitative Funktion eine Energiefunktion des dekorrelierten Signals ist.
  3. Verfahren nach Anspruch 1, dadurch gekennzeichnet, dass die quantitative Funktion von der Art ist:
    q x y = x p + y p 1 p
    Figure imgb0031
    mit p einer ganzen Zahl größer als oder gleich 1.
  4. Verfahren nach Anspruch 1, dadurch gekennzeichnet, dass die Verräumlichungsparameter ein Parameter (R) des Energieverhältnisses zwischen den Kanälen des Mehrkanalsignals und ein Parameter (I) der Interkanal-Korrelation des Mehrkanalsignals sind, wobei ein Werterbereich der Bereich ist, in dem der Interkanal-Korrelationsparameter negativ ist.
  5. Verfahren nach Anspruch 1, dadurch gekennzeichnet, dass eine andere quantitative Funktion pro Wertebereich der Verräumlichungsparameter gewählt wird.
  6. Vorrichtung zum räumlichen Synthese eines Summensignals, die mindestens zwei digitale Ausgangs-Audiosignale erzeugt, wobei das Summensignal sowie Verräumlichungsparameter von einer parametrischen Codiervorrichtung stammen, die eine Matrizierung eines ursprünglichen digitalen Mehrkanal-Audiosignals durchführt, wobei die Vorrichtung aufweist:
    - Dekorreliereinrichtungen (510) des Summensignals, um ein dekorreliertes Signal zu erhalten;
    - Einrichtungen (520) zur Anwendung einer Synthesematrix (M Minq), deren Koeffizienten von den Verräumlichungsparametern abhängen, an das dekorrelierte Signal und an das Summensignal, um die Ausgangssignale zu erhalten,
    dadurch gekennzeichnet, dass für mindestens einen Wertebereich mindestens eines Verräumlichungsparameters die Koeffizienten der Synthesematrix gemäß einem Minimierungskriterium einer quantitativen Funktion bestimmt werden, die sich auf die dekorrelierte Signalmenge in jedem der Ausgangssignale bezieht, die durch die Anwendungseinrichtungen der Synthesematrix erhalten werden, wobei die quantitative Funktion so ist, dass die Erhöhung des Absolutwerts der an das dekorrelierte Signal angewendeten Koeffizienten der Synthesematrix den Wert der an diese gleichen Koeffizienten angewendeten Funktion erhöht.
  7. Decodierer eines digitalen Audiosignals, der mindestens eine Synthesevorrichtung nach Anspruch 6 aufweist.
  8. Multimediaausrüstung, die einen Decodierer nach Anspruch 7 aufweist.
  9. EDV-Programm, das Codeanweisungen für die Durchführung der Schritte des Verfahrens nach einem der Ansprüche 1 bis 5 aufweist, wenn diese Anweisungen von einem Prozessor ausgeführt werden.
EP09794018A 2008-06-26 2009-06-16 Raumsynthese mehrkanaliger tonsignale Active EP2304721B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR0854282 2008-06-26
PCT/FR2009/051146 WO2010004155A1 (fr) 2008-06-26 2009-06-16 Synthese spatiale de signaux audio multicanaux

Publications (2)

Publication Number Publication Date
EP2304721A1 EP2304721A1 (de) 2011-04-06
EP2304721B1 true EP2304721B1 (de) 2012-05-09

Family

ID=40328191

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09794018A Active EP2304721B1 (de) 2008-06-26 2009-06-16 Raumsynthese mehrkanaliger tonsignale

Country Status (7)

Country Link
US (1) US8583424B2 (de)
EP (1) EP2304721B1 (de)
JP (1) JP5366104B2 (de)
CN (1) CN102077276B (de)
AT (1) ATE557386T1 (de)
ES (1) ES2387867T3 (de)
WO (1) WO2010004155A1 (de)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2362375A1 (de) * 2010-02-26 2011-08-31 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Gerät und Verfahren zur Änderung eines Audiosignals durch Hüllkurvenenformung
EP2369861B1 (de) * 2010-03-25 2016-07-27 Nxp B.V. Verarbeitung eines Mehrkanal-Audiosignals
KR101756838B1 (ko) * 2010-10-13 2017-07-11 삼성전자주식회사 다채널 오디오 신호를 다운 믹스하는 방법 및 장치
KR101842257B1 (ko) * 2011-09-14 2018-05-15 삼성전자주식회사 신호 처리 방법, 그에 따른 엔코딩 장치, 및 그에 따른 디코딩 장치
CN110223701B (zh) * 2012-08-03 2024-04-09 弗劳恩霍夫应用研究促进协会 用于从缩混信号产生音频输出信号的解码器和方法
EP2717263B1 (de) 2012-10-05 2016-11-02 Nokia Technologies Oy Verfahren, Vorrichtung und Computerprogrammprodukt zur kategorischen räumlichen Analyse-Synthese des Spektrums eines Mehrkanal-Audiosignals
EP2830333A1 (de) 2013-07-22 2015-01-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Mehrkanaliger Dekorrelator, mehrkanaliger Audiodecodierer, mehrkanaliger Audiocodierer, Verfahren und Computerprogramm mit Vormischung von Dekorrelatoreingangssignalen
PL3022949T3 (pl) * 2013-07-22 2018-04-30 Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. Wielokanałowy dekoder audio, wielokanałowy koder audio, sposoby, program komputerowy i zakodowana reprezentacja audio z użyciem dekorelacji renderowanych sygnałów audio
TWI634547B (zh) 2013-09-12 2018-09-01 瑞典商杜比國際公司 在包含至少四音訊聲道的多聲道音訊系統中之解碼方法、解碼裝置、編碼方法以及編碼裝置以及包含電腦可讀取的媒體之電腦程式產品
KR20160081844A (ko) * 2014-12-31 2016-07-08 한국전자통신연구원 다채널 오디오 신호의 인코딩 방법 및 상기 인코딩 방법을 수행하는 인코딩 장치, 그리고, 다채널 오디오 신호의 디코딩 방법 및 상기 디코딩 방법을 수행하는 디코딩 장치
WO2016108655A1 (ko) 2014-12-31 2016-07-07 한국전자통신연구원 다채널 오디오 신호의 인코딩 방법 및 상기 인코딩 방법을 수행하는 인코딩 장치, 그리고, 다채널 오디오 신호의 디코딩 방법 및 상기 디코딩 방법을 수행하는 디코딩 장치
FR3048808A1 (fr) * 2016-03-10 2017-09-15 Orange Codage et decodage optimise d'informations de spatialisation pour le codage et le decodage parametrique d'un signal audio multicanal
CN111407268B (zh) * 2020-03-27 2021-05-14 华南理工大学 一种基于相关函数的多通道脑电信号压缩方法

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5956674A (en) * 1995-12-01 1999-09-21 Digital Theater Systems, Inc. Multi-channel predictive subband audio coder using psychoacoustic adaptive bit allocation in frequency, time and over the multiple channels
US5835375A (en) * 1996-01-02 1998-11-10 Ati Technologies Inc. Integrated MPEG audio decoder and signal processor
DE19632734A1 (de) * 1996-08-14 1998-02-19 Thomson Brandt Gmbh Verfahren und Vorrichtung zum Generieren eines Mehrton-Signals aus einem Mono-Signal
US6199039B1 (en) * 1998-08-03 2001-03-06 National Science Council Synthesis subband filter in MPEG-II audio decoding
US7006636B2 (en) * 2002-05-24 2006-02-28 Agere Systems Inc. Coherence-based audio coding and synthesis
ATE354161T1 (de) 2002-04-22 2007-03-15 Koninkl Philips Electronics Nv Signalsynthese
PL373120A1 (en) * 2002-08-07 2005-08-08 Dolby Laboratories Licensing Corporation Audio channel spatial translation
KR100923297B1 (ko) * 2002-12-14 2009-10-23 삼성전자주식회사 스테레오 오디오 부호화 방법, 그 장치, 복호화 방법 및그 장치

Also Published As

Publication number Publication date
ES2387867T3 (es) 2012-10-03
JP2011525999A (ja) 2011-09-29
CN102077276B (zh) 2014-04-09
ATE557386T1 (de) 2012-05-15
JP5366104B2 (ja) 2013-12-11
CN102077276A (zh) 2011-05-25
WO2010004155A1 (fr) 2010-01-14
US8583424B2 (en) 2013-11-12
EP2304721A1 (de) 2011-04-06
US20110106543A1 (en) 2011-05-05

Similar Documents

Publication Publication Date Title
EP2304721B1 (de) Raumsynthese mehrkanaliger tonsignale
EP2374123B1 (de) Verbesserte codierung von mehrkanaligen digitalen audiosignalen
EP2374124B1 (de) Verwaltete codierung von mehrkanaligen digitalen audiosignalen
EP2005420B1 (de) Einrichtung und verfahren zur codierung durch hauptkomponentenanalyse eines mehrkanaligen audiosignals
EP1794748B1 (de) Datenverarbeitungsverfahren durch Übergang zwischen verschiedenen Subband-domänen
EP1600042B1 (de) Verfahren zum bearbeiten komprimierter audiodaten zur räumlichen wiedergabe
EP2539892B1 (de) Mehrkanal-audiostromkomprimierung
EP2042001B1 (de) Binaurale spatialisierung kompressionsverschlüsselter tondaten
FR2898725A1 (fr) Dispositif et procede de codage gradue d'un signal audio multi-canal selon une analyse en composante principale
EP3427260B1 (de) Optimierte codierung und decodierung von verräumlichungsinformationen zur parametrischen codierung und decodierung eines mehrkanaligen audiosignals
EP2489039B1 (de) Optimierte parametrische codierung/decodierung mit niedrigem durchsatz
FR2966634A1 (fr) Codage/decodage parametrique stereo ameliore pour les canaux en opposition de phase
EP2168121B1 (de) Quantifizierung nach linearer umwandlung durch kombination von audiosignalen einer klangszene und kodiergerät dafür
EP2319037B1 (de) Rekonstruktion von mehrkanal-audiodaten
WO2007101958A2 (fr) Optimisation d'une spatialisation sonore binaurale a partir d'un encodage multicanal
EP3391370A1 (de) Adaptive kanalreduktionsverarbeitung zur codierung eines mehrkanalaudiosignals
EP2126905B1 (de) Verfahren und Vorrichtung zur Kodierung und Dekodierung von Audiosignalen, kodiertes Audiosignal
WO2011073600A1 (fr) Codage/decodage parametrique stereo avec optimisation du traitement de reduction des canaux
EP4042418B1 (de) Bestimmung von korrekturen zur anwendung auf ein mehrkanalaudiosignal, zugehörige codierung und decodierung
EP1362344A1 (de) Verfahren und vorrichtung zur rekonstruktion des spektrums von mehrkanaligen signalen
EP2489040A1 (de) Optimierte parametrische stereodecodierung
WO2023232823A1 (fr) Titre: codage audio spatialisé avec adaptation d'un traitement de décorrélation
WO2009081002A1 (fr) Traitement d'un flux audio 3d en fonction d'un niveau de presence de composantes spatiales

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110125

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA RS

17Q First examination report despatched

Effective date: 20110622

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 557386

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120515

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602009006883

Country of ref document: DE

Effective date: 20120705

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20120509

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2387867

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20121003

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

Effective date: 20120509

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120909

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120809

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 557386

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120509

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120910

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120810

BERE Be: lapsed

Owner name: FRANCE TELECOM

Effective date: 20120630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120630

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

26N No opposition filed

Effective date: 20130212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120630

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120616

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602009006883

Country of ref document: DE

Effective date: 20130212

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120809

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130630

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20130630

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20120509

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120616

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20090616

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20230523

Year of fee payment: 15

Ref country code: FR

Payment date: 20230524

Year of fee payment: 15

Ref country code: DE

Payment date: 20230523

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230523

Year of fee payment: 15

Ref country code: ES

Payment date: 20230703

Year of fee payment: 15