EP2517485A1 - Verfahren zur erzeugung von linken und rechten raumklangsignalen auf der basis eines stereotonsignals - Google Patents

Verfahren zur erzeugung von linken und rechten raumklangsignalen auf der basis eines stereotonsignals

Info

Publication number
EP2517485A1
EP2517485A1 EP10807709A EP10807709A EP2517485A1 EP 2517485 A1 EP2517485 A1 EP 2517485A1 EP 10807709 A EP10807709 A EP 10807709A EP 10807709 A EP10807709 A EP 10807709A EP 2517485 A1 EP2517485 A1 EP 2517485A1
Authority
EP
European Patent Office
Prior art keywords
block
signal
gain
signals
surround
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP10807709A
Other languages
English (en)
French (fr)
Other versions
EP2517485B1 (de
Inventor
Frédéric AMADU
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Arkamys SA
Original Assignee
Arkamys SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Arkamys SA filed Critical Arkamys SA
Publication of EP2517485A1 publication Critical patent/EP2517485A1/de
Application granted granted Critical
Publication of EP2517485B1 publication Critical patent/EP2517485B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 
    • H04S5/02—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation  of the pseudo four-channel type, e.g. in which rear channel signals are derived from two-channel stereo signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control

Definitions

  • the invention relates to a method for generating left and right "surround" sound signals from a stereo sound signal intended to be broadcast by a 5.1 type sound system.
  • the invention aims in particular to provide a method of processing the surround sound providing a good sound reproduction while consuming few resources.
  • the invention finds a particularly advantageous application in the field of sound processing for home theater, stereos, computers, mobile phones or any other device having a sound diffusion system with limited computing capabilities or not for the treatment of sound.
  • a 5.1 broadcasting system is an acoustic system comprising two front (left and right) lanes, two rear lanes (left and right), one Low Frequency Effect lane and one central lane.
  • the sound broadcast by this kind of system is a so-called "surround" sound that provides a feeling of envelopment to the listener.
  • the left and right signals forming a stereo signal are each composed of 3 distinct components:
  • the purpose of the invention is to create these surround components in order to reproduce a good quality surround sound effect while limiting the calculation time during the extraction of these components.
  • the stereo signals of its left and right are subtracted from each other, so as to eliminate the correlated common component and in phase of the signals. stereo. Then, the signal resulting from this subtraction step is decorrelated by means of a decorrelation module, so as to obtain the left and right "surround" components of the stereo signal ready to be broadcast, if necessary after parametric equalization. on the rear tracks of a 5.1-type system.
  • the invention therefore relates to a method for generating left and right sound signals called “surround” signals from a stereo sound signal composed of a signal of its left and a signal of its right, characterized in that it comprises the following steps:
  • the "surround" signals are intended to be broadcast on the rear channels of a 5.1 type sound system.
  • the input subtraction signal of a first and of a second elementary block is applied, the output signal of these blocks corresponding respectively to the signal of its right and to the signal of its left surround, the output signal of each block is the combination of the input signal of the block weighted by a first gain, and the combination of the output signal of the weighted block by a second gain and input signals of the delayed block by a delay line.
  • s-i being the output signal of the first block corresponding to one of the surround sound signals (right or left),
  • gi, g 2 being respectively the values of the first gain and the second gain of the first block
  • D-i being the value of the number of delay samples introduced by the delay line
  • s 2 (n) e 2 (n) .g 3 + s 2 (n-D 2 ) .g 4 + e 2 (n-D 2 ),
  • s 2 being the output signal of the second block corresponding to the other surround sound signal (right if s corresponds to the left or left if Si corresponds to the right),
  • g 3 , g 4 being respectively the values of the first gain and the second gain of the second block
  • D2 being the value of the number of delay samples introduced by the delay line.
  • the gain values within a block are opposite to each other, the value of the first gain being opposite to the value of the second gain.
  • the gain values of the first block are opposite with respect to the gain values of the second block, the value of the first gain of the first block being opposite to the value of the first gain of the first block. second block; while the value of the second gain of the first block is opposite to the value of the second gain of the second block.
  • the gain values of the first and second elementary blocks have the same absolute value.
  • the first gain of the first block and the second gain of the second block are g; while the second gain of the first block and the first gain of the second block are worth -g.
  • the delay introduced by the line of the first block and the delay by the line of the second block are equal.
  • the subtraction signal is first filtered using a high frequency filter and only the filtered high frequency part is applied to the input of the elementary blocks.
  • the low frequency part of the left and right signals of the stereo signal is filtered
  • the low frequency parts thus filtered are delayed by a delay with the aid of third delay lines, and
  • the low frequency part thus delayed is summed with the output signals of the elementary blocks to obtain the signal of its surround right and the signal of its left surround.
  • the phase and the gain of the output signals of each elementary block are modified as a function of frequency by means of parametric filtering cells for modifying the sound perception of the left and right surround sound signals.
  • the invention furthermore relates to a method of generating surround signals intended to be broadcast by an acoustic system composed of front / rear loudspeakers from a stereo sound signal composed of a signal of its left and a signal of its right, characterized in that it presents the following step: the "surround" sound signals are generated using the method according to one of the preceding claims and are applied to the rear channels of the acoustic system.
  • Figure 1 a schematic representation of a device according to the invention for extracting the "surround" components of a stereo sound signal in a basic version
  • Figure 2 a graphical representation of a device according to the invention for extracting the "surround" components of a stereo sound signal in an improved version
  • Figure 3 a schematic representation of a device according to the invention for generating, from a stereo sound signal, sound signals diffusable by a type 5.1 acoustic system.
  • Figure 1 shows a device 10 according to the invention for generating a left sound signal Ls and a signal of its right Rs called "surround" signals from a stereo sound signal formed by a signal of his left L and a signal from his right R.
  • the component C is common to the two signals L and R since it corresponds to the correlated and phase components of the signals L and R -
  • the component S corresponds to the correlated component and out of phase of the signals L and R.
  • the object of the invention is to isolate the component S and to create two decorrelated components in order to be able to broadcast them on channels distinct from those in which the stereo signals L and R are broadcast in order to provide a wrap-around effect. auditor (see Figure 3).
  • the signals of its left L and right R are applied at the input of a subtractor 11 in order to suppress the component C of the left and right signals R and retain only the components L 0 , R 0 and the S component of the stereo signals L and R.
  • the signal is subtracted from its right R to the left-hand signal L (LR), but it would be possible to perform the inverse operation (RL).
  • the subtraction signal LR obtained at the output of the subtractor 1 1 is then applied at the input of a signal decorrelation module 12 which makes it possible to create, from the subtraction signal LR, two decorrelated signals relative to one another. to the other: the signal from its left “surround” Ls and the signal from its right “surround” R s .
  • the decorrelation module 12 is formed of two input 13.1-13.2 blocks from which the LR subtraction signal is applied, the output s1, s2 of these blocks 13.1, 13.2 respectively corresponding to the signal of its right. surround R s and the left surround signal L s .
  • the output signal if (resp., S 2 ) of each block 13.1 is a function of the input signal ei (or e 2 ) of the weighted block by a first gain gi (resp, g3), and of the combination of the input signals e1 (respectively e2) and output if (respectively 2 ) of the weighted block by a second gain g 2 (respectively g), delayed by a delay line 14.1 (respectively 14.2) .
  • the input signal e- ⁇ , e 2 is applied at the input of a first adder 16.1, 16.2 and applied to an input of a second adder 17.1, 17.2 after being multiplied by the first gain gi, g 3 .
  • the output signal if, s 2 of the block is applied to another input of the first summer 16.1, 16.2 after having been multiplied by the second gain g 2 , g 4 , the output signal of the first summer 16.1, 16.2 being applied as input the delay line 14.1, 14.2.
  • the output signal of the delay line 14.1, 14.2 is applied to another input of the second adder 17.1, 17.2, the output signal of this second adder 17.1, 17.2 corresponding to the output signal if, s 2 of the block and therefore to the signal of its right Rs or left l_s surround.
  • s 1 (n) e 1 (n) .g + s 1 (n-D1) .g 2 + e (n-D1)
  • gi, g 2 being respectively the values of the first gain and the second gain of the first block 13.
  • D1 being the value of the number of delay samples introduced by the delay line 14.1.
  • g 3 , g 4 being respectively the values of the first gain and the second gain of the second block 13.2
  • D2 being the value of the number of delay samples introduced by the delay line 14.2.
  • the first gain gi (respectively g 3 ) and the second gain g 2 (respectively g 4 ) have opposite values. one compared to the other.
  • Each block 13.1, 13.2 then behaves as an all-pass type filter which does not change the gain of the input signal ei, e 2 but only its phase.
  • the gains g- ⁇ , g 2 of the first block 13.1 and the gains g 3 , g 4 of the second block 13.2 preferably have opposite values from each other.
  • the value of the first gain gi of the first block 13.1 is opposite to the value of the first gain g 3 of the second block 3.2; while the value of the second gain g 2 of the first block 13.1 is opposite to the value of the second gain g 4 of the second block 13.2.
  • the first gain gi of the first block 13.1 and the second gain g 4 of the second block 13.2 have a value g; while the second gain g 2 of the first block 3.1 and the first g 3 gain of the second block 13.2 has a value -g.
  • the delays D1, D2 introduced by the delay line 14.1 of the first elementary block 13.1 and the delay line 14.2 of the second elementary block 13.2 are equal. However, it would be possible to choose delays D1, D2 having different durations.
  • g 0.4 and a delay of D1 and D2 of 176 samples with a sampling frequency of 44.1 kHz, such values making it possible to obtain a good sound reproduction.
  • a stage 19 composed of two filters 20.1, 20.2 for isolating the low frequency part respectively L and R signals and a filter 21 for isolating the high frequency portion of the LR subtraction signal.
  • the cut-off frequencies of the low-frequency filters 20.1, 20.2 and the high-frequency filter 21 are of the order of 350 Hz.
  • the low frequency parts of the left and right signals are applied as third delay line inputs 23.1, 23.2 and the low frequency parts thus delayed are summed, if necessary after weighting by gains g 7 , g 8 respectively with the output signals si, s 2 of the elementary blocks, so as to obtain signals of its right Rs and left L s surround having improved sound reproduction.
  • the delay D3 applied by the third delay lines 23.1, 23.2 is 176 samples with a sampling frequency of 44.1 kHz
  • parametric equalizing cells 25.1, 25.2 are connected at the output of each elementary block 13.1, 13.2 before summation with the delayed low frequency part. These cells 25.1, 25.2 have the effect of modifying the perception of the output signals if, s 2 of these blocks 13.1, 13.2, because even if the signals si, s 2 have substantially identical levels, there are differences in their perception of because of the decorrelation they have with respect to each other. As a result, it may be useful to modify these signals perceptively so that the overall auditory impression is the best possible.
  • the equalizing cells 25.1, 25.2 each comprise a filter 26.1, 26.2 whose type, the gain and the phase can be adjusted according to different frequency bands of the signals si, s 2 and a gain g 5 , g6 which acts on the entire spectrum of signals if, s 2 .
  • These parameters are adapted by sound engineers in particular according to the intended application.
  • FIG. 3 shows a use of the invention in the context of a 4-way (2-way front and 2-way rear-seat) or 5-way (with an additional central channel) sound broadcasting system. get an excellent sound reproduction while limiting the computing power of sound processing.
  • the left stereo signals L and R right are applied to the input of the module 10 of Figures 1 or 2 so as to extract the signals "surround" left Ls and right R s which are distributed on the rear tracks 29.1, 19.2; while the initial left L and right S stereo signals are directly broadcast on the front channels 30.1, 30.2, where appropriate after parametric equalization performed using the modules 31.1, 31.2 (similar to the modules 25.1, 25.2 of the Figure). 2).
  • the common component C to the L and R signals is also extracted using a module 33 (an implementation example of such a module is given in the document FR-2886503) in order to be broadcast on the central channel 34.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Stereophonic System (AREA)
EP10807709.0A 2009-12-23 2010-12-21 Verfahren zur erzeugung von linken und rechten raumklangsignalen auf der basis eines stereotonsignals Active EP2517485B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR0959554A FR2954654B1 (fr) 2009-12-23 2009-12-23 Procede de generation de signaux de son surround gauche et droit a partir d'un signal de son stereo
PCT/FR2010/052864 WO2011077040A1 (fr) 2009-12-23 2010-12-21 Procede de generation de signaux de son surround gauche et droit a partir d'un signal de son stereo

Publications (2)

Publication Number Publication Date
EP2517485A1 true EP2517485A1 (de) 2012-10-31
EP2517485B1 EP2517485B1 (de) 2014-10-15

Family

ID=42313478

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10807709.0A Active EP2517485B1 (de) 2009-12-23 2010-12-21 Verfahren zur erzeugung von linken und rechten raumklangsignalen auf der basis eines stereotonsignals

Country Status (5)

Country Link
US (1) US9204237B2 (de)
EP (1) EP2517485B1 (de)
KR (1) KR101753929B1 (de)
FR (1) FR2954654B1 (de)
WO (1) WO2011077040A1 (de)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118511545A (zh) 2021-12-20 2024-08-16 狄拉克研究公司 用于上混/重混/下混应用的多声道音频处理

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL7714502A (nl) * 1977-12-29 1979-07-03 Philips Nv Kunstmatige nagalminrichting voor audiofrequen- te trillingen.
NL7903195A (nl) * 1979-04-24 1980-10-28 Philips Nv Inrichting voor kunstmatige nagalm.
JPS62258599A (ja) * 1986-04-28 1987-11-11 Fujitsu Ten Ltd 車載用サラウンド装置
JP2512038B2 (ja) * 1987-12-01 1996-07-03 松下電器産業株式会社 音場再生装置
JP2580774B2 (ja) * 1989-05-15 1997-02-12 ヤマハ株式会社 楽音合成装置
GB9211756D0 (en) * 1992-06-03 1992-07-15 Gerzon Michael A Stereophonic directional dispersion method
JP2871387B2 (ja) * 1992-07-27 1999-03-17 ヤマハ株式会社 音像定位装置
JP2727883B2 (ja) * 1992-08-20 1998-03-18 ヤマハ株式会社 楽音合成装置
US5641931A (en) * 1994-03-31 1997-06-24 Yamaha Corporation Digital sound synthesizing device using a closed wave guide network with interpolation
US5708718A (en) * 1996-02-22 1998-01-13 Sounds' So Real Accessories, Inc. Surround sound processor system
US5970153A (en) * 1997-05-16 1999-10-19 Harman Motive, Inc. Stereo spatial enhancement system
JP3792845B2 (ja) 1997-07-24 2006-07-05 キヤノン株式会社 光学装置
US6175631B1 (en) * 1999-07-09 2001-01-16 Stephen A. Davis Method and apparatus for decorrelating audio signals
US7149314B2 (en) * 2000-12-04 2006-12-12 Creative Technology Ltd Reverberation processor based on absorbent all-pass filters
US6996239B2 (en) * 2001-05-03 2006-02-07 Harman International Industries, Inc. System for transitioning from stereo to simulated surround sound
JP4414905B2 (ja) * 2005-02-03 2010-02-17 アルパイン株式会社 オーディオ装置
FR2886503B1 (fr) 2005-05-27 2007-08-24 Arkamys Sa Procede pour produire plus de deux signaux electriques temporels distincts a partir d'un premier et d'un deuxieme signal electrique temporel
JP4946148B2 (ja) * 2006-04-19 2012-06-06 ソニー株式会社 音声信号処理装置、音声信号処理方法及び音声信号処理プログラム
JP4841324B2 (ja) * 2006-06-14 2011-12-21 アルパイン株式会社 サラウンド生成装置
US20100303245A1 (en) * 2009-05-29 2010-12-02 Stmicroelectronics, Inc. Diffusing acoustical crosstalk
JP5481943B2 (ja) 2009-06-01 2014-04-23 日本テキサス・インスツルメンツ株式会社 微粒子感知装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2011077040A1 *

Also Published As

Publication number Publication date
KR101753929B1 (ko) 2017-07-04
FR2954654B1 (fr) 2012-10-12
WO2011077040A1 (fr) 2011-06-30
EP2517485B1 (de) 2014-10-15
KR20120120257A (ko) 2012-11-01
US9204237B2 (en) 2015-12-01
US20120263327A1 (en) 2012-10-18
FR2954654A1 (fr) 2011-06-24

Similar Documents

Publication Publication Date Title
EP2163126B1 (de) Verfahren zur sicheren verarbeitung eines stereophonen signals in einem motorfahrzeug und motorfahrzeug, in dem ein solches verfahren angewendet wird
EP1886535B1 (de) Verfahren zum herstellen mehrerer zeitsignale
US7920711B2 (en) Audio device and method for generating surround sound having first and second surround signal generation units
RU2010137901A (ru) Стереофоническое расширение
EP2517387B1 (de) Verfahren zur optimierung des stereoempfangs für analogen funk und zugehöriger analoger funkempfänger
WO2007101958A2 (fr) Optimisation d'une spatialisation sonore binaurale a partir d'un encodage multicanal
EP2709380B1 (de) Aktive Monoblock-Lautsprecherbox, die zur Einzel- oder paarweisen Benutzung konfiguriert werden kann, mit Verstärkung des Stereobilds
EP2517485B1 (de) Verfahren zur erzeugung von linken und rechten raumklangsignalen auf der basis eines stereotonsignals
WO2007104877A1 (fr) Synthese et spatialisation sonores conjointes
CH622919A5 (de)
FR3091636A1 (fr) Procédé de traitement d’un signal audio multicanal
WO2013060761A1 (fr) Enceinte acoustique comprenant un haut-parleur coaxial a directivite controlee et variable
JP3925274B2 (ja) 収音装置及びステレオ演算方法
EP3864859B1 (de) Akustisches system mit räumlichem effekt
WO2013093240A1 (fr) Dispositif de reglage de la position du centre d'une image sonore stereophonique
FR3136072A1 (fr) Procédé de traitement de signal
WO2013087638A1 (fr) Procédé de traitement numérique sur un ensemble de pistes audio avant mixage
EP2957110B1 (de) Verfahren und vorrichtung zur erzeugung von eingangssignalen für ein klangwiedergabesystem
FR3091632A1 (fr) Procédé de détermination d’un filtre de phase pour un système de génération de vibrations perceptibles par un utilisateur comprenant plusieurs transducteurs
EP2901717B2 (de) Verfahren und vorrichtung zur erzeugung von tonsignalen zur lieferung an ein schallwiedergabesystem
JPH07222295A (ja) オーディオ信号の中央定位成分強調装置
EP1278399A1 (de) Empfänger, Verfahren, Programm und Signal zur Anpassung der Laustärke eines Rufsignals
JP2003179999A (ja) 多チャンネル変換シンセサイザー回路システム

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20120711

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20140502

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 692110

Country of ref document: AT

Kind code of ref document: T

Effective date: 20141115

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602010019606

Country of ref document: DE

Effective date: 20141127

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20141015

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 692110

Country of ref document: AT

Kind code of ref document: T

Effective date: 20141015

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150215

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150216

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150115

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150116

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141231

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602010019606

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141221

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20150716

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141231

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141221

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141231

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20101221

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151221

PGRI Patent reinstated in contracting state [announced from national office to epo]

Ref country code: IT

Effective date: 20170710

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161221

PGRI Patent reinstated in contracting state [announced from national office to epo]

Ref country code: IT

Effective date: 20170710

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20171227

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20181221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181221

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20171222

Year of fee payment: 8

PGRI Patent reinstated in contracting state [announced from national office to epo]

Ref country code: IT

Effective date: 20190710

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181221

PGRI Patent reinstated in contracting state [announced from national office to epo]

Ref country code: IT

Effective date: 20190710

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230512

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20231227

Year of fee payment: 14

Ref country code: DE

Payment date: 20231219

Year of fee payment: 14