EP2517485B1 - Method of generating left and right surround sound signals on the basis of a stereo sound signal - Google Patents

Method of generating left and right surround sound signals on the basis of a stereo sound signal Download PDF

Info

Publication number
EP2517485B1
EP2517485B1 EP10807709.0A EP10807709A EP2517485B1 EP 2517485 B1 EP2517485 B1 EP 2517485B1 EP 10807709 A EP10807709 A EP 10807709A EP 2517485 B1 EP2517485 B1 EP 2517485B1
Authority
EP
European Patent Office
Prior art keywords
block
gain
signal
signals
surround
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP10807709.0A
Other languages
German (de)
French (fr)
Other versions
EP2517485A1 (en
Inventor
Frédéric AMADU
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Arkamys SA
Original Assignee
Arkamys SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Arkamys SA filed Critical Arkamys SA
Publication of EP2517485A1 publication Critical patent/EP2517485A1/en
Application granted granted Critical
Publication of EP2517485B1 publication Critical patent/EP2517485B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S5/00Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 
    • H04S5/02Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation  of the pseudo four-channel type, e.g. in which rear channel signals are derived from two-channel stereo signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control

Description

L'invention concerne un procédé de génération de signaux de son « surround » gauche et droit à partir d'un signal de son stéréo destinés à être diffusés par un système acoustique de type 5.1. L'invention a notamment pour but de proposer un procédé de traitement du son surround procurant un bon rendu sonore tout en consommant peu de ressources.The invention relates to a method for generating left and right "surround" sound signals from a stereo sound signal intended to be broadcast by a 5.1 type sound system. The invention aims in particular to provide a method of processing the surround sound providing a good sound reproduction while consuming few resources.

L'invention trouve une application particulièrement avantageuse dans le domaine du traitement du son pour le home-cinéma, les chaînes stéréo, les ordinateurs, les téléphones mobiles ou tout autre dispositif ayant un système de diffusion sonore disposant de capacités de calculs limitées ou non pour le traitement du son.The invention finds a particularly advantageous application in the field of sound processing for home cinema, stereos, computers, mobile phones or any other device having a sound diffusion system with limited or no computation capabilities. the treatment of sound.

On rappelle qu'un système de diffusion 5.1 est un système acoustique comprenant deux voies avant (gauche et droite), deux voies arrière (gauche et droite), une voie Low Frequency Effect, ainsi qu'une voie centrale. Le son diffusé par ce genre de système est un son dit « surround » qui procure une sensation d'enveloppement à l'auditeur.It is recalled that a 5.1 broadcasting system is an acoustic system comprising two front channels (left and right), two rear channels (left and right), a Low Frequency Effect channel, and a central channel. The sound broadcast by this kind of system is a so-called "surround" sound that provides a feeling of envelopment to the listener.

Un système de production d'un tel son « surround » est par exemple décrit dans le document JP 2007 336118 A system for producing such "surround sound" is for example described in the document JP 2007 336118

L'invention est décrite ci-après dans une application pour les systèmes acoustiques de type 5.1, toutefois elle pourrait être mise en oeuvre avec tout autre système acoustique basé sur la création de signaux de son visant à donner une sensation d'enveloppement sonore à l'auditeur.The invention is described below in an application for type 5.1 acoustic systems, however it could be implemented with any other acoustic system based on the creation of sound signals to give a feeling of sound wrap to the sound. 'auditor.

Plus précisément, il est possible de considérer que les signaux de son gauche et droit formant un signal stéréo sont composés chacun de 3 composantes distinctes :

  • une composante décorrélée avec celle de l'autre signal destinée à être diffusée sur les voies avant d'un système de type 5.1 ;
  • une composante corrélée et en phase par rapport à celle de l'autre signal destinée à être diffusée sur la voie centrale d'un système de type 5.1 ; et
  • une composante dite composante « surround » corrélée et hors phase par rapport à celle de l'autre signal destinée normalement à être diffusée sur les voies arrière d'un système de type 5.1.
More precisely, it is possible to consider that the left and right signals forming a stereo signal are each composed of 3 distinct components:
  • a component decorrelated with that of the other signal intended to be broadcast on the front channels of a type 5.1 system;
  • a component correlated and in phase with that of the other signal intended to be broadcast on the central channel of a type 5.1 system; and
  • a so-called "surround" component correlated and out of phase with that of the other signal normally intended to be broadcast on the rear channels of a type 5.1 system.

L'invention a pour but de créer ces composants surrounds afin de restituer un effet sonore surround de bonne qualité tout en limitant le temps de calcul lors de l'extraction de ces composantes.The object of the invention is to create these surround components in order to reproduce a good quality surround sound effect while limiting the calculation time during the extraction of these components.

A cette fin, dans le procédé selon l'invention, on effectue une soustraction des signaux stéréo de son gauche et droit l'un par rapport à l'autre, de manière à supprimer la composante commune corrélée et en phase des signaux stéréo. Ensuite, on décorrèle le signal issu de cette étape de soustraction à l'aide d'un module de décorrélation, de manière à obtenir les composantes « surround » gauche et droite du signal stéréo prêtes à être diffusées, le cas échéant après égalisation paramétrique, sur les voies arrière d'un système de type 5.1.For this purpose, in the method according to the invention, a subtraction of the stereo signals from its left and right is carried out with respect to the other, so as to eliminate the correlated common component and in phase of the stereo signals. Then, the signal resulting from this subtraction step is decorrelated by means of a decorrelation module, so as to obtain the left and right "surround" components of the stereo signal ready to be broadcast, if necessary after parametric equalization. on the rear tracks of a 5.1-type system.

En outre, le compromis entre la puissance de calcul du traitement et l'effet sonore « surround » obtenu est excellent avec le procédé selon l'invention.In addition, the compromise between the processing power of the treatment and the "surround" sound effect obtained is excellent with the method according to the invention.

L'invention concerne donc un procédé de génération de signaux de son gauche et droit dits signaux « surround » à partir d'un signal de son stéréo composé d'un signal de son gauche et d'un signal de son droit, caractérisé en ce qu'il comporte les étapes suivantes :

  • on soustrait un des signaux stéréo à l'autre signal à l'aide d'un module de soustraction pour obtenir un signal unique de soustraction dans lequel les composantes corrélées et en phase des signaux stéréo ont été supprimées,
  • on génère, à partir du signal de soustraction, un signal de son droit et un signal de son gauche décorrélés l'un par rapport à l'autre correspondant respectivement aux signaux « surround » de son droit et gauche.
The invention therefore relates to a method of generating left and right signals called "surround" signals from a stereo sound signal composed of a signal of its left and a signal of its right, characterized in that it has the following steps:
  • subtracting one of the stereo signals to the other signal using a subtraction module to obtain a single subtraction signal in which the correlated and in-phase components of the stereo signals have been suppressed,
  • from the subtraction signal, a signal of its right and a signal of its left uncorrelated with respect to the other corresponding respectively to the signals "surround" of its right and left are generated.

Selon une mise en oeuvre, les signaux « surround » sont destinés à être diffusés sur les voies arrière d'un système acoustique de type 5.1.According to one implementation, the "surround" signals are intended to be broadcast on the rear channels of a 5.1 type sound system.

Selon une mise en oeuvre, pour générer, à partir du signal de soustraction, les signaux de son droit et gauche « surround » décorrélés l'un par rapport à l'autre,

  • on applique le signal de soustraction en entrée d'un premier et d'un deuxième bloc élémentaire, le signal de sortie de ces blocs correspondant respectivement au signal de son droit et au signal de son gauche surround,
  • le signal de sortie de chaque bloc est la combinaison du signal d'entrée du bloc pondéré par un premier gain, et de la combinaison du signal de sortie du bloc pondéré par un deuxième gain et des signaux d'entrée du bloc retardée par une ligne à retard.
According to one embodiment, for generating, from the subtraction signal, the signals of its left and right "surround" uncorrelated with respect to each other,
  • the input subtraction signal of a first and a second elementary block is applied, the output signal of these blocks corresponding respectively to the signal of its right and to the signal of its left surround,
  • the output signal of each block is the combination of the input signal of the weighted block by a first gain, and the combination of the output signal of the weighted block by a second gain and the input signals of the delayed block by a line. late.

Selon une mise en oeuvre:

  • pour le premier bloc élémentaire, on a : s 1 n = e 1 n . g 1 + s 1 n - D 1 . g 2 + e 1 n - D 1 ,
    Figure imgb0001
    • e1 étant le signal d'entrée du premier bloc correspondant au signal de soustraction,
    • s1 étant le signal de sortie du premier bloc correspondant à un des signaux de son surround (droit ou gauche),
    • g1, g2 étant respectivement les valeurs du premier gain et du deuxième gain du premier bloc,
    • D1 étant la valeur du nombre d'échantillons de retard introduits par la ligne à retard, et
  • pour le deuxième bloc élémentaire, on a : s 2 n = e 2 n . g 3 + s 2 n - D 2 . g 4 + e 2 n - D 2 ,
    Figure imgb0002
    • e2 étant le signal d'entrée du deuxième bloc correspondant au signal de soustraction,
    • s2 étant le signal de sortie du deuxième bloc correspondant à l'autre signal de son surround (droit si s1 correspond au gauche ou gauche si s1 correspond au droit),
    • g3, g4 étant respectivement les valeurs du premier gain et du deuxième gain du deuxième bloc,
    • D2 étant la valeur du nombre d'échantillons de retard introduits par la ligne à retard.
According to one implementation:
  • for the first elementary block, we have: s 1 not = e 1 not . boy Wut 1 + s 1 not - D 1 . boy Wut 2 + e 1 not - D 1 ,
    Figure imgb0001
    • e 1 being the input signal of the first block corresponding to the subtraction signal,
    • where s 1 is the output signal of the first block corresponding to one of the surround sound signals (right or left),
    • g 1 , g 2 being respectively the values of the first gain and the second gain of the first block,
    • D 1 being the value of the number of delay samples introduced by the delay line, and
  • for the second elementary block, we have: s 2 not = e 2 not . boy Wut 3 + s 2 not - D 2 . boy Wut 4 + e 2 not - D 2 ,
    Figure imgb0002
    • e 2 being the input signal of the second block corresponding to the subtraction signal,
    • s 2 being the output signal of the second block corresponding to the other surround sound signal (right if s 1 corresponds to the left or left if s 1 corresponds to the right),
    • g 3 , g 4 being respectively the values of the first gain and the second gain of the second block,
    • D2 being the value of the number of delay samples introduced by the delay line.

Selon une mise en oeuvre, les valeurs de gain à l'intérieur d'un bloc sont opposées l'une par rapport à l'autre, la valeur du premier gain étant opposée par rapport à la valeur du deuxième gain.According to one implementation, the gain values inside a block are opposite to each other, the value of the first gain being opposite to the value of the second gain.

Selon une mise en oeuvre, les valeurs de gain du premier bloc sont opposées par rapport aux valeurs de gain du deuxième bloc, la valeur du premier gain du premier bloc étant opposée à la valeur du premier gain du deuxième bloc ; tandis que la valeur du deuxième gain du premier bloc est opposée à la valeur du deuxième gain du deuxième bloc.According to one implementation, the gain values of the first block are opposite to the gain values of the second block, the value of the first gain of the first block being opposite to the value of the first gain of the first block. second block; while the value of the second gain of the first block is opposite to the value of the second gain of the second block.

Selon une mise en oeuvre, les valeurs de gain du premier et du deuxième bloc élémentaire ont la même valeur absolue.According to one implementation, the gain values of the first and second elementary blocks have the same absolute value.

Selon une mise en oeuvre, le premier gain du premier bloc et le deuxième gain du deuxième bloc valent g ; tandis que le deuxième gain du premier bloc et le premier gain du deuxième bloc valent -g.According to one implementation, the first gain of the first block and the second gain of the second block are equal to g; while the second gain of the first block and the first gain of the second block are worth -g.

Selon une mise en oeuvre, le retard introduit par la ligne du premier bloc et le retard par la ligne du deuxième bloc sont égaux.According to one implementation, the delay introduced by the line of the first block and the delay by the line of the second block are equal.

Selon une mise en oeuvre, on filtre au préalable le signal de soustraction à l'aide d'un filtre haute fréquence et on applique uniquement la partie haute fréquence filtrée en entrée des blocs élémentaires.According to one embodiment, the subtraction signal is firstly filtered using a high frequency filter and only the filtered high frequency part is applied to the input of the elementary blocks.

Selon une mise en oeuvre,

  • on filtre la partie basse fréquence des signaux gauche et droit du signal stéréo,
  • on retarde les parties basses fréquences ainsi filtrées d'un retard à l'aide de troisièmes lignes à retard, et
  • on somme la partie basses fréquences ainsi retardée avec les signaux de sortie des blocs élémentaires pour obtenir le signal de son droit surround et le signal de son gauche surround.
According to one implementation,
  • the low frequency part of the left and right signals of the stereo signal is filtered,
  • the low frequency parts thus filtered are delayed by a delay with the aid of third delay lines, and
  • the low frequency part thus delayed is summed with the output signals of the elementary blocks to obtain the signal of its surround right and the signal of its left surround.

Selon une mise en oeuvre, on modifie en fonction de la fréquence la phase et le gain des signaux de sortie de chaque bloc élémentaire au moyen de cellules de filtrage paramétriques pour modifier la perception sonore des signaux de son surround gauche et droit.According to one embodiment, the phase and the gain of the output signals of each elementary block are modified as a function of the frequency by means of parametric filtering cells to modify the sound perception of the left and right surround sound signals.

L'invention concerne en outre un procédé de génération de signaux surround destinés à être diffusés par un système acoustique composé de haut parleur avant / arrière à partir d'un signal de son stéréo composés d'un signal de son gauche et d'un signal de son droit, caractérisé en ce qu'il présente l'étape suivante :

  • on génère les signaux de son « surround » à l'aide du procédé selon l'une des revendications précédentes et on les applique sur les voies arrière du système acoustique.
The invention further relates to a method of generating surround signals to be broadcast by an acoustic system consisting of a front / rear speaker from a stereo sound signal composed of a left signal and a signal. of his right, characterized in that it presents the following step:
  • the "surround" sound signals are generated by the method according to one of the preceding claims and are applied to the rear channels of the acoustic system.

L'invention sera mieux comprise à la lecture de la description qui suit et à l'examen des figures qui l'accompagnent. Ces figures ne sont données qu'à titre illustratif mais nullement limitatif de l'invention. Elles montrent :

  • Figure 1 : une représentation schématique d'un dispositif selon l'invention permettant l'extraction des composantes « surrounds » d'un signal de son stéréo dans une version basique ;
  • Figure 2 : une représentation graphique d'un dispositif selon l'invention permettant l'extraction des composantes « surrounds » d'un signal de son stéréo dans une version perfectionnée ;
  • Figure 3 : une représentation schématique d'un dispositif selon l'invention permettant de générer, à partir d'un signal de son stéréo, des signaux de son diffusables par un système acoustique de type 5.1.
The invention will be better understood on reading the description which follows and the examination of the figures which accompany it. These figures are given for illustrative but not limiting of the invention. They show :
  • Figure 1 : a schematic representation of a device according to the invention for extracting the "surround" components of a stereo sound signal in a basic version;
  • Figure 2 : a graphic representation of a device according to the invention for extracting the "surround" components of a stereo sound signal in an improved version;
  • Figure 3 : a schematic representation of a device according to the invention for generating, from a stereo sound signal, sound signals diffusable by a 5.1 type acoustic system.

Les éléments identiques conservent la même référence d'une figure à l'autre.Identical elements retain the same reference from one figure to another.

La Figure 1 montre un dispositif 10 selon l'invention permettant de générer un signal de son gauche LS et un signal de son droit RS dits signaux « surround » à partir d'un signal de son stéréo formé d'un signal de son gauche L et d'un signal de son droit R.The Figure 1 shows a device 10 according to the invention for generating a left sound signal L S and a signal of its right R S said "surround" signals from a stereo sound signal formed of a left sound signal L and a signal from his right R.

On considère que le signal de son gauche L et le signal de son droit R sont formés respectivement d'une somme de 3 composantes :

  • L = L0+C+S pour le signal de son gauche L, et
  • R = R0+C+(-S) pour le signal de son droit R.
  • Les composantes L0 et S0 sont les composantes décorrélées entre elles,
  • La composante C est commune aux deux signaux L et R puisqu'elle correspond aux composantes corrélées et en phase des signaux L et R
  • La composante S correspond à la composante corrélée et hors phase des signaux L et R.
It is considered that the signal of its left L and the signal of its right R are formed respectively of a sum of 3 components:
  • L = L 0 + C + S for the left signal L, and
  • R = R 0 + C + (- S) for the signal of his right R.
  • The components L 0 and S 0 are the components decorrelated between them,
  • The component C is common to the two signals L and R since it corresponds to the correlated components and in phase of the signals L and R
  • The S component corresponds to the correlated and out-of-phase component of the L and R signals.

L'invention a pour but d'isoler la composante S et de créer 2 composantes décorrélées pour pouvoir les diffuser sur des voies distinctes de celles où sont diffusées les signaux stéréo L et R afin de procurer un effet d'enveloppement à l'auditeur (cf Figure 3).The object of the invention is to isolate the component S and to create two decorrelated components in order to be able to broadcast them on channels distinct from those where the stereo signals L and R are broadcast in order to provide a enveloping effect to the listener ( cf. Figure 3 ).

A cet effet, les signaux de son gauche L et droit R sont appliqués en entrée d'un soustracteur 11 afin de supprimer la composante C des signaux gauche L et droit R et ne conserver que les composante L0, R0 et la composante S des signaux stéréo L et R. Ici, on soustrait le signal de son droit R au signal de son gauche L (L-R), mais il serait possible d'effectuer l'opération inverse (R-L).For this purpose, the signals of its left L and right R are applied at the input of a subtractor 11 in order to suppress the component C of the left and right signals R and retain only the components L 0 , R 0 and the component S stereo signals L and R. Here, we subtract the signal from its right R to the left-hand signal L (LR), but it would be possible to perform the reverse operation (RL).

Le signal de soustraction L-R obtenu en sortie du soustracteur 11 est ensuite appliqué en entrée d'un module 12 de décorrélation du signal qui permet de créer, à partir du signal de soustraction L-R, deux signaux décorrélés l'un par rapport à l'autre : le signal de son gauche « surround » LS et le signal de son droit « surround » RS.The subtraction signal LR obtained at the output of the subtracter 11 is then applied at the input of a signal decorrelation module 12 which makes it possible to create, from the subtraction signal LR, two signals decorrelated with respect to each other. : the signal of its left "surround" L S and the signal of its right "surround" R S.

A cet effet, le module 12 de décorrélation est formé de deux blocs 13.1-13.2 élémentaires en entrée desquels on applique le signal de soustraction L-R, la sortie s1, s2 de ces blocs 13.1, 13.2 correspondant respectivement au signal de son droit surround RS et au signal de son gauche surround LS. Le signal de sortie s1 (resp. s2) de chaque bloc 13.1 (resp. 13.2) est fonction du signal d'entrée e1 (resp. e2) du bloc pondéré par un premier gain g1 (resp. g3), et de la combinaison des signaux d'entrée e1 (resp. e2) et de sortie s1 (resp. s2) du bloc pondérée par un deuxième gain g2 (resp. g4), retardée par une ligne à retard 14.1 (resp .14.2).For this purpose, the decorrelation module 12 is formed of two input 13.1-13.2 blocks from which the subtraction signal LR is applied, the output s1, s2 of these blocks 13.1, 13.2 respectively corresponding to the signal of its surround right R S and to the signal of his left surround L S. The output signal s 1 (resp., S 2 ) of each block 13.1 (respectively 13.2) is a function of the input signal e 1 (respectively e 2 ) of the weighted block by a first gain g 1 (respectively g 3 ), and of the combination of the input signals e1 (respectively e2) and of the output s 1 (respectively s 2 ) of the weighted block by a second gain g 2 (respectively g 4 ), delayed by a delay line 14.1 (respectively 14.2).

Selon une réalisation, pour chaque bloc élémentaire 13.1, 13.2, le signal d'entrée e1, e2 est appliqué en entrée d'un premier sommateur 16.1, 16.2 et appliqué sur une entrée d'un deuxième sommateur 17.1, 17.2 après avoir été multiplié par le premier gain g1, g3. Le signal de sortie s1, s2 du bloc est appliqué sur une autre entrée du premier sommateur 16.1, 16.2 après avoir été multiplié par le deuxième gain g2, g4, le signal de sortie du premier sommateur 16.1, 16.2 étant appliqué en entrée de la ligne à retard 14.1, 14.2. Le signal de sortie de la ligne à retard 14.1, 14.2 est appliqué sur une autre entrée du deuxième sommateur 17.1, 17.2, le signal de sortie de ce deuxième sommateur 17.1, 17.2 correspondant au signal de sortie s1, s2 du bloc et donc au signal de son droit RS ou gauche LS surround.According to one embodiment, for each elementary block 13.1, 13.2, the input signal e 1 , e 2 is applied at the input of a first adder 16.1, 16.2 and applied to an input of a second adder 17.1, 17.2 after having been multiplied by the first gain g 1 , g 3 . The output signal s 1 , s 2 of the block is applied to another input of the first summer 16.1, 16.2 after having been multiplied by the second gain g 2 , g 4 , the output signal of the first summer 16.1, 16.2 being applied in input of delay line 14.1, 14.2. The output signal of the delay line 14.1, 14.2 is applied to another input of the second adder 17.1, 17.2, the output signal of this second adder 17.1, 17.2 corresponding to the output signal s 1 , s 2 of the block and therefore to the right signal R S or left L S surround.

Ainsi pour le premier bloc élémentaire 13.1, on a : s 1 n = e 1 n . g 1 + s 1 n - D 1 . g 2 + e 1 n - D 1

Figure imgb0003

  • e1 étant le signal d'entrée du premier bloc 13.1 correspondant au signal de soustraction (L-R),
  • s1 étant le signal de sortie du premier bloc 13.1 correspondant à un des signaux de son surround (droit RS ou gauche LS),
  • g1, g2 étant respectivement les valeurs du premier gain et du deuxième gain du premier bloc 13.1,
  • D1 étant la valeur du nombre d'échantillons de retard introduits par la ligne à retard 14.1.
Thus for the first elementary block 13.1, we have: s 1 not = e 1 not . boy Wut 1 + s 1 not - D 1 . boy Wut 2 + e 1 not - D 1
Figure imgb0003
  • e 1 being the input signal of the first block 13.1 corresponding to the subtraction signal (LR),
  • s 1 being the output signal of the first block 13.1 corresponding to one of the surround sound signals (right R S or left L S ),
  • g 1 , g 2 being respectively the values of the first gain and the second gain of the first block 13.1,
  • D1 being the value of the number of delay samples introduced by the delay line 14.1.

Pour le deuxième bloc élémentaire 13.2, on a : s 2 n = e 2 n . g 3 + s 2 n - D 2 . g 4 + e 2 n - D 2

Figure imgb0004

  • e2 étant le signal d'entrée du deuxième bloc 13.2 correspondant au signal de soustraction (L-R),
  • s2 étant le signal de sortie du deuxième bloc 13.2 correspondant à l'autre signal de son surround (droit RS si s1 correspond au gauche ; ou gauche LS si s1 correspond au droit),
  • g3, g4 étant respectivement les valeurs du premier gain et du deuxième gain du deuxième bloc 13.2,
  • D2 étant la valeur du nombre d'échantillons de retard introduits par la ligne à retard 14.2.
For the second elementary block 13.2, we have: s 2 not = e 2 not . boy Wut 3 + s 2 not - D 2 . boy Wut 4 + e 2 not - D 2
Figure imgb0004
  • e 2 being the input signal of the second block 13.2 corresponding to the subtraction signal (LR),
  • s 2 being the output signal of the second block 13.2 corresponding to the other surround sound signal (right R S if s 1 corresponds to the left, or left L S if s 1 corresponds to the right),
  • g 3 , g 4 being respectively the values of the first gain and the second gain of the second block 13.2,
  • D2 being the value of the number of delay samples introduced by the delay line 14.2.

De préférence, à l'intérieur d'un même bloc 13.1 (resp. 13.2), le premier gain g1 (resp. g3) et le deuxième gain g2 (resp. g4) présentent des valeurs opposées l'une par rapport à l'autre. Chaque bloc 13.1, 13.2 se comporte alors comme un filtre de type passe-tout qui ne modifie pas le gain du signal d'entrée e1, e2 mais uniquement sa phase.Preferably, within the same block 13.1 (respectively 13.2), the first gain g 1 (respectively g 3 ) and the second gain g 2 (respectively g 4 ) have opposite values, one for each report to the other. Each block 13.1, 13.2 then behaves like an all-pass type filter which does not modify the gain of the input signal e 1 , e 2 but only its phase.

En outre, les gains g1, g2 du premier bloc 13.1 et les gains g3, g4 du deuxième bloc 13.2 présentent de préférence des valeurs opposées les unes des autres. Ainsi, la valeur du premier gain g1 du premier bloc 13.1 est opposée à la valeur du premier gain g3 du deuxième bloc 13.2 ; tandis que la valeur du deuxième gain g2 du premier bloc 13.1 est opposée à la valeur du deuxième gain g4 du deuxième bloc 13.2.In addition, the gains g 1 , g 2 of the first block 13.1 and the gains g 3 , g 4 of the second block 13.2 preferably have opposite values from each other. Thus, the value of the first gain g 1 of the first block 13.1 is opposite to the value of the first gain g 3 of the second block 13.2; while the value of the second gain g 2 of the first block 13.1 is opposite to the value of the second gain g 4 of the second block 13.2.

On choisira également de préférence des gains pour le premier 13.1 et le deuxième 13.2 bloc qui ont une valeur absolue identique g. Ainsi de préférence, le premier gain g1 du premier bloc 13.1 et le deuxième gain g4 du deuxième bloc 13.2 présentent une valeur g ; tandis que le deuxième gain g2 du premier bloc 13.1 et le premier g3 gain du deuxième bloc 13.2 présente une valeur -g.We will also preferably choose gains for the first 13.1 and the second 13.2 block which have an identical absolute value g. Thus, preferably, the first gain g 1 of the first block 13.1 and the second gain g 4 of the second block 13.2 have a value g; while the second gain g 2 of the first block 13.1 and the first g 3 gain of the second block 13.2 has a value -g.

De préférence, les retards D1, D2 introduits par la ligne à retard 14.1 du premier bloc élémentaire 13.1 et la ligne à retard 14.2 du deuxième bloc 13.2 élémentaire sont égaux. Toutefois, il serait possible de choisir des retards D1, D2 ayant des durées différentes.Preferably, the delays D1, D2 introduced by the delay line 14.1 of the first elementary block 13.1 and the delay line 14.2 of the second elementary block 13.2 are equal. However, it would be possible to choose delays D1, D2 having different durations.

Dans un exemple de réalisation, on choisit g=0.4 et un retard de D1 et D2 de 176 échantillons avec une fréquence d'échantillonnage de 44,1 kHz, de telles valeurs permettant d'obtenir un bon rendu sonore.In an exemplary embodiment, g = 0.4 and a delay of D1 and D2 of 176 samples with a sampling frequency of 44.1 kHz are chosen, such values making it possible to obtain a good sound reproduction.

Dans un perfectionnement de l'invention représenté sur la Figure 2, on utilise en outre un étage 19 composé de deux filtres 20.1, 20.2 permettant d'isoler la partie basse fréquence respectivement des signaux L et R et d'un filtre 21 permettant d'isoler la partie haute fréquence du signal de soustraction L-R.In an improvement of the invention shown in the Figure 2 in addition, a stage 19 composed of two filters 20.1, 20.2 is used to isolate the low frequency part respectively of the L and R signals and of a filter 21 making it possible to isolate the high frequency part of the subtraction signal LR.

Dans ce cas, seule la partie haute fréquence du signal L-R est appliquée en entrée du module 12 de décorrélation. Dans un exemple, les fréquences de coupure des filtres basse fréquence 20.1, 20.2 et du filtre haute fréquence 21 sont de l'ordre de 350Hz.In this case, only the high frequency portion of the L-R signal is applied to the input of the decorrelation module 12. In one example, the cut-off frequencies of the low-frequency filters 20.1, 20.2 and the high-frequency filter 21 are of the order of 350 Hz.

Les parties basse fréquence des signaux gauche et droit sont appliquées en entrée de troisièmes lignes à retard 23.1, 23.2 et les parties basse fréquence ainsi retardées sont sommées, s'il y a lieu après pondération par des gains g7, g8 respectivement avec les signaux de sortie s1, s2 des blocs élémentaires, de manière à obtenir des signaux de son droit RS et gauche LS surround ayant un rendu sonore amélioré. Dans un exemple, le retard D3 appliqué par les troisièmes lignes à retard 23.1, 23.2 vaut 176 échantillons avec une fréquence d'échantillonnage de 44,1 kHzThe low frequency parts of the left and right signals are applied as third delay line inputs 23.1, 23.2 and the low frequency parts thus delayed are summed, if necessary after weighting by gains g 7 , g 8 respectively with the output signals s 1 , s 2 of the elementary blocks, so as to obtain signals of its right R S and left L S surround having improved sound reproduction. In one for example, the delay D3 applied by the third delay lines 23.1, 23.2 is 176 samples with a sampling frequency of 44.1 kHz

En outre, des cellules 25.1, 25.2 d'égalisation paramétriques sont connectées en sortie de chaque bloc élémentaire 13.1, 13.2 avant sommation avec la partie basse fréquence retardée. Ces cellules 25.1, 25.2 ont pour effet de modifier la perception des signaux de sortie s1, s2 de ces blocs 13.1, 13.2, car même si les signaux s1, s2 présentent des niveaux sensiblement identiques, il existe des différences dans leur perception en raison de la décorrélation qu'ils présentent l'un par rapport à l'autre. En conséquence, il peut être utile de modifier perceptivement ces signaux pour que l'impression auditive d'ensemble soit la meilleure possible.In addition, parametric equalizing cells 25.1, 25.2 are connected at the output of each elementary block 13.1, 13.2 before summation with the delayed low frequency part. These cells 25.1, 25.2 have the effect of modifying the perception of the output signals s 1 , s 2 of these blocks 13.1, 13.2, because even if the signals s 1 , s 2 have substantially identical levels, there are differences in their perception because of the decorrelation they exhibit relative to each other. As a result, it may be useful to modify these signals perceptively so that the overall auditory impression is the best possible.

A cet effet, les cellules 25.1, 25.2 d'égalisation comportent chacune un filtre 26.1, 26.2 dont le type, le gain et la phase peuvent être réglés en fonction de différentes bandes de fréquence des signaux s1, s2 et un gain g5, g6 qui agit sur l'ensemble du spectre des signaux s1, s2. Ces paramètres sont adaptés par des ingénieurs du son notamment en fonction de l'application envisagée.For this purpose, the equalizing cells 25.1, 25.2 each comprise a filter 26.1, 26.2 whose type, the gain and the phase can be adjusted according to different frequency bands of the signals s 1 , s 2 and a gain g 5 , g 6 which acts on the entire spectrum of signals s 1 , s 2 . These parameters are adapted by sound engineers in particular according to the intended application.

La Figure 3 montre une utilisation de l'invention dans le cadre d'un système de diffusion sonore à 4 voies (2 voies avant et 2 voies arrière) ou à 5 voies (avec une voie centrale en plus) permettant d'obtenir un excellent rendu sonore tout en limitant la puissance de calcul du traitement du son.The Figure 3 shows a use of the invention in the context of a 4-way (2-way front and 2-way rear) or 5-way sound system (with a central channel in addition) to obtain excellent sound reproduction while by limiting the computing power of sound processing.

Plus précisément, dans le cadre de cette utilisation, les signaux stéréo gauche L et droit R sont appliqués en entrée du module 10 des Figures 1 ou 2 de manière à extraire les signaux « surround » gauche LS et droit RS qui sont diffusés sur les voies arrière 29.1, 19.2 ; tandis que les signaux stéréo initiaux gauche L et droit S sont directement diffusés sur les voies avant 30.1, 30.2, le cas échéant après égalisation paramétrique effectuée à l'aide des modules 31.1, 31.2 (semblables aux modules 25.1, 25.2 de la Figure 2).More specifically, in the context of this use, the left stereo signals L and R right are applied to the input of the module 10 Figures 1 or 2 in order to extract the left surround signals L S and right R S which are broadcast on the rear channels 29.1, 19.2; while the initial left L and right S stereo signals are directly broadcast on the front channels 30.1, 30.2, where appropriate after parametric equalization performed using the modules 31.1, 31.2 (similar to the modules 25.1, 25.2 of the Figure 2 ).

Optionnellement, la composante commune C aux signaux L et R est également extraite à l'aide d'un module 33 (un exemple d'implémentation d'un tel module est donné dans le document FR-2886503 ) afin d'être diffusée sur la voie centrale 34.Optionally, the common component C to the L and R signals is also extracted using a module 33 (an implementation example of such a module is given in the document FR-2886503 ) to be broadcast on the central lane 34.

Claims (10)

  1. Method of generating left (Ls) and right (Rs) sound signals, called "surround" signals, from a stereo sound signal made up of a left sound signal (L) and a right sound signal (R), characterized in that it comprises the following steps:
    - one of the stereo signals (L, R) is subtracted from the other signal (L, R) using a subtraction module to obtain a single subtraction signal (L-R) in which the correlated and in-phase components of the stereo signals (L, R) have been eliminated,
    - the subtraction signal (L-R) is filtered using a high-frequency filter (21) and only the filtered high-frequency part is applied to the input of a first (13.1) and a second (13.2) individual block,
    - the output signal (s1, s2) of each block (13.1, 13.2) being the combination of the input signal (e1, e2) of the block weighted by a first gain (g1, g3), and of the combination of the output signal (s1, s2) of the block weighted by a second gain (g2, g4) and of the input signal (e1, e2) of the block delayed by a delay line (14.1, 14.2),
    - the low-frequency part of the left (L) and right (R) signals of the stereo signal is filtered,
    - the duly filtered low-frequency parts are delayed by a delay (D3) using third delay lines (23.1, 23.2), and
    - the duly delayed low-frequency part is aggregated with the output signals (s1, s2) of the individual blocks (13.1, 13.2) to obtain the right surround sound signal (Rs) and the left surround sound signal (Ls).
  2. Method according to Claim 1, characterized in that the "surround" signals (Ls, Rs) are intended to be broadcast over the rear channels of an acoustic system of 5.1 type.
  3. Method according to Claim 1 or 2, characterized in that:
    - for the first individual block (13.1), the following applies: s 1 n = e 1 n . g 1 + s 1 n - D 1 . g 2 + e 1 n - D 1
    Figure imgb0009
    e1 being the input signal of the first block corresponding to the subtraction signal (L-R),
    s1 being the output signal of the first block corresponding to one of the surround sound signals (right RS or left LS),
    g1, g2 being, respectively, the values of the first gain and of the second gain of the first block (13.1),
    D1 being the value of the number of delay samples introduced by the delay line (14.1), and
    - for the second individual block (13.2), the following applies: s 2 n = e 2 n . g 3 + s 2 n - D 2 . g 4 + e 2 n - D 2
    Figure imgb0010
    e2 being the input signal of the second block corresponding to the subtraction signal (L-R),
    s2 being the output signal of the second block corresponding to the other surround sound signal (right if s1 corresponds to the left or left if s1 corresponds to the right),
    g3, g4 being, respectively, the values of the first gain and of the second gain of the second block (13.2),
    D2 being the value of the number of delay samples introduced by the delay line (14.2).
  4. Method according to one of Claims 1 to 3, characterized in that the gain values within a block (13.1, 13.2) are opposite to one another, the value of the first gain (g1, g3) being opposite in relation to the value of the second gain (g2, g4).
  5. Method according to one of Claims 1 to 4, characterized in that the gain values (g1, g2) of the first block (13.1) are opposite in relation to the gain values (g3, g4) of the second block (13.2), the value of the first gain (g1) of the first block (13.1) being opposite to the value of the first gain (g3) of the second block (13.2); whereas the value of the second gain (g2) of the first block (13.1) is opposite to the value of the second gain (g4) of the second block (13.2).
  6. Method according to one of Claims 1 to 5, characterized in that the gain values of the first (g1, g2) and of the second (g3, g4) individual block have the same absolute value (g).
  7. Method according to one of Claims 1 to 6, characterized in that the first gain (g1) of the first block (13.1) and the second gain (g4) of the second block have the value g; whereas the second gain (g2) of the first block (13.1) and the first gain (g3) of the second block have the value -g.
  8. Method according to one of Claims 1 to 7, characterized in that the delay (D1) introduced by the line (14.1) of the first block (13.1) and the delay (D2) by the line (14.1) of the second block (14.2) are equal.
  9. Method according to one of Claims 1 to 8, characterized in that the phase and the gain of the output signals (s1, s2) of each individual block (13.1, 13.2) are modified as a function of the frequency by means of parametric filtering cells (25.1, 25.2) to modify the audio perception of the left (Ls) and right (Rs) surround sound signals.
  10. Method of generating surround signals intended to be broadcast by an acoustic system consisting of front/rear loudspeakers from a stereo sound signal made up of a left sound signal (L) and of a right sound signal (R), characterized in that it has the following step:
    - the "surround" sound signals are generated using the method according to one of the preceding claims and they are applied to the rear channels (29.1, 29.2) of the acoustic system.
EP10807709.0A 2009-12-23 2010-12-21 Method of generating left and right surround sound signals on the basis of a stereo sound signal Active EP2517485B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR0959554A FR2954654B1 (en) 2009-12-23 2009-12-23 METHOD OF GENERATING LEFT AND RIGHT SURROUND SIGNAL SIGNALS FROM A SOUND STEREO SIGNAL
PCT/FR2010/052864 WO2011077040A1 (en) 2009-12-23 2010-12-21 Method of generating left and right surround sound signals on the basis of a stereo sound signal

Publications (2)

Publication Number Publication Date
EP2517485A1 EP2517485A1 (en) 2012-10-31
EP2517485B1 true EP2517485B1 (en) 2014-10-15

Family

ID=42313478

Family Applications (1)

Application Number Title Priority Date Filing Date
EP10807709.0A Active EP2517485B1 (en) 2009-12-23 2010-12-21 Method of generating left and right surround sound signals on the basis of a stereo sound signal

Country Status (5)

Country Link
US (1) US9204237B2 (en)
EP (1) EP2517485B1 (en)
KR (1) KR101753929B1 (en)
FR (1) FR2954654B1 (en)
WO (1) WO2011077040A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023118078A1 (en) 2021-12-20 2023-06-29 Dirac Research Ab Multi channel audio processing for upmixing/remixing/downmixing applications

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL7714502A (en) * 1977-12-29 1979-07-03 Philips Nv ARTIFICIAL RETURN DEVICE FOR AUDIO-FREQUENCY VIBRATIONS.
NL7903195A (en) * 1979-04-24 1980-10-28 Philips Nv DEVICE FOR ARTIFICIAL NAIL.
JPS62258599A (en) * 1986-04-28 1987-11-11 Fujitsu Ten Ltd On-vehicle surrounding device
JPS64900A (en) * 1987-06-23 1989-01-05 Yamaha Corp Sound field control circuit
JP2512038B2 (en) * 1987-12-01 1996-07-03 松下電器産業株式会社 Sound field playback device
JP2580774B2 (en) * 1989-05-15 1997-02-12 ヤマハ株式会社 Music synthesizer
GB9211756D0 (en) * 1992-06-03 1992-07-15 Gerzon Michael A Stereophonic directional dispersion method
JP2871387B2 (en) * 1992-07-27 1999-03-17 ヤマハ株式会社 Sound image localization device
JP2727883B2 (en) * 1992-08-20 1998-03-18 ヤマハ株式会社 Music synthesizer
US5641931A (en) * 1994-03-31 1997-06-24 Yamaha Corporation Digital sound synthesizing device using a closed wave guide network with interpolation
US5708718A (en) * 1996-02-22 1998-01-13 Sounds' So Real Accessories, Inc. Surround sound processor system
US5970153A (en) * 1997-05-16 1999-10-19 Harman Motive, Inc. Stereo spatial enhancement system
JP3792845B2 (en) 1997-07-24 2006-07-05 キヤノン株式会社 Optical device
US6175631B1 (en) * 1999-07-09 2001-01-16 Stephen A. Davis Method and apparatus for decorrelating audio signals
US7149314B2 (en) * 2000-12-04 2006-12-12 Creative Technology Ltd Reverberation processor based on absorbent all-pass filters
AU2002305342A1 (en) * 2001-05-03 2002-11-18 Harman International Industries, Incorporated System for transitioning from stereo to simulated surround sound
JP4414905B2 (en) * 2005-02-03 2010-02-17 アルパイン株式会社 Audio equipment
FR2886503B1 (en) 2005-05-27 2007-08-24 Arkamys Sa METHOD FOR PRODUCING MORE THAN TWO SEPARATE TEMPORAL ELECTRIC SIGNALS FROM A FIRST AND A SECOND TIME ELECTRICAL SIGNAL
JP4946148B2 (en) * 2006-04-19 2012-06-06 ソニー株式会社 Audio signal processing apparatus, audio signal processing method, and audio signal processing program
JP4841324B2 (en) * 2006-06-14 2011-12-21 アルパイン株式会社 Surround generator
US20100303245A1 (en) * 2009-05-29 2010-12-02 Stmicroelectronics, Inc. Diffusing acoustical crosstalk
JP5481943B2 (en) 2009-06-01 2014-04-23 日本テキサス・インスツルメンツ株式会社 Fine particle detector

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023118078A1 (en) 2021-12-20 2023-06-29 Dirac Research Ab Multi channel audio processing for upmixing/remixing/downmixing applications

Also Published As

Publication number Publication date
US9204237B2 (en) 2015-12-01
KR101753929B1 (en) 2017-07-04
US20120263327A1 (en) 2012-10-18
FR2954654B1 (en) 2012-10-12
EP2517485A1 (en) 2012-10-31
FR2954654A1 (en) 2011-06-24
WO2011077040A1 (en) 2011-06-30
KR20120120257A (en) 2012-11-01

Similar Documents

Publication Publication Date Title
EP1886535B1 (en) Method of producing a plurality of time signals
US7920711B2 (en) Audio device and method for generating surround sound having first and second surround signal generation units
EP2517387B1 (en) Method of optimizing stereo reception for analogue radio and associated analogue radio receiver
EP2163126A2 (en) Method for the sound processing of a stereophonic signal inside a motor vehicle and motor vehicle implementing said method
RU2010137901A (en) STEREOPHONIC EXPANSION
KR102660704B1 (en) Spectrally orthogonal audio component processing
EP1001654A2 (en) Sound signal mixing
KR102179779B1 (en) Crosstalk cancellation on opposing transoral loudspeaker systems
EP2517485B1 (en) Method of generating left and right surround sound signals on the basis of a stereo sound signal
EP1994526B1 (en) Joint sound synthesis and spatialization
CH622919A5 (en)
WO2013060761A1 (en) Acoustic chamber including a coaxial loudspeaker having a controlled and variable directivity
KR20240060678A (en) Spectrally orthogonal audio component processing
FR3136072A1 (en) Signal processing method
WO2013087638A1 (en) Method for digitally processing a set of audio tracks before mixing
WO2013093240A1 (en) Device for adjusting the position of the centre of a stereophonic sound image
FR3091632A1 (en) Method for determining a phase filter for a system for generating vibrations perceptible by a user comprising several transducers
EP3864859A1 (en) Acoustic system with spatial effect
FR3091636A1 (en) Method for processing a multichannel audio signal

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20120711

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20140502

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 692110

Country of ref document: AT

Kind code of ref document: T

Effective date: 20141115

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602010019606

Country of ref document: DE

Effective date: 20141127

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20141015

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 692110

Country of ref document: AT

Kind code of ref document: T

Effective date: 20141015

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150215

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150216

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150115

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150116

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141231

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602010019606

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141221

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20150716

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141231

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141221

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20141231

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20101221

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20151221

PGRI Patent reinstated in contracting state [announced from national office to epo]

Ref country code: IT

Effective date: 20170710

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20161221

PGRI Patent reinstated in contracting state [announced from national office to epo]

Ref country code: IT

Effective date: 20170710

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20171227

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141015

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20181221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181221

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20171222

Year of fee payment: 8

PGRI Patent reinstated in contracting state [announced from national office to epo]

Ref country code: IT

Effective date: 20190710

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181221

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181221

PGRI Patent reinstated in contracting state [announced from national office to epo]

Ref country code: IT

Effective date: 20190710

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230512

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20231227

Year of fee payment: 14

Ref country code: DE

Payment date: 20231219

Year of fee payment: 14