EP2952016A1 - Method for processing a multichannel sound in a multichannel sound system - Google Patents

Method for processing a multichannel sound in a multichannel sound system

Info

Publication number
EP2952016A1
EP2952016A1 EP13705936.6A EP13705936A EP2952016A1 EP 2952016 A1 EP2952016 A1 EP 2952016A1 EP 13705936 A EP13705936 A EP 13705936A EP 2952016 A1 EP2952016 A1 EP 2952016A1
Authority
EP
European Patent Office
Prior art keywords
signals
signal
surround
stereo
difference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP13705936.6A
Other languages
German (de)
French (fr)
Other versions
EP2952016B1 (en
Inventor
Gunnar Kron
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kronoton GmbH
Original Assignee
Kronoton GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kronoton GmbH filed Critical Kronoton GmbH
Publication of EP2952016A1 publication Critical patent/EP2952016A1/en
Application granted granted Critical
Publication of EP2952016B1 publication Critical patent/EP2952016B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/02—Systems employing more than two channels, e.g. quadraphonic of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S5/00—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation 
    • H04S5/02—Pseudo-stereo systems, e.g. in which additional channel signals are derived from monophonic signals by means of phase shifting, time delay or reverberation  of the pseudo four-channel type, e.g. in which rear channel signals are derived from two-channel stereo signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems

Definitions

  • the invention relates to a method for multi-channel sound processing in a multi-channel sound system in which the input signals L and R, preferably as stereo signals, are decoded.
  • the coefficients ai... A 8 of these weighted summations are derived from level measurements.
  • two control signals from the level difference of a left and right channel D LR and level difference of a sum and difference signal D cs are calculated. These two control signals are changed with time-variant response times in this dynamic.
  • Four individual weighting factors E c , E s , E L and E R are then derived from these two time variant new control signals, which enable a time-variant output matrix for calculating the front signals L 'and R' as well as the center signal C and the surround signal S. ,
  • the two front signals L out and R out are obtained from the two input signals L and R and the subtraction of a weighted sum signal (L + R) and a weighted difference signal (LR).
  • the center signal C results from the sum (L + R) and the subtraction of the weighted input signals L and R.
  • the surround signal S is made up of the sum (LR) and the subtraction of the weighted input signals L and R.
  • the weighting coefficients gi , g r , g c and g s are obtained from a level matching of the signals L and R and L + R and LR in a recursive structure. Also, US Pat. No. 6,697,491 Bl uses the level difference calculation for L / R and (L + R) / (LR) for deriving control signals for the weighted matrix coding in the multi-channel tone processing.
  • the front signals L 0 and R 0 , the center signal C 0 and the surround signals L R0 and R R0 are derived from stereo signals, ie from the input signals L and R.
  • the respective other signals are subtracted from the signals L, R, L + R and LR with a weighting.
  • frequency-dependent weighting factors are derived in addition to the level ratio calculations.
  • the center signal C is varied only in the level, whereas the two surround signals L R0 and R R0 are derived in two frequency bands and phase-inverted.
  • the signals L and R are decoded into a space signal R and into a center signal.
  • the space signal is formed from the difference between the signals L and R (R L ) and / or the difference between the signals R and L (R R ).
  • a space is created by the method according to the invention - And stereo extension of a stereo signal achieved by an expansion of the stereo decomposition.
  • S R 2R-L proved to be favorable.
  • the advantage here is a frequency-dependent weighting of the surround signals.
  • a frequency-dependent weighting of the signals S L and S R takes place .
  • the frequency-dependent weighting is preferably carried out by means of a height-helving filter.
  • the signals L and R are expediently added to the signals L P and R P.
  • an audio system for carrying out the method is the subject matter of claim 13, wherein the audio system comprises a signal processor, preferably in the form of an audio processor.
  • a software is provided which is located on a signal processor, ie. is imported to the signal processor.
  • the software contains an algorithm which is processed by the signal processor, the algorithm detecting the method.
  • the invention covers a signal processor for carrying out the method.
  • Fig. 1 a method according to the invention.
  • Fig. 1 shows the method according to the invention, which has four method sections A, B, C, D.
  • the procedural sections are:
  • the method begins with the fact that, as part of the decoding, the input signals L and R, which are present as stereo signals, are split into three sine parts, whereby the signals L and R can be retained.
  • the signal components are the center signal C, the room signal R and the surround signals S L and S R.
  • the center signal C is single-channel, ie. it contains only the channel C, whereas the space signal R and the surround signal S are two-channel, ie they contain the signals R L and R R and S L and S R, respectively.
  • the surround and space signals S L , S R and R L and R R contain the direction and spatial information of the stereo signals L and R.
  • the signals i. H .
  • the process section A is followed by the process section B, in which the processing of the channels C, R L , RR, S L and S R takes place.
  • these signals are provided by first level control 1, 2 with a level weighting, which manifests itself in the factor 1.5.
  • the further level controls 3, 4 provide a further variable level weighting, which weights the sound characteristics of the decoded signals to L, R.
  • the filters 5, 6 have a minimal phase shift in the frequency range of preferably 2 kHz, so that extinction effects are minimized in the taking place in process section C encoding, at the same time the actual gain effect is emphasized with a height helving frequency response by, for example, 3 d B at preferably 2KHZ.
  • the surround signals S L , S R are supplied to the level selectors 7, 8 which weight the sound characteristics of the decoded signals to S
  • R P V c C + V R R r + V s
  • S R V c (L + R) + V R ( R L) + V s (2R-L) or after filtering the surround signals S L , S R
  • R P V c C + V R RR + V s (S R ) Fi
  • ered t V c (L + R) + VR (R 'L) + V s (2R-L) Fi
  • the encoded weighted signals L P , R P undergo post-processing by stereo equalizers 9, 10.
  • a special non-linear characteristic NL is used. This non-linear characteristic maps an input amplitude x to an output amplitude y.
  • the signals L P , R P undergo further post-processing in the method section D such that the level adjusters 11, 12 determine the degree of overtone mixing to the direct signal. Further processing is finally carried out by the level control 13, 14, which make the overall level of the process result adjustable.
  • the present invention is not limited in its execution to the standing specified embodiment. Rather, a number of variants is conceivable, which make use of the solution shown in other types. For example, within the scope of the method section D Maximizer, i. Compressors / Limiter find application to further enrich the sound.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Algebra (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Physics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Stereophonic System (AREA)

Abstract

The invention relates to a method for processing a multichannel sound in a multichannel sound system, wherein the input signals L and R are decoded, preferably as stereo signals. The aim of the invention is to develop the method such that a further improvement of the spatial reproduction of the input signals L and R is achieved on the basis of an extraction of direction components. According to the invention, this is achieved in that the signals R and L are decoded at least into two signals of the form nL-mR, in which n, m = 1, 2, 3, 4.

Description

Verfahren zur Mehrkanaltonbearbeituna in einem Mehrkanaltonsvstem  Method of multi-channel sound processing in a multi-channel sound system
Die Erfindung betrifft ein Verfahren zur Mehrkanaltonbearbeitung in einem Mehrkanaltonsystem, bei dem die Eingangssignale L und R, vorzugsweise als Stereo- Signale, decodiert werden. The invention relates to a method for multi-channel sound processing in a multi-channel sound system in which the input signals L and R, preferably as stereo signals, are decoded.
Verfahren der eingangs genannten Art sind dem Fachmann bekannt und geläufig . Methods of the type mentioned are known to the skilled worker and familiar.
In dem der Druckschrift US 5,046,098 offenbarten vorbekannten Verfahren werden die Frontsignale L' und R' sowie das Center-Signal C und das Surround-Signal S erzeugt, in dem durch Summen und Differenzbildung das Center-Signal In the previously known method disclosed in US Pat. No. 5,046,098, the front signals L 'and R' as well as the center signal C and the surround signal S are generated, in which the center signal is added by summing and subtraction
C=ai*L+a2*R und das Surround-Signal S=a3*L-a4*R und die Frontsignale C = ai * L + a 2 * R and the surround signal S = a 3 * La 4 * R and the front signals
L'=a5*L-a6*C und R'=a7*R-a8*C aus den beiden Eingangssignalen L und R gebildet werden. Die Koeffizienten ai...a8 dieser gewichteten Summationen werden aus Pegelmessungen abgeleitet. Zur Steuerung dieser Differenzbildung werden zwei Steuersignale aus der Pegeldifferenz eines linken und rechten Kanals DLR und aus Pegeldifferenz eines Summen- und Differenzsignales Dcs berechnet. Diese beiden Steuersignale werden mit zeitvarianten Ansprechzeiten in dieser Dynamik verändert. Aus diesen beiden zeitvarianten neuen Steuersignalen werden dann vier einzelne Gewichtsfaktoren Ec, Es, EL und ER abgeleitet, die eine zeitvariante Ausgangsmatrix zur Berechnung der Frontsignale L' und R' sowie des Center-Signales C und des Surround-Signales S ermöglichen. L '= a 5 * La 6 * C and R' = a 7 * Ra 8 * C are formed from the two input signals L and R. The coefficients ai... A 8 of these weighted summations are derived from level measurements. To control this difference formation, two control signals from the level difference of a left and right channel D LR and level difference of a sum and difference signal D cs are calculated. These two control signals are changed with time-variant response times in this dynamic. Four individual weighting factors E c , E s , E L and E R are then derived from these two time variant new control signals, which enable a time-variant output matrix for calculating the front signals L 'and R' as well as the center signal C and the surround signal S. ,
Ein weiteres Verfahren der eingangs genannten Art offenbart die Druckschrift US 2004/0125960 AI, die eine Erweiterung der Decodierung mit zeitvarianten Steuersignalen zum Inhalt hat. Die beiden Frontsignale Lout und Rout werden dabei aus den beiden Eingangssignalen L und R und der Subtraktion eines gewichteten Summen- signales (L+R) und eines gewichteten Differenzsignales (L-R) gewonnen. Das Center-Signal C ergibt sich aus der Summe (L+R) und der Subtraktion der gewichteten Eingangssignale L und R. Das Surround-Signal S erfolgt aus der Summe (L-R) und der Subtraktion der gewichteten Eingangssignale L und R. Die Gewichtskoeffizienten gi, gr, gc und gs werden aus einer Pegelanpassung der Signale L und R bzw. L+R und L-R in einer rekursiven Struktur gewonnen. Auch dient in der Druckschrift US 6,697,491 Bl die Pegeldifferenzberechnung für L/R und (L+R)/(L-R) zur Ableitung von Steuersignalen für die gewichtete Matrixde Codierung in der Mehrkanaltonbearbeitung . Another method of the aforementioned type discloses the document US 2004/0125960 AI, which has an extension of the decoding with time-variant control signals to the content. The two front signals L out and R out are obtained from the two input signals L and R and the subtraction of a weighted sum signal (L + R) and a weighted difference signal (LR). The center signal C results from the sum (L + R) and the subtraction of the weighted input signals L and R. The surround signal S is made up of the sum (LR) and the subtraction of the weighted input signals L and R. The weighting coefficients gi , g r , g c and g s are obtained from a level matching of the signals L and R and L + R and LR in a recursive structure. Also, US Pat. No. 6,697,491 Bl uses the level difference calculation for L / R and (L + R) / (LR) for deriving control signals for the weighted matrix coding in the multi-channel tone processing.
In dem in der Druckschrift US 5,771,295 beschriebenen Mehrkanaltonverfahren werden aus Stereo-Signalen, d.h. aus den Eingangssignalen L und R die Frontsignale L0 und R0, das Center-Signal C0 und die Surround-Signale LR0 und RR0 abgeleitet. Für jedes der Signale werden von den Signalen L, R, L+R und L-R die jeweil anderen Signale mit einer Gewichtung subtrahiert. Im Rahmen dieses vorbekannten Verfahrens zur Mehrkanaltonbearbeitung werden neben den Pegelverhältnisbe rechnungen auch frequenzabhängige Gewichtsfaktoren abgeleitet. Dabei wird das Center-Signal C nur in dem Pegel variiert, wohingegen die beiden Surround-Signale LR0 und RR0 in zwei Frequenzbändern und phaseninvertiert abgeleitet werden. In the multi-channel sound method described in the document US Pat. No. 5,771,295, the front signals L 0 and R 0 , the center signal C 0 and the surround signals L R0 and R R0 are derived from stereo signals, ie from the input signals L and R. For each of the signals, the respective other signals are subtracted from the signals L, R, L + R and LR with a weighting. In the context of this previously known method for multichannel sound processing, frequency-dependent weighting factors are derived in addition to the level ratio calculations. In this case, the center signal C is varied only in the level, whereas the two surround signals L R0 and R R0 are derived in two frequency bands and phase-inverted.
Die beschriebenen Verfahren zur Mehrkanalbearbeitung in einem Mehrkanaltonsystem sind hauptsächlich für die Verarbeitung von Kinoton-Signalen entwickelt worden. Hierbei ist es wichtig gewesen, dynamisch auftretende Richtungen von Signalen, zumeist in Form von Sprach- und Effektsignalen, räumlich über mehrere Lautsprecher richtungsadäquat wiederzugeben. Die dynamische Ansteuerung dieser Mehrkanalsignale unterstützt die Richtungswahrnehmung bei derartigen Signalarten. Demgegenüber ist jedoch die Richtungsinformation in musikalischen Stereo-Aufnahmen zu einem hohen Prozentsatz nicht dynamisch, sondern eher statisch und ändert sich bei speziellen Raumeffekten eher geringfügig . Akustische Un tersuchungen im Rahmen des in der Druckschrift US 2004/0125960 AI offenbarte Verfahrens zeigen ein minimales Steuern der Richtungsinformationen, da dominan te Richtungen innerhalb eines Stereo-Mixes selten auftreten. Diese zeitvariante Mehrkanal-Steuerung sorgt für eine räumliche Verschiebung des Signales, wenn anschließend wieder eine Stereo-Encodierung vorgenommen wird. The described methods for multi-channel processing in a multi-channel sound system have been developed mainly for the processing of Kinoton signals. In this case, it has been important to reproduce directions of signals which occur dynamically, in the form of speech and effect signals, spatially over several loudspeakers in a directionally adequate manner. The dynamic control of these multi-channel signals supports the direction perception in such types of signals. In contrast, however, the directional information in musical stereo recordings is not dynamic to a high percentage, but rather static, and tends to change slightly with special spatial effects. Acoustic investigations in the context of the method disclosed in US 2004/0125960 A1 show minimal control of the direction information, since dominant directions within a stereo mix seldom occur. This time-variant multichannel control ensures a spatial shift of the signal when subsequently a stereo encoding is performed again.
Wesentlich entscheidender für eine räumliche Auflösungsverbesserung von Stereo Signalen ist dagegen eine Extraktion von Richtungssignalanteilen und deren Ge- wichtung durch statische oder frequenzabhängige Gewichtung . Von daher stellt die Druckschrift WO 2010/015275 AI einen wesentlichen Fortschritt des Verfahrens der eingangs genannten Art dar, da hier die Zerlegung von Stereo-Signalen in Raumanteile erfolgt, um diese mit unterschiedlichen Pegelstellern zu bewerten. Danach werden die bewerteten Raumsignale wieder zu einem Stereo-Signal zusammengesetzt. Aufgrund der Gewichtung der Raumsignalanteile erfährt das Stereo-Signal eine Verbesserung der räumlichen Wiedergabe. Much more decisive for a spatial resolution improvement of stereo signals, however, is an extraction of directional signal components and their weighting by static or frequency-dependent weighting. Therefore, the publication WO 2010/015275 AI represents a significant advance of the method of the type mentioned, since here the decomposition of stereo signals in spatial proportions takes place in order to evaluate them with different level controls. Thereafter, the valued spatial signals are reassembled into a stereo signal. Due to the weighting of the spatial signal components, the stereo signal experiences an improvement of the spatial reproduction.
Es ist deshalb Aufgabe der Erfindung, ein Verfahren der eingangs genannten Art derart weiterzuentwickeln, dass auf Grundlage einer Extraktion von Richtungssignalanteilen eine weitere Verbesserung der räumlichen Wiedergabe der Eingangssignale L und R erzielt wird . It is therefore an object of the invention to further develop a method of the type mentioned above, that on the basis of an extraction of directional signal components, a further improvement of the spatial reproduction of the input signals L and R is achieved.
Diese Aufgabe wird mit den Merkmalen des Anspruches 1 gelöst. Vorteilhafte Ausgestaltungen der Erfindung ergeben sich aus den Unteransprüchen. This object is achieved with the features of claim 1. Advantageous embodiments of the invention will become apparent from the dependent claims.
Gemäß der Erfindung werden R und L mindestens in zwei Signale der Form nL-mR mit n, m = 1, 2, 3, 4 decodiert. Hierdurch wird vorteilhafterweise eine Verbesserung der räumlichen Wiedergabe und Transparenz der Eingangs-Signale L und R erzielt. Hierzu werden bei der Decodierung vorzugsweise die Signale L-R (das heißt mit n,m = l) und 2L-R (das heißt mit n = 2 und m= l) gebildet. According to the invention, R and L are decoded into at least two signals of the form nL-mR with n, m = 1, 2, 3, 4. As a result, an improvement of the spatial reproduction and transparency of the input signals L and R is advantageously achieved. For this purpose, in the decoding preferably the signals L-R (that is, with n, m = l) and 2L-R (that is, with n = 2 and m = l) are formed.
Vorzugsweise werden die Signale L und R in ein Raumsignal R und in ein Center- Signal decodiert. Das Raumsignal wird dabei aus der Differenz der Signale L und R (RL) und/oder aus der Differenz der Signale R und L (RR) gebildet. Preferably, the signals L and R are decoded into a space signal R and into a center signal. The space signal is formed from the difference between the signals L and R (R L ) and / or the difference between the signals R and L (R R ).
Entgegen den herkömmlichen Verfahren, die eine Zerlegung der Signale L und R in die Front-Signale Lfr0nt und Rfr0nt, das Center-Signal C und die Surround-Signale SL und SR vorsehen, wird durch das erfindungsgemäße Verfahren eine Raum- und Stereo-Erweiterung eines Stereo-Signales durch eine Erweiterung der Stereo-Zerlegung erreicht. Hierzu werden die Raum-Signale RL=L-R und RR=R-L zusätzlich aus den Eingangskanälen R und L gerechnet. Diese Eigenschaften sind bei den folgenden Systemen verifiziert: Contrary to the conventional methods, which provide for a decomposition of the signals L and R into the front signals L fr0 nt and R fr0 nt, the center signal C and the surround signals S L and S R , a space is created by the method according to the invention - And stereo extension of a stereo signal achieved by an expansion of the stereo decomposition. For this purpose, the space signals R L = LR and R R = RL are additionally calculated from the input channels R and L. These properties are verified on the following systems:
- MS40 Behringer-Monitor-Lautsprecher - MS40 Behringer monitor speakers
- Notebook Toshiba  - Notebook Toshiba
- IMAC27 Rechner  - IMAC27 calculator
- Mobiltelefon LG GM205 mit DolbyMobile  - LG GM205 mobile phone with DolbyMobile
- Philips Flatscreen-Fernseher 42PFL9703D mit BBE Surround  - Philips Flatscreen TV 42PFL9703D with BBE Surround
- Dockingstation JBL On Stage 400p.  - Docking station JBL On Stage 400p.
Vergleiche zu DolbyMobile, Virtual Dolby Surround und anderen Stereo- Spatializern zeigen, dass das erfindungsgemäße Verfahren eine wesentlich neutralere Verbesserung des Stereo-Klangbildes erzeugt. Comparisons to Dolby Mobile, Virtual Dolby Surround and other stereo spatializers show that the inventive method produces a much more neutral enhancement of the stereo sound image.
Im Rahmen von psychoakustischen Untersuchungen hat sich zudem die Ableitung der Surround-Signale aus der Differenz L-R als weiterer wichtiger Schritt für eine verbesserte Stereo- und Raumaufweitung erwiesen. Hierbei hat sich wiederum nach intensivem Hörtest das Verhältnis der Surround-Signale SL=2L-R und In the context of psychoacoustic examinations, the derivation of the surround signals from the difference LR has proven to be another important step for improved stereo and spatial expansion. Once again after intensive listening test, the ratio of the surround signals S L = 2L-R and
SR=2R-L als günstig herausgestellt. Eine vorteilhafte Ausgestaltung der Erfindung sieht daher vor, dass das Surround-Signal SL=2L-R und das Surround-Signal SR aus der Differenz SR=2R-L gebildet werden. S R = 2R-L proved to be favorable. An advantageous embodiment of the invention therefore provides that the surround signal S L = 2L-R and the surround signal S R are formed from the difference S R = 2R-L.
Von Vorteil ist dabei eine frequenzabhängige Gewichtung der Surround-Signale. Zweckmäßigerweise erfolgt daher eine frequenzabhängige Gewichtung der Signale SL und SR. Die frequenzabhängige Gewichtung erfolgt vorzugsweise mittels eines Höhenshelving- Filters. The advantage here is a frequency-dependent weighting of the surround signals. Appropriately, therefore, a frequency-dependent weighting of the signals S L and S R takes place . The frequency-dependent weighting is preferably carried out by means of a height-helving filter.
Zweckmäßigerweise werden zu den Signalen LP und RP die Signale L und R addiert. The signals L and R are expediently added to the signals L P and R P.
Ein Audiosystem zur Durchführung des Verfahrens ist Gegenstand von Anspruch 13, wobei das Audiosystem einen Signalprozessor, vorzugsweise in Form eines Audioprozessors, aufweist. Im Rahmen der Erfindung ist auch eine Software vorgesehen, die sich auf einem Signalprozessor befindet, d .h. auf den Signalprozessor importiert ist. Die Software enthält dabei einen Algorithmus, der von dem Signalprozessor abgearbeitet wird, wobei der Algorithmus das Verfahren erfasst. An audio system for carrying out the method is the subject matter of claim 13, wherein the audio system comprises a signal processor, preferably in the form of an audio processor. In the context of the invention, a software is provided which is located on a signal processor, ie. is imported to the signal processor. The software contains an algorithm which is processed by the signal processor, the algorithm detecting the method.
Zudem erfasst die Erfindung einen Signalprozessor zur Durchführung des Verfahrens. In addition, the invention covers a signal processor for carrying out the method.
Im Folgenden wird die Erfindung anhand der Zeichnung näher erläutert. Es zeigt in schematischer Darstellung : In the following the invention will be explained in more detail with reference to the drawing. It shows in a schematic representation:
Fig . 1 ein Verfahren gemäß der Erfindung. Fig. 1 a method according to the invention.
Fig . 1 zeigt das erfindungsgemäße Verfahren, welches vier Verfahrensabschnitte A, B, C, D aufweist. Im Einzelnen handelt es sich bei den Verfahrensabschnitten um Fig. 1 shows the method according to the invention, which has four method sections A, B, C, D. In detail, the procedural sections are:
- die Decodierung (Verfahrensabschnitt A), the decoding (method section A),
- die Verarbeitung der decodierten Signale (Verfahrensabschnitt B),  the processing of the decoded signals (method section B),
- die Encodierung (Verfahrensabschnitt C),  the encoding (method section C),
- die Verarbeitung der encodierten Signale (Verfahrensabschnitt D).  - The processing of the encoded signals (method section D).
Das Verfahren beginnt damit, dass im Rahmen der Decodierung die Eingangs- Signale L und R, die als Stereo-Signale vorliegen, in drei Sinaianteile zerlegt werden, wobei die Signale L und R erhalten bleiben können. Bei den Signalanteilen handelt es sich um das Center-Signal C, das Raumsignal R sowie die Sur- round-Signale SL und SR. Das Center-Signal C ist dabei einkanalig, d .h. es enthält nur den Kanal C, wohingegen das Raum-Signal R und das Surround-Signal S zweikanalig sind, d.h. sie enthalten die Signale RL und RR bzw. SL und SR. Die Surround- und Raum-Signale SL, SR sowie RL und RR enthalten dabei die Richtung und Rauminformation der Stereo-Signale L und R. In Verfahrensabschnitt A werden die Signale, d . h . The method begins with the fact that, as part of the decoding, the input signals L and R, which are present as stereo signals, are split into three sine parts, whereby the signals L and R can be retained. The signal components are the center signal C, the room signal R and the surround signals S L and S R. The center signal C is single-channel, ie. it contains only the channel C, whereas the space signal R and the surround signal S are two-channel, ie they contain the signals R L and R R and S L and S R, respectively. The surround and space signals S L , S R and R L and R R contain the direction and spatial information of the stereo signals L and R. In method section A, the signals, i. H .
- der einkanalige Center-Signal C= L+ R, auch Mono-Signal genannt, the single-channel center signal C = L + R, also called mono-signal,
- der Stereo-Anteil RL= L-R und RR= R-L des zweikanaligen Raum-Signales R sowie - The stereo portion R L = LR and R R = RL of the two-channel room signal R and
- die beiden zweikanaligen Surround-Kanäle SL=2L-R und SR=2R-L, aus den Stereo-Signalen R und L in fünf parallelen Stufen decodiert. - The two two-channel surround channels S L = 2L-R and S R = 2R-L, decoded from the stereo signals R and L in five parallel stages.
Dem Verfahrensabschnitt A schließt sich der Verfahrensabschnitt B an, in dem die Verarbeitung der Kanäle C, RL, RR, SL und SR erfolgt. Um die Lautstärke des Center-Signales C und des Raum-Signales RL= L-R und RR= R-L einzustellen, werden diese Signale durch erste Pegelsteller 1, 2 mit einer Pegelgewichtung versehen, die sich in dem Faktor 1,5 manifestiert. Nach dieser ersten Pegelgewichtung erfolgt durch die weiteren Pegelsteller 3, 4 eine weitere variable Pegelgewichtung, die die Klangcharakteristika der decodierten Signale zu L, R gewichten . The process section A is followed by the process section B, in which the processing of the channels C, R L , RR, S L and S R takes place. To adjust the volume of the center signal C and the space signal R L = LR and R R = RL, these signals are provided by first level control 1, 2 with a level weighting, which manifests itself in the factor 1.5. After this first level weighting, the further level controls 3, 4 provide a further variable level weighting, which weights the sound characteristics of the decoded signals to L, R.
Die beiden Surround-Signale SL=2L-R und SR=2R-L werden dagegen Höhen- shelving-Filtern 5, 6 zugeführt, durch die der Frequenzgang der Surround-Signale SL und SR eingestellt werden . Es findet also eine frequenzabhängige Gewichtung der Signale SL und SR statt, wobei die Filter 5, 6 eine minimale Phasenverschiebung im Frequenzbereich um vorzugsweise 2 kHz aufweisen, so dass Auslöschungseffekte bei der in Verfahrensabschnitt C stattfindenden Encodierung minimiert werden, gleichzeitig der eigentliche Verstärkungseffekt jedoch betont wird und zwar mit einem Höhenshelving-Frequenzgang um beispielsweise 3 d B bei vorzugsweise 2KHZ. Danach werden die Surround-Signale SL, SR den Pegelstellern 7, 8 zugeführt, die die Klangcharakteristika der decodierten Signale zu S|_, SR gewichten . The two surround signals S L = 2L-R and S R = 2R-L, on the other hand, are supplied to shelving filters 5, 6, by means of which the frequency response of the surround signals S L and S R are set. Thus, there is a frequency-dependent weighting of the signals S L and S R , wherein the filters 5, 6 have a minimal phase shift in the frequency range of preferably 2 kHz, so that extinction effects are minimized in the taking place in process section C encoding, at the same time the actual gain effect is emphasized with a height helving frequency response by, for example, 3 d B at preferably 2KHZ. Thereafter, the surround signals S L , S R are supplied to the level selectors 7, 8 which weight the sound characteristics of the decoded signals to S | _, SR.
Bei der Encodierung, d .h . in dem Verfahrensabschnitt C, ergeben sich somit nach Summation, die schon in dem Verfahrensschritt A gegeben ist, der Signale C, RL, RR, SL, Sr in der Form : In the encoding, d .h. in the process section C, thus arise after summation, already given in method step A, of the signals C, R L , RR, S L , S r in the form:
LP = C+RL+SL = (L+R) + (L-R) + (2L-R) = 4L-R L P = C + R L + S L = (L + R) + (LR) + (2L-R) = 4L-R
RP = C+ RR + SR = (L+R) + (R-L) + (2R-L) = 4R-L die encodierten Stereosignale LP, RP gemäß R P = C + RR + S R = (L + R) + (RL) + (2R-L) = 4R-L the encoded stereo signals L P , R P according to
LP = Vc C + VR RL + Vs SL = Vc (L+ R) + VR (L-R) + Vs (2L-R) L P = V c C + V R R L + V s S L = V c (L + R) + V R (LR) + V s (2L-R)
RP = Vc C + VR Rr + Vs SR = Vc (L+R) + VR (R-L) + Vs (2R-L) bzw. nach Filterung der Surround-Signale SL, SR R P = V c C + V R R r + V s S R = V c (L + R) + V R ( R L) + V s (2R-L) or after filtering the surround signals S L , S R
LP = Vc C + VR Rl + Vs (SL) Filtered — Vc (L+ R) + VR (L-R) + Vs (2L-R) Filtered L P = V c C + V R R l + V s (S L ) Filtered - V c (L + R) + V R (LR) + V s (2L-R) Filtered
RP = Vc C + VR RR + Vs (SR)Fi|tered = Vc (L+R) + VR (R"L) + Vs (2R-L)Fi|tered R P = V c C + V R RR + V s (S R ) Fi | ered t = V c (L + R) + VR (R 'L) + V s (2R-L) Fi | tered
In dem letzten Verfahrensabschnitt D erfahren die encodierten gewichteten Signale LP, RP eine Nachbearbeitung durch Stereo-Equalizer 9, 10. Zur weitere Anreicherung des Klangbildes wird eine spezielle nichtlineare Kennlinie NL verwendet. Diese nichtlineare Kennlinie bildet eine Eingangsamplitude x auf eine Ausgangsamplitude y ab. Die eingesetzte, nicht lineare Kennlinie y=f(x) lautet y=tanh(( l/7.522*atan(7.522*x) .*(sign(x) + l)J2. +x*(sign(-x) + l) ./2)/0.5)*0.5 In the last method section D, the encoded weighted signals L P , R P undergo post-processing by stereo equalizers 9, 10. For further enrichment of the sound image, a special non-linear characteristic NL is used. This non-linear characteristic maps an input amplitude x to an output amplitude y. The used, non-linear characteristic y = f (x) is y = tanh ((l / 7.522 * atan (7.522 * x). * (Sign (x) + 1) J2. + X * (sign (-x) + l) ./2 )/0.5)*0.5
Durch diese Kennlinie werden dem Direkt-Musiksignal harmonische Obertöne hinzugefügt. Schließlich erfahren die Signale LP, RP eine weitere Nachverarbeitung in dem Verfahrensabschnitt D derart, dass die Pegelsteller 11, 12 den Grad der Obertonzumischung zum Direktsignal bestimmen . Eine weitere Bearbeitung erfolgt schließlich durch die Pegelsteller 13, 14, die den Gesamtpegel des Verfahrensergebnisses regelbar machen . This characteristic adds harmonic overtones to the direct music signal. Finally, the signals L P , R P undergo further post-processing in the method section D such that the level adjusters 11, 12 determine the degree of overtone mixing to the direct signal. Further processing is finally carried out by the level control 13, 14, which make the overall level of the process result adjustable.
Die vorliegende Erfindung beschränkt sich in ihrer Ausführung nicht auf das vor- stehend angegebene Ausführungsbeispiel . Vielmehr ist eine Anzahl von Varianten denkbar, welche von der dargestellten Lösung auch bei anders gearteten Ausführungen Gebrauch machen. Beispielsweise können im Rahmen des Verfahrensabschnittes D Maximizer, d .h. Kompressoren/Limiter Anwendung finden, um das Klangbild weiter anzureichern. The present invention is not limited in its execution to the standing specified embodiment. Rather, a number of variants is conceivable, which make use of the solution shown in other types. For example, within the scope of the method section D Maximizer, i. Compressors / Limiter find application to further enrich the sound.
Bezuaszeichenliste: Bezuaszeichenliste:
I, 2 erste Pegelsteller 3, 4 weitere Pegelsteller 5, 6 Höhenshelving-Filter 7, 8 Pegelsteller I, 2 first level adjuster 3, 4 further level adjuster 5, 6 height-helving filters 7, 8 level adjuster
9, 10 Stereo-Equalizer 9, 10 stereo equalizer
I I, 12, I, 12,
13, 14 weitere Komponenten  13, 14 other components

Claims

Patentansprüche: claims:
1. Verfahren zur Mehrkanaltonbearbeitung in einem Mehrkanaltonsystem, bei dem die Eingangssignale L und R, vorzugsweise als Stereo-Signale, decodiert werden, dadurch gekennzeichnet, 1. A method for multi-channel sound processing in a multi-channel sound system in which the input signals L and R, preferably as stereo signals, are decoded, characterized
dass die Signale R und L mindestens in zwei Signale der Form n L-mR mit n, m =that the signals R and L at least in two signals of the form n L-mR with n, m =
1. 2, 3, 4 decodiert werden . 1. 2, 3, 4 are decoded.
2. Verfahren nach Anspruch 1, 2. The method according to claim 1,
dadurch gekennzeichnet, characterized,
dass die Signale L und R in ein Raumsignal R und in ein Center-Signal decodiert werden, wobei ein Raumsignal RL aus der Differenz der Signale L und R und/oder ein Raumsignal RR aus der Differenz der Signale R und L gebildet wird . that the signals L and R are decoded in a space signal R and a center signal, a surround signal R L from the difference of the signals L and R and / or a surround signal R R from the difference of the signals R and L is formed.
3. Verfahren nach Anspruch 1 oder 2, 3. The method according to claim 1 or 2,
dadurch gekennzeichnet, characterized,
dass ein Surround-Signal SL aus der Differenz SL = 2L-R und ein Surround-Signal SR aus der Differenz SR = 2R-L gebildet werden . a surround signal S L from the difference S L = 2L-R and a surround signal S R from the difference S R = 2R-L are formed.
4. Verfahren nach einem der Ansprüche 2 bis 3, 4. The method according to any one of claims 2 to 3,
dadurch gekennzeichnet, characterized,
dass eine Encodierung zu Signalen LP, RP in der Form that an encoding to signals L P , R P in the form
LP = C+RL+SL = (L+R) + (L-R) + (2L-R) = 4L-R und L P = C + R L + S L = (L + R) + (LR) + (2L-R) = 4L-R and
RP = C+ RR + SR = (L+R) + (R-L) + (2R-L) = 4R-L erfolgt. R P = C + RR + S R = (L + R) + (RL) + (2R-L) = 4R-L.
5. Verfahren nach einem der Ansprüche 3 bis 4, 5. The method according to any one of claims 3 to 4,
dadurch gekennzeichnet, characterized,
dass die Signale RL, RR, C, SL und SR eine Pegelgewichtung Vc, VR, Vs erhalten . the signals R L , R R , C, S L and S R receive a level weighting V c , V R , V s .
6. Verfahren nach Anspruch 4, 6. The method according to claim 4,
dadurch gekennzeichnet, characterized,
dass eine Encodierung zu Signalen LP, RP in der Form that an encoding to signals L P , R P in the form
LP = Vc C + VR Rl + Vs SL = Vc (L+ R) + VR (L-R) + Vs (2L-R) sowie L P = V c C + V R R l + V s S L = V c (L + R) + V R (LR) + V s (2L-R) and
RP = Vc C + VR Rr + Vs SR = Vc ( L+ R) + VR ( R-L) + Vs (2R-L) erfolgt. R P = V c C + V R R r + V s S R = V c (L + R) + V R ( R L) + V s (2R-L).
7. Verfahren nach einem der Ansprüche 3 bis 6, 7. The method according to any one of claims 3 to 6,
dadurch gekennzeichnet, characterized,
dass eine frequenzabhängige Gewichtung der Signale SL und SR erfolgt. that a frequency-dependent weighting of the signals S L and S R takes place.
8. Verfahren nach Anspruch 7, 8. The method according to claim 7,
dadurch gekennzeichnet, characterized,
dass die frequenzabhängige Gewichtung mittels eines Höhenshelving-Filters (5,6) erfolgt. the frequency-dependent weighting takes place by means of a height-helving filter (5, 6).
9. Verfahren nach einem der Ansprüche 4 bis 7, 9. The method according to any one of claims 4 to 7,
dadurch gekennzeichnet, characterized,
dass die Signale LP, RP mittels eines Equalizers (9,10) gefiltert werden. the signals L P , R P are filtered by means of an equalizer (9, 10).
10. Verfahren nach einem der Ansprüche 4 bis 8, 10. The method according to any one of claims 4 to 8,
dadurch gekennzeichnet, characterized,
dass den Signalen LP, RP harmonische Obertöne hinzugefügt werden. that harmonic overtones are added to the signals L P , R P.
11. Verfahren nach Anspruch 10, 11. The method according to claim 10,
dadurch gekennzeichnet, characterized,
dass das Hinzufügen der harmonischen Obertöne mittels eines Maximizers oder einer nichtlinearen Kennlinie N L erfolgt. the addition of the harmonic overtones takes place by means of a maximizer or a nonlinear characteristic N L.
12. Verfahren nach einem der Ansprüche 3 bis 11, 12. The method according to any one of claims 3 to 11,
dadurch gekennzeichnet, characterized,
dass zu den Signalen LP und RP die Signale L und R addiert werden. in that the signals L and R are added to the signals L P and R P.
13. Audiosystem zur Durchführung des Verfahrens gemäß einem der Ansprüche 1 bis 12, 13. audio system for carrying out the method according to one of claims 1 to 12,
dadurch gekennzeichnet, characterized,
dass es einen Signalprozessor aufweist. that it has a signal processor.
14. Software, die auf einen Signalprozessor importiert ist, 14. software imported on a signal processor,
dadurch gekennzeichnet, characterized,
dass die Software einen Algorithmus enthält, der von dem Signalprozessor abgearbeitet wird, wobei der Algorithmus das Verfahren gemäß einem der Ansprüche 1 bis 12 erfasst. in that the software contains an algorithm which is executed by the signal processor, the algorithm detecting the method according to one of claims 1 to 12.
15. Signalprozessor zur Durchführung des Verfahrens gemäß einem der 15. Signal processor for carrying out the method according to one of
Ansprüche 1 bis 12. Claims 1 to 12.
EP13705936.6A 2013-02-04 2013-02-04 Method for processing a multichannel sound in a multichannel sound system Active EP2952016B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2013/052127 WO2014117867A1 (en) 2013-02-04 2013-02-04 Method for processing a multichannel sound in a multichannel sound system

Publications (2)

Publication Number Publication Date
EP2952016A1 true EP2952016A1 (en) 2015-12-09
EP2952016B1 EP2952016B1 (en) 2018-09-26

Family

ID=47749772

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13705936.6A Active EP2952016B1 (en) 2013-02-04 2013-02-04 Method for processing a multichannel sound in a multichannel sound system

Country Status (7)

Country Link
US (1) US9628932B2 (en)
EP (1) EP2952016B1 (en)
JP (1) JP6438892B2 (en)
KR (1) KR102089821B1 (en)
CN (1) CN104969575B (en)
SG (1) SG11201506075UA (en)
WO (1) WO2014117867A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9380383B2 (en) 2013-09-06 2016-06-28 Gracenote, Inc. Modifying playback of content using pre-processed profile information
CN110719563B (en) * 2018-07-13 2021-04-13 海信视像科技股份有限公司 Method for adjusting stereo sound image and circuit for acquiring stereo sound image

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5248001B2 (en) * 1973-08-20 1977-12-07
US5046098A (en) 1985-03-07 1991-09-03 Dolby Laboratories Licensing Corporation Variable matrix decoder with three output channels
JPS62146000A (en) * 1985-12-20 1987-06-30 Sony Corp Sound field extending signal generating circuit
JPH05316600A (en) * 1992-05-12 1993-11-26 Nec Corp Surround circuit
US5771295A (en) * 1995-12-26 1998-06-23 Rocktron Corporation 5-2-5 matrix system
US6697491B1 (en) 1996-07-19 2004-02-24 Harman International Industries, Incorporated 5-2-5 matrix encoder and decoder system
US5970153A (en) 1997-05-16 1999-10-19 Harman Motive, Inc. Stereo spatial enhancement system
JP4627880B2 (en) 1997-09-16 2011-02-09 ドルビー ラボラトリーズ ライセンシング コーポレイション Using filter effects in stereo headphone devices to enhance the spatial spread of sound sources around the listener
US7035413B1 (en) * 2000-04-06 2006-04-25 James K. Waller, Jr. Dynamic spectral matrix surround system
JP4624643B2 (en) 2000-08-31 2011-02-02 ドルビー・ラボラトリーズ・ライセンシング・コーポレーション Method for audio matrix decoding apparatus
JP2003333699A (en) * 2002-05-10 2003-11-21 Pioneer Electronic Corp Matrix surround decoding apparatus
JP4580210B2 (en) * 2004-10-19 2010-11-10 ソニー株式会社 Audio signal processing apparatus and audio signal processing method
JP2007311965A (en) * 2006-05-17 2007-11-29 Pioneer Electronic Corp Digital audio signal processor
DE102008036924B4 (en) 2008-08-08 2011-04-21 Gunnar Kron Method for multi-channel processing in a multi-channel sound system
US8867749B2 (en) * 2011-04-18 2014-10-21 Paul Blair McGowan Acoustic spatial projector

Also Published As

Publication number Publication date
EP2952016B1 (en) 2018-09-26
KR102089821B1 (en) 2020-03-17
CN104969575B (en) 2018-03-23
US20150382125A1 (en) 2015-12-31
US9628932B2 (en) 2017-04-18
SG11201506075UA (en) 2015-09-29
WO2014117867A1 (en) 2014-08-07
JP2016509427A (en) 2016-03-24
JP6438892B2 (en) 2018-12-19
KR20150114508A (en) 2015-10-12
CN104969575A (en) 2015-10-07

Similar Documents

Publication Publication Date Title
DE69210689T2 (en) ENCODER / DECODER FOR MULTI-DIMENSIONAL SOUND FIELDS
DE69827775T2 (en) TONKANALSMISCHUNG
DE19715498B4 (en) Stereo sound image enhancement apparatus and methods using tables
DE112012006457B4 (en) Frequency characteristic modification device
EP2206113A1 (en) Device and method for generating a multi-channel signal using voice signal processing
DE102006053919A1 (en) Apparatus and method for generating a number of speaker signals for a speaker array defining a playback space
DE112007003683B4 (en) Echo cancellation system, echo cancellation method, sound output device, audio system, navigation system and mobile object
EP2939445B1 (en) Production of 3d audio signals
DE102009052992B3 (en) Method for mixing microphone signals of a multi-microphone sound recording
DE102008056704B4 (en) Method for generating a backwards compatible sound format
EP0825800A2 (en) Method and apparatus for generating multi-audio signals from a mono audio signal
EP2952016B1 (en) Method for processing a multichannel sound in a multichannel sound system
DE10148351A1 (en) Method and device for selecting a sound algorithm
DE19645867A1 (en) Multiple channel sound transmission method
DE2209424B2 (en) CODING MATRIX FOR CODING FOUR SIGNALS IN TWO SIGNAL MIXTURES
DE102012025016B3 (en) Method for determining at least two individual signals from at least two output signals
EP0776144B1 (en) Signal modification circuit
DE102010015630B3 (en) Method for generating a backwards compatible sound format
DE2649525A1 (en) SOUND PLAYBACK SYSTEM
DE112011105624T5 (en) Control device for dynamic range
WO2015128376A1 (en) Autonomous residual determination and yield of low-residual additional signals
DE2252132C3 (en) Decoder for a 4-2-4 matrix system
DE756615C (en) Stereophonic transmission of sound vibrations
DE69405409T2 (en) IMPROVEMENT AT THE INTERFACE AMPLIFIER SPEAKER BOX
DE102019126509A1 (en) IMPROVING THE SUBJECTIVE BASS PERCEPTION OF AN AUDIO SIGNAL WITH THE HELP OF HIGHER HARMONICS

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20150903

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20160909

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: KRONOTON GMBH

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20171201

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1047474

Country of ref document: AT

Kind code of ref document: T

Effective date: 20181015

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502013011168

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20180926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181226

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20181227

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190126

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190126

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502013011168

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20190627

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190204

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190228

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190228

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 1047474

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20130204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180926

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 502013011168

Country of ref document: DE

Representative=s name: MEISSNER BOLTE PATENTANWAELTE RECHTSANWAELTE P, DE

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CZ

Payment date: 20230227

Year of fee payment: 12

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230608

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240227

Year of fee payment: 12

Ref country code: GB

Payment date: 20240222

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240221

Year of fee payment: 12