EP2245622A1 - Procédés et moyens pour décoder des informations de bruit de fond - Google Patents

Procédés et moyens pour décoder des informations de bruit de fond

Info

Publication number
EP2245622A1
EP2245622A1 EP09712583A EP09712583A EP2245622A1 EP 2245622 A1 EP2245622 A1 EP 2245622A1 EP 09712583 A EP09712583 A EP 09712583A EP 09712583 A EP09712583 A EP 09712583A EP 2245622 A1 EP2245622 A1 EP 2245622A1
Authority
EP
European Patent Office
Prior art keywords
time
entering
phase
broadband
decoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP09712583A
Other languages
German (de)
English (en)
Other versions
EP2245622B1 (fr
Inventor
Panji Setiawan
Stefan Schandl
Herve Taddei
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Unify GmbH and Co KG
Original Assignee
Siemens Enterprise Communications GmbH and Co KG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Enterprise Communications GmbH and Co KG filed Critical Siemens Enterprise Communications GmbH and Co KG
Publication of EP2245622A1 publication Critical patent/EP2245622A1/fr
Application granted granted Critical
Publication of EP2245622B1 publication Critical patent/EP2245622B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/012—Comfort noise or silence coding
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding

Definitions

  • the invention relates to methods and means for decoding background noise information in speech signal coding methods.
  • Such a limited frequency range is also provided in many speech signal coding methods for today's digital telecommunications.
  • a bandwidth limitation of the analog signal Prior to a coding process, a bandwidth limitation of the analog signal is performed for this purpose.
  • a codec is used which, due to the described bandwidth limitation in the frequency range between 300 Hz and 3400 Hz, is also referred to below as narrow-band speech codec (Narrow Band Speech Codec).
  • the term codec is understood to mean both the coding rule for the digital coding of audio signals and the decoding rule for the decoding of data with the aim of reconstructing the audio signal.
  • a narrowband speech codec is known from ITU-T Recommendation G.729.
  • a transmission of a narrow-band voice signal with a data rate of 8 kbit / s is provided.
  • Band Speech Codec are known, which provide a coding of one in an extended frequency range to improve the Hor- impressive. Such an extended frequency range lies for example between a frequency of 50 Hz and 7000 Hz.
  • a broadband voice codec is for example from the ITU-T Recommendation G.729. EV known.
  • Speech codecs made scalable.
  • Scalability means that the transmitted coded data contain various demarcated blocks which contain the narrowband component, the broadband component and / or the full bandwidth of the coded voice signal.
  • such a scalable design allows for backwards compatibility on the receiver side and, on the other hand, offers a simple possibility of adapting the data rate and the size of transmitted data frames in the transmission channel in the case of limited data transmission capacities.
  • a compression of the data to be transmitted is provided. Compression is achieved, for example, by coding methods, in which parameters for an excitation signal and filter parameters are determined for coding the speech data. The filter parameters and parameters specifying the excitation signal are then transmitted to the receiver. There, a synthetic speech signal is synthesized using the codec, which is as similar as possible to the original speech signal with regard to a subjective impression of hearing. With the aid of this method, also known as "analysis-by-synthesis", the determined and digitized samples (samples) are not transmitted themselves but determined parameters which enable a receiver-side synthesis of the speech signal.
  • a further measure for reducing the data transmission rate is provided by a method for discontinuous transmission (Discontinuous Transmission), which is also known in the art as DTX.
  • the fundamental goal DTX is a reduction in the data transfer rate in the event of a speech break.
  • a voice pause detection (VAD) is used on the transmitter side, which detects a pause in speech when the signal falls below a certain signal level.
  • VAD voice pause detection
  • Comfort noise is noise that is synthesized to fill silence phases on the receiver's side.
  • the comfort noise serves as a subjective impression of a continuing connection, without claiming the data transmission rate intended for the transmission of speech signals. In other words, less effort is required to code the speech data for the transmitter-side coding of the noise. For a receiver-side still perceived as realistic synthesis - i.
  • Decoding - Comfort noise transmits data at a much lower data rate.
  • the data transmitted here are also referred to in the professional world as the SID (Meaning Insertion Description).
  • the aforementioned scalable wideband speech codecs usually support different data transmission rates in a bandwidth range of 50 to 7000 Hz.
  • Possible data rates for encoding the voice information include 8, 12, 14, 16, ..., 32 kbit / s, which are used, for example, in the G.729.1 standard.
  • the data rates of 8 and 12 kbit / s are applied to narrowband signals (50Hz to 4kHz). Data rates greater than 12 kbit / s are applied to the upper frequency band of 4 to 7 kHz.
  • a sudden change from a narrowband to a broadband data rate is known to cause a disturbing effect on a human recipient.
  • Such a transition occurs, for example, as a result of a truncation of the data stream (bitstream transformation), which is caused, for example, by the transmission network between transmitter and receiver, for example as a result of the establishment of further additional connections or due to a congestion in the transmission network.
  • the said clipping leads to a change in the data rate and finally to a transition from a broadband to a narrowband transmission of the speech signal.
  • a saving of the data transmission rate for the transmission of the respective data frames is possible.
  • the DTX method is used exactly when a corresponding frame is characterized as a speech break.
  • a reduced data transmission rate on transmitted frames is achieved due to two factors. First, the encoder does not need to send all inactive frames to the decoder. Second, a transmitted SID frame occupies much fewer bits than a voice data frame.
  • VAD Paging detection
  • the encoder then sends a specially marked frame, a Silence Insertion Descriptor (SID) frame, to the decoder.
  • SID Silence Insertion Descriptor
  • the decoder synthesizes comfort noise based on the information contained in a SID frame, and the decoder can determine, based on the SID frame, whether the contained noise information is narrowband or broadband information.
  • bit rate switching Changing the bit rate (bit rate switching) between narrowband and wideband information is a common scenario for any scalable wideband speech codec.
  • a treatment of a data rate change during a normal speech phase i. in the absence of pauses in speech, although adequately described in the literature, a treatment on entry into a DTX phase is currently still unknown.
  • the active speech frames are narrow-band decoded and the background noise is played back in pauses in broadband.
  • the object of the invention is to specify a method for changing a data rate of SID frames during a speech pause, which results in an improved quality of the signal synthesized on the decoder.
  • a basic idea of the invention is a determination of information about the course of the bandwidth switchover
  • information about the percentage of broadband active speech frames in comparison to narrowband active speech frames is collected on the decoder side during the speech phase.
  • information on the nature of the background noise is not collected until the time of a change to a speech break, as has hitherto been suggested by the prior art.
  • a high percentage of broadband active speech frames indicates that the codec prefers broadband use and therefore there is a need to broadly synthesize noise information during a DTX phase, i. to decode.
  • narrow-band noise is generated on the decoder's side when entering a DTX phase, even if the received SID frames require a synthesizer - i. Decoding - would allow a broadband noise.
  • the object of the invention to provide a method for changing a data rate of SID frames during a speech break more than solved.
  • the change to be made between noise information with different data rate according to the object is refined according to the inventive solution presented here into a determination of a proportion of noise information with different data rates.
  • the proportion is adjustable in contrast to a change in any ratio between noise information with different data rate.
  • the method according to the invention thus achieves the object of the invention to achieve an improved quality of the signal synthesized on the decoder.
  • a decision is made that a noise signal having a certain quality (ie, wideband or narrowband) is synthesized during a speech pause a case may arise in which a truncation occurs in the last few frames during an active speech phase on the part of the network the active data frame took place.
  • a predominantly narrow-band decoding of the background noise information first takes place, which after a settable period of time transitions into a predominantly wideband decoding.
  • Such a transition is thus preferably quasi-continuous, with a Transition to discrete times - hence "quasi" -continuous - is set to a certain share factor.
  • the following values for the proportion factor have proven to be particularly advantageous for subjective human hearing: at the time of entering the DTX phase, a proportion factor of 0, and consequently only narrowband noise; at a time of 20 ms after entering the DTX phase, a share factor of 0.09525986892242; at a time of 40 ms after entering the DTX phase, a proportion factor of 0.19753086419753; at a time of 60 ms after entering the DTX phase, a share factor of 0.36595031245237; at a time of 80 ms after entering the DTX phase, a proportion factor of 0.62429507696997; and; at a time of 100 ms after entering the DTX phase, a share factor of 1, hence exclusively broadband
  • the codec used preferred a narrow-band reproduction mode and / or a broadband transmission method in the past was not ensured by the transmission network. This may lead to the case that few active speech frames arrive at the receiving decoder as wideband speech frames before receiving first SID frames there.
  • a predominantly wideband decoding of the background noise information first takes place, which after a settable period of time transitions into a predominantly narrowband decoding.
  • Such a transition is preferably quasi-continuous analogous to the development described above, wherein a transition to discrete times is set to a certain proportion factor.
  • the proportion factor is set with values as above, but in reverse order.
  • Showing: 1 shows a time representation of a data rate between a transmitter and a receiver with a plurality of bandwidth switches and an entry into a speech pause, wherein SID frames are transmitted;
  • Fig. 2A is a schematic illustration of a first scenario of bandwidth switching
  • FIG. 2B shows a schematic illustration of a second scenario of bandwidth switching
  • FIG. 3 A switching process executed on the decoder side with a quasi-continuous transition from a narrow-band to a broad-band noise signal quality.
  • FIG. 1 shows a time transmission of voice data frames with a respective data rate DR and, as of a third time t3, a transmission of SID frames.
  • a transmission of broadband active speech frames takes place with a data rate of 32 kbit / s. From the time t1, a switchover to a data rate of 22 kbit / s and from a second time t2 to a data rate of 12 kbit / s. A data rate of 12 kbit / s already corresponds to a narrowband speech frame.
  • FIG. 2A and FIG. 2B show two possible scenarios for a progression of the data rate DR over time t.
  • a transmission is largely narrow-band due to restrictions of the network or due to other circumstances, in the example of FIG. 2A at 8 kbit / s, while at a few points in time, between a first time t 1 and a second time t 2, exceptionally a broadband. dige transmission with 32 kbit / s takes place.
  • FIG. 2B again shows a situation in reverse, namely a predominantly wideband transmission mode with 32 kbit / s and an exceptionally short, narrowband transmission method between a fourth time t4 and a fifth time t5.
  • information about the proportion of broadband active speech frames in comparison to narrowband active speech frames is collected on the part of the decoder during the speech phase.
  • the percentage of broadband active speech frames is to be described as very low, while in the example of FIG. tual proportion of broadband active speech frames.
  • FIG. 3 illustrates a design of the noise signal following a scenario according to FIG. 2B, in which a requirement has been determined on the basis of the decoder-side determined percentage share of broadband active speech frames, and broadband noise information during the DTX phase to synthesize.
  • Transition from a narrowband speech signal to a broadband noise signal quasi-continuous which has proven to be the most favorable embodiment for a subjective Horempfinden a human recipient, is started at this time TIME with an exclusively narrow-band signal, ie with a proportion HB- SHARE of the wideband noise of 0.
  • the wideband noise is 1 or 100%.
  • a further embodiment of the invention analogously provides for a transition from a wideband speech signal to a narrowband noise signal.
  • a slightly modified scenario is assumed in which, unlike the scenario illustrated in FIG. 2A, shortly before time t3, a change-not shown-to a broadband transmission at 32 kbit / s takes place , Despite this "peak", the percentage of broadband active speech frames remains very low, so that now in transition to the DTX phase, a noise signal is to be synthesized that broadband begins, however - due to the predominantly narrow-band transmission history and thus expected for the future Continuation of the narrow-band transfer character - to be converted into a narrow-band noise signal. To make this transition from a broadband
  • an exclusively broadband signal is entered to enter the DTX phase, ie with a HB-SHARE component of the broadband noise of 1.
  • the narrow-band noise component is 0
  • the values proposed above are advantageously set in an inverse row. This would correspond to a curve mirrored on the ordinate HB-SHARE according to FIG. 3.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Telephonic Communication Services (AREA)

Abstract

L'invention vise à déterminer des informations concernant le déroulement d'une commutation de largeur de bande (commutation de débit binaire) au cours d'une phase de parole active. Selon l'invention, des informations sont obtenues du côté du décodeur pendant la phase de parole concernant le pourcentage de trames de parole actives à large bande par rapport aux trames de parole actives à bande étroite. Un pourcentage élevé de trames de parole actives à large bande indique qu'une utilisation d'une large bande est préférée du côté du codeur-décodeur et qu'il est ainsi nécessaire de synthétiser des informations de bruit sur une large bande au cours d'une phase de transmission discontinue (DTX).
EP09712583.5A 2008-02-19 2009-02-02 Procédés et moyens pour décoder des informations de bruit de fond Active EP2245622B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102008009720A DE102008009720A1 (de) 2008-02-19 2008-02-19 Verfahren und Mittel zur Dekodierung von Hintergrundrauschinformationen
PCT/EP2009/051120 WO2009103609A1 (fr) 2008-02-19 2009-02-02 Procédés et moyens pour décoder des informations de bruit de fond

Publications (2)

Publication Number Publication Date
EP2245622A1 true EP2245622A1 (fr) 2010-11-03
EP2245622B1 EP2245622B1 (fr) 2016-07-13

Family

ID=40790517

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09712583.5A Active EP2245622B1 (fr) 2008-02-19 2009-02-02 Procédés et moyens pour décoder des informations de bruit de fond

Country Status (8)

Country Link
US (1) US8260606B2 (fr)
EP (1) EP2245622B1 (fr)
JP (1) JP5006975B2 (fr)
KR (1) KR101166650B1 (fr)
CN (1) CN101946281B (fr)
DE (1) DE102008009720A1 (fr)
RU (1) RU2454737C2 (fr)
WO (1) WO2009103609A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2980790A1 (fr) * 2014-07-28 2016-02-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Appareil et procédé de sélection de mode de génération de bruit de confort
JP2016038513A (ja) * 2014-08-08 2016-03-22 富士通株式会社 音声切替装置、音声切替方法及び音声切替用コンピュータプログラム
US10049684B2 (en) 2015-04-05 2018-08-14 Qualcomm Incorporated Audio bandwidth selection

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FI105001B (fi) * 1995-06-30 2000-05-15 Nokia Mobile Phones Ltd Menetelmä odotusajan selvittämiseksi puhedekooderissa epäjatkuvassa lähetyksessä ja puhedekooderi sekä lähetin-vastaanotin
RU2237296C2 (ru) * 1998-11-23 2004-09-27 Телефонактиеболагет Лм Эрикссон (Пабл) Кодирование речи с функцией изменения комфортного шума для повышения точности воспроизведения
US6691084B2 (en) * 1998-12-21 2004-02-10 Qualcomm Incorporated Multiple mode variable rate speech coding
US6631139B2 (en) * 2001-01-31 2003-10-07 Qualcomm Incorporated Method and apparatus for interoperability between voice transmission systems during speech inactivity
EP1808852A1 (fr) * 2002-10-11 2007-07-18 Nokia Corporation Procédé d'interopération entre des codecs à large bande à haute vitesse adaptative (AMR-WB) et à large bande à débit binaire variable multimode (VMR-WB)
JP4438280B2 (ja) * 2002-10-31 2010-03-24 日本電気株式会社 トランスコーダ及び符号変換方法
JP2008546341A (ja) * 2005-06-18 2008-12-18 ノキア コーポレイション 非連続音声送信の際の擬似背景ノイズパラメータ適応送信のためのシステム及び方法
KR101295729B1 (ko) * 2005-07-22 2013-08-12 프랑스 텔레콤 비트 레이트­규모 가변적 및 대역폭­규모 가변적 오디오디코딩에서 비트 레이트 스위칭 방법
EP1955321A2 (fr) 2005-11-30 2008-08-13 TELEFONAKTIEBOLAGET LM ERICSSON (publ) Conversion efficace d'un flux vocal
US8260609B2 (en) * 2006-07-31 2012-09-04 Qualcomm Incorporated Systems, methods, and apparatus for wideband encoding and decoding of inactive frames
US8032359B2 (en) * 2007-02-14 2011-10-04 Mindspeed Technologies, Inc. Embedded silence and background noise compression
KR101290622B1 (ko) * 2007-11-02 2013-07-29 후아웨이 테크놀러지 컴퍼니 리미티드 오디오 복호화 방법 및 장치
CN101335000B (zh) * 2008-03-26 2010-04-21 华为技术有限公司 编码的方法及装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2009103609A1 *

Also Published As

Publication number Publication date
JP2011512564A (ja) 2011-04-21
CN101946281A (zh) 2011-01-12
RU2010138566A (ru) 2012-03-27
DE102008009720A1 (de) 2009-08-20
WO2009103609A1 (fr) 2009-08-27
KR20100125340A (ko) 2010-11-30
JP5006975B2 (ja) 2012-08-22
US8260606B2 (en) 2012-09-04
US20110040560A1 (en) 2011-02-17
CN101946281B (zh) 2012-08-15
RU2454737C2 (ru) 2012-06-27
KR101166650B1 (ko) 2012-07-23
EP2245622B1 (fr) 2016-07-13

Similar Documents

Publication Publication Date Title
EP2245621B1 (fr) Procédé et moyens d encodage d informations de bruit de fond
EP0667063B1 (fr) Procede de transmission et/ou de memorisation de signaux numeriques provenant de plusieurs canaux
DE60214599T2 (de) Skalierbare audiokodierung
DE60120504T2 (de) Verfahren zur transcodierung von audiosignalen, netzwerkelement, drahtloses kommunikationsnetzwerk und kommunikationssystem
DE60117471T2 (de) Breitband-signalübertragungssystem
EP1953739B1 (fr) Procédé et dispositif pour réduire le bruit dans un signal décodé
DE60121592T2 (de) Kodierung und dekodierung eines digitalen signals
EP1647010B1 (fr) Conversion d'un format de fichier audio
EP1338004A1 (fr) Procede et dispositif pour produire ou decoder un flux de donnees modulable compte tenu d'une banque de bits, codeur et codeur modulable
EP2245620B1 (fr) Procédé et moyens d'encodage d'informations de bruit de fond
WO2007087823A1 (fr) Procédé et dispositifs pour coder un signal audio
EP2245622B1 (fr) Procédés et moyens pour décoder des informations de bruit de fond
WO2002058054A1 (fr) Procede et dispositif pour produire un flux de donnees modulable et procede et dispositif pour decoder un flux de donnees modulable
EP1677286A1 (fr) Procédé pour l'adaptation de paramètres de génération de bruit de confort
DE4430864A1 (de) Verfahren zum unbemerktem Übertragen und/oder Speichern von Zusatzinformationen innerhalb eines quellencodierten, datenreduzierten Audiosignals
DE69921643T2 (de) Av-signalübertragung mit variabler bitrate in einem paketnetz
DE60304237T2 (de) Sprachkodiervorrichtung und Verfahren mit TFO (Tandem Free Operation) Funktion
EP1390947B1 (fr) Procede pour la reception de signaux
DE19727938B4 (de) Verfahren und Vorrichtung zum Codieren von Signalen
EP1433166A1 (fr) Dispositif d'extension vocale et procede pour evaluer un signal vocal a large bande au moyen d'un signal vocal a bande etroite
DE10339498A1 (de) Audiodateiformatumwandlung
DE19906223B4 (de) Verfahren und Funk-Kommunikationssystem zur Sprachübertragung, insbesondere für digitale Mobilkummunikationssysteme
WO2006072526A1 (fr) Procede d'extension de bande passante
DE19735675A1 (de) Verfahren zum Verschleiern von Fehlern in einem Audiodatenstrom
DE19905868A1 (de) Verfahren zur Verarbeitung eines Datenstromes sowie Dekoder und Verwendung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20100812

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA RS

RIN1 Information on inventor provided before grant (corrected)

Inventor name: TADDEI, HERVE

Inventor name: SCHANDL, STEFAN

Inventor name: SETIAWAN, PANJI

DAX Request for extension of the european patent (deleted)
RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: UNIFY GMBH & CO. KG

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 502009012809

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G10L0019000000

Ipc: G10L0019012000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 19/24 20130101ALI20150609BHEP

Ipc: G10L 19/012 20130101AFI20150609BHEP

INTG Intention to grant announced

Effective date: 20150706

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20151012

INTG Intention to grant announced

Effective date: 20160224

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 812878

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160715

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502009012809

Country of ref document: DE

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 502009012809

Country of ref document: DE

Representative=s name: SCHAAFHAUSEN PATENTANWAELTE PARTNERSCHAFTSGESE, DE

Ref country code: DE

Ref legal event code: R082

Ref document number: 502009012809

Country of ref document: DE

Representative=s name: FRITZSCHE PATENTANWAELTE, DE

Ref country code: DE

Ref legal event code: R081

Ref document number: 502009012809

Country of ref document: DE

Owner name: UNIFY GMBH & CO. KG, DE

Free format text: FORMER OWNER: UNIFY GMBH & CO. KG, 81379 MUENCHEN, DE

RAP2 Party data changed (patent owner data changed or rights of a patent transferred)

Owner name: UNIFY GMBH & CO. KG

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160713

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161113

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161013

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161114

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161014

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502009012809

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170228

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20161013

26N No opposition filed

Effective date: 20170418

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170228

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170228

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170202

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20170228

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170202

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 812878

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170202

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170202

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20090202

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160713

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160713

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 502009012809

Country of ref document: DE

Representative=s name: SCHAAFHAUSEN PATENTANWAELTE PARTNERSCHAFTSGESE, DE

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240216

Year of fee payment: 16

Ref country code: GB

Payment date: 20240222

Year of fee payment: 16

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240221

Year of fee payment: 16