EP2245622A1 - Verfahren und mittel zur dekodierung von hintergrundrauschinformationen - Google Patents
Verfahren und mittel zur dekodierung von hintergrundrauschinformationenInfo
- Publication number
- EP2245622A1 EP2245622A1 EP09712583A EP09712583A EP2245622A1 EP 2245622 A1 EP2245622 A1 EP 2245622A1 EP 09712583 A EP09712583 A EP 09712583A EP 09712583 A EP09712583 A EP 09712583A EP 2245622 A1 EP2245622 A1 EP 2245622A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- time
- entering
- phase
- broadband
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/012—Comfort noise or silence coding
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/18—Vocoders using multiple modes
- G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
Definitions
- the invention relates to methods and means for decoding background noise information in speech signal coding methods.
- Such a limited frequency range is also provided in many speech signal coding methods for today's digital telecommunications.
- a bandwidth limitation of the analog signal Prior to a coding process, a bandwidth limitation of the analog signal is performed for this purpose.
- a codec is used which, due to the described bandwidth limitation in the frequency range between 300 Hz and 3400 Hz, is also referred to below as narrow-band speech codec (Narrow Band Speech Codec).
- the term codec is understood to mean both the coding rule for the digital coding of audio signals and the decoding rule for the decoding of data with the aim of reconstructing the audio signal.
- a narrowband speech codec is known from ITU-T Recommendation G.729.
- a transmission of a narrow-band voice signal with a data rate of 8 kbit / s is provided.
- Band Speech Codec are known, which provide a coding of one in an extended frequency range to improve the Hor- impressive. Such an extended frequency range lies for example between a frequency of 50 Hz and 7000 Hz.
- a broadband voice codec is for example from the ITU-T Recommendation G.729. EV known.
- Speech codecs made scalable.
- Scalability means that the transmitted coded data contain various demarcated blocks which contain the narrowband component, the broadband component and / or the full bandwidth of the coded voice signal.
- such a scalable design allows for backwards compatibility on the receiver side and, on the other hand, offers a simple possibility of adapting the data rate and the size of transmitted data frames in the transmission channel in the case of limited data transmission capacities.
- a compression of the data to be transmitted is provided. Compression is achieved, for example, by coding methods, in which parameters for an excitation signal and filter parameters are determined for coding the speech data. The filter parameters and parameters specifying the excitation signal are then transmitted to the receiver. There, a synthetic speech signal is synthesized using the codec, which is as similar as possible to the original speech signal with regard to a subjective impression of hearing. With the aid of this method, also known as "analysis-by-synthesis", the determined and digitized samples (samples) are not transmitted themselves but determined parameters which enable a receiver-side synthesis of the speech signal.
- a further measure for reducing the data transmission rate is provided by a method for discontinuous transmission (Discontinuous Transmission), which is also known in the art as DTX.
- the fundamental goal DTX is a reduction in the data transfer rate in the event of a speech break.
- a voice pause detection (VAD) is used on the transmitter side, which detects a pause in speech when the signal falls below a certain signal level.
- VAD voice pause detection
- Comfort noise is noise that is synthesized to fill silence phases on the receiver's side.
- the comfort noise serves as a subjective impression of a continuing connection, without claiming the data transmission rate intended for the transmission of speech signals. In other words, less effort is required to code the speech data for the transmitter-side coding of the noise. For a receiver-side still perceived as realistic synthesis - i.
- Decoding - Comfort noise transmits data at a much lower data rate.
- the data transmitted here are also referred to in the professional world as the SID (Meaning Insertion Description).
- the aforementioned scalable wideband speech codecs usually support different data transmission rates in a bandwidth range of 50 to 7000 Hz.
- Possible data rates for encoding the voice information include 8, 12, 14, 16, ..., 32 kbit / s, which are used, for example, in the G.729.1 standard.
- the data rates of 8 and 12 kbit / s are applied to narrowband signals (50Hz to 4kHz). Data rates greater than 12 kbit / s are applied to the upper frequency band of 4 to 7 kHz.
- a sudden change from a narrowband to a broadband data rate is known to cause a disturbing effect on a human recipient.
- Such a transition occurs, for example, as a result of a truncation of the data stream (bitstream transformation), which is caused, for example, by the transmission network between transmitter and receiver, for example as a result of the establishment of further additional connections or due to a congestion in the transmission network.
- the said clipping leads to a change in the data rate and finally to a transition from a broadband to a narrowband transmission of the speech signal.
- a saving of the data transmission rate for the transmission of the respective data frames is possible.
- the DTX method is used exactly when a corresponding frame is characterized as a speech break.
- a reduced data transmission rate on transmitted frames is achieved due to two factors. First, the encoder does not need to send all inactive frames to the decoder. Second, a transmitted SID frame occupies much fewer bits than a voice data frame.
- VAD Paging detection
- the encoder then sends a specially marked frame, a Silence Insertion Descriptor (SID) frame, to the decoder.
- SID Silence Insertion Descriptor
- the decoder synthesizes comfort noise based on the information contained in a SID frame, and the decoder can determine, based on the SID frame, whether the contained noise information is narrowband or broadband information.
- bit rate switching Changing the bit rate (bit rate switching) between narrowband and wideband information is a common scenario for any scalable wideband speech codec.
- a treatment of a data rate change during a normal speech phase i. in the absence of pauses in speech, although adequately described in the literature, a treatment on entry into a DTX phase is currently still unknown.
- the active speech frames are narrow-band decoded and the background noise is played back in pauses in broadband.
- the object of the invention is to specify a method for changing a data rate of SID frames during a speech pause, which results in an improved quality of the signal synthesized on the decoder.
- a basic idea of the invention is a determination of information about the course of the bandwidth switchover
- information about the percentage of broadband active speech frames in comparison to narrowband active speech frames is collected on the decoder side during the speech phase.
- information on the nature of the background noise is not collected until the time of a change to a speech break, as has hitherto been suggested by the prior art.
- a high percentage of broadband active speech frames indicates that the codec prefers broadband use and therefore there is a need to broadly synthesize noise information during a DTX phase, i. to decode.
- narrow-band noise is generated on the decoder's side when entering a DTX phase, even if the received SID frames require a synthesizer - i. Decoding - would allow a broadband noise.
- the object of the invention to provide a method for changing a data rate of SID frames during a speech break more than solved.
- the change to be made between noise information with different data rate according to the object is refined according to the inventive solution presented here into a determination of a proportion of noise information with different data rates.
- the proportion is adjustable in contrast to a change in any ratio between noise information with different data rate.
- the method according to the invention thus achieves the object of the invention to achieve an improved quality of the signal synthesized on the decoder.
- a decision is made that a noise signal having a certain quality (ie, wideband or narrowband) is synthesized during a speech pause a case may arise in which a truncation occurs in the last few frames during an active speech phase on the part of the network the active data frame took place.
- a predominantly narrow-band decoding of the background noise information first takes place, which after a settable period of time transitions into a predominantly wideband decoding.
- Such a transition is thus preferably quasi-continuous, with a Transition to discrete times - hence "quasi" -continuous - is set to a certain share factor.
- the following values for the proportion factor have proven to be particularly advantageous for subjective human hearing: at the time of entering the DTX phase, a proportion factor of 0, and consequently only narrowband noise; at a time of 20 ms after entering the DTX phase, a share factor of 0.09525986892242; at a time of 40 ms after entering the DTX phase, a proportion factor of 0.19753086419753; at a time of 60 ms after entering the DTX phase, a share factor of 0.36595031245237; at a time of 80 ms after entering the DTX phase, a proportion factor of 0.62429507696997; and; at a time of 100 ms after entering the DTX phase, a share factor of 1, hence exclusively broadband
- the codec used preferred a narrow-band reproduction mode and / or a broadband transmission method in the past was not ensured by the transmission network. This may lead to the case that few active speech frames arrive at the receiving decoder as wideband speech frames before receiving first SID frames there.
- a predominantly wideband decoding of the background noise information first takes place, which after a settable period of time transitions into a predominantly narrowband decoding.
- Such a transition is preferably quasi-continuous analogous to the development described above, wherein a transition to discrete times is set to a certain proportion factor.
- the proportion factor is set with values as above, but in reverse order.
- Showing: 1 shows a time representation of a data rate between a transmitter and a receiver with a plurality of bandwidth switches and an entry into a speech pause, wherein SID frames are transmitted;
- Fig. 2A is a schematic illustration of a first scenario of bandwidth switching
- FIG. 2B shows a schematic illustration of a second scenario of bandwidth switching
- FIG. 3 A switching process executed on the decoder side with a quasi-continuous transition from a narrow-band to a broad-band noise signal quality.
- FIG. 1 shows a time transmission of voice data frames with a respective data rate DR and, as of a third time t3, a transmission of SID frames.
- a transmission of broadband active speech frames takes place with a data rate of 32 kbit / s. From the time t1, a switchover to a data rate of 22 kbit / s and from a second time t2 to a data rate of 12 kbit / s. A data rate of 12 kbit / s already corresponds to a narrowband speech frame.
- FIG. 2A and FIG. 2B show two possible scenarios for a progression of the data rate DR over time t.
- a transmission is largely narrow-band due to restrictions of the network or due to other circumstances, in the example of FIG. 2A at 8 kbit / s, while at a few points in time, between a first time t 1 and a second time t 2, exceptionally a broadband. dige transmission with 32 kbit / s takes place.
- FIG. 2B again shows a situation in reverse, namely a predominantly wideband transmission mode with 32 kbit / s and an exceptionally short, narrowband transmission method between a fourth time t4 and a fifth time t5.
- information about the proportion of broadband active speech frames in comparison to narrowband active speech frames is collected on the part of the decoder during the speech phase.
- the percentage of broadband active speech frames is to be described as very low, while in the example of FIG. tual proportion of broadband active speech frames.
- FIG. 3 illustrates a design of the noise signal following a scenario according to FIG. 2B, in which a requirement has been determined on the basis of the decoder-side determined percentage share of broadband active speech frames, and broadband noise information during the DTX phase to synthesize.
- Transition from a narrowband speech signal to a broadband noise signal quasi-continuous which has proven to be the most favorable embodiment for a subjective Horempfinden a human recipient, is started at this time TIME with an exclusively narrow-band signal, ie with a proportion HB- SHARE of the wideband noise of 0.
- the wideband noise is 1 or 100%.
- a further embodiment of the invention analogously provides for a transition from a wideband speech signal to a narrowband noise signal.
- a slightly modified scenario is assumed in which, unlike the scenario illustrated in FIG. 2A, shortly before time t3, a change-not shown-to a broadband transmission at 32 kbit / s takes place , Despite this "peak", the percentage of broadband active speech frames remains very low, so that now in transition to the DTX phase, a noise signal is to be synthesized that broadband begins, however - due to the predominantly narrow-band transmission history and thus expected for the future Continuation of the narrow-band transfer character - to be converted into a narrow-band noise signal. To make this transition from a broadband
- an exclusively broadband signal is entered to enter the DTX phase, ie with a HB-SHARE component of the broadband noise of 1.
- the narrow-band noise component is 0
- the values proposed above are advantageously set in an inverse row. This would correspond to a curve mirrored on the ordinate HB-SHARE according to FIG. 3.
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102008009720A DE102008009720A1 (de) | 2008-02-19 | 2008-02-19 | Verfahren und Mittel zur Dekodierung von Hintergrundrauschinformationen |
PCT/EP2009/051120 WO2009103609A1 (de) | 2008-02-19 | 2009-02-02 | Verfahren und mittel zur dekodierung von hintergrundrauschinformationen |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2245622A1 true EP2245622A1 (de) | 2010-11-03 |
EP2245622B1 EP2245622B1 (de) | 2016-07-13 |
Family
ID=40790517
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP09712583.5A Active EP2245622B1 (de) | 2008-02-19 | 2009-02-02 | Verfahren und mittel zur dekodierung von hintergrundrauschinformationen |
Country Status (8)
Country | Link |
---|---|
US (1) | US8260606B2 (de) |
EP (1) | EP2245622B1 (de) |
JP (1) | JP5006975B2 (de) |
KR (1) | KR101166650B1 (de) |
CN (1) | CN101946281B (de) |
DE (1) | DE102008009720A1 (de) |
RU (1) | RU2454737C2 (de) |
WO (1) | WO2009103609A1 (de) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2980790A1 (de) * | 2014-07-28 | 2016-02-03 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zur Komfortgeräuscherzeugungs-Modusauswahl |
JP2016038513A (ja) * | 2014-08-08 | 2016-03-22 | 富士通株式会社 | 音声切替装置、音声切替方法及び音声切替用コンピュータプログラム |
US10049684B2 (en) * | 2015-04-05 | 2018-08-14 | Qualcomm Incorporated | Audio bandwidth selection |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FI105001B (fi) * | 1995-06-30 | 2000-05-15 | Nokia Mobile Phones Ltd | Menetelmä odotusajan selvittämiseksi puhedekooderissa epäjatkuvassa lähetyksessä ja puhedekooderi sekä lähetin-vastaanotin |
RU2237296C2 (ru) * | 1998-11-23 | 2004-09-27 | Телефонактиеболагет Лм Эрикссон (Пабл) | Кодирование речи с функцией изменения комфортного шума для повышения точности воспроизведения |
US6691084B2 (en) * | 1998-12-21 | 2004-02-10 | Qualcomm Incorporated | Multiple mode variable rate speech coding |
US6631139B2 (en) * | 2001-01-31 | 2003-10-07 | Qualcomm Incorporated | Method and apparatus for interoperability between voice transmission systems during speech inactivity |
EP1808852A1 (de) * | 2002-10-11 | 2007-07-18 | Nokia Corporation | Verfahren zur Interoperation zwischen adaptiven Breitband-Codecs mit unterschiedlichen Raten und Breitband-Codecs mit mehreren Betriebsarten und variabler Bitrate |
JP4438280B2 (ja) * | 2002-10-31 | 2010-03-24 | 日本電気株式会社 | トランスコーダ及び符号変換方法 |
ES2629727T3 (es) * | 2005-06-18 | 2017-08-14 | Nokia Technologies Oy | Sistema y método para la transmisión adaptativa de parámetros de ruido de confort durante la transmisión de habla discontinua |
CN101263554B (zh) * | 2005-07-22 | 2011-12-28 | 法国电信公司 | 在比特率分级和带宽分级的音频解码中的比特率切换方法 |
EP2276023A3 (de) | 2005-11-30 | 2011-10-05 | Telefonaktiebolaget LM Ericsson (publ) | Effiziente sprach-strom-umsetzung |
US8260609B2 (en) * | 2006-07-31 | 2012-09-04 | Qualcomm Incorporated | Systems, methods, and apparatus for wideband encoding and decoding of inactive frames |
US8032359B2 (en) * | 2007-02-14 | 2011-10-04 | Mindspeed Technologies, Inc. | Embedded silence and background noise compression |
BRPI0818927A2 (pt) * | 2007-11-02 | 2015-06-16 | Huawei Tech Co Ltd | Método e aparelho para a decodificação de áudio |
CN101335000B (zh) * | 2008-03-26 | 2010-04-21 | 华为技术有限公司 | 编码的方法及装置 |
-
2008
- 2008-02-19 DE DE102008009720A patent/DE102008009720A1/de not_active Withdrawn
-
2009
- 2009-02-02 WO PCT/EP2009/051120 patent/WO2009103609A1/de active Application Filing
- 2009-02-02 JP JP2010547138A patent/JP5006975B2/ja not_active Expired - Fee Related
- 2009-02-02 EP EP09712583.5A patent/EP2245622B1/de active Active
- 2009-02-02 KR KR1020107020944A patent/KR101166650B1/ko active IP Right Grant
- 2009-02-02 CN CN2009801056374A patent/CN101946281B/zh not_active Expired - Fee Related
- 2009-02-02 RU RU2010138566/08A patent/RU2454737C2/ru not_active IP Right Cessation
- 2009-02-02 US US12/867,791 patent/US8260606B2/en active Active
Non-Patent Citations (1)
Title |
---|
See references of WO2009103609A1 * |
Also Published As
Publication number | Publication date |
---|---|
JP2011512564A (ja) | 2011-04-21 |
JP5006975B2 (ja) | 2012-08-22 |
CN101946281A (zh) | 2011-01-12 |
US8260606B2 (en) | 2012-09-04 |
DE102008009720A1 (de) | 2009-08-20 |
US20110040560A1 (en) | 2011-02-17 |
RU2454737C2 (ru) | 2012-06-27 |
EP2245622B1 (de) | 2016-07-13 |
WO2009103609A1 (de) | 2009-08-27 |
CN101946281B (zh) | 2012-08-15 |
RU2010138566A (ru) | 2012-03-27 |
KR20100125340A (ko) | 2010-11-30 |
KR101166650B1 (ko) | 2012-07-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2245621B1 (de) | Verfahren und mittel zur enkodierung von hintergrundrauschinformationen | |
EP0667063B1 (de) | Verfahren zur übertragung und/oder speicherung digitaler signale mehrerer kanäle | |
DE60214599T2 (de) | Skalierbare audiokodierung | |
DE60120504T2 (de) | Verfahren zur transcodierung von audiosignalen, netzwerkelement, drahtloses kommunikationsnetzwerk und kommunikationssystem | |
DE60117471T2 (de) | Breitband-signalübertragungssystem | |
EP1953739B1 (de) | Verfahren und Vorrichtung zur Geräuschsunterdrückung bei einem decodierten Signal | |
EP1647010B1 (de) | Audiodateiformatumwandlung | |
DE60121592T2 (de) | Kodierung und dekodierung eines digitalen signals | |
WO2002063611A1 (de) | Verfahren und vorrichtung zum erzeugen bzw. decodieren eines skalierbaren datenstroms unter berücksichtigung einer bitsparkasse, codierer und skalierbarer codierer | |
EP0978172B1 (de) | Verfahren zum verschleiern von fehlern in einem audiodatenstrom | |
EP2245620B1 (de) | Verfahren und mittel zur enkodierung von hintergrundrauschinformationen | |
EP1979899A1 (de) | Verfahren und anordnungen zur audiosignalkodierung | |
EP2245622B1 (de) | Verfahren und mittel zur dekodierung von hintergrundrauschinformationen | |
WO2002058054A1 (de) | Verfahren und vorrichtung zum erzeugen eines skalierbaren datenstroms und verfahren und vorrichtung zum decodieren eines skalierbaren datenstroms | |
EP1677286A1 (de) | Verfahren zur Anpassung von Comfort Noise Generation Parametern | |
DE69921643T2 (de) | Av-signalübertragung mit variabler bitrate in einem paketnetz | |
DE60304237T2 (de) | Sprachkodiervorrichtung und Verfahren mit TFO (Tandem Free Operation) Funktion | |
EP1390947B1 (de) | Verfahren zum signalempfang in einem digitalen kommunikationssystem | |
DE19727938B4 (de) | Verfahren und Vorrichtung zum Codieren von Signalen | |
EP1433166A1 (de) | Sprachextender und verfahren zum schätzen eines breitbandigen sprachsignals anhand eines schmalbandigen sprachsignals | |
DE10339498A1 (de) | Audiodateiformatumwandlung | |
DE19906223B4 (de) | Verfahren und Funk-Kommunikationssystem zur Sprachübertragung, insbesondere für digitale Mobilkummunikationssysteme | |
WO2006072526A1 (de) | Verfahren zur bandbreitenerweiterung | |
DE102008050351A1 (de) | System und Verfahren zur Übertragung von Audiodaten an ein Hörgerät | |
DE19735675A1 (de) | Verfahren zum Verschleiern von Fehlern in einem Audiodatenstrom |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20100812 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA RS |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: TADDEI, HERVE Inventor name: SCHANDL, STEFAN Inventor name: SETIAWAN, PANJI |
|
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: UNIFY GMBH & CO. KG |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 502009012809 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G10L0019000000 Ipc: G10L0019012000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 19/24 20130101ALI20150609BHEP Ipc: G10L 19/012 20130101AFI20150609BHEP |
|
INTG | Intention to grant announced |
Effective date: 20150706 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20151012 |
|
INTG | Intention to grant announced |
Effective date: 20160224 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 812878 Country of ref document: AT Kind code of ref document: T Effective date: 20160715 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: GERMAN |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 502009012809 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 502009012809 Country of ref document: DE Representative=s name: SCHAAFHAUSEN PATENTANWAELTE PARTNERSCHAFTSGESE, DE Ref country code: DE Ref legal event code: R082 Ref document number: 502009012809 Country of ref document: DE Representative=s name: FRITZSCHE PATENTANWAELTE, DE Ref country code: DE Ref legal event code: R081 Ref document number: 502009012809 Country of ref document: DE Owner name: UNIFY GMBH & CO. KG, DE Free format text: FORMER OWNER: UNIFY GMBH & CO. KG, 81379 MUENCHEN, DE |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: UNIFY GMBH & CO. KG |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161113 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161013 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161114 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161014 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 502009012809 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170228 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20161013 |
|
26N | No opposition filed |
Effective date: 20170418 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170228 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170228 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170202 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20170228 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170202 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MM01 Ref document number: 812878 Country of ref document: AT Kind code of ref document: T Effective date: 20170202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20090202 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160713 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 502009012809 Country of ref document: DE Representative=s name: SCHAAFHAUSEN PATENTANWAELTE PARTNERSCHAFTSGESE, DE |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230217 Year of fee payment: 15 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230221 Year of fee payment: 15 Ref country code: DE Payment date: 20230216 Year of fee payment: 15 |