EP1859439A1 - Multichannel audio compression and decompression method using virtual source location information - Google Patents
Multichannel audio compression and decompression method using virtual source location informationInfo
- Publication number
- EP1859439A1 EP1859439A1 EP06716366A EP06716366A EP1859439A1 EP 1859439 A1 EP1859439 A1 EP 1859439A1 EP 06716366 A EP06716366 A EP 06716366A EP 06716366 A EP06716366 A EP 06716366A EP 1859439 A1 EP1859439 A1 EP 1859439A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- channel
- vector
- angle
- location information
- audio signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000006837 decompression Effects 0.000 title abstract description 4
- 230000006835 compression Effects 0.000 title description 3
- 238000007906 compression Methods 0.000 title description 3
- 230000005236 sound signal Effects 0.000 claims abstract description 52
- 239000013598 vector Substances 0.000 claims description 85
- 238000004091 panning Methods 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 4
- 238000013139 quantization Methods 0.000 abstract description 5
- 238000001228 spectrum Methods 0.000 abstract 1
- 230000000694 effects Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/0204—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using subband decomposition
Definitions
- the present invention relates to compression and decompression of a
- multi-channel audio signal and more particularly, to a method for
- VSLI source location information
- ICLD ICLD
- the ICLD is
- quantization process assigns a limited number of bits, resolution is limited.
- the present invention is directed to a method for representing,
- VSLI source location information
- the present invention is also directed to a method for compressing a
- One aspect of the present invention provides a method for estimating
- VSLI virtual source location information
- angle of the global vector is greater than zero and in a second set when the
- Another aspect of the present invention provides a method for
- VSLI VSI information
- Yet another aspect of the present invention provides a method for
- VSLI source location information
- the method comprising the steps of: (i) predicting inverse panning angle information from the VSLI using a constant
- spatial cue information is represented using virtual sound location
- FIG. 1 schematically illustrates the configuration of a multi-channel
- FIG. 2 is a flowchart illustrating a process of estimating virtual sound
- VSLI location information
- FIG. 3 illustrates an example in which respective channels of a multi ⁇
- channel audio signal are virtually assigned on a semicircular plane structure according to an exemplary embodiment of the present invention.
- FIG. 4 illustrates an example of local vectors estimated in respective
- FIG. 5 is a flowchart illustrating a process of decoding a multi-channel
- FIG. 1 schematically illustrates the configuration of a multi-channel
- multi-channel audio encoder includes a down mixer 110 for down-mixing an
- AAC advanced audio coding
- VSLI virtual source location information
- a quantizing unit 140 for quantizing the VSLI
- a multiplexing unit 150 for multiplexing the down-mixed audio signal encoded
- the virtual source location information (VSLI)
- ICLD inter-channel level difference
- sound location vectors include a global vector Gv b , left and right half-plane
- Ga b LHa b , RHa b , LSa b and RSa b , respectively.
- the channels of the multi-channel audio signal are identical to the channels of the multi-channel audio signal
- FIG. 2 is a flowchart illustrating a process of estimating VSLI of a
- step 210 respective channels of an input multi-channel audio signal
- FIG. 3 shows
- step 220 the multi-channel audio signal is converted into a signal in
- step 230 the signal in the frequency domain is
- S Ch,n denotes a frequency coefficient of the ch-th channel.
- eh denotes one of a center channel (C)
- B b and B b+ i-1 denote frequency indexes corresponding to upper and lower boundaries of the sub-band B b , respectively.
- step 240 a global vector represented on the semicircular plane
- assigned the channels is estimated from the signal magnitude of each channel
- a global vector Gv b is estimated using
- Aj denotes virtual location information of each channel signal assigned
- the virtual location information may be defined as
- step 250 it is determined whether the angle Ga b of the global vector
- step 260 if the angle of the global global
- step 1 a first set of local vectors are estimated.
- the first set of local vectors are estimated.
- the first set of local vectors are estimated.
- the second set of local vectors includes LHv b , LSv b , and RSv b , and the second set of local vectors includes
- Equations 3 An embodiment thereof is shown in FIG. 4.
- step 280 the angle of the global vector and the angles of the local
- vectors estimated in step 260 or 270 are transmitted as the VSLI to the decoder.
- RSa b , LSa b ⁇ is transmitted, and otherwise, ⁇ Ga b , LHa b , LSa b , RSa b ⁇ is
- the spatial cue information for N multi-channel audio signals can be
- FIG. 5 is a flowchart illustrating a process of decoding a multi-channel
- decoder estimates vector information of original sound from virtual source
- the sound vector is represented by its magnitude and angle.
- the vector angle can be obtained from the received VSLI, and the vector
- an inverse panning angle is predicted
- the inverse panning angle is predicted using
- step 520 an estimated power component for each channel in the
- sub-band is obtained from the predicted inverse panning angle.
- estimated power component for each channel is obtained using the following
- each channel signal in each sub-band can be finally
- S k ' denotes a frequency component coefficient of the received down- mixed signal
- U c i 1;k denotes the decompressed audio signal
- the present invention described above may be provided as one or more
- the mediums may include a floppy disc, a hard disc, a CD-ROM,
- a flash memory card a programmable read only memory (PROM), a random access memory (RAM).
- PROM programmable read only memory
- RAM random access memory
- ROM read only memory
- magnetic tape a magnetic tape
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Stereophonic System (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR20050021104 | 2005-03-14 | ||
| KR1020060023545A KR100714980B1 (en) | 2005-03-14 | 2006-03-14 | Multichannel audio compression and decompression method using Virtual Source Location Information |
| PCT/KR2006/000916 WO2006098583A1 (en) | 2005-03-14 | 2006-03-14 | Multichannel audio compression and decompression method using virtual source location information |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| EP1859439A1 true EP1859439A1 (en) | 2007-11-28 |
| EP1859439A4 EP1859439A4 (en) | 2010-12-22 |
| EP1859439B1 EP1859439B1 (en) | 2013-10-30 |
Family
ID=36991912
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP06716366.7A Expired - Lifetime EP1859439B1 (en) | 2005-03-14 | 2006-03-14 | Multichannel audio compression and decompression method using virtual source location information |
Country Status (2)
| Country | Link |
|---|---|
| EP (1) | EP1859439B1 (en) |
| WO (1) | WO2006098583A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103137130B (en) | 2006-12-27 | 2016-08-17 | 韩国电子通信研究院 | For creating the code conversion equipment of spatial cue information |
| US9025775B2 (en) | 2008-07-01 | 2015-05-05 | Nokia Corporation | Apparatus and method for adjusting spatial cue information of a multichannel audio signal |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7292901B2 (en) * | 2002-06-24 | 2007-11-06 | Agere Systems Inc. | Hybrid multi-channel/cue coding/decoding of audio signals |
| US20030035553A1 (en) * | 2001-08-10 | 2003-02-20 | Frank Baumgarte | Backwards-compatible perceptual coding of spatial cues |
-
2006
- 2006-03-14 EP EP06716366.7A patent/EP1859439B1/en not_active Expired - Lifetime
- 2006-03-14 WO PCT/KR2006/000916 patent/WO2006098583A1/en not_active Ceased
Non-Patent Citations (4)
| Title |
|---|
| Han-gil Moon: "Multi-channel audio compression method with virtual source location information for MPEG-4 SAC"[Online] February 2005 (2005-02), XP002605438 Seoul National University Retrieved from the Internet: URL:http://library.snu.ac.kr/Eng/DetailView.jsp?uid=1&cid=1198524&ResultType=Multi> [retrieved on 2010-08-16] * |
| James R. West: "Five-Channel Panning Laws: An Analytical and Experimental Comparison - Chapter 3: IID-based Panning Methods"[Online] 1 May 1998 (1998-05-01), page 24PP, XP002605439 University of Miami Music Engineering Retrieved from the Internet: URL:http://mue.music.miami.edu/thesis/jwest/Chap_3/Chap_3_IID_Based_Panning_Methods.html> [retrieved on 2010-08-18] * |
| PULKII V: "VIRTUAL SOUND SOURCE POSITIONING USING VECTOR BASE AMPLITUDE PANNING" JOURNAL OF THE AUDIO ENGINEERING SOCIETY, vol. 45, no. 6, 1 June 1996 (1996-06-01), pages 456-466, XP000695381 AUDIO ENGINEERING SOCIETY, NEW YORK, NY, US ISSN: 1549-4950 * |
| See also references of WO2006098583A1 * |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2006098583A1 (en) | 2006-09-21 |
| EP1859439B1 (en) | 2013-10-30 |
| EP1859439A4 (en) | 2010-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10381013B2 (en) | Method and device for metadata for multi-channel or sound-field audio signals | |
| JP2022509440A (en) | Determining the coding of spatial audio parameters and the corresponding decoding | |
| JP7689196B2 (en) | Combining spatial audio streams | |
| CN114945982B (en) | Coding of spatial audio direction parameters | |
| US20110137661A1 (en) | Quantizing device, encoding device, quantizing method, and encoding method | |
| JP5949270B2 (en) | Audio decoding apparatus, audio decoding method, and audio decoding computer program | |
| WO2019106221A1 (en) | Processing of spatial audio parameters | |
| US20080187144A1 (en) | Multichannel Audio Compression and Decompression Method Using Virtual Source Location Information | |
| WO2006006809A1 (en) | Method and apparatus for encoding and cecoding multi-channel audio signal using virtual source location information | |
| EP1859439A1 (en) | Multichannel audio compression and decompression method using virtual source location information | |
| CN111182443B (en) | Method and apparatus for decoding bitstreams including encoded HOA representations | |
| JP6051621B2 (en) | Audio encoding apparatus, audio encoding method, audio encoding computer program, and audio decoding apparatus | |
| JP5990954B2 (en) | Audio encoding apparatus, audio encoding method, audio encoding computer program, audio decoding apparatus, audio decoding method, and audio decoding computer program | |
| HK40107858A (en) | Method and apparatus for decoding a bitstream including encoded hoa representations, and medium | |
| HK40019652A (en) | Method and apparatus for decoding a bitstream including encoded hoa representations, and medium | |
| HK40018256A (en) | Method and apparatus for decoding a bitstream including encoded hoa representations, and medium | |
| HK40110211A (en) | Method and apparatus for decoding a bitstream including encoded hoa representations, and medium | |
| HK40020236A (en) | Method and apparatus for decoding a bitstream including encoded hoa representations, and medium | |
| HK40020236B (en) | Method and apparatus for decoding a bitstream including encoded hoa representations, and medium | |
| HK40019652B (en) | Method and apparatus for decoding a bitstream including encoded hoa representations, and medium | |
| HK40018256B (en) | Method and apparatus for decoding a bitstream including encoded hoa representations, and medium | |
| HK1227165A1 (en) | Method and apparatus for improving the coding of side information required for coding a higher order ambisonics representation of a sound filed | |
| HK40020197A (en) | Method and apparatus for decoding a bitstream including encoded hoa representations | |
| HK40020197B (en) | Method and apparatus for decoding a bitstream including encoded hoa representations |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20070717 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
| DAX | Request for extension of the european patent (deleted) | ||
| A4 | Supplementary search report drawn up and despatched |
Effective date: 20101119 |
|
| 17Q | First examination report despatched |
Effective date: 20120418 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602006039029 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G10L0019000000 Ipc: G10L0019008000 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 19/008 20130101AFI20130502BHEP Ipc: G10L 19/02 20130101ALN20130502BHEP |
|
| INTG | Intention to grant announced |
Effective date: 20130523 |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 19/02 20130101ALN20130510BHEP Ipc: G10L 19/008 20130101AFI20130510BHEP |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| 111L | Licence recorded |
Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR Free format text: EXCLUSIVE LICENSE Name of requester: INTELLECTUAL DISCOVERY CO., LTD., KR Effective date: 20130712 |
|
| 111L | Licence recorded |
Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR Free format text: EXCLUSIVE LICENSE Name of requester: INTELLECTUAL DISCOVERY CO., LTD., KR Effective date: 20130712 |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PK Free format text: ERGAENZUNG LIZENZEINTRAG: AUSSCHLIESSLICHE LIZENZ Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 638675 Country of ref document: AT Kind code of ref document: T Effective date: 20131115 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602006039029 Country of ref document: DE Effective date: 20131224 |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20131030 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 638675 Country of ref document: AT Kind code of ref document: T Effective date: 20131030 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140228 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140228 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602006039029 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 |
|
| 26N | No opposition filed |
Effective date: 20140731 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140314 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602006039029 Country of ref document: DE Effective date: 20140731 |
|
| GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20140314 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20141128 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140331 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140331 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140331 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140314 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140314 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R088 Ref document number: 602006039029 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20140131 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20060314 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20131030 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20190220 Year of fee payment: 14 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602006039029 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20201001 |