EP1112625B1 - Verfahren zur kodierung von informationsignalen - Google Patents

Verfahren zur kodierung von informationsignalen Download PDF

Info

Publication number
EP1112625B1
EP1112625B1 EP99943854A EP99943854A EP1112625B1 EP 1112625 B1 EP1112625 B1 EP 1112625B1 EP 99943854 A EP99943854 A EP 99943854A EP 99943854 A EP99943854 A EP 99943854A EP 1112625 B1 EP1112625 B1 EP 1112625B1
Authority
EP
European Patent Office
Prior art keywords
positions
pulse
pulses
speech
signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP99943854A
Other languages
English (en)
French (fr)
Other versions
EP1112625A1 (de
EP1112625A4 (de
Inventor
James P. Ashley
Weimin Peng
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Motorola Solutions Inc
Original Assignee
Motorola Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Motorola Inc filed Critical Motorola Inc
Publication of EP1112625A1 publication Critical patent/EP1112625A1/de
Publication of EP1112625A4 publication Critical patent/EP1112625A4/de
Application granted granted Critical
Publication of EP1112625B1 publication Critical patent/EP1112625B1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G10L19/12—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G10L19/10—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a multipulse excitation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G10L19/10—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a multipulse excitation
    • G10L19/107—Sparse pulse excitation, e.g. by using algebraic codebook

Definitions

  • the present invention relates, in general, to communication systems and, more particularly, to coding information signals in such communication systems.
  • CDMA communication systems are well known.
  • One exemplary CDMA communication system is the so-called IS-95 which is defined for use in North America by the Telecommunications Industry Association (TIA).
  • TIA Telecommunications Industry Association
  • EIA Electronic Industries Association
  • a variable rate speech codec, and specifically Code Excited Linear Prediction (CELP) codec, for use in communication systems compatible with IS-95 is defined in the document known as IS-127 and titled Enhanced Variable Rate Codec, Speech Service Option 3 for Wideband Spread Spectrum Digital Systems, September 1996. IS-127 is also published by the Electronic Industries Association (EIA), 2001 Eye Street, N.W., Washington, D.C. 20006.
  • EIA Electronic Industries Association
  • the invention is defined by a method claim 1.
  • constraints on position combinations among two or more pulses are implemented. By placing constraints on position combinations, certain combinations of pulses are prohibited which allows the most significant pulses to always be coded, thereby improving speech quality.
  • a list of pulse pairs (codebook) which can be indexed using a single, predetermined bit length codeword is produced. The codeword is transmitted to a destination where it is used by a decoder to reconstruct the original information signal.
  • a method for coding an information signal comprises the steps of dividing the information signal into blocks and deriving a target signal based on a block of the information signal.
  • the method further includes the steps of coding the target signal using pulse positioning techniques based on an error criteria, wherein the allowable positions of a given pulse are dependent on the positions of one or more other pulses, to produce coded pulse positions and transmitting the coded pulse positions to a destination.
  • the information signal further comprises a speech signal or an audio signal and a block of the information signals further comprise a frame or a subframe of the information signals.
  • the error criteria further comprises a perceptually weighted squared error criteria and the allowable pulse positions are determined using an arbitrary closed-form expression F ( ⁇ ), in which at least one of the conditions within the expression pertain to at least two of the elements within ⁇ .
  • FIG. 1 generally depicts a Code Excited Linear Prediction (CELP) decoder 100 as is known in the art.
  • CELP Code Excited Linear Prediction
  • the excitation sequence or "codevector" c k is generated from a fixed codebook 102 (FCB) using the appropriate codebook index k.
  • This signal is scaled using the FCB gain factor ⁇ and combined with a signal E(n) output from an adaptive codebook 104 (ACB) and scaled by a factor ⁇ , which is used to model the long term (or periodic) component of a speech signal (with period r).
  • the signal E t (n) which represents the total excitation, is used as the input to the LPC synthesis filter 106, which models the coarse short term spectral shape, commonly referred to as "formants".
  • the output of the synthesis filter 106 is then perceptually postfiltered by perceptual postfilter 108 in which the coding distortions are effectively "masked” by amplifying the signal spectra at frequencies that contain high speech energy, and attenuating those frequencies that contain less speech energy. Additionally, the total excitation signal E l (n) is used as the adaptive codebook for the next block of synthesized speech.
  • FIG. 2 generally depicts a CELP encoder 200.
  • H zs (z) is the "zero state" response of H(z) from filter 206, in which the initial state of H(z) is all zeroes
  • H ZIR (z) is the "zero input response" of H(z) from filter 210, in which the previous state of H(z) is allowed to evolve with no input excitation.
  • the initial state used for generation of H ZIR ( z ) is derived from the total excitation E t (n) from the previous subframe.
  • FCB fixed codebook
  • Eq. 4 can also be expressed in vector-matrix form as: min k ⁇ ( x w ⁇ ⁇ k H c k ) T ( x w ⁇ ⁇ k H c k ) ⁇ , 0 ⁇ k ⁇ M , where c k and x w are length L column vectors, H is the L x L zero-state convolution matrix: and T denotes the appropriate vector or matrix transpose.
  • index k corresponding to the codevector c k that results in the minimum squared error between the perceptually weighted target signal x w ( n ) and the perceptually weighted excitation signal x ⁇ w ( n ) can be found by maximizing the term in Eq. 12.
  • the FCB utilizes a multipulse configuration in which the excitation vector c k contains very few non-zero, unit magnitude values.
  • This configuration is known in the art as Algebraic CELP, or ACELP. Since there are very few non-zero elements within c k , the computational complexity involved with Eq. 12 is relatively low.
  • an associated "track” defines the allowable positions for each of the three pulses within c k (3 bits per pulse plus 1 bit for composite sign of +, -, + or -, +, -).
  • pulse 1 can occupy positions 0, 7, 14, ..., 49
  • pulse 2 can occupy positions 2, 9, 16, ..., 51
  • pulse 3 can occupy positions 4, 11, 18, ....53. This is known as "interleaved pulse permutation", which is well known in the art.
  • the sign bit is then set according to the sign of the gain term ⁇ k .
  • Table 1 generally depicts pulse positions defined for IS-127 Rate 1/2.
  • the excitation codevector c k can contain "holes" in which certain positions are not represented by the vector space. That is, an optimal match to the target vector may require a pulse at position 12, but the definitions of the pulse positions in Table I does not allow a pulse to be located at that position.
  • the constraints on positions may cause the pulse to be placed either at locations close to the optimal position, or worse, the energy of the target signal may be completely missed at that position. This can cause distortion, and possibly audible artifacts in the synthesized speech signal.
  • the bit allocation of 16 bits would be divided between the four tracks equally so that each track would receive four bits.
  • the four bits per track would further be composed of three bits for position (comprising 8 different positions) and one sign bit to indicate the polarity of the pulse.
  • Codeword 11 ⁇ p i 5 ⁇ + ⁇ p j 5 ⁇ , where p i and p j are the positions of the i-th and j -th pulses, and ⁇ x ⁇ represents the largest integer ⁇ x .
  • all positions are not adequately represented by the vector space which would allow efficient, low rate coding of pulse positions.
  • design of an efficient 16 bit, 4 pulse, 56 position codebook (with all positions representable) is not readily achievable in the prior art.
  • a method is presented which allows all pulse positions to be coded, while maintaining the design constraints as presented in the previous example.
  • the present invention provides a general flexibility which allows efficient solutions to a wide variety of design constraints.
  • the present invention solves the aforementioned problems by placing constraints on position combinations among two or more pulses.
  • the allowable positions for a given pulse are jointly dependent on the associated positions of one or more other pulses.
  • FIG. 3 where a joint interleaved pulse permutation matrix in accordance with the invention is shown.
  • the respective positions of pulse 0 are shown along the horizontal axis, and the positions of pulse 1 are shown along the vertical axis.
  • the "forbidden" pulse combinations are designated by the shaded regions while the allowable combinations are unshaded.
  • FIG. 4 generally depicts a flow chart describing how the codebook is generated in accordance with the invention.
  • the flowchart shows a basic nested loop structure in which all permutations of 0 ⁇ i ⁇ M and 0 ⁇ j ⁇ N are generated.
  • N and M are the total number of allowable positions for each pulse.
  • This function returns a value of 1 for cases when the absolute value of the difference of i and j is an element of the given set; otherwise, a zero is returned. This is shown in step 403.
  • the elements of the given set correspond to the distances between the diagonal shaded elements of FIG. 3, and the expression is therefore sufficient in describing all necessary shaded regions.
  • the codebook index k is incremented at step 404, and the process continues until the entire codebook is filled via steps 400-401 and 405-408.
  • a similar technique would be used for generating position information for pulses p 2 and p 3 of the given example.
  • FIG. 5 generally depicts a joint interleaved pulse permutation matrix for pulses p 2 and p 3 in accordance with the present invention. As shown in FIG.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Paper (AREA)
  • Control Of El Displays (AREA)
  • Control Of Motors That Do Not Use Commutators (AREA)
  • Reduction Or Emphasis Of Bandwidth Of Signals (AREA)
  • Transmission Systems Not Characterized By The Medium Used For Transmission (AREA)

Claims (4)

  1. Verfahren zum Codieren eines Sprach- oder Audiosignals, basierend auf linearer Prädiktion, umfassend die Schritte:
    a.) Unterteilen des Sprach- oder Audiosignals in Blöcke;
    b.) Ableiten eines Zielsignals, basierend auf einer Repräsentation der Differenz zwischen einer gewichteten Version des Sprach- oder Audiosignals und einer gewichteten, synthetisierten Version des erwünschten Signals durch lineare Prädiktion aus einem Block des Informationssignals;
    c.) gekennzeichnet durch Codieren des Zielsignals unter Verwendung von Pulspositionierungstechniken, basierend auf einem Fehlerkriterium, wobei die erlaubten Positionen eines gegebenen Pulses abhängig sind von den Positionen eines oder mehrerer anderer Pulse, um codierte Pulspositionen zu erzeugen; und
    d.) Senden der codierten Pulspositionen an ein Bestimmungsziel.
  2. Verfahren nach Anspruch 1, wobei ein Block der Informationssignale weiter einen Rahmen oder einen Subrahmen der Informationssignale umfasst.
  3. Verfahren nach Anspruch 1, wobei das Fehlerkriterium ein wahrnehmungsgewichtetes Fehlerquadratkriterium umfasst.
  4. Verfahren nach Anspruch 1, wobei die erlaubten Pulspositionen unter Verwendung eines beliebigen, geschlossenen Ausdrucks F(λ) bestimmt werden, in dem wenigstens eine der Bedingungen innerhalb des Ausdrucks wenigstens zwei der Elemente innerhalb λ betrifft.
EP99943854A 1998-09-11 1999-08-24 Verfahren zur kodierung von informationsignalen Expired - Lifetime EP1112625B1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15143098A 1998-09-11 1998-09-11
US151430 1998-09-11
PCT/US1999/019217 WO2000016501A1 (en) 1998-09-11 1999-08-24 Method and apparatus for coding an information signal

Publications (3)

Publication Number Publication Date
EP1112625A1 EP1112625A1 (de) 2001-07-04
EP1112625A4 EP1112625A4 (de) 2004-06-16
EP1112625B1 true EP1112625B1 (de) 2006-05-31

Family

ID=22538745

Family Applications (1)

Application Number Title Priority Date Filing Date
EP99943854A Expired - Lifetime EP1112625B1 (de) 1998-09-11 1999-08-24 Verfahren zur kodierung von informationsignalen

Country Status (6)

Country Link
EP (1) EP1112625B1 (de)
JP (1) JP4460165B2 (de)
KR (1) KR100409167B1 (de)
AT (1) ATE328407T1 (de)
DE (1) DE69931641T2 (de)
WO (1) WO2000016501A1 (de)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6539349B1 (en) 2000-02-15 2003-03-25 Lucent Technologies Inc. Constraining pulse positions in CELP vocoding
US7889103B2 (en) * 2008-03-13 2011-02-15 Motorola Mobility, Inc. Method and apparatus for low complexity combinatorial coding of signals

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2579356B1 (fr) * 1985-03-22 1987-05-07 Cit Alcatel Procede de codage a faible debit de la parole a signal multi-impulsionnel d'excitation
SE463691B (sv) * 1989-05-11 1991-01-07 Ericsson Telefon Ab L M Foerfarande att utplacera excitationspulser foer en lineaerprediktiv kodare (lpc) som arbetar enligt multipulsprincipen
US5754976A (en) * 1990-02-23 1998-05-19 Universite De Sherbrooke Algebraic codebook with signal-selected pulse amplitude/position combinations for fast coding of speech
JP3057907B2 (ja) * 1992-06-16 2000-07-04 松下電器産業株式会社 音声符号化装置
KR950011967B1 (ko) * 1992-07-31 1995-10-12 임홍식 반도체 녹음기용 메모리 정리 장치
JP3196595B2 (ja) * 1995-09-27 2001-08-06 日本電気株式会社 音声符号化装置
JP4063911B2 (ja) * 1996-02-21 2008-03-19 松下電器産業株式会社 音声符号化装置
US5970444A (en) * 1997-03-13 1999-10-19 Nippon Telegraph And Telephone Corporation Speech coding method
US5963897A (en) * 1998-02-27 1999-10-05 Lernout & Hauspie Speech Products N.V. Apparatus and method for hybrid excited linear prediction speech encoding
JP3180762B2 (ja) * 1998-05-11 2001-06-25 日本電気株式会社 音声符号化装置及び音声復号化装置
JP3824810B2 (ja) * 1998-09-01 2006-09-20 富士通株式会社 音声符号化方法、音声符号化装置、及び音声復号装置

Also Published As

Publication number Publication date
JP4460165B2 (ja) 2010-05-12
KR20010073146A (ko) 2001-07-31
DE69931641T2 (de) 2006-10-05
WO2000016501A1 (en) 2000-03-23
JP2002525667A (ja) 2002-08-13
ATE328407T1 (de) 2006-06-15
DE69931641D1 (de) 2006-07-06
EP1112625A1 (de) 2001-07-04
EP1112625A4 (de) 2004-06-16
KR100409167B1 (ko) 2003-12-12

Similar Documents

Publication Publication Date Title
US6236960B1 (en) Factorial packing method and apparatus for information coding
US6141638A (en) Method and apparatus for coding an information signal
US7280959B2 (en) Indexing pulse positions and signs in algebraic codebooks for coding of wideband signals
US5991717A (en) Analysis-by-synthesis linear predictive speech coder with restricted-position multipulse and transformed binary pulse excitation
DE69928288T2 (de) Kodierung periodischer sprache
US6055496A (en) Vector quantization in celp speech coder
US6470313B1 (en) Speech coding
EP2805324B1 (de) System und verfahren für gemischte codebuchanregung zur sprachcodierung
US6865534B1 (en) Speech and music signal coder/decoder
Salami et al. 8 kbit/s ACELP coding of speech with 10 ms speech-frame: A candidate for CCITT standardization
EP1130576A1 (de) Fehlerschutz für multimodalen Sprachkodierer
US6415252B1 (en) Method and apparatus for coding and decoding speech
EP1112625B1 (de) Verfahren zur kodierung von informationsignalen
Juan et al. An 8-kb/s conjugate-structure algebraic CELP (CS-ACELP) speech coding
JPH0519795A (ja) 音声の励振信号符号化・復号化方法
Bessette et al. Techniques for high-quality ACELP coding of wideband speech
US20050096903A1 (en) Method and apparatus for performing harmonic noise weighting in digital speech coders
JP3166697B2 (ja) 音声符号化・復号装置及びシステム
JP2853170B2 (ja) 音声符号化復号化方式
EP1892701A1 (de) Einspeisung eines Hochfrequenzgeräusches in eine Impulserregung für CELP mit niedriger Bitrate
Moulsley et al. Fast vector quantisation using orthogonal codebooks
Saleem et al. Implementation of Low Complexity CELP Coder and Performance Evaluation in terms of Speech Quality
Ravishankar et al. Voice Coding Technology for Digital Aeronautical Communications
JPH0291699A (ja) 音声符号化復号化方式
Lee et al. Encoding of Speech Spectral Parameters Using Adaptive Vector-Scalar Quantization Methods for Mobile Communication Systems

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20010411

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

A4 Supplementary search report drawn up and despatched

Effective date: 20040506

RIC1 Information provided on ipc code assigned before grant

Ipc: 7G 10L 19/10 B

Ipc: 7H 04B 7/216 A

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RTI1 Title (correction)

Free format text: METHOD FOR CODING AN INFORMATION SIGNAL

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060531

Ref country code: LI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060531

Ref country code: CH

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060531

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060531

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060531

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 69931641

Country of ref document: DE

Date of ref document: 20060706

Kind code of ref document: P

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060824

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060831

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060831

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20060831

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060911

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20061031

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20070301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060901

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060824

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070824

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20110127 AND 20110202

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 69931641

Country of ref document: DE

Owner name: MOTOROLA MOBILITY, INC. ( N.D. GES. D. STAATES, US

Free format text: FORMER OWNER: MOTOROLA, INC., SCHAUMBURG, ILL., US

Effective date: 20110324

REG Reference to a national code

Ref country code: FR

Ref legal event code: TP

Owner name: MOTOROLA MOBILITY, INC., US

Effective date: 20110912

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 18

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FI

Payment date: 20160831

Year of fee payment: 18

Ref country code: GB

Payment date: 20160830

Year of fee payment: 18

Ref country code: DE

Payment date: 20160826

Year of fee payment: 18

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20160825

Year of fee payment: 18

Ref country code: SE

Payment date: 20160829

Year of fee payment: 18

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20170831 AND 20170906

REG Reference to a national code

Ref country code: FR

Ref legal event code: TP

Owner name: GOOGLE TECHNOLOGY HOLDINGS LLC, US

Effective date: 20171214

Ref country code: FR

Ref legal event code: CD

Owner name: GOOGLE TECHNOLOGY HOLDINGS LLC, US

Effective date: 20171214

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 69931641

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20170824

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170825

Ref country code: FI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170824

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20180430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170824

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180301

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170831

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230520