EP2345029A1 - Critical sampling encoding with a predictive encoder - Google Patents
Critical sampling encoding with a predictive encoderInfo
- Publication number
- EP2345029A1 EP2345029A1 EP09755960A EP09755960A EP2345029A1 EP 2345029 A1 EP2345029 A1 EP 2345029A1 EP 09755960 A EP09755960 A EP 09755960A EP 09755960 A EP09755960 A EP 09755960A EP 2345029 A1 EP2345029 A1 EP 2345029A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- decoding
- coding
- predictive
- transform
- sequence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000005070 sampling Methods 0.000 title claims description 19
- 238000000034 method Methods 0.000 claims abstract description 48
- 239000013598 vector Substances 0.000 claims description 59
- 230000015572 biosynthetic process Effects 0.000 claims description 30
- 238000003786 synthesis reaction Methods 0.000 claims description 30
- 230000009466 transformation Effects 0.000 claims description 21
- 230000007704 transition Effects 0.000 claims description 17
- 238000004458 analytical method Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 10
- 230000005236 sound signal Effects 0.000 abstract description 8
- 239000011159 matrix material Substances 0.000 description 7
- 230000008901 benefit Effects 0.000 description 5
- 230000005284 excitation Effects 0.000 description 5
- 230000007774 longterm Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000002123 temporal effect Effects 0.000 description 4
- 238000000844 transformation Methods 0.000 description 4
- 101710084218 Master replication protein Proteins 0.000 description 3
- 101710112078 Para-Rep C2 Proteins 0.000 description 3
- 102100022880 Rab proteins geranylgeranyltransferase component A 2 Human genes 0.000 description 3
- 101710119961 Trans-acting factor C Proteins 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 3
- 101100468275 Caenorhabditis elegans rep-1 gene Proteins 0.000 description 2
- 241001362574 Decodes Species 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 230000001755 vocal effect Effects 0.000 description 2
- 101100515445 Arabidopsis thaliana MYB17 gene Proteins 0.000 description 1
- ATJFFYVFTNAWJD-UHFFFAOYSA-N Tin Chemical compound [Sn] ATJFFYVFTNAWJD-UHFFFAOYSA-N 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/022—Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L19/0212—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders using orthogonal transformation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
- G10L19/10—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a multipulse excitation
- G10L19/107—Sparse pulse excitation, e.g. by using algebraic codebook
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/16—Vocoder architecture
- G10L19/18—Vocoders using multiple modes
- G10L19/20—Vocoders using multiple modes using sound class specific coding, hybrid encoders or object based coding
Definitions
- the present invention relates to the field of coding digital signals.
- the invention advantageously applies to the coding of sounds with alternating speech and music.
- CELP Code Excited Linear Prediction
- transform coding techniques are preferred.
- CELP coders are predictive coders. They aim to model the production of speech from various elements: a long-term prediction to model the vibration of vocal chords in voiced period, a stochastic excitation (white noise, algebraic excitation), and a short prediction -term to model vocal tract changes.
- Transform coders use critical-sampling transforms to compact the signal in the transformed domain.
- a "critical-sampling transform” is a transform for which the number of coefficients in the transformed domain is equal to the number of coefficients of the digitized sound.
- AMR WB + One solution for effectively coding a signal containing these two types of content is to select the best technique over time. This solution has been recommended by the 3GPP ("3rd Generation Partnership Project") standardization organization, and a technique called AMR WB + has been proposed. This technique is based on CELP technology of the AMR WB type and transform coding based on a Fourier transform overlay.
- the overlapping Fourier transform is not a critical sampling transformation, and therefore, it is suboptimal.
- the windows used in this encoder are not optimal vis-à-vis the concentration of energy: the frequency forms of these windows are relatively fixed.
- TDAC Time Domain Aliasing Cancellation
- TDAC makes it possible to obtain excellent quality on the music. Nevertheless, this has the disadvantage of introducing temporal folds that make it difficult to combine with CELP type technologies.
- An object of the present invention is to propose a technique for reconstructing an audio signal, with good quality, by alternating transform coding techniques (for example with critical sampling) and predictive coding techniques (for example of the CELP type ).
- the present invention proposes a method of encoding a digital signal, comprising the steps:
- the folding created by the coding in the subsequence of the first sequence can be suppressed by means of samples of this subsequence resulting from the decoding of the sub-sequence within the second sequence.
- the second sequence can be decoded because the samples of the past, useful for predictive decoding, do not have this folding.
- the transform coding is a critical sampling transform coding.
- transform coding is a TDAC type transform coding.
- predictive coding is a CELP encoding.
- the transform coding of the first sequence comprises the application of an analysis window making it possible to deduce from a perfect reconstruction relation of the digital signal a synthesis window comprising at least three parts: a first nominal part,
- substantially continuous means that the third part makes it possible to have no discontinuity between the first and second parts. Indeed, this type of discontinuity reduces the quality of decoding by adding decoding noise.
- the perfect reconstruction relation imposes a relation between the forms of the windows of analysis and synthesis.
- the relation of reconstruction makes appear a direct relation between the two forms.
- the additional number of samples is related to the size of the intermediate part.
- the middle part is a sinus arch.
- the intermediate part is a function derived from "Kaiser-Bessel". In addition, it can come from a window optimization calculation and not have an explicit expression.
- the summary window is an asymmetric window.
- the synthesis window further comprises a fourth continuous initial portion between a substantially zero value and a non-zero value of the first part.
- the fourth part of the synthesis window is a smooth transition between an initial value and a value of the nominal part
- the third part is an abrupt transition between a value of the nominal part and a value of the substantially zero part.
- the first and second sequences belong to the same frame of the digital signal.
- the encoding of the first sequence can be used as a transition encoding after the encoding of a frame by transform coding. This makes it possible to improve the coding efficiency by not disturbing this frame.
- the present invention also provides a method for decoding a digital signal, comprising the steps of:
- step b) decoding at least in the prediction vector the subsequence common to the first and second sequences at least by a predictive decoding based on at least one sample from step a);
- step b) comprises the sub-steps:
- step b) decoding in the predictive vector the common subsequence to the first and second sequences by a predictive decoding based on at least one sample from step a);
- step b3) decoding the common subsequence to the first and second sequences by combining at least one sample from step b1) with a corresponding sample from step b2).
- the combination is a linear combination.
- step b) comprises the sub-steps:
- step b7) decoding the common subsequence to the first and second sequences by combining at least one sample from step b5) with a corresponding sample from step b6).
- step b5) corresponds exactly to the folding present in the decoded subsequence.
- the creation of the folding can be done by applying a matrix representing direct and inverse transformation operations.
- a matrix representing direct and inverse transformation operations.
- Such a matrix may be equivalent to the application of transform coding immediately followed by transform decoding.
- the same transform coding / decoding can be used, with the same analysis and synthesis windows, whenever such coding / decoding is performed.
- step a) comprises the application of a synthesis window comprising at least three parts:
- the present invention provides a computer program comprising instructions for implementing the encoding method as described, when the program is executed by a processor.
- the present invention aims a support readable by a computer on which is recorded such a computer program.
- the present invention also provides a computer program comprising instructions for implementing the decoding method as described, when the program is executed by a processor.
- the present invention aims a support readable by a computer on which is recorded such a computer program.
- the present invention provides a coding entity adapted to implement the coding method as described.
- Such a coding entity of a digital audio signal may comprise:
- transform encoder for encoding a first sequence of samples of the digital audio signal according to transform coding
- a predictive encoder for encoding a second sequence of samples of the digital audio signal according to a predictive encoding; it is expected that the second sequence begins before the end of the first sequence, a subsequence common to the first and second sequences thus being encoded by both predictive coding and transform coding.
- the present invention provides a decoding entity adapted to implement the decoding method as described.
- a prediction vector encoding a second sequence of samples of the digital signal according to a predictive coding
- a first decoder for applying to the transformed vector an inverse transformation of the transform coding for decoding a subsequence of the first non-coded sequence by predictive coding
- a second decoder for decoding at least in the predictive vector the subsequence common to the first and second sequences by at least one predictive decoding based on at least one sample derived from the first transform decoder; and a third predictive decoder for decoding in the predictive vector by a predictive decoding a subsequence of the second non-coded sequence by transform coding, based on at least one sample derived from one of the first and second coders.
- the second decoder comprises:
- third means for decoding the common subsequence to the first and second sequences by combining at least one sample from the first means with a corresponding sample from the second means.
- the second decoder comprises:
- fourth means for creating, from at least one sample returned by the first means, a sample containing folding equivalent to transform coding followed by transform decoding
- sixth means for decoding the common subsequence to the first and second sequences by combining at least one sample from the fourth means with a corresponding sample from the fifth means.
- encoders / decoders described may comprise a signal processor, storage elements, as well as means of communication between these elements.
- the present invention thus makes it possible to alternate transformation coding techniques, for example with TDAC-type critical sampling, and predictive coding techniques, for example of the CELP type over time in order to obtain a good quality of reconstruction.
- the invention proposes particular temporal relations between the two types of coding: the time position of the CELP and transformed frames being temporally offset.
- the invention also proposes extending the duration of the frames, or sequences covered by the CELP coding, by an overlap, during a transition from transform to CELP. This duration can be variable in time if the transform requires a good frequency concentration.
- the duration of use of the CELP coding can be variable from one frame to another, in order to quickly adapt the coding technique to changes in the nature of the sounds.
- a frame of M samples can be subdivided into several subframes mixing portions encoded in CELP and others in the transformed domain.
- the invention finds its application in sound coding systems, in particular in standardized speech coders, in particular to the ITU ("International Telecommunications Union") or to the ISO ("International Standard Organization") for coding generic sounds, including speech signals.
- ITU International Telecommunications Union
- ISO International Standard Organization
- FIG. 1 illustrates two windows of synthesis of a transform coding
- FIG. 2 illustrates synthetic windows of one embodiment of the invention
- FIG. 3 illustrates data frames processed by synthesis windows
- FIG. 4 illustrates sample vectors obtained by application of synthesis windows
- FIG. 5 illustrates the case of a TDAC coding followed by an AMR WB coding, followed by a TDAC coding according to one embodiment of the invention
- FIG. 6 illustrates the same case of coding with an advantageous asymmetric window
- FIG. 7 illustrates a general context of a problem solved by the invention
- FIG. 8 illustrates a general scheme for solving this problem by the present invention
- FIG. 9 illustrates the steps of an embodiment of a coding method according to the invention.
- FIG. 10 illustrates the composition of a synthesis window according to one embodiment of the invention
- FIG. 11 illustrates the steps of an embodiment of a decoding method according to the present invention
- FIG. 12 illustrates an advantageous decoding used in the decoding method
- FIG. 13 illustrates a variant of this advantageous decoding
- FIG. 14 illustrates an encoder according to one embodiment of the invention
- FIG. 15 illustrates a decoder according to one embodiment of the invention
- FIG. 16 illustrates a hardware device adapted to produce an encoder or a decoder according to an embodiment of the present invention.
- a digitized sound signal is considered according to a sampling period - (F e being the sampling frequency).
- M represents the size of the transform
- the following inverse transform, at decoding is applied in order to reconstruct the samples O ⁇ n ⁇ M which are then in a recovery zone of two consecutive transforms.
- the decoded samples are then given by:
- J M is the anti-identity square matrix of size M, which, at a series of increasing index values, returns the same series of values with the decreasing indices
- - 0 M is a square matrix of size M containing only zeros.
- the synthesis is illustrated by an example in FIG. 1.
- two inverse transforms of size M h s o and h s i are passed.
- M 0 a given integer value between 1 and M-I.
- h s o (n) will be taken as symmetric in this area of h s i to obtain the perfect reconstruction.
- h s i can be defined also by a function of "Kaiser
- a first frame T30 (windowed by h s o) combined with the frame T3 1 (windowed by hs l) makes it possible to reconstruct the segment from M to 2M-1, the frames T3 1 and T33 enabling 'get the samples 2M to 3M- 1 etc.
- the critical sampling is respected and the reconstruction is perfect insofar as the analysis and synthesis filters verify the necessary condition.
- h s o contains zeros between M + (M + M 0 ) / 2 and 2M-1
- h a i contains zeros between 0 and (MM o ) / 2.
- the vector * o, M + n contains 3 zones:
- - x l ⁇ does not contain folding components between (M + Mo) / 2 and M-I, and the central zone around M / 2 for which there are folded components.
- a converted type coding using TDAC is alternated with a time-type coding which consists of a CELP coder (for example according to AMR recommendation WB).
- the AMR WB coding is based on a prediction of the periodicity of the signal, termed long-term prediction. As such, it builds its samples as follows
- the signal r is constructed with respect to old samples taken upstream of T samples weighted by a gain, transmitted and updated periodically, and a so-called stochastic part W n assigned a gain b, transmitted and updated also over time. T represents the pitch.
- the AMR encoder WB estimates the components a, b and T and the part W n to be added according to the flow rate considered.
- the CELP decoder uses past samples that should not have artifacts.
- the frame T51 is coded in TDAC, there will be folding in the samples between M + (M-MQ) H and M + (M + Mo) / 2 as long as the frame T52 will not be restored with the folding to delete that of the frame T51.
- the area of coverage of the samples transmitted by this coding is widened to cover the initial transition zone completely.
- the duration of the CELP is extended to the content of index M + (M-Mo) / 2 ... 5M / 2.
- the zone M 0 is limited in duration in order to avoid transmitting too much additional information.
- M 0 is around 1 to 2 ms for a frame of duration M corresponding to 20 ms.
- the number of samples is calculated based on the sampling frequency.
- Mo / 2 as a duration proportional to a subframe of CELP, that is to say the usual duration of updating pitch / gain values and stochastic vector, where a size adapted to fast algorithms for the search of the stochastic vector and its transmission effectively. For example, we take a power of 2.
- the period between M and (M-Mo) / 2 is reconstructed using the inverse transform of a frame T50 (not shown) preceding the frame T51. Then the area between M + (M-Mo) / 2 and M-I is reconstructed with the CELP alone which is based for the long term on the samples returned by the transformed part.
- ⁇ a set of positive or zero coefficients less than or equal to one.
- the portion 2M, ... 3M-1 is decoded using the end of the CELP samples transmitted between the indices 2M to 5M / 2. Then, in
- the samples from the following transform are reconstructed in the overlap area, which contains folding in a similar manner to the overlap area between the frames T51 and T52.
- the window hs i may be asymmetrical.
- the overlap zone between the CELP and TDAC part, denoted M 0 ', may be different from M 0 .
- the CELP frame covers a duration equal to the size M + Mo / 2 as presented in FIG. 4. According to the AMR standard WB, this frame is divided into sub segments, of size denoted Mc in FIG. , allowing a frequent update of the parameters making it possible to synthesize a signal CELP of quality. Thus the values of pitch, gain and the stochastic part are initially transmitted and updated optionally.
- the length of the first sub-segment (Mc ') immediately following the transform may be different if it is desired to use an arbitrary length Mo' with a standard CELP encoder with Mc imposed by this standard.
- the pitch can be estimated on the decoded part before the sample of index M + (M-Mo) / 2. Thus, it is possible to avoid transmitting the initial pitch, only the pitch gain that is estimated according to the common method presented in AMR recommendation WB is transmitted.
- the pitch gain is not transmitted. It is estimated on the decoded signal in the transformed part.
- the pitch estimate can be performed by including the period M + (M-Mo) / 2 to M + (M + Mo) / 2 which contains folded components.
- the stochastic part is transmitted in preamble, or ignored. And this, especially if it is considered negligible because of its low power, or if during the reconstruction is based on the version using the weighting a n .
- the portion of duration Mo / 2 covered by the CELP can therefore be a specialized part, in that it can benefit from the information resulting from the complete decoding of the part resulting from the previous transform.
- the CELP encoding covers a shorter length than the base frame of length M.
- the covered portion by the samples M + (MM / 2) / 2 to 2M + M / 16 is encoded from a transform of a size shorter than the initial size (M / 2).
- the frames T61, T62 and T64 are represented in the transformed domain of the TDAC.
- the frames T61 and T64 are encoded with transformations of length M (windows h 6 ⁇ and h 64 ), the frame T62 being encoded with a transform of size M / 2 (window h 62 ).
- This coding is effective because the window h 6 i is relatively soft, which allows to obtain a better concentration of energy in the frequency domain.
- the h 62 window has a steeper transition in the vicinity of the 2M sample, but this steep window does not penalize the quality of the coding too much because temporally the duration affected is short.
- a frame of length M can be subdivided into subparts coded in CELP or TDAC of variable size.
- LPC synthesis filters can optionally be applied to restore the sound signal if necessary.
- the filter Hd e - emph (z) is a high frequency de-emphasis filter.
- the CELP coder operates it, that is to say that the excitation signal r n will be well calculated in the residual domain of a linear prediction filter A (z). Special attention will be paid for the signal synthesized by the first inverse transform, and which is therefore in a perceptually weighted domain, is returned to the field of CELP excitation, so that the long-term portion of the CELP excitation can be calculated.
- the samples are coded from 0 to 2M-1 by transform coding according to a transformed vector X o .
- samples of M to 3M-1 are coded by transform coding according to a transformed vector Xf.
- Decoding of this transformed vector gives the samples from M to 3M-1 of the decoded signal *.
- This decoding shows the same folding with a sign opposite REP 1 in the samples from M to 2M-1 as during the decoding of x £. It also shows REP2 folding in samples from 2M to 3M-1 in *.
- DELPR_REP delete
- the samples of 3M to 4M-1 of x are then coded by predictive coding according to the prediction vector X ⁇ .
- this vector requires knowledge of previous samples. That is to say the samples from 2M to 3M-1. These samples are available at the decoding of X, r , nevertheless they are unusable because of the presence of REP2 folding.
- REP2 folding requires knowledge of x samples from 2M to 3M-1 to recreate the folding and delete it by combination.
- these samples are not available for decoding.
- the prior art proposes to communicate to the decoder the samples it needs in addition to the vectors from the transform and the prediction part.
- the present invention proposes the solution illustrated in FIG.
- the prediction vector X ⁇ encodes a number M of samples comprising part of the samples coded by xj.
- This arrangement makes it possible to reconstruct the signal x at decoding.
- the samples preceding the REP folding creates the decoding of X
- r are used for the decoding of the first samples that the decoding of X ⁇ will make it possible to obtain. That is, those he has in common with x, ⁇ .
- samples of x are retrieved to recreate REP folding.
- the samples of x corresponding to REP are subjected to coding followed by a decoding identical to those undergone by the samples from M to 3M-1.
- the completely decoded M to 3M-1 samples can be used to decode x £.
- step S90 samples of a signal to be coded are received.
- step S91 two sample sequences are delimited, so that the second sequence begins before the end of the first sequence.
- a first sequence SEQ 1 and a second sequence SEQ 2 are thus obtained.
- Each of these sequences is then coded according to a transform coding in step S93 for SEQ 1, and according to a predictive coding in step S94 for SEQ2.
- the synthesis window H is described. This window comprises four particular parts.
- INIT corresponds to the initial part of the filter, one chooses this part according to the coding of the preceding samples. For example, here, H makes it possible to reconstitute a part of SEQ 1 (samples 0 to M-I). If the samples preceding SEQ 1 are coded by transform, we advantageously choose INIT as a smooth transition. This makes it possible not to disturb these previous samples.
- NOMI corresponds to a nominal part.
- this portion takes a substantially constant value.
- NL corresponds to a substantially zero portion of the window.
- the duration of NL (or the number of coefficients of NL) can advantageously be chosen as a function of the duration (or number of coefficients) of NOMI.
- the INTER part is a continuous part between NOMI and NL.
- This part can have a shape adapted to the transition between the transform coding of SEQ1 and the predictive encoding of SEQ2. For example, it's a relatively abrupt transition.
- SEQ1 of SEQ1 which does not include a sample of S-SEQ, the subsequence common to SEQ1 and SEQ2. INTER is applied to S-SEQ.
- steps S101 and S111 a transformed vector containing samples S-SEQ1 * encoding S-SEQ1, and a prediction vector comprising S-SEQ * samples encoding S-SEQ and S-SEQ2 * samples encoding S-, are respectively received.
- step S 112 an inverse transform is applied to the S-SEQl * samples.
- it is an H-type window.
- step S11 comprising additional decoding operations to obtain S-SEQ1.
- step S14 S-SEQ1 is decoded by step S13 and S-SEQ *. At least by predictive decoding, at step S14 S-SEQ is decoded.
- step S 115 S-SEQ decoded in step S14 and S-SEQ2 * is received and then S-SEQ2 is decoded by predictive decoding. If necessary, it is also possible to use S-SEQ1 decoded in step S113.
- step S 114 An embodiment of step S 114 is described with reference to FIG. In this embodiment, both transform decoding and predictive decoding are involved.
- step S 120 S-SEQ 1 (from S14) and S-SEQ * are received, and then S-SEQ is decoded by predictive decoding. We obtain S-SEQ '.
- step S 121 an inverse transform (for example that already applied to S-SEQ 1 * to obtain S-SEQ 1) is applied to S-SEQ 1 *.
- S-SEQ 1 * We obtain S-SEQ ".
- step S 122 a linear combination of the samples S-SEQ 'and S-SEQ "is performed to obtain S-SEQ.
- step S14 is described.
- step S 13 the same folding as S-SEQ "in S-SEQ 'is created, for which purpose the matrix S described above is applied.
- S-SEQ "corresponds to the decoding of S-SEQ * by transform in step S 132.
- S-SEQ '' and S-SEQ '' are combined in step S 133 to obtain S-SEQ.
- This coding entity comprises a processing unit 140 adapted to receive a digital signal GIS and to determine two sequences of samples: a first sequence comprising an S-SEQ subsequence common to both sequences, and a sub-sequence S-SEQ1, and a second sequence which begins before the end of the first sequence and which contains S-SEQ and an S-SEQ2 subsequence.
- the coding entity also comprises a transform coder 141, and a predictive coder 142. These coders are adapted to implement the steps of the coding method described above, and respectively deliver a transformed vector V_T encoding the first sequence and a prediction vector V_P encoding the second sequence.
- Communication means may be provided for exchanging signals between the encoders.
- This DECOD decoding entity comprises reception units 150 and 151 for respectively receiving a transformed vector V_T comprising samples S-SEQ 1 * encoding S-
- the unit 150 provides S-SEQ1 * to an inverse transform application unit 152.
- the unit 152 provides a result to a transform decode unit 153 for performing additional decoding operations. and provide S-SEQ l.
- the decoding unit 154 receives S-SEQ decoded by the unit 153, and S-SEQ * provided by the unit 151.
- the unit 154 decodes, at least by predictive decoding S-SEQ, and provided S-SEQ.
- DECOD includes a predictive decoding unit 155 for receiving S-SEQ provided by the unit 154, and S-SEQ2 * provided by the unit 151, then decoding S-SEQ2 by predictive decoding and providing S-SEQ2. If necessary, the unit 153 also provides S-SEQ 1 previously decoded by the unit 153.
- a computer program for comprising instructions for implementing the coding method described above could be established according to a general algorithm described in FIG. 9.
- This computer program could be executed in a processor of a coding entity as described above, to encode a signal with at least the same advantages as those provided by the coding method.
- This computer program could be executed in a processor of a decoding entity as described above, for decoding a signal with at least the same advantages as those provided by the decoding method.
- This device DISP comprises an input E to receive a digital signal SIG.
- the device also comprises a processor PROC of digital signals adapted to carry out coding / decoding operations in particular on a signal coming from the input E.
- This processor is connected to one or more memory units MEM adapted to store information necessary for driving. of the device for coding / decoding.
- these memory units include instructions for implementing the coding / decoding method described above.
- These memory units may also include calculation parameters or other information.
- the processor is also adapted to store results in these memory units.
- the device comprises an output S connected to the processor to provide an output signal SIG *.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0856822A FR2936898A1 (en) | 2008-10-08 | 2008-10-08 | CRITICAL SAMPLING CODING WITH PREDICTIVE ENCODER |
PCT/FR2009/051888 WO2010040937A1 (en) | 2008-10-08 | 2009-10-05 | Critical sampling encoding with a predictive encoder |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2345029A1 true EP2345029A1 (en) | 2011-07-20 |
EP2345029B1 EP2345029B1 (en) | 2015-04-22 |
Family
ID=40457007
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP09755960.3A Active EP2345029B1 (en) | 2008-10-08 | 2009-10-05 | Method, computer program and device for decoding a digital audio signal |
Country Status (6)
Country | Link |
---|---|
US (1) | US8880411B2 (en) |
EP (1) | EP2345029B1 (en) |
CN (1) | CN102177544B (en) |
ES (1) | ES2542067T3 (en) |
FR (1) | FR2936898A1 (en) |
WO (1) | WO2010040937A1 (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
PL4120248T3 (en) * | 2010-07-08 | 2024-05-13 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Decoder using forward aliasing cancellation |
FR2969805A1 (en) | 2010-12-23 | 2012-06-29 | France Telecom | LOW ALTERNATE CUSTOM CODING PREDICTIVE CODING AND TRANSFORMED CODING |
FR2992766A1 (en) * | 2012-06-29 | 2014-01-03 | France Telecom | EFFECTIVE MITIGATION OF PRE-ECHO IN AUDIONUMERIC SIGNAL |
EP2951821B1 (en) * | 2013-01-29 | 2017-03-01 | Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. | Concept for coding mode switching compensation |
FR3024582A1 (en) * | 2014-07-29 | 2016-02-05 | Orange | MANAGING FRAME LOSS IN A FD / LPD TRANSITION CONTEXT |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6134518A (en) * | 1997-03-04 | 2000-10-17 | International Business Machines Corporation | Digital audio signal coding using a CELP coder and a transform coder |
US6233550B1 (en) * | 1997-08-29 | 2001-05-15 | The Regents Of The University Of California | Method and apparatus for hybrid coding of speech at 4kbps |
ATE302991T1 (en) * | 1998-01-22 | 2005-09-15 | Deutsche Telekom Ag | METHOD FOR SIGNAL-CONTROLLED SWITCHING BETWEEN DIFFERENT AUDIO CODING SYSTEMS |
US6947888B1 (en) * | 2000-10-17 | 2005-09-20 | Qualcomm Incorporated | Method and apparatus for high performance low bit-rate coding of unvoiced speech |
US6658383B2 (en) * | 2001-06-26 | 2003-12-02 | Microsoft Corporation | Method for coding speech and music signals |
US6785645B2 (en) * | 2001-11-29 | 2004-08-31 | Microsoft Corporation | Real-time speech and music classifier |
US20030220800A1 (en) * | 2002-05-21 | 2003-11-27 | Budnikov Dmitry N. | Coding multichannel audio signals |
WO2004029935A1 (en) * | 2002-09-24 | 2004-04-08 | Rad Data Communications | A system and method for low bit-rate compression of combined speech and music |
FR2867649A1 (en) * | 2003-12-10 | 2005-09-16 | France Telecom | OPTIMIZED MULTIPLE CODING METHOD |
CA2457988A1 (en) * | 2004-02-18 | 2005-08-18 | Voiceage Corporation | Methods and devices for audio compression based on acelp/tcx coding and multi-rate lattice vector quantization |
JP2007538281A (en) * | 2004-05-17 | 2007-12-27 | ノキア コーポレイション | Speech coding using different coding models. |
US7596486B2 (en) * | 2004-05-19 | 2009-09-29 | Nokia Corporation | Encoding an audio signal using different audio coder modes |
US7751572B2 (en) * | 2005-04-15 | 2010-07-06 | Dolby International Ab | Adaptive residual audio coding |
US7418394B2 (en) * | 2005-04-28 | 2008-08-26 | Dolby Laboratories Licensing Corporation | Method and system for operating audio encoders utilizing data from overlapping audio segments |
WO2007139911A2 (en) * | 2006-05-26 | 2007-12-06 | Surroundphones Holdings, Inc. | Digital audio encoding |
JP2008096906A (en) * | 2006-10-16 | 2008-04-24 | Matsushita Electric Ind Co Ltd | Audio signal decoding device and resource access control method |
CA2672165C (en) * | 2006-12-12 | 2014-07-29 | Ralf Geiger | Encoder, decoder and methods for encoding and decoding data segments representing a time-domain data stream |
SG170078A1 (en) * | 2006-12-13 | 2011-04-29 | Panasonic Corp | Encoding device, decoding device, and method thereof |
CN101025918B (en) * | 2007-01-19 | 2011-06-29 | 清华大学 | Voice/music dual-mode coding-decoding seamless switching method |
CN101231850B (en) * | 2007-01-23 | 2012-02-29 | 华为技术有限公司 | Encoding/decoding device and method |
CN101221766B (en) * | 2008-01-23 | 2011-01-05 | 清华大学 | Method for switching audio encoder |
AU2009267518B2 (en) * | 2008-07-11 | 2012-08-16 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Apparatus and method for encoding/decoding an audio signal using an aliasing switch scheme |
-
2008
- 2008-10-08 FR FR0856822A patent/FR2936898A1/en not_active Withdrawn
-
2009
- 2009-10-05 EP EP09755960.3A patent/EP2345029B1/en active Active
- 2009-10-05 WO PCT/FR2009/051888 patent/WO2010040937A1/en active Application Filing
- 2009-10-05 US US13/120,473 patent/US8880411B2/en active Active
- 2009-10-05 CN CN200980140384.4A patent/CN102177544B/en active Active
- 2009-10-05 ES ES09755960.3T patent/ES2542067T3/en active Active
Non-Patent Citations (1)
Title |
---|
See references of WO2010040937A1 * |
Also Published As
Publication number | Publication date |
---|---|
FR2936898A1 (en) | 2010-04-09 |
EP2345029B1 (en) | 2015-04-22 |
US20110178809A1 (en) | 2011-07-21 |
WO2010040937A1 (en) | 2010-04-15 |
US8880411B2 (en) | 2014-11-04 |
ES2542067T3 (en) | 2015-07-30 |
CN102177544A (en) | 2011-09-07 |
CN102177544B (en) | 2014-07-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1989706B1 (en) | Device for perceptual weighting in audio encoding/decoding | |
EP2104936B1 (en) | Low-delay transform coding using weighting windows | |
CA2766777C (en) | Allocation of bits in an enhancement coding/decoding for improving a hierarchical coding/decoding of digital audio signals | |
EP3175444B1 (en) | Frame loss management in an fd/lpd transition context | |
EP3161659A1 (en) | Resampling of an audio signal by interpolation for low-delay encoding/decoding | |
FR2929466A1 (en) | DISSIMULATION OF TRANSMISSION ERROR IN A DIGITAL SIGNAL IN A HIERARCHICAL DECODING STRUCTURE | |
EP3103116B1 (en) | Improved frequency band extension in an audio signal decoder | |
EP2452336B1 (en) | Improved coding /decoding of digital audio signals | |
EP3069340B1 (en) | Transition from a transform coding/decoding to a predictive coding/decoding | |
EP2489039A1 (en) | Optimized low-throughput parametric coding/decoding | |
EP2345029B1 (en) | Method, computer program and device for decoding a digital audio signal | |
EP3175443B1 (en) | Determining a budget for lpd/fd transition frame encoding | |
EP2232489B1 (en) | Transform-based coding/decoding, with adaptive windows | |
EP1275109B1 (en) | Spectral enhancing method and device | |
FR3133265A1 (en) | Optimized encoding and decoding of an audio signal using a neural network-based autoencoder | |
EP2589045B1 (en) | Adaptive linear predictive coding/decoding | |
FR2911227A1 (en) | Digital audio signal coding/decoding method for telecommunication application, involves applying short and window to code current frame, when event is detected at start of current frame and not detected in current frame, respectively | |
FR2980620A1 (en) | Method for processing decoded audio frequency signal, e.g. coded voice signal including music, involves performing spectral attenuation of residue, and combining residue and attenuated signal from spectrum of tonal components |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20110421 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA RS |
|
DAX | Request for extension of the european patent (deleted) | ||
17Q | First examination report despatched |
Effective date: 20120308 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: ORANGE |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602009030802 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G10L0019020000 Ipc: G10L0019080000 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 19/107 20130101ALN20141024BHEP Ipc: G10L 19/08 20130101AFI20141024BHEP Ipc: G10L 19/20 20130101ALN20141024BHEP Ipc: G10L 19/022 20130101ALN20141024BHEP Ipc: G10L 19/02 20130101ALI20141024BHEP |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 19/107 20130101ALN20141111BHEP Ipc: G10L 19/08 20130101AFI20141111BHEP Ipc: G10L 19/02 20130101ALI20141111BHEP Ipc: G10L 19/022 20130101ALN20141111BHEP Ipc: G10L 19/20 20130101ALN20141111BHEP |
|
INTG | Intention to grant announced |
Effective date: 20141126 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 723656 Country of ref document: AT Kind code of ref document: T Effective date: 20150515 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602009030802 Country of ref document: DE Effective date: 20150603 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Ref document number: 2542067 Country of ref document: ES Kind code of ref document: T3 Effective date: 20150730 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20150422 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 723656 Country of ref document: AT Kind code of ref document: T Effective date: 20150422 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D Ref country code: FR Ref legal event code: PLFP Year of fee payment: 7 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150824 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150722 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150723 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150822 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602009030802 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RO Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150422 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 |
|
26N | No opposition filed |
Effective date: 20160125 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151005 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151031 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151031 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 8 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151005 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20091005 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20151031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20150422 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20230920 Year of fee payment: 15 Ref country code: GB Payment date: 20230920 Year of fee payment: 15 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230920 Year of fee payment: 15 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20231102 Year of fee payment: 15 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230920 Year of fee payment: 15 |