EP1378887A1 - Generation method of comfort noise frames (CNF) - Google Patents

Generation method of comfort noise frames (CNF) Download PDF

Info

Publication number
EP1378887A1
EP1378887A1 EP02380144A EP02380144A EP1378887A1 EP 1378887 A1 EP1378887 A1 EP 1378887A1 EP 02380144 A EP02380144 A EP 02380144A EP 02380144 A EP02380144 A EP 02380144A EP 1378887 A1 EP1378887 A1 EP 1378887A1
Authority
EP
European Patent Office
Prior art keywords
frames
block
cnf
frame
tetra
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP02380144A
Other languages
German (de)
French (fr)
Other versions
EP1378887B1 (en
Inventor
Paloma Garcia
Enrique Masgrau Gomez
Eduardo Lleida Solano
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Teltronic SA
Original Assignee
Teltronic SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Teltronic SA filed Critical Teltronic SA
Priority to ES02380144T priority Critical patent/ES2261619T3/en
Priority to EP02380144A priority patent/EP1378887B1/en
Priority to DE60210435T priority patent/DE60210435D1/en
Priority to AT02380144T priority patent/ATE322732T1/en
Publication of EP1378887A1 publication Critical patent/EP1378887A1/en
Application granted granted Critical
Publication of EP1378887B1 publication Critical patent/EP1378887B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/012Comfort noise or silence coding
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16Vocoder architecture
    • G10L19/173Transcoding, i.e. converting between two coded representations avoiding cascaded coding-decoding

Definitions

  • the present invention refers to a generation method of Comfort Noise Frames (CNF), providing essential novelty features and significant advantages with respect to the means known and used for the same purposes in the current state of the art.
  • CNF Comfort Noise Frames
  • the invention proposes the development of a method by means of which it is possible to carry out the generation of frames capable of being used in background noise generation in a receiver for the purpose of the intermittent transmission from an emitter in TETRA systems, that is to say during the time periods in which said emitter is silent, this noise being obtained from said CNF frames.
  • the method develops an algorithm for generating said frames.
  • the field of application of the invention is comprised within the telecommunications sector in general, and more specifically in the radio transmissions sector.
  • TETRA TETRA standard based on the intermittent performance of an emission from a suitable emitting device, whose emission. must be received and completed in the corresponding receiver device.
  • said TETRA system permits, as a functioning option, that while a person speaking from an emitter device remains silent (absence of voice or tones), the emitter device periodically sends a frame, denominated a Comfort Noise Frame (CNF), in which the spectral features of the room noise are parameterized as if it were a normal speech signal, such that by ceasing to emit during alternating time periods, a considerable saving of the terminal feed batteries is achieved, as well as a reduction in the co-channel interferences with the rest of the system users.
  • CNF Comfort Noise Frame
  • the sending of this frame is indicated to the receiver by means of the insertion of a CNF command in the first half of a slot, reserving the second half of the slot in order to include the parameterization of the noise.
  • the emitter device does not transmit this background noise information during several subsequent frames, whose number is a compromise between the desired update frequency, the danger of disconnecting from the base due to an absence of signal in the uplink, and the desired level of energetic saving and of co-channel interference reduction.
  • the Vocal Activity Detector (VAD) of said emitter device detects the presence of an information signal, it immediately switches to the normal transmission mode.
  • the receiver device it must be able to reconstruct the room noise signal as from said periodic frame while the silence lasts in the emitter device.
  • the reconstruction of this signal is carried out as from the reception of a CNF command, applying an algorithm to the received CNF parameters for generating the frame with the information of the received noise, and a synthesis will be carried out in the subsequent frames, being based on a determined algorithm.
  • a new noise frame is received, it proceeds in the same manner as with the first CNF command, and determined parameters used in the synthesis are updated.
  • International patent PCT number WO 00/11648 refers to a voice decoder using a vocal activity detector in the noise coding. Said document proposes various methods for generating the speech signal in case of an absence of vocal activity, among which there is a method based on the generation of a random excitation sequence which can be generated in the voice decoder. Other proposed methods are based on the use of information relative to the energy level or to the spectral profile.
  • US patent number 5,642,464 discloses methods and apparatuses for noise conditioning in digital vocal compression systems with the use of linear predictive coding, and it proposes a noise signals (absence of voice) processing method consisting of the calculation of the LPC (Lineal Predictive Coding) coefficients, and for this it makes provisions for the samples of that noise interval and the samples of a plurality of prior signal intervals.
  • LPC Lineal Predictive Coding
  • US patent number 6,240,383 refers to a voice coding and decoding system for the creation of comfort noise depending on the spectral envelope of the speech signal by means of storing the LPC parameters of the first non-speech signal prior to switching to non-speech.
  • the present invention refers to a generation method of Comfort Noise Frames (CNF), which has as the object obtaining such frames in the receiver terminal during the voice inactivity periods of the emitter with the applicatior of a suitable algorithm.
  • CNF Comfort Noise Frames
  • VAD Voice Activity Detector
  • the block diagram in figure 1 corresponds to a coder structured in the emitter terminal according to the TETRA standard, and includes a vocoder block 1, and a vocoder control block 2, the latter including several sub-blocks among which a sub-block 2a is distinguished for functions in test mode, a sub-block 2b for the reset function of the coder 1, a sub-block 2c for the frame uptake function, a sub-block 2d responsible for the comfort noise function, a sub-block 2e for the speech importance function, and lastly, an enciphering interface sub-block 2f.
  • the blocks affected by the insertion of the comfort noise are, in particular, those identified as control noise function sub-block 2d and speech importance function sub-block 2e.
  • the voice activity detection is carried out in this last sub-block, while the comfort noise function sub-block 2d is responsible for carrying out the calculations of the parameters of the comfort noise to be sent in the CNF slot, on the basis of the parameters given by the vocoder 1.
  • the decoder device includes a voice decoder control block 3 and a voice decoder block 4.
  • the control block 3 several sub-blocks are distinguished, such as the enciphering interface sub-block 3a, reset function sub-block 3b of the decoder 4, the missing frame generation sub-block 3c, the missing frame substitution sub-block 3d, and the sub-block 3e for functions in test mode.
  • the blocks affected by the comfort noise are, particularly, the sub-block 3c corresponding to the missing frame generation, which detects the presence of a CNF slot and carries out the noise frames synthesis, and the missing frame substitution sub-block 3d, with which the frame provided by the missing frame generation sub-block 3c is simply inserted in the frame fed to said voice decoder 4.
  • the proposed method precisely consists of the generation of an algorithm for generating the Comfort Noise Frames (CNF) in the receiver terminal, and for this purpose the algorithmic strategies, which will be defined below, are developed.
  • the emitter sub-blocks intervening in implementing the method correspond to those indicated by means of the numerical references 2d and 2e, that is to say, the comfort noise function and speech importance function sub-blocks, respectively, appearing in the scheme in figure 1.
  • the speech importance function sub-block 2e in reality corresponds to a Voice Activity Detector (VAD).
  • VAD Voice Activity Detector
  • the VAD used by the invention is based on the GSM standard [see: Digital cellular telecommunications system (phase 2); Voice Activity Decoder (VAD) for enhanced full rate (EFR) speech traffic channels.
  • GSM 06.82 version 4.0.1 Document ETSI EN 301 249 v4.0.1. (1997-12)] [1].
  • the invention foresees introducing variations in the GSM type VAD for the purpose of adapting it to the peculiarities of the TETRA standard vocoder.
  • the comfort noise function block 2d is responsible for carrying out the calculation of the parameters to be sent in a corresponding frame to a CNF slot.
  • FIG 3 schematically shows the operation mode of the TETRA vocoder when the noise capacity is active.
  • the non-shaded slots 5 correspond to speech slots or CNF slots
  • the shaded (crosshatched) slots 6 correspond to the transmitter inactivity periods.
  • the transmission is temporarily suspended (shaded slots 6) until a speech slot 5 transmits again, or the CNF information must be updated to the receiver (CNF updating period indicated with "T" in figure 3).
  • the method of the invention foresees introducing modifications in the GSM standard VAD system for its adaptation to the TETRA vocoder particularities, according to the description below.
  • the particularities and features of the VAD corresponding to said GSM standard are described in detail in document [1], which has been previously mentioned.
  • the TETRA vocoder works with frames of 30 msec divided into four sub-frames of 7.5 msec each, while the GSM vocoder works with frames of 20 msec, with four sub-frames of 5 msec each.
  • the TETRA vocoder accepts quantified voice samples in 16 bits (15 plus a one of sign), which are subsequently scaled by 2, which implies 15 bits.
  • the GSM standard VAD basically consists of an energy detector by threshold (high energy level indicates speech; low energy level indicates silence). This detection is carried out on a pinpoint signal by means of a filtering adapted to the features of the noise, using a continuously: adapted decision threshold according to the features of the present signal.
  • Figure 4 shows a scheme of blocks of the GSM system VAD with the following functionalities: block 7a, adaptive filtration and energy calculation; block 7b, periodicity detection; block 7c, tone detection; block 7d, averaged ACF; block 7e, calculation of predictor values; block 7f, spectral comparison; block 7g, threshold adaptation; block 7h, VAD decision; and block 7i, VAD persistence addition.
  • E 1 , E 2 and E 3 coming from the TETRA vocoder, while giving one single outlet, indicated as S1, consisting of a vadflag variable, which adopts a value of "1" in the case of the presence of speech, and a "0" value in the case of silence.
  • the three inputs E 1 to E 3 , associated to the blocks 7a, 7b and 7c are, respectively, the 8 autocorrelation coefficients of current frame (acf) (there could be up to 10, which are those calculated by the TETRA vocoder; however, in the case of the present invention, it has been chosen to maintain the number 8, as in the GSM standard, given that the most costly calculation is that of the LPC coefficients, which must be specifically carried out in the VAD); the four lags of the adaptive code, corresponding to each one of the four sub-frames, show an estimate of the periodicity or pitch of the signal (lags); and the first four LPC reflection coefficients (rc).
  • the acf coefficients of the input E1 provide the necessary information for carrying out a pinpoint filtering of the input signal, improving its SNR (signal-noise ratio), and they intervene in deciding if it adapts the noise energy threshold: yes, in the case of pre-classifying the current frame as noise; no, in the case of pre-classifying it as an information signal (speech or tones).
  • the lag values of the input E 2 permit detecting audible speech frames with well defined periodicity, in which case it does not update the decision threshold.
  • the first four reflection coefficients through the input E 3 permit reliably detecting the presence of tones, which also determines not updating the threshold.
  • Figure 5 shows a schematic view of a block diagram corresponding to a TETRA vocoder, constituted of a number of sub-blocks which will not be described in detail as they are known by themselves, and of those which reference will be made only to those intervening in the development of the method of the invention for extracting the useful information required by the VAD in order to make its decision.
  • a second point P 2 associated to the block 8c, permits extracting the periodicity lags(i) values corresponding to the four sub-frames of 7.5 msec into which each frame is divided for applying to the input E 2 .
  • a third point P 3 associated to the block 8b, permits extracting the first four reflection coefficients, which are intermediate magnitudes obtained in the calculation of the A(z) LPC predictor coefficients by means of the Levinson-Durbin algorithm.
  • the second algorithmic strategy according to the invention consists of the calculation of the CNF frame (LSP parameters and Rp and Rc gains).
  • the calculation of the parameters characterizing the comfort noise are described below, which are transmitted in the second frame of slot 5 (figure 3), which is marked as CNF.
  • the structure of the frame has a similar appearance to that of a speech frame, changing the way of calculating the parameters representing it.
  • This CNF slot is sent with a rate of a determined N number of frames (semi-slots).
  • the LSP parameters are the result of quantifying the average of the LSPs of the last four available frames: the current one and the three immediately prior to the decision of silence by the VAD. These three frames are the last three of the 10 composing the hangover (persistence, block 7i) included in the VAD.
  • TETRA Speech codec for full-rate traffic channel; Part 2; TETRA codec.
  • the calculations are taken in the last frame.
  • the method of the invention foresees performing a gains averaging.
  • problems of sudden energy hops occur between contiguous CNF periods in the synthesis process carried out in the receiver.
  • the scheme shown below is responsible for carrying out a certain processing on the energies for the purpose of reducing this undesired effect.
  • This new alternative takes advantage of the existence of 4 sub-frames for each speech frame in order to code different energy values (by means of Rp and Rc), thus achieving that the total average energy of the coded frame approximates with greater exactness the total energy desired (obtained as from the averaging of 4 noise frames).
  • the main problem arising consists of the lack of precision of the vector coding (6 bits), so that the difference between a value of the quantifier and the next one could be of one unit, corresponding to a multiplication factor 2 of the energy (remember that the energies are coded in log2) . Due to this, the work is now with the two values of the quantifier closest to the value of the energy to code (one above said value, and the other below), alternating said values in the sub-frames, such that the average of the 4 sub-frames is as close as possible to the desired energy.
  • Et log 2 (2 Ep + 2 Ec )
  • the following diagram carries out a comparison between a situation in which the Et is approximated by using the same value for the four sub-frames, and another in which two values are permitted regarding the value to quantify.
  • the energy Et to quantify is shown with a dashed line, and a solid line shows the quantified value. It can be seen how, on average, the energy Et is quantified more precisely in the second situation.

Abstract

A generation method of Comfort Noise Frames (CNF) in a TETRA system is described, for the generation of background noise frames in an emitter terminal, which must be transmitted during the periods of silence of said emitter terminal. The invention, also applicable to the case of the GSM standard, uses algorithmic alternatives for generating the frames by means of applying an algorithm to the parameters given by the control block terminal vocoder to the vocoder control block, the latter including a Vocal Activity Detector (VAD) and a comfort noise parameters calculation block. The method of the invention foresees the adaptation phases of the GSM standard VAD to that of TETRA, the CNF frame calculation, and the gains averaging by alternating the values of the quantizer, such that the average of the values over the subframes is as close as possible to the desired energy.

Description

    Object of the Invention
  • The present invention refers to a generation method of Comfort Noise Frames (CNF), providing essential novelty features and significant advantages with respect to the means known and used for the same purposes in the current state of the art.
  • More specifically, the invention proposes the development of a method by means of which it is possible to carry out the generation of frames capable of being used in background noise generation in a receiver for the purpose of the intermittent transmission from an emitter in TETRA systems, that is to say during the time periods in which said emitter is silent, this noise being obtained from said CNF frames. The method develops an algorithm for generating said frames.
  • The field of application of the invention is comprised within the telecommunications sector in general, and more specifically in the radio transmissions sector.
  • Background and Summary of the Invention
  • Skilled persons in the art know the features which define the TETRA standard based on the intermittent performance of an emission from a suitable emitting device, whose emission. must be received and completed in the corresponding receiver device. Actually, said TETRA system permits, as a functioning option, that while a person speaking from an emitter device remains silent (absence of voice or tones), the emitter device periodically sends a frame, denominated a Comfort Noise Frame (CNF), in which the spectral features of the room noise are parameterized as if it were a normal speech signal, such that by ceasing to emit during alternating time periods, a considerable saving of the terminal feed batteries is achieved, as well as a reduction in the co-channel interferences with the rest of the system users. The sending of this frame is indicated to the receiver by means of the insertion of a CNF command in the first half of a slot, reserving the second half of the slot in order to include the parameterization of the noise.
  • The emitter device does not transmit this background noise information during several subsequent frames, whose number is a compromise between the desired update frequency, the danger of disconnecting from the base due to an absence of signal in the uplink, and the desired level of energetic saving and of co-channel interference reduction. In the moment in which the Vocal Activity Detector (VAD) of said emitter device detects the presence of an information signal, it immediately switches to the normal transmission mode.
  • Concerning the receiver device, it must be able to reconstruct the room noise signal as from said periodic frame while the silence lasts in the emitter device. The reconstruction of this signal is carried out as from the reception of a CNF command, applying an algorithm to the received CNF parameters for generating the frame with the information of the received noise, and a synthesis will be carried out in the subsequent frames, being based on a determined algorithm. When a new noise frame is received, it proceeds in the same manner as with the first CNF command, and determined parameters used in the synthesis are updated.
  • Some methods and devices are already known in the state of the art, by means of which certain aspects of speech analysis-synthesis, their coding and decoding are carried out. In this sense, those currently constituting the most relevant prior art are cited below.
  • International patent PCT number WO 00/11648 refers to a voice decoder using a vocal activity detector in the noise coding. Said document proposes various methods for generating the speech signal in case of an absence of vocal activity, among which there is a method based on the generation of a random excitation sequence which can be generated in the voice decoder. Other proposed methods are based on the use of information relative to the energy level or to the spectral profile.
  • US patent number 5,642,464 discloses methods and apparatuses for noise conditioning in digital vocal compression systems with the use of linear predictive coding, and it proposes a noise signals (absence of voice) processing method consisting of the calculation of the LPC (Lineal Predictive Coding) coefficients, and for this it makes provisions for the samples of that noise interval and the samples of a plurality of prior signal intervals.
  • US patent number 6,240,383 refers to a voice coding and decoding system for the creation of comfort noise depending on the spectral envelope of the speech signal by means of storing the LPC parameters of the first non-speech signal prior to switching to non-speech.
  • The present invention refers to a generation method of Comfort Noise Frames (CNF), which has as the object obtaining such frames in the receiver terminal during the voice inactivity periods of the emitter with the applicatior of a suitable algorithm.
  • Thus, in the case of the present invention and given that the art used can also be used in the transmission of GSM (Global System for Mobile Communications) signals, the method foresees on one hand, the adaptation of a Voice Activity Detector (VAD) such that it can be used in TETRA terminals, and on the other hand, the development and use of algorithmic strategies capable of being performed by the comfort noise parameters calculation block in order to generate the CNF parameters to be periodically transmitted during the periods of silence.
  • Brief Description of the Drawings
  • These and other features and advantages of the invention will become more clearly evident based on the following detailed description of a preferred embodiment, given only as an illustrative and non-limiting example, with reference to the accompanying drawings in which:
  • Figures 1 and 2 show illustrative graphic representations of blocks of coding and decoding devices, respectively, according to that encompassed by the TETRA standard;
  • Figure 3 shows an illustrative diagram of the TETRA vocoder operation when the comfort noise function is active;
  • Figure 4 shows a schematic representation of a GSM type voice activity decoder (VAD), and
  • Figure 5 lastly shows a representation of a TETRA coder with indication of the extraction points of the parameters required by the VAD.
  • Description of a Preferred Embodiment Example
  • As has previously been stated, the detailed description of the preferred embodiment of the invention will be carried out with the use of the attached drawings, for the purposes of providing, in the first place and with illustrative purposes, the representations of the conventional technique appearing in figures 1 and 2.
  • As can be seen, the block diagram in figure 1 corresponds to a coder structured in the emitter terminal according to the TETRA standard, and includes a vocoder block 1, and a vocoder control block 2, the latter including several sub-blocks among which a sub-block 2a is distinguished for functions in test mode, a sub-block 2b for the reset function of the coder 1, a sub-block 2c for the frame uptake function, a sub-block 2d responsible for the comfort noise function, a sub-block 2e for the speech importance function, and lastly, an enciphering interface sub-block 2f. The blocks affected by the insertion of the comfort noise are, in particular, those identified as control noise function sub-block 2d and speech importance function sub-block 2e. The voice activity detection is carried out in this last sub-block, while the comfort noise function sub-block 2d is responsible for carrying out the calculations of the parameters of the comfort noise to be sent in the CNF slot, on the basis of the parameters given by the vocoder 1.
  • Concerning the decoder device according to the TETRA standard, incorporated in the receiver terminal and schematically shown in the drawing in figure 2, it includes a voice decoder control block 3 and a voice decoder block 4. In the control block 3, several sub-blocks are distinguished, such as the enciphering interface sub-block 3a, reset function sub-block 3b of the decoder 4, the missing frame generation sub-block 3c, the missing frame substitution sub-block 3d, and the sub-block 3e for functions in test mode. In this case, the blocks affected by the comfort noise are, particularly, the sub-block 3c corresponding to the missing frame generation, which detects the presence of a CNF slot and carries out the noise frames synthesis, and the missing frame substitution sub-block 3d, with which the frame provided by the missing frame generation sub-block 3c is simply inserted in the frame fed to said voice decoder 4.
  • According to the invention, the proposed method precisely consists of the generation of an algorithm for generating the Comfort Noise Frames (CNF) in the receiver terminal, and for this purpose the algorithmic strategies, which will be defined below, are developed. In any case, the emitter sub-blocks intervening in implementing the method correspond to those indicated by means of the numerical references 2d and 2e, that is to say, the comfort noise function and speech importance function sub-blocks, respectively, appearing in the scheme in figure 1. Of them, the speech importance function sub-block 2e in reality corresponds to a Voice Activity Detector (VAD). The VAD used by the invention is based on the GSM standard [see: Digital cellular telecommunications system (phase 2); Voice Activity Decoder (VAD) for enhanced full rate (EFR) speech traffic channels. (GSM 06.82 version 4.0.1). Document ETSI EN 301 249 v4.0.1. (1997-12)] [1]. However, the invention foresees introducing variations in the GSM type VAD for the purpose of adapting it to the peculiarities of the TETRA standard vocoder.
  • On the other hand, the comfort noise function block 2d is responsible for carrying out the calculation of the parameters to be sent in a corresponding frame to a CNF slot.
  • Figure 3 schematically shows the operation mode of the TETRA vocoder when the noise capacity is active. In this figure, the non-shaded slots 5 correspond to speech slots or CNF slots, while the shaded (crosshatched) slots 6 correspond to the transmitter inactivity periods. When a CNF frame is transmitted, the transmission is temporarily suspended (shaded slots 6) until a speech slot 5 transmits again, or the CNF information must be updated to the receiver (CNF updating period indicated with "T" in figure 3).
  • As previously indicated, the method of the invention foresees introducing modifications in the GSM standard VAD system for its adaptation to the TETRA vocoder particularities, according to the description below. The particularities and features of the VAD corresponding to said GSM standard are described in detail in document [1], which has been previously mentioned.
  • The TETRA vocoder works with frames of 30 msec divided into four sub-frames of 7.5 msec each, while the GSM vocoder works with frames of 20 msec, with four sub-frames of 5 msec each. In addition, the TETRA vocoder accepts quantified voice samples in 16 bits (15 plus a one of sign), which are subsequently scaled by 2, which implies 15 bits. In exchange, the GSM vocoder accepts samples in 13 bits. Both differences affect the energy levels per frame, which in the case of TETRA will be 1.5x (4)2=24 times grater than that of GSM. As many of the VAD calculations require the use of magnitudes dependent on the energy of the frames, it will be precise to adapt these to the length of the TETRA frame.
  • The GSM standard VAD basically consists of an energy detector by threshold (high energy level indicates speech; low energy level indicates silence). This detection is carried out on a pinpoint signal by means of a filtering adapted to the features of the noise, using a continuously: adapted decision threshold according to the features of the present signal.
  • Figure 4 shows a scheme of blocks of the GSM system VAD with the following functionalities: block 7a, adaptive filtration and energy calculation; block 7b, periodicity detection; block 7c, tone detection; block 7d, averaged ACF; block 7e, calculation of predictor values; block 7f, spectral comparison; block 7g, threshold adaptation; block 7h, VAD decision; and block 7i, VAD persistence addition. The existence of three inputs can also be seen, respectively indicated as E1, E2 and E3, coming from the TETRA vocoder, while giving one single outlet, indicated as S1, consisting of a vadflag variable, which adopts a value of "1" in the case of the presence of speech, and a "0" value in the case of silence. The three inputs E1 to E3, associated to the blocks 7a, 7b and 7c are, respectively, the 8 autocorrelation coefficients of current frame (acf) (there could be up to 10, which are those calculated by the TETRA vocoder; however, in the case of the present invention, it has been chosen to maintain the number 8, as in the GSM standard, given that the most costly calculation is that of the LPC coefficients, which must be specifically carried out in the VAD); the four lags of the adaptive code, corresponding to each one of the four sub-frames, show an estimate of the periodicity or pitch of the signal (lags); and the first four LPC reflection coefficients (rc).
  • The acf coefficients of the input E1 provide the necessary information for carrying out a pinpoint filtering of the input signal, improving its SNR (signal-noise ratio), and they intervene in deciding if it adapts the noise energy threshold: yes, in the case of pre-classifying the current frame as noise; no, in the case of pre-classifying it as an information signal (speech or tones). The lag values of the input E2 permit detecting audible speech frames with well defined periodicity, in which case it does not update the decision threshold. The first four reflection coefficients through the input E3 permit reliably detecting the presence of tones, which also determines not updating the threshold. It is interesting to point out that the three types of signal intervene in the decision to update or not update the energy threshold, but only the acf's of the input E1 are those used in obtaining the energy level, on making the final decision, and in the calculation of the pinpoint filter.
  • For illustrative purposes, a chart is shown below with the values adopted by the different parameters of the GSM standard VAD.
    PARAMETER VALUE
    Pth 130000*1,5
    Plev 130000*1,5
    Adp 6
    Dec 16
    Inc 8
    Fac 2
    Margin 150000000*1,5
    Threshold (Spectral comparison) 0,056
    FREQTH (Tone detection) 0,0973
    PREDTH (Tone detection) 0,0447
    LTHRESH (Periodicity detection) 2
    NTHRESH 6
    Hangconst (VAD persistence) 10
    Burstconst (VAD persistence) 3
  • Figure 5 shows a schematic view of a block diagram corresponding to a TETRA vocoder, constituted of a number of sub-blocks which will not be described in detail as they are known by themselves, and of those which reference will be made only to those intervening in the development of the method of the invention for extracting the useful information required by the VAD in order to make its decision. For this purpose, it is necessary to mention the sub-blocks 8a of autocorrelation and window selection, 8b of the Levinson-Durbin algorithmic function and 8c of the better delay and gain search. A first extraction point P1, located between blocks 8a and 8b, permits obtaining the 8 autocorrelation coefficients acf(i)=R(i) to be applied to the input E1. A second point P2, associated to the block 8c, permits extracting the periodicity lags(i) values corresponding to the four sub-frames of 7.5 msec into which each frame is divided for applying to the input E2. Lastly, a third point P3, associated to the block 8b, permits extracting the first four reflection coefficients, which are intermediate magnitudes obtained in the calculation of the A(z) LPC predictor coefficients by means of the Levinson-Durbin algorithm.
  • The second algorithmic strategy according to the invention consists of the calculation of the CNF frame (LSP parameters and Rp and Rc gains). The calculation of the parameters characterizing the comfort noise are described below, which are transmitted in the second frame of slot 5 (figure 3), which is marked as CNF. The structure of the frame has a similar appearance to that of a speech frame, changing the way of calculating the parameters representing it. This CNF slot is sent with a rate of a determined N number of frames (semi-slots).
  • A table is shown below with the structure of a frame of the TETRA vocoder, containing both the parameters to be modified and those which are given to the TETRA vocoder without any modification.
    Class of parameter Buffer memory shift Name of the parameter
    Filter +0 Code index: LSP1 to LSP3
    +1 Code index: LSP4 to LSP6
    +2 Code index: LSP7 to LSP10
    Sub-frame #
    1 +3 Pitch delay
    +4 Code index: pulse 4
    Code index: pulse 3
    Code index: pulse 2
    Code index: pulse 1
    Global pulse sign
    +5 Pulse shift
    Code index: gains
    +6
    +7
    Sub-frame #2 +8 Pitch delay
    +9 Code index: pulse 4
    Code index: pulse 3
    Code index: pulse 2
    Code index: pulse 1
    Global pulse sign
    +10 Pulse shift
    Code index: gains
    +11
    +12
    Sub-frame #3 +13 Pitch delay
    +14 Code index: pulse 4
    Code index: pulse 3
    Code index: pulse 2
    Code index: pulse 1
    Global pulse sign
    +15 Pulse shift
    Code index: gains
    +16
    +17
    Sub-frame #4 +18 Pitch delay
    +19 Code index: pulse 4
    Code index: pulse 3
    Code index: pulse 2
    Code index: pulse 1
    Global pulse sign
    +20 Pulse shift
    Code index: gains
    +21
    +22
  • The LSP parameters are the result of quantifying the average of the LSPs of the last four available frames: the current one and the three immediately prior to the decision of silence by the VAD. These three frames are the last three of the 10 composing the hangover (persistence, block 7i) included in the VAD.
  • The differential Rp and Rc gains, corresponding to the adaptive (pitch) and random indices, are not straight averaged. This occurs because it has been seen that these values greatly vary from one noise frame to another, although it has similar features. A straight average of Rp and Rc would provide values of them that would produce an energy noise frame very different from the real one. Alternately, the pitch Ep and code Ec energies of said last four frames are averaged, and the Rp and Rc parameters corresponding to this energy are calculated. Specifically, those values steadily providing the average Ep and Ec energies are taken. The resulting expressions of Rp and Rc are the following: Rc=0.5Ec - 0.25Ep + 3 Rp=0.5Ep - 0.25Ec + 3
  • They are obtained from expressions (31) to (36) in section 4.2.2.6 of document [2]: TETRA: Speech codec for full-rate traffic channel; Part 2; TETRA codec. Document ETS 300 295-2. September, 1997 (pp. 22). These Rp and Rc parameters are normally quantified by means of the 64-code codebook of the TETRA coder.
  • As indices of the random and of the adaptive code, the calculations are taken in the last frame.
  • During a determined number of subsequent frames, data is not sent. Once this number of frames has elapsed, a new update CNF frame is transmitted, calculated in the same manner.
  • Lastly, as a third algorithmic strategy, the method of the invention foresees performing a gains averaging. Actually, with the scheme shown in the previous section on the energies averaging, problems of sudden energy hops occur between contiguous CNF periods in the synthesis process carried out in the receiver. The scheme shown below is responsible for carrying out a certain processing on the energies for the purpose of reducing this undesired effect.
  • This new alternative takes advantage of the existence of 4 sub-frames for each speech frame in order to code different energy values (by means of Rp and Rc), thus achieving that the total average energy of the coded frame approximates with greater exactness the total energy desired (obtained as from the averaging of 4 noise frames).
  • The main problem arising consists of the lack of precision of the vector coding (6 bits), so that the difference between a value of the quantifier and the next one could be of one unit, corresponding to a multiplication factor 2 of the energy (remember that the energies are coded in log2) . Due to this, the work is now with the two values of the quantifier closest to the value of the energy to code (one above said value, and the other below), alternating said values in the sub-frames, such that the average of the 4 sub-frames is as close as possible to the desired energy. That is to say, the situation is of the type explained below:
    Figure 00150001
    With (E1 + E2+ E3 + E4)/4 being a value approximate to Et (desired energy), and where E1, E2, E3, and E4 can only take two possible values, namely, the immediately greater one and the immediate lesser one to E).
  • The Et value corresponds to the total energy of the frame and is obtained from the averaging on the last four noise frames in the following manner: Et = log2 (2 Ep + 2 Ec )
  • The following diagram carries out a comparison between a situation in which the Et is approximated by using the same value for the four sub-frames, and another in which two values are permitted regarding the value to quantify.
  • The energy Et to quantify is shown with a dashed line, and a solid line shows the quantified value. It can be seen how, on average, the energy Et is quantified more precisely in the second situation.
    Figure 00150002
    Figure 00160001
  • As can be understood, the preceding explanation corresponds only to one preferred embodiment of the invention, therefore different variants and modifications are possible without changing the scope of the invention, limited only by the content of the following claims.

Claims (4)

  1. A generation method of Comfort Noise Frames (CNF), particularly applicable in combination with an emitter terminal according to the TETRA standard, by means of which said generation is carried out by applying an algorithm to the parameters given by the terminal vocoder to the vocoder control block, and in which said vocoder control block includes a Vocal Activity Detector (VAD) block and a comfort noise parameters calculation block, also applicable to the transmission of signals under the GSM standard, characterized in that it comprises the phases of: a) adapting the GSM standard VAD to the TETRA standard, b) calculating the CNF frame (LSP parameters, Rp and Rc gains) which must be periodically transmitted from the emitter during the state of silence of the latter, and c) gains averaging by means of the average calculation of the values of the pitch and code energies, corresponding to four frames (the current one and three previous ones), and with a transmission of the algebraic and adaptive code index values corresponding to those calculated in the last frame.
  2. A method according to claim 1, characterized in that the adaptation of the VAD is carried out with the provision of three inputs (E1, E2, E3) respectively corresponding to autocorrelation coefficients input of the current frame, extracted from among the blocks (8a) of autocorrelation and window selection, and (8b) of the Levinson-Durbin algorithm, of the TETRA coder; input of the adaptive code lags corresponding to each one of the four sub-frames, extracted in the block (8c) of better delay and gain search of the TETRA coder; and input of the first four LPC reflection coefficients (rc), extracted in the previously mentioned block (8b).
  3. A method according to claim 1, characterized in that the calculation of parameters is carried out such that:
    the LSP parameters are the result of quantifying the average of the LSPs of the last four available frames, namely, the current one and the three immediately prior ones, and
    the Rp and Rc parameters, representative of the adaptive (pitch) and random codes, respectively, are calculated by taking into consideration the pitch(Ep) and code (Ec) energies, with the application of the following expressions: Rc=0.5Ec - 0.25Ep + 3 Rp=0.5Ep - 0.25Ec + 3.
  4. A method according to claim 1, characterized in that the gains averaging, carried out for the purpose of preventing sudden energy hops between contiguous CNF periods, is carried out by taking advantage of the existence of 4 sub-frames for each speech frame, carrying out the arithmetic average of the four respective energies (E1, E2, E3, E4) corresponding to said sub-frames, and such that the value of the total energy Et of the frame responds to the formula: Et = log2 (2 Ep + 2 Ec ).
EP02380144A 2002-07-02 2002-07-02 Generation method of comfort noise frames (CNF) Expired - Lifetime EP1378887B1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
ES02380144T ES2261619T3 (en) 2002-07-02 2002-07-02 METHOD OF GENERATING ACCEPTABLE NOISE FRAMES.
EP02380144A EP1378887B1 (en) 2002-07-02 2002-07-02 Generation method of comfort noise frames (CNF)
DE60210435T DE60210435D1 (en) 2002-07-02 2002-07-02 Method for generating comfort noise frame (CNF)
AT02380144T ATE322732T1 (en) 2002-07-02 2002-07-02 METHOD FOR GENERATING COMFORT SOUND FRAMEWORK (CNF)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP02380144A EP1378887B1 (en) 2002-07-02 2002-07-02 Generation method of comfort noise frames (CNF)

Publications (2)

Publication Number Publication Date
EP1378887A1 true EP1378887A1 (en) 2004-01-07
EP1378887B1 EP1378887B1 (en) 2006-04-05

Family

ID=29719797

Family Applications (1)

Application Number Title Priority Date Filing Date
EP02380144A Expired - Lifetime EP1378887B1 (en) 2002-07-02 2002-07-02 Generation method of comfort noise frames (CNF)

Country Status (4)

Country Link
EP (1) EP1378887B1 (en)
AT (1) ATE322732T1 (en)
DE (1) DE60210435D1 (en)
ES (1) ES2261619T3 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107516530A (en) * 2012-10-01 2017-12-26 日本电信电话株式会社 Coding method, code device, program and recording medium

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0843301A2 (en) * 1996-11-15 1998-05-20 Nokia Mobile Phones Ltd. Methods for generating comfort noise during discontinous transmission

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0843301A2 (en) * 1996-11-15 1998-05-20 Nokia Mobile Phones Ltd. Methods for generating comfort noise during discontinous transmission

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"Digital cellular telecomunications system (Phase2); Voice Activity Detector (VAD) for Enhanced Full Rate (EFR) speech traffic channels (GSM 06.82 version 4.0.1)", EN 301 249 V4.0.1, XX, XX, 1 December 1997 (1997-12-01), XX, pages 1 - 19, XP002224624 *
"Terrestrial Trunked Radio (TETRA); Speech codec for full-rate traffic channel: Part 2: TETRA codec", ETS 300 395-2, XX, XX, 1 February 1998 (1998-02-01), XX, pages 1 - 92, XP002224625 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107516530A (en) * 2012-10-01 2017-12-26 日本电信电话株式会社 Coding method, code device, program and recording medium
CN107516530B (en) * 2012-10-01 2020-08-25 日本电信电话株式会社 Encoding method, encoding device, and recording medium

Also Published As

Publication number Publication date
DE60210435D1 (en) 2006-05-18
EP1378887B1 (en) 2006-04-05
ES2261619T3 (en) 2006-11-16
ATE322732T1 (en) 2006-04-15

Similar Documents

Publication Publication Date Title
EP0819302B1 (en) Arrangement and method relating to speech transmission and a telecommunications system comprising such arrangement
KR100357254B1 (en) Method and Apparatus for Generating Comfort Noise in Voice Numerical Transmission System
JP4444749B2 (en) Method and apparatus for performing reduced rate, variable rate speech analysis synthesis
EP2535893B1 (en) Device and method for lost frame concealment
CN100508028C (en) Method and device for adding release delay frame to multi-frame coded by voder
JP4585689B2 (en) Adaptive window for analysis CELP speech coding by synthesis
JP4173198B2 (en) Method and apparatus for reconstructing received audio signal
FI118702B (en) Variable speed vocoder
US7680651B2 (en) Signal modification method for efficient coding of speech signals
EP0786760A2 (en) Speech coding
US8296132B2 (en) Apparatus and method for comfort noise generation
EP2259040B1 (en) Method and apparatus for noise generating
WO1999066494A1 (en) Improved lost frame recovery techniques for parametric, lpc-based speech coding systems
EP2936486B1 (en) Comfort noise addition for modeling background noise at low bit-rates
US20100106490A1 (en) Method and Speech Encoder with Length Adjustment of DTX Hangover Period
JP2007525723A (en) Method of generating comfort noise for voice communication
CN1244090C (en) Speech coding with background noise reproduction
JP2001506764A (en) Methods and arrangements in telecommunications systems
EP1378887B1 (en) Generation method of comfort noise frames (CNF)
US8195469B1 (en) Device, method, and program for encoding/decoding of speech with function of encoding silent period
CN101266798B (en) A method and device for gain smoothing in voice decoder
EP1378888B1 (en) Method of synthesizing comfort noise frames (CNF)
JP3475958B2 (en) Speech encoding / decoding apparatus including speechless encoding, decoding method, and recording medium recording program
Kleider et al. Multi-rate speech coding for wireless and Internet applications
Xinfu et al. AMR vocoder and its multi-channel implementation based on a single DSP chip

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

17P Request for examination filed

Effective date: 20040412

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SK TR

17Q First examination report despatched

Effective date: 20050404

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SK TR

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

Ref country code: LI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT;WARNING: LAPSES OF ITALIAN PATENTS WITH EFFECTIVE DATE BEFORE 2007 MAY HAVE OCCURRED AT ANY TIME BEFORE 2007. THE CORRECT EFFECTIVE DATE MAY BE DIFFERENT FROM THE ONE RECORDED.

Effective date: 20060405

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

Ref country code: CH

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 60210435

Country of ref document: DE

Date of ref document: 20060518

Kind code of ref document: P

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060703

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060705

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060705

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060705

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060706

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060905

NLV1 Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents act
REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2261619

Country of ref document: ES

Kind code of ref document: T3

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20070108

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20060705

EN Fr: translation not filed
PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060706

Ref country code: FR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20070309

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060705

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060702

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20060405

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20210802

Year of fee payment: 20

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20220727

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION

Effective date: 20220703