EP1665234A1 - Procede de transmission d un flux d information par insertion a l'interieur d'un flux de donnees de parole, et codec parametrique pour sa mise en oeuvre - Google Patents
Procede de transmission d un flux d information par insertion a l'interieur d'un flux de donnees de parole, et codec parametrique pour sa mise en oeuvreInfo
- Publication number
- EP1665234A1 EP1665234A1 EP04787314A EP04787314A EP1665234A1 EP 1665234 A1 EP1665234 A1 EP 1665234A1 EP 04787314 A EP04787314 A EP 04787314A EP 04787314 A EP04787314 A EP 04787314A EP 1665234 A1 EP1665234 A1 EP 1665234A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- bits
- information flow
- frames
- parametric
- stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 43
- 230000005540 biological transmission Effects 0.000 title abstract description 20
- 230000005284 excitation Effects 0.000 claims description 78
- 238000003780 insertion Methods 0.000 claims description 49
- 230000037431 insertion Effects 0.000 claims description 49
- 238000004422 calculation algorithm Methods 0.000 claims description 14
- 230000035945 sensitivity Effects 0.000 claims description 5
- 239000013598 vector Substances 0.000 description 30
- 230000003044 adaptive effect Effects 0.000 description 25
- 230000000875 corresponding effect Effects 0.000 description 18
- 230000015572 biosynthetic process Effects 0.000 description 17
- 238000003786 synthesis reaction Methods 0.000 description 17
- 230000006870 function Effects 0.000 description 12
- 230000008569 process Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000008901 benefit Effects 0.000 description 6
- 230000007774 longterm Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000000605 extraction Methods 0.000 description 4
- 230000003595 spectral effect Effects 0.000 description 4
- 230000002194 synthesizing effect Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 230000015654 memory Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000001755 vocal effect Effects 0.000 description 3
- 230000015556 catabolic process Effects 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 238000006731 degradation reaction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000004907 flux Effects 0.000 description 2
- 238000012966 insertion method Methods 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- DTCAGAIFZCHZFO-UHFFFAOYSA-N 2-(ethylamino)-1-(3-fluorophenyl)propan-1-one Chemical compound CCNC(C)C(=O)C1=CC=CC(F)=C1 DTCAGAIFZCHZFO-UHFFFAOYSA-N 0.000 description 1
- OQEBBZSWEGYTPG-UHFFFAOYSA-N 3-aminobutanoic acid Chemical compound CC(N)CC(O)=O OQEBBZSWEGYTPG-UHFFFAOYSA-N 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000010237 hybrid technique Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 238000011002 quantification Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 238000011282 treatment Methods 0.000 description 1
- 210000001260 vocal cord Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
- G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
- G10L19/12—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
Definitions
- the present invention relates generally to the field of speech coding, and in particular to a method of inserting an information stream inside a speech data stream, the information stream inserted may be a lower bit rate speech data stream or a transparent data stream.
- the invention finds applications, in particular, in public or professional mobile radiocommunication systems (PMR systems, from the English "Professional Mobile Radiocommunication").
- PMR systems from the English "Professional Mobile Radiocommunication"
- a speech signal is an acoustic signal emitted by a human voice device.
- Coded is a hardware and / or software unit for coding and decoding a digital stream. Its coding function makes it possible to transcode a digital stream of quantified samples in the time domain of a source signal (for example a speech signal) into a compressed digital stream.
- a speech data stream is a data stream generated by a speech codec, from the coding of a speech signal.
- a transparent data stream is a binary digital sequence whose content type is unspecified, whether it is effectively a computer data stream or a speech data stream. The data is said to be transparent in the sense that, from an external point of view, all the bits are of equal importance with respect to, for example, the correction of transmission errors so that an error correcting coding must therefore be uniform over all the bits. Conversely, if the stream is a speech data stream, some bits are more important to protect than others.
- a speech codec also called a vocoder (in English "Vocoder”"SpeechCoded” or “Voice Coded”) is a specialized codec which is suitable for coding a quantized speech signal and for decoding a stream of frame lyrics. In particular, it has a sensitivity for its coding function which depends on the characteristics of the speaker's speech and a low bit rate. associated with a more limited frequency band than the general audio frequency band (20 Hz-20 kHz).
- speech signal waveform coding techniques e.g. ITU-T G.711 MIC A / mu law coding
- voice coding techniques e.g. ITU-T G.711 MIC A / mu law coding
- source model (the best known being CELP coding, from the English “Code-Excited Linear Prediction"), perceptual coding, and hybrid techniques based on the combination of techniques belonging to at least two of the above families.
- the invention relates to the application to "source model” coding techniques.
- These techniques are also called parametric coding techniques, because they are based on the representation of excitation parameters of the speech source and / or of parameters describing the spectral envelope of the signal emitted by the speaker (for example according to a model of coding by linear prediction exploiting the correlation between the consecutive values of the parameters associated with a synthesis filter, or even according to a cepstral model) and / or of acoustic parameters depending on the source, for example the amplitude and the fundamental fundamental frequency perceived ( "Pitch" in English, the period (“Pitch period” in English) and the amplitude of the energy peaks of the first harmonics of a pitch frequency at different intervals, its degree of voicing ("voicing rate” in English ), its melody and its sequences.
- a parametric voeoder implementing digital speech coding using a parametric model of the speech source is called a parametric voeoder.
- a parametric voeoder associates several parameters with each frame of the speech flow.
- spectral parameters of linear prediction also called, for example, LP coefficients (from English "Linear Prediction") or LPC coefficients (from English "Linear Prediction Coding"), which define the linear prediction filter of the vooder ( short-term filter).
- adaptive excitation parameters associated with (or more) vector (s) of fixed excitation also called algebraic parameters or stochastic parameters which define a second excitation vector and an associated gain to be applied at the input of the synthesis filter.
- Document EP-A-1 020 848 discloses a method for transmitting auxiliary information in a main information flow corresponding to a speech signal, said auxiliary information being inserted at the level of the CELP vooder which codes the signal of speech, replacing the index of the adaptive excitation vector and / or the index of the fixed excitation vector. More specifically, the auxiliary information bits are inserted into the transmitter's voeoder in place of the bits coding normally the corresponding index, and the gain value is set to zero in order to inform the receiver's voeoder.
- the main object of the invention is to allow the discrete insertion of a secondary stream into a main stream corresponding to a speech stream.
- Other objects of the invention aim to maximize the bit rate of the secondary stream that can be inserted, while preserving at best the performance of the coding of the main stream with respect to attributes of the source (ie by preserving the quality perceived at hearing when synthesizing speech flow).
- Another object of the invention is also to simultaneously preserve the performance of the coding of the secondary stream with respect to attributes of the source of the secondary stream, in particular when it is also a speech stream.
- Bits of the secondary information flow are inserted: - in some only of the frames of the main information flow, selected by a mask of frames known to the transmitter and the receiver; and / or, - within a determined frame of the main information flow, by imposing a constraint on only some of the bits of the frame, selected by a bit mask known to the transmitter and to the receiver.
- the transmitter and the receiver, as well as the transmission, must be interpreted in their broadest sense.
- the transmitter and the receiver are terminal equipment of the system, and the transmission is a radio transmission.
- the insertion is carried out at the level of a parametric voeoder of the transmitter which produces said main information flow, without modification of the bit rate of the latter compared to what it would be without insertion.
- the secondary information flow is interpreted as a series of constraints on the series of values of certain parameters of the parametric coding model of the main information flow.
- the method according to the invention has the advantage that nothing in the main information flow which is transmitted betrays the presence of the inserted secondary information flow.
- the intelligibility of the coded speech signal in the main information stream is preserved, which is by no means the case with the aforementioned known insertion method.
- the mask of frames can be variable. It is then generated according to a common algorithm in parallel in the transmitter and in the receiver, in order to ensure synchronization of the coding and decoding of the main information flow, respectively in the transmitter and in the receiver.
- the frame mask can advantageously define a subsequence of groups of consecutive frames in each of which bits of the secondary information stream are inserted, in order to take advantage of the coding slip effect which results from the storage of the frames in the parametric vooder. This contributes to preserving the fidelity of the main information flow to the speech signal.
- the length in number of frames of a group of consecutive frames is then substantially equal to the depth of storage of the frames in the parametric voeoder.
- the mask of bits can be such that bits of the secondary information flow are inserted into these frames by imposing a priority priority on the bits belonging to the least sensitive bit class. This also contributes to preserving the fidelity of the main information flow to the speech signal.
- the secondary information stream may be a speech data stream having a lower rate than the primary information rate.
- the secondary information flow leaves another voeoder having a lower bit rate than the bit rate of the parametric vocoder.
- the secondary information flow can also be a transparent data flow.
- the bit rate of the secondary information flow to be inserted is too high compared to the bit rate of the parametric vocoder, it may be necessary to delete bits of the secondary information stream, if this is compatible with the application.
- the secondary information flow is subject to error correcting coding before insertion into the main information flow.
- bits of the secondary information flow are inserted by imposing values on bits which belong to excitation parameters of a filter of the source model of the parametric vooder, for example parameters adaptive excitation and / or fixed excitation parameters of the linear prediction filter of a CELP vooder.
- the fact of not imposing a constraint on the bits of the linear prediction parameters preserves the intelligibility of the main information flow. Also for this purpose, it is preferable to impose bit constraints forming the fixed excitation parameters rather than those forming the fixed excitation parameters.
- bits of the secondary information flow may also be inserted into silence frames of the main information flow, in place of or in addition to insertion into speech frames.
- bits of the secondary information flow can be inserted by imposing constraints on unencrypted bits as an end-to-end encryption of the main information flow. This allows a receiving device to be able, after extraction, to decode the secondary information flow although it does not have the decryption capacity as such.
- the bits concerned can nevertheless undergo one or more encryption / decryption operations for another reason, for example link or radio interface encryption.
- the insertion constraint may be an equality constraint of the bits of the frame of the main information flow with the bits of the secondary information flow inserted.
- a second aspect of the invention relates to a parametric vooder adapted for implementing the method according to the first aspect.
- a parametric vooder includes insertion means for the insertion of a secondary information flow into a main information flow which is generated by the vooder parametric from a speech signal.
- These insertion means are suitable for inserting bits of the secondary information flow: - in only some of the frames of the main information flow, selected by a determined mask of frames; and / or, - within a determined frame of the main information flow, by imposing a constraint on only some of the bits of the frame, selected by a determined bit mask.
- the voeoder comprises means for extracting the secondary information flow from the main information flow.
- a third aspect of the invention also relates to terminal equipment of a radiocommunication system comprising a parametric vooder according to the second aspect.
- Other characteristics and advantages of the invention will become apparent on reading the description which follows. This is purely illustrative and should be read with reference to the appended drawings in which: - Figure 1 is a diagram illustrating an example of coded speech data stream (speech stream) organized in frames and sub-frames; - Figure 2 is a partial block diagram of an example of transmitter equipment according to the invention; - Figure 3 is a partial block diagram of an example of a voeodor according to the invention; and - Figure 4 is a partial block diagram of an example of a voeodor used in receiving equipment according to the invention.
- FIG. 1 is a diagram illustrating an example of coded speech data stream (speech stream) organized in frames and sub-frames
- - Figure 2 is a partial block diagram of an example of transmitter equipment according to the invention
- - Figure 3 is a partial block diagram of an example
- FIG. 1 is a diagram illustrating the general principle of the insertion of a secondary data stream DS2 into a main data stream DS1 coding a speech signal VS1.
- This insertion is carried out at the level of a transmitter which, after multiplexing and channel coding, transmits the DS1 stream, and therefore the DS2 stream which it contains, to a remote receiver.
- a transmitter and such a receiver are, for example, mobile terminals of a public radiocommunication system such as GSM or UMTS, or a professional radiocommunication system such as TETRA or TETRAPOL.
- the stream DS1 is generated by a vooder 10 from the speech signal VS1, which is produced by a speech source 1 such as the vocal apparatus of an individual.
- the speech signal VS1 is digitized according to a linear MIC coding (pulse modulation coding), and segmented into frames called speech frames.
- each frame is generally segmented at the level of the vocoder 10 into a fixed number M of segments called subframes in the time domain (CELP model) or in the frequency domain (MBE model, from English "Multi-Band Excitation").
- M is between 2 and 6, depending on the vocoders).
- Each frame comprises a determined number N of bits.
- FIG. 2 illustrates a speech signal digitized and segmented into successive frames F [i], for i comprised between 0 and infinity.
- each frame F [i] can be segmented into M sub-frames denoted SF [m], for m between 1 and M.
- SF [m] the duration of a frame .
- the secondary data stream DS2 is for example generated by a codec 20, which receives a data stream to be coded from a source 2.
- the source 2 also transmits a speech signal, the coded 20 then being a lower rate voeoder than that of the cocoder 10.
- the DS2 stream is also a stream of speech frames.
- the invention allows the discrete insertion of a secondary communication into a main communication.
- the coded 20, more specifically the voeoder 20, can be a MF-MELP (from the English "Multi-Frame - Mixed Excitation Linear Prediction") type 1200/2400 bit / s described in NATO STANAG 4591.
- the DS2 stream may be subject to error correcting coding, for example CRC coding (from the English "Cyclic Redundancy Code”) or convolutional coding, which forms a channel coding for transmission through the transmission channel.
- error correcting coding for example CRC coding (from the English "Cyclic Redundancy Code") or convolutional coding, which forms a channel coding for transmission through the transmission channel.
- CRC coding from the English "Cyclic Redundancy Code”
- convolutional coding which forms a channel coding for transmission through the transmission channel.
- the vooder 10 comprises an encoder 100 which implements a source model (or parametric model) coding algorithm, for example of the CELP type or of the MELP type.
- the parameters corresponding to the coding of a speech frame on the transmitter side include, among other things, excitation vectors which are subjected, on the receiver side, to a filter whose response models the speech.
- Parametric coding algorithms use parameters calculated either directly according to the flow of incoming speech frames and an internal state of the voeodor, or calculated by iterations (on successive frames and / or sub-frames) by optimizing a criterion given.
- the first parameters include the linear prediction parameters (LP) defining a short term filter
- the second parameters include the adaptive excitation parameters (LTP) defining a long term filter and the fixed excitation parameters. Each iteration corresponds to the coding of a sub-frame in a frame of the input stream.
- LP linear prediction parameters
- LTP adaptive excitation parameters
- the adaptive excitation parameters and the fixed excitation parameters are selected by successive iterations in order to minimize the quadratic error between the synthesized speech signal and the original speech signal VS1.
- this iterative selection is sometimes called "Codebook search” or "Analysis by Synthesis
- the adaptive excitation parameters and / or the fixed excitation parameters can each include, on the one hand, an index corresponding to a value of a vector in the adaptive dictionary (depending on the sub-frame) or in a fixed dictionary, respectively, and on the other hand a gain value associated with said vector.
- certain vocoders such as the TETRAPOL vocoder, the parameters of at least one of the adaptive and fixed excitations directly define the excitation vector to be applied, that is to say without addressing a dictionary by an index. In what follows, no distinction is made between the mode of definition of the excitation vectors.
- the voeoder 10 receives a stream TS of frame masks, and / or a stream BS of bit masks .
- the stream FS is generated by a generator of frame masks 3, from a bit stream received from a pseudo-random generator 5, which operates from a secret key Kf known to the transmitter and to the receiver.
- the function of a frame mask is to select, from a determined number of frames of the stream of speech frames DS1, those in which only the bits of the secondary data stream DS2 are inserted.
- the generator 3 performs the following process. Either the sequence of frames F [i] of the main stream DS1, or h a digital function with integer values, and either k a determined integer, which is preferably substantially equal to the depth of storage of successive frames in the vooder 10 ( see further, number P, with reference to the diagram in FIG. 3), then the frames F [h (i)], F [h (i) +1], ..., F [h (i) + k ] define what is called here a subsequence of groups of frames of the sequence of frames F [i].
- the frames undergoing the insertion constraint are frames belonging to a subsequence of groups of consecutive frames of the main stream DS1.
- the number k which corresponds to the length in frames of a group of frames, is preferably equal to, or at least close to the storage depth R of the vocoder 10, as has been said above.
- the stream BS is in turn generated by a generator of bit masks 4, from a binary stream received from a pseudo-random generator 6, which operates from a secret key Kb, also known from transmitter and receiver.
- the function of a bit mask is to select, from among the N bits of a frame of the stream of speech frames DS1 selected by virtue of the frame mask associated with the current frame F [i], those which, only, are constrained by bits of the DS2 secondary data stream.
- the generator 4 performs the following process. It produces a stream of a fixed number Smax bits, where Smax designates the maximum number of bits of a current frame Fi of the main stream DS1 which can be constrained by bits of the secondary stream DS2.
- Smax designates the maximum number of bits of a current frame Fi of the main stream DS1 which can be constrained by bits of the secondary stream DS2.
- a determined number S of bits among these Smax bits, where S is less than or equal to Smax (S ⁇ Smax) have the logical value 1, the others having the logical value 0.
- Smax bits are inserted in a chain of N bits , at predefined and fixed positions which are provided in the software of the voeoder 10, so as to form a binary mask on the frame.
- This mask called bit mask, therefore comprises S bits equal to 1.
- a bit of the bit mask when a bit of the bit mask is equal to 1, it indicates a position for inserting a bit of the secondary stream DS2 in the current frame Fi of the main stream DS1.
- the number Smax is fixed by achieving a compromise between the maximum number of bits of the secondary stream DS2 which can be inserted in a frame of the main stream DS1, on the one hand, and the concern to preserve the quality of the coding of the speech signal.
- VS1 in the main DS1 stream on the other hand.
- the number Smax being fixed, the number S depends on the bit rate of the secondary stream DS2.
- the S / N ratio defines what can be called the insertion rate of the secondary flow DS2 in the main flow DS1 for the current frame F [i], the Smax N ratio defining the maximum insertion rate.
- N 120
- h (i) 10 xi
- Such a bit rate allows the insertion of a secondary data stream generated by a coded MF-MELP type at 1200 bit / s (requiring 81 bits in 67.5 ms) described in NATO STANAG 4591.
- the rate d insertion is sufficient to discreetly transmit a secondary flow which is also a speech flow generated by a secondary voeoder 20 of lower flow rate than that of the main voeodor 10.
- An example of insertion constraint consists in replacing (ie, overwriting) the bits of the main stream DS1 normally generated according to the standard coding algorithm implemented by the voeoder 10 from the speech signal VS1, by bits of the secondary stream DS2.
- the constraints applied to the speech coding parameters of the main stream are equality constraints with the bits of the second stream, combined with constraints of selection by logical AND operation applying a binary mask on the bits forming the main stream.
- This example is the simplest, but it is not the only one. Indeed, algorithms on the main flow and on the secondary flow using any contextual grammar or linear or non-linear algebra, including the Boolean algebra and the Allen temporal algebra (see the article "Maintaining Knowledge about Temporal Intervais ", Communications of the ACM, 11/26/1983, pp. 832-84), possible auxiliary memories and depending on the value of third-party parameters, allow the skilled person to define complex constraints, which respect for example statistical properties imposed by the speech model of the main stream.
- the set of excitation indices in a dictionary generally has a distribution of the bits at 0 and at 1 completely neutral with respect to a statistical analysis of occurrences. It is generally possible to encrypt the secondary stream DS2 in a pseudo-random form before insertion, without modifying the statistical distribution of 0 and 1 in the modified bits of the main stream. Assuming a speech coding model leading to a codestream with certain subframes having a correlation towards 0 or towards 1, the aforementioned pseudo-random generator or an encryption algorithm of the secondary stream must also have this bias. As will be understood, the number of bits constrained during coding varies from one frame to another according to a known evolution law of the transmitter and the receiver, which are supposed to be synchronized.
- the synchronization of the transmitter and the receiver with regard to the application of frame masks and / or bit masks results from the general synchronization between these two devices. Typically, this synchronization is ensured by labeling the frames using values generated by a frame counter.
- the general synchronization between the transmitter and the receiver can also come, in whole or in addition, from synchronization elements (particular bit patterns) inserted in the main stream DS1.
- the encoder 100 of the transmitter and the decoder of the receiver share the same initial information making it possible to determine the subsequence of the frame groups and of the subframes where the insertion of the secondary stream takes place. This information can include an initialization vector of the pseudo-random generators 5 and 6. It can be fixed.
- the coder 100 comprises a module 11 which is a hardware and / or software module for synthesizing linear prediction parameters, receiving the speech signal VS1 as input and delivering information LP as output corresponding to the linear prediction parameters (coefficients of the short-term linear prediction filter).
- the LP information is passed to the input of a logic unit 12, for example a multiplexer, which is controlled by the flow of frame masks FS and the bit mask flow BS.
- the unit 12 generates as output LP 'information corresponding to the information LP of which certain bits at least for at least certain frames, have been altered by application of the constraints resulting from the secondary stream DS2 via the frame mask and the bit mask associated with the current frame.
- the coder 100 also includes a module 21 which is a hardware and / or software module for synthesizing adaptive excitation parameters, receiving as input l 'LP information' and outputting LTP information corresponding to the adaptive excitation parameters (defining a first quantization vector and an associated gain for the short-term synthesis filter).
- the LTP information is passed to the input of a logic unit 22, for example a multiplexer, which is controlled by the flow of frame masks FS and the bit mask flow BS.
- the unit 22 generates as output LTP information 'corresponding to the LTP information of which certain bits at least for certain frames and / or for at least certain sub-frames, have been altered by application of the constraints resulting from the secondary flow DS2 via the frame mask and the bit mask associated with the current frame.
- a storage of the LTP 'information with a storage depth corresponding to a determined number Q of successive subframes of the current frame (Q ⁇ M-1), may be provided for the module 21.
- the encoder 100 comprises finally a module 31 which is a hardware and / or software module for synthesizing the fixed excitation parameters, receiving the LTP information as input and outputting a FIX information corresponding to the fixed excitation parameters (defining a second vector of quantification and an associated gain for the short-term synthesis filter).
- the FIX information is passed to the input of a logic unit 32, for example a multiplexer, which is controlled by the flow of frame masks FS and the bit mask flow BS.
- the unit 32 generates as output FIX 'information corresponding to the FIX information, at least some bits of which for certain frames and / or for at least certain sub-frames, have been altered by application of the constraints resulting from the secondary stream DS2 via the frame mask and the bit mask associated with the current frame.
- a storage of the information FIX ' with a storage depth corresponding to a determined number R of successive sub-frames of the current frame (R M M ⁇ 1), is provided for module 21.
- a storage of FIX 'information with a storage depth corresponding for example to a determined number W of successive sub-frames of the current frame (W ⁇ M-1), possibly provided for module 21.
- LP '(F [i]) f (LP' (F [i-1]), LP '(F [i-2]) LP' (F [i-P]);
- the recovery of the information coded by the bits of this secondary flow requires synchronization of the equipment with the sending equipment, means of extracting the secondary flow DS2 from the flow main DS1.
- identical to code 20 of the transmitting equipment Reference is made to the diagram in FIG. 4, which schematically shows the means of a receiver equipment voater 10a intended for processing the secondary stream transmitted by the method according to the invention.
- the vooder 10a if necessary after demultiplexing and channel decoding, receives the main stream DS1 at input, and delivers a speech signal VS1 'at output.
- the signal VS1 ' is less faithful to the source speech signal VS1 (figure
- the receiving equipment can also include a means for restoring the speech signal VS1 ′, for example a loudspeaker or the like.
- the known transmission protocols provide for general synchronization of the receiving equipment with the transmitting equipment. The implementation of the invention therefore does not require any particular means in this regard.
- the vooder 10a For the extraction of the secondary stream, the vooder 10a comprises a generator of frame masks 3a and a generator of bit masks 4a, respectively associated with a pseudo-random generator 5a and with a pseudo-random generator 6a, which are identical and arranged in the same way as the means 3, 4, 5 and 6 respectively of the voeoder 10 of the transmitting equipment (FIG. 3). It will be noted that the generators 5a and 6a of the receiver receive the same secret key, respectively Kf and Kb, as the generators 5 and 6 of the voeoder 10 of the transmitting equipment. These keys are stored in an ad hoc memory of the equipment.
- the generators 3a and 4a respectively generate a stream of frame masks FSa and a stream of bit masks BSa, which are supplied at the input of a decoder 100a of the vooder 10a.
- the extraction of the bits of the secondary stream DS2 is done by synchronous application (for example via logical AND operations) of the mask masks and bit masks at the input of the decoder 100a (for example via logical AND operations), without this affects the decoding of the main stream DS1 by the latter.
- the flow DS1 is supplied at the input of the decoder 00a via a logic unit 7a, which extracts the secondary information flow DS2 from the main information flow DS1 under the control of the flow of frame masks FSa and the flow of BSa bit masks.
- the receiving equipment can also include a secondary codec, identical to the coding 20 of the transmitting equipment for the decoding of the secondary stream DS2. When this stream is a speech stream, the secondary codec generates a speech signal which can be reproduced via a loudspeaker or the like.
- the fluctuation of the transmission rate of the bits of the secondary stream DS2 does not pose any particular problem on the receiver side, since the secondary stream DS2 is supplied at the input of a secondary codec with variable bit rate as is the case of all the vocoders on the market.
- a secondary codec comprises an input buffer memory ("Input Buffer" in English) in which the data of the DS2 stream are stored with a view to their decoding. You just have to make sure that the input buffer is never empty.
- the appropriate insertion rate is determined, taking into account in particular the bit rate of the encoder 100 and the secondary vooder 20 and the objectives of preserving the fidelity of the main stream VS1 to the speech signal VS1.
- this question of supplying the secondary voeoder of the receiving equipment should not pose a problem, with a main voeoder 10 of AMR type. in its coding mode at 12.2 kbits / s and a secondary voeoder 20 of bit rate approximately ten times less. Furthermore, in the case where the secondary stream is a speech stream and in order to provide the second decoder with a regular stream of frames, it is optionally possible to store the sequences and not to immediately start decoding.
- the secondary flow is a transparent data flow
- it is proposed to concatenate it and to treat it as if it had been transmitted by means of short messaging of maximum length (SMS service in GSM, for example), and to add a convolutional error correction code.
- the transparent data stream can be sent to an encryption module or to a transcoding and synthesis module of the "Text-to-Speech" type.
- constraints are imposed during coding on the value of zero, several or all the bits of the frame which are associated with an excitation vector of determined type, adaptive or fixed, before performing the iterations making it possible to calculate the parameters which depend on said excitation vector by virtue of the memorizations carried out in the voeodor.
- bits of constrained value are then the information of the secondary flow transported by the frame and constitute the channel of the secondary information flow DS2.
- the secondary stream is inserted by imposing values on bits forming the parameters of the adaptive or fixed excitation vectors. This can possibly be extended by applying constraints simultaneously to the excitation vectors of the other type, respectively fixed or adaptive.
- the bit mask can advantageously coincide with a set of unencrypted bits of a frame.
- This allows the receiving equipment playing the role of gateway to perform the extraction of the secondary stream inserted into the main stream without having the means to decrypt the main stream.
- This is particularly useful while preserving the confidentiality of the main stream, under the approximate assumption of linearity of the speech model of the voeodor, that is to say by considering that the residual or excitation parameters of the vocal cords are uncorrelated coefficients describing the response spectrum of the vocal tract.
- this mode of implementation of the method is characterized in that the secondary information stream is inserted by imposing constraints on unencrypted bits of parameters of the speech model of the main stream.
- This mode of implementation is illustrated by an example concerning an EFR voeoder (see above) used as main code.
- These 78 unprotected bits are identified in Table 6 (entitled “Ordering of Enhaneed Full Rate Speech Parameters for the Channel Encoder" in the ETSI specification EN 300 909 V8.5.1 GSM 05.03 "Channel coding”) and relate to a subset of the bits describing the fixed excitation vectors.
- the constraint consists in imposing a determined excitation value, taken from the dictionary.
- the dictionary is partitioned into several sub-dictionaries, and the constraint consists in imposing one of the sub-dictionaries.
- Another variant comprises the combination of the two types of constraint above.
- the constraint of imposition of the sub-dictionary can be equivalent to the application of the constraints on the least significant bits of the indices of excitation in the dictionary.
- the secondary flow defines a differential coding of the indices of excitation vectors, for example of fixed excitation vectors, in the subsequent series of frames of the main flow.
- the constrained bits may be the least significant bits of the fixed excitations (that is to say non-adaptive excitations) for each speech frame and possibly for each sub-frame defined in the speech frame within the meaning of the coding algorithm of the voeoder 10.
- the number and the position of the constrained bits are identified for each successive frame according to a mask calculation algorithm and of a secret element known to the transmitter and the receiver, in order to increase the chances of non-detection of the existence of the secondary stream by a third party.
- Another implementation mode applicable to a coding algorithm requiring several vectors of fixed excitation per frame or sub-frame, such as the CELP coded for the speech of an MPEG-4 stream (defined in the ISO specification / IEC 14496-3 Sub-part 3) for which certain fixed excitations of a frame are chosen from previous calculations and where other fixed excitations of the same frame are calculated by analysis by synthesis on a dictionary (see ISO specification / IEC 14496-3 ⁇ 7.9.3.4 "Multi-Pulse Excitation for the bandwidth extension tool"), consists in imposing the constraint on the choice by dictionary of the first fixed excitation and then using the iterations of analysis by synthesis on the second fixed excitation to make up for the error imposed by the constraint on the first fixed excitation.
- the sub-sequence of the frames of the main stream which are concerned with the insertion of the secondary stream only includes the frames which have sufficient energy and speech in the sense of the vooder.
- MELP vocoders which define several voicing levels
- HVXC vocoders from the English "Harmony Vector Excitation Coded"
- the sub-sequence only relates to segments with little or no visibility of the frames.
- the parameters of a sub-frame of the main stream DS1 remain entirely in accordance with the speech coding model of the vooder.
- the sequence of modified fixed excitations may be statistically atypical for human speech or possibly atypical for the speaker recognition process, depending on the constraints applied and the desired fidelity objective.
- a processing of the parameters including a smoothing of the gains of the fixed excitations associated with a processing of the pulses isolated from the excitation vectors followed by a post- filtering after speech synthesis, can be applied to decoding.
- the sub-suite frames on which the constraints are applied can be defined as a function of preliminary statistical analyzes on the values of the consecutive parameters of the speech model of the vocoders, for example by taking advantage of the texture of the speech parameters, defined by an inertia, an entropy or an energy derived from the probability of the sequences of values of the parameters, for example in eight consecutive frames representative of the duration of a phoneme.
- the performance of the synthesis of the main stream DS1, that is to say the fidelity to the signal VS1 is inversely proportional to the relative bit rate of the secondary stream DS2.
- the performance of subjective fidelity to the source 1 of the speech signal VS1 can however be achieved when the proposed method keeps invariant certain subjective attributes (for example certain psycho-acoustic criteria) of the source 1. It can be measured by statistical measurements ( "Mean Opinion Score", or MOS) according to a standardized scale (see recommendation ITU-T P.862 "Perceptual evaluation of speech quality -PESQ").
- the degradation of the subjective quality of the speech stream DS1 coming from the vooder 10, which is due to the insertion of the secondary stream DS2, is assumed to be acceptable to justify the application of the proposed method.
- This is particularly the case when the secondary stream is also a speech stream and the auditory content of the main stream is much less important than the content of the secondary stream for the legitimate listener.
- the psycho-acoustic perception of the possible presence of the flow secondary when listening to the main stream decoded and restored does not help to locate the secondary stream in the main stream and therefore to provide formal proof of its existence.
- one embodiment consists in preferably applying the constraints on sub-frames different from the sub-frames on which the long-term analysis windows of the frame are concentrated, namely, for example, the second and the fourth sub-frame for the 12.2 kbit / s coding mode of the AMR vooder mentioned above (see specification 3GPP TS 26.090 V5.0.0, ⁇ 5.2.1 "Windowing and auto-correlation computation").
- the error between the signal of the main flow and the signal synthesized by the short-term filter with the contribution of the constrained adaptive vector is compensated by the choice of the fixed excitation vector which tries to catch up with the residual error (for example the error quadratic residual) of the long-term prediction on the same sub-frame, as well as the excitation vectors of the successive sub-frames.
- the constrained excitation vectors encode the secondary flux as an adaptive residue above the response of the short-term synthesis filter of the main flux corrected by the fixed residue.
- an implementation leads to focus on the least significant bits of the amplitude parameters of the harmonics of the frame segments or in the amplitude parameters of samples of l spectral envelope.
- the excitation parameters are the fundamental frequency as well as the voiced / unvoiced decision for each frequency band.
- the main stream DS1 also contains silence frames, which are frames coded by the voeoder 10 with a lower bit rate and transmitted with a lower periodicity than the speech frames, to synthesize when the periods of silence contained in the speech signal VS1. These frames of silence synthesize what is called a comfort noise.
- a method of implementing the method may provide, as a variant or in addition, the insertion of the secondary stream via numerical constraints on the values of the descriptors of the comfort noise parameters to be generated under the main stream. This implementation mode is illustrated by an example concerning an EFR or AMR code (see above) used as the main code.
- SID frames In GSM and UMTS systems, frames carrying comfort noise (silence frames) are called SID frames (see for example specification 3GPP TS 26.092 "Mandatory Speech Codée Speech Processing Functions; AMR Speech Codée; Confort Noise Aspects" of l 'AND IF). More specifically the frames considered here are SID-UPDATE frames which contain 35 bits of comfort noise parameters and a 7-bit error correcting code. In a GSM or UMTS system, it is the source that controls the transmission of silence frames, that is to say the code of the transmitter (subject to interactions with the voice activity detection process and discontinuous transmission, in particular on the downlink from the relay to the mobile terminal).
- the frequency of the silence frames is controlled by the source or by the relay and corresponds either to a silence frame every 20 ms or to a silence frame every 160 ms, or even to a frame silence every 480 ms for the EFR coded of the GSM system. This determines the maximum flow rate for the secondary flow in this variant of the process.
- the duplex transmission channel it is possible to use the duplex transmission channel to send frames of silence when the speaker is a second participant in the communication or in silence in a first conversation, that is to say between the groups of phonemes emitted according to the main stream.
- the 3GPP TS 26.090 specification specifies that the size of the EFR coded comfort noise coding field, namely 35 bits per silence frame, is identical to the size of the fixed excitation parameter for this same coded. This means that the same constraints can be applied and a minimum permanent insertion rate obtained by using all the frames regardless of the nature, speech or silence, of the main stream.
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Time-Division Multiplex Systems (AREA)
- Communication Control (AREA)
- Telephone Set Structure (AREA)
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0310546A FR2859566B1 (fr) | 2003-09-05 | 2003-09-05 | Procede de transmission d'un flux d'information par insertion a l'interieur d'un flux de donnees de parole, et codec parametrique pour sa mise en oeuvre |
PCT/FR2004/002259 WO2005024786A1 (fr) | 2003-09-05 | 2004-09-06 | Procede de transmission d'un flux d'information par insertion a l'interieur d'un flux de donnees de parole, et codec parametrique pour sa mise en oeuvre |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1665234A1 true EP1665234A1 (fr) | 2006-06-07 |
EP1665234B1 EP1665234B1 (fr) | 2010-10-13 |
Family
ID=34178831
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP04787314A Expired - Lifetime EP1665234B1 (fr) | 2003-09-05 | 2004-09-06 | Procede de transmission d un flux d information par insertion a l'interieur d'un flux de donnees de parole, et codec parametrique pour sa mise en oeuvre |
Country Status (8)
Country | Link |
---|---|
US (1) | US7684980B2 (fr) |
EP (1) | EP1665234B1 (fr) |
AT (1) | ATE484821T1 (fr) |
CA (1) | CA2541805A1 (fr) |
DE (1) | DE602004029590D1 (fr) |
ES (1) | ES2354024T3 (fr) |
FR (1) | FR2859566B1 (fr) |
WO (1) | WO2005024786A1 (fr) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2898229B1 (fr) | 2006-03-06 | 2008-05-30 | Eads Secure Networks Soc Par A | Synchronisation cryptographique entrelacee |
US8054969B2 (en) * | 2007-02-15 | 2011-11-08 | Avaya Inc. | Transmission of a digital message interspersed throughout a compressed information signal |
WO2009004227A1 (fr) * | 2007-06-15 | 2009-01-08 | France Telecom | Codage de signaux audionumériques |
US8792473B2 (en) * | 2008-12-18 | 2014-07-29 | Motorola Solutions, Inc. | Synchronization of a plurality of data streams |
BR112012025347B1 (pt) * | 2010-04-14 | 2020-06-09 | Voiceage Corp | dispositivo de codificação de livro-código de inovação combinado, codificador de celp, livro-código de inovação combinado, decodificador de celp, método de codificação de livro-código de inovação combinado e método de decodificação de livro-código de inovação combinado |
US8689089B2 (en) * | 2011-01-06 | 2014-04-01 | Broadcom Corporation | Method and system for encoding for 100G-KR networking |
CN103187065B (zh) | 2011-12-30 | 2015-12-16 | 华为技术有限公司 | 音频数据的处理方法、装置和系统 |
US9165162B2 (en) * | 2012-12-28 | 2015-10-20 | Infineon Technologies Ag | Processor arrangements and a method for transmitting a data bit sequence |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1991003901A1 (fr) * | 1989-09-04 | 1991-03-21 | Fujitsu Limited | Systeme d'echange a relais de donnees a multiplexage temporel |
US5319735A (en) * | 1991-12-17 | 1994-06-07 | Bolt Beranek And Newman Inc. | Embedded signalling |
US5937000A (en) * | 1995-09-06 | 1999-08-10 | Solana Technology Development Corporation | Method and apparatus for embedding auxiliary data in a primary data signal |
US5790759A (en) * | 1995-09-19 | 1998-08-04 | Lucent Technologies Inc. | Perceptual noise masking measure based on synthesis filter frequency response |
US5757788A (en) * | 1996-01-11 | 1998-05-26 | Matsushita Electric Ind. | Digital radio communication system with efficient audio and non-audio data transmission |
JP4456185B2 (ja) * | 1997-08-29 | 2010-04-28 | 富士通株式会社 | コピー防止機能を持つ見える透かし入り動画像記録媒体とその作成・検出および録画・再生装置 |
WO1999041094A1 (fr) * | 1998-02-17 | 1999-08-19 | Mi-Jack Products | Systeme de roues pour rails servant a supporter les charges d'une grue a portique se deplaçant sur la route |
GB2340351B (en) * | 1998-07-29 | 2004-06-09 | British Broadcasting Corp | Data transmission |
WO2000039955A1 (fr) * | 1998-12-29 | 2000-07-06 | Kent Ridge Digital Labs | Application de filigrane audio numerique par utilisation de sauts a echos multiples adaptes au contenu |
AU6533799A (en) * | 1999-01-11 | 2000-07-13 | Lucent Technologies Inc. | Method for transmitting data in wireless speech channels |
US7130309B2 (en) * | 2002-02-20 | 2006-10-31 | Intel Corporation | Communication device with dynamic delay compensation and method for communicating voice over a packet-switched network |
-
2003
- 2003-09-05 FR FR0310546A patent/FR2859566B1/fr not_active Expired - Fee Related
-
2004
- 2004-09-06 CA CA002541805A patent/CA2541805A1/fr not_active Abandoned
- 2004-09-06 EP EP04787314A patent/EP1665234B1/fr not_active Expired - Lifetime
- 2004-09-06 WO PCT/FR2004/002259 patent/WO2005024786A1/fr active Application Filing
- 2004-09-06 AT AT04787314T patent/ATE484821T1/de not_active IP Right Cessation
- 2004-09-06 DE DE602004029590T patent/DE602004029590D1/de not_active Expired - Lifetime
- 2004-09-06 US US10/569,914 patent/US7684980B2/en active Active
- 2004-09-06 ES ES04787314T patent/ES2354024T3/es not_active Expired - Lifetime
Non-Patent Citations (1)
Title |
---|
See references of WO2005024786A1 * |
Also Published As
Publication number | Publication date |
---|---|
ES2354024T3 (es) | 2011-03-09 |
FR2859566B1 (fr) | 2010-11-05 |
ATE484821T1 (de) | 2010-10-15 |
CA2541805A1 (fr) | 2005-03-17 |
ES2354024T8 (es) | 2011-04-12 |
EP1665234B1 (fr) | 2010-10-13 |
US7684980B2 (en) | 2010-03-23 |
WO2005024786A1 (fr) | 2005-03-17 |
FR2859566A1 (fr) | 2005-03-11 |
DE602004029590D1 (de) | 2010-11-25 |
US20060247926A1 (en) | 2006-11-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1320087B1 (fr) | Synthèse d'un signal d'excitation utilisé dans un générateur de bruit de confort | |
EP2277172B1 (fr) | Dissimulation d'erreur de transmission dans un signal audionumerique dans une structure de decodage hierarchique | |
EP1316087B1 (fr) | Dissimulation d'erreurs de transmission dans un signal audio | |
US7310596B2 (en) | Method and system for embedding and extracting data from encoded voice code | |
EP0139803A1 (fr) | Procédé de reconstitution d'informations perdues dans un système de transmission numérique de la voix et système de transmission utilisant ledit procédé | |
FR3007564A3 (fr) | Decodeur audio avec metadonnees d'informations de programme | |
KR20070028373A (ko) | 음성음악 복호화 장치 및 음성음악 복호화 방법 | |
EP1051703A1 (fr) | Procede decodage d'un signal audio avec correction des erreurs de transmission | |
EP2080194B1 (fr) | Attenuation du survoisement, notamment pour la generation d'une excitation aupres d'un decodeur, en absence d'information | |
EP1692687B1 (fr) | Transcodage entre indices de dictionnaires multi-impulsionnels utilises en codage en compression de signaux numeriques | |
EP1665234B1 (fr) | Procede de transmission d un flux d information par insertion a l'interieur d'un flux de donnees de parole, et codec parametrique pour sa mise en oeuvre | |
EP2347411A1 (fr) | Attenuation de pre-echos dans un signal audionumerique | |
WO2004039053A2 (fr) | Embrouillage adaptatif et progressif de flux audio | |
EP2203915B1 (fr) | Dissimulation d'erreur de transmission dans un signal numerique avec repartition de la complexite | |
EP2171713B1 (fr) | Codage de signaux audionumériques | |
US20030158730A1 (en) | Method and apparatus for embedding data in and extracting data from voice code | |
TW202427458A (zh) | 用於音訊編碼/解碼的錯誤恢復工具 | |
FR2760285A1 (fr) | Procede et dispositif de generation d'un signal de bruit pour la sortie non vocale d'un signal decode de la parole | |
MX2007015190A (en) | Robust decoder |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20060306 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PL PT RO SE SI SK TR |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: EADS SECURE NETWORKS |
|
DAX | Request for extension of the european patent (deleted) | ||
17Q | First examination report despatched |
Effective date: 20081022 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Free format text: NOT ENGLISH |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Free format text: LANGUAGE OF EP DOCUMENT: FRENCH |
|
REF | Corresponds to: |
Ref document number: 602004029590 Country of ref document: DE Date of ref document: 20101125 Kind code of ref document: P |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20101013 |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: EADS SECURE NETWORKS |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FG2A Effective date: 20110225 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602004029590 Country of ref document: DE Owner name: CASSIDIAN SAS, FR Free format text: FORMER OWNER: EADS SECURE NETWORKS, MONTIGNY LE BRETONNEUX, FR Effective date: 20110302 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FD4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110113 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110214 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: CA |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: CASSIDIAN SAS |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20110114 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 |
|
RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: EADS SECURE NETWORKS |
|
26N | No opposition filed |
Effective date: 20110714 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602004029590 Country of ref document: DE Effective date: 20110714 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 |
|
BERE | Be: lapsed |
Owner name: EADS SECURE NETWORKS Effective date: 20110930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110930 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110930 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110930 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF EXPIRATION OF PROTECTION Effective date: 20101013 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110906 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: TP Owner name: CASSIDIAN SAS, FR Effective date: 20130719 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602004029590 Country of ref document: DE Owner name: CASSIDIAN SAS, FR Free format text: FORMER OWNER: EADS SECURE NETWORKS, ELANCOURT, FR Effective date: 20130725 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 732E Free format text: REGISTERED BETWEEN 20130926 AND 20131002 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20101013 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: ES Payment date: 20130906 Year of fee payment: 10 Ref country code: DE Payment date: 20130820 Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: PC2A Owner name: CASSISIAN SAS Effective date: 20131028 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20130823 Year of fee payment: 10 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20130920 Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: CD Owner name: AIRBUS DS SAS, FR Effective date: 20150106 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602004029590 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20140906 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20150529 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140906 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20150401 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140930 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Ref document number: 602004029590 Country of ref document: DE Free format text: PREVIOUS MAIN CLASS: G10L0019140000 Ipc: G10L0019040000 |
|
REG | Reference to a national code |
Ref country code: ES Ref legal event code: FD2A Effective date: 20151127 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20140907 |