EP2062254B1 - Stéganographie dans des codeurs de signaux numériques - Google Patents

Stéganographie dans des codeurs de signaux numériques Download PDF

Info

Publication number
EP2062254B1
EP2062254B1 EP07801969A EP07801969A EP2062254B1 EP 2062254 B1 EP2062254 B1 EP 2062254B1 EP 07801969 A EP07801969 A EP 07801969A EP 07801969 A EP07801969 A EP 07801969A EP 2062254 B1 EP2062254 B1 EP 2062254B1
Authority
EP
European Patent Office
Prior art keywords
code
information
code word
signal
steganographic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP07801969A
Other languages
German (de)
English (en)
Other versions
EP2062254A1 (fr
Inventor
Bernd Geiser
Peter Vary
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Telefonaktiebolaget LM Ericsson AB
Original Assignee
Telefonaktiebolaget LM Ericsson AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Telefonaktiebolaget LM Ericsson AB filed Critical Telefonaktiebolaget LM Ericsson AB
Priority to EP11006299A priority Critical patent/EP2385521A1/fr
Priority to SI200731014T priority patent/SI2062254T1/sl
Priority to PL07801969T priority patent/PL2062254T3/pl
Publication of EP2062254A1 publication Critical patent/EP2062254A1/fr
Application granted granted Critical
Publication of EP2062254B1 publication Critical patent/EP2062254B1/fr
Priority to CY20121100830T priority patent/CY1113155T1/el
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04K—SECRET COMMUNICATION; JAMMING OF COMMUNICATION
    • H04K1/00—Secret communication
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/018—Audio watermarking, i.e. embedding inaudible data in the audio signal
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G10L19/12—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L2019/0001—Codebooks
    • G10L2019/0007—Codebook element generation

Definitions

  • the invention is directed to a method for embedding a steganographic information in a signal information of a signal encoder.
  • digital transmission is becoming increasingly important. Among other things, this is due to the fact that digital signal information is processed more easily, i. can be copied or compressed.
  • the compression of digital signal information means that information can be transmitted by means of signal transmission channels with limited data transmission rates with high information density.
  • the voice information to be transmitted by means of the well-known CELP (Code-book Excited Linear Predictive Coding) or ACELP (Algebraic Code Excited Linear Prediction) or in the future the AMR (Adaptive Multi-Rate) coding coded.
  • CELP Code-book Excited Linear Predictive Coding
  • ACELP Algebraic Code Excited Linear Prediction
  • AMR Adaptive Multi-Rate
  • a signal coder such as a CELP coder, an ACELP coder or an AMR coder, generates a codebook entry, typically a vector of a so-called codebook, with the codebook entry code elements - ie usually the vector components - information regarding the (filter) excitation included. Filter coefficients, gain factors, etc. are encoded as time information by means of dedicated codebooks.
  • a codebook for excitation coding usually consists of a set of vectors, for example each with 10 components in the ACELP encoding according to the Enhanced Full Rate (EFR) standard, which encode the speech information to be transmitted for a certain length, for example 5 milliseconds.
  • EFR Enhanced Full Rate
  • This speech information can be decoded on the receiver side, wherein the actual decoder can also recognize at the same time from which decomposition of the codebook the codebook entry originates.
  • the publication also describes the known analysis-by-synthesis method.
  • the selected codeword is evaluated, ie the quality of the coding is checked. This is essentially achieved by decoding, ie synthesizing, the coding after speech information has been coded, and comparing the result of the decoding, which in turn represents speech information, with the original speech information.
  • a synthesis is performed in advance on the transmitter side - encoder side - which, after any transmission, is also performed on the receiver side decoder side.
  • a codeword that is to say generally a vector from a codebook, which firstly has the desired property, ie originating from the correspondingly decomposed subcodebook, and thereby the speech information coded with sufficient quality.
  • the invention is therefore based on the object to provide a solution that makes it possible to embed a steganographic information in a signal information of a signal encoder such that a reduction in voice quality is largely avoided.
  • the object is achieved by providing a data information, in particular a speech information, selecting a steganographic information from a set of steganographic information, generating a codeword from a provided codebook by means of a signal coder based on the codeword forming code elements, such that using the generated codeword in the context of a the codebook associable transmission standards, the data information is encoded in a codeword-containing and / or referring to the codeword signal information; and that the generated codeword has an additional property computable on the basis of the codewords forming the codeword, the additional property representing the steganographic information.
  • Such a method for embedding steganographic information in signal information of a signal coder in which a codeword is generated from a provided codebook by means of the signal coder on the basis of codeword-forming code elements makes it possible to provide a codeword having a calculable property on the one hand, ie represents a steganographic information, and on the other hand at the same time provides signal information which for a data information, in particular a voice information, encoded.
  • codewords not in the practical codebook and / or the decompositions of the practical code may be considered book were available. This significantly expands the number of code elements that can be accessed so that either decomposition in more sub-codebooks compared to the prior art or with an equal number of sub-codebooks provides improved speech quality over the prior art can.
  • an evaluation of the generated codeword is carried out in the context of a transmission standard associable with the provided codebook by decoding the codeword and then comparing the decoded data information with the original data information.
  • the code word is generated from the provided codebook by means of the signal coder on the basis of the codeword-forming code elements, taking into account the evaluation.
  • the use of a based on the GSM (Global System for Mobile Communications) - and / or UMTS (Universal Mobile Telecommunications Standard) transmission standards based coder and codebook is provided.
  • GSM Global System for Mobile Communications
  • UMTS Universal Mobile Telecommunications Standard
  • the generation of a codeword on the basis of the ACELP (Algebraic Code Exited Linear Prediction) - and / or the AMR encoding is provided.
  • ACELP coding allows the use of the method according to the invention in many fields of technology, in particular mobile telecommunications. This also applies to the future by analogy for the AMR coding.
  • the calculation of the property of the code word is performed as a result of applying at least one operation to at least one of the code elements forming the code word.
  • the provision of the code word is carried out such that the code word implicitly satisfies the property.
  • the selection of the steganographic information is carried out in such a way that the steganographic information is used for signal improvement, in particular for voice transmission, such as artificial bandwidth expansion and / or noise reduction.
  • the additional transferable steganographic information can be used, for example, to describe a property of the data information actually to be transmitted, so that the steganographic information can be used for signal enhancement.
  • the code word coding for the data information is generated by the method according to the invention - the marginal loss in the transmission quality can not only be compensated by the steganographic additional information, but can even be overcompensated.
  • the selection of steganographic information is performed such that the steganographic information is used as a digital watermark.
  • the steganographic information When using the steganographic information as a digital watermark not only the originality and the origin of data information can be marked, but also copyright to data information can be introduced using the steganographic information in the form of a digital watermark.
  • the data information is qualitatively hardly impaired in the context of the method according to the invention.
  • a transmission of the codeword-containing or referring to the codeword signal information is performed to a receiver.
  • provision of data information by means of decoding of the codeword is carried out in the context of a transmission standard associable with the provided codebook.
  • the data information included in the signal information as well as the steganographic information can be recovered and used.
  • the steganographic information is provided on the receiving side by means of calculating the additional property of the codeword on the basis of the code elements forming the codeword.
  • the receiver it is possible to calculate the steganographic information contained in the signal information. This possibility can optionally be used, ie systems which are not able to recalculate the steganographic information will only extract the data information from the signal information without getting to the steganographic information.
  • the method is also carried out in a mobile radio device.
  • the method is particularly suitable for signal information transmission, i. Voice or other information, by means of mobile devices, which are operable in a mobile network.
  • Fig. 1 shows an encoder 100 according to an embodiment of the invention.
  • the coder 100 is supplied with a signal 101 to be coded, for example a speech signal 100.
  • data 100 to be embedded is supplied to the encoder 100.
  • the coder generates a coded signal 103 from the signal 101 to be coded, into which the data 102 to be embedded is embedded, that is, from which a corresponding decoder can determine the data 102 to be embedded.
  • the coded signal 103 is transmitted, for example, to a receiver, for example by means of a computer network or by means of a radio network.
  • the encoder 100 is used in a GSM (Global System for Mobile Communications) mobile radio network.
  • the encoder can also be used within the framework of a mobile radio network in accordance with UMTS (Universal Mobile Telecommunications Standard), CDMA2000 (CDMA: Code Division Multiple Access) or according to FOMA (Freedom of Mobile Access).
  • UMTS Universal Mobile Telecommunications Standard
  • CDMA2000 CDMA: Code Division Multiple Access
  • FOMA Freedom of Mobile Access
  • the signal 101 to be encoded is a speech signal outputted from the encoder 100 according to an ACELP (Algebraic Code Excited Linear Prediction) speech compression method.
  • ACELP Algebraic Code Excited Linear Prediction
  • ACCELP Enhanced Full Rate
  • the encoder 100 uses a codebook defined as follows:
  • the codebook C used in this embodiment is the codebook of the GSM EFR (Enhanced Full Rate) codec and is given by the vectors c of the ACELP pulse positions (unsigned in this embodiment) for each 5ms subframe:
  • a codeword c from the codebook (ie, the set of all possible codewords) C is thus a ten component vector, with each component describing a position of a pulse within a subframe.
  • the components of the vectors c are signed.
  • the use of signed components allows for improved information embedding.
  • EFR dispenses with the use of signed components for complexity reasons.
  • the codebook C is in one embodiment decomposed into two sub-codebooks C (1) and C (2) so that one bit of the data to be embedded 102 can be embedded per codeword in the coded signal 103 and accordingly one bit of the data 102 to be embedded per Subframe is transmitted, which corresponds to a sub-frame duration of 5ms a data rate of 200bit / s.
  • the codewords of the sub-codebooks differ in that the sum of the components c i of a codeword is even from the one sub-codebook and odd from the other sub-codebook.
  • a codeword from C (1) is used for coding (the current signal values of the signal to be coded 101), and a second message ( in this example consisting of one bit, for example bit value 1), a codeword from C (1) is used for coding.
  • a receiver or decoder may determine whether the first message or the second message has been embedded based on the membership of a received codeword to C (1) or C (2).
  • four bits are embedded per subframe, thereby achieving a data rate of 400bit / s.
  • the expression trunc (c i / 5) may also be used Pulse position clearly indicated within a so-called track.
  • the respective graycoded version GRAY (c i ) or GRAY (trunc (c i / 5)) may be used as intended for channel coding in EFR.
  • the summation is carried out modulo 2, so that it is required that the sum modulo 2 of several codeword bits b j is equal to the message bit m i to be embedded.
  • the above-described procedure for embedding information can also be used in other coders, for example in all CELP speech coders but also in other signal coders such as video coders, image coders, etc.
  • the transmission of page information (embedded information) by means of steganography can also improve the signal
  • a receiver without knowledge of the embedded information can use the (speech) signal in which the information was embedded as usual, that is, as in the case of no embedding of information with only a small amount of information Decode losses. If the recipient knows the embedded information, the page information can be used to improve the signal.
  • a corresponding embodiment will be described below with reference to Fig.2 described.
  • Fig.2 shows an encoder / decoder system 200 according to another embodiment of the invention.
  • the encoding / decoding system 200 includes an encoder 201 as described with reference to FIG Fig. 1 described on. Accordingly, a signal 202 to be encoded and data 203 to be embedded are supplied to the encoder 201. The data to be embedded are used for signal enhancement and are accordingly generated in a signal-enhancement-encoding signal 202 by a signal analyzer 204 to which the signal 202 to be coded is supplied.
  • the encoder 201 outputs a coded signal 205 into which the data 203 to be embedded is embedded.
  • the coded signal 205 can now be transmitted to a receiver, for example, as described above, by means of a mobile radio communication network.
  • the receiver has a "conventional" decoder 206, that is, a decoder that can not detect the embedded data from the encoded signal 205, the decoder 206 decodes only the encoded signal 205 to a decoded signal 207 which (except for transmission errors and coding / decoding losses) corresponds to the signal 202 to be coded.
  • a "conventional" decoder 206 that is, a decoder that can not detect the embedded data from the encoded signal 205
  • the decoder 206 decodes only the encoded signal 205 to a decoded signal 207 which (except for transmission errors and coding / decoding losses) corresponds to the signal 202 to be coded.
  • the receiver has an "extended" decoder 208, that is, a decoder capable of detecting the embedded data from the encoded signal 205, then the embedded data is extracted and the extracted data 209 is used by a signal enhancement unit 210 which decodes a signal and (compared to the decoded signal 207) improved signal 211 generated.
  • extended decoder 208 that is, a decoder capable of detecting the embedded data from the encoded signal 205
  • the embedded data is extracted and the extracted data 209 is used by a signal enhancement unit 210 which decodes a signal and (compared to the decoded signal 207) improved signal 211 generated.
  • the coefficients of a postfilter determined by the transmitter can also be transmitted by steganography.
  • the application of artificial bandwidth expansion is advantageous because the telephone network is historically limited to an acoustic bandwidth of 3.1kHz (300Hz-3.4kHz), a transmission of broadband (50Hz-7kHz) but only with enormous effort on the part of the network operators and the terminal manufacturers would be accomplished. Changes in the (mobile) transmission network, however, are not required to implement the embodiments described above.
  • Corresponding (powerful) bandwidth expansion algorithms are disclosed, for example, in the publication of Peter Jax, Bernd Geiser, Stefan Schandl, Hervé Taddei, and Peter Vary, "An Embedded Scalable Wideband Codec Based on the GSM EFR Codec," described in Proceedings of ICASSP, Toulouse, May 2006 s.
  • c6_offset 5 * ((c1 + b + 1) mod 2)
  • other combinations of already determined pulse positions and embedded bis can also be used.
  • the search space for the pulse position c 6 was divided into two equal parts (odd / even values). Further divisions (for example, first / second half of the value) are also possible, with the equation for c6_offset being adapted accordingly.
  • the idea underlying an embodiment can be seen in that the information embedding is known to the signal encoder, which is achieved by a common data embedding and signal coding, that is, for example, the watermark embedding is integrated into the encoder. This can be done within an analysis-by-synthesis loop ("closed-loop") as described in Figure 3 is shown.
  • Figure 3 shows an encoder 300 according to another embodiment of the invention.
  • the encoder is supplied with a signal to be encoded and data 302 to be embedded.
  • An encoded signal 303 is generated from the signal 301 to be encoded by means of a loop comprising a codebook 304, a synthesizer 305 and a comparator 306.
  • a possible coding of the signal 301 to be coded is generated by the codebook 304 and it is checked by means of the synthesizer 305 and the comparator 306 how well it reflects the signal 301 to be coded and, if appropriate, modified based on the output of the comparator 306.
  • the data to be embedded 302 are embedded in the encoded signal 303 during the encoding process, for example according to one of the procedures described above.
  • a sub-codebook of the codebook 304 is selected as shown in FIG Figure 4 is shown.
  • Figure 4 shows an encoder 400 according to another embodiment of the invention.
  • the encoder 300 to be embedded is supplied with data 402 to be embedded in the encoder and a signal 401 to be encoded, and generates a coded signal 403 in which the data 402 to be embedded is embedded.
  • the encoder 400 has a plurality of sub-codebooks 404, a codebook divided into a plurality of sub-codebooks 404. Based on the data to be embedded, the sub-codebooks are selected in coding the signal 401 to be coded.
  • a data word of the signal to be coded 401 is input Codeword assigned from a first sub-codebook, when a first page information from the data to be embedded 402, for example a bit with the value 0, to be embedded and it is assigned a codeword from a second sub-codebook, if a second page information from the Trobettenden Data 402, for example a bit with the value 1, should be embedded.
  • Fig. 5 shows a codebook 500 according to another embodiment of the invention.
  • the codebook 500 is labeled C. For efficiency reasons, if the codeword extent of the codebook 500 is very large, the codebook 500 is only partially searched during coding, i. Codewords for coding are selected only from a codebook subset 501 denoted C '(practical codebook).
  • the codebook 500 for data embedding is decomposed into codebooks as explained above, for example, four subcodebooks 502 designated C (1) to C (4).
  • a sub-codebook 502 Since a sub-codebook 502 has a smaller codeword extent than the codebook subset 501, and thus the quality of the signal coding (depending on the number of subcodebooks 502) would decrease from using the entire codebook subset 501, in one embodiment Code extent of the sub-codebooks 502 extended, so that a total of an extended codebook subset 503 is used for coding.
  • the algorithmic complexity increases only slightly, the quality of the coding does not decrease and in special cases even an increase in quality can be achieved.
  • an algebraic codebook is used.
  • an algebraic codebook exists only in the sense of an algebraic design rule. This means that the individual codebook entries (codewords) are generated during the signal coding by a codeword generator.
  • the "binning scheme" for information embedding that is, the decomposition of the codebook in sub-codebooks and selection of the sub-codebook used for coding depending on the information to be embedded, in an encoder with algebraic codebook now no longer consists only in the division of the codebook in a number of sub-codebooks, but moreover in the modification of the codeword generator in that only codewords associated with the sub-codebook C (i) selected by the currently-to-be-embedded message i are output.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Editing Of Facsimile Originals (AREA)

Abstract

Dans un procédé destiné à incorporer une information stéganographique dans une information de signalisation d'un codeur de signaux, l'objectif est de concevoir une solution qui permet d'incorporer une information stéganographique dans une information de signalisation d'un codeur de signaux, de manière à éviter largement une diminution de la qualité vocale. Celle-ci est obtenue par la mise à disposition d'une information de données, en particulier une information vocale, la sélection d'une information stéganographique parmi une pluralité d'informations stéganographiques, la création d'un mot codé à partir d'un livre de codes mis à disposition, au moyen d'un codeur de signaux, sur la base d'éléments codés formant le mot codé, de telle sorte que, moyennant l'utilisation du mot codé créé dans le cadre d'un standard de transmission associable au livre de codes, l'information de données est codée en une information de signalisation contenant le mot codé et/ou renvoyant au mot codé et que le mot codé créé possède une propriété supplémentaire, apte à être calculée sur la base des éléments codés formant le mot codé, la propriété supplémentaire constituant l'information stéganographique.

Claims (24)

  1. Procédé d'incorporation d'une information stéganographique dans une information de signal d'un codeur de signaux (100), caractérisé par :
    - la fourniture d'une information de données, notamment d'une information vocale, comme signal à coder (101),
    - la sélection d'une information stéganographique comme données à incorporer (102), dans lequel l'information stéganographique est sélectionnée parmi une quantité d'informations stéganographiques,
    - la génération d'un mot de code d'après une nomenclature de codage algébrique (500) dans l'esprit d'une consigne de construction algébrique au moyen du codeur de signaux (100) sur la base des éléments de code formant le mot de code, de telle sorte que
    • en utilisant le mot de code généré dans le cadre d'une norme de transmission associée à la nomenclature de codage l'information de données est codée dans une information de signal contenant le mot de code et/ou renvoyant au mot de code comme signal codé (103) ;
    • le mot de code généré présente une propriété supplémentaire, pouvant être calculée sur la base des éléments de code formant le mot de code, dans lequel la propriété supplémentaire représente l'information stéganographique ; et
    • la nomenclature de codage (500) dans l'esprit de la consigne de construction algébrique est divisé en une pluralité de sous-nomenclatures de codage et par l'intermédiaire du codeur de signaux (100) respectivement seul un mot de code appartenant à la sous-nomenclature de codage sélectionnée par l'information stéganographique à incorporer actuellement est émis.
  2. Procédé selon la revendication 1, caractérisé par une évaluation du mot de code généré dans le cadre d'une norme de transmission associée à la nomenclature de codage fournie au moyen du décodage du mot de code et de la comparaison consécutive de l'information de données décodée avec l'information de données d'origine.
  3. Procédé selon la revendication 2, caractérisé par la génération du mot de code d'après la nomenclature de codage fournie au moyen du codeur de signaux (100) sur la base des éléments de code formant le mot de code en tenant compte de l'évaluation.
  4. Procédé selon une des revendications précédentes, caractérisé par l'utilisation d'un codeur (100) et d'une nomenclature de codage se basant sur la norme de transmission GSM et/ou UMTS.
  5. Procédé selon une des revendications précédentes, caractérisé par la génération d'un mot de code sur la base d'un codage ACELP ou AMR.
  6. Procédé selon une des revendications précédentes, caractérisé par le calcul de la propriété du mot de code comme résultat d'une utilisation d'au moins une opération sur au moins un des éléments de code formant le mot de code.
  7. Procédé selon une des revendications précédentes, caractérisé par la fourniture du mot de code de telle sorte que le mot de code satisfasse implicitement à la propriété.
  8. Procédé selon la revendication 7, caractérisé par la génération du mot de code de telle sorte qu'il satisfasse à la propriété, qui représente l'information stéganographique, déjà pendant sa génération.
  9. Procédé selon une des revendications précédentes, caractérisé par la sélection de l'information stéganographique, de telle sorte que l'information stéganographique soit utilisée du côté récepteur pour l'amélioration du signal, notamment en cas de transmission vocale, comme un élargissement de bande passante artificiel et/ou une réduction de perturbations.
  10. Procédé selon une des revendications précédentes, caractérisé par la sélection de l'information stéganographique de telle sorte que l'information stéganographique soit utilisée comme filigrane numérique.
  11. Procédé selon une des revendications précédentes, caractérisé par une transmission de l'information de signal contenant le mot de code ou renvoyant au mot de code à un récepteur.
  12. Procédé selon la revendication 11, caractérisé par une fourniture du côté récepteur d'une information de données au moyen du décodage du mot de code dans le cadre d'une norme de transmission associée à la nomenclature de codage fournie.
  13. Procédé selon la revendication 11 ou 12, caractérisé par une fourniture du côté récepteur de l'information stéganographique au moyen du calcul de la propriété supplémentaire du mot de code sur la base des éléments de code formant le mot de code.
  14. Procédé selon une des revendications précédentes, caractérisé par une mise e oeuvre du procédé dans un dispositif radio mobile.
  15. Procédé selon une des revendications précédentes, dans lequel l'information à incorporer est alimentée dans le codeur de signaux (100).
  16. Procédé selon une des revendications précédentes, dans lequel le codeur de signaux (100) détermine un premier élément de code et un deuxième élément de code du mot de code, dans lequel le deuxième élément de code est déterminé en fonction du premier élément de code et de l'information à incorporer.
  17. Codeur de signaux (100) pour incorporer une information stéganographique dans une information de signal du codeur de signaux (100), caractérisé par :
    - un dispositif de réception d'une information de données, notamment d'une information vocale, comme signal à coder (101),
    - un dispositif de réception d'une information stéganographique comme données à incorporer (102), dans lequel l'information stéganographique est sélectionnée parmi une quantité d'informations stéganographiques,
    - un dispositif de génération d'un mot de code d'après une nomenclature de codage (500) algébrique fournie dans l'esprit d'une consigne de construction algébrique au moyen du codeur de signaux (100) sur la base des éléments de code formant le mot de code, de telle sorte que
    • en utilisant le mot de code généré dans le cadre de la norme de transmission associée à la nomenclature de codage, l'information de données soit codée en un signal d'information contenant le mot de code et/ou renvoyant au mot de code comme signal codé (103) ;
    • le mot de code généré présente une propriété supplémentaire, pouvant être calculée sur la base des éléments de code formant le mot de code, dans lequel la propriété supplémentaire représente l'information stéganographique ; et
    • la nomenclature de codage (500) dans l'esprit de la consigne de construction algébrique est divisé en une pluralité de sous-nomenclatures de codage et par l'intermédiaire du codeur de signaux (100) respectivement seul un mot de code appartenant à la sous-nomenclature de codage sélectionnée par l'information stéganographique à incorporer actuellement est émis.
  18. Codeur de signaux selon la revendication 17, conçu pour fournir le mot de code de telle sorte que le mot de code satisfasse implicitement à la propriété.
  19. Dispositif selon la revendication 18, conçu pour générer le mot de code de telle sorte qu'il satisfasse à la propriété, qui représente l'information stéganographique, déjà pendant sa génération.
  20. Dispositif selon une des revendications 17 à 19, dans lequel le odeur de signaux (100) est conçu afin de déterminer un premier élément de code et un deuxième élément de code du mot de code, dans lequel le codeur de signaux (100) détermine le deuxième élément de code en fonction du premier élément de code et de l'information à incorporer.
  21. Procédé de fourniture du côté récepteur d'une information stéganographique, qui a été incorporée par un codeur de signaux (100) dans une information de signal par l'intermédiaire de la génération d'un mot de code d'après une nomenclature de codage (500) algébrique fournie dans l'esprit d'une consigne de construction algébrique au moyen du codeur de signaux (100) sur la base des éléments de code formant le mot de code, de telle sorte que
    • en utilisant le mot de code généré dans le cadre de la norme de transmission associée à la nomenclature de codage, l'information de données soit codée en un signal d'information contenant le mot de code et/ou renvoyant au mot de code comme signal codé (103) ;
    • le mot de code généré présente une propriété supplémentaire, pouvant être calculée sur la base des éléments de code formant le mot de code, dans lequel la propriété supplémentaire représente l'information stéganographique ; et
    • la nomenclature de codage (500) dans l'esprit de la consigne de construction algébrique est divisé en une pluralité de sous-nomenclatures de codage et par l'intermédiaire du codeur de signaux (100) respectivement seul un mot de code appartenant à la sous-nomenclature de codage sélectionnée par l'information stéganographique à incorporer actuellement est émis ;
    dans lequel la fourniture du côté récepteur de l'information stéganographique comprend le calcul de l'information supplémentaire du mot de code sur la base des éléments de code formant le mot de code.
  22. Procédé selon la revendication 21, dans lequel du côté du récepteur un premier élément de code et un deuxième élément de code du mot de code sont déterminés, dans lequel l'information stéganographique est déterminée en fonction du premier élément de code et du deuxième élément de code.
  23. Dispositif (208) de fourniture du côté récepteur d'une information stéganographique qui a été incorporée par un codeur de signaux (100) dans une information de signal en générant un mot de code d'après une nomenclature de codage (500) algébrique fournie dans l'esprit d'une consigne de construction algébrique au moyen du codeur de signaux (100) sur la base des éléments de code formant le mot de code, de telle sorte que
    • en utilisant le mot de code généré dans le cadre de la norme de transmission associée à la nomenclature de codage, l'information de données soit codée en un signal d'information contenant le mot de code et/ou renvoyant au mot de code comme signal codé (103) ;
    • le mot de code généré présente une propriété supplémentaire, pouvant être calculée sur la base des éléments de code formant le mot de code, dans lequel la propriété supplémentaire représente l'information stéganographique ; et
    • la nomenclature de codage (500) dans l'esprit de la consigne de construction algébrique est divisé en une pluralité de sous-nomenclatures de codage et par l'intermédiaire du codeur de signaux (100) respectivement seul un mot de code appartenant à la sous-nomenclature de codage sélectionnée par l'information stéganographique à incorporer actuellement est émis ;
    dans lequel le dispositif (208) de fourniture du côté récepteur de l'information stéganographique est conçu en calculant la propriété supplémentaire du mot de code sur la base des éléments de code formant le mot de code.
  24. Dispositif selon la revendication 23, qui est conçu afin de déterminer du côté récepteur un premier élément de code et un deuxième élément de code du mot de code ainsi que pour déterminer l'information stéganographique en fonction du premier élément de code et du deuxième élément de code.
EP07801969A 2006-09-15 2007-08-29 Stéganographie dans des codeurs de signaux numériques Not-in-force EP2062254B1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP11006299A EP2385521A1 (fr) 2006-09-15 2007-08-29 Stéganographie à codage de signal numérique
SI200731014T SI2062254T1 (sl) 2006-09-15 2007-08-29 Steganografija v digitalnih signalnih kodirnikih
PL07801969T PL2062254T3 (pl) 2006-09-15 2007-08-29 Steganografia w kodowaniu sygnału cyfrowego
CY20121100830T CY1113155T1 (el) 2006-09-15 2012-09-12 Στενογραφια σε εγκωδικευτες ψηφιακου σηματος

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102006044181 2006-09-15
DE102007007627A DE102007007627A1 (de) 2006-09-15 2007-02-16 Steganographie in digitalen Signal-Codierern
PCT/EP2007/007548 WO2008031498A1 (fr) 2006-09-15 2007-08-29 Stéganographie dans des codeurs de signaux numériques

Related Child Applications (1)

Application Number Title Priority Date Filing Date
EP11006299.9 Division-Into 2011-07-29

Publications (2)

Publication Number Publication Date
EP2062254A1 EP2062254A1 (fr) 2009-05-27
EP2062254B1 true EP2062254B1 (fr) 2012-06-13

Family

ID=39105180

Family Applications (2)

Application Number Title Priority Date Filing Date
EP11006299A Ceased EP2385521A1 (fr) 2006-09-15 2007-08-29 Stéganographie à codage de signal numérique
EP07801969A Not-in-force EP2062254B1 (fr) 2006-09-15 2007-08-29 Stéganographie dans des codeurs de signaux numériques

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP11006299A Ceased EP2385521A1 (fr) 2006-09-15 2007-08-29 Stéganographie à codage de signal numérique

Country Status (10)

Country Link
US (1) US8412519B2 (fr)
EP (2) EP2385521A1 (fr)
CY (1) CY1113155T1 (fr)
DE (1) DE102007007627A1 (fr)
DK (1) DK2062254T3 (fr)
ES (1) ES2389012T3 (fr)
PL (1) PL2062254T3 (fr)
PT (1) PT2062254E (fr)
SI (1) SI2062254T1 (fr)
WO (1) WO2008031498A1 (fr)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9767823B2 (en) 2011-02-07 2017-09-19 Qualcomm Incorporated Devices for encoding and detecting a watermarked signal
US9767822B2 (en) 2011-02-07 2017-09-19 Qualcomm Incorporated Devices for encoding and decoding a watermarked signal
US8930182B2 (en) * 2011-03-17 2015-01-06 International Business Machines Corporation Voice transformation with encoded information
US9417221B2 (en) 2013-08-27 2016-08-16 International Business Machines Corporation Food steganography
US9600793B2 (en) 2013-12-09 2017-03-21 International Business Machines Corporation Active odor cancellation
US9665828B2 (en) 2014-01-16 2017-05-30 International Business Machines Corporation Using physicochemical correlates of perceptual flavor similarity to enhance, balance and substitute flavors
CN104010193B (zh) * 2014-05-29 2017-02-22 中国科学院信息工程研究所 基于宏块划分方式扰动的视频隐写方法
CN105704489B (zh) * 2016-01-30 2019-01-04 武汉大学 一种基于宏块复杂度的自适应视频运动矢量隐写方法
CN109346091B (zh) * 2018-09-13 2021-12-14 中国科学院信息工程研究所 一种基于等长熵码字替换的压缩音频自适应隐写方法和系统
CN111462765B (zh) * 2020-04-02 2023-08-01 宁波大学 一种基于一维卷积核的自适应音频复杂度表征方法
CN112738355B (zh) * 2020-12-24 2021-10-26 华南理工大学 能抵御深度学习网络检测的非降质hevc视频隐写方法
CN117614740B (zh) * 2024-01-18 2024-04-16 华侨大学 一种基于多级矢量联合优化的ip语音隐写方法

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11272299A (ja) * 1998-03-23 1999-10-08 Toyo Commun Equip Co Ltd 音声符号化時の透かしビットの埋込方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5636292C1 (en) * 1995-05-08 2002-06-18 Digimarc Corp Steganography methods employing embedded calibration data
US5748763A (en) * 1993-11-18 1998-05-05 Digimarc Corporation Image steganography system featuring perceptually adaptive and globally scalable signal embedding
US6330672B1 (en) * 1997-12-03 2001-12-11 At&T Corp. Method and apparatus for watermarking digital bitstreams
JP3022462B2 (ja) * 1998-01-13 2000-03-21 興和株式会社 振動波の符号化方法及び復号化方法
AU6533799A (en) * 1999-01-11 2000-07-13 Lucent Technologies Inc. Method for transmitting data in wireless speech channels
US20030161469A1 (en) * 2002-02-25 2003-08-28 Szeming Cheng Method and apparatus for embedding data in compressed audio data stream
KR100520711B1 (ko) 2002-08-14 2005-10-17 아주대학교산학협력단 벡터 양자화 기법에서 코드북 그룹화를 이용한 블라인드 이미지 워터마킹 처리 방법
US20040225500A1 (en) * 2002-09-25 2004-11-11 William Gardner Data communication through acoustic channels and compression
JP4527369B2 (ja) * 2003-07-31 2010-08-18 富士通株式会社 データ埋め込み装置及びデータ抽出装置
CN1867970A (zh) * 2003-10-17 2006-11-22 皇家飞利浦电子股份有限公司 信号编码

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11272299A (ja) * 1998-03-23 1999-10-08 Toyo Commun Equip Co Ltd 音声符号化時の透かしビットの埋込方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MUNETOSHI IWAKIRI ET AL: "Embedding a text into conjugate strusture algebraic code excited linear prediction audio codes", COMPUTER SYSTEM SYMPOSIUM, INFORMATION PROCESSING SOCIETY OF JAPAN, JP, vol. 39, no. 3, 1 September 1998 (1998-09-01), pages 2623 - 2630, XP007916951 *

Also Published As

Publication number Publication date
SI2062254T1 (sl) 2012-10-30
CY1113155T1 (el) 2016-04-13
ES2389012T3 (es) 2012-10-22
EP2385521A1 (fr) 2011-11-09
EP2062254A1 (fr) 2009-05-27
DK2062254T3 (da) 2012-08-20
DE102007007627A1 (de) 2008-03-27
WO2008031498A1 (fr) 2008-03-20
US8412519B2 (en) 2013-04-02
PT2062254E (pt) 2012-09-19
US20110131047A1 (en) 2011-06-02
PL2062254T3 (pl) 2012-11-30

Similar Documents

Publication Publication Date Title
EP2062254B1 (fr) Stéganographie dans des codeurs de signaux numériques
EP0954909B1 (fr) Procede de codage d'un signal audio
DE602004003610T2 (de) Halbrätiger Vocoder
DE602004005784T2 (de) Verbesserte Anregung für Höherband-Kodierung in einem Codec basierend auf Frequenzbandtrennungs-Kodierungsverfahren
DE19604273C5 (de) Verfahren und Vorrichtung zum Durchführen einer Suche in einem Kodebuch im Hinblick auf das Kodieren eines Klangsignales, Zellkommunikationssystem, Zellnetzwerkelement und mobile Zell-Sender-/Empfänger-Einheit
DE60024123T2 (de) Lpc-harmonischer sprachkodierer mit überrahmenformat
DE602004005197T2 (de) Vorrichtung und verfahren zum kodieren eines audiosignals und vorrichtung und verfahren zum dekodieren eines kodierten audiosignals
DE69815650T2 (de) Sprachkodierer
EP1869671B1 (fr) Procede et dispositif pour attenuer le bruit
DE69839312T2 (de) Kodierverfahren für vibrationswellen
DE112012000698B4 (de) Stimmentransformation mit codierten Informationen
EP1016319B1 (fr) Procede et dispositif pour coder un signal stereo temporellement discret
DE69121411T2 (de) Methode und gerät zur codierung von analogen signalen
WO1999004505A1 (fr) Procede de signalisation d'une substitution de bruit lors du codage d'un signal audio
DE102006051673A1 (de) Vorrichtung und Verfahren zum Nachbearbeiten von Spektralwerten und Encodierer und Decodierer für Audiosignale
DE102004009954A1 (de) Vorrichtung und Verfahren zum Verarbeiten eines Multikanalsignals
EP1397799B1 (fr) Procede et dispositif de traitement de valeurs d'echantillonnage audio discretes dans le temps
DE60303346T2 (de) Encodier- und/oder Decodierverfahren für digitale Audiosignale, basierend auf Zeit-Frequenzkorrelation und Vorrichtung hierzu
EP1080464A1 (fr) Procede et dispositif de codage de la parole
DE60016305T2 (de) Verfahren zum Betrieb eines Sprachkodierers
DE10138650A1 (de) Verfahren und Vorrichtung zum Verschlüsseln eines diskreten Signals sowie Verfahren und Vorrichtung zur Entschlüsselung
DE19906512C2 (de) Verfahren zum unbemerkten Übertragen und/oder Speichern von Zusatzinformationen innerhalb eines Signals, insbesondere Audiosignals
EP1390946A1 (fr) Procede d'evaluation d'un parametre de codeur-decodeur
EP1834322B1 (fr) Procede de codage d'un signal analogique
AT509439B1 (de) Verfahren und mittel zur skalierbaren verbesserung der qualität eines signalcodierverfahrens

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20090317

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK RS

17Q First examination report despatched

Effective date: 20090729

DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04K 1/00 20060101ALI20111005BHEP

Ipc: G10L 19/12 20060101ALI20111005BHEP

Ipc: G10L 19/00 20060101AFI20111005BHEP

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: ERICSSON AB

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: TELEFONAKTIEBOLAGET L M ERICSSON (PUBL)

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 562303

Country of ref document: AT

Kind code of ref document: T

Effective date: 20120615

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502007010060

Country of ref document: DE

Effective date: 20120809

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: ISLER & PEDRAZZINI AG

REG Reference to a national code

Ref country code: DK

Ref legal event code: T3

REG Reference to a national code

Ref country code: RO

Ref legal event code: EPE

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: PT

Ref legal event code: SC4A

Free format text: AVAILABILITY OF NATIONAL TRANSLATION

Effective date: 20120913

REG Reference to a national code

Ref country code: NL

Ref legal event code: T3

REG Reference to a national code

Ref country code: EE

Ref legal event code: FG4A

Ref document number: E007020

Country of ref document: EE

Effective date: 20120801

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2389012

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20121022

REG Reference to a national code

Ref country code: GR

Ref legal event code: EP

Ref document number: 20120401790

Country of ref document: GR

Effective date: 20120920

REG Reference to a national code

Ref country code: PL

Ref legal event code: T3

REG Reference to a national code

Ref country code: SK

Ref legal event code: T3

Ref document number: E 12437

Country of ref document: SK

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20130314

REG Reference to a national code

Ref country code: HU

Ref legal event code: AG4A

Ref document number: E015359

Country of ref document: HU

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502007010060

Country of ref document: DE

Effective date: 20130314

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: EE

Payment date: 20180802

Year of fee payment: 12

Ref country code: LT

Payment date: 20180731

Year of fee payment: 12

Ref country code: MC

Payment date: 20180802

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: AT

Payment date: 20180730

Year of fee payment: 12

Ref country code: BG

Payment date: 20180823

Year of fee payment: 12

Ref country code: BE

Payment date: 20180827

Year of fee payment: 12

Ref country code: SK

Payment date: 20180731

Year of fee payment: 12

Ref country code: AT

Payment date: 20180801

Year of fee payment: 12

Ref country code: GR

Payment date: 20180829

Year of fee payment: 12

Ref country code: LV

Payment date: 20180801

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PT

Payment date: 20180802

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: MT

Payment date: 20180806

Year of fee payment: 12

Ref country code: CY

Payment date: 20180807

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DK

Payment date: 20190828

Year of fee payment: 13

Ref country code: IE

Payment date: 20190827

Year of fee payment: 13

Ref country code: TR

Payment date: 20190806

Year of fee payment: 13

Ref country code: IT

Payment date: 20190826

Year of fee payment: 13

Ref country code: SE

Payment date: 20190828

Year of fee payment: 13

Ref country code: ES

Payment date: 20190902

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PL

Payment date: 20190805

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20190903

Year of fee payment: 13

REG Reference to a national code

Ref country code: EE

Ref legal event code: MM4A

Ref document number: E007020

Country of ref document: EE

Effective date: 20190831

REG Reference to a national code

Ref country code: FI

Ref legal event code: MAE

REG Reference to a national code

Ref country code: LT

Ref legal event code: MM4D

Effective date: 20190829

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 562303

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190829

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190829

Ref country code: FI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190829

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190829

Ref country code: LV

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190829

Ref country code: EE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190831

Ref country code: GR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200305

Ref country code: PT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200302

Ref country code: HU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190830

Ref country code: BG

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200229

Ref country code: LT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190829

REG Reference to a national code

Ref country code: SK

Ref legal event code: MM4A

Ref document number: E 12437

Country of ref document: SK

Effective date: 20190829

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190829

Ref country code: SK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190829

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190829

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190829

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190902

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20190831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190830

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190831

REG Reference to a national code

Ref country code: SI

Ref legal event code: KO00

Effective date: 20200723

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20200825

Year of fee payment: 14

REG Reference to a national code

Ref country code: DK

Ref legal event code: EBP

Effective date: 20200831

REG Reference to a national code

Ref country code: SE

Ref legal event code: EUG

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200831

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190901

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200829

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200831

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200829

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20220110

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190829

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200830

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200829

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200829

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20220826

Year of fee payment: 16

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20220829

Year of fee payment: 16

Ref country code: DE

Payment date: 20220629

Year of fee payment: 16

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 502007010060

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MM

Effective date: 20230901

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20230829

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230901

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230901