EP1557043A1 - DISPOSITIF POUR LE MARQUAGE ET LA RESTITUTION DE SIGNAUX MULTIMÉDIA - Google Patents
DISPOSITIF POUR LE MARQUAGE ET LA RESTITUTION DE SIGNAUX MULTIMÉDIAInfo
- Publication number
- EP1557043A1 EP1557043A1 EP03786001A EP03786001A EP1557043A1 EP 1557043 A1 EP1557043 A1 EP 1557043A1 EP 03786001 A EP03786001 A EP 03786001A EP 03786001 A EP03786001 A EP 03786001A EP 1557043 A1 EP1557043 A1 EP 1557043A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- signal
- module
- marking
- transformed
- message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 239000000969 carrier Substances 0.000 claims abstract description 40
- 230000004044 response Effects 0.000 claims abstract description 39
- 238000012545 processing Methods 0.000 claims abstract description 5
- 230000001131 transforming effect Effects 0.000 claims abstract 2
- 238000003780 insertion Methods 0.000 claims description 55
- 230000037431 insertion Effects 0.000 claims description 55
- 239000013598 vector Substances 0.000 claims description 48
- 230000009466 transformation Effects 0.000 claims description 46
- 238000000605 extraction Methods 0.000 claims description 34
- 238000007493 shaping process Methods 0.000 claims description 13
- 230000006978 adaptation Effects 0.000 claims description 3
- 206010021403 Illusion Diseases 0.000 claims 2
- 238000000034 method Methods 0.000 description 31
- 230000002441 reversible effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 239000003550 marker Substances 0.000 description 5
- 238000001914 filtration Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 3
- 230000036961 partial effect Effects 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000007667 floating Methods 0.000 description 2
- 238000002372 labelling Methods 0.000 description 2
- 230000000670 limiting effect Effects 0.000 description 2
- 230000000873 masking effect Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000011144 upstream manufacturing Methods 0.000 description 2
- 239000000654 additive Substances 0.000 description 1
- 230000000996 additive effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
- H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
- H04N1/32154—Transform domain methods
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
- H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
- H04N1/32154—Transform domain methods
- H04N1/32187—Transform domain methods with selective or adaptive application of the additional information, e.g. in selected frequency coefficients
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
- H04N1/32352—Controlling detectability or arrangements to facilitate detection or retrieval of the embedded information, e.g. using markers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
- H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N2201/3225—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
- H04N2201/3233—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document of authentication information, e.g. digital signature, watermark
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
- H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N2201/3269—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of machine readable codes or marks, e.g. bar codes or glyphs
- H04N2201/327—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of machine readable codes or marks, e.g. bar codes or glyphs which are undetectable to the naked eye, e.g. embedded codes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
- H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N2201/328—Processing of the additional information
- H04N2201/3281—Encryption; Ciphering
Definitions
- the present invention relates to a device for marking and rendering multimedia signals.
- the marking of a multimedia signal also known as the watermarking method, consists in invisibly inserting a message in the multimedia signal before its transmission in order to be able to reproduce it legibly on reception.
- a set of private or public keys is often used so as not to offer the possibility to unauthorized persons to find or even remove the hidden message.
- the fields of application of a multimedia signal marking method are numerous.
- the content of the multimedia message can be altered in different ways.
- it can be altered following the use of a representation format introducing degradations, such as lossy coding (for example, JPEG for still images, MPEG for video or even MP3 for audio) or alternatively by various acquisition methods such as analog recording, printing or "scanning" for an image.
- lossy coding for example, JPEG for still images, MPEG for video or even MP3 for audio
- acquisition methods such as analog recording, printing or "scanning" for an image.
- the content of a multimedia signal can also be altered following reshaping, for example when selecting a portion of an audio file or when cropping an image.
- the content of a multimedia signal can also be intentionally attacked in order to defeat the message extraction process. This can be done by adding noise to the signal, using a filtering technique or using desynchronizing techniques (for example, geometric transformation for images or frequency change for sound files). In this context of applications, it is important to ensure that the inserted message can be extracted correctly whether the content has undergone intentional modifications or not.
- Another framework of applications relates to the provision, by means of a watermarking process, of a channel for transmitting information in a non-perceptible manner and linked to the content itself of the multimedia signals.
- This adjacent channel can then be used, depending on its capacity, to transmit any useful information.
- additional information such as a teletext service or subtitles
- a COFDM type modulation technique is used, commonly used in digital communication, where bj bits define the message and are modulated by several carriers defined by public and private keys. The signal thus modulated is added to the original signal. Upon extraction, a demodulation makes it possible to find the inserted bits bj.
- this labeling technique suffers from imperfections because the host signal can interfere with the carriers used, the inserted signal may be visible or the re-synchronization may be imperfect.
- the object of the invention is to remedy this situation.
- the invention provides for this purpose a signal processing device comprising a signal transformation module capable of producing a transformed signal from a signal original and a mixer module intended to mark the signal transformed by a marking message.
- the mixer module comprises:
- a formatting module capable of calculating a response of the transformed signal to the demodulation of a first set of carriers defined by message protection keys and of calculating marking information as a function of this response and of code words associated with the marking message
- a modulator capable of modulating the marking information supplied by the shaping module by a given coefficient of the carriers of the first set of carriers, and of modulating in amplitude the coefficient thus obtained by a corresponding quantity linked to the weighting term of the energy of the marking message and to the set of carriers, which provides a marking coefficient
- an adder capable of adding the marking coefficient to the corresponding coefficient of the original transformed signal.
- the device of the invention implements a channel coding technique with on-board information.
- the components of the marking information are information with floating values defined in such a way that their insertion compensates for the response of the host signal.
- the shaping module comprises a demodulator intended to perform the demodulation, this demodulator being able to multiply each coefficient of the transformed signal by the corresponding coefficient of a given carrier of the first set of carriers, by the perceptual weight of distortion and by the attenuation factor associated with the coefficient of the transformed signal, and adding the coefficients thus determined, which provides a component of the response of the transformed signal.
- the formatting module is also able to calculate the marking information from a predetermined parameter, from a first vector associated with a particular code word of the marking message and from a second vector forming with said first vector a normalized orthogonal base defining a hyperplane.
- the particular code word is obtained by splitting a quadratic error criterion between the code words associated with the marking message and the normalized value of the response of the transformed signal to demodulation.
- Each component of the second vector is proportional to the difference between the corresponding component of the response to demodulation and the projection of the vector representing the response to demodulation on a unit vector collinear with the first vector.
- the predetermined parameter corresponds to the angle between the vector representing the marking information and the first vector, this parameter being determined by maximizing the relation:
- - uo represents the scalar product entered the vector representing the response to the demodulation and the first vector, divided by the number m of components of the response to the demodulation
- the mixer comprises a scaling module capable of modulating in amplitude each coefficient of the signal supplied by the adder circuit by an amount linked to the energy weighting term of the marking message and the variance of the corresponding coefficient of the transformed signal.
- This quantity is defined by aj; / ( ⁇ j- + ⁇ ⁇ ), where ⁇ ⁇ 2 is the term defining the energy of the marking message and ⁇ 1 is the variance of the corresponding coefficient of the transformed signal.
- the device comprises a reverse transformation module at the output of the mixer, capable of carrying out on the marked signal a reverse transformation from that carried out by the transformation module, and a signal transformation module capable of transformed the resynchronized marked signal, which provides a transformed marked signal.
- the device can also include an extraction device at the output of the reverse transformation module for extracting the message from the marked signal, this extraction device comprising a resynchronization module capable of resynchronizing the marked signal.
- the extraction device is capable of calculating a response of the resynchronized marked signal to the demodulation of a second set of carriers defined by message protection keys, which provides an estimate of the marking information inserted.
- the first set of carriers and the second set of carriers are identical.
- the extraction device may comprise a demodulator intended to perform the demodulation, this demodulator being able to multiply each coefficient of the marked signal resynchronized by the corresponding coefficient of a given carrier of the second set of carriers and by the perceptual weight of distortion associated with said coefficient of the resynchronized marked signal, and adding the coefficients thus determined, which provides a component of the estimation of the marking information.
- the extraction device may include a carrier generator module capable of generating the second set of carriers from the message protection keys.
- the extraction device can also include a decoder capable of determining the code word closest to the estimation of the marking information by maximizing a quadratic error criterion between a set of code words and the estimate of the tagging information, which provides the tagging message.
- the processing device can also comprise a module for defining insertion parameters coupled to the mixer module capable of determining the energy weighting term of the marking message and the attenuation factor from the intrinsic properties of the signal, the constraints of the application domain, and the properties of the transformation used.
- the module for defining insertion parameters is capable of calculating two global insertion parameters as a function of the insertion distortion D ⁇ between the original signal and the signal marked in the transformed space, of the distortion d 'maximum tolerated attack D ⁇ . between the original signal and the resynchronized marked signal, in the transformed space, and of the signal to noise ratio between the energy of the marking message and the attack noise Eb / No.
- the two global insertion parameters are calculated by looking for the parameters ⁇ and ⁇ which maximizes the relationship:
- the module for defining insertion parameters is capable of calculating the energy weighting term of the marking message and the attenuation factor from the two determined global insertion parameters.
- FIG. 1 illustrates the composition of a system for transmitting marked multimedia signals for the implementation of the invention
- FIG. 2 is a general organization of the insertion device of FIG. 1,
- FIG. 3 is a general organization of the extraction device of FIG. 1,
- FIG. 4 is a functional diagram of the insertion module of FIG. 2,
- FIG. 5 is a functional diagram of the mixer module of Figure 4
- - Figure 6 is a graphical representation for assessing the robustness of a signal, following the addition of noise energy given
- FIG. 7 is a functional diagram of an embodiment of the extraction module of FIG. 3, and
- FIG. 8 is the diagram of a mechanism used in one embodiment.
- Annex I lists the various notations used in the description.
- Appendix JJ lists the mathematical formulas used in the description.
- the device for marking and rendering multimedia signals for implementing the invention shown diagrammatically in FIG. 1, consists of a device for inserting a marker message 1 and a device for extraction of the marker message
- the message insertion device 1 develops a marking of a multimedia signal S to be transmitted through an application domain 3, from the content of a marker message M.
- the marking technique used is an additive technique putting in implements a spread spectrum modulation method. It is similar to the COFDM type modulation technique commonly used in digital communication.
- the components bj which define the marker message M are modulated by carriers defined by public and private keys, and applied to the input of the insertion device. The signal thus modulated is added to the original signal S. On extraction, a demodulation makes it possible to find the components inserted bj of the marker message.
- an amplitude modulation of the added signal is carried out as a function of the energy of the mark added to each coefficient of the signal in the transformed domain.
- another amplitude modulation is performed on each marked coefficient. This second modulation corresponds to a Wiener filter aimed at limiting the noise thus added to the host signal.
- the components bj correspond to the bits defining the message to be inserted after a possible use of correcting codes.
- a channel coding technique with edge information is used.
- the components bj of this marking model are then information with floating values.
- the marking process described below, takes into account such a marking model and optimizes it in order to resist attacks of the noise addition, filtering and partial desynchronization type, modeling the various processing operations which a signal can undergo fairly well. .
- the insertion device shown in FIG. 2, comprises an insertion module 4 coupled upstream to a transformation module 5 and downstream to a reverse transformation module 6.
- the original signal S defined in a first space
- the transformation module 5 is applied to the transformation module 5 to be transformed into a number n of coefficients xi, defined in a second space.
- Any transformation process can be implemented without excluding the identity transformation which leads to working directly on the original signal.
- Different transformations can be used, such as the Fourier transformation, the discrete cosine transformation or the wavelet transformation.
- the message M to be inserted is applied in the insertion module 4 to the different coefficients xi of the transformed signal to form coefficients marked yi.
- the coefficients marked yi are then applied to the reverse transformation module 6 in order to undergo a reverse transformation from that applied before marking and thus restore a marked signal close to the original signal.
- This marked signal is then transmitted to an extraction device, as shown in FIG. 3.
- the extraction device 2 which is represented inside a closed line in dotted lines, comprises a transformation module 7 coupled upstream to a resynchronization module 8 and downstream to a module extraction 9.
- the marked signal received is firstly resynchronized by the resynchronization module 8, then transformed by the transformation module 7 into a series of coefficients yi 'by a transformation identical to that which was used during the insertion .
- the coefficients yi ' are then applied to the extraction device 9 to extract the marking signal M.
- the resynchronization process used can be arbitrary (exhaustive search linked to the insertion of a pilot signal or to an intrinsic property of the mark ) or even implicit thanks to the insertion in a domain invariant to desynchronizations (for example, amplitudes in a Fourier domain or Fourier-Mellin transformation).
- FIG. 4 An embodiment of the insertion module 4 is shown in FIG. 4, inside a closed line in dotted lines.
- This module includes a mixer module 10, a signal analysis module 11, an intrinsic properties analysis module 12 and a module for defining global insertion parameters 13.
- the insertion of a message M into a signal with coefficients xi begins in module 11 with an analysis which makes it possible to define the properties linked to the signal, namely the perceptual weighting weight in the distortion metric ⁇ i, defined for each coefficient xi of the original signal transformed as a function of the value of the variance ⁇ ⁇ 2 of the corresponding coefficient.
- the perceptual weighting weight ⁇ i of each coefficient xi of the signal is a function of the type of signal processed, the transformation used and the values of. signal observed.
- any method can be used.
- vi represents a neighborhood of the coefficient considered.
- An example of a more suitable model for images taking into account masking phenomena can be defined by the relation (3), expressed in appendix II to the description.
- ⁇ bi 2 corresponds to a visibility threshold for the i-th coefficient
- Ni corresponds to a local masking force factor defined by a sliding average over the neighborhood vi of the coefficient considered, according to relation (4) of Annex II.
- p is a parameter of the order of 0.5 to 1 (typically the values 0.5, 0.6 and 0.7 are the most commonly used).
- application parameters ai, bi and ci are determined by the intrinsic properties analysis module 12, for each coefficient xi.
- the parameter ai represents the degree of interference with the original signal
- the parameter bi the degree of self-interference of the inserted signal
- the parameter ci is the site attenuation parameter.
- the application parameters ai, bi and ci make it possible to take into account a phenomenon of desynchronization on each site, that is to say on each carrier frequency of the space. transformed.
- a desynchronization ⁇ on the i-th site, representing the precision of the localization of the coefficient, one will typically use the values defined by the relations (5) of appendix II to the description.
- module 13 estimates the global insertion parameters ⁇ and ⁇ . From these global insertion parameters, the module 13 then determines the insertion parameters ⁇ i and ⁇ ⁇ , defining the intrinsic properties of the marking signal.
- the first insertion parameter Ni represents the attenuation factor of the site considered and the second insertion parameter ⁇ ⁇ represents the weighting term of the labeling energy.
- the message M is inserted into the transformed signal ⁇ xi ⁇ by the mixer module 10 from the application parameters ai, bi and ci, calculated by module 12, of the perceptual weighting weight ⁇ ⁇ i ⁇ and the variance ⁇ ⁇ 2 ⁇ calculated by the signal analysis module 11, and the insertion parameters ⁇ ⁇ and ⁇ i estimated by the module 13.
- the mixer module comprises a demodulator 15 which estimates the response rx of the original signal transformed to a demodulation of a first set of carriers ⁇ G j .
- This demodulation takes into account the values of the perceptual weighting weight ⁇ i and the values of the attenuation factor ⁇ i.
- the mixer module 10 further comprises a carrier generator 16 which generates the first set of m carriers ⁇ G j ⁇ from public or private keys.
- a carrier generator 16 which generates the first set of m carriers ⁇ G j ⁇ from public or private keys.
- Each component rxj of the response of the original transformed signal is determined from the relation ⁇ i e [ i , n] i ( ⁇ i.xi) .Gr £ jS
- G ⁇ denotes the i-th coefficient of the j-th carrier supplied by the carrier generator 16.
- the mixer module 10, shown in FIG. 5, also includes a module 14 for formatting the message capable of providing m components bj defining the message to be inserted, from the responses rxj supplied by the demodulator 15 and a set of U code words applied to the formatting device 14 at the same time as the marking message M.
- the values of the n coefficients ⁇ yi ⁇ of the signal after marking are then calculated from these components bj, via a modulator 18, an adder 20 and a scaling module 17, according to the relation (6) of the Annex II to the description.
- the carrier generator device 16 supplies the carriers G y to the modulator 18 to modulate the components bj.
- the modulator 18 modulates the components bj of the marking information by the carriers Gy to provide n coefficients relating to the marking information.
- the i-th coefficient relating to the marking information is given by the relation ⁇ jS 1; m] bjG.
- the modulator 18 then supplies the adder circuit 20 with a number n of coefficients relating to the marking information of the form:
- the scaling module 17 therefore provides the signal marked with coefficients yi in the transformed space, as indicated by the relation (6) of appendix II.
- the formatting module 14 receives a message M to be inserted, which is defined from a set of code words U.
- This set is of size 2 C + R and is divided into 2 nd subsets U M.
- Each of these subsets has 2 R code words and are associated with each of the 2 nd possible messages.
- Any method of generating these code words and grouping these code words into a sub-assembly U M can be used. Among these, one can in particular quote the code words generated by a system of correcting codes (for example, the first C bits are useful bits which identify the message, while the last R bits are bits of adaptation to the host signal which identifies the code word used for the message M).
- the shaping module 14 also receives the response rx of the original transformed signal, supplied by the demodulator 15. To determine the components rxj of this response, the demodulator 15 first provides an estimate according to the relationship ( ⁇ i.xi) -Gi j s indicated above. Then it renormalizes this estimate adequately in rxj so that the insertion of rxj, using the technique proposed previously by equation (6), compensates for the response of the host signal at the point of attack considered defined by the parameters d 'attack, whether this attack is materialized by adding noise and filtering or by partial desynchronization.
- the shaping module 14 searches for a code word U k , among the code words associated with the message M to be inserted, minimizing the quadratic deviation criterion defined by the relation (7) of appendix TJ to the description, from the rx response to the original transformed signal.
- This code word represents a vector U k having m components U y .
- the shaping module 14 From this code word U k and from the response rx supplied by the demodulator 15, the shaping module 14 defines a vector V of dimension m having components defined by the relation (8) of appendix II, where the notation ⁇ A
- B> ⁇ AjBj represents the dot product between two vectors A and B.
- the shaping module 14 defines a vector N of components Nj according to the relation (9) of appendix II, so that the vector N is proportional to the vector N 'and that the we have ⁇ N
- N> 0 or ⁇ N
- N> m, depending on whether N 'is zero or not.
- this vector N has the property of being orthogonal to the vector U k .
- the shaping module 14 searches for the value of a parameter ⁇ maximizing the relation (10) formulated in appendix H, from parameters uO, vO and K determined as a function of the response to the original transformed signal rx, of the vector U k and of the vector N.
- parameters uO, vO and K are defined by the relations (11) also incorporated in appendix ⁇ .
- the shaping module 14 calculates the values of the components bj from the parameter ⁇ thus determined, and of the components U ⁇ and N j of the vectors U k and N, according to the relation (12) of appendix H.
- the purpose of calculating the values of the components bj is to define the signal to be added so that the response of the demodulator used during the extraction is consistent with that of the code word U k and as robust as possible.
- Robustness is defined by equation (10). This robustness corresponds to the energy level of the noise that can be added without leaving the cone associated with the code word U k in FIG. 6.
- the vectors U k represented by the vector u
- the vector N represented by the vector v
- the vector v form a normalized orthogonal base defining the hyperplane containing the response vector rx and the code vector U k .
- the displacement (cos ⁇ , sin ⁇ ) defines the signal that can be added.
- the maximization of equation (10) then amounts to searching for the vector of components bj maximizing the robustness. Referred to each component of the modulation (ie bj values), this is then expressed by equation (12).
- Figure 6 shows a geometric interpretation of this definition.
- the cone represented by the hatched area represents F set of values leading to a correct decoding of the code word.
- the vector w corresponds to the vector of components bj and x corresponds to the vector rx.
- Hn hyperbolas correspond to responses of constant robustness (i, e following the addition of noise of a given energy).
- This technique aimed at limiting the interference of the host signal corresponds to the channel coding technique with on-board information.
- the general principle of this channel coding technique was initially proposed by Costa in an article entitled “Writing on dirty paper", IEEE Trans. Info. Thy, 29 (3): 439-441, May 1983. In the context of the invention this technique is applied to the information resulting from the demodulation of the Gy carriers.
- the module for defining global insertion parameters 13 defining the intrinsic properties of the marking device is described in more detail below.
- the definition module 13 firstly searches for the pair of global parameters ( ⁇ , ⁇ ), to define the insertion parameters.
- the optimal couple ( ⁇ , ⁇ ) sought can be defined by specifying two properties among the following three which are:
- the system searches for the couple ( ⁇ , ⁇ ) leading to the highest value of the ratio Eb / N 0 , or for Eb / N 0 and D ⁇ given, the system searches for the couple ( ⁇ , ⁇ ) leading to the most high value of D ⁇ ", or again for Eb / N 0 and D ⁇ . given, the system searches for the couple ( ⁇ , ⁇ ) leading to the smallest value of D ⁇ .
- the module 13 After determining the global insertion parameters ( ⁇ , ⁇ ), the module 13 then determines the insertion parameters ⁇ i and ⁇ ⁇ .
- ⁇ i and ⁇ ⁇ are auxiliary working variables, functions of ⁇ and ⁇ , which define the insertion properties for a site i corresponding to the position of a coefficient xi in the spectrum of the transformed signal.
- the couple ( ⁇ i, ⁇ ⁇ is determined by the execution of the steps of the flowchart represented on the figure 8.
- step 100 ⁇ ⁇ is sought, in the interval [0, ⁇ hT ⁇ 1 1 ci] which maximizes the function (16) of appendix II, with ⁇ i given by the relation (17) of appendix II .
- the device tests if ⁇ i ⁇ O and ⁇ i [ ⁇ 1 / ( ⁇ ⁇ 2 + ⁇ ⁇ 2 )]: - If ⁇ i ⁇ O and ⁇ i ⁇ [ ⁇ ⁇ 2 / ( ⁇ ⁇ 2 + ⁇ ⁇ 2 )], the couple ( ⁇ i, ⁇ ⁇ ) is used in step 104;
- the theoretical basis on which the developments described above are based is as follows.
- the different expressions used for the definition of the insertion parameters correspond to the expressions linked to a statistical modeling of the different signals and to a fairly general attack model.
- the coefficients xi are supposed to follow a Gaussian probability law of mean 0, and of variance oj; and be independent.
- the attacks considered are of the "scaling" type (factors ⁇ i) and addition of Gaussian noise with variance ⁇ ⁇ i 2 .
- the scale factor also makes it possible to take proper account of the filtering techniques that can be applied.
- the novelty of the approach proposed here is to consider non-identically distributed signals, the use of a perceptual metric, taking into account partial desynchronization and the use of an insertion / extraction technique based on the use of a COFDM type modulation (acronym for "Coded Orthogonal Frequency Division Multiplex ", encoded orthogonal frequency multiplexing) spread spectrum used on all coefficients.
- the defender seeks to maximize this performance measure under a maximum insertion distortion constraint D ⁇ y _max.
- Eb N 0 represents the signal to noise ratio between the energy of the hidden message and the attack noise.
- the extraction of a message inserted after attacks is carried out in two phases in the extraction device 2.
- a linear demodulation is carried out in order to obtain observations bj with je [l, m].
- the extracted message is defined searching for the code word close to the observations.
- the signal marked yi is resynchronized by the resynchronization module 8, then transformed by the transformation module 7 into a series of coefficients yi 'by a transformation identical to that which was used during the insertion.
- the extraction module which is represented in FIG. 7 comprises a demodulator 21coupled to a decoder of the extracted message.
- the demodulator 21 calculates a response of the signal ⁇ yi 1 ⁇ to a demodulation of a second set of carriers G j supplied by a generator of carriers 23, according to the relation (19) of appendix U.
- This demodulation takes into account the perceptual weighting weight ⁇ i calculated from an analysis performed by a module 24 for analyzing the signal yi '.
- the demodulation is based on the extraction of an estimate of the message inserted bj by the relation (19) of appendix II, on all the marked sites.
- the second set of carriers is identical to the first set of carriers produced by the carrier generator module 16 of the insertion module.
- the decoding of the message takes place after its estimated formatting bj. It consists in searching for the code word U k closest to the estimated values bj by the relation (20) defined in appendix II.
- the message associated with the code word U k then corresponds to the extracted message.
- an exhaustive search method or alternatively take advantage of any rapid search technique linked to the definition of the code words used, by using channel code decoding technique. for example.
- - ⁇ i perceptual weighting weight for the i th coefficient in the distortion metric. These weights are defined in relation to the type of signal processed, the transformation used and the values of the signal observed. - D ⁇ : insertion distortion. -D ⁇ .: attack distortion.
- Attenuation parameter of a site (for example linked to its sensitivity to desynchronizing attacks); this term depends on the transformation space used and on the order of magnitude of the expected desynchronization error following the resynchronization carried out on extraction, and on the tolerations degraded.
- They can for example be thus generated via a secret key and a random number generator controlled by this secret key.
- -2 e number of existing messages likely to be inserted into the signal.
- -U set of code words used.
- 2 C + R area code words are defined, and grouped into 2 R subsets U M associated with the various existing M messages.
- -U k code word used, of size m and defined by the values Uy with je ⁇ 1, .., m ⁇ .
- Perceptual parameter ⁇ i perceptual weights of distortion of the signal coefficients.
- N'j rxj- ⁇ rx
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Editing Of Facsimile Originals (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0213605 | 2002-10-30 | ||
FR0213605A FR2846827B1 (fr) | 2002-10-30 | 2002-10-30 | Dispositif pour le marquage et la restitution de signaux multimedia |
PCT/FR2003/003208 WO2004043072A1 (fr) | 2002-10-30 | 2003-10-28 | Dispositif pour le marquage et la restitution de signaux multimédia |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1557043A1 true EP1557043A1 (fr) | 2005-07-27 |
Family
ID=32104320
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP03786001A Withdrawn EP1557043A1 (fr) | 2002-10-30 | 2003-10-28 | DISPOSITIF POUR LE MARQUAGE ET LA RESTITUTION DE SIGNAUX MULTIMÉDIA |
Country Status (7)
Country | Link |
---|---|
US (1) | US20060159262A1 (fr) |
EP (1) | EP1557043A1 (fr) |
JP (1) | JP2006505207A (fr) |
AU (1) | AU2003295009A1 (fr) |
CA (1) | CA2503466A1 (fr) |
FR (1) | FR2846827B1 (fr) |
WO (1) | WO2004043072A1 (fr) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7702023B2 (en) * | 2003-12-29 | 2010-04-20 | Marvell World Trade Ltd. | Transmitter operations for interference mitigation |
FR2872373B1 (fr) * | 2004-06-28 | 2006-12-08 | Canon Res Ct France S A S Soc | Procede et dispositif de detection et preuve pour le tatouage d'entites multimedia |
JP5246804B2 (ja) * | 2006-07-18 | 2013-07-24 | トムソン ライセンシング | 時間同期化のための方法及びシステム |
US9226047B2 (en) * | 2007-12-07 | 2015-12-29 | Verimatrix, Inc. | Systems and methods for performing semantic analysis of media objects |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
BE1000643A5 (fr) * | 1987-06-05 | 1989-02-28 | Belge Etat | Procede de codage de signaux d'image. |
GB2210236B (en) * | 1987-09-24 | 1991-12-18 | Newbridge Networks Corp | Speech processing system |
US6614914B1 (en) * | 1995-05-08 | 2003-09-02 | Digimarc Corporation | Watermark embedder and reader |
JP3596590B2 (ja) * | 1998-11-18 | 2004-12-02 | ソニー株式会社 | 付随情報付加装置および方法、付随情報検出装置および方法 |
US7031491B1 (en) * | 1999-04-09 | 2006-04-18 | Canon Kabushiki Kaisha | Method for determining a partition in order to insert a watermark, and associated insertion and decoding methods |
JP2001061052A (ja) * | 1999-08-20 | 2001-03-06 | Nec Corp | 電子すかしデータ挿入方法及びその装置と電子すかしデータ検出装置 |
US6385329B1 (en) * | 2000-02-14 | 2002-05-07 | Digimarc Corporation | Wavelet domain watermarks |
US6778587B1 (en) * | 2000-09-01 | 2004-08-17 | Microsoft Corporation | Spread spectrum modulation system and method for embedding digital information into digital or analog media |
US6674876B1 (en) * | 2000-09-14 | 2004-01-06 | Digimarc Corporation | Watermarking in the time-frequency domain |
FR2820928B1 (fr) * | 2001-02-15 | 2003-05-09 | Canon Kk | Estimation de la capacite d'un signal numerique pour l'insertion d'un message |
EP1449212B1 (fr) * | 2001-11-16 | 2021-09-29 | Nagravision S.A. | Inclusion de donnees supplementaires dans un signal d'information |
US7286604B2 (en) * | 2003-05-27 | 2007-10-23 | Aquity Llc | Carrier interferometry coding and multicarrier processing |
-
2002
- 2002-10-30 FR FR0213605A patent/FR2846827B1/fr not_active Expired - Fee Related
-
2003
- 2003-10-28 US US10/532,805 patent/US20060159262A1/en not_active Abandoned
- 2003-10-28 CA CA002503466A patent/CA2503466A1/fr not_active Abandoned
- 2003-10-28 WO PCT/FR2003/003208 patent/WO2004043072A1/fr not_active Application Discontinuation
- 2003-10-28 AU AU2003295009A patent/AU2003295009A1/en not_active Abandoned
- 2003-10-28 EP EP03786001A patent/EP1557043A1/fr not_active Withdrawn
- 2003-10-28 JP JP2004549262A patent/JP2006505207A/ja active Pending
Non-Patent Citations (1)
Title |
---|
See references of WO2004043072A1 * |
Also Published As
Publication number | Publication date |
---|---|
AU2003295009A1 (en) | 2004-06-07 |
US20060159262A1 (en) | 2006-07-20 |
WO2004043072A1 (fr) | 2004-05-21 |
JP2006505207A (ja) | 2006-02-09 |
FR2846827A1 (fr) | 2004-05-07 |
FR2846827B1 (fr) | 2005-02-25 |
CA2503466A1 (fr) | 2004-05-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Goljan et al. | New blind steganalysis and its implications | |
Katzenbeisser et al. | Information hiding | |
Cox et al. | Secure spread spectrum watermarking for multimedia | |
Chen | Design and analysis of digital watermarking, information embedding, and data hiding systems | |
Chen et al. | Quantization index modulation: A class of provably good methods for digital watermarking and information embedding | |
US6778678B1 (en) | High-capacity digital image watermarking based on waveform modulation of image components | |
Hernández et al. | Statistical analysis of watermarking schemes for copyright protection of images | |
Cox et al. | Watermarking as communications with side information | |
Moulin et al. | Data-hiding codes | |
US6678389B1 (en) | Method and apparatus for embedding digital information in digital multimedia data | |
US20020106104A1 (en) | Synchronizing readers of hidden auxiliary data in quantization-based data hiding schemes | |
WO2000065840A1 (fr) | Procede d'insertion d'une filigrane dans une image | |
Woo | Digital image watermarking methods for copyright protection and authentication | |
Solanki et al. | Modeling the print-scan process for resilient data hiding | |
EP1330110B1 (fr) | Procédé et système de décodage de tatouage | |
EP1459555A1 (fr) | Realisation de filigranes numeriques par modulation d'indice de quantification (qim) de signaux multimedia | |
EP1557043A1 (fr) | DISPOSITIF POUR LE MARQUAGE ET LA RESTITUTION DE SIGNAUX MULTIMÉDIA | |
Rahmati et al. | Watermarking in E-commerce | |
WO2001054053A1 (fr) | Attribution de domaine de transformee destinee au filigranage multimedia | |
Cacciaguerra et al. | Data hiding: steganography and copyright marking | |
US20050144456A1 (en) | Robust digital image watermarking utilizing a Walsh transform algorithm | |
Vovk et al. | Synthesis of optimal steganographic method meeting given criteria | |
Hadian Dehkordi et al. | OPTP: A new steganography scheme with high capacity and security | |
Jiang et al. | Steganalysis of halftone images | |
Singh et al. | Audio watermarking using spectral modifications |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20050426 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL LT LV MK |
|
DAX | Request for extension of the european patent (deleted) | ||
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: LE GUELVOUIT, GAETAN Inventor name: PATEUX, STEPHANE Inventor name: GUILLEMOT, CHRISTINE |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20070503 |