US20090080689A1 - Watermarking Encoded Content - Google Patents
Watermarking Encoded Content Download PDFInfo
- Publication number
- US20090080689A1 US20090080689A1 US12/085,253 US8525308A US2009080689A1 US 20090080689 A1 US20090080689 A1 US 20090080689A1 US 8525308 A US8525308 A US 8525308A US 2009080689 A1 US2009080689 A1 US 2009080689A1
- Authority
- US
- United States
- Prior art keywords
- watermark
- encoded content
- alternative
- value
- values
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 54
- 238000001514 detection method Methods 0.000 claims description 7
- 230000003287 optical effect Effects 0.000 claims description 2
- 230000002596 correlated effect Effects 0.000 claims 2
- 238000007781 pre-processing Methods 0.000 description 6
- 238000003780 insertion Methods 0.000 description 5
- 230000037431 insertion Effects 0.000 description 5
- 238000013459 approach Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000006467 substitution reaction Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000015556 catabolic process Effects 0.000 description 2
- 238000006731 degradation reaction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 101150115425 Slc27a2 gene Proteins 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000001010 compromised effect Effects 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000003817 vacuum liquid chromatography Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0021—Image watermarking
- G06T1/0028—Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
- G06T1/0035—Output size adaptive watermarking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/835—Generation of protective data, e.g. certificates
- H04N21/8358—Generation of protective data, e.g. certificates involving watermark
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
- H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
- H04N1/32154—Transform domain methods
- H04N1/32165—Transform domain methods using cosine transforms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
- H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
- H04N1/32154—Transform domain methods
- H04N1/3217—Transform domain methods using wavelet transforms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
- H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
- H04N1/32154—Transform domain methods
- H04N1/32187—Transform domain methods with selective or adaptive application of the additional information, e.g. in selected frequency coefficients
- H04N1/32192—Transform domain methods with selective or adaptive application of the additional information, e.g. in selected frequency coefficients according to calculated or estimated visibility of the additional information in the image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
- H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
- H04N1/32267—Methods relating to embedding, encoding, decoding, detection or retrieval operations combined with processing of the image
- H04N1/32277—Compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
- H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
- H04N1/32336—Informed embedding, i.e. the original image being known for the encoding or decoding method
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/129—Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/18—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a set of transform coefficients
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/48—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2201/00—General purpose image data processing
- G06T2201/005—Image watermarking
- G06T2201/0051—Embedding of the watermark in the spatial domain
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2201/00—General purpose image data processing
- G06T2201/005—Image watermarking
- G06T2201/0061—Embedding of the watermark in each block of the image, e.g. segmented watermarking
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B2220/00—Record carriers by type
- G11B2220/20—Disc-shaped record carriers
- G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
- G11B2220/2508—Magnetic discs
- G11B2220/2516—Hard disks
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B2220/00—Record carriers by type
- G11B2220/20—Disc-shaped record carriers
- G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
- G11B2220/2537—Optical discs
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B2220/00—Record carriers by type
- G11B2220/90—Tape-like record carriers
Definitions
- the present invention relates to digital watermarking and specifically, to embedding, removing/replacing and detecting digital watermarks in encoded content.
- Encoded content requires a “decoding” process in order to use the content.
- Some examples of encoded content include MPEG-1 MPEG-2 H264/AVC, WMA, MPEG4, JPEG2000, MP3, PDF, Windows Word, Postscript, etc, and their encrypted versions.
- Another prior art method for watermarking encoded content is to embed a watermark by adding noise to the DCT coefficients for MPEG encoded content.
- An example of this approach is described by F. Hartung and B. Girod in “Digital Watermarking of MPEG-2 Coded Video in the Bit Stream Domain”, Proc. IEEE ICASSP, pp. 2621-4, April 1997. The method of Hartung and Girod does not use perceptual techniques.
- Conover describes a watermarking method within an MPEG compressed video bit stream by modifying some DCT coefficient in such a way that the entropy encoded length of these coefficients remain unchanged after modification.
- No specific watermark embedding methods are specified in Conover.
- the methods for selecting watermark sites in Conover are limited to the coefficients with 0 run-zero.
- the coefficients of Conover are in the high frequency domain.
- the method of Conover includes no preprocessing phase nor is there any “alternative value” for actual watermark insertion in the later phase described.
- the concept of generating and using “watermark units” is nowhere disclosed or taught in Conover.
- the prior art methods for watermarking encoded content does not have a pre-processor for producing “alternative values” for some parts of the encoded content.
- the prior art methods for watermarking encoded content exclude encoded content that is further masked, obfuscated, scrambled or encrypted (collectively “encrypted”).
- the present invention watermarks encoded content by embedding watermarks in selected locations in the encoded content. This is accomplished by replacing original values in the encoded content by their alternative values. Each original value may have one or more alternative values and each alternative value contains a watermark signal. Moreover, watermarks can be removed by replacing the alternative values with the original value, or by substituting one alternative value with another alternative value.
- a localized encryption allows for a correspondence between the clear text and cipher text.
- a unit of clear text includes components c1,c2, . . . cn.
- the cipher text consists of c1′, c2′, . . . , cn′ where ci′ is the encrypted version of ci (1 ⁇ i ⁇ n).
- a simple example of localized encryption is to split the content into parts and encrypt each part separately. For example, in an extreme case, each coefficient or group of coefficients is encrypted separately.
- One category of encryption, which makes localized encryption possible, is selective encryption or partial encryption.
- selective encryption methods instead of treating content (audio or video) as binary data streams (also called “native encryption”), selective encryption methods “understand” the content syntax structure (e.g. MPEG-2 structure) and only selectively encrypt some parts of the content. Selective encryption occurs after compression. Encrypted content must not have commercial value, although part of content may be visible. Some selective encryption schemes may preserve the format, bit rate, and size of the encoded content that is not selectively encrypted. Other selective encryption schemes may increase bit rate or require a special decoder.
- content syntax structure e.g. MPEG-2 structure
- the selectively encrypted MPEG may be a valid MPEG stream. Although P and B frames in MPEG-2 are not valuable without knowledge of the corresponding I frames, large portions of MPEG video are still visible because of inter-frame correlation and mainly from unencrypted I-blocks in the P and B frames.
- Other selective encryption schemes include encryption of MPEG-2 headers and/or encryption of DCT coefficients.
- the DCT coefficients are divided into “DC coefficient” and “AC coefficients”. DC coefficients are the coefficients with zero frequency in both dimensions, and AC coefficients are the remaining coefficients with non-zero frequencies. All DC coefficients or partial values of AC coefficients of all I-blocks can be encrypted.
- a system and method for inserting a watermark in encoded content including receiving encoded content, receiving at least one watermark unit and replacing directly a number of bits starting at a position with an alternative value, wherein the alternative value has embedded therein watermark signals.
- a apparatus and method for generating watermark units are also described including selecting a position where a value in encoded content is to be replaced by an alternative value and calculating the alternative value.
- a system and method for replacing a watermark in encoded content are also described including receiving encoded content, receiving at least one watermark unit and replacing a number of bits starting at a position in the encoded content with a value, wherein the value is specified in the at least one watermark unit and further wherein the position is specified in the at least one watermark unit.
- a system and method for inserting a watermark in encoded content including receiving encoded content, receiving at least one watermark unit, receiving a sequence of bits, wherein the sequence of bits comprises watermark payload information and performing one of replacing directly a number of bits starting at a position with an alternative value and leaving unchanged the number of bits starting at the position based on bit values of the sequence of bits of the watermark payload information and wherein the alternative value has embedded therein watermark signals.
- a system and method for watermark detection are also described including receiving at least one watermark unit, receiving watermarked content, retrieving a plurality of coefficient values from the watermarked content and retrieving bit values of the watermark from the coefficient values.
- FIG. 1 is a block diagram showing the workflow for the pre-processing for watermark embedding in accordance with the principles of the present invention.
- FIG. 2 depicts a watermark unit (U) of the present invention.
- FIG. 3 is flowchart of the method of watermark detection in accordance with the principles of the present invention.
- FIG. 4 is a block diagram of a playback device, which receives encoded content having watermark units embedded therein.
- Watermarking encoded content can be divided into three separate steps:
- the first two steps can be pre-processed.
- a set of watermark units (WUs) are produced.
- WUs contain all information for actually embedding/inserting a watermark.
- the watermark pre-processor takes encoded content as the input and a watermark key, and outputs a sequence of watermark units. In the case where only one alternative value is generated for each WU, a watermark payload may become an additional input to the pre-processor.
- These watermark units are integrated into the final content as meta data of the encoded content, as a separate channel multiplexed with the content, as steganographic data hidden in the syntax elements or in the content, or as a separate file stored in the physical media (optical disc, tape, hard drive, etc.) or transmitted over a network (TCP/IP, satellite, etc.).
- the watermark payload information is embedded by selecting from among the alternative values in WUs.
- a WU has at least one alternative value.
- the first method is to embed single fixed watermark payload by replacing all original values in WUs by their alternative values.
- the second method allows for embedding various watermark payloads by switching between replacement or non-replacement for WUs. For example, a replacement indicates a positive bit value and non-replacement for the negative bit value.
- each alternative value which contains a watermark signal that may represent a different information unit of watermark payload.
- the alternative value is selected for substitution based on the watermark payload.
- V1 and V2 are required to embed a bit value ‘0’.
- V1 is selected to replace the original value in the encoded content
- V2 is selected.
- V1 and V2 it is possible to express a ‘0’- and a ‘1’-bit.
- V1, V2, V3 and V4 two bits information (i.e. ‘00’, ‘01’, ‘10’ and ‘11’) can be embedded.
- more alternative values at one position more bits can be embedded, which allows for a very efficient embedding of information.
- the watermark payload is typically received in the third step “Watermark Insertion”. It can be stored in or calculated by a component external to the watermarking system.
- the watermark payload information is typically an identifier uniquely identifying the recipient, playback device (manufacturer, model and/or serial number), or date and time of the playback of the content.
- the difference between the original value, V, and its alternative values may be stored in WUs to potentially reduce the size of WUs. WUs can be further compressed.
- the WUs are protected against unauthorized access or modification, because with this information not only the watermarking system is vulnerable to various attacks but also it is easy for a hacker to insert fake watermarks, or alter or remove existing watermarks. If the WUs are stored and transmitted as steganographic (watermarking) data, the access can be controlled by a watermarking key. If the WUs are stored and transmitted over any another channel, it requires encryption of the WUs.
- the first and second steps can be performed as a pre-processing.
- the encoded content is not watermarked.
- the third step performs the watermark embedding by replacing some values in the encoded content with the alternative values specified in WUs.
- WUs can be encoded syntax elements such as package identification, headers, quantization table, Huffman table for entropy coding, encoded coefficients or encoded motion vectors.
- the WUs specify where the watermark signals (in alternative values) are embedded and what the possible watermark signals can be in these positions by selecting the appropriate alternative values.
- FIG. 1 is a block diagram showing the workflow for preprocessing of encoded content to generate WUs.
- FIG. 2 depicts a watermark unit in accordance with the principles of the present invention.
- Each WU is described by a vector (P, L, C, ⁇ V ⁇ , V1, V2, . . . Vn) where P is the position of the original value V that may be replaced in the future by an alternative value in the encoded content, L is the number of bits occupied by the original value V in the encoded content starting at P, C is a set of global positions of the coefficients (for example, the DCT or wavelet quantized coefficients) that are encoded in the L bits (in encoded content) with an entropy coding method.
- P the position of the original value V that may be replaced in the future by an alternative value in the encoded content
- L is the number of bits occupied by the original value V in the encoded content starting at P
- C is a set of global positions of the coefficients (for example, the DCT
- Entropy coding such as a Huffman coding is typically applied to the last stage of encoding to produce the encoded content.
- V1, V2, . . . Vn are valid alternative values of V and each of such values contain a watermark signal.
- Each coefficient position is represented by c(ch,f,b,co) where ch is the channel index, f is the frame index, b is the block index, and co is the coefficient index within the block for a unit of video content.
- An alternative value is valid, if, when this value replaces the current value it maintains format compliance and there are no perceptual effects on the content.
- V1, V2, . . . Vn occupy L bits as V does in the encoded content.
- ⁇ V ⁇ indicates that the original value is optional in the embedding/insertion process. The original value may be required in the watermark removal processes.
- An original value V may contain one or more coefficients in encoded form.
- the entropy coding i.e. Variable Length Coding (VLC)
- VLC Variable Length Coding
- An alternative value Vi may correspond to the same coefficients as V does, but in some cases Vi may correspond to more or less coefficients than V does.
- a typical 8 ⁇ 8 block of quantized DCT coefficients in MPEG-2 is shown below. Most of the higher order coefficients have been quantized to 0.
- the first DCT coefficient (12) is sent via a separate Huffman table. After Run-Level parsing, the remaining coefficients and associated runs of zeros are:
- VLC Variable Length Code
- VLC Variable length code
- VLC also called entropy codes
- the first and second DCT coefficients use a fixed length code to encode Run and Level according to the table “MPEG2 Encoding of run and level following an ESCAPE code”, and the remaining DCT coefficients are coded according to “MPEG-2 DCT coefficients Table zero”.
- the last VLC is a special “End of Block” code indicating the remaining coefficients in the block are 0.
- An alternative value can be any part of the above encoded bits.
- one alternative value may consist of part of VLC, one or more consecutive VLCs, or one VLC plus part of next VLC.
- an alternative value consists of one VLC, which is the 5 th VLC:
- a Run (R) and Level (L) pair represents a sequence of numbers beginning with R zeros followed by L.
- the alternative values above represent the following coefficients before entropy coding:
- this block will be changed to the following quantized DCT coefficients:
- encoded content is the content encoded with H.264 (MPEG4 Profile 10).
- MPEG4 Profile 10 MPEG4 Profile 10
- an encoder may use a fixed NumTrail table (e.g. NumTrail Table 0), instead of a NumTrail table based on certain properties of neighborhood blocks.
- Another example is to use a fixed length code xxxxyyy to encode the number of non-zero (NumCoeff) and the number of trailing ones (T1) for a 4 ⁇ 4 quantized DCT block where xxxx is for coding the number of non-zero (0-16) and yy is for coding the number of trailing ones (0 . . . 3).
- xxxx is for coding the number of non-zero (0-16)
- yy is for coding the number of trailing ones (0 . . . 3).
- One can also force an encoder to use 4 ⁇ 4 block only. In the following example, some of the above rules are applied for encoding a 4 ⁇ 4 block.
- CAVLC coding consists of the following five steps:
- Level Code Level Code 1 1 1 10 ⁇ 1 01 ⁇ 1 11 2 001 2 010 ⁇ 2 0001 ⁇ 2 011 3 00001 3 0010 ⁇ 3 000001 ⁇ 3 0011 . . . . . . . . . . .
- the final encoded bits for this 4 ⁇ 4 block contain 25 bits: 0001011
- One example of alternative values is the encoded bits of an entire encoded 4 ⁇ 4 block.
- Another example of alternative value can be the bits coding signs of trailing ones as described in the above step c). In such a case, changing the alternative value only changes the sign of trailing ones and therefore does not change the total bit length of the encoded block.
- JPEG2000 uses Digital Wavelet Transform (DWT).
- DWT Digital Wavelet Transform
- the DWT of a pixeled image is computed by the successive application of vertical and horizontal, low-pass and high-pass filters to the image pixels, where the resulting values are called ‘wavelet coefficients’.
- a wavelet is an oscillating waveform that persists for only one or a few cycles.
- the low-pass only filtered wavelet coefficients of the previous iteration are decimated, then go through a low-pass vertical filter and a high-pass vertical filter, and the results of this process are passed through a low-pass horizontal and a high-pass horizontal filter.
- the resulting set of coefficients is grouped in four ‘subbands’, namely the LL, LH, HL and HH subbands. Each iteration corresponds to a certain ‘layer’ or ‘level’ of coefficients.
- the first layer of coefficients corresponds to the highest resolution level of the image, while the last layer corresponds to the lowest resolution level.
- One example of alternative value for JPEG2000 encoded picture is the encoded LL subband at a specific layer (e.g. the lowest resolution).
- WUs can be produced with an exiting watermarking system that works in transform domain.
- the steps 1 and 2 can be performed in the following manner to select and produce WUs by scanning A and B until the following conditions are satisfied:
- a bit of watermark payload is encoded as a relationship between two selected quantized coefficients in a middle frequency.
- a bit of watermark payload is encoded as a relationship between property values of two sets of pixel values, or DCT/wavelet coefficients.
- properties include the average luminance, average color histogram distribution, or energy in certain frequency subband.
- One principle of the present invention is to pre-process encoded content and generate alternative values containing watermarking signals. These alternative values will be later used to replace clearly defined parts of the encoded content.
- the existing watermarking systems can be applied to pre-processing (i.e. Step 1 and 2 ) and actual insertion (Step 3 ), new watermarking algorithms can be developed specially for this scheme.
- a simple and generic watermark detection method is to correlate the current coefficient in the watermarked content with the alternative values of a WU to find the alternative value having the best match to the current coefficient.
- the alternative values need to be decoded to coefficient values by using the corresponding entropy decoder.
- Each alternative value of a WU may contain a watermark signal, which corresponds to watermark payload information. By finding the matched alternative values in all WUs, the watermark payload information can be retrieved.
- Watermark detection can be performed at multiple levels. At the first level, P, L and C elements of WUs are required. Assume the number of Wus is N. For each WU, obtain the coefficient values according to the global coefficient indexes C.
- FIG. 3 is a flowchart of the watermark detection process of the present invention.
- an index is initialized. ‘N’ watermark units are accepted/received at 310 and the suspect content is received at 315 . The index is tested at 320 to determine if all watermarks have been processed/detected. If the index is greater than “N”, the number of watermarks then the process is complete.
- the process proceeds to 325 where the coefficients are obtained.
- the bit values are retrieved according to the relationships between/among the coefficients.
- the index is incremented and the process proceeds to step 320 .
- a relationship can be better determined by correlating the current coefficients with the coefficients encoded in V, V1, V2, . . . and Vn.
- the highest correlation value is the correlation indicating the closest match between the current coefficient and one of V, V1, V2, . . . Vn. That is, the highest correlation between the current coefficients and the coefficients encoded in Vi (1 ⁇ i ⁇ n) indicates a match.
- the original content may be required for further analysis and correlation.
- WUs for delivering copyrighted content
- the encoded content that is delivered to a playback/rendering device is explicitly corrupted either in the format/structure (invalid format) or in the content (degraded content).
- a decoder will not be able to decode it. If the corruptions are applied to the content, this content can be decoded and played but the corrupted portions of the content can have various visual artefacts such as noise, warning, and random patterns.
- corrupted format or degraded quality is to countermeasure a specific device or one category of devices that have been compromised or used for content piracy. These alternative values that cause corrupted format or degraded content are selected for substitution only for a specific watermark payload, which identifies the device or the category of devices.
- a watermark can be removed if WUs are known, by simply restoring the content to the original value V in each WU.
- To overwrite an existing watermark in the encoded content one can simply select an appropriate value from V1, V2, . . . Vn in each WU according to the payload information to replace the value containing the existing watermark in the encoded content.
- a removable watermark is useful in some applications for supporting multi-generation watermarks.
- An example of multi-generation watermarks is to embed a forensic mark in each step of content post-production. To avoid accumulation of perceptual degradation potentially introduced by multiple watermarks, one may wish remove some or all previous watermarks before a new watermark is embedded.
- FIG. 4 shows an example of the watermark inserter in a playback device.
- the watermark inserter embeds a watermark by replacing some values/coefficients in the encoded content received by the devices with the alternative values specified in WUs.
- a replaceable watermark can also be useful for switching the states of copy protection for copyrighted content. For example, for a unit of content with a watermark information indicating “copy once”, after one copy is made one may wish to change the watermark information from “copy once” to “no copy”.
- There are several approaches to avoid any potential conflict of multiple watermarks i.e. interfere between multiple watermarks).
- One approach is to use a unique subband for each generation of watermarks.
- Another approach is to select WUs with the positions that are different from the previous watermarks.
- the present invention may be implemented in various forms of hardware, software, firmware, special purpose processors, or a combination thereof.
- the present invention is implemented as a combination of hardware and software.
- the software is preferably implemented as an application program tangibly embodied on a program storage device.
- the application program may be uploaded to, and executed by, a machine comprising any suitable architecture.
- the machine is implemented on a computer platform having hardware such as one or more central processing units (CPU), a random access memory (RAM), and input/output (I/O) interface(s).
- CPU central processing units
- RAM random access memory
- I/O input/output
- the computer platform also includes an operating system and microinstruction code.
- various processes and functions described herein may either be part of the microinstruction code or part of the application program (or a combination thereof), which is executed via the operating system.
- various other peripheral devices may be connected to the computer platform such as an additional data storage device and a printing device.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Editing Of Facsimile Originals (AREA)
- Image Processing (AREA)
Abstract
Description
- The present invention relates to digital watermarking and specifically, to embedding, removing/replacing and detecting digital watermarks in encoded content.
- Encoded content requires a “decoding” process in order to use the content. Some examples of encoded content include MPEG-1 MPEG-2 H264/AVC, WMA, MPEG4, JPEG2000, MP3, PDF, Windows Word, Postscript, etc, and their encrypted versions.
- One prior art method for watermarking encoded content is to insert watermark signals in the structure and syntax elements. U.S. Pat. No. 6,687,384 is an example for embedding data in syntax elements in a coded bit stream such as MPEG-1 and MPEG-2. Such watermarks do not, however, survive format change or digital-analog conversion.
- Another prior art method for watermarking encoded content is to embed a watermark by adding noise to the DCT coefficients for MPEG encoded content. An example of this approach is described by F. Hartung and B. Girod in “Digital Watermarking of MPEG-2 Coded Video in the Bit Stream Domain”, Proc. IEEE ICASSP, pp. 2621-4, April 1997. The method of Hartung and Girod does not use perceptual techniques.
- Yet another prior art method for watermarking encoded content is to directly modify the encoded content. U.S. Pat. No. 6,373,960, hereinafter “Conover”, describes a watermarking method within an MPEG compressed video bit stream by modifying some DCT coefficient in such a way that the entropy encoded length of these coefficients remain unchanged after modification. No specific watermark embedding methods are specified in Conover. The methods for selecting watermark sites in Conover are limited to the coefficients with 0 run-zero. The coefficients of Conover are in the high frequency domain. The method of Conover includes no preprocessing phase nor is there any “alternative value” for actual watermark insertion in the later phase described. The concept of generating and using “watermark units” is nowhere disclosed or taught in Conover.
- The prior art methods for watermarking encoded content does not have a pre-processor for producing “alternative values” for some parts of the encoded content. The prior art methods for watermarking encoded content exclude encoded content that is further masked, obfuscated, scrambled or encrypted (collectively “encrypted”).
- The present invention watermarks encoded content by embedding watermarks in selected locations in the encoded content. This is accomplished by replacing original values in the encoded content by their alternative values. Each original value may have one or more alternative values and each alternative value contains a watermark signal. Moreover, watermarks can be removed by replacing the alternative values with the original value, or by substituting one alternative value with another alternative value.
- By selecting one of the alternative values to substitute for the original value in the corresponding locations in the encoded content, the following goals are fulfilled:
-
- The alternative values are identical in size to the original value, and replacement by any one of the alternative values creates an encoded content compliant with a defined format and does not introduce perceptual artifacts in the encoded content.
- The alternative values may improve the quality of the encoded content. For example, the original value may or may not be a valid value. In other words, without the replacement by one of its alternative values, the encoded content may not be a legitimate format. In another case where the original value is a valid value, without the replacement by the alternative value, the original value may introduce the degradation of the encoded content.
- Each alternative value contains watermark signals. These watermark signals, either together with other watermark signals at other positions within the encoded content or by themselves, can have one or more units of information embedded. A unit of information consists of one or more bits.
- The data volume of the alternative values (defined by the data size per alternative value and the number of alternative values) must be small, compared to the data volume of encoded content.
- One important goal of directly watermarking encrypted content is “localized encryption”. A localized encryption allows for a correspondence between the clear text and cipher text. For example, a unit of clear text includes components c1,c2, . . . cn. After localized encryption, the cipher text consists of c1′, c2′, . . . , cn′ where ci′ is the encrypted version of ci (1≦i≦n). A simple example of localized encryption is to split the content into parts and encrypt each part separately. For example, in an extreme case, each coefficient or group of coefficients is encrypted separately. One category of encryption, which makes localized encryption possible, is selective encryption or partial encryption. Instead of treating content (audio or video) as binary data streams (also called “native encryption”), selective encryption methods “understand” the content syntax structure (e.g. MPEG-2 structure) and only selectively encrypt some parts of the content. Selective encryption occurs after compression. Encrypted content must not have commercial value, although part of content may be visible. Some selective encryption schemes may preserve the format, bit rate, and size of the encoded content that is not selectively encrypted. Other selective encryption schemes may increase bit rate or require a special decoder.
- Taking MPEG-2 content as an example, a simple selective algorithm encrypts only the I-frames. The selectively encrypted MPEG may be a valid MPEG stream. Although P and B frames in MPEG-2 are not valuable without knowledge of the corresponding I frames, large portions of MPEG video are still visible because of inter-frame correlation and mainly from unencrypted I-blocks in the P and B frames. Other selective encryption schemes include encryption of MPEG-2 headers and/or encryption of DCT coefficients. The DCT coefficients are divided into “DC coefficient” and “AC coefficients”. DC coefficients are the coefficients with zero frequency in both dimensions, and AC coefficients are the remaining coefficients with non-zero frequencies. All DC coefficients or partial values of AC coefficients of all I-blocks can be encrypted.
- A system and method for inserting a watermark in encoded content are described including receiving encoded content, receiving at least one watermark unit and replacing directly a number of bits starting at a position with an alternative value, wherein the alternative value has embedded therein watermark signals. A apparatus and method for generating watermark units are also described including selecting a position where a value in encoded content is to be replaced by an alternative value and calculating the alternative value. Further a system and method for replacing a watermark in encoded content are also described including receiving encoded content, receiving at least one watermark unit and replacing a number of bits starting at a position in the encoded content with a value, wherein the value is specified in the at least one watermark unit and further wherein the position is specified in the at least one watermark unit.
- Further a system and method for inserting a watermark in encoded content are described including receiving encoded content, receiving at least one watermark unit, receiving a sequence of bits, wherein the sequence of bits comprises watermark payload information and performing one of replacing directly a number of bits starting at a position with an alternative value and leaving unchanged the number of bits starting at the position based on bit values of the sequence of bits of the watermark payload information and wherein the alternative value has embedded therein watermark signals. A system and method for watermark detection are also described including receiving at least one watermark unit, receiving watermarked content, retrieving a plurality of coefficient values from the watermarked content and retrieving bit values of the watermark from the coefficient values.
- The present invention is best understood from the following detailed description when read in conjunction with the accompanying drawings. The drawings include the following figures briefly described below:
-
FIG. 1 is a block diagram showing the workflow for the pre-processing for watermark embedding in accordance with the principles of the present invention. -
FIG. 2 depicts a watermark unit (U) of the present invention. -
FIG. 3 is flowchart of the method of watermark detection in accordance with the principles of the present invention. -
FIG. 4 is a block diagram of a playback device, which receives encoded content having watermark units embedded therein. - Watermarking encoded content can be divided into three separate steps:
- Location selection, which is the selection of the position where the value in the encoded content can be replaced by alternative values containing watermark signals.
- Calculation of alternative values, which is the determination of the alternative values so that the alternative values have the same number of bits as the value the alternative values are to replace in the encoded content and such substitution will not cause perceptual changes to the content. Moreover, these alternative values contain watermark signals.
- Watermark embedding/insertion, which is the actual replacement of the value in the encoded content by one of the alternative values.
- The first two steps can be pre-processed. As a result of the pre-processing, a set of watermark units (WUs) are produced. WUs contain all information for actually embedding/inserting a watermark. The watermark pre-processor takes encoded content as the input and a watermark key, and outputs a sequence of watermark units. In the case where only one alternative value is generated for each WU, a watermark payload may become an additional input to the pre-processor. These watermark units are integrated into the final content as meta data of the encoded content, as a separate channel multiplexed with the content, as steganographic data hidden in the syntax elements or in the content, or as a separate file stored in the physical media (optical disc, tape, hard drive, etc.) or transmitted over a network (TCP/IP, satellite, etc.).
- The watermark payload information is embedded by selecting from among the alternative values in WUs. A WU has at least one alternative value. When each WU has only one alternative value, there are two methods to embed/insert the watermark information (payload). The first method is to embed single fixed watermark payload by replacing all original values in WUs by their alternative values. The second method allows for embedding various watermark payloads by switching between replacement or non-replacement for WUs. For example, a replacement indicates a positive bit value and non-replacement for the negative bit value. To embed a watermark payload ‘00101001”, the original values in the first and second WU are not replaced, the original value in the third WU is replaced by its alternative value. For a WU with more than one alternative value, each alternative value, which contains a watermark signal that may represent a different information unit of watermark payload. The alternative value is selected for substitution based on the watermark payload. For example, to embed one bit in a WU, only two alternative values V1 and V2 are required. To embed a bit value ‘0’, V1 is selected to replace the original value in the encoded content, and to embed a bit value ‘1’, V2 is selected. With two values V1 and V2 it is possible to express a ‘0’- and a ‘1’-bit. If there are four alternative values (V1, V2, V3 and V4) two bits information (i.e. ‘00’, ‘01’, ‘10’ and ‘11’) can be embedded. With more alternative values at one position, more bits can be embedded, which allows for a very efficient embedding of information.
- The watermark payload is typically received in the third step “Watermark Insertion”. It can be stored in or calculated by a component external to the watermarking system. The watermark payload information is typically an identifier uniquely identifying the recipient, playback device (manufacturer, model and/or serial number), or date and time of the playback of the content. The difference between the original value, V, and its alternative values may be stored in WUs to potentially reduce the size of WUs. WUs can be further compressed.
- It is important that the WUs are protected against unauthorized access or modification, because with this information not only the watermarking system is vulnerable to various attacks but also it is easy for a hacker to insert fake watermarks, or alter or remove existing watermarks. If the WUs are stored and transmitted as steganographic (watermarking) data, the access can be controlled by a watermarking key. If the WUs are stored and transmitted over any another channel, it requires encryption of the WUs.
- As indicated earlier, the first and second steps can be performed as a pre-processing. Thus, prior to the third step the encoded content is not watermarked. The third step performs the watermark embedding by replacing some values in the encoded content with the alternative values specified in WUs. These values can be encoded syntax elements such as package identification, headers, quantization table, Huffman table for entropy coding, encoded coefficients or encoded motion vectors. The WUs specify where the watermark signals (in alternative values) are embedded and what the possible watermark signals can be in these positions by selecting the appropriate alternative values.
-
FIG. 1 is a block diagram showing the workflow for preprocessing of encoded content to generate WUs.FIG. 2 depicts a watermark unit in accordance with the principles of the present invention. Each WU is described by a vector (P, L, C, {V}, V1, V2, . . . Vn) where P is the position of the original value V that may be replaced in the future by an alternative value in the encoded content, L is the number of bits occupied by the original value V in the encoded content starting at P, C is a set of global positions of the coefficients (for example, the DCT or wavelet quantized coefficients) that are encoded in the L bits (in encoded content) with an entropy coding method. Entropy coding such as a Huffman coding is typically applied to the last stage of encoding to produce the encoded content. V1, V2, . . . Vn are valid alternative values of V and each of such values contain a watermark signal. Each coefficient position is represented by c(ch,f,b,co) where ch is the channel index, f is the frame index, b is the block index, and co is the coefficient index within the block for a unit of video content. An alternative value is valid, if, when this value replaces the current value it maintains format compliance and there are no perceptual effects on the content. Moreover, V1, V2, . . . Vn occupy L bits as V does in the encoded content. {V} indicates that the original value is optional in the embedding/insertion process. The original value may be required in the watermark removal processes. - An original value V may contain one or more coefficients in encoded form. When the WUs are generated, if the input is encoded content such as MPEG-2 or MPEG-4, the entropy coding, i.e. Variable Length Coding (VLC), first needs to be “undone” to access to coefficients, and then find the appropriate position and alternative values and store the original coefficient and these alternative values. An alternative value Vi may correspond to the same coefficients as V does, but in some cases Vi may correspond to more or less coefficients than V does.
- A typical 8×8 block of quantized DCT coefficients in MPEG-2 is shown below. Most of the higher order coefficients have been quantized to 0.
-
12 34 0 2 0 0 0 0 87 0 0 1 0 0 0 0 16 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 - After zig-zag scanning the sequence of DCT coefficients to be transmitted looks like:
-
- 12 34 87 16 0 0 2 0 0 0 0 0 0 1 0 0 0 0 0 0 . . .
- The first DCT coefficient (12) is sent via a separate Huffman table. After Run-Level parsing, the remaining coefficients and associated runs of zeros are:
-
- 34| 87 | 16 | 0 0 2 | 0 0 0 0 0 0 1 | 0 0 0 0 0 0 . . .
- Using the DCT Coefficients Table Zero listed below and specified in MPEG-2 standard, these coefficients are encoded into 6 Variable Length Codes (VLC) as follows (in binary bit representation):
-
- 0000 0100 0010 0010 | 0000 0100 0000 0000 0101 0111 | 0000 0000 0111 110 | 0000 1000 | 0001 010 110 | 10
-
-
Variable length code (VLC) Run Level 10 End of Block . . . . . . . . . 0001 10 s 1 2 0001 11 s 5 1 0001 01 s 6 1 0001 00 s 7 1 . . . . . . . . . 0000 100 s 2 2 . . . . . . . . . 0000 01 Escape . . . . . . . . . 0000 0000 0111 11 s 0 16 . . . . . . . . . (note: the last bit ‘s’ in each VLC above indicate the sign of the level: ‘0’ for positive and ‘1’ for negative value) -
- MPEG2 Encoding of Run and Level Following an ESCAPE Code
-
Fixed length code Run Fixed length code signed_level 0000 00 0 1000 0000 0000 reserved 0000 01 1 1000 0000 0001 −2047 0000 10 2 1000 0000 0010 −2046 . . . . . . . . . . . . 1111 1111 1111 −1 . . . . . . 0000 0000 0000 Forbidden . . . . . . 0000 0000 0001 +1 . . . . . . . . . . . . 1111 11 63 0111 1111 1111 +2047 - For ease of reading, the above VLC (also called entropy codes) are separated by a “|”. The first and second DCT coefficients use a fixed length code to encode Run and Level according to the table “MPEG2 Encoding of run and level following an ESCAPE code”, and the remaining DCT coefficients are coded according to “MPEG-2 DCT coefficients Table zero”. The last VLC is a special “End of Block” code indicating the remaining coefficients in the block are 0.
- An alternative value can be any part of the above encoded bits. For example, one alternative value may consist of part of VLC, one or more consecutive VLCs, or one VLC plus part of next VLC.
- In the following example of WU, an alternative value consists of one VLC, which is the 5th VLC:
-
- (PO+63, 7, C, 0001010, 0001110, 0001100, 0001000)
Each element in this WU is explained as follows: - P0 is the starting position of this block in the encoded content. “63” the relative position (in bits) to the beginning of this block, 7 indicates a length L, C consists of 7 coefficients as follows:
- c(f,ch,b,7), c(f,ch,b,8), . . . c(f,ch,b,13) where f is the current frame index, ch is the current channel index and b is the current block index of this block in the example.
- The size of the alternative value is 7 bits, i.e. L=7.
- 0001010 is the original value (V), there are three alternative values: 0001110 (V1), 0001100 (V2), and 0001000 (V3). These alternative values are coded as the following Run and Level values (refer to MPEG2 DCT coefficients Table zero), respectively:
- 0001110: Run=5, Level=1
- 0001100: Run=1, Level=2
- 0001000: Run=7, Level=1
- (PO+63, 7, C, 0001010, 0001110, 0001100, 0001000)
- A Run (R) and Level (L) pair represents a sequence of numbers beginning with R zeros followed by L. For example, a Run-Level pair (5, 3), i.e. Run=5 and Level=3, represents 0 0 0 0 0 3. Thus, the alternative values above represent the following coefficients before entropy coding:
-
- 0 0 0 0 0 1 0 (Run=5, level=1)
- 0 2 (Run=1, Level=2)
- 0 0 0 0 0 0 0 1 (Run=7, Level=1)
Because the 5th VLC is the last VLC coding non-zero coefficients in this block, the alternative values do not necessarily correspond to the same coefficients coded by V. In case of V2 and V3, instead of coding seven coefficients in V1, V2 encodes only 2 coefficients and V3 encodes 7 coefficients.
- If the first alternative value in the example WU is selected by the watermark inserter in the Step 3, this block will be changed to the following quantized DCT coefficients:
-
12 34 0 2 0 0 0 0 87 0 0 0 0 0 0 0 16 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 - Another example of encoded content is the content encoded with H.264 (MPEG4 Profile 10). There are some major differences in entropy coding between MPEG-2 and H264 including:
-
- H264 supports both CAVLC (Context-Adaptive Variable Length Coding) and CABAC (Context-Adaptive Binary Arithmetic Coding).
- Instead of 8×8 DCT block in MPEG2, H264 may also use 4×4 DCT block
- Unlike AVLC (Adaptive Variable Length Coding) in MPEG-2, CAVLC uses smaller VLC tables by coding levels and runs separately.
- Instead of the fixed VLC tables in MPEG-2, VLC tables can be switched according to the context information.
- Because of the context-based entropy coding in H264, it is harder than MPEG-2 to predict its encoded value after a coefficient is modified. However, one may force a H264 encoder to reduce such context-based coding during encoding. For example, an encoder may use a fixed NumTrail table (e.g. NumTrail Table 0), instead of a NumTrail table based on certain properties of neighborhood blocks. Another example is to use a fixed length code xxxxyyy to encode the number of non-zero (NumCoeff) and the number of trailing ones (T1) for a 4×4 quantized DCT block where xxxx is for coding the number of non-zero (0-16) and yy is for coding the number of trailing ones (0 . . . 3). One can also force an encoder to use 4×4 block only. In the following example, some of the above rules are applied for encoding a 4×4 block.
- 1. A 4×4 qualitized DCT coefficients:
-
0 3 −1 0 0 −1 1 0 1 0 0 0 0 0 0 0
After zigzag scanning, the coefficients in this block:0 3 0 1 −1 −1 0 1 0 . . . 0
2. CAVLC coding consists of the following five steps: -
- a. Encoding the number of non-zero (NumCoeff) and the number of trailing ones (T1): (5,3). The maximum number of T1 is limited to 3. These two numbers (NumCoef and T1) are coded into the bits “0001011” by using a 17×4 Huffman table (see below) (NumCoef: 0-16, T1: 0-3).
-
-
T1 NumCoef 0 1 2 3 0 — — — — 1 000011 01 — — . . . . . . . . . . . . . . . 5 0000000111 000001010 000000100 0001011 . . . . . . . . . . . . . . . 16 00000000000000000 000000000000001001 0000000000000010001 0000000000000010000 -
- b. Encoding the signs of trailing ones in the reverse order, if any (0 for positive and 1 for negative): 0,1,1.
- c. Encoding the remaining non-zero coefficients in reverse order: 1,3. The non-zero coefficients are encoded as “1” with Level VLC 0 table, and “0010” with Level VLC 1 table, respectively.
-
-
Level Code Level Code 1 1 1 10 −1 01 −1 11 2 001 2 010 −2 0001 −2 011 3 00001 3 0010 −3 000001 −3 0011 . . . . . . . . . . . . -
- d. Encoding total zeros (TotalZeros) from the beginning to the last non-zero coefficients. The maximum total zeros is 16-NumCoeff. If NumCoeff is 16, TotalZeros must be 0. If NumCoeff is 0, no further code is needed, i.e. the end of the coding for this block. For the remaining 15 cases, each case uses a Huffman table for coding TotalZeros (see TotalZero table). In this case, TotalZeros is 3, which is coded as “1110” with TotZeros table [NumCoeff=5].
-
TotZeros table NumCoef TotZeros 1 2 3 4 5 6 . . . 15 0 1 111 0010 111101 01000 101100 . . . . . . 1 011 101 1101 1110 01010 101101 . . . . . . 2 010 011 000 0110 01011 1010 . . . . . . 3 0011 001 010 1010 1110 001 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 000000100 — — — — — . . . . . . -
- e. Coding the positions of all zeros from the beginning to the last non-zero coefficients. In this case, the positions of all zeros are coded to “001101”.
- The final encoded bits for this 4×4 block contain 25 bits: 0001011 | 011 | 10010 | 1110 | 001101. One example of alternative values is the encoded bits of an entire encoded 4×4 block. Another example of alternative value can be the bits coding signs of trailing ones as described in the above step c). In such a case, changing the alternative value only changes the sign of trailing ones and therefore does not change the total bit length of the encoded block.
- Yet another example of encoded content is a JPEG2000 picture. Instead of DCT transforms, JPEG2000 uses Digital Wavelet Transform (DWT). The DWT of a pixeled image is computed by the successive application of vertical and horizontal, low-pass and high-pass filters to the image pixels, where the resulting values are called ‘wavelet coefficients’. A wavelet is an oscillating waveform that persists for only one or a few cycles. At each iteration, the low-pass only filtered wavelet coefficients of the previous iteration are decimated, then go through a low-pass vertical filter and a high-pass vertical filter, and the results of this process are passed through a low-pass horizontal and a high-pass horizontal filter. The resulting set of coefficients is grouped in four ‘subbands’, namely the LL, LH, HL and HH subbands. Each iteration corresponds to a certain ‘layer’ or ‘level’ of coefficients. The first layer of coefficients corresponds to the highest resolution level of the image, while the last layer corresponds to the lowest resolution level. One example of alternative value for JPEG2000 encoded picture is the encoded LL subband at a specific layer (e.g. the lowest resolution).
- A simple way to produce WUs is to use “trial and error” by performing the following steps for each WU:
-
- a) For each entropy code (e.g. a VLC in MPEG2), randomly select a value as a candidate for an alternative value.
- b) Determine if this candidate is a valid value by verifying the format compliance after substituting this candidate for the existing value. If not, go back to Step a).
- c) Check the perceptual changes after exchanging the existing value with this candidate. If the perceptual change is acceptable, record this candidate as an alternative value for the WU. Otherwise, go back to Step a).
The above steps are repeated until all needed WUs are produced.
- In one embodiment, WUs can be produced with an exiting watermarking system that works in transform domain. First with the selected watermarking system, produce two watermarked copies (A and B, both in encoded form) of an original encoded content with two different payload information: the first copy contains the watermark payload in which each bit is ‘1’ and the other copy contains the watermark payload in which each bit is ‘0. The steps 1 and 2 (see
FIG. 1 ) can be performed in the following manner to select and produce WUs by scanning A and B until the following conditions are satisfied: -
- (Location selection) P1 a and P2 a are the start position and end position of a plurality of consecutive encoded coefficients (their positions before entropy coding are noted as C) in the encoded content A, P1 b and P2 b are the start position and end position of the same encoded coefficients in the encoded content B, and (P2 b-P2 a) and (P1 b-P1 a) must be equal (and are equal to length L), and
- (Calculation of alternative values) Assume that at least one bit of watermark payload information is to be embedded in the encoded coefficients (in both A and B). Recording one watermark unit (P,L,C,V,V1,V2) in the following manner: P=P1 a, L=P2 a-P1 a, V is not available in this case, V1 is the value from the position P1 a to P2 a in A, and V2 is the value from the position P1 b to P2 b in B.
- To select N watermark units, repeat the second step above.
- In an alternative embodiment, a bit of watermark payload is encoded as a relationship between two selected quantized coefficients in a middle frequency. By scanning the encoded content a watermark unit (P, L, C, V, V1, V2, . . . Vn) can be located and determined with the following conditions:
-
- V contains a plurality of consecutive encoded coefficients and there is at least one relationship (the kind/category of the relationships are predefined) between and/or among these coefficients. For example, if C1, C2 are two consecutive encoded coefficients and a relationship exists C1>C2+T where T is a threshold which may be used to adjust the strength of the relationship, which in turn determine the watermark robustness.
- According to the perceptual model of the watermarking system, the coefficients can be modified to establish another relationship without perceptual change of the content. For example, C1 and C2 can be modified to C1′ and C2′ respectively so that a reverse relationship is formed, i.e. C1′<C2′. Recording the new value containing C1′ and C2′ as an alternative value Vi (1<=i<=n). Repeat this step until all alternative values are found.
- To select N watermark units, repeat the above steps. Ideally the first N watermark units containing the most coefficients are selected so that most relationships can be potentially established within each watermark unit. In the referenced watermarking system, one relationship may represent one bit of watermark payload therefore the watermark unit with most relationships may have the highest capability of embedding more bits of watermark payload.
- In yet another example of a watermarking system, a bit of watermark payload is encoded as a relationship between property values of two sets of pixel values, or DCT/wavelet coefficients. Typical examples of properties include the average luminance, average color histogram distribution, or energy in certain frequency subband.
- One principle of the present invention is to pre-process encoded content and generate alternative values containing watermarking signals. These alternative values will be later used to replace clearly defined parts of the encoded content. Although the existing watermarking systems can be applied to pre-processing (i.e. Step 1 and 2) and actual insertion (Step 3), new watermarking algorithms can be developed specially for this scheme.
- A simple and generic watermark detection method is to correlate the current coefficient in the watermarked content with the alternative values of a WU to find the alternative value having the best match to the current coefficient. To perform such correlation, the alternative values need to be decoded to coefficient values by using the corresponding entropy decoder. Each alternative value of a WU may contain a watermark signal, which corresponds to watermark payload information. By finding the matched alternative values in all WUs, the watermark payload information can be retrieved. Watermark detection can be performed at multiple levels. At the first level, P, L and C elements of WUs are required. Assume the number of Wus is N. For each WU, obtain the coefficient values according to the global coefficient indexes C. If the input content is baseband or encoded in other format than the format used in watermark embedding, transform the content first to the same encoded form as the watermark embedding. The raw watermark payload bits are retrieved by observing the relationships between and/or among the coefficients, or between property values of pixel values or coefficient values.
FIG. 3 is a flowchart of the watermark detection process of the present invention. At 305 an index is initialized. ‘N’ watermark units are accepted/received at 310 and the suspect content is received at 315. The index is tested at 320 to determine if all watermarks have been processed/detected. If the index is greater than “N”, the number of watermarks then the process is complete. If the index is not greater then “N” then the process proceeds to 325 where the coefficients are obtained. At 330 the bit values are retrieved according to the relationships between/among the coefficients. At 335 the index is incremented and the process proceeds to step 320. - If very weak relationships are retrieved from a WU, it would be helpful to access the other elements V and V1, V2, . . . Vn of the WU in order to provide additional information to determine the relationship. A relationship can be better determined by correlating the current coefficients with the coefficients encoded in V, V1, V2, . . . and Vn. The highest correlation value is the correlation indicating the closest match between the current coefficient and one of V, V1, V2, . . . Vn. That is, the highest correlation between the current coefficients and the coefficients encoded in Vi (1≦i ≦n) indicates a match. For suspect content with serious attacks, the original content may be required for further analysis and correlation.
- Another way to use WUs for delivering copyrighted content is to use WUs to recover the corrupted content prior to playback. In such a case, the encoded content that is delivered to a playback/rendering device is explicitly corrupted either in the format/structure (invalid format) or in the content (degraded content). For a format-corrupted content, a decoder will not be able to decode it. If the corruptions are applied to the content, this content can be decoded and played but the corrupted portions of the content can have various visual artefacts such as noise, warning, and random patterns.
- To produce a format-corrupted content, with a given watermark unit (P, L, V, V1, V2, . . . Vn), one can simply replace the L bits starting at P in the encoded content to be delivered with a random value. To further ensure that the random value indeed corrupts the format, one can simply exclude the random values, which are valid entropy codes. To introduce visual artefacts in the content or degraded content, select a valid alternative value, which is far from the original value V and all other alternative values V1, V2, . . . Vn, to the replace the current value in the encoded content. One exemplary use of corrupted format or degraded quality is to countermeasure a specific device or one category of devices that have been compromised or used for content piracy. These alternative values that cause corrupted format or degraded content are selected for substitution only for a specific watermark payload, which identifies the device or the category of devices.
- A watermark can be removed if WUs are known, by simply restoring the content to the original value V in each WU. To overwrite an existing watermark in the encoded content, one can simply select an appropriate value from V1, V2, . . . Vn in each WU according to the payload information to replace the value containing the existing watermark in the encoded content. A removable watermark is useful in some applications for supporting multi-generation watermarks. An example of multi-generation watermarks is to embed a forensic mark in each step of content post-production. To avoid accumulation of perceptual degradation potentially introduced by multiple watermarks, one may wish remove some or all previous watermarks before a new watermark is embedded.
FIG. 4 shows an example of the watermark inserter in a playback device. The watermark inserter embeds a watermark by replacing some values/coefficients in the encoded content received by the devices with the alternative values specified in WUs. A replaceable watermark can also be useful for switching the states of copy protection for copyrighted content. For example, for a unit of content with a watermark information indicating “copy once”, after one copy is made one may wish to change the watermark information from “copy once” to “no copy”. There are several approaches to avoid any potential conflict of multiple watermarks (i.e. interfere between multiple watermarks). One approach is to use a unique subband for each generation of watermarks. Another approach is to select WUs with the positions that are different from the previous watermarks. - It is to be understood that the present invention may be implemented in various forms of hardware, software, firmware, special purpose processors, or a combination thereof. Preferably, the present invention is implemented as a combination of hardware and software. Moreover, the software is preferably implemented as an application program tangibly embodied on a program storage device. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture. Preferably, the machine is implemented on a computer platform having hardware such as one or more central processing units (CPU), a random access memory (RAM), and input/output (I/O) interface(s). The computer platform also includes an operating system and microinstruction code. The various processes and functions described herein may either be part of the microinstruction code or part of the application program (or a combination thereof), which is executed via the operating system. In addition, various other peripheral devices may be connected to the computer platform such as an additional data storage device and a printing device.
- It is to be further understood that, because some of the constituent system components and method steps depicted in the accompanying figures are preferably implemented in software, the actual connections between the system components (or the process steps) may differ depending upon the manner in which the present invention is programmed. Given the teachings herein, one of ordinary skill in the related art will be able to contemplate these and similar implementations or configurations of the present invention.
Claims (51)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US2005/043895 WO2007067168A1 (en) | 2005-12-05 | 2005-12-05 | Watermarking encoded content |
Publications (2)
Publication Number | Publication Date |
---|---|
US20090080689A1 true US20090080689A1 (en) | 2009-03-26 |
US8144923B2 US8144923B2 (en) | 2012-03-27 |
Family
ID=36691610
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/085,253 Active 2028-03-31 US8144923B2 (en) | 2005-12-05 | 2005-12-05 | Watermarking encoded content |
Country Status (9)
Country | Link |
---|---|
US (1) | US8144923B2 (en) |
EP (1) | EP1958430A1 (en) |
JP (1) | JP2009518945A (en) |
KR (1) | KR101273473B1 (en) |
CN (1) | CN101326806B (en) |
AU (1) | AU2005338930B2 (en) |
BR (1) | BRPI0520718A2 (en) |
TW (1) | TWI439135B (en) |
WO (1) | WO2007067168A1 (en) |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080301304A1 (en) * | 2007-06-01 | 2008-12-04 | Microsoft Corporation | Multimedia spaces |
US20090049302A1 (en) * | 2006-03-17 | 2009-02-19 | Thomason Licensing | System And Method For Processing Conent For Later Insertion Of Digital Watermark And Other Data |
US20100027684A1 (en) * | 2007-03-23 | 2010-02-04 | Thomson Licensing | Modifying a coded bitstream |
US20100150394A1 (en) * | 2007-06-14 | 2010-06-17 | Jeffrey Adam Bloom | Modifying a coded bitstream |
US20110129114A1 (en) * | 2009-05-29 | 2011-06-02 | Marie-Jean Colaitis | Method for inserting watermark assistance data in a bitstream and bitstream comprising the watermark assistance data |
EP2387250A1 (en) * | 2010-05-11 | 2011-11-16 | Broadcom Corporation | Method and system for watermark insertion using video start codes |
US20120151598A1 (en) * | 2010-12-06 | 2012-06-14 | Electronics And Telecommunications Research Institute | Apparatus and method for forensic marking of digital content |
US20120159174A1 (en) * | 2010-12-17 | 2012-06-21 | General Instrument Corporation | System and Method for Conveying Session Information for Use in Forensic Watermarking |
WO2012139913A1 (en) * | 2011-04-15 | 2012-10-18 | Nagravision S.A. | Method to identify the origin of a security module in pay-tv decoder system |
EP2605536A1 (en) * | 2011-12-13 | 2013-06-19 | Thomson Licensing | Device for generating watermark metadata, associated device for embedding watermark |
US8515123B2 (en) | 2008-07-03 | 2013-08-20 | Verimatrix, Inc. | Efficient watermarking approaches of compressed media |
US20130223671A1 (en) * | 2012-02-28 | 2013-08-29 | Rogers Communications Inc. | Method and system for dynamically watermarking media |
US20140114666A1 (en) * | 2009-11-04 | 2014-04-24 | Digimarc Corporation | Orchestrated encoding and decoding |
WO2015047290A1 (en) * | 2013-09-27 | 2015-04-02 | Hewlett-Packard Development Company, L.P. | Digital watermarks |
US20150347442A1 (en) * | 2014-06-02 | 2015-12-03 | Sean Lawrence | Data embedding in run length encoded streams |
RU2619536C1 (en) * | 2013-06-19 | 2017-05-16 | Долби Лабораторис Лайсэнзин Корпорейшн | Audio encoder and audio decoder with metadata information on program or substreams structure |
EP3304486A4 (en) * | 2015-05-29 | 2018-12-05 | Digimarc Corporation | Serialized digital watermarking for variable data printing |
US20180351728A1 (en) * | 2015-06-30 | 2018-12-06 | Orange | Method and device for generating a signal in a network of connected objects |
WO2019071253A1 (en) * | 2017-10-07 | 2019-04-11 | Arp-Ip Llc | System and method for randomizing hidden messages in digital files |
WO2019209027A1 (en) * | 2018-04-24 | 2019-10-31 | 리마 주식회사 | Method and system for detecting and tracking video copy |
US10956121B2 (en) | 2013-09-12 | 2021-03-23 | Dolby Laboratories Licensing Corporation | Dynamic range control for a wide variety of playback environments |
RU2758666C1 (en) * | 2021-03-25 | 2021-11-01 | Публичное Акционерное Общество "Сбербанк России" (Пао Сбербанк) | Method and system for protection of digital information displayed on the screen of electronic apparatuses using dynamic digital tags |
CN113688601A (en) * | 2021-10-26 | 2021-11-23 | 北京凯睿数加科技有限公司 | Watermark generation method and device based on form, electronic equipment and computer medium |
US11269976B2 (en) * | 2019-03-20 | 2022-03-08 | Saudi Arabian Oil Company | Apparatus and method for watermarking a call signal |
US11611808B2 (en) | 2017-05-09 | 2023-03-21 | Verimatrix, Inc. | Systems and methods of preparing multiple video streams for assembly with digital watermarking |
WO2023057734A1 (en) * | 2021-10-05 | 2023-04-13 | Synamedia Limited | Systems, devices, and methods for watermark embedding |
Families Citing this family (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102005063136B3 (en) * | 2005-12-30 | 2007-07-05 | Siemens Ag | Marked data stream generating method for use in digital video data, involves displaying applicability of marked data stream section and localizing marked data stream section using marking information |
US8085972B2 (en) * | 2008-07-03 | 2011-12-27 | Primax Electronics Ltd. | Protection method for preventing hard copy of document from being released or reproduced |
JP5639056B2 (en) | 2008-08-19 | 2014-12-10 | トムソン ライセンシングThomson Licensing | Luminance evaluation |
CN102132247B (en) | 2008-08-19 | 2014-09-10 | 汤姆森特许公司 | A propagation map |
WO2010021682A1 (en) * | 2008-08-19 | 2010-02-25 | Thomson Licensing | Cabac/avc compliant watermarking of syntax elements in compressed video |
CN102187583B (en) * | 2008-08-19 | 2013-09-11 | 汤姆森特许公司 | Context-based adaptive binary arithmetic coding (cabac) video stream compliance |
WO2010021694A1 (en) * | 2008-08-20 | 2010-02-25 | Thomson Licensing | Selection of watermarks for the watermarking of compressed video |
JP2011082675A (en) * | 2009-10-05 | 2011-04-21 | Sony Corp | Apparatus and method for processing image signal, apparatus and method for displaying image, program therefor, and system for displaying image |
FR2951344B1 (en) * | 2009-10-14 | 2012-10-05 | Neotion | METHOD AND INSTALLATION FOR REAL-TIME MARKING A VIDEO STREAM COMPRISING A SUCCESSION OF VIDEO PICTURES ENCODED IN MPEG-4 AVC. |
WO2011100048A1 (en) | 2010-02-09 | 2011-08-18 | Thomson Licensing | Watermark detection using a propagation map |
EP2458890B1 (en) | 2010-11-29 | 2019-01-23 | Nagravision S.A. | Method to trace video content processed by a decoder |
US9767822B2 (en) * | 2011-02-07 | 2017-09-19 | Qualcomm Incorporated | Devices for encoding and decoding a watermarked signal |
EP2692135B1 (en) | 2011-03-29 | 2017-10-25 | Irdeto B.V. | Content segmentation of watermarking |
EP2600531A1 (en) * | 2011-12-01 | 2013-06-05 | Thomson Licensing | Method for determining a modifiable element in a coded bit-stream and associated device |
US10009663B1 (en) | 2012-08-02 | 2018-06-26 | Google Llc | Digital fingerprinting of live events for automatic detection |
US9270515B1 (en) | 2012-08-15 | 2016-02-23 | Google Inc. | Identifying portions of a media stream |
RU2517337C1 (en) * | 2012-10-25 | 2014-05-27 | Государственное казенное образовательное учреждение высшего профессионального образования Академия Федеральной службы охраны Российской Федерации (Академия ФСО России) | Method of embedding message in jpeg 2000 digital image |
CN103686276A (en) * | 2013-12-04 | 2014-03-26 | 乐视致新电子科技(天津)有限公司 | Infrared remote controller code value conflict avoiding system and method |
US9858633B2 (en) * | 2015-01-23 | 2018-01-02 | Sony Corporation | Model anti-collusion watermark |
GB201601793D0 (en) | 2016-02-01 | 2016-03-16 | Nagravision Sa | Embedding watermarking data |
CN110322385B (en) * | 2018-03-28 | 2021-08-24 | 浙江大学 | Watermark embedding and extracting method and device and electronic equipment |
US10831869B2 (en) * | 2018-07-02 | 2020-11-10 | International Business Machines Corporation | Method for watermarking through format preserving encryption |
US12093405B2 (en) | 2022-02-14 | 2024-09-17 | Hiwin Technologies Corp. | Method and system for automatically loading parameters, and client-end server thereof |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6359985B1 (en) * | 1995-06-16 | 2002-03-19 | Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Procedure for marking binary coded data sets |
US6373960B1 (en) * | 1998-01-06 | 2002-04-16 | Pixel Tools Corporation | Embedding watermarks into compressed video data |
US20020085737A1 (en) * | 2001-01-02 | 2002-07-04 | Matsushita Electric Industrial Co., Ltd. | Apparatus and method for embedding watermark information in compressed image data, and apparatus and method for retrieving watermark information from compressed image data having watermark information embedded therein |
US6621933B2 (en) * | 1997-08-20 | 2003-09-16 | Samsung Electronics Co., Ltd. | MPEG2 moving picture encoding/decoding system |
US20030191941A1 (en) * | 2002-04-05 | 2003-10-09 | Koichi Terada | Data transmitting apparatus, contents distribution apparatus, contents distribution system, digital contents distribution method and data storage apparatus |
US6687384B1 (en) * | 2000-03-27 | 2004-02-03 | Sarnoff Corporation | Method and apparatus for embedding data in encoded digital bitstreams |
US6711276B1 (en) * | 1998-12-03 | 2004-03-23 | Hitachi, Ltd. | Control method and apparatus for embedding information in data |
US20050044374A1 (en) * | 2003-08-14 | 2005-02-24 | Mustafa Kesal | Watermark-based goods authentication |
US7181044B2 (en) * | 2002-07-09 | 2007-02-20 | Kaleidescope, Inc. | Watermarking and fingerprinting digital content using alternative blocks to embed information |
US20070079381A1 (en) * | 2003-10-31 | 2007-04-05 | Frank Hartung | Method and devices for the control of the usage of content |
US20070143617A1 (en) * | 2003-02-21 | 2007-06-21 | Nikolaus Farber | Method for embedding and detecting a watermark in a digital audio signal |
US7248190B2 (en) * | 2002-03-27 | 2007-07-24 | Matsushita Electric Industrial Co., Ltd. | Variable-length encoding method, variable-length decoding method, storage medium, variable-length encoding device, variable-length decoding device, and bit stream |
US7334129B1 (en) * | 1999-01-13 | 2008-02-19 | Koninklijke Philips Electronics N.V. | Embedding supplemental data in an encoded signal |
US7386146B2 (en) * | 2001-09-13 | 2008-06-10 | Canon Kabushiki Kaisha | Insertion of a message in a sequence of digital images |
US7779271B2 (en) * | 2001-11-23 | 2010-08-17 | Civolution B.V. | Watermark embedding |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW532039B (en) | 2001-01-05 | 2003-05-11 | Jen-Cheng Jang | Robust gray-level watermark embedding and retrieving technique |
GB2377109B (en) | 2001-06-28 | 2003-12-03 | Motorola Inc | Video/image communication with watermarking |
US7515730B2 (en) * | 2001-12-13 | 2009-04-07 | Digimarc Corporation | Progressive image quality control using watermarking |
-
2005
- 2005-12-05 US US12/085,253 patent/US8144923B2/en active Active
- 2005-12-05 CN CN2005800522299A patent/CN101326806B/en active Active
- 2005-12-05 EP EP05852953A patent/EP1958430A1/en not_active Ceased
- 2005-12-05 AU AU2005338930A patent/AU2005338930B2/en not_active Ceased
- 2005-12-05 BR BRPI0520718-5A patent/BRPI0520718A2/en not_active IP Right Cessation
- 2005-12-05 JP JP2008544305A patent/JP2009518945A/en active Pending
- 2005-12-05 WO PCT/US2005/043895 patent/WO2007067168A1/en active Application Filing
-
2006
- 2006-12-05 TW TW095145214A patent/TWI439135B/en not_active IP Right Cessation
-
2008
- 2008-06-02 KR KR1020087013343A patent/KR101273473B1/en active IP Right Grant
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6359985B1 (en) * | 1995-06-16 | 2002-03-19 | Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Procedure for marking binary coded data sets |
US6621933B2 (en) * | 1997-08-20 | 2003-09-16 | Samsung Electronics Co., Ltd. | MPEG2 moving picture encoding/decoding system |
US6373960B1 (en) * | 1998-01-06 | 2002-04-16 | Pixel Tools Corporation | Embedding watermarks into compressed video data |
US6711276B1 (en) * | 1998-12-03 | 2004-03-23 | Hitachi, Ltd. | Control method and apparatus for embedding information in data |
US7334129B1 (en) * | 1999-01-13 | 2008-02-19 | Koninklijke Philips Electronics N.V. | Embedding supplemental data in an encoded signal |
US6687384B1 (en) * | 2000-03-27 | 2004-02-03 | Sarnoff Corporation | Method and apparatus for embedding data in encoded digital bitstreams |
US20020085737A1 (en) * | 2001-01-02 | 2002-07-04 | Matsushita Electric Industrial Co., Ltd. | Apparatus and method for embedding watermark information in compressed image data, and apparatus and method for retrieving watermark information from compressed image data having watermark information embedded therein |
US7386146B2 (en) * | 2001-09-13 | 2008-06-10 | Canon Kabushiki Kaisha | Insertion of a message in a sequence of digital images |
US7779271B2 (en) * | 2001-11-23 | 2010-08-17 | Civolution B.V. | Watermark embedding |
US7248190B2 (en) * | 2002-03-27 | 2007-07-24 | Matsushita Electric Industrial Co., Ltd. | Variable-length encoding method, variable-length decoding method, storage medium, variable-length encoding device, variable-length decoding device, and bit stream |
US20030191941A1 (en) * | 2002-04-05 | 2003-10-09 | Koichi Terada | Data transmitting apparatus, contents distribution apparatus, contents distribution system, digital contents distribution method and data storage apparatus |
US7181044B2 (en) * | 2002-07-09 | 2007-02-20 | Kaleidescope, Inc. | Watermarking and fingerprinting digital content using alternative blocks to embed information |
US20070143617A1 (en) * | 2003-02-21 | 2007-06-21 | Nikolaus Farber | Method for embedding and detecting a watermark in a digital audio signal |
US20050044374A1 (en) * | 2003-08-14 | 2005-02-24 | Mustafa Kesal | Watermark-based goods authentication |
US20070079381A1 (en) * | 2003-10-31 | 2007-04-05 | Frank Hartung | Method and devices for the control of the usage of content |
Cited By (68)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090049302A1 (en) * | 2006-03-17 | 2009-02-19 | Thomason Licensing | System And Method For Processing Conent For Later Insertion Of Digital Watermark And Other Data |
US9299120B2 (en) | 2007-03-23 | 2016-03-29 | Thomson Licensing Llc | Modifying a coded bitstream |
US20100027684A1 (en) * | 2007-03-23 | 2010-02-04 | Thomson Licensing | Modifying a coded bitstream |
US8358703B2 (en) * | 2007-03-23 | 2013-01-22 | Thomson Licensing | Modifying a coded bitstream |
US20100169349A1 (en) * | 2007-03-23 | 2010-07-01 | Thomson Licensing | Modifying a coded bitstream |
US20080301304A1 (en) * | 2007-06-01 | 2008-12-04 | Microsoft Corporation | Multimedia spaces |
US8055708B2 (en) * | 2007-06-01 | 2011-11-08 | Microsoft Corporation | Multimedia spaces |
US20100150394A1 (en) * | 2007-06-14 | 2010-06-17 | Jeffrey Adam Bloom | Modifying a coded bitstream |
US8588459B2 (en) | 2007-06-14 | 2013-11-19 | Thomson Licensing | Modifying a coded bitstream |
US8995711B2 (en) | 2008-07-03 | 2015-03-31 | Verimatrix, Inc. | Efficient watermarking approaches of compressed media |
US8515123B2 (en) | 2008-07-03 | 2013-08-20 | Verimatrix, Inc. | Efficient watermarking approaches of compressed media |
TWI486903B (en) * | 2009-05-29 | 2015-06-01 | Thomson Licensing | Method for inserting watermark assistance data in a bitstream and bitstream comprising the watermark assistance data |
US20110129114A1 (en) * | 2009-05-29 | 2011-06-02 | Marie-Jean Colaitis | Method for inserting watermark assistance data in a bitstream and bitstream comprising the watermark assistance data |
US8462982B2 (en) * | 2009-05-29 | 2013-06-11 | Thomson Licensing | Method for inserting watermark assistance data in a bitstream and bitstream comprising the watermark assistance data |
US20140114666A1 (en) * | 2009-11-04 | 2014-04-24 | Digimarc Corporation | Orchestrated encoding and decoding |
US9412386B2 (en) * | 2009-11-04 | 2016-08-09 | Digimarc Corporation | Orchestrated encoding and decoding |
TWI508540B (en) * | 2010-05-11 | 2015-11-11 | Broadcom Corp | Method and system for watermark insertion using video start codes |
EP2387250A1 (en) * | 2010-05-11 | 2011-11-16 | Broadcom Corporation | Method and system for watermark insertion using video start codes |
US20120151598A1 (en) * | 2010-12-06 | 2012-06-14 | Electronics And Telecommunications Research Institute | Apparatus and method for forensic marking of digital content |
US8752188B2 (en) * | 2010-12-06 | 2014-06-10 | Electronics And Telecommunications Research Institute | Apparatus and method for forensic marking of digital content |
US20120159174A1 (en) * | 2010-12-17 | 2012-06-21 | General Instrument Corporation | System and Method for Conveying Session Information for Use in Forensic Watermarking |
CN103404159A (en) * | 2010-12-17 | 2013-11-20 | 摩托罗拉移动有限责任公司 | System and method for conveying session information for use in forensic watermarking |
WO2012082526A2 (en) | 2010-12-17 | 2012-06-21 | General Instrument Corporation | System and method for conveying session information for use in forensic watermarking |
US8886945B2 (en) * | 2010-12-17 | 2014-11-11 | Motorola Mobility Llc | System and method for conveying session information for use in forensic watermarking |
KR101498841B1 (en) * | 2010-12-17 | 2015-03-04 | 모토로라 모빌리티 엘엘씨 | System and method for conveying session information for use in forensic watermarking |
US20150067718A1 (en) * | 2010-12-17 | 2015-03-05 | Motorola Mobility Llc | System and Method for Conveying Session Information for Use in Forensic Watermarking |
US9641877B2 (en) * | 2010-12-17 | 2017-05-02 | Google Technology Holdings LLC | System and method for conveying session information for use in forensic watermarking |
WO2012082526A3 (en) * | 2010-12-17 | 2012-08-02 | General Instrument Corporation | System and method for conveying session information for use in forensic watermarking |
US20140229972A1 (en) * | 2011-04-15 | 2014-08-14 | Nagravision S.A. | Method to identify the origin of a security module in pay-tv decoder system |
US10419800B2 (en) * | 2011-04-15 | 2019-09-17 | Nagravision S.A. | Method to identify the origin of a security module in pay-TV decoder system |
WO2012139913A1 (en) * | 2011-04-15 | 2012-10-18 | Nagravision S.A. | Method to identify the origin of a security module in pay-tv decoder system |
EP2605537A1 (en) * | 2011-12-13 | 2013-06-19 | Thomson Licensing | Device for generating watermark metadata, associated device for embedding watermark |
US9082172B2 (en) | 2011-12-13 | 2015-07-14 | Thomson Licensing | Device for generating watermark metadata, associated device for embedding watermark |
EP2605536A1 (en) * | 2011-12-13 | 2013-06-19 | Thomson Licensing | Device for generating watermark metadata, associated device for embedding watermark |
US20130223671A1 (en) * | 2012-02-28 | 2013-08-29 | Rogers Communications Inc. | Method and system for dynamically watermarking media |
US9066157B2 (en) * | 2012-02-28 | 2015-06-23 | Rogers Communications Inc. | Method and system for dynamically watermarking media |
US11404071B2 (en) | 2013-06-19 | 2022-08-02 | Dolby Laboratories Licensing Corporation | Audio encoder and decoder with dynamic range compression metadata |
US11823693B2 (en) | 2013-06-19 | 2023-11-21 | Dolby Laboratories Licensing Corporation | Audio encoder and decoder with dynamic range compression metadata |
RU2619536C1 (en) * | 2013-06-19 | 2017-05-16 | Долби Лабораторис Лайсэнзин Корпорейшн | Audio encoder and audio decoder with metadata information on program or substreams structure |
RU2624099C1 (en) * | 2013-06-19 | 2017-06-30 | Долби Лабораторис Лайсэнзин Корпорейшн | Audio encoder and audio decoder with metadata information on program or substreams structure |
RU2696465C2 (en) * | 2013-06-19 | 2019-08-01 | Долби Лабораторис Лайсэнзин Корпорейшн | Audio encoder and audio decoder with metadata of program information or structure of embedded streams |
US9959878B2 (en) | 2013-06-19 | 2018-05-01 | Dolby Laboratories Licensing Corporation | Audio encoder and decoder with dynamic range compression metadata |
US10037763B2 (en) | 2013-06-19 | 2018-07-31 | Dolby Laboratories Licensing Corporation | Audio encoder and decoder with program information or substream structure metadata |
US10147436B2 (en) | 2013-06-19 | 2018-12-04 | Dolby Laboratories Licensing Corporation | Audio encoder and decoder with program information or substream structure metadata |
US11429341B2 (en) | 2013-09-12 | 2022-08-30 | Dolby International Ab | Dynamic range control for a wide variety of playback environments |
US11842122B2 (en) | 2013-09-12 | 2023-12-12 | Dolby Laboratories Licensing Corporation | Dynamic range control for a wide variety of playback environments |
US10956121B2 (en) | 2013-09-12 | 2021-03-23 | Dolby Laboratories Licensing Corporation | Dynamic range control for a wide variety of playback environments |
WO2015047290A1 (en) * | 2013-09-27 | 2015-04-02 | Hewlett-Packard Development Company, L.P. | Digital watermarks |
US10424039B2 (en) * | 2013-09-27 | 2019-09-24 | Hewlett-Packard Development Company, L.P. | Digital watermarks |
US20160239935A1 (en) * | 2013-09-27 | 2016-08-18 | Hewlett-Packard Development Company, L.P. | Digital watermarks |
US20150347442A1 (en) * | 2014-06-02 | 2015-12-03 | Sean Lawrence | Data embedding in run length encoded streams |
US9946723B2 (en) * | 2014-06-02 | 2018-04-17 | Intel Corporation | Data embedding in run length encoded streams |
US11386517B2 (en) | 2015-05-29 | 2022-07-12 | Digimarc Corporation | Serialized digital watermarking for variable data printing |
US10235731B2 (en) | 2015-05-29 | 2019-03-19 | Digimarc Corporation | Serialized digital watermarking for variable data printing |
US12045908B2 (en) | 2015-05-29 | 2024-07-23 | Digimarc Corporation | Serialized digital watermarking for variable data printing |
EP3304486A4 (en) * | 2015-05-29 | 2018-12-05 | Digimarc Corporation | Serialized digital watermarking for variable data printing |
US10565669B2 (en) | 2015-05-29 | 2020-02-18 | Digimarc Corporation | Serialized digital watermarking for variable data printing |
US10491364B2 (en) * | 2015-06-30 | 2019-11-26 | Orange | Method and device for generating a signal in a network of connected objects |
US20180351728A1 (en) * | 2015-06-30 | 2018-12-06 | Orange | Method and device for generating a signal in a network of connected objects |
US11611808B2 (en) | 2017-05-09 | 2023-03-21 | Verimatrix, Inc. | Systems and methods of preparing multiple video streams for assembly with digital watermarking |
WO2019071253A1 (en) * | 2017-10-07 | 2019-04-11 | Arp-Ip Llc | System and method for randomizing hidden messages in digital files |
WO2019209027A1 (en) * | 2018-04-24 | 2019-10-31 | 리마 주식회사 | Method and system for detecting and tracking video copy |
US11269976B2 (en) * | 2019-03-20 | 2022-03-08 | Saudi Arabian Oil Company | Apparatus and method for watermarking a call signal |
WO2022203536A1 (en) * | 2021-03-25 | 2022-09-29 | Публичное Акционерное Общество "Сбербанк России" | Method and system for protecting digital information |
RU2758666C1 (en) * | 2021-03-25 | 2021-11-01 | Публичное Акционерное Общество "Сбербанк России" (Пао Сбербанк) | Method and system for protection of digital information displayed on the screen of electronic apparatuses using dynamic digital tags |
WO2023057734A1 (en) * | 2021-10-05 | 2023-04-13 | Synamedia Limited | Systems, devices, and methods for watermark embedding |
US12050670B2 (en) | 2021-10-05 | 2024-07-30 | Synamedia Limited | Systems, devices, and methods for watermark embedding |
CN113688601A (en) * | 2021-10-26 | 2021-11-23 | 北京凯睿数加科技有限公司 | Watermark generation method and device based on form, electronic equipment and computer medium |
Also Published As
Publication number | Publication date |
---|---|
EP1958430A1 (en) | 2008-08-20 |
KR101273473B1 (en) | 2013-06-14 |
AU2005338930B2 (en) | 2010-12-09 |
AU2005338930A1 (en) | 2007-06-14 |
US8144923B2 (en) | 2012-03-27 |
WO2007067168A1 (en) | 2007-06-14 |
TWI439135B (en) | 2014-05-21 |
JP2009518945A (en) | 2009-05-07 |
CN101326806A (en) | 2008-12-17 |
BRPI0520718A2 (en) | 2009-05-26 |
KR20080075853A (en) | 2008-08-19 |
TW200746828A (en) | 2007-12-16 |
CN101326806B (en) | 2011-10-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8144923B2 (en) | Watermarking encoded content | |
US6208745B1 (en) | Method and apparatus for imbedding a watermark into a bitstream representation of a digital image sequence | |
EP2130173B1 (en) | Modifying a coded bitstream | |
CA2689634C (en) | Modifying a coded bitstream | |
JP5300741B2 (en) | Method and apparatus for video watermarking | |
Zou et al. | H. 264 stream replacement watermarking with CABAC encoding | |
JP2004163855A (en) | Electronic watermark embedding method, and encoder and decoder capable of utilizing such method | |
WO2002060182A1 (en) | Watermarking a compressed information signal | |
JP2002325170A (en) | Image processing unit and its method, and program code, storage medium | |
RU2434356C2 (en) | Creating watermarks in coded information content | |
Zou et al. | H. 264/AVC stream replacement technique for video watermarking | |
US7418110B2 (en) | Method and apparatus for compressed-domain watermarking | |
Li et al. | A reversible data hiding scheme for JPEG images | |
Zou et al. | H. 264/AVC substitution watermarking: a CAVLC example | |
US11308572B1 (en) | Method and system for invisible watermarking of images and video | |
EP1743296B1 (en) | Watermarking a compressed information signal | |
JP5571756B2 (en) | Watermark encoded content | |
Zlomek | Video watermarking | |
US7583850B2 (en) | Image-processing apparatus and method | |
MX2008006995A (en) | Watermarking encoded content | |
Berger II et al. | Watermarking in JPEG bitstream | |
JP4414328B2 (en) | Image processing apparatus and image processing apparatus | |
JP2009501477A (en) | How to embed data | |
Su | Information hiding in digital images: watermarking and steganography | |
CN102036072A (en) | Method and system for watermark detection |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: THOMSON LICENSING, FRANCE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TECHNICOLOR INC.;REEL/FRAME:021022/0805 Effective date: 20080507 |
|
AS | Assignment |
Owner name: THOMSON LICENSING, FRANCE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:ZHAO, JIAN;KOCH, ECKHARD;REEL/FRAME:021022/0881 Effective date: 20060316 Owner name: THOMSON LICENSING, FRANCE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MEDIASEC TECHNOLOGIES, GMBH;REEL/FRAME:021022/0893 Effective date: 20080507 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
AS | Assignment |
Owner name: BAUDRY, SEVERINE, FRANCE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:THOMSON LICENSING;REEL/FRAME:039065/0303 Effective date: 20160201 Owner name: VINCENT, CHRISTOPHE, FRANCE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:THOMSON LICENSING;REEL/FRAME:039065/0303 Effective date: 20160201 Owner name: CONTENTARMOR, FRANCE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DURAND, ALAIN;BAUDRY, SEVERINE;DOERR, GWENAEL;AND OTHERS;REEL/FRAME:039065/0315 Effective date: 20160301 Owner name: BENETIERE, ERIC, FRANCE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:THOMSON LICENSING;REEL/FRAME:039065/0303 Effective date: 20160201 Owner name: DOERR, GWENAEL, FRANCE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:THOMSON LICENSING;REEL/FRAME:039065/0303 Effective date: 20160201 Owner name: DURAND, ALAIN, FRANCE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:THOMSON LICENSING;REEL/FRAME:039065/0303 Effective date: 20160201 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |