WO2004104926A1 - Digital fingerprints and watermarks for images - Google Patents
Digital fingerprints and watermarks for images Download PDFInfo
- Publication number
- WO2004104926A1 WO2004104926A1 PCT/IB2004/050690 IB2004050690W WO2004104926A1 WO 2004104926 A1 WO2004104926 A1 WO 2004104926A1 IB 2004050690 W IB2004050690 W IB 2004050690W WO 2004104926 A1 WO2004104926 A1 WO 2004104926A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- watermark
- size
- grid
- content
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0021—Image watermarking
- G06T1/0028—Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/387—Composing, repositioning or otherwise geometrically modifying originals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0021—Image watermarking
- G06T1/005—Robust watermarking, e.g. average attack or collusion attack resistant
- G06T1/0064—Geometric transfor invariant watermarking, e.g. affine transform invariant
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2201/00—General purpose image data processing
- G06T2201/005—Image watermarking
- G06T2201/0051—Embedding of the watermark in the spatial domain
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2201/00—General purpose image data processing
- G06T2201/005—Image watermarking
- G06T2201/0052—Embedding of the watermark in the frequency domain
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2201/00—General purpose image data processing
- G06T2201/005—Image watermarking
- G06T2201/0061—Embedding of the watermark in each block of the image, e.g. segmented watermarking
Definitions
- This invention relates to the application of digital fingerprints and/or watermarks to images.
- Video fingerprinting can be used for video content identification and associated applications. It is desirable that the video fingerprint recognition can proceed successfully despite certain distortions to the video content, such as compression, scaling, or translation.
- a typical video fingerprint extraction scheme consists of a first stage of extracting features from video frames. Many different features have been proposed for use in generating fingerprints including: DC (mean luminance) values, luminance and/or chrominance histograms, and edges. A common aspect of these schemes is that images are usually divided up into regions (e.g. rectangular blocks) and features extracted for each region. Such a fingerprinting scheme is disclosed in International Patent Application WO-A-02/065782.
- a method of applying/detecting a digital fingerprint to/in an image comprises: dividing the image into regions, the location and size of the regions being based on a content of the image; and applying/detecting the digital fingerprint.
- a method of dividing an image into regions for the application/detection of a digital fingerprint comprises selecting the location and size of the regions according to a content of the image.
- the image is divided based on the location of a centroid of the image.
- a grid for dividing the image is centred substantially at a location of the centroid of the image.
- horizontal and vertical sizes of divisions of the grid are independent of one another.
- the size of horizontal and/or vertical divisions is based on a content of portions of the image, preferably based on centroids of portions of the image.
- the method advantageously allows a grid location and size to be calculated based on image content, thereby allowing scaling and translation of the image without affecting the watermarking thereof.
- the regions may overlap, either horizontally and/or vertically. It has been found that overlapping regions can be used with advantageously better results.
- a method of embedding/detecting a digital watermark into an image comprises selecting a size and/or location of a watermark pattern based on a content of the image, and applying/detecting the watermark.
- a location of the watermark which is preferably present as a grid element, is chosen according to a location of a centroid of the image.
- a size of the watermark preferably a size of grid for the watermark present as grid elements or in grid elements, is chosen according to a content of portions of the image, preferably centroids of portions of the image.
- a computing device programmed to operate the method of the first and/or second aspect.
- a computer program product is operable to perform the method of the first and/or the second aspect of the present invention.
- Figure 1 is a schematic diagram of an image frame showing a centroid
- Figure 2 is an image having a grid of blocks applied thereto;
- Figure 3 is the image of Figure 2, after horizontal scaling and vertical shifting
- Figure 4 shows bit error rates (BER) for fingerprints of a first example video clip and the same vide clip after scaling/shifting
- Figure 5 shows BER for a second example video clip after scaling/shifting
- Figure 6 shows a sample image with a "subtitle" applied
- Figure 7 shows BER for the first example image with a subtitle added
- Figure 8 shows BER for the second example image with a subtitle added
- the invention is a technique of deriving fingerprints for image/video content that improves the recognition rate in cases where the content is scaled or translated. It is also described how the same idea can be applied to watermarking in order to help achieve detection in scaled/shifted versions of a watermarked image.
- the key idea in this invention disclosure is to divide images into regions in a manner dependent upon the image content itself.
- the grid used to divide frames into regions should be determined from the image content.
- the grid can be made to scale and shift identically to the image content, resulting in fingerprints for scaled/shifted images that are as close as possible to those of the original images.
- centroid centroid of mass
- centroid has the property of shifting identically to the image content: ⁇ xl(x-x 0 ,y)
- down-scaling will in practice be combined with padding with new content (by adding additional data to achieve a required ratio of side lengths) in order to retain the original image dimensions. Scale invariance is still achieved if the padding is made with pixels of value zero, such that they do not contribute in the summations above.
- centroid shifts and scales sufficiently accurately to achieve considerable robustness in the resulting fingerprints.
- centroids to provide a scale/shift robust division of the image will be explained for the example of splitting an image into a grid consisting of a number of rectangular blocks. This is desired, for example, by the fingerprint scheme in WO-A-02/065782 the contents of which are incorporated herein by reference, where the DC differences between these blocks are then used to derive the fingerprint bits.
- the process consists of the following steps:
- the resulting grid consists of 2Mx2N blocks.
- xi ⁇ is the centroid in the horizontal direction of the portion of the image left of the total image centroid C (x, y)
- Figure 3 shows the grid formed for the same image scaled horizontally by a factor of 1.1, and shifted vertically by 20 pixels. It can be seen that the image content of each block is similar in both cases, and much more so than if a fixed grid had been used.
- the above procedure was used to form blocks from which fingerprints were subsequently derived as in WO-A-02/065782.
- Figures 4 and 5 show the fingerprint bit error rates (BER) between fingerprints of the original video content, and fingerprints from scaled/shifted versions of the same content. For comparison, the fingerprint bit error rates for fixed blocks of 144x80 pixels are also shown; the improvement of the new centroid scheme is clear.
- BER fingerprint bit error rates
- the BERs due to shifts and up-scales are lower for the 'interv' video clip in figure 4 than they are for the 'kitchgrass' clip in figure 5. This is because the former has a slightly wider black border at its perimeter. The near-zero intensity values of such a border do not influence the centroid position, thus the BER only begins to rise at larger shifts or up-scales where the effect of cropping begins to take effect. Note also that the BERs for down-scaling are lower than for up-scaling, as expected, as no cropping takes place under down-scaling.
- An additional advantage of the presented scheme is that it is robust to different scale factors in the horizontal and vertical directions, i.e. it is robust to aspect ratio changes.
- Scaling and shifting of an image can also prevent detection of a watermark contained in that image.
- the watermark pattern can be formulated as a tile of noise samples in the spatial domain. This watermark pattern is added to the original image in order to create the watermarked image.
- the invention presented above allows the size and shift of the embedded watermark pattern to be set by properties of the image content itself (e.g. centroids).
- the watermark detector can automatically find the appropriate scale and shift of the watermark pattern in the received image by repeating the procedure.
- watermark detection is typically very sensitive to scaling, and the accuracy of the scaling indicated by (e.g.) the centroids may not be great enough to allow detection of the watermark.
- the invention does, however, provide a first estimate of the scale factor, and this can be used to reduce the number of scale factors that need to be searched in order to detect the watermark. Thus the invention can still provide an advantage in terms of reduced computation in the watermark detector.
- the method can be applied equally well to the application or detection of a fingerprint or watermark.
- Subtitles were 'simulated' by adding high density 'salt and pepper' noise in the area where subtitles would be added.
- An example is shown at Figure 6: This was found to cause a BER of around 7% for the centroid scheme compared to around 4% for the original scheme of fixed blocks. The position and size of the grid was found to be only slightly affected by the addition of the 'subtitle'. The minimal impact of the subtitle is simply due to it being only a small fraction of the total number of image pixels: in these experiments the subtitle occupied 5% of the image height, and 60% of the image width, i.e. only 3% of pixels.
- Each block is extended horizontally such that it covers 50% of each block either side, and likewise vertically. For blocks at the perimeter of the image, the extension is made just to the image edge
- a hanning window is applied to the pixel values of the extended block
- the DC is calculated
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP04732704A EP1629433A1 (en) | 2003-05-21 | 2004-05-13 | Digital fingerprints and watermarks for images |
JP2006530849A JP2007500987A (en) | 2003-05-21 | 2004-05-13 | Electronic fingerprints and watermarks for images |
US10/557,630 US20060291690A1 (en) | 2003-05-21 | 2004-05-13 | Digital fingerprints and watermarks for images |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP03101447.5 | 2003-05-21 | ||
EP03101447 | 2003-05-21 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2004104926A1 true WO2004104926A1 (en) | 2004-12-02 |
Family
ID=33462192
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2004/050690 WO2004104926A1 (en) | 2003-05-21 | 2004-05-13 | Digital fingerprints and watermarks for images |
Country Status (6)
Country | Link |
---|---|
US (1) | US20060291690A1 (en) |
EP (1) | EP1629433A1 (en) |
JP (1) | JP2007500987A (en) |
KR (1) | KR20060012640A (en) |
CN (1) | CN1791888A (en) |
WO (1) | WO2004104926A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007148264A1 (en) * | 2006-06-20 | 2007-12-27 | Koninklijke Philips Electronics N.V. | Generating fingerprints of video signals |
CN100365655C (en) * | 2005-08-16 | 2008-01-30 | 北京交通大学 | Digital watermark technology for resisting rotary extension and displacement attack |
EP2770476A3 (en) * | 2013-02-25 | 2014-10-29 | Hitachi Solutions, Ltd. | Digital watermark embedding method and digital watermark detection method |
Families Citing this family (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100776663B1 (en) * | 2006-08-30 | 2007-11-19 | 한국전자통신연구원 | A mobile apparatus with digital camera having watermark abstraction fuction and its method |
KR100944903B1 (en) * | 2008-03-18 | 2010-03-03 | 한국전자통신연구원 | Feature extraction apparatus of video signal and its extraction method, video recognition system and its identification method |
US8347408B2 (en) * | 2008-06-30 | 2013-01-01 | Cisco Technology, Inc. | Matching of unknown video content to protected video content |
US20090327334A1 (en) * | 2008-06-30 | 2009-12-31 | Rodriguez Arturo A | Generating Measures of Video Sequences to Detect Unauthorized Use |
US8259177B2 (en) * | 2008-06-30 | 2012-09-04 | Cisco Technology, Inc. | Video fingerprint systems and methods |
WO2010011991A2 (en) * | 2008-07-25 | 2010-01-28 | Anvato, Inc. | Method and apparatus for detecting near-duplicate videos using perceptual video signatures |
US8934545B2 (en) * | 2009-02-13 | 2015-01-13 | Yahoo! Inc. | Extraction of video fingerprints and identification of multimedia using video fingerprinting |
CN101533509B (en) * | 2009-03-23 | 2011-04-06 | 福建师范大学 | A three-dimensional grid splitting method of blind watermark |
US20120114046A1 (en) * | 2010-11-10 | 2012-05-10 | Iouri Gordon | Transcode video verifier device and method for verifying a quality of a transcoded video file |
WO2016099441A1 (en) * | 2014-12-15 | 2016-06-23 | Hewlett-Packard Development Company, L.P. | Grid-based watermark |
US10474745B1 (en) | 2016-04-27 | 2019-11-12 | Google Llc | Systems and methods for a knowledge-based form creation platform |
US11039181B1 (en) | 2016-05-09 | 2021-06-15 | Google Llc | Method and apparatus for secure video manifest/playlist generation and playback |
US10771824B1 (en) | 2016-05-10 | 2020-09-08 | Google Llc | System for managing video playback using a server generated manifest/playlist |
US11069378B1 (en) | 2016-05-10 | 2021-07-20 | Google Llc | Method and apparatus for frame accurate high resolution video editing in cloud using live video streams |
US10750216B1 (en) | 2016-05-10 | 2020-08-18 | Google Llc | Method and apparatus for providing peer-to-peer content delivery |
US10750248B1 (en) | 2016-05-10 | 2020-08-18 | Google Llc | Method and apparatus for server-side content delivery network switching |
US10595054B2 (en) | 2016-05-10 | 2020-03-17 | Google Llc | Method and apparatus for a virtual online video channel |
US10785508B2 (en) | 2016-05-10 | 2020-09-22 | Google Llc | System for measuring video playback events using a server generated manifest/playlist |
US11032588B2 (en) | 2016-05-16 | 2021-06-08 | Google Llc | Method and apparatus for spatial enhanced adaptive bitrate live streaming for 360 degree video playback |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1043687A1 (en) * | 1999-04-09 | 2000-10-11 | Canon Kabushiki Kaisha | Method for determining a partition in order to insert a watermark, and associated insertion and decoding methods |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB9502274D0 (en) * | 1995-02-06 | 1995-03-29 | Central Research Lab Ltd | Method and apparatus for coding information |
US6222932B1 (en) * | 1997-06-27 | 2001-04-24 | International Business Machines Corporation | Automatic adjustment of image watermark strength based on computed image texture |
US5949055A (en) * | 1997-10-23 | 1999-09-07 | Xerox Corporation | Automatic geometric image transformations using embedded signals |
US6694041B1 (en) * | 2000-10-11 | 2004-02-17 | Digimarc Corporation | Halftone watermarking and related applications |
US7167574B2 (en) * | 2002-03-14 | 2007-01-23 | Seiko Epson Corporation | Method and apparatus for content-based image copy detection |
-
2004
- 2004-05-13 KR KR1020057022208A patent/KR20060012640A/en not_active Application Discontinuation
- 2004-05-13 WO PCT/IB2004/050690 patent/WO2004104926A1/en not_active Application Discontinuation
- 2004-05-13 EP EP04732704A patent/EP1629433A1/en not_active Ceased
- 2004-05-13 CN CNA2004800137244A patent/CN1791888A/en active Pending
- 2004-05-13 JP JP2006530849A patent/JP2007500987A/en not_active Withdrawn
- 2004-05-13 US US10/557,630 patent/US20060291690A1/en not_active Abandoned
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1043687A1 (en) * | 1999-04-09 | 2000-10-11 | Canon Kabushiki Kaisha | Method for determining a partition in order to insert a watermark, and associated insertion and decoding methods |
Non-Patent Citations (2)
Title |
---|
ALGHONIEMY M ET AL: "Geometric distortion correction through image normalization", MULTIMEDIA AND EXPO, 2000. ICME 2000. 2000 IEEE INTERNATIONAL CONFERENCE ON NEW YORK, NY, USA 30 JULY-2 AUG. 2000, PISCATAWAY, NJ, USA,IEEE, US, 30 July 2000 (2000-07-30), pages 1291 - 1294, XP010512742, ISBN: 0-7803-6536-4 * |
KUTTER M ET AL: "Towards second generation watermarking schemes", IMAGE PROCESSING, 1999. ICIP 99. PROCEEDINGS. 1999 INTERNATIONAL CONFERENCE ON KOBE, JAPAN 24-28 OCT. 1999, PISCATAWAY, NJ, USA,IEEE, US, 24 October 1999 (1999-10-24), pages 320 - 323, XP010369234, ISBN: 0-7803-5467-2 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN100365655C (en) * | 2005-08-16 | 2008-01-30 | 北京交通大学 | Digital watermark technology for resisting rotary extension and displacement attack |
WO2007148264A1 (en) * | 2006-06-20 | 2007-12-27 | Koninklijke Philips Electronics N.V. | Generating fingerprints of video signals |
EP2770476A3 (en) * | 2013-02-25 | 2014-10-29 | Hitachi Solutions, Ltd. | Digital watermark embedding method and digital watermark detection method |
Also Published As
Publication number | Publication date |
---|---|
US20060291690A1 (en) | 2006-12-28 |
CN1791888A (en) | 2006-06-21 |
EP1629433A1 (en) | 2006-03-01 |
JP2007500987A (en) | 2007-01-18 |
KR20060012640A (en) | 2006-02-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2004104926A1 (en) | Digital fingerprints and watermarks for images | |
Nikolaidis et al. | Region-based image watermarking | |
Tang et al. | A feature-based robust digital image watermarking scheme | |
Pereira et al. | Second generation benchmarking and application oriented evaluation | |
US9773290B2 (en) | Content watermarking | |
Kumar et al. | A fast DCT based method for copy move forgery detection | |
EP3477578B1 (en) | Watermark embedding and extracting method for protecting documents | |
EP0981899A2 (en) | Embedding and detecting a watermark in images | |
CN112241929B (en) | Watermark embedding method, watermark detecting method, watermark embedding device, watermark detecting device and electronic equipment | |
US6975745B2 (en) | Synchronizing watermark detectors in geometrically distorted signals | |
US20030202678A1 (en) | Method of and system for edge watermarking of an image | |
US8638977B2 (en) | Volume marking with low-frequency | |
KR100697768B1 (en) | The method for digital watermarking using circular hough transform | |
Seng et al. | Semi fragile watermark with self authentication and self recovery | |
Haitao et al. | Low luminance smooth blocks based watermarking scheme in DCT domain | |
Zheng et al. | A rotation invariant feature and image normalization based image watermarking algorithm | |
Toony et al. | A novel image hiding scheme using content aware seam carving method | |
CN111640052B (en) | Robust high-capacity digital watermarking method based on mark code | |
JP4866698B2 (en) | Embedded information reproduction apparatus, falsification detection apparatus, and embedded information reproduction method | |
Barni et al. | Text based geometric normalization for robust watermarking of digital maps | |
Pantuwong et al. | Alpha channel digital image watermarking method | |
JP3630026B2 (en) | Judgment method of digital watermark information | |
Pantuwong et al. | Comparative study of two projective-invariant digital watermarking methods using cross-ratios and line intersections | |
Wu | A novel multipurpose watermarking algorithm for image authentication and protection | |
Hauer et al. | Temporal synchronization of marked MPEG video frames based on image hash system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2004732704 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2006291690 Country of ref document: US Ref document number: 10557630 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2006530849 Country of ref document: JP Ref document number: 20048137244 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020057022208 Country of ref document: KR Ref document number: 3089/CHENP/2005 Country of ref document: IN |
|
WWP | Wipo information: published in national office |
Ref document number: 1020057022208 Country of ref document: KR |
|
WWP | Wipo information: published in national office |
Ref document number: 2004732704 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 10557630 Country of ref document: US |
|
WWR | Wipo information: refused in national office |
Ref document number: 2004732704 Country of ref document: EP |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 2004732704 Country of ref document: EP |