CN100556136C - Video watermark process based on the location, moving region - Google Patents
Video watermark process based on the location, moving region Download PDFInfo
- Publication number
- CN100556136C CN100556136C CNB2008100155806A CN200810015580A CN100556136C CN 100556136 C CN100556136 C CN 100556136C CN B2008100155806 A CNB2008100155806 A CN B2008100155806A CN 200810015580 A CN200810015580 A CN 200810015580A CN 100556136 C CN100556136 C CN 100556136C
- Authority
- CN
- China
- Prior art keywords
- watermark
- frame
- video
- moving region
- location
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Editing Of Facsimile Originals (AREA)
Abstract
The invention provides a kind of video watermark process based on the location, moving region.This method is embedded in watermark in the moving region that obtains by the location in each frame of video, at first video is decomposed framing, extract the component motion frame of adjacent two frames, the two field picture that promptly comprises adjacent two frame relative motion information, according to the most violent zone of relative motion in the former frame of video of this component motion frame alignment, promptly realize the location of moving region then; Watermarked in the moving region of preceding frame, the every frame in the video is carried out identical operations, rebuild and obtain watermarked video; When detecting watermark, according to above-mentioned identical method, statistical analysis for improving the accuracy of watermark detection, carried out to the watermark that each frame extracts to extract watermark in the moving region of the every frame of positioning video, gets testing result to the end.The present invention has great improvement and raising to the robustness and the invisibility of watermark.
Description
Technical field
The present invention relates to a kind of Techniques on Digital Video Watermarking, belong to video, multimedia signal processing technique field based on the location, moving region.
It has taken into full account the human eye visual characteristic relatively low to the variation sensitiveness of moving region and adjacent domain thereof, location by the moving region, watermark is embedded in the moving region of frame of video, and adopt QIM algorithm based on vision mode, guaranteeing to make watermark have higher robustness under the sightless prerequisite of watermark.
Background technology
Along with network technology and development of multimedia technology, daily life more and more trends towards digitlization and networking with work, and multi-medium data becomes the important source that people obtain information gradually.People not only can obtain and the identical duplicate of initial data by network, and can have no restrictedly to edit, revise, copy and scatter these multimedia messagess, the information security issue that causes thus, problem of piracy and dispute over copyright problem become the factor that influences social stability.Under this background, copyright protection, the issue that digital watermark technology is widely used in digital product as the important means of information protection follow the trail of and research topics such as authentication in go.
Digital watermark technology has been obtained very big development in recent years, but research mainly concentrates on the rest image digital watermark.Aspect video watermark research, because comprising the more accurate human vision model of characteristics such as spatial concealment effect does not set up as yet fully, the appearance of some special attack forms (as frame exchange, frame cutting, frame deletion etc.) at video watermark, and characteristics such as the real-time of video watermark algorithm and blind Detecting make the video watermark research and development relatively lag behind.The video watermark algorithm mainly is divided three classes at present: watermarked in original video, and watermarked in compressed video, and watermarked when encoding compression.The algorithm that the original video watermark embeds is fairly simple, complexity is relatively low, the method that watermark embeds is also many, can make full use of the digital watermark of rest image, and the algorithm comparative maturity still, needs decoding earlier to the video that has compressed, recompile again after watermarked tends to influence the quality of video and the robustness and the invisibility of watermark.The process that the algorithm that the compressed video watermark embeds does not have decoding and encodes, thereby can not cause the decline of video quality, but define the size of watermarked data volume owing to the restriction of compression bit rate, watermarked intensity is subjected to the constraint of video decode error, and perceptible variation may appear in the effect after the embedding.Watermarked when encoding compression, general consideration combines with certain dynamic image expert group (MPEG) coding standard, as common MPEG-1, MPEG-2 or MPEG-4, the embedding of its algorithm and extraction are handled can be fairly simple, can realize the real-time processing that watermark embeds and extracts, but it need revise encoder, and has the accumulation of error of picture group (GOP), causes the reduction of video quality.
Summary of the invention
The present invention is directed to the deficiency that present original video watermarking algorithm exists, a kind of video watermark process based on the location, moving region is provided, the method has great improvement and raising to the robustness and the invisibility of watermark.
The video watermark process based on the location, moving region that the present invention proposes may further comprise the steps:
(1) location, moving region, the component motion frame of adjacent two frames promptly comprises the two field picture of adjacent two frame relative motion information, and realizes the location of moving region in the original video frame in view of the above in the extraction video;
(2) watermarked, according to location, the moving region in the step (1), watermark is embedded the moving region of each frame of video;
(3) detect watermark, each frame of video is carried out watermark extracting, and the further watermark of each frame extraction of statistical analysis, to detect in the video whether contain watermark information.
Every frame in the video all passes through the location of the moving region of frame realization thereafter, and every frame is all watermarked according to step (2), but except the last frame.Can resist frame deletion like this attacks.
The specific implementation step of described step (1) is:
A extracts the component motion frame of adjacent two frames in the video, promptly comprises the two field picture of adjacent two frame relative motion information;
B resolves into the fritter that is easy to encode of non-overlapping copies with the component motion frame, and calculates the variance of each piece;
Square that comprises at least four fritters of c definition is a macro block, with this macro block scanning motion component frame, with the variance of each fritter in the macro block with as weighing the whether violent standard of motion, with variance and maximum macro block is that a square region is determined at the center, this zone corresponds in the former frame of video, is the moving region that will locate.
The length of neglecting watermark greatly of square region is determined among the above-mentioned steps c, should satisfy the requirement of each fritter embedding one bit watermark information in the square region.
Extract in the described step (1) method that the component motion frame of adjacent two frames in the video adopted be based on method of wavelet, based on the method for two-dimentional principal component analysis (2DPCA), the method that the front and back frame subtracts each other, independent component analysis (ICA) algorithm.When adopting independent component analysis (ICA) algorithm can be quick independent component analysis (FastICA) algorithm.
The watermarking algorithm of watermarked employing is the watermarking algorithm that is applicable to rest image in the described step (2), particularly based on quantization index modulation (QIM) algorithm of vision mode.
The specific implementation step of described step (3) is:
The watermark that a extracts each frame according to the extraction step of the watermarking algorithm that adopts in the step (2);
B utilizes voting method that statistical analysis is carried out in the watermark that each frame extracts, i.e. certain bit of watermark extracts that this bit is 1 in the watermark that obtains if surpass half frame of sum, and then this bit is judged to 1, otherwise is judged to 0.
The present invention considers the visual characteristic that human eye is relatively low to the variation sensitiveness of moving region and adjacent domain thereof, makes full use of the interframe relation of video sequence, and the setting movement zone is with watermarked.The method has great improvement and raising to the robustness and the invisibility of watermark.
Description of drawings
Fig. 1 is the frame diagram of the inventive method.
Fig. 2 is the key diagram of moving region position fixing process, and the little square frame in the frame of the left side is represented macro block, and big square frame is represented corresponding moving region in the frame of video.
Prior image frame in Fig. 3 video in adjacent two frames.
Fig. 4 is the back two field picture in adjacent two frames in the video.
Fig. 5 is the component motion frame that the FastICA algorithm extracts, and promptly comprises the two field picture of adjacent two frame relative motion information.
Fig. 6 is the static component frame that the FastICA algorithm extracts, and promptly comprises the two field picture of adjacent two frame background informations.
Fig. 7 is a QIM watermarking algorithm flow chart, and its flow chart is made up of watermark embedding, Channel Transmission and watermark detection three parts.
Fig. 8 is Y-PSNR (PSNR) curve chart of each frame in the watermark video.
Embodiment
Adopt quick independent component analysis (FastICA) algorithm to extract the dynamic component frame, promptly extract the two field picture that comprises adjacent two frame relative motion information, and adopt that quantization index modulation (QIM) algorithm in the existing watermarking algorithm is watermarked to be specifically described for example.Those skilled in the art also can adopt other algorithms to carry out the extraction of dynamic component according to explanation, the method for subtracting each other as adjacent two frames, utilize method of wavelet and other ICA algorithm etc.In addition, in watermarked, also can utilize other existing watermarking algorithm, as spread spectrum (SS) watermarking algorithm, based on the watermarking algorithm of small echo, based on watermarking algorithm of singular value decomposition etc.
Fig. 1 has provided the frame diagram of the inventive method, and flow process shown in pressing comprises following concrete steps:
1. locate the moving region, promptly determines the embedded location of watermark
Original video is decomposed framing, utilize the FastICA algorithm to extract the component motion frame of adjacent two frames, described component motion frame is meant the two field picture that comprises adjacent two frame relative motion information.The fritter that this component motion frame is resolved into non-overlapping copies and be easy to encode (size is 8*8 usually), and calculate the variance of each piece.With the macro block that is equivalent to four block sizes (size is 16*16 usually) scanning motion component frame, with the variance of each fritter in the macro block with as weighing the whether violent standard of motion, with variance and maximum macro block is that the center determines that a size is the square region of N*N, this zone corresponds to former frame of video, promptly obtains the moving region that will locate.Wherein, the size of moving region satisfies relational expression L=N * N by the decision of the length L of watermark, promptly embeds the watermark information of a bit in fritter.As shown in Figure 2.The result of FastICA algorithm extraction component motion such as Fig. 3, Fig. 4, Fig. 5, shown in Figure 6.
Why Fig. 3, Fig. 4, Fig. 5, Fig. 6 can interpretation scheme adopt variance as weighing the whether violent foundation of motion.As seen from Figure 5, only have texture at the moving region image, these textures have identified relative motion.And the violent motion of significant texture reflection, fuzzy texture represents its motion small, does not have the i.e. not motion generation of texture.Can draw from mathematical computations, the significant regional variance of texture is big in the component motion frame, so scheme utilizes variance as weighing the location that the whether violent standard of motion realizes the moving region.
2. watermark embeds
In watermark embed process, scheme has adopted a kind of QIM algorithm based on vision mode, and Fig. 7 has provided the frame diagram of this algorithm.The Watson vision mode that uses in the algorithm is made up of a sensitivity function, two masked portion and assembling sections of sheltering based on the brightness and contrast.Each element t in the responsive kilsyth basalt of Watson vision mode (i, j) with the DCT coefficient (i, j) corresponding one by one, representative under situation without any masking noise, calculate the DCT coefficient (i, j) the critical visible error of maximum magnitude of modification, i wherein, j=0,1 ..., 7.c
o(i, j, k) be k piece among the former figure the DCT coefficient (i, j), c
w(i, j are that (i, j), watermark W is for only comprising 0,1 binary pseudo-random sequence for the DCT coefficient of watermarked back k piece k).
According to the watermark embedded part among Fig. 7, its idiographic flow is as follows:
(1) the piece dct transform is carried out in the moving region,, set c by the Waston model
o(i, j, k) watermarked quantization step be step (i, j)=(i, j), wherein beta is used for controlling watermarked intensity to beta * t.Quantification obtains
m
e(i, j, k)=round (q
e(i, j, k)), δ=m
e(i, j, k)-q
e(i, j, k), wherein
And watermarked by following rule:
(a) if mod (m
e(i, j, k), 2)=W, then | c
w(i, j, k) |=m
e(i, j, k) * step (i, j);
(b) if mod (m
e(i, j, k), 2) ≠ W, then
When δ 〉=0, | c
w(i, j, k) |=(m
e(i, j, k)+1) * step (i, j);
When δ＜0, | c
w(i, j, k) |=(m
e(i, j, k)-1) * step (i, j).
(2) after all bits embed and finish, carry out anti-piece dct transform, obtain the image after watermarked.
In the video every two field picture through moving region location watermarked after, rebuild and obtain watermarked video.
3. watermark detection
The video that receives is decomposed framing, each frame is carried out motion positions according to the detailed process of step 1, obtain carrying out watermark extracting behind the moving region.According to the watermark detection part among Fig. 7, its idiographic flow is as follows:
(1) the piece dct transform is carried out in moving region to be detected, obtain k piece (i, j) the DCT coefficient c of position
w(i, j, k), calculate its quantization step that detects watermark and be step (i, j)=beta * t (i, j).Quantification obtains
m
d(i, j, k)=round (q
d(i, j, k)), and by following Rule Extraction watermark: W '
n=mod (m
d(i, j, k), 2).
Obtain watermark W '
n, subscript n is represented watermark W '
nBe to extract by the n frame in the video to obtain;
(2) the watermark W ' that each frame is extracted with voting method
nCarrying out the comprehensive statistics analysis, is example with the wherein bit of watermark, if surpass
Watermark in this bit be 1, then this bit is for being judged to 1, otherwise is judged to 0, that is:
Wherein, W ' is final detection watermark, and L is the length of watermark.
(3) the normalizated correlation coefficient NC between the watermark W of the watermark W ' of calculating extraction and embedding, to judge whether there is watermark in the video:
As NC during, judge in the video to have watermark, otherwise do not have watermark in the video greater than threshold value threshold.Wherein, the value of threshold can be carried out different settings according to different situations.
L-G simulation test has intercepted one section polar bear video as the carrier video, comprises 51 two field pictures altogether, and every two field picture size is 272*352, and frame per second is 25fps.The watermark of using is the binary pseudo-random sequence of forming by 0,1, and length is 100.Fig. 8 has provided the PSNR curve chart of watermark video each frame of the present invention under noiseless condition, and each frame of watermark video has higher PSNR value as seen from Figure 8, and promptly each two field picture has higher fidelity.
Robustness for watermark among proof the present invention, adopt some common information processing manners that watermark video is handled, comprise that various averages are that the different white Gaussian noise of 0 variance Var is attacked, under the prerequisite that keeps video duration or frame number, adopt the MPEG-2 compression of different frame per second, and frame deletion and frame are cut out attack.Wherein, delete in the video about 10% frame in the frame deletion at random, i.e. 5 frames, frame are cut out attack and have been comprised again and cut out and cut out at random dual mode in proper order.Following table has provided under the various attack, the detected value NC of watermark.
The detected value NC of watermark under the various attack
To sum up, simulation result has proved the feasibility and the reliability of this programme.It is guaranteeing under the sightless prerequisite of watermark, white Gaussian noise, MPEG-2 compression, frame deletion and frame is being cut out attack have higher robustness.
Claims (1)
1. the video watermark treatment method based on the location, moving region is characterized in that, may further comprise the steps:
(1) location, moving region, the component motion frame of adjacent two frames promptly comprises the two field picture of adjacent two frame relative motion information, and realizes the location of moving region in the original video frame in view of the above in the extraction video; The specific implementation step is:
A extracts the component motion frame of adjacent two frames in the video, promptly comprises the two field picture of adjacent two frame relative motion information;
B resolves into the fritter that is easy to encode of non-overlapping copies with the component motion frame, and calculates the variance of each piece;
Square that comprises at least four fritters of c definition is a macro block, with this macro block scanning motion component frame, with the variance of each fritter in the macro block with as weighing the whether violent standard of motion, with variance and maximum macro block is that a square region is determined at the center, this zone corresponds in the former frame of video, is the moving region that will locate; The length of neglecting watermark greatly of square region is determined, should satisfy the requirement of each fritter embedding one bit watermark information in the square region;
(2) watermarked, according to location, the moving region in the step (1), watermark is embedded the moving region of each frame of video;
(3) detect watermark, each frame of video is carried out watermark extracting, and the further watermark of each frame extraction of statistical analysis, to detect in the video whether contain watermark information, utilize voting method that the watermark that each frame extracts is carried out statistical analysis to determine final detection watermark, promptly when determining each bit of above-mentioned final detection watermark, extract that this bit is 1 in the watermark that obtains if surpass half frame of sum, this bit of then determining this final detection watermark is judged to 1, otherwise is judged to 0.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2008100155806A CN100556136C (en) | 2008-04-23 | 2008-04-23 | Video watermark process based on the location, moving region |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2008100155806A CN100556136C (en) | 2008-04-23 | 2008-04-23 | Video watermark process based on the location, moving region |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101277438A CN101277438A (en) | 2008-10-01 |
| CN100556136C true CN100556136C (en) | 2009-10-28 |
Family
ID=39996384
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2008100155806A Expired - Fee Related CN100556136C (en) | 2008-04-23 | 2008-04-23 | Video watermark process based on the location, moving region |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100556136C (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102801977B (en) * | 2012-08-07 | 2015-03-11 | 合肥极光科技股份有限公司 | Method for embedding robust digital watermark in H.264 based on video complexity analysis |
| US9208534B2 (en) * | 2014-05-07 | 2015-12-08 | Cisco Technology Inc. | System and method for embedding data |
| US10607312B2 (en) | 2014-12-18 | 2020-03-31 | Nokia Technologies Oy | Method and apparatus for publishing locational copyrighted watermarking video |
| CN105741844B (en) * | 2016-03-30 | 2019-03-22 | 杭州电子科技大学 | A kind of digital audio watermarking algorithm based on DWT-SVD-ICA |
| US10678929B2 (en) * | 2018-03-09 | 2020-06-09 | Citrix Systems, Inc. | Systems and methods for embedding data in remote session displays |
| CN110136166B (en) * | 2019-04-09 | 2021-04-30 | 深圳锐取信息技术股份有限公司 | Automatic tracking method for multi-channel pictures |
| CN113179407B (en) * | 2021-04-23 | 2022-08-12 | 山东大学 | Video watermark embedding and extracting method and system based on interframe DCT coefficient correlation |
-
2008
- 2008-04-23 CN CNB2008100155806A patent/CN100556136C/en not_active Expired - Fee Related
Non-Patent Citations (2)
| Title |
|---|
| 基于独立分量分析的盲视频水印方案. 孙建德，刘琚.电子学报，第32卷第9期. 2004 |
| 基于独立分量分析的盲视频水印方案. 孙建德，刘琚.电子学报，第32卷第9期. 2004 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101277438A (en) | 2008-10-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100556136C (en) | Video watermark process based on the location, moving region | |
| Kankanhalli et al. | Content based watermarking of images | |
| Voloshynovskiy et al. | Attack modelling: towards a second generation watermarking benchmark | |
| US6373974B2 (en) | Method for extracting multiresolution watermark images to determine rightful ownership | |
| CN100586181C (en) | Embedding and detecting method and system for image data watermark information | |
| Su et al. | An integrated approach to image watermarking and JPEG-2000 compression | |
| Cruz-Ramos et al. | A blind video watermarking scheme robust to frame attacks combined with MPEG2 compression | |
| Lacy et al. | On combining watermarking with perceptual coding | |
| KR100948381B1 (en) | Image Watermarking Method Using Human Visual System | |
| Barni et al. | Object watermarking for for MPEG-4 video streams copyright protection | |
| Rawat et al. | DCT and SVD based new watermarking scheme | |
| Li et al. | Improved robust watermarking in DCT domain for color images | |
| Maity et al. | An image watermarking scheme using HVS characteristics and spread transform | |
| Fu-zheng et al. | A no-reference video quality assessment method based on digital watermark | |
| Yan et al. | Block-based adaptive image watermarking scheme using just noticeable difference | |
| Huang et al. | A video watermarking algorithm based on pseudo 3D DCT | |
| Seo et al. | Robust Image Watermarking Method Using Discrete Cosine Decomposition and Just Noticeable Distortion | |
| Namazi et al. | Block-based adaptive image watermarking scheme using visual perception Model in DCT Domain | |
| Weiwei et al. | JPEG Quantization-Distribution Steganalytic Method Attacking JSteg | |
| Hernandez et al. | DCT-domain image watermarking and generalized Gaussian models | |
| Zhang et al. | Image watermarking capacity and reliability analysis in wavelet domain | |
| Liu et al. | An improved spatial spread-spectrum video watermarking | |
| Yu-min et al. | Adaptive video watermarking algorithm based on MPEG-4 streams | |
| Kong et al. | Statistic-based color image watermarking scheme in DWT domain | |
| Zou et al. | Real-time video watermarking based on extended m-sequences |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20091028 Termination date: 20100423 |