CN113556553A - Method, system, equipment, medium and terminal for embedding and extracting fast video watermark - Google Patents
Method, system, equipment, medium and terminal for embedding and extracting fast video watermark Download PDFInfo
- Publication number
- CN113556553A CN113556553A CN202110733473.2A CN202110733473A CN113556553A CN 113556553 A CN113556553 A CN 113556553A CN 202110733473 A CN202110733473 A CN 202110733473A CN 113556553 A CN113556553 A CN 113556553A
- Authority
- CN
- China
- Prior art keywords
- watermark
- video
- embedding
- frame
- matrix
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 238000000605 extraction Methods 0.000 claims abstract description 43
- 238000012216 screening Methods 0.000 claims abstract description 29
- 230000008569 process Effects 0.000 claims abstract description 10
- 239000011159 matrix material Substances 0.000 claims description 52
- 238000006243 chemical reaction Methods 0.000 claims description 17
- 238000004422 calculation algorithm Methods 0.000 claims description 16
- 230000000903 blocking effect Effects 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 9
- 230000008859 change Effects 0.000 claims description 8
- 239000000126 substance Substances 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000000354 decomposition reaction Methods 0.000 claims description 6
- 230000008707 rearrangement Effects 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 5
- 238000009432 framing Methods 0.000 claims description 5
- 238000013139 quantization Methods 0.000 claims description 4
- 230000010354 integration Effects 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000002474 experimental method Methods 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 239000000969 carrier Substances 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/88—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
- Editing Of Facsimile Originals (AREA)
Abstract
The invention belongs to the technical field of information security, and discloses a method, a system, equipment, a medium and a terminal for embedding and extracting a fast video watermark, wherein the method for embedding and extracting the fast video watermark comprises two processes of embedding and extracting the video watermark; the video watermark embedding method comprises the following steps: screening key frames of a video to be embedded with a watermark; carrying out watermark binarization; watermark embedding is carried out in the frame, and each key frame to be embedded is subjected to watermark embedding; replacing the original video frame with the key frame embedded with the watermark, and integrating the frame into a video containing the watermark; the video watermark extraction method comprises the following steps: screening key frames of a video with a watermark to be extracted; attempting watermark extraction on each initial key frame to be extracted; judging whether the extracted watermark sequence to be judged is an illegal sequence; and (4) performing secondary voting on the sequences in the to-be-voted list to improve the extraction accuracy rate, so as to obtain the final extracted watermark sequence. The invention can rapidly and stably carry out watermark operation, provides reliable basis for copyright protection and infringement tracing and is convenient for practical application.
Description
Technical Field
The invention belongs to the technical field of information security, and particularly relates to a method, a system, equipment, a medium and a terminal for quickly embedding and extracting a video watermark.
Background
In recent years, with the development of internet technology and applications, digital assets such as pictures, videos, and audios have entered various fields of daily life like traditional physical assets, and these data can be downloaded and easily modified and illegally used, and can be easily redistributed or commercialized on the internet. As people increasingly hold digital assets, how to effectively protect intellectual property rights of digital asset holders becomes an important problem which is troubling society, and behaviors of lawbreakers to tamper and misappropriate digital assets are often difficult to detect and store despite invading the vital interests of digital asset holders.
In view of the above problems, the digital watermarking technology has been well applied in the field of copyright protection as an effective solution. The digital watermarking refers to embedding specific information into digital information carriers such as images, audios and videos through a watermarking algorithm, reserving important information capable of proving owners of the specific information without influencing the use of the original digital information carriers, and detecting and analyzing the important information under the condition of needing through a specific extraction method. A sophisticated and secure digital watermarking technique typically consists of two parts: an embedding program and an extracting program executed by using the embedding and extracting keys. The embedding process includes inserting a digitally signed watermark holding the copyright information of the owner of the asset in the digital information carrier to be embedded. Thus, with a given key, the extraction program only allows the owner or authorized recipient of the digital content to retrieve the embedded watermark from the watermarked carrier.
With the continuous development of image watermarking technology, video watermarking technology is also increasingly studied as an important branch of digital watermarking technology. Unlike picture watermarking, video watermarking needs to meet some specific time dimension requirements, including robustness should not only handle common image processing attacks such as noise addition and JPEG compression, but also should be able to resist video processing attacks such as MPEG compression and frame synchronization attacks; due to the motion of objects in the video sequence, the temporal dimension should be considered to avoid distortion between frames; the complexity of the watermarking scheme should be low because of the large number of frames to be processed in the video object, which consumes a lot of time.
In practical applications, digital video is basically considered as a collection of images, and many schemes extend the picture watermarking scheme to the video domain by embedding watermarks in all frames of a video sequence. The conventional video watermarking scheme obtained by expanding the image watermark usually has certain problems, if the watermark needs to be embedded into all frames in a video sequence, the algorithm time complexity is high, the influence on the visual effect of the video is large, and good invisibility is difficult to maintain. Because human eyes are not sensitive to the quality of a fast moving picture of an object, the existing scheme selects to add watermarks in a frame range with larger motion energy to achieve good invisibility, but the number of the added watermarks is still too large, so that the method is difficult to apply in practical engineering.
In view of the above problems, a watermarking scheme that is stable in spatial complexity and invisibility and can be applied in practical engineering and that can perform watermarking quickly is urgently needed.
Through the above analysis, the problems and defects of the prior art are as follows: the existing video watermarking algorithm is high in operation complexity, low in time efficiency, large in influence on the visual effect of a video, difficult to keep good invisibility, and too large in watermarking adding frame number, and difficult to apply in practical engineering.
The watermarking efficiency is always a big difficulty in the current domestic and foreign research on video watermarking algorithms, most of algorithm researches achieve higher robustness and invisibility by extremely high algorithm complexity, time efficiency is neglected, balance is difficult to achieve in the algorithm researches, and time consumption of the algorithm is rapidly increased when the algorithm acts on a high-resolution video, and even hours of time can be consumed. Therefore, the method has certain practical significance for researching an algorithm which has good robustness and invisibility and can rapidly add and extract watermarks to the high-definition video.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a method, a system, equipment, a medium and a terminal for embedding and extracting a fast video watermark, in particular to a method, a system, equipment, a medium and a terminal for embedding and extracting a fast video watermark based on three-frame difference increment screening, aiming at solving the problems of low time efficiency and poor practicability in engineering of the current video watermark algorithm.
The invention is realized in such a way that a method for embedding and extracting a fast video watermark comprises the following steps:
in the watermark embedding process, calculating a maximum value point of an interframe change difference value of a target video after framing by a three-frame difference method and extracting a key frame to be selected at the point; with i2Screening key frames to be selected for increment, respectively performing color space conversion, brightness calculation one-dimensional MR-SVD, low-frequency component blocking, blocking SVD, QIM embedded binary watermark, repeated embedding watermark sequence in a frame for multiple times, ISVD reconstructed blocking and IMRSVD reconstructed key frames after selecting the key frames, and finally inserting the key frames into video frames to combine the frames into a watermark-containing video;
in the extraction process of the watermark, calculating a maximum value point of an interframe change difference value of the target video after framing by a three-frame difference method and extracting a key frame to be selected at the point; with i2Selecting initial key frames for increment screening, respectively carrying out color space conversion, brightness calculation one-dimensional MR-SVD, low-frequency component blocking, blocking SVD, QIM watermark extraction and voting on watermark sequences extracted in frames after selecting key frames, trying to extract the initial key frames without the watermarks between the current initial key frame and the next initial key frame by taking 1 as an increment, and carrying out integration voting on all extracted key frame watermarks to obtainA watermark sequence is proposed.
Further, the fast video watermark embedding and extracting method comprises two processes of video watermark embedding and video watermark extracting.
The video watermark embedding method comprises the following steps:
(I) screening key frames of a video to be embedded with a watermark;
(II) carrying out watermark binarization;
(III) embedding watermarks in the frames, and embedding each key frame to be embedded;
and (IV) replacing the original video frame with the key frame embedded with the watermark, and integrating the frame into a video containing the watermark.
The method for extracting the video watermark comprises the following steps:
(1) screening key frames of a video with a watermark to be extracted;
(2) attempting watermark extraction on each initial key frame to be extracted;
(3) if the extracted watermark sequence to be judged is an illegal sequence, trying to perform (2) extraction operation between the current initial key frame and the next initial key frame by taking 1 as an increment until the legal watermark sequence is found, and storing the legal watermark sequence into a list to be voted;
(4) and (4) performing secondary voting on the sequences in the to-be-voted list to improve the extraction accuracy rate, so as to obtain the final extracted watermark sequence.
Further, in step (I), the screening key frames for the video to be embedded with the watermark includes:
i) calculating the difference D between the three framesn(x, y), the formula is as follows:
Dn(x，y)＝|fn+1(x，y)-fn(x，y)|∩|fn(x，y)-fn-1(x，y)|；
ii) taking the difference DnTaking the video frame at the (x, y) maximum point as a key frame to be selected;
iii) with i2(i∈N+) And screening the key frames to be selected for the increment, and selecting the final key frames to be embedded.
Further, in step (II), the binarizing of the watermark includes:
the watermark sequence composed of decimal digits to be embedded is binarized, one-digit decimal digits are represented by four-digit binary digits, and the watermark processing is carried out on characters in the same way.
Further, in step (III), the embedding the watermark in the frame, and for each key frame to be embedded, includes:
i) performing color space conversion on the key frame, and converting the RGB color space into YUV color space;
ii) performing one-dimensional MR-SVD on the luminance Y after the color space conversion to reduce the amount of computation;
iii) matrix of pairs
SVD decomposition to obtain matrix U, S and W-1；
iv) obtaining the low frequency component LAThe formula is as follows:
v) low frequency component LADividing into 16 × 16 sub-blocks;
vi) SVD of each subblock L into U, S and W-1Three matrices, the SVD formula is as follows:
where U and W are orthogonal matrices representing horizontal and vertical details of the image, respectively, and the values on the S diagonal are the singular values of the matrix L;
vii) because the singular value contains a lot of energy, and the disturbance such as adding watermark will not change the singular value significantly, then embed the watermark into the singular value by QIM method, and embed one bit of the binary watermark in the first bit of the singular value of each sub-block in turn, the formula is as follows:
wherein S is(x，y)(1, 1) is the first digit of the singular value, WI(y) the watermark value to be embedded, the watermark embedding effect is adjusted by adjusting the quantization step length M, and when M is smaller, the imperceptibility of the watermark algorithm is better but the robustness is poorer;
viii) repeatedly embedding the watermark sequence to be embedded for a plurality of times until all sub-blocks are embedded;
ix) use of U, S × W by ISVD-1Reconstructing the sub-blocks;
x) reconstructing the key frame by IMR-SVD.
Further, in step ii), performing one-dimensional MR-SVD on the luminance Y after converting the color space to reduce the computation amount includes:
arranging
Rearranging the Y matrix into the following form
The matrix Y':
wherein the content of the first and second substances,
the number of the columns of the matrix after rearrangement is obtained;
② centralization
Centralizing each row of the matrix Y' to obtain a matrix
The formula is as follows:
wherein the content of the first and second substances,
is the average of all elements in row i of matrix Y'.
Further, in the step (1), the screening key frames of the video with the watermark to be extracted includes:
1) calculating the difference D between the three framesn(x, y), the formula is as follows:
Dn(x，y)＝|fn+1(x，y)-fn(x，y)|∩|fn(x，y)-fn-1(x，y)|；
2) take the difference DnTaking the video frame at the (x, y) maximum point as a key frame to be selected;
3) with i2(i∈N+) And screening the key frames to be selected for the increment, and selecting the initial key frames to be finally extracted.
Further, in step (2), the attempting of watermark extraction for each initial key frame to be extracted includes:
1) performing color space conversion on the key frame, and converting the RGB color space into YUV color space;
2) performing one-dimensional MR-SVD on the brightness Y after the color space conversion to reduce the operation amount;
3) for matrix
SVD decomposition to obtain matrix U, S and W-1；
4) Obtaining a low frequency component LAThe formula is as follows:
5) low frequency component LADividing into 16 × 16 sub-blocks;
6) SVD of each subblock L into U, S and W-1Three matrices, the SVD formula is as follows:
where U and W are orthogonal matrices representing horizontal and vertical details of the image, respectively, and the values on the S diagonal are the singular values of the matrix L;
7) extracting a watermark value by a QIM method, wherein the formula is as follows:
8) and carrying out intra-frame voting on the watermark sequence extracted in the frame according to bits to obtain the watermark sequence to be judged and extracted.
Further, in step 2), performing one-dimensional MR-SVD on the luminance Y after converting the color space to reduce the amount of computation includes:
arranging
Rearranging the Y matrix into the following form
The matrix Y':
wherein the content of the first and second substances,
the number of the columns of the matrix after rearrangement is obtained;
② centralization
Centralizing each row of the matrix Y' to obtain a matrix
The formula is as follows:
wherein the content of the first and second substances,
is the ith row of the matrix YMean of all elements.
Another object of the present invention is to provide a fast video watermark embedding and extracting system applying the fast video watermark embedding and extracting method.
It is a further object of the present invention to provide a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the fast video watermark embedding and extraction method.
It is another object of the present invention to provide a computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to execute the fast video watermark embedding and extracting method.
Another object of the present invention is to provide an information data processing terminal for implementing the fast video watermark embedding and extracting method.
By combining all the technical schemes, the invention has the advantages and positive effects that: the method is mainly used for embedding and extracting the watermark in the video, can quickly and stably perform watermark operation, can be used for scenes such as copyright protection, infringement traceability and the like of the video, and provides a reliable basis for the copyright protection and the infringement traceability.
The invention solves the problems that the existing video watermarking algorithm has high operation complexity and is difficult to apply in practical engineering. The invention screens the video frames by utilizing the three-frame difference increment screening, stabilizes the overall time complexity of the video watermark at an easily accepted level and is convenient for practical application.
The analysis experiment result shows that the running time of the MMMV method is extremely increased to be unacceptable when the resolution of the cover video is high, and the high-definition video is often required to be subjected to watermarking operation in the project.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments of the present invention will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a fast video watermark embedding and extracting method according to an embodiment of the present invention.
Fig. 2 is a flowchart of a fast video watermark embedding method according to an embodiment of the present invention.
Fig. 3 is a schematic diagram of a fast video watermark embedding method provided by an embodiment of the present invention.
Fig. 4 is a flowchart of a fast video watermark extraction method according to an embodiment of the present invention.
Fig. 5 is a schematic diagram of a fast video watermark extraction method provided in an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail with reference to the following embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In view of the problems in the prior art, the present invention provides a method, a system, a device, a medium, and a terminal for fast embedding and extracting a video watermark, and the present invention is described in detail below with reference to the accompanying drawings.
As shown in fig. 1, the fast video watermark embedding and extracting method provided by the embodiment of the present invention includes the following steps:
s101, acquiring a key frame to be selected at a maximum point by calculating a three-frame difference method for a target video;
s102, selecting the key frame i2Screening for increments;
s103, converting the color space of the key frame from RGB to YUV;
s104, carrying out binarization on the watermark, and storing a decimal watermark bit by four binary digits;
s105, performing one-dimensional MR-SVD on the brightness Y of the picture frame, and dividing the low-frequency components into 16 x 16 sub-blocks;
s106, carrying out SVD operation on each subblock to divide each subblock into three matrixes;
s107, embedding a watermark into each decomposed sub-block through QIM;
s108, repeatedly embedding for many times to improve robustness;
s109, ISVD reconstructing blocks;
s110, reconstructing a frame by IMRSVD;
s111, repeatedly performing each screened frame;
s112, combining the frames into a video;
s113, repeating S101-S106, and extracting the watermark through QIM;
and S114, voting is carried out on the extracted watermark to obtain an extraction result.
The method for embedding and extracting the video watermark comprises two processes of embedding and extracting the video watermark.
As shown in fig. 2, the method for embedding a video watermark provided by the embodiment of the present invention includes:
s201, screening key frames of a video to be embedded with a watermark;
s202, carrying out watermark binarization;
s203, embedding the watermark in the frame, and embedding each key frame to be embedded;
and S204, replacing the original video frame with the key frame embedded with the watermark, and integrating the frame into a video containing the watermark.
As shown in fig. 4, the method for extracting a video watermark provided in the embodiment of the present invention includes:
s301, screening key frames of a video with a watermark to be extracted;
s302, attempting watermark extraction on each initial key frame to be extracted;
s303, if the extracted watermark sequence to be judged is an illegal sequence, trying to perform S302 extraction operation between the current initial key frame and the next initial key frame by taking 1 as an increment until the legal watermark sequence is found, and storing the legal watermark sequence into a list to be voted;
s304, performing secondary voting on the sequence in the to-be-voted list to improve the extraction accuracy, and obtaining the final extracted watermark sequence.
The technical solution of the present invention is further described below with reference to specific examples.
The specific implementation thought of the rapid video watermark embedding and extracting method provided by the embodiment of the invention is that in the watermark embedding process, firstly, a maximum value point of inter-frame variation difference values of a target video after frame division is calculated by a three-frame difference method, a key frame to be selected is extracted at the point, and then, i is used for extracting a key frame to be selected2Screening key frames to be selected for increment, respectively performing color space conversion, brightness calculation one-dimensional MR-SVD, low-frequency component blocking, blocking SVD, QIM embedded binary watermark, repeated embedding watermark sequence in a frame for multiple times, ISVD reconstructed blocking and IMRSVD reconstructed key frames after selecting the key frames, and finally inserting the key frames into video frames to combine the frames into a watermark-containing video; in the extraction process of the watermark, firstly, a maximum value point of interframe change difference values of a target video after framing is calculated by a three-frame difference method, a key frame to be selected is extracted at the point, and then, i is used for extracting the key frame to be selected2The method comprises the steps of screening initial key frames for increment, conducting color space conversion, brightness calculation one-dimensional MR-SVD, low-frequency component blocking, blocking SVD, QIM watermark extraction and voting on watermark sequences extracted in frames after selecting the key frames, conducting trial extraction between the current initial key frame and the next initial key frame by taking 1 as the increment on the initial key frames without extracting the watermarks, and conducting integration voting on all extracted key frame watermarks to obtain the proposed watermark sequences.
The invention comprises two processes of embedding and extracting the video watermark:
as shown in fig. 3, the specific steps of the video watermark embedding process of the present invention are as follows:
(1) screening key frames of a video to be embedded with a watermark:
1) calculating the difference D between the three framesn(x, y), the formula is as follows:
Dn(x，y)＝|fn+1(x，y)-fn(x，y)|∩|fn(x，y)-fn-1(x，y)|
2) take the difference DnAnd the video frame at the (x, y) maximum point is used as a key frame to be selected.
3) With i2(i∈N+) And screening the key frames to be selected for the increment, and selecting the final key frames to be embedded.
(2) And (3) watermark binarization:
the watermark sequence composed of decimal digits to be embedded is binarized to facilitate subsequent embedding, one-digit decimal digits are represented by four-digit binary digits, and the watermark processing can be carried out on characters in the same way.
(3) Watermark embedding is carried out in the frame, and for each key frame to be embedded:
1) the key frame is subjected to color space conversion from RGB color space to YUV color space
2) The luminance Y after converting the color space is subjected to one-dimensional MR-SVD to reduce the amount of computation according to the following documents "r.kakarala and p.o.ogonbona, Signal analysis using a multiresolution form of the single value decoding. ieee transformations on Image Processing, 2001, vol.10, No.5, pp.723-735", and the following steps are specifically performed:
1. rearranging
Rearranging the Y matrix into the following form
Y' of (a), wherein
The number of columns of the matrix after rearrangement.
2. Centralization
Centralizing each row of the matrix Y' to obtain a matrix
The formula is as follows:
which is composed of
Is the average of all elements in row i of matrix Y'.
3) For matrix
SVD decomposition to obtain matrix U, S and W-1。
4) Obtaining a low frequency component LAThe formula is as follows:
5) low frequency component LADivided into 16 x 16 sub-blocks.
6) SVD of each subblock L into U, S and W-1Three matrices, the SVD formula is as follows:
where U and W are orthogonal matrices representing horizontal and vertical details of the image, respectively, and the values on the S diagonal are the singular values of the matrix L.
7) Since singular values contain a large amount of energy and disturbances such as watermarking do not significantly change the singular values, the singular values can be determined by the following documents "b.chen and g.w.wornell, Quantization index modulation: a class of conventional good methods for digital watermarking and Information embedding, IEEE Transactions on Information Theory, 2001, vol.47, No.4, pp.1423-1443, "the QIM method mentioned embeds a watermark into singular values, and embeds one bit of a binary watermark in the first bit of the singular value of each sub-block, and the specific formula is as follows:
wherein S(x，y)(1, 1) is the first digit of the singular value, WIAnd (y) is the watermark value to be embedded, the watermark embedding effect can be adjusted by adjusting the quantization step length M, and when M is smaller, the imperceptibility of the watermark algorithm is better but the robustness is poorer.
8) And repeatedly embedding the watermark sequence to be embedded for a plurality of times until all the sub-blocks are embedded.
9) U, S × W by ISVD-1And reconstructing the sub-blocks.
10) The key frame is reconstructed by IMR-SVD.
(4) And replacing the original video frame with the key frame embedded with the watermark, and integrating the frame into a video containing the watermark.
As shown in fig. 5, the specific steps of the video watermark extraction process of the present invention are as follows:
(1) screening key frames of a video to be watermarked:
1) calculating the difference D between the three framesn(x, y), the formula is as follows:
Dn(x，y)＝|fn+1(x，y)-fn(x，y)|∩|fn(x，y)-fn-1(x，y)|
2) take the difference DnAnd the video frame at the (x, y) maximum point is used as a key frame to be selected.
3) With i2(i∈N+) And screening the key frames to be selected for the increment, and selecting the initial key frames to be finally extracted.
(2) Watermark extraction is tried to each initial key frame to be extracted:
1) and performing color space conversion on the key frame, and converting the key frame from an RGB color space to a YUV color space.
2) And performing one-dimensional MR-SVD on the brightness Y after the color space conversion to reduce the operation amount, and specifically comprising the following steps:
1. rearranging
Rearranging the Y matrix into the following form
Y' of (a), wherein
The number of columns of the matrix after rearrangement.
2. Centralization
Centralizing each row of the matrix Y' to obtain a matrix
The formula is as follows:
wherein
Is the average of all elements in row i of matrix Y'.
3) For matrix
SVD decomposition to obtain matrix U, S and W-1
4) Obtaining a low frequency component LAThe formula is as follows:
5) low frequency component LADivided into 16 x 16 sub-blocks.
6) SVD of each subblock L into U, S and W-1Three matrices, the SVD formula is as follows:
where U and W are orthogonal matrices representing horizontal and vertical details of the image, respectively, and the values on the S diagonal are the singular values of the matrix L.
7) Extracting a watermark value by a QIM method, wherein a specific formula is as follows:
8) and carrying out intra-frame voting on the watermark sequence extracted in the frame according to bits to obtain the watermark sequence to be judged and extracted.
(3) And if the watermark extraction sequence to be judged is an illegal sequence, trying to perform (2) extraction operation between the current initial key frame and the next initial key frame by taking 1 as an increment until the legal watermark sequence is found, and storing the legal watermark sequence into a list to be voted.
(4) And (4) performing secondary voting on the sequences in the to-be-voted list to improve the extraction accuracy rate, so as to obtain the final extracted watermark sequence.
The technical effects of the present invention will be described in detail with reference to simulation experiments.
A set of experiments was designed below to compare the MMMV method described in the three-frame difference method-Based Video watermark embedding and extraction algorithm of the present invention and the documents "Nouioua I, Amardjia N, Bellia S.A Novel band and Robust Video watermark verification Technique in Fast Motion Frames Based on SVD and MR-SVD [ J ]. Security and communication networks,2018 (10): 1-17" for the time efficiency of the same test Video in the same operating environment. The selected test video is a color video which is common in actual engineering, the resolution is 1920x1080, and the frame number is 394 frames.
TABLE 1 comparison of run times for the present method and the MMMV method
The analysis experiment result shows that the running time of the MMMV method is extremely increased to be unacceptable when the resolution of the cover video is high, and the high-definition video is often required to be subjected to watermarking operation in the project.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When used in whole or in part, can be implemented in a computer program product that includes one or more computer instructions. When loaded or executed on a computer, cause the flow or functions according to embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website site, computer, server, or data center to another website site, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL), or wireless (e.g., infrared, wireless, microwave, etc.)). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that includes one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
The above description is only for the purpose of illustrating the present invention and the appended claims are not to be construed as limiting the scope of the invention, which is intended to cover all modifications, equivalents and improvements that are within the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A fast video watermark embedding and extracting method is characterized by comprising the following steps:
in the watermark embedding process, calculating a maximum value point of an interframe change difference value of a target video after framing by a three-frame difference method and extracting a key frame to be selected at the point; with i2Screening key frames to be selected for increment, respectively performing color space conversion, brightness calculation one-dimensional MR-SVD, low-frequency component blocking, blocking SVD, QIM embedded binary watermark, repeated embedding watermark sequence in a frame for multiple times, ISVD reconstructed blocking and IMRSVD reconstructed key frames after selecting the key frames, and finally inserting the key frames into video frames to combine the frames into a watermark-containing video;
in the extraction process of the watermark, calculating a maximum value point of an interframe change difference value of the target video after framing by a three-frame difference method and extracting a key frame to be selected at the point; with i2The method comprises the steps of screening initial key frames for increment, conducting color space conversion, brightness calculation one-dimensional MR-SVD, low-frequency component blocking, blocking SVD, QIM watermark extraction and voting on watermark sequences extracted in frames after selecting the key frames, conducting trial extraction between the current initial key frame and the next initial key frame by taking 1 as the increment on the initial key frames without extracting the watermarks, and conducting integration voting on all extracted key frame watermarks to obtain the proposed watermark sequences.
2. The fast video watermark embedding and extraction method of claim 1, wherein the fast video watermark embedding and extraction method comprises a two-part process of video watermark embedding and extraction;
the video watermark embedding method comprises the following steps:
(I) screening key frames of a video to be embedded with a watermark;
(II) carrying out watermark binarization;
(III) embedding watermarks in the frames, and embedding each key frame to be embedded;
(IV) replacing the original video frame with the key frame embedded with the watermark, and integrating the frame into a video containing the watermark;
the method for extracting the video watermark comprises the following steps:
(1) screening key frames of a video with a watermark to be extracted;
(2) attempting watermark extraction on each initial key frame to be extracted;
(3) if the extracted watermark sequence to be judged is an illegal sequence, trying to perform (2) extraction operation between the current initial key frame and the next initial key frame by taking 1 as an increment until the legal watermark sequence is found, and storing the legal watermark sequence into a list to be voted;
(4) and (4) performing secondary voting on the sequences in the to-be-voted list to improve the extraction accuracy rate, so as to obtain the final extracted watermark sequence.
3. The fast video watermark embedding and extracting method of claim 2, wherein in step (I), the screening the video to be watermarked for key frames comprises:
i) calculating the difference D between the three framesn(x, y), the formula is as follows:
Dn(x，y)＝|fn+1(x，y)-fn(x，y)|∩|fn(x，y)-fn-1(x，y)|；
ii) taking the difference DnTaking the video frame at the (x, y) maximum point as a key frame to be selected;
iii) with i2(i∈N+) And screening the key frames to be selected for the increment, and selecting the final key frames to be embedded.
4. The fast video watermark embedding and extraction method of claim 2, wherein in step (II), the watermark binarization comprises: the watermark sequence composed of decimal digits to be embedded is binarized, one-digit decimal digits are represented by four-digit binary digits, and the watermark processing is carried out on characters in the same way.
5. The fast video watermark embedding and extraction method according to claim 2, wherein in step (III), the embedding of the watermark in the frame comprises, for each key frame to be embedded:
i) performing color space conversion on the key frame, and converting the RGB color space into YUV color space;
ii) performing one-dimensional MR-SVD on the luminance Y after the color space conversion to reduce the amount of computation;
iii) matrix of pairs
SVD decomposition to obtain matrix U, S and W-1；
iV) obtaining the low frequency component LAThe formula is as follows:
v) low frequency component LADividing into 16 × 16 sub-blocks;
vi) SVD of each subblock L into U, S and W-1Three matrices, the SVD formula is as follows:
where U and W are orthogonal matrices representing horizontal and vertical details of the image, respectively, and the values on the S diagonal are the singular values of the matrix L;
vii) because the singular value contains a lot of energy, and the disturbance such as adding watermark will not change the singular value significantly, then embed the watermark into the singular value by QIM method, and embed one bit of the binary watermark in the first bit of the singular value of each sub-block in turn, the formula is as follows:
wherein S is(x，y)(1, 1) is the first digit of the singular value, WI(y) is to be embeddedThe embedded watermark value is adjusted by adjusting the quantization step length M, and when M is smaller, the imperceptibility of a watermark algorithm is better but the robustness is poorer;
viii) repeatedly embedding the watermark sequence to be embedded for a plurality of times until all sub-blocks are embedded;
ix) use of U, S × W by ISVD-1Reconstructing the sub-blocks;
x) reconstructing the key frame by IMR-SVD.
6. The fast video watermark embedding and extraction method according to claim 5, wherein in step ii), the performing one-dimensional MR-SVD on the luminance Y after converting the color space to reduce the computation amount comprises:
arranging
Rearranging the Y matrix into the following form
The matrix Y':
wherein the content of the first and second substances,
the number of the columns of the matrix after rearrangement is obtained;
② centralization
Centralizing each row of the matrix Y' to obtain a matrix
The formula is as follows:
wherein the content of the first and second substances,
is the average value of all elements in the ith row of the matrix Y';
in the step (1), the screening of the key frame for the video with the watermark to be extracted includes:
1) calculating the difference D between the three framesn(x, y), the formula is as follows:
Dn(x，y)＝|fn+1(x，y)-fn(x，y)|∩|fn(x，y)-fn-1(x，y)|；
2) take the difference DnTaking the video frame at the (x, y) maximum point as a key frame to be selected;
3) with i2(i∈N+) Screening the key frames to be selected for the increment, and selecting the initial key frames to be finally extracted;
in the step (2), the attempting of watermark extraction for each initial key frame to be extracted includes:
1) performing color space conversion on the key frame, and converting the RGB color space into YUV color space;
2) performing one-dimensional MR-SVD on the brightness Y after the color space conversion to reduce the operation amount;
3) for matrix
SVD decomposition to obtain matrix U, S and W-1；
4) Obtaining a low frequency component LAThe formula is as follows:
5) low frequency component LADividing into 16 × 16 sub-blocks;
6) SVD of each subblock L into U, S and W-1Three matrices, the SVD formula is as follows:
where U and W are orthogonal matrices representing horizontal and vertical details of the image, respectively, and the values on the S diagonal are the singular values of the matrix L;
7) extracting a watermark value by a QIM method, wherein the formula is as follows:
8) carrying out intra-frame voting on the watermark sequence extracted in the frame according to bits to obtain an extracted watermark sequence to be judged;
in step 2), performing one-dimensional MR-SVD on the luminance Y after converting the color space to reduce the amount of computation includes:
arranging
Rearranging the Y matrix into the following form
The matrix Y':
wherein the content of the first and second substances,
the number of the columns of the matrix after rearrangement is obtained;
② centralization
Centralizing each row of the matrix Y' to obtain a matrix
The formula is as follows:
wherein the content of the first and second substances,
is the average of all elements in row i of matrix Y'.
7. A fast video watermark embedding and extraction system implementing the fast video watermark embedding and extraction method of any one of claims 1 to 6.
8. A computer device comprising a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the fast video watermark embedding and extraction method of any one of claims 1 to 6.
9. A computer readable storage medium storing a computer program which, when executed by a processor, causes the processor to perform the fast video watermark embedding and extraction method of any one of claims 1 to 6.
10. An information data processing terminal, characterized in that the information data processing terminal is used for implementing the fast video watermark embedding and extracting method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110733473.2A CN113556553A (en) | 2021-06-30 | 2021-06-30 | Method, system, equipment, medium and terminal for embedding and extracting fast video watermark |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110733473.2A CN113556553A (en) | 2021-06-30 | 2021-06-30 | Method, system, equipment, medium and terminal for embedding and extracting fast video watermark |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113556553A true CN113556553A (en) | 2021-10-26 |
Family
ID=78131120
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110733473.2A Pending CN113556553A (en) | 2021-06-30 | 2021-06-30 | Method, system, equipment, medium and terminal for embedding and extracting fast video watermark |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113556553A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070098212A1 (en) * | 2005-10-28 | 2007-05-03 | Global Epoint, Inc. | Two level cross-correlation based system for watermarking continuous digital media |
| KR20120045132A (en) * | 2010-10-29 | 2012-05-09 | 에스케이플래닛 주식회사 | Apparatus and method for encoding video |
| US20130259294A1 (en) * | 2012-03-27 | 2013-10-03 | Infosys Limited | Method, system, and computer-readable medium for embedding and extracting a watermark in a video |
| CN105657431A (en) * | 2016-02-01 | 2016-06-08 | 杭州当虹科技有限公司 | Watermarking algorithm based on DCT domain of video frame |
| CN106097236A (en) * | 2016-04-29 | 2016-11-09 | 西安电子科技大学 | Frequency domain robust image reversible water mark method based on Non-negative Matrix Factorization |
-
2021
- 2021-06-30 CN CN202110733473.2A patent/CN113556553A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070098212A1 (en) * | 2005-10-28 | 2007-05-03 | Global Epoint, Inc. | Two level cross-correlation based system for watermarking continuous digital media |
| KR20120045132A (en) * | 2010-10-29 | 2012-05-09 | 에스케이플래닛 주식회사 | Apparatus and method for encoding video |
| US20130259294A1 (en) * | 2012-03-27 | 2013-10-03 | Infosys Limited | Method, system, and computer-readable medium for embedding and extracting a watermark in a video |
| CN105657431A (en) * | 2016-02-01 | 2016-06-08 | 杭州当虹科技有限公司 | Watermarking algorithm based on DCT domain of video frame |
| CN106097236A (en) * | 2016-04-29 | 2016-11-09 | 西安电子科技大学 | Frequency domain robust image reversible water mark method based on Non-negative Matrix Factorization |
Non-Patent Citations (3)
| Title |
|---|
| IMEN NOUIOUA等: "A Novel Blind and Robust Video Watermarking Technique in Fast Motion Frames Based on SVD and MR-SVD", 《SECURITY AND COMMUNICATION NETWORKS》 * |
| 北方工业大学教务处: "《北方工业大学2011年"北京市大学生科学研究与创业行动计划"研究报告论文集》", 31 December 2012 * |
| 魏瑶: "基于视频序列的数字水印方法研究", 《中国优秀博硕士学位论文全文数据库（硕士）信息科技辑》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Himeur et al. | A robust and secure key-frames based video watermarking system using chaotic encryption | |
| Dasgupta et al. | Optimized video steganography using genetic algorithm (GA) | |
| Darmstaedter et al. | Low cost spatial watermarking | |
| Tagliasacchi et al. | Hash-based identification of sparse image tampering | |
| Queluz | Authentication of digital images and video: Generic models and a new contribution | |
| US20060107056A1 (en) | Techniques to manage digital media | |
| CN111917558B (en) | Video frame data double-authentication and hierarchical encryption method based on block chain | |
| Nouioua et al. | A novel blind and robust video watermarking technique in fast motion frames based on SVD and MR‐SVD | |
| Hosam et al. | Adaptive block‐based pixel value differencing steganography | |
| Farfoura et al. | Low complexity semi-fragile watermarking scheme for H. 264/AVC authentication | |
| Amanipour et al. | Video-tampering detection and content reconstruction via self-embedding | |
| Ponni alias Sathya et al. | Non‐redundant frame identification and keyframe selection in DWT‐PCA domain for authentication of video | |
| Juarez‐Sandoval et al. | Improved imperceptible visible watermarking algorithm for auxiliary informationdelivery | |
| Rabie et al. | Secure high payload steganography: A model-based approach | |
| Jiang et al. | A high capacity steganographic method based on quantization table modification and F5 algorithm | |
| Sowmya et al. | Video authentication using watermark and digital signature—a study | |
| Ling et al. | Watermarking for image authentication | |
| Laskar et al. | A review on image steganalysis techniques for attacking steganography | |
| Zeng et al. | Extraction of multiresolution watermark images for resolving rightful ownership | |
| Zhang et al. | A video watermarking algorithm of H. 264/AVC for content authentication | |
| Patil et al. | Fragile video watermarking for tampering detection and localization | |
| Narkedamilly et al. | Discrete multiwavelet–based video watermarking scheme using SURF | |
| CN113556553A (en) | Method, system, equipment, medium and terminal for embedding and extracting fast video watermark | |
| CN114598887A (en) | Anti-recompression video watermarking method for controlling bit rate increase | |
| Sakib et al. | A robust DWT-based compressed domain video watermarking technique |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 710071 No. 2 Taibai South Road, Shaanxi, Xi'an Applicant after: XIDIAN University Applicant after: Xi'an Lianrong Technology Co.,Ltd. Address before: 710071 No. 2 Taibai South Road, Shaanxi, Xi'an Applicant before: XIDIAN University Applicant before: XI'AN XIDIAN LIANRONG TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20211026 |
|
| RJ01 | Rejection of invention patent application after publication |