CN111182365A - Compressed domain video watermark embedding and extracting method based on visual sensitive block - Google Patents

Compressed domain video watermark embedding and extracting method based on visual sensitive block Download PDF

Info

Publication number
CN111182365A
CN111182365A CN202010039301.0A CN202010039301A CN111182365A CN 111182365 A CN111182365 A CN 111182365A CN 202010039301 A CN202010039301 A CN 202010039301A CN 111182365 A CN111182365 A CN 111182365A
Authority
CN
China
Prior art keywords
watermark
entering
video
setting
counter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010039301.0A
Other languages
Chinese (zh)
Other versions
CN111182365B (en
Inventor
江小平
陶睿欣
李成华
丁昊
石鸿凌
王怀
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South Central Minzu University
Original Assignee
South Central University for Nationalities
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South Central University for Nationalities filed Critical South Central University for Nationalities
Priority to CN202010039301.0A priority Critical patent/CN111182365B/en
Publication of CN111182365A publication Critical patent/CN111182365A/en
Application granted granted Critical
Publication of CN111182365B publication Critical patent/CN111182365B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835—Generation of protective data, e.g. certificates
    • H04N21/8358—Generation of protective data, e.g. certificates involving watermark
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/88—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks

Abstract

The invention discloses a compressed domain video watermark embedding method based on a visual sensitive block, which comprises the following steps: scrambling and encrypting the binary watermark sequence to obtain an encrypted binary watermark sequence, acquiring a visual sensitive block of the last frame in each group of pictures (GOP) of the video, correcting the acquired visual sensitive block by using a video significance region detection method based on a compression region to obtain a macro block to be embedded with the watermark, and embedding the encrypted binary watermark sequence into the macro block according to a first alternating current coefficient of a 4 x 4 sub-macro block positioned in the 1 st row and the 1 st column in the obtained macro block to be embedded with the watermark to obtain the video embedded with the watermark. The invention can solve the technical problem that the embedded watermark can be damaged when the QP value used in the recompression process of the video digital watermark embedding method of the existing compression domain is changed, thereby being incapable of resisting quantization attack.

Description

Compressed domain video watermark embedding and extracting method based on visual sensitive block
Technical Field
The invention belongs to the field of multimedia information security, and particularly relates to a method for embedding and extracting a video watermark in a compressed domain based on a visual sensitive block.
Background
With the development of network technology, information is rapidly spreading with the development of multimedia technology. Some illegal videos are also easy to copy and illegally spread on the network, and due to the diversified requirements of different users, the video content can appropriately adapt to the requirements of different users and equipment, so that the video content can be continuously recompressed under the appropriate video compression standard in the transmission process, and meanwhile, in the recompression process, in order to prevent the video content from being illegally manipulated by lawless persons and protect the copyright of the video content, the watermark embedding operation needs to be performed on the video.
In the video digital watermarking technology, many methods for embedding video digital watermarks have been proposed, which are mainly classified into two main categories, namely methods based on a compressed domain and methods based on a pixel domain. The compressed domain based method is mainly implemented in a codeword mode, a motion vector mode, or a transform domain mode at present.
However, the existing video digital watermark embedding method based on the compressed domain has the defects that: in order to ensure the robustness of the finally extracted watermark, the methods must use a fixed quantization step (QP) in the recompression process, and when the QP value changes, the embedded watermark is damaged, so that the quantization attack cannot be resisted.
Disclosure of Invention
Aiming at the defects or improvement requirements of the prior art, the invention provides a compressed domain video watermark embedding and extracting method based on a visual sensitive block, and aims to solve the technical problem that when a QP value used in a recompression process of the conventional compressed domain video digital watermark embedding method is changed, the embedded watermark is damaged, and thus quantization attack cannot be resisted.
To achieve the above object, according to one aspect of the present invention, there is provided a method for embedding a visual sensitive block-based compressed domain video watermark, comprising the steps of:
(1) scrambling and encrypting the binary watermark sequence to obtain an encrypted binary watermark sequence;
(2) the method comprises the steps of obtaining a visual sensitive block of the last frame in each GOP of a video, and correcting the obtained visual sensitive block by using a video salient region detection method based on a compressed region to obtain a macro block to be embedded with a watermark;
(3) embedding the binary watermark sequence encrypted in the step (1) into the macro block according to the first alternating current coefficient of the 4 × 4 sub-macro block positioned in the 1 st row and the 1 st column in the macro block to be embedded with the watermark obtained in the step (2) to obtain a video embedded with the watermark;
preferably, the scrambling encryption method used in step (1) may be an Arnold transform method, a Fibonacci transform encryption algorithm, a Hilbert curve transform encryption algorithm, an affine transform encryption algorithm, or a magic square transform encryption algorithm, and the binary watermark sequence is a {0, 1} sequence.
Preferably, step (2) comprises in particular the following sub-steps:
(2-1) acquiring the last frame in each group of pictures (GOP) of the video;
(2-2) setting a counter i to 1, and initializing the number NNZ of non-zero quantized transform residual coefficients QDCT of the ith 16 × 16 macroblock in the last frameiAnd energy factor ENiAre all equal to 0;
(2-3) judging whether the counter i is larger than or equal to the total number of the macro blocks with the size of 16 x 16 in the last frame, if so, entering the step (2-14), and if not, entering the step (2-4);
(2-4) setting a counter j equal to 1;
(2-5) judging whether the counter j is more than or equal to 16, if so, entering the step (2-13), otherwise, entering the step (2-6);
(2-6) setting a counter k equal to 1;
(2-7) judging whether the counter k is more than or equal to 16, if so, entering the step (2-11), and otherwise, entering the step (2-8);
(2-8) obtaining the kth QDCT in the jth 4 x 4 sub-macroblock in the ith 16 x 16 macroblockkJudging whether the value is not equal to 0, if not, entering the step (2-9), otherwise, entering the step (2-10);
(2-9) setting the number NNZ of non-zero in QDCTi＝NNZi+1, energy factor ENi＝ENi+|QDCTk|；
(2-10) setting a counter k ═ k +1, and returning to the step (2-7);
(2-11) setting a counter j ═ j +1, and returning to the step (2-5);
(2-12) setting a counter i ═ i +1, and returning to the step (2-3);
(2-13) number NNZ of non-zero values in QDCT according to i-th macroblock of size 16 x 16iAnd energy factor ENiCalculating the information quantity M of the i 16 th macroblocki，Mi＝Norm(NNZi+ENi+NNZi⊙ENi) wherein Norm () represents the normalization operation, a ⊙ B represents the multiplication of the corresponding bits of the matrices A and B, and returns to step (2-12);
(2-14) extracting the information amount M from all the 16 × 16 macro blocks of the last frameiAll macroblocks equal to 1 constitute a visually sensitive block;
and (2-15) processing the last frame by using a video salient region detection method based on a compressed region to obtain a motion target mark map by using the motion vector of the last frame, and screening the plurality of visual sensitive blocks obtained in the step (2-14) according to the motion target mark map to obtain a plurality of screened visual sensitive blocks serving as the macro blocks to be embedded with the watermark.
Preferably, the screening process in step (2-15) is to keep the visually sensitive blocks of the plurality of visually sensitive blocks obtained in step (2-14) located in the moving target mark map and delete the visually sensitive blocks located outside the moving target mark map.
Preferably, step (3) comprises the sub-steps of:
(3-1) setting a counter m to 1;
(3-2) judging whether the counter m is larger than the total length of the binary watermark sequence encrypted in the step (1), if so, ending the process, otherwise, turning to the step (3-3);
(3-3) setting a counter n to 1;
(3-4) judging whether the counter n is larger than the total number of the macro blocks to be embedded with the watermark obtained in the step (2), if so, ending the process, otherwise, turning to the step (3-5);
(3-5) taking the nth macro block from the macro block to be embedded with the watermark obtained in the step (2), and judging the first AC coefficient AC of the sub macro block with the size of 4 x 4 in the 1 st row and the 1 st column in the nth macro block1Whether the value is greater than or equal to 0, if so, entering the step (3-6), otherwise, entering the step (3-9);
(3-6) judging whether the mth watermark value in the binary watermark sequence encrypted in the step (1) is equal to 1, if so, entering the step (3-7), otherwise, entering the step (3-8);
(3-7) setting the AC coefficient AC1＝AC1+1 and returning to step (3-2);
(3-8) setting the AC coefficient AC1＝-AC1+1 and returning to step (3-2);
(3-9) judging whether the mth watermark value in the binary watermark sequence encrypted in the step (1) is equal to 1, if so, entering the step (3-10), otherwise, entering the step (3-11);
(3-10) setting the AC coefficient AC1＝-AC11 and returning to the step (3-2);
(3-11) setting the AC coefficient AC1＝AC1-1 and returning to step (3-2).
According to another aspect of the present invention, there is provided a method for extracting a video watermark in a compressed domain based on a visual-sensitive block, comprising the following steps:
(1) acquiring a visual sensitive block of the last frame in each group of pictures (GOP) of the video with the embedded watermark, and correcting the acquired visual sensitive block by using a video salient region detection method based on a compressed region to obtain a plurality of macro blocks with the watermark to be extracted;
(2) for the first macroblock to be watermarked obtained in step (1), determining a first AC coefficient AC of a 4 × 4 sub-macroblock located in row 1 and column 11Whether the value is greater than or equal to 0, if so, entering the step (3), otherwise, entering the step (4);
(3) setting the watermark value corresponding to the macro block in the binary watermark ciphertext as 1;
(4) setting the watermark value corresponding to the macro block in the binary watermark ciphertext as 0;
(5) for the residual macro blocks to be subjected to watermark extraction obtained in the step (1), repeating the steps (2) to (4) to obtain a complete binary watermark ciphertext;
(6) and (5) carrying out anti-scrambling decryption on the complete binary watermark ciphertext obtained in the step (5) to obtain a binary watermark sequence.
In general, compared with the prior art, the above technical solution contemplated by the present invention can achieve the following beneficial effects:
(1) because the invention firstly depends on the information amount M of the macro block during the watermark embedding processiScreening out a visual sensitive block which best represents the video texture characteristics, and then screening and obtaining a final macro block which represents the motion characteristics and is to be embedded with the watermark by using a video salient region detection method based on a compressed region, wherein the corresponding coordinates of the macro block are kept unchanged under different quantization step lengths, so that the macro block embedded with the watermark is not lost even after recompression treatment of different quantization step lengths, and the invention has good quantization resistance;
(2) the method can further improve the safety of the method by scrambling and encrypting the binary watermark information;
(3) because the method of the invention uses the motion vector and the quantized transformation residual coefficient, the method can be widely applied to videos with formats such as MPEG-4, H.264, H.265 and the like;
(4) because the watermark embedding and watermark extraction are processed in the compressed domain, and partial decoding operation is adopted, the complete decoding and reconstruction of the video are avoided, so that the processing efficiency of the system can be improved, and the real-time application is facilitated.
Drawings
FIG. 1 is a visually sensitive block resulting from steps (2-14) of the method of the present invention;
FIG. 2 is a graph of the moving object markers resulting from steps (2-15) of the method of the present invention;
FIG. 3 depicts a plurality of visually sensitive blocks after screening in step (2-15) of the method of the present invention;
FIG. 4 is a schematic diagram of binary watermark information obtained after encryption in step (1) of the method of the present invention;
fig. 5 is a scan sequence diagram of 4 × 4 sub-macroblocks;
FIG. 6 is a flow chart of the compressed domain video watermark embedding method based on visual sensitive blocks of the present invention;
FIG. 7 is a flowchart of the compressed domain video watermark extraction method based on visual sensitive blocks according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. In addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
As shown in fig. 6, the present invention provides a method for embedding a visual-sensitive-block-based compressed-domain video watermark, which includes the following steps:
(1) scrambling and encrypting the binary watermark sequence to obtain an encrypted binary watermark sequence (as shown in fig. 4);
specifically, the scrambling encryption method used in this step may be an Arnold transformation method, a Fibonacci transformation encryption algorithm, a Hilbert curve transformation encryption algorithm, an affine transformation encryption algorithm, or a magic square transformation encryption algorithm, etc.;
the binary watermark sequence referred to in this step is a 0, 1 sequence.
(2) The method comprises the steps of obtaining a visual sensitive block of the last frame in each Group of Pictures (GOP for short) of a video, and correcting the obtained visual sensitive block by using a video salient region detection method based on a compressed region to obtain a macro block to be embedded with a watermark;
specifically, the video salient region detection method based on the Compressed domain used in this step is Compressed-domain correlations of human eye salient regions in a dynamic scene.
The method specifically comprises the following substeps:
(2-1) acquiring a last frame in each GOP of the video;
(2-2) setting a counter i to 1, and initializing the number NNZ of non-zero Quantized transformed residual coefficients (QDCT) of the ith 16 × 16 macroblock in the last frameiAnd energy factor ENiAre all equal to 0;
(2-3) judging whether the counter i is larger than or equal to the total number of the macro blocks with the size of 16 x 16 in the last frame, if so, entering the step (2-14), and if not, entering the step (2-4);
specifically, the total number of macroblocks having a size of 16 × 16 is the size/(16 × 16) of the last frame.
(2-4) setting a counter j equal to 1;
(2-5) judging whether the counter j is more than or equal to 16, if so, entering the step (2-13), otherwise, entering the step (2-6);
the purpose of this step is to traverse 16 sub-macroblocks 4 × 4 included in each macroblock of size 16 × 16;
(2-6) setting a counter k equal to 1;
(2-7) judging whether the counter k is more than or equal to 16, if so, entering the step (2-11), and otherwise, entering the step (2-8);
the purpose of this step is to traverse 16 QDCTs included in each sub-macroblock of size 4 x 4;
(2-8) obtaining the kth QDCT in the jth 4 x 4 sub-macroblock in the ith 16 x 16 macroblockkJudging whether the value is not equal to 0, if not, entering the step (2-9), otherwise, entering the step (2-10);
(2-9) setting the number NNZ of non-zero in QDCTi＝NNZi+1, energy factor ENi＝ENi+|QDCTk|；
(2-10) setting a counter k ═ k +1, and returning to the step (2-7);
(2-11) setting a counter j ═ j +1, and returning to the step (2-5);
(2-12) setting a counter i ═ i +1, and returning to the step (2-3);
(2-13) number NNZ of non-zero values in QDCT according to i-th macroblock of size 16 x 16iAnd energy factor ENiCalculating the information quantity M of the i 16 th macroblocki，Mi＝Norm(NNZi+ENi+NNZi⊙ENi) wherein Norm () represents the normalization operation, a ⊙ B represents the multiplication of the corresponding bits of the matrices A and B, and returns to step (2-12);
(2-14) extracting the information amount M from all the 16 × 16 macro blocks of the last frameiAll macroblocks equal to 1 constitute a visually sensitive block (as shown in fig. 1);
(2-15) processing the last frame by using a video salient region detection method based on a compressed region, so as to obtain a motion target mark map (as shown in fig. 2) by using the motion vector of the last frame, and screening the plurality of visual sensitive blocks obtained in the step (2-14) according to the motion target mark map, so as to obtain a plurality of screened visual sensitive blocks (as shown in fig. 3) as a macro block to be embedded with a watermark;
specifically, the screening process in this step is to keep the visually sensitive blocks of the plurality of visually sensitive blocks obtained in steps (2-14) located in the moving target mark map, and delete the visually sensitive blocks located outside the moving target mark map.
(3) Embedding the binary watermark sequence encrypted in the step (1) into the macro block according to a first Alternating Current (AC) coefficient of a 4 × 4 sub-macro block positioned in the 1 st row and the 1 st column in the macro block to be embedded with the watermark obtained in the step (2) to obtain a video embedded with the watermark;
the method comprises the following substeps:
(3-1) setting a counter m to 1;
(3-2) judging whether the counter m is larger than the total Length of the binary watermark sequence encrypted in the step (1), if so, ending the process, otherwise, turning to the step (3-3);
(3-3) setting a counter n to 1;
(3-4) judging whether the counter n is larger than the total number of the macro blocks to be embedded with the watermark obtained in the step (2), if so, ending the process, otherwise, turning to the step (3-5);
(3-5) taking the nth macro block from the macro block to be embedded with the watermark obtained in the step (2), and judging the first AC coefficient AC of the sub macro block with the size of 4 x 4 in the 1 st row and the 1 st column in the nth macro block1Whether the value is greater than or equal to 0, if so, entering the step (3-6), otherwise, entering the step (3-9);
as shown in fig. 5, a scan order diagram of 4 × 4 sub-macroblocks is shown.
(3-6) judging whether the mth watermark value in the binary watermark sequence encrypted in the step (1) is equal to 1, if so, entering the step (3-7), otherwise, entering the step (3-8);
(3-7) setting the AC coefficient AC1＝AC1+1 and returning to step (3-2);
(3-8) setting the AC coefficient AC1＝-AC1+1 and returning to step (3-2);
(3-9) judging whether the mth watermark value in the binary watermark sequence encrypted in the step (1) is equal to 1, if so, entering the step (3-10), otherwise, entering the step (3-11);
(3-10) setting the AC coefficient AC1＝-AC11 and returning to the step (3-2);
(3-11) setting the AC coefficient AC1＝AC11 and returning to the step (3-2);
the process of the above steps (3-7), (3-8), (3-10) and (3-11) is to perform the watermark embedding operation on the macro block.
As shown in fig. 7, the present invention provides a method for extracting a video watermark in a compressed domain based on a visual sensitive block, which includes the following steps:
(1) the method comprises the steps of obtaining a visual sensitive block of the last frame in each GOP of a video after the watermark is embedded, and correcting the obtained visual sensitive block by using a video salient region detection method based on a compressed region to obtain a plurality of macro blocks of which the watermark is to be extracted;
specifically, this step is identical to the process of step (2) in the watermark embedding process, and is not described herein again.
The decoding method used in this step corresponds to the type of video, and if the video is in h.264 format, the corresponding decoding method is the h.264 decoding method.
(2) For the first macroblock to be watermarked obtained in step (1), determining a first AC coefficient AC of a 4 × 4 sub-macroblock located in row 1 and column 11Whether the value is greater than or equal to 0, if so, entering the step (3), otherwise, entering the step (4);
(3) setting the watermark value corresponding to the macro block in the binary watermark ciphertext as 1;
(4) setting the watermark value corresponding to the macro block in the binary watermark ciphertext as 0;
(5) for the residual macro blocks to be subjected to watermark extraction obtained in the step (1), repeating the steps (2) to (4) to obtain a complete binary watermark ciphertext;
(6) carrying out anti-scrambling decryption on the complete binary watermark ciphertext obtained in the step (5) to obtain a binary watermark sequence;
the descrambling decryption method used in this step is an inverse algorithm corresponding to the scrambling encryption method in step (1) in the above-mentioned watermark embedding process.
Results and analysis of the experiments
Firstly, the performance of binary watermark information obtained after the watermark extraction process is as follows:
TABLE 1
Figure BDA0002367157830000101
Table 1 above shows watermark Error rates (ER for short) under different quantization parameter compression, which are obtained by selecting three different sequences of video Stefan (Stefan), library (hall), and news (news), compressing and embedding a watermark for the first time when QP is 20, and recompressing and extracting a watermark when QP is 16,17,18,19,20,21,22, and 23, respectively, and determining robustness of a watermarking method in the prior art by recording Error rates of watermarks extracted from a video embedded with a watermark in each compression process.
Secondly, the video quality performance after embedding the watermark is as follows:
(1) peak noise signal ratio (PNSR for short)
TABLE 2
Figure BDA0002367157830000102
Table 2 above is the PSNR of the video with embedded watermark under different quantization parameter compression of the present invention. Table 2 shows that, by using the method of the present invention, the embedded watermark has little influence on the quality of the video, and is hardly noticeable to human eyes, and has robustness, and the present invention can better satisfy the requirements of practical applications.
(2) Structural similarity (Structural similarity index, SSIM for short)
TABLE 3
Figure BDA0002367157830000111
Table 3 above is the SSIM of the watermark embedded video under different quantization parameter compression of the present invention. Table 3 shows how the damage degree of the video image after being compressed by different QPs after the video is embedded with the watermark is determined by recording the SSIM value of the video frame in each compression process, taking three different video sequences of video stefin (Stefan), library (hall), and news (news) as an example. From the data in table 3, it can be seen that the video quality of the video embedded with the watermark by the method of the present invention is slowly damaged in the process of multiple compression, which can satisfy the protection of the video quality.
It will be understood by those skilled in the art that the foregoing is only a preferred embodiment of the present invention, and is not intended to limit the invention, and that any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (6)

1. A compressed domain video watermark embedding method based on a visual sensitive block is characterized by comprising the following steps:
(1) scrambling and encrypting the binary watermark sequence to obtain an encrypted binary watermark sequence;
(2) the method comprises the steps of obtaining a visual sensitive block of the last frame in each GOP of a video, and correcting the obtained visual sensitive block by using a video salient region detection method based on a compressed region to obtain a macro block to be embedded with a watermark;
(3) and (3) embedding the binary watermark sequence encrypted in the step (1) into the macro block according to the first alternating current coefficient of the 4 x 4 sub-macro block positioned in the 1 st row and the 1 st column in the macro block to be embedded with the watermark obtained in the step (2) so as to obtain the video embedded with the watermark.
2. The compressed domain video watermark embedding method of claim 1,
the scrambling encryption method used in the step (1) can be an Arnold transformation method, a Fibonacci transformation encryption algorithm, a Hilbert curve transformation encryption algorithm, an affine transformation encryption algorithm or a magic square transformation encryption algorithm;
the binary watermark sequence is a 0, 1 sequence.
3. The compressed domain video watermark embedding method of claim 1, wherein the step (2) comprises the following sub-steps:
(2-1) acquiring the last frame in each group of pictures (GOP) of the video;
(2-2) setting a counter i to 1, and initializing the number NNZ of non-zero quantized transform residual coefficients QDCT of the ith 16 × 16 macroblock in the last frameiAnd energy factor ENiAre all equal to 0;
(2-3) judging whether the counter i is larger than or equal to the total number of the macro blocks with the size of 16 x 16 in the last frame, if so, entering the step (2-14), and if not, entering the step (2-4);
(2-4) setting a counter j equal to 1;
(2-5) judging whether the counter j is more than or equal to 16, if so, entering the step (2-13), otherwise, entering the step (2-6);
(2-6) setting a counter k equal to 1;
(2-7) judging whether the counter k is more than or equal to 16, if so, entering the step (2-11), and otherwise, entering the step (2-8);
(2-8) obtaining the kth QDCT in the jth 4 x 4 sub-macroblock in the ith 16 x 16 macroblockkJudging whether the value is not equal to 0, if not, entering the step (2-9), otherwise, entering the step (2-10);
(2-9) setting the number NNZ of non-zero in QDCTi＝NNZi+1, energy factor ENi＝ENi+|QDCTk|；
(2-10) setting a counter k ═ k +1, and returning to the step (2-7);
(2-11) setting a counter j ═ j +1, and returning to the step (2-5);
(2-12) setting a counter i ═ i +1, and returning to the step (2-3);
(2-13) number NNZ of non-zero values in QDCT according to i-th macroblock of size 16 x 16iAnd energy factor ENiCalculating the information quantity M of the i 16 th macroblocki，Mi＝Norm(NNZi+ENi+NNZi⊙ENi) wherein Norm () represents a normalization operation, A | _ B represents the corresponding bits of matrices A and BMultiplying and returning to the step (2-12);
(2-14) extracting the information amount M from all the 16 × 16 macro blocks of the last frameiAll macroblocks equal to 1 constitute a visually sensitive block;
and (2-15) processing the last frame by using a video salient region detection method based on a compressed region to obtain a motion target mark map by using the motion vector of the last frame, and screening the plurality of visual sensitive blocks obtained in the step (2-14) according to the motion target mark map to obtain a plurality of screened visual sensitive blocks serving as the macro blocks to be embedded with the watermark.
4. The method for embedding a compressed domain video watermark according to claim 3, wherein the filtering process in step (2-15) is to keep the visually sensitive blocks of the plurality of visually sensitive blocks obtained in step (2-14) located in the moving object mark map and delete the visually sensitive blocks located outside the moving object mark map.
5. The compressed domain video watermark embedding method of claim 1, wherein the step (3) comprises the sub-steps of:
(3-1) setting a counter m to 1;
(3-2) judging whether the counter m is larger than the total length of the binary watermark sequence encrypted in the step (1), if so, ending the process, otherwise, turning to the step (3-3);
(3-3) setting a counter n to 1;
(3-4) judging whether the counter n is larger than the total number of the macro blocks to be embedded with the watermark obtained in the step (2), if so, ending the process, otherwise, turning to the step (3-5);
(3-5) taking the nth macro block from the macro block to be embedded with the watermark obtained in the step (2), and judging the first AC coefficient AC of the sub macro block with the size of 4 x 4 in the 1 st row and the 1 st column in the nth macro block1Whether the value is greater than or equal to 0, if so, entering the step (3-6), otherwise, entering the step (3-9);
(3-6) judging whether the mth watermark value in the binary watermark sequence encrypted in the step (1) is equal to 1, if so, entering the step (3-7), otherwise, entering the step (3-8);
(3-7) setting the AC coefficient AC1＝AC1+1 and returning to step (3-2);
(3-8) setting the AC coefficient AC1＝-AC1+1 and returning to step (3-2);
(3-9) judging whether the mth watermark value in the binary watermark sequence encrypted in the step (1) is equal to 1, if so, entering the step (3-10), otherwise, entering the step (3-11);
(3-10) setting the AC coefficient AC1＝-AC11 and returning to the step (3-2);
(3-11) setting the AC coefficient AC1＝AC1-1 and returning to step (3-2).
6. A compressed domain video watermark extraction method based on a visual sensitive block is characterized by comprising the following steps:
(1) acquiring a visual sensitive block of the last frame in each group of pictures (GOP) of the video with the embedded watermark, and correcting the acquired visual sensitive block by using a video salient region detection method based on a compressed region to obtain a plurality of macro blocks with the watermark to be extracted;
(2) for the first macroblock to be watermarked obtained in step (1), determining a first AC coefficient AC of a 4 × 4 sub-macroblock located in row 1 and column 11Whether the value is greater than or equal to 0, if so, entering the step (3), otherwise, entering the step (4);
(3) setting the watermark value corresponding to the macro block in the binary watermark ciphertext as 1;
(4) setting the watermark value corresponding to the macro block in the binary watermark ciphertext as 0;
(5) for the residual macro blocks to be subjected to watermark extraction obtained in the step (1), repeating the steps (2) to (4) to obtain a complete binary watermark ciphertext;
(6) and (5) carrying out anti-scrambling decryption on the complete binary watermark ciphertext obtained in the step (5) to obtain a binary watermark sequence.
CN202010039301.0A 2020-01-15 2020-01-15 Compressed domain video watermark embedding and extracting method based on visual sensitive block Active CN111182365B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010039301.0A CN111182365B (en) 2020-01-15 2020-01-15 Compressed domain video watermark embedding and extracting method based on visual sensitive block

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010039301.0A CN111182365B (en) 2020-01-15 2020-01-15 Compressed domain video watermark embedding and extracting method based on visual sensitive block

Publications (2)

Publication Number Publication Date
CN111182365A true CN111182365A (en) 2020-05-19
CN111182365B CN111182365B (en) 2020-10-27

Family

ID=70657936

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010039301.0A Active CN111182365B (en) 2020-01-15 2020-01-15 Compressed domain video watermark embedding and extracting method based on visual sensitive block

Country Status (1)

Country Link
CN (1) CN111182365B (en)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101064847A (en) * 2007-05-15 2007-10-31 浙江大学 Visible sensation characteristic based video watermark process
US7567721B2 (en) * 2002-01-22 2009-07-28 Digimarc Corporation Digital watermarking of low bit rate video
CN101527850A (en) * 2009-04-10 2009-09-09 北京航空航天大学 Video self-recovery watermark method based on motion estimation
CN101662686A (en) * 2009-09-07 2010-03-03 江南大学 DCT domain video watermark treatment method based on texture features
CN101990081A (en) * 2010-11-11 2011-03-23 宁波大学 Method for protecting copyright of virtual viewpoint image
CN102801977A (en) * 2012-08-07 2012-11-28 合肥极光科技股份有限公司 Method for embedding robust digital watermark in H.264 based on video complexity analysis
CN103152578A (en) * 2013-03-25 2013-06-12 中国传媒大学 H.264 video watermark embedding and extraction method based on mixed coding/decoding
CN104539965A (en) * 2015-01-12 2015-04-22 中国电子科技集团公司第三十八研究所 H.264/AVC compressed-domain video watermark embedding and extracting method
CN107613304A (en) * 2017-09-11 2018-01-19 西安电子科技大学 The hidden close transmission method of mobile terminal video stream based on Android platform
CN108366259A (en) * 2018-01-15 2018-08-03 华南理工大学 A kind of reversible steganography method of three coefficient of H.264/AVC video of high-fidelity
CN108521613A (en) * 2018-05-15 2018-09-11 中南民族大学 A kind of compressed domain video watermark insertion and extracting method based on moving target
CN109427032A (en) * 2018-09-17 2019-03-05 上海理工大学 A kind of telescopic video watermark insertion and extracting method based on compression domain

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7567721B2 (en) * 2002-01-22 2009-07-28 Digimarc Corporation Digital watermarking of low bit rate video
CN101064847A (en) * 2007-05-15 2007-10-31 浙江大学 Visible sensation characteristic based video watermark process
CN101527850A (en) * 2009-04-10 2009-09-09 北京航空航天大学 Video self-recovery watermark method based on motion estimation
CN101662686A (en) * 2009-09-07 2010-03-03 江南大学 DCT domain video watermark treatment method based on texture features
CN101990081A (en) * 2010-11-11 2011-03-23 宁波大学 Method for protecting copyright of virtual viewpoint image
CN102801977A (en) * 2012-08-07 2012-11-28 合肥极光科技股份有限公司 Method for embedding robust digital watermark in H.264 based on video complexity analysis
CN103152578A (en) * 2013-03-25 2013-06-12 中国传媒大学 H.264 video watermark embedding and extraction method based on mixed coding/decoding
CN104539965A (en) * 2015-01-12 2015-04-22 中国电子科技集团公司第三十八研究所 H.264/AVC compressed-domain video watermark embedding and extracting method
CN107613304A (en) * 2017-09-11 2018-01-19 西安电子科技大学 The hidden close transmission method of mobile terminal video stream based on Android platform
CN108366259A (en) * 2018-01-15 2018-08-03 华南理工大学 A kind of reversible steganography method of three coefficient of H.264/AVC video of high-fidelity
CN108521613A (en) * 2018-05-15 2018-09-11 中南民族大学 A kind of compressed domain video watermark insertion and extracting method based on moving target
CN109427032A (en) * 2018-09-17 2019-03-05 上海理工大学 A kind of telescopic video watermark insertion and extracting method based on compression domain

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
李淑芝: "H.264压缩域安全型视频水印算法", 《电视技术》 *
李聪颖等: "一种抗重压缩视频水印算法", 《数字技术与应用》 *

Also Published As

Publication number Publication date
CN111182365B (en) 2020-10-27

Similar Documents

Publication Publication Date Title
Hsu et al. DCT-based watermarking for video
Venugopala et al. Video watermarking by adjusting the pixel values and using scene change detection
Li et al. A 3D wavelet based spatial-temporal approach for video watermarking
Goel et al. An optimized un-compressed video watermarking scheme based on SVD and DWT
Luo et al. Fast and robust watermarking of JPEG files
Ma et al. A Video Watermarking DRM Method Based on H. 264 Compressed Domain with Low Bit‐Rate Increasement
Hussein et al. Robust video watermarking using multi-band wavelet transform
Das et al. An improved video key-frame extraction algorithm leads to video watermarking
Leelavathy et al. A scene based video watermarking in discrete multiwavelet domain
Barni et al. Object watermarking for for MPEG-4 video streams copyright protection
Khalili A novel secure, imperceptible and robust CDMA digital image watermarking in JPEG-YCbCr channel using DWT2
CN111182365B (en) Compressed domain video watermark embedding and extracting method based on visual sensitive block
Pickering et al. A novel blind video watermarking scheme for access control using complex wavelets
Zhang et al. A video watermarking algorithm of H. 264/AVC for content authentication
CN114598887A (en) Anti-recompression video watermarking method for controlling bit rate increase
Fallahpour et al. Flexible image watermarking in JPEG domain
Salman et al. Proposed copyright protection systems for 3D video based on key frames
El-Ghoneimy COMPARISON BETWEEN TWO WATERMARKING ALGORITHMS USING DCT COEFFICIENT, AND LSB REPLACEMENT.
Patil et al. Fragile video watermarking for tampering detection and localization
Sakib et al. A robust DWT-based compressed domain video watermarking technique
Bouchama et al. Reversible data hiding scheme for the H. 264/AVC codec
Tsai et al. Highly imperceptible video watermarking with the Watson's DCT-based visual model
Chen et al. A novel reversible semi-fragile watermarking algorithm of MPEG-4 video for content authentication
Li et al. Dst-based video watermarking robust to lossy channel compression
Yang et al. An adaptive video watermarking technique based on DCT domain

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant