CN114727112A - H.265/HEVC video self-adaptive information hiding method based on distortion compensation optimization - Google Patents

H.265/HEVC video self-adaptive information hiding method based on distortion compensation optimization Download PDF

Info

Publication number
CN114727112A
CN114727112A CN202210172234.9A CN202210172234A CN114727112A CN 114727112 A CN114727112 A CN 114727112A CN 202210172234 A CN202210172234 A CN 202210172234A CN 114727112 A CN114727112 A CN 114727112A
Authority
CN
China
Prior art keywords
qdst
coefficient
carrier
sequence
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210172234.9A
Other languages
Chinese (zh)
Other versions
CN114727112B (en
Inventor
王让定
杨璘
徐达文
董理
何松翰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ningbo University
Ningbo University of Technology
Original Assignee
Ningbo University
Ningbo University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ningbo University, Ningbo University of Technology filed Critical Ningbo University
Priority to CN202210172234.9A priority Critical patent/CN114727112B/en
Publication of CN114727112A publication Critical patent/CN114727112A/en
Application granted granted Critical
Publication of CN114727112B publication Critical patent/CN114727112B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • H04N19/467Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/91Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96Tree coding, e.g. quad-tree coding

Abstract

The invention discloses a distortion compensation optimization-based H.265/HEVC video adaptive information hiding method, wherein the hidden information embedding comprises three parts of carrier extraction, distortion cost value calculation and distortion compensation, proper carriers are extracted from QDST coefficients in 4 multiplied by 4 coding units in all stored I frames according to a threshold value, the distortion cost value of the carriers during simulation embedding is calculated, the adaptive hidden information embedding is realized by using an STC algorithm according to distortion cost values to realize a data hiding mode with the minimum total distortion cost, and distortion compensation is performed on coefficient groups corresponding to the carriers according to a difference value before and after steganography to eliminate intra-frame distortion drift caused by modulating the QDST coefficients; because the method comprehensively considers factors such as video picture quality, video block texture complexity, interframe distortion transmission, code stream and the like when calculating the distortion cost value, the video containing the secret code after the steganography by the method has better picture quality, lower code rate increase and higher safety.

Description

H.265/HEVC video self-adaptive information hiding method based on distortion compensation optimization
Technical Field
The invention relates to a video information hiding technology, in particular to an H.265/HEVC video self-adaptive information hiding method based on distortion compensation optimization.
Background
In the current society, intelligent devices have become more and more popular, and people can acquire various information contents through channels such as characters, audio, images or videos. However, at the same time, the phenomenon of tampering, counterfeiting or attack of the digital information is becoming more serious, and how to protect the information content of the digital media and prevent illegal use of the digital media has become a hot problem to be solved. Information hiding is a technology which hides secret information in a public transmission channel and cannot be perceived by visual sense and auditory sense of people, and is a powerful secret communication and copyright protection means. In the digital multimedia information hiding technology, an adaptive information hiding technology is an extremely important component, which can adaptively embed hidden information into a carrier according to a distortion function, and can minimize the embedded distortion through steganographic coding such as STC (space-time-Trellis Codes), thereby achieving excellent visual effect and high coding efficiency.
Because the data volume of digital Video is generally huge, the digital Video is generally transmitted in a compressed form in an open transmission channel, and HEVC (High Efficiency Video Coding) is a latest generation Video compression Coding standard, and the core objective of the digital Video is to double the compression Efficiency on the basis of h.264/AVC, and play an important role in the Video application fields of High definition, ultra High definition and the like. Therefore, the research on the adaptive information hiding technology of the H.265/HEVC video has great practical significance and theoretical value. Although there have been many studies on adaptive information hiding technology in the audio and video fields, these studies cannot be directly migrated into the video information hiding technology field due to the difference between video bearers and both audio and video, and therefore, it is necessary to study the characteristics of h.265/HEVC video and design a suitable and efficient adaptive distortion function for the video characteristics thereof to reduce the embedding distortion.
Disclosure of Invention
The invention aims to solve the technical problem of providing an H.265/HEVC video adaptive information hiding method based on distortion compensation optimization, which can well improve the video visual quality, has small influence on the modification of video code streams and has high safety.
The technical scheme adopted by the invention for solving the technical problems is as follows: a H.265/HEVC video self-adaptive information hiding method based on distortion compensation optimization comprises two parts of hidden information embedding and hidden information extraction; the method is characterized in that:
the specific process of embedding the secret information is as follows:
step 1_ 1: performing compression coding on an original video by adopting an H.265/HEVC standard encoder to obtain an H.265/HEVC video, and storing a prediction mode and a depth of each coding unit in each coding tree unit in each frame of the H.265/HEVC video, a PU partition mode corresponding to each coding unit and a QDST coefficient of each pixel point in each coding unit in a compression coding process; wherein the size of the coding tree unit is 64 × 64, and the size of the coding unit is 64 × 64, 32 × 32, 16 × 16, 8 × 8 or 4 × 4;
step 1_ 2: traversing all frames in the H.265/HEVC video in sequence, and defining the currently traversed frame as a current frame;
step 1_ 3: judging whether the current frame is an I frame, if so, executing the step 1_ 4; if the current frame is not an I frame, directly executing the step 1_ 8;
step 1_ 4: sequentially traversing all coding units with the size of 4 multiplied by 4 in the current frame, and defining the currently traversed coding unit with the size of 4 multiplied by 4 as a current unit;
step 1_ 5: classifying the current unit into a first type candidate block, a second type candidate block or a third type candidate block, or not processing the current unit, the specific process is as follows:
if the current unit has only the adjacent lower-left coding unit with the size of 4 × 4 and the numerical identifier of the prediction mode of the lower-left coding unit is within the interval [2,26], and the adjacent lower-right coding unit with the size of 4 × 4 and the numerical identifier of the prediction mode of the lower-right coding unit is within the interval [2,10], classifying the current unit as a first class candidate block, and then performing step 1_ 6;
classifying the current unit into a second class of candidate blocks if the current unit has only an adjacent upper-right coding unit of size 4 × 4 and the numerical identifier of the prediction mode of the upper-right coding unit is within the interval [10,34] or 1, and an adjacent right-left coding unit of size 4 × 4 and the numerical identifier of the prediction mode of the right-left coding unit is within the interval [26,34], and then performing step 1_ 6;
if the current unit has an adjacent lower-left coding unit of size 4 × 4 and the number of prediction mode of the lower-left coding unit is identified within the interval [2,26], and has an adjacent lower-right coding unit of size 4 × 4 and the number of prediction mode of the lower-right coding unit is identified within the interval [2,10], and has an adjacent upper-right coding unit of size 4 × 4 and the number of prediction mode of the upper-right coding unit is identified within the interval [10,34] or is 1, and has an adjacent right-right coding unit of size 4 × 4 and the number of prediction mode of the right-right coding unit is identified within the interval [26,34], and has an adjacent lower-right coding unit of size 4 × 4 and the number of prediction mode of the lower-right coding unit is identified within the interval [26,34] or within the interval [2,10] or is 0 or is 1, classifying the current unit into a third class candidate block and then executing the step 1_ 6;
for the rest cases, the current unit is not processed, and then the step 1_7 is directly executed;
the above-described lower-left coding unit is a coding unit of size 4 × 4 located at the lower left of the current unit, the lower-right coding unit is a coding unit of size 4 × 4 located directly below the current unit, the upper-right coding unit is a coding unit of size 4 × 4 located at the upper right of the current unit, the right-left coding unit is a coding unit of size 4 × 4 located directly right of the current unit, and the lower-right coding unit is a coding unit of size 4 × 4 located at the lower right of the current unit;
step 1_ 6: selecting carriers from QDST coefficients of all pixel points in the current unit, if the current unit is a first-class candidate block, selecting QDST coefficients with absolute values larger than or equal to a set threshold th from 4 QDST coefficients of the 1 st column of pixel points of the current unit as carriers, classifying the carriers into first-class carriers, and then executing the step 1_ 7; if the current unit is a second-class candidate block, selecting QDST coefficients with absolute values larger than or equal to a set threshold th from 4 QDST coefficients of the 1 st line of pixel points of the current unit as carriers, classifying the carriers into second-class carriers, and then executing the step 1_ 7; if the current unit is a third-class candidate block, selecting QDST coefficients with absolute values larger than or equal to a set threshold th from 16 QDST coefficients of all pixel points of the current unit as carriers, classifying the carriers into third-class carriers, and then executing step 1_ 7; wherein th ∈ (0,10 ];
step 1_ 7: traversing the next coding unit with the size of 4 × 4 in the current frame to serve as the current unit, then returning to the step 1_5 to continue executing until all coding units with the size of 4 × 4 in the current frame are completely traversed, and then executing the step 1_ 8;
step 1_ 8: traversing the next frame in the H.265/HEVC video to be used as a current frame, and then returning to the step 1_3 to continue executing until all frames in the H.265/HEVC video are completely traversed;
step 1_ 9: arranging all carriers classified as first-class carriers, namely QDST coefficients according to the sequence of index positions of corresponding pixel points in the H.265/HEVC video to form a first-class carrier sequence; similarly, all carriers classified as the second type of carriers, namely QDST coefficients, are arranged according to the sequence of the index positions of the corresponding pixel points in the H.265/HEVC video to form a second type of carrier sequence; arranging all carriers classified as third-class carriers, namely QDST coefficients according to the sequence of index positions of corresponding pixel points in the H.265/HEVC video to form a third-class carrier sequence;
step 1_ 10: calculating distortion cost values when each carrier in the first type carrier sequence, the second type carrier sequence and the third type carrier sequence simulates and embeds +1 or 0 or-1, setting the QDST coefficient of a pixel point with a coordinate position (i, j) in the nth coding tree unit in the mth frame of the H.265/HEVC video as any carrier, and recording the distortion cost values of the carriers as rhom,n(i,j),
Figure BDA0003517831070000041
Wherein, M is more than or equal to 1 and less than or equal to M, M represents the total frame number of frames contained in the H.265/HEVC video, N is more than or equal to 1 and less than or equal to N, N represents the total number of coding tree units contained in the mth frame in the H.265/HEVC video, (i, j) represents the coordinate position in the coding tree unit, i is more than or equal to 1 and less than or equal to 64, j is more than or equal to 1 and less than or equal to 64,
Figure BDA0003517831070000042
representing the intra-block distortion cost value of a QDST coefficient of a pixel point with a coordinate position (i, j) in the nth coding tree unit in the mth frame of the modified H.265/HEVC video, wherein alpha represents the inter-frame distortion transfer rate, GOPSize represents the length of a GOP (group of pictures) in the H.265/HEVC video, the value of the GOPSize is 4 or 16 or 32, and QstepRepresenting the quantization step size, Cp, of H.265/HEVC videom,n(i, j) represents the texture complexity of a coding unit with the size of 4 x 4 where the QDST coefficient of the pixel point with the coordinate position (i, j) in the nth coding tree unit in the mth frame in the H.265/HEVC video is located, and taum,n(i, j) represents the coefficient group cost value of modifying the QDST coefficient of the pixel point with the coordinate position (i, j) in the nth coding tree unit in the mth frame in the H.265/HEVC video, and k1、k2、k3All are proportionality coefficients;
step 1_ 11: randomly generating three different binary secret information sequences by using the same embedded load rate payload, and correspondingly marking the sequences as X1、X2、X3(ii) a Then X is simulated to be embedded into +1 or 0 or-1 according to all carriers in the first type carrier sequence according to the distortion cost value1Embedding the vector sequences into all vectors in a first type of vector sequences to obtain a first type of dense vector sequences; similarly, X is embedded using STC toolkit according to distortion cost value of embedding +1 or 0 or-1 of all carriers in the second type carrier sequence2Embedding the vector sequences into all vectors in a second type of vector sequences to obtain a second type of dense vector sequences; simulating X's with STC toolkit according to distortion cost value of embedding +1 or 0 or-1 by all carriers in the third type carrier sequence3Embedding the third type of dense vector sequences into all vectors in the third type of vector sequences to obtain third type of dense vector sequences; wherein, payload belongs to (0, 0.5)],X1Has a length of Num1×payload,X2Is Num2×payload,X3Has a length of Num3×payload,Num1Denotes the total number of vectors in the first type of vector sequence, Num2Indicates the total number of vectors in the second type of vector sequence, Num3Representing the total number of vectors in the third type of vector sequence;
step 1_ 12: carrying out distortion compensation optimization according to the first type of dense carrier sequence, the second type of dense carrier sequence and the second type of carrier sequence, wherein the specific process is as follows:
step 1_12 a: calculating the difference between each secret carrier in the first type of secret carrier sequences and the corresponding carrier in the first type of carrier sequences to obtain a first difference sequence; similarly, calculating the difference value between each dense carrier in the second type of dense carrier sequences and the corresponding carrier in the second type of carrier sequences to obtain a second difference value sequence; wherein, the difference value in the first difference value sequence is the value obtained by subtracting the corresponding carrier in the first type of carrier sequence from the dense carrier in the first type of dense carrier sequence, the difference value in the second difference value sequence is the value obtained by subtracting the corresponding carrier in the second type of carrier sequence from the dense carrier in the second type of dense carrier sequence, and each difference value in the first difference value sequence and the second difference value sequence is 0 or +1 or-1;
step 1_12 b: aiming at any difference value in the first difference value sequence and the second difference value sequence, if the difference value is +1, when the difference value belongs to the first difference value sequence, subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +2 in the H.265/HEVC video, and adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +3 to realize the distortion compensation optimization of the two QDST coefficients; when the difference value belongs to a second difference value sequence, subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +8 in the H.265/HEVC video, and adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +12 to realize the distortion compensation optimization of the two QDST coefficients;
if the difference is-1, when the difference belongs to a first difference sequence, adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +2 in the H.265/HEVC video, and subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +3 to realize the distortion compensation optimization of the two QDST coefficients; when the difference value belongs to a second difference value sequence, adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +8 in the H.265/HEVC video, and subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +12 to realize the distortion compensation optimization of the two QDST coefficients;
if the difference is 0, no matter whether the difference belongs to the first difference sequence or the second difference sequence, distortion compensation optimization is not performed on the QDST coefficient of any pixel point in the H.265/HEVC video;
pos represents the index position of a pixel point corresponding to the difference in the H.265/HEVC video;
step 1_ 13: carrying out compression coding on an original video by adopting an H.265/HEVC standard encoder, replacing an original QDST coefficient at a corresponding position with a QDST coefficient optimized by distortion compensation in the conversion quantization process of the compression coding, and carrying out compression coding to obtain a dense video code stream;
the specific process of extracting the secret information comprises the following steps:
step 2_ 1: decoding the code stream of the video with the density by adopting an H.265/HEVC standard decoder to obtain a decoded video, and storing the prediction mode and the depth of each coding unit in each coding tree unit in each frame of the decoded video, the PU partition mode corresponding to each coding unit and the QDST coefficient of each pixel point in each coding unit in the decoding process;
step 2_ 2: according to the process from the step 1_2 to the step 1_9, a first carrier sequence, a second carrier sequence and a second carrier sequence corresponding to the decoded video are obtained in the same way;
step 2_ 3: decoding the first type of carrier sequence obtained in the step 2_2 by using an STC (space time coding) tool kit, and extracting to obtain first secret information; similarly, decoding the second type of carrier sequence obtained in the step 2_2 by using an STC toolkit, and extracting to obtain second secret information; and decoding the third type carrier sequence obtained in the step 2_2 by using an STC toolkit, and extracting to obtain third secret information.
In the step 1_6, th is 1.
In the step 1_10, the value of alpha is 0.6, and k is1The value is 4, k2A value of 1, k3The value is 1.
In the step 1-10, the first step,
Figure BDA0003517831070000061
is equal to the sum of the absolute values of all elements in the distortion matrix E of the coding unit with the size of 4 × 4 where the QDST coefficient is caused by modifying the QDST coefficient of the pixel with the coordinate position (i, j) in the nth coding tree unit in the mth frame in the h.265/HEVC video, where E is HT·Δ·Qstep·26-shiftH, where the symbol "·" is a dot product operation symbol, H denotes a DST transform matrix in the HEVC coding standard, HTIs the transpose of H, Δ represents the modification matrix when the carrier model is embedded, dimension of Δ is 4 × 4, shift represents the scaling coefficient of the DST transform process in the HEVC coding standard,
Figure BDA0003517831070000071
floor () is a rounding-down function, QP represents a quantization parameter of h.265/HEVC video, and IT _ Shift represents a scaling coefficient of the DST inverse transform process in the HEVC coding standard.
In the step 1_10, Cpm,n(i,j)=<P,|QDSTm,n|>Wherein P represents a matrix obtained from statistical randomness analysis of QDST coefficients of all pixels in a coding unit of size 4 x 4,
Figure BDA0003517831070000072
QDSTm,na coefficient matrix formed by QDST coefficients of all pixels in a coding unit with the size of 4 multiplied by 4 and representing the QDST coefficient of a pixel with the coordinate position (i, j) in the nth coding tree unit in the mth frame of the H.265/HEVC videom,nOf dimension 4 × 4, symbol "< >"is an inner product operation symbol, and the symbol" | "is an absolute value symbol.
In the step 1-10, the first step,
Figure BDA0003517831070000073
wherein INF represents a positive infinite value, SCG represents a sum of absolute values of all QDST coefficients in a coefficient group corresponding to a QDST coefficient of a pixel having a coordinate position (i, j) in an mth frame in an h.265/HEVC video, constant is a small constant for preventing DNNZC from being zero, flag represents whether a position of a last non-zero QDST coefficient in a coding unit having a size of 4 × 4 in which a coefficient group corresponding to a QDST coefficient of a pixel having a coordinate position (i, j) is located in an nth coding tree unit in an mth frame in an h.265/HEVC video before and after carrier simulation embedding changes, if the position of the last non-zero QDST coefficient changes, flag is 1 if the position of the last non-zero QDST coefficient changes, flag is 0 if the position of the last non-zero QDST coefficient changes, DNNZC represents a size difference of 4 QDST coefficients in a coefficient group corresponding to a QDST coefficient of a pixel having a coordinate position (i, j) in an nth coding tree unit in an mth frame in an h.265/HEVC video before and after carrier simulation embedding, setting the index position of the pixel point corresponding to the carrier in the H.265/HEVC video as pos, then: when the carrier belongs to a first-class carrier sequence, a coefficient group corresponding to a QDST coefficient of a pixel point with a coordinate position (i, j) in an nth coding tree unit in an mth frame in an H.265/HEVC video is (QDST)pos,qdstpos+2,qdstpos+3) When the carrier belongs to a second type of carrier sequence, a coefficient group corresponding to a QDST coefficient of a pixel point with a coordinate position (i, j) in an nth coding tree unit in an mth frame in an H.265/HEVC video is (QDST)pos,qdstpos+8,qdstpos+12) When the carrier belongs to a third type carrier sequence, the carrier belongs to the nth coding tree in the mth frame of the H.265/HEVC videoThe coefficient group corresponding to the QDST coefficient of the pixel point with the coordinate position (i, j) in the unit is (QDST)pos),qdstposRepresents the QDST coefficient, QDST of the pixel point with coordinate position (i, j) in the nth coding tree unit in the mth frame of the carrier, namely H.265/HEVC videopos+2QDST coefficient, QDST, of pixel point with index position pos +2 in H.265/HEVC videopos+3QDST coefficient, QDST, of pixel point with index position pos +3 in H.265/HEVC videopos+8QDST coefficient, QDST, of pixel point with index position pos +8 in H.265/HEVC videopos+12And the QDST coefficient represents the pixel point with the index position of pos +12 in the H.265/HEVC video.
Compared with the prior art, the invention has the advantages that:
1) the method designs a self-adaptive distortion cost value calculation function by analyzing factors such as in-block distortion, inter-frame distortion influence, block texture complexity, coefficient group cost and the like, and performs self-adaptive data hiding on the QDST coefficient by using an STC algorithm, so that the quality of a video picture after steganography can be effectively improved.
2) The method comprehensively considers the entropy coding process of video coding during modification, and reduces the influence of the modified QDST coefficient on entropy coding by analyzing the position change of the last non-zero coefficient of the coefficient in the block before and after modification, the sum of absolute values of the coefficient, non-zero coefficient change of the coefficient and other factors, thereby reducing the increase of video code rate and improving the steganography safety.
3) The method can ensure that the covert information is effectively extracted, and the steganography process and the extraction process are combined with the HEVC video compression process, so that the method can be applied to real-time communication in real life.
Drawings
FIG. 1 is a block diagram of an overall implementation of the method of the present invention;
FIG. 2a is a schematic diagram illustrating the determination of a first type of candidate block;
FIG. 2b is a schematic diagram illustrating the determination of a second type of candidate block;
FIG. 2c is a schematic diagram illustrating the determination of a third type of candidate block;
FIG. 3 shows a result of a dense video obtained by data hiding of an original video using a DCO method and a dense video obtained by data hiding of an original video using a method according to the present invention on a BIR;
fig. 4 shows the results of the steganography analysis error rate detection of the dense video obtained by using the DCO method to perform data hiding on the original video and the dense video obtained by using the method to perform data hiding on the original video.
Detailed Description
The invention is described in further detail below with reference to the accompanying examples.
The general implementation block diagram of the H.265/HEVC video adaptive information hiding method based on distortion compensation optimization, which is provided by the invention, is shown in fig. 1 and comprises two parts, namely hidden information embedding and hidden information extraction.
The specific process of embedding the secret information is as follows:
step 1_ 1: performing compression Coding on an original video by using an H.265/HEVC standard encoder to obtain an H.265/HEVC video, and storing a prediction mode and a depth of each Coding Unit (CU) in each Coding Tree Unit (CTU, Coding Tree Unit) in each frame of the H.265/HEVC video, a PU (prediction Unit) partition mode corresponding to each Coding Unit, and a QDST (Quantized Discrete Sine Transform) coefficient of each pixel point in each Coding Unit in a compression Coding process; wherein the size of the coding tree unit is 64 × 64, and the size of the coding unit is 64 × 64, 32 × 32, 16 × 16, 8 × 8, or 4 × 4.
Step 1_ 2: traversing all frames in the H.265/HEVC video in sequence, and defining the currently traversed frame as a current frame.
Step 1_ 3: judging whether the current frame is an I frame, if so, executing the step 1_ 4; if the current frame is not an I frame, step 1_8 is directly performed.
Step 1_ 4: and traversing all coding units with the size of 4 × 4 in the current frame in sequence, and defining the currently traversed coding unit with the size of 4 × 4 as the current unit.
Step 1_ 5: classifying the current unit into a first type candidate block, a second type candidate block or a third type candidate block, or not processing the current unit, the specific process is as follows:
as shown in fig. 2a, if the current unit has only the neighboring lower-left coding unit with the size of 4 × 4 and the number of prediction modes of the lower-left coding unit is identified within the interval [2,26], and the neighboring right lower coding unit with the size of 4 × 4 and the number of prediction modes of the right lower coding unit is identified within the interval [2,10], the current unit is classified as a candidate block of the first class, and then step 1_6 is performed.
As shown in fig. 2b, if the current unit has only the adjacent upper-right coding unit of size 4 × 4 and the numerical flag of the prediction mode of the upper-right coding unit is within the interval [10,34] or 1, and the adjacent right coding unit of size 4 × 4 and the numerical flag of the prediction mode of the right coding unit are within the interval [26,34], the current unit is classified as a second class candidate block, and then step 1_6 is performed.
As shown in fig. 2c, if there are adjacent lower-left coding units of size 4 × 4 and the number of prediction modes of the lower-left coding unit in the current unit is identified in the interval [2,26], there are adjacent lower-right coding units of size 4 × 4 and the number of prediction modes of the lower-right coding units is identified in the interval [2,10], there are adjacent upper-right coding units of size 4 × 4 and the number of prediction modes of the upper-right coding units is identified in the interval [10,34] or is 1, there are adjacent right coding units of size 4 × 4 and the number of prediction modes of the right coding units is identified in the interval [26,34], there are adjacent lower-right coding units of size 4 × 4 and the number of prediction modes of the lower-right coding units is identified in the interval [26,34] or in the interval [2,10 is either 0 or 1, the current unit is classified as a third class candidate block and step 1_6 is performed.
For the rest of the cases, no processing is done on the current cell, and then step 1_7 is performed directly.
The lower-left coding unit is a coding unit of 4 × 4 size located at the lower left of the current unit, the lower-right coding unit is a coding unit of 4 × 4 size located at the lower right of the current unit, the upper-right coding unit is a coding unit of 4 × 4 size located at the upper right of the current unit, the right-left coding unit is a coding unit of 4 × 4 size located at the right of the current unit, the lower-right coding unit is a coding unit of 4 × 4 size located at the lower right of the current unit, the lower-left coding unit is located at the right of the lower-right coding unit, the upper-right coding unit is located at the upper right of the right-right coding unit, and the lower-right coding unit is located at the right below the right-right coding unit.
Step 1_ 6: selecting carriers from QDST coefficients of all pixel points in the current unit, if the current unit is a first-class candidate block, selecting QDST coefficients with absolute values larger than or equal to a set threshold th from 4 QDST coefficients of 1 st row of pixel points (namely 4 pixel points with coordinate positions of (1,1), (2,1), (3,1) and (4, 1)) of the current unit as carriers, classifying the carriers into first-class carriers, and then executing the step 1_ 7; if the current unit is a second-class candidate block, selecting QDST coefficients with absolute values larger than or equal to a set threshold th from 4 QDST coefficients of 1 st line of pixel points of the current unit (namely 4 pixel points with coordinate positions of (1,1), (1,2), (1,3) and (1,4) in the current unit) as carriers, classifying the carriers into second-class carriers, and then executing step 1_ 7; if the current unit is a third-class candidate block, selecting QDST coefficients with absolute values larger than or equal to a set threshold th from 16 QDST coefficients of all pixel points of the current unit as carriers, classifying the carriers into third-class carriers, and then executing step 1_ 7; wherein th e (0, 10), if the value of th is too large, the carrier will be less, the embedding capacity will be less, if the value of th is 0, the distortion will be large, and it is not recommended to choose, in this embodiment, the embedding capacity and the distortion are considered in a trade-off, and the value of th is chosen to be 1.
Step 1_ 7: and traversing the next coding unit with the size of 4 × 4 in the current frame to serve as the current unit, then returning to the step 1_5 to continue executing until all the coding units with the size of 4 × 4 in the current frame are completely traversed, and then executing the step 1_ 8.
Step 1_ 8: and traversing the next frame in the H.265/HEVC video to be used as the current frame, and then returning to the step 1_3 to continue executing until all frames in the H.265/HEVC video are completely traversed.
Step 1_ 9: arranging all carriers classified as first-class carriers, namely QDST coefficients according to the sequence of index positions of corresponding pixel points in the H.265/HEVC video to form a first-class carrier sequence; similarly, all carriers classified as the second type of carriers, namely QDST coefficients, are arranged according to the sequence of the index positions of the corresponding pixel points in the H.265/HEVC video to form a second type of carrier sequence; and arranging all carriers classified as the third type of carriers, namely QDST coefficients according to the sequence of the index positions of the corresponding pixel points in the H.265/HEVC video to form a third type of carrier sequence.
Step 1_ 10: calculating distortion cost values when each carrier in the first type carrier sequence, the second type carrier sequence and the third type carrier sequence simulates and embeds +1 or 0 or-1, setting the QDST coefficient of a pixel point with a coordinate position (i, j) in the nth coding tree unit in the mth frame of the H.265/HEVC video as any carrier, and recording the distortion cost values of the carriers as rhom,n(i,j),
Figure BDA0003517831070000111
Wherein M is more than or equal to 1 and less than or equal to M, M represents the total frame number of frames contained in the H.265/HEVC video, N is more than or equal to 1 and less than or equal to N, N represents the total number of coding tree units contained in the mth frame in the H.265/HEVC video, (i, j) represents the coordinate position in the coding tree unit, i is more than or equal to 1 and less than or equal to 64, j is more than or equal to 1 and less than or equal to 64,
Figure BDA0003517831070000121
representing the intra-block distortion cost value of a QDST coefficient of a pixel point with a coordinate position (i, j) in the nth coding tree unit in the mth frame in the H.265/HEVC video, wherein alpha represents the inter-frame distortion transfer rate, the value of alpha is 0.6 in the embodiment, GOPSize represents the length of a GOP (group of pictures) in the H.265/HEVC video, the value of GOPSize is 4, 16 or 32, the value of GOPSize takes 4 in the embodiment, and Q is QstepRepresenting quantization steps of H.265/HEVC videoLong, Cpm,n(i, j) represents the texture complexity of a coding unit with the size of 4 x 4 where the QDST coefficient of the pixel point with the coordinate position (i, j) in the nth coding tree unit in the mth frame in the H.265/HEVC video is located, and taum,n(i, j) represents the coefficient group cost value of modifying the QDST coefficient of the pixel point with the coordinate position (i, j) in the nth coding tree unit in the mth frame in the H.265/HEVC video, and k1、k2、k3Are all proportionality coefficients, in this example k is taken1=4、k2=1、k3The value of alpha is found to be 0.6 and k is found by experiments as 11=4、k2=1、k3When the video embedding effect is 1, the video embedding effect is better.
Step 1_ 11: randomly generating three different binary secret information sequences by using the same embedded load rate payload, and correspondingly marking the sequences as X1、X2、X3(ii) a Then, according to the distortion cost value when all carriers in the first type of carrier sequences are simulated to be embedded into +1 or 0 or-1, utilizing an STC (space time-Trellis Codes) toolkit to convert X into X1Embedding the vector sequences into all vectors in a first type of vector sequences to obtain a first type of dense vector sequences; similarly, X is embedded using STC toolkit according to distortion cost value of embedding +1 or 0 or-1 of all carriers in the second type carrier sequence2Embedding the vector sequences into all vectors in a second type of vector sequences to obtain a second type of dense vector sequences; simulating X's with STC toolkit according to distortion cost value of embedding +1 or 0 or-1 by all carriers in the third type carrier sequence3Embedding the third type of dense vector sequences into all vectors in the third type of vector sequences to obtain third type of dense vector sequences; wherein, payload belongs to (0, 0.5)]In this embodiment, payload takes 0.4, X1Has a length of Num1×payload,X2Has a length of Num2×payload,X3Has a length of Num3×payload,Num1Denotes the total number of vectors in the first type of vector sequence, Num2Indicates the total number of vectors in the second type of vector sequence, Num3Indicates the total number of vectors in the third type of vector sequence.
Step 1_ 12: carrying out distortion compensation optimization according to the first type of dense carrier sequence, the second type of dense carrier sequence and the second type of carrier sequence, wherein the specific process is as follows:
step 1_12 a: calculating the difference between each secret carrier in the first type of secret carrier sequence and the corresponding carrier in the first type of carrier sequence to obtain a first difference sequence; similarly, calculating the difference value between each dense carrier in the second type of dense carrier sequences and the corresponding carrier in the second type of carrier sequences to obtain a second difference value sequence; wherein, the difference value in the first difference value sequence is the value obtained by subtracting the corresponding carrier in the first type of carrier sequence from the dense carrier in the first type of dense carrier sequence, the difference value in the second difference value sequence is the value obtained by subtracting the corresponding carrier in the second type of carrier sequence from the dense carrier in the second type of dense carrier sequence, and each difference value in the first difference value sequence and the second difference value sequence is 0 or +1 or-1.
Step 1_12 b: aiming at any difference value in the first difference value sequence and the second difference value sequence, if the difference value is +1, when the difference value belongs to the first difference value sequence, subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +2 in the H.265/HEVC video, and adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +3 to realize the distortion compensation optimization of the two QDST coefficients; when the difference value belongs to a second difference value sequence, subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +8 in the H.265/HEVC video, and adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +12 to realize the distortion compensation optimization of the two QDST coefficients.
If the difference is-1, when the difference belongs to a first difference sequence, adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +2 in the H.265/HEVC video, and subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +3 to realize the distortion compensation optimization of the two QDST coefficients; and when the difference belongs to a second difference sequence, adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +8 and subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +12 in the H.265/HEVC video to realize the distortion compensation optimization of the two QDST coefficients.
If the difference is 0, no matter whether the difference belongs to the first difference sequence or the second difference sequence, distortion compensation optimization is not performed on the QDST coefficient of any pixel point in the h.265/HEVC video.
And pos represents the index position of the pixel point corresponding to the difference value in the H.265/HEVC video.
For example: the QDST coefficient of the pixel point with the index position being pos in the H.265/HEVC video, the QDST coefficient of the pixel point with the index position being pos +2 and the QDST coefficient of the pixel point with the index position being pos +3 correspond to 5, 6 and 7 respectively, the QDST coefficient of the pixel point with the index position being pos in the H.265/HEVC video belongs to a first-class carrier sequence, the QDST coefficient obtained after the QDST coefficient of the pixel point with the index position being pos in the H.265/HEVC video is embedded with the secret information is 6, namely a secret carrier is contained, and the obtained difference is +1, so that the QDST coefficient of the pixel point with the index position being pos +2 in the H.265/HEVC video and the QDST coefficient obtained after distortion compensation optimization through distortion compensation optimization correspond to 5 and 8. I.e. the coefficient set at pos before steganography is (5, 6, 7), and the coefficient set at pos after optimization of steganography and distortion compensation is (6, 5, 8).
Step 1_ 13: and performing compression coding on the original video by adopting an H.265/HEVC standard encoder, replacing the original QDST coefficient at the corresponding position with the QDST coefficient optimized by distortion compensation in the conversion and quantization process of the compression coding, and performing compression coding to obtain a dense video code stream.
The specific process of extracting the secret information comprises the following steps:
step 2_ 1: decoding the code stream of the video with the density by adopting an H.265/HEVC standard decoder to obtain a decoded video, and storing the prediction mode and the depth of each coding unit in each coding tree unit in each frame of the decoded video, the PU partition mode corresponding to each coding unit and the QDST coefficient of each pixel point in each coding unit in the decoding process.
Step 2_ 2: and according to the process from the step 1_2 to the step 1_9, obtaining a first carrier sequence, a second carrier sequence and a second carrier sequence corresponding to the decoded video in the same way.
Step 2_ 3: decoding the first type of carrier sequence obtained in the step 2_2 by using an STC (Serial time coding) toolkit, and extracting to obtain first secret information; similarly, decoding the second type of carrier sequence obtained in the step 2_2 by using an STC toolkit, and extracting to obtain second secret information; and (3) decoding the third type of carrier sequence obtained in the step (2 _ 2) by using an STC tool kit, and extracting to obtain third secret information.
In this embodiment, in step 1_10,
Figure BDA0003517831070000141
is equal to the sum of the absolute values of all elements in the distortion matrix E of the coding unit with the size of 4 × 4 where the QDST coefficient is caused by modifying the QDST coefficient of the pixel with the coordinate position (i, j) in the nth coding tree unit in the mth frame in the h.265/HEVC video, where E is HT·Δ·Qstep·26 -shiftH, where the symbol "·" is a dot product operation symbol, H denotes a DST transform matrix in the HEVC coding standard,
Figure BDA0003517831070000142
HTthe vector is the transposition of H, delta represents a modification matrix when a carrier is embedded in a simulation mode, the dimension of delta is 4 multiplied by 4, delta is given in the HEVC coding process, delta is actually determined by the modification quantity when the carrier is embedded in a simulation mode, namely +1 or 0 or-1, if the modification quantity of the carrier (when the index position of a pixel corresponding to the carrier is pos) is t, when the carrier belongs to a first-class carrier sequence, the compensation modification quantity of the QDST coefficient of the pixel with the index position of pos +2 and the QDST coefficient of the pixel with the index position of pos +3 is-t,
Figure BDA0003517831070000151
when the carrier belongs to the second type carrier sequence, the compensation modification quantity of the QDST coefficient of the pixel point with the index position of pos +8 and the QDST coefficient of the pixel point with the index position of pos +12 is t,
Figure BDA0003517831070000152
when the vector belongs to the third class of vector sequences,
Figure BDA0003517831070000153
the value of t is1 or-1 or 0, shift denotes the scaling factor of the DST transform process in the HEVC coding standard,
Figure BDA0003517831070000154
floor () is a rounding-down function, QP represents a quantization parameter of h.265/HEVC video, and IT _ Shift represents a scaling coefficient of the DST inverse transform process in the HEVC coding standard.
In this embodiment, in step 1_10, Cpm,n(i,j)=<P,|QDSTm,n|>Wherein P represents a matrix obtained by statistical randomness analysis of QDST coefficients of all pixels in a coding unit with the size of 4 x 4, and is used for representing the maximum distribution statistical characteristics,
Figure BDA0003517831070000155
QDSTm,na coefficient matrix formed by QDST coefficients of all pixels in a coding unit with the size of 4 multiplied by 4 and representing the QDST coefficient of a pixel with the coordinate position (i, j) in the nth coding tree unit in the mth frame of the H.265/HEVC videom,nOf dimension 4 × 4, symbol "< >"is an inner product operation symbol, and the symbol" | "is an absolute value symbol.
In this embodiment, in step 1_10,
Figure BDA0003517831070000156
wherein INF represents a positive infinite value, SCG represents a sum of absolute values of all QDST coefficients in a coefficient group corresponding to a QDST coefficient of a pixel having a coordinate position (i, j) in an mth frame in an h.265/HEVC video, constant is a small constant for preventing DNNZC from being zero, if constant takes a value of 0.001, flag represents whether a position of a last non-zero QDST coefficient in a coding unit having a size of 4 × 4 in which the coefficient group corresponding to the QDST coefficient of the pixel having the coordinate position (i, j) in the mth frame before and after carrier simulation embedding is located in the coding unit having the size of 4 × 4 in the mth frame in the h.265/HEVC video, if change occurs, flag is 1, if no change occurs, DNNZC is 0, and nrzc represents a coordinate position in the nth coding tree unit in the mth frame in the h.265/HEVC video before and after carrier simulation embedding is located in the mth frameSetting the index position of the pixel point corresponding to the carrier in the h.265/HEVC video as pos for the difference between the number of non-zero QDST coefficients in the coding unit with the size of 4 × 4 where the coefficient group corresponding to the QDST coefficient of the pixel point of (i, j) is located, then: when the carrier belongs to a first-class carrier sequence, a coefficient group corresponding to a QDST coefficient of a pixel point with a coordinate position (i, j) in an nth coding tree unit in an mth frame in an H.265/HEVC video is (QDST)pos,qdstpos+2,qdstpos+3) When the carrier belongs to a second type of carrier sequence, the coefficient group corresponding to the QDST coefficient of the pixel point with the coordinate position (i, j) in the nth coding tree unit in the mth frame in the H.265/HEVC video is (QDST)pos,qdstpos+8,qdstpos+12) When the carrier belongs to a third-class carrier sequence, a coefficient group corresponding to the QDST coefficient of a pixel point with a coordinate position (i, j) in the nth coding tree unit in the mth frame in the H.265/HEVC video is (QDST)pos),qdstposThe QDST coefficient, QDST, of the pixel point with the coordinate position (i, j) in the nth coding tree unit in the mth frame of the carrier, namely the H.265/HEVC videopos+2QDST coefficient, QDST, of pixel point with index position pos +2 in H.265/HEVC videopos+3QDST coefficient, QDST, of pixel point with index position pos +3 in H.265/HEVC videopos+8QDST coefficient, QDST, of pixel point with index position pos +8 in H.265/HEVC videopos+12And the QDST coefficient represents the pixel point with the index position of pos +12 in the H.265/HEVC video.
To further illustrate the feasibility and effectiveness of the method of the present invention, experiments were conducted on the method of the present invention.
4 different video sequences with a resolution of 1920 × 1080 are selected, namely "basetballdrive", "BQTerrace", "Cactus" and "ParkScene", respectively. The method is carried out under H.265/HEVC reference software HM16.15, and encoding is carried out by using an encoder _ lowdelay _ P _ main.cfg configuration file, wherein the encoding structure of a video sequence is IPPP, the length of a GOP (group of pictures) is 4, the frame number is 40 frames (namely 40 frames before each video sequence is selected), the encoding quantization parameter QP is fixed to be 25, and other encoding parameters are consistent with the original configuration file.
In order to further illustrate the effectiveness of the method of the present invention, five indexes, such as Peak Signal-to-Noise Ratio (PSNR), Structural Similarity (SSIM), Mean Squared Error (MSE), Bit Increase Rate (BIR), and steganalysis detection Error Rate (detection Error Rate), are used to evaluate the visual quality impact caused by HEVC video data hiding, where the larger the PSNR and SSIM values are, the better the video picture quality is; the smaller the MSE is, the better the video picture quality is represented; the smaller the BIR is, the smaller the influence of the steganography method on the video code rate is; the higher the error rate of steganalysis detection, the more the steganalysis method can deceive steganalysis detection.
Table 1 shows the results of PSNR, SSIM, and MSE comparisons of a video obtained by compressing an original video using an HM encoder, a dense video obtained by data hiding an original video using a DCO method, and a dense video obtained by data hiding an original video using the method of the present invention.
PSNR, SSIM, MSE comparisons obtained by three methods in Table 1
Figure BDA0003517831070000171
In table 1, "Original" refers to a method of compressing an Original video using an HM encoder, and a DCO method refers to Yunxia L, Shuyang L, Hongguo Z, et al.a new data editing method for h.265/HEVC video streams with out intra-frame distortion driver [ J ]. Multimedia Tools & Applications,2018 (a novel h.265/HEVC data hiding method without intra-frame distortion drift).
From the data presented in table 1, it can be seen that the video sequence modified by the method of the present invention is superior to the comparison method in video picture quality.
Fig. 3 shows a dense video obtained by data hiding of an original video using a DCO method and a result of the dense video obtained by data hiding of the original video using the method of the present invention on a BIR, and fig. 4 shows a dense video obtained by data hiding of the original video using the DCO method and a result of the dense video obtained by data hiding of the original video using the method of the present invention on a steganalysis detection error rate.
It can be derived from the data shown in fig. 3 that the bitrate impact of the video sequence with the secret modified by the method of the present invention is smaller than that of the comparative method. From the data listed in fig. 4, it can be seen that the steganalysis detection error rate of most of the video sequences containing the secret information modified by the method of the present invention is higher than that of the comparative method, which indicates that the method of the present invention has higher security.

Claims (6)

1. A H.265/HEVC video self-adaptive information hiding method based on distortion compensation optimization comprises two parts, namely hidden information embedding and hidden information extraction; the method is characterized in that:
the specific process of embedding the secret information comprises the following steps:
step 1_ 1: performing compression coding on an original video by adopting an H.265/HEVC standard encoder to obtain an H.265/HEVC video, and storing a prediction mode and a depth of each coding unit in each coding tree unit in each frame of the H.265/HEVC video, a PU partition mode corresponding to each coding unit and a QDST coefficient of each pixel point in each coding unit in a compression coding process; wherein the size of the coding tree unit is 64 × 64, and the size of the coding unit is 64 × 64, 32 × 32, 16 × 16, 8 × 8 or 4 × 4;
step 1_ 2: traversing all frames in the H.265/HEVC video in sequence, and defining the currently traversed frame as a current frame;
step 1_ 3: judging whether the current frame is an I frame, if so, executing the step 1_ 4; if the current frame is not an I frame, directly executing the step 1_ 8;
step 1_ 4: sequentially traversing all coding units with the size of 4 multiplied by 4 in the current frame, and defining the currently traversed coding units with the size of 4 multiplied by 4 as current units;
step 1_ 5: classifying the current unit into a first class candidate block, a second class candidate block or a third class candidate block, or not processing the current unit, wherein the specific process comprises the following steps:
if the current unit has only the adjacent lower-left coding unit with the size of 4 × 4 and the numerical identifier of the prediction mode of the lower-left coding unit is within the interval [2,26], and the adjacent lower-right coding unit with the size of 4 × 4 and the numerical identifier of the prediction mode of the lower-right coding unit is within the interval [2,10], classifying the current unit as a first class candidate block, and then performing step 1_ 6;
classifying the current unit into a second class of candidate blocks if the current unit has only an adjacent upper-right coding unit of size 4 × 4 and the numerical identifier of the prediction mode of the upper-right coding unit is within the interval [10,34] or 1, and an adjacent right-left coding unit of size 4 × 4 and the numerical identifier of the prediction mode of the right-left coding unit is within the interval [26,34], and then performing step 1_ 6;
if the current unit has an adjacent lower-left coding unit of size 4 × 4 and the number of prediction mode of the lower-left coding unit is identified within the interval [2,26], and has an adjacent lower-right coding unit of size 4 × 4 and the number of prediction mode of the lower-right coding unit is identified within the interval [2,10], and has an adjacent upper-right coding unit of size 4 × 4 and the number of prediction mode of the upper-right coding unit is identified within the interval [10,34] or is 1, and has an adjacent right-right coding unit of size 4 × 4 and the number of prediction mode of the right-right coding unit is identified within the interval [26,34], and has an adjacent lower-right coding unit of size 4 × 4 and the number of prediction mode of the lower-right coding unit is identified within the interval [26,34] or within the interval [2,10] or is 0 or is 1, classifying the current unit into a third class candidate block and then executing the step 1_ 6;
for the rest cases, the current unit is not processed, and then the step 1_7 is directly executed;
the above-described lower-left coding unit is a coding unit of size 4 × 4 located at the lower left of the current unit, the lower-right coding unit is a coding unit of size 4 × 4 located at the lower right of the current unit, the upper-right coding unit is a coding unit of size 4 × 4 located at the upper right of the current unit, the right-left coding unit is a coding unit of size 4 × 4 located at the upper right of the current unit, and the lower-right coding unit is a coding unit of size 4 × 4 located at the lower right of the current unit;
step 1_ 6: selecting carriers from QDST coefficients of all pixel points in the current unit, if the current unit is a first-class candidate block, selecting QDST coefficients with absolute values larger than or equal to a set threshold th from 4 QDST coefficients of the 1 st column of pixel points of the current unit as carriers, classifying the carriers into first-class carriers, and then executing the step 1_ 7; if the current unit is a second-class candidate block, selecting QDST coefficients with absolute values larger than or equal to a set threshold th from 4 QDST coefficients of the 1 st line of pixel points of the current unit as carriers, classifying the carriers into second-class carriers, and then executing the step 1_ 7; if the current unit is a third-class candidate block, selecting QDST coefficients with absolute values larger than or equal to a set threshold th from 16 QDST coefficients of all pixel points of the current unit as carriers, classifying the carriers into third-class carriers, and then executing step 1_ 7; wherein th ∈ (0,10 ];
step 1_ 7: traversing the next coding unit with the size of 4 × 4 in the current frame to serve as the current unit, then returning to the step 1_5 to continue executing until all coding units with the size of 4 × 4 in the current frame are completely traversed, and then executing the step 1_ 8;
step 1_ 8: traversing the next frame in the H.265/HEVC video to be used as a current frame, and then returning to the step 1_3 to continue executing until all frames in the H.265/HEVC video are completely traversed;
step 1_ 9: arranging all carriers classified as first-class carriers, namely QDST coefficients according to the sequence of index positions of corresponding pixel points in the H.265/HEVC video to form a first-class carrier sequence; similarly, all carriers classified as the second type of carriers, namely QDST coefficients, are arranged according to the sequence of the index positions of the corresponding pixel points in the H.265/HEVC video to form a second type of carrier sequence; arranging all carriers classified as third-class carriers, namely QDST coefficients according to the sequence of index positions of corresponding pixel points in the H.265/HEVC video to form a third-class carrier sequence;
step 1_ 10: calculating outSimulating distortion cost values when +1 or 0 or-1 is embedded in each carrier in the first carrier sequence, the second carrier sequence and the third carrier sequence, setting a QDST coefficient of a pixel point with a coordinate position (i, j) in an nth coding tree unit in an mth frame of an H.265/HEVC video for any carrier, and recording the distortion cost value of the carrier as rhom,n(i,j),
Figure FDA0003517831060000031
Wherein, M is more than or equal to 1 and less than or equal to M, M represents the total frame number of frames contained in the H.265/HEVC video, N is more than or equal to 1 and less than or equal to N, N represents the total number of coding tree units contained in the mth frame in the H.265/HEVC video, (i, j) represents the coordinate position in the coding tree unit, i is more than or equal to 1 and less than or equal to 64, j is more than or equal to 1 and less than or equal to 64,
Figure FDA0003517831060000032
representing the intra-block distortion cost value of a QDST coefficient of a pixel point with a coordinate position (i, j) in the nth coding tree unit in the mth frame of the modified H.265/HEVC video, wherein alpha represents the inter-frame distortion transfer rate, GOPSize represents the length of a GOP (group of pictures) in the H.265/HEVC video, the value of the GOPSize is 4 or 16 or 32, and QstepRepresenting the quantization step size, Cp, of H.265/HEVC videom,n(i, j) represents the texture complexity of a coding unit with the size of 4 x 4 where the QDST coefficient of the pixel point with the coordinate position (i, j) in the nth coding tree unit in the mth frame in the H.265/HEVC video is located, and taum,n(i, j) represents the coefficient group cost value of modifying the QDST coefficient of the pixel point with the coordinate position (i, j) in the nth coding tree unit in the mth frame in the H.265/HEVC video, and k1、k2、k3Are all proportionality coefficients;
step 1_ 11: randomly generating three different binary secret information sequences by using the same embedded load rate payload, and correspondingly marking the sequences as X1、X2、X3(ii) a Then X is simulated to be embedded into +1 or 0 or-1 according to the distortion cost value of all carriers in the first type of carrier sequence by using an STC tool kit1Embedding the vector sequences into all vectors in the first type of vector sequences to obtain a first type of dense vector sequences; also, root ofSimulating the distortion cost value of embedding +1 or 0 or-1 according to all carriers in the second type carrier sequence by using an STC toolkit to convert X into X2Embedding the vector sequences into all vectors in a second type of vector sequences to obtain a second type of dense vector sequences; simulating X's with STC toolkit according to distortion cost value of embedding +1 or 0 or-1 by all carriers in the third type carrier sequence3Embedding the third type of dense vector sequences into all vectors in the third type of vector sequences to obtain third type of dense vector sequences; wherein, payload belongs to (0, 0.5)],X1Has a length of Num1×payload,X2Has a length of Num2×payload,X3Has a length of Num3×payload,Num1Denotes the total number of vectors in the first type of vector sequence, Num2Indicates the total number of vectors in the second type of vector sequence, Num3Representing the total number of vectors in the third type of vector sequence;
step 1_ 12: and carrying out distortion compensation optimization according to the first type of dense carrier sequences, the first type of carrier sequences, the second type of dense carrier sequences and the second type of carrier sequences, wherein the specific process comprises the following steps:
step 1_12 a: calculating the difference between each secret carrier in the first type of secret carrier sequence and the corresponding carrier in the first type of carrier sequence to obtain a first difference sequence; similarly, calculating the difference value between each dense carrier in the second type of dense carrier sequences and the corresponding carrier in the second type of carrier sequences to obtain a second difference value sequence; wherein, the difference value in the first difference value sequence is the value obtained by subtracting the corresponding carrier in the first type of carrier sequence from the dense carrier in the first type of dense carrier sequence, the difference value in the second difference value sequence is the value obtained by subtracting the corresponding carrier in the second type of carrier sequence from the dense carrier in the second type of dense carrier sequence, and each difference value in the first difference value sequence and the second difference value sequence is 0 or +1 or-1;
step 1_12 b: aiming at any difference value in the first difference value sequence and the second difference value sequence, if the difference value is +1, when the difference value belongs to the first difference value sequence, subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +2 in the H.265/HEVC video, and adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +3 to realize the distortion compensation optimization of the two QDST coefficients; when the difference value belongs to a second difference value sequence, subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +8 in the H.265/HEVC video, and adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +12 to realize the distortion compensation optimization of the two QDST coefficients;
if the difference is-1, when the difference belongs to a first difference sequence, adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +2 in the H.265/HEVC video, and subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +3 to realize the distortion compensation optimization of the two QDST coefficients; when the difference value belongs to a second difference value sequence, the distortion compensation optimization of the two QDST coefficients is realized by adding 1 to the value of the QDST coefficient of the pixel point with the index position of pos +8 and subtracting 1 from the value of the QDST coefficient of the pixel point with the index position of pos +12 in the H.265/HEVC video;
if the difference is 0, no matter whether the difference belongs to the first difference sequence or the second difference sequence, distortion compensation optimization is not performed on the QDST coefficient of any pixel point in the H.265/HEVC video;
pos represents the index position of a pixel point corresponding to the difference in the H.265/HEVC video;
step 1_ 13: carrying out compression coding on an original video by adopting an H.265/HEVC standard encoder, replacing an original QDST coefficient at a corresponding position with a QDST coefficient optimized by distortion compensation in the conversion quantization process of the compression coding, and carrying out compression coding to obtain a dense video code stream;
the specific process of extracting the secret information comprises the following steps:
step 2_ 1: decoding the code stream of the video with the density by adopting an H.265/HEVC standard decoder to obtain a decoded video, and storing the prediction mode and the depth of each coding unit in each coding tree unit in each frame of the decoded video, the PU partition mode corresponding to each coding unit and the QDST coefficient of each pixel point in each coding unit in the decoding process;
step 2_ 2: according to the process from the step 1_2 to the step 1_9, a first carrier sequence, a second carrier sequence and a second carrier sequence corresponding to the decoded video are obtained in the same way;
step 2_ 3: decoding the first type of carrier sequence obtained in the step 2_2 by using an STC (Serial time coding) toolkit, and extracting to obtain first secret information; similarly, decoding the second type of carrier sequence obtained in the step 2_2 by using an STC toolkit, and extracting to obtain second secret information; and decoding the third type carrier sequence obtained in the step 2_2 by using an STC toolkit, and extracting to obtain third secret information.
2. The method according to claim 1, wherein in step 1_6, th is 1.
3. The H.265/HEVC video adaptive information hiding method based on distortion compensation optimization as claimed in claim 1, wherein in the step 1-10, α is 0.6, k is k1The value is 4, k2A value of 1, k3The value is 1.
4. The distortion compensation optimization-based H.265/HEVC video adaptation information hiding method according to any one of claims 1 to 3, wherein in the step 1_10,
Figure FDA0003517831060000051
is equal to the sum of the absolute values of all elements in the distortion matrix E of the coding unit with the size of 4 × 4 where the QDST coefficient is caused by modifying the QDST coefficient of the pixel with the coordinate position (i, j) in the nth coding tree unit in the mth frame in the h.265/HEVC video, where E is HT·Δ·Qstep·26 -shiftH, where the symbol "·" is a dot product operation symbol, H denotes a DST transform matrix in the HEVC coding standard, HTIs the transpose of H, Δ represents the modification matrix when embedding the carrier simulation, dimension of Δ is 4 × 4, shift represents the scaling factor of the DST transform process in the HEVC coding standard,
Figure FDA0003517831060000061
floor () is taken downAnd an integral function, wherein QP represents a quantization parameter of the H.265/HEVC video, and IT _ Shift represents a scaling coefficient of a DST inverse transformation process in an HEVC coding standard.
5. The method as claimed in claim 4, wherein in step 1_10, Cp is in Cp _ p _ Cp _ l _ p _ Cp _ p _ Cp _ p _ Cp _ p _ Cp _ p _ Cp _ p _ Cp _ pm,n(i,j)=<P,|QDSTm,n|>Wherein P represents a matrix obtained from statistical randomness analysis of QDST coefficients of all pixels in a coding unit of size 4 x 4,
Figure FDA0003517831060000062
QDSTm,na coefficient matrix formed by QDST coefficients of all pixels in a coding unit with the size of 4 multiplied by 4 and representing the QDST coefficient of a pixel with the coordinate position (i, j) in the nth coding tree unit in the mth frame of the H.265/HEVC videom,nOf dimension 4 × 4, symbol "<>"is an inner product operation symbol, and the symbol" | "is an absolute value symbol.
6. A distortion compensation optimization based H.265/HEVC video adaptation information hiding method according to claim 5, wherein in the step 1-10,
Figure FDA0003517831060000063
wherein INF represents a positive infinite value, SCG represents a sum of absolute values of all QDST coefficients in a coefficient group corresponding to a QDST coefficient of a pixel having a coordinate position (i, j) in an mth frame in an h.265/HEVC video, cont is a small constant for preventing DNNZC from being zero, flag represents whether a position of a last non-zero QDST coefficient in a coding unit having a size of 4 × 4 in which the coefficient group corresponding to the QDST coefficient of the pixel having the coordinate position (i, j) is located in the nth coding tree unit in the mth frame before and after carrier simulation embedding in the h.265/HEVC video changes, if the position of the last non-zero QDST coefficient changes, the flag is 1, if the position of the last non-zero QDST coefficient changes, the DNNZC represents that the last non-zero QDST coefficient changes in the mth frame in the h.265/HEVC video before and after carrier simulation embeddingSetting the index position of the pixel point corresponding to the carrier in the h.265/HEVC video to pos according to the difference between the number of nonzero QDST coefficients in the coding unit with the size of 4 × 4, where the coefficient group corresponding to the QDST coefficient of the pixel point with the coordinate position (i, j) in the nth coding tree unit is located, then: when the carrier belongs to a first-class carrier sequence, a coefficient group corresponding to a QDST coefficient of a pixel point with a coordinate position (i, j) in an nth coding tree unit in an mth frame in an H.265/HEVC video is (QDST)pos,qdstpos+2,qdstpos+3) When the carrier belongs to a second type of carrier sequence, the coefficient group corresponding to the QDST coefficient of the pixel point with the coordinate position (i, j) in the nth coding tree unit in the mth frame in the H.265/HEVC video is (QDST)pos,qdstpos+8,qdstpos+12) When the carrier belongs to a third-class carrier sequence, a coefficient group corresponding to the QDST coefficient of a pixel point with a coordinate position (i, j) in the nth coding tree unit in the mth frame in the H.265/HEVC video is (QDST)pos),qdstposThe QDST coefficient, QDST, of the pixel point with the coordinate position (i, j) in the nth coding tree unit in the mth frame of the carrier, namely the H.265/HEVC videopos+2QDST coefficient, QDST, of pixel point with index position pos +2 in H.265/HEVC videopos+3QDST coefficient, QDST, of pixel point with index position pos +3 in H.265/HEVC videopos+8QDST coefficient, QDST, of pixel point with index position pos +8 in H.265/HEVC videopos+12And the QDST coefficient represents a pixel point with an index position of pos +12 in the H.265/HEVC video.
CN202210172234.9A 2022-02-24 2022-02-24 H.265/HEVC video self-adaptive information hiding method based on distortion compensation optimization Active CN114727112B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210172234.9A CN114727112B (en) 2022-02-24 2022-02-24 H.265/HEVC video self-adaptive information hiding method based on distortion compensation optimization

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210172234.9A CN114727112B (en) 2022-02-24 2022-02-24 H.265/HEVC video self-adaptive information hiding method based on distortion compensation optimization

Publications (2)

Publication Number Publication Date
CN114727112A true CN114727112A (en) 2022-07-08
CN114727112B CN114727112B (en) 2023-05-16

Family

ID=82236578

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210172234.9A Active CN114727112B (en) 2022-02-24 2022-02-24 H.265/HEVC video self-adaptive information hiding method based on distortion compensation optimization

Country Status (1)

Country Link
CN (1) CN114727112B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110216936A1 (en) * 2010-03-05 2011-09-08 Reed Alastair M Reducing Watermark Perceptibility and Extending Detection Distortion Tolerances
CN105049871A (en) * 2015-07-13 2015-11-11 宁波大学 HEVC-based audio information embedding method and extraction and reconstruction method
CN106210717A (en) * 2016-08-05 2016-12-07 北京航空航天大学 A kind of HEVC decoding complex degree control method based on saliency
CN107318022A (en) * 2017-06-27 2017-11-03 郑州师范学院 A kind of video steganography method based on the undistorted drift of H.265 standard
CN109803143A (en) * 2018-10-16 2019-05-24 曙光云计算集团有限公司 A kind of pair of video carries out the hiding method of frame information and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110216936A1 (en) * 2010-03-05 2011-09-08 Reed Alastair M Reducing Watermark Perceptibility and Extending Detection Distortion Tolerances
CN105049871A (en) * 2015-07-13 2015-11-11 宁波大学 HEVC-based audio information embedding method and extraction and reconstruction method
CN106210717A (en) * 2016-08-05 2016-12-07 北京航空航天大学 A kind of HEVC decoding complex degree control method based on saliency
CN107318022A (en) * 2017-06-27 2017-11-03 郑州师范学院 A kind of video steganography method based on the undistorted drift of H.265 standard
CN109803143A (en) * 2018-10-16 2019-05-24 曙光云计算集团有限公司 A kind of pair of video carries out the hiding method of frame information and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
朱银芳: "一种综合带失真补偿量化和扩频的水印算法" *

Also Published As

Publication number Publication date
CN114727112B (en) 2023-05-16

Similar Documents

Publication Publication Date Title
Lee et al. High-payload image hiding with quality recovery using tri-way pixel-value differencing
CN101841700B (en) H.264 compression bit stream oriented video watermark method
CN108366259A (en) A kind of reversible steganography method of three coefficient of H.264/AVC video of high-fidelity
CN110677694B (en) Video encryption method for resisting contour attack
CN107040787A (en) The 3D HEVC inter-frame information hidden methods that a kind of view-based access control model is perceived
CN108965887B (en) Video information hiding method and device based on inter-block decoupling
CN112070647B (en) Reversible high dynamic range image information hiding method
CN102685500B (en) H.264 large-capacity information hiding method based on information variable-length packet structure
CN111787335B (en) Reversible information hiding method based on AMBTC compression technology and Huffman coding
CN109819260B (en) Video steganography method and device based on multi-embedded domain fusion
Wang et al. An Information Hiding Algorithm for HEVC Based on Angle Differences of Intra Prediction Mode.
CN104581176A (en) H.264/AVC (advanced video coding) compressed domain robust video watermark embedding and extracting methods free from intra-frame error drift
CN113034334A (en) Encryption image reversible information hiding method and device combining JPEG and Huffman coding
Pan et al. Novel reversible data hiding scheme for two-stage VQ compressed images based on search-order coding
Ge et al. Oblivious video watermarking scheme with adaptive embedding mechanism
CN113329229A (en) High-capacity hiding method for H.265 video information with high-efficiency fidelity
CN109361926B (en) Lossless reversible information hiding method for H.264/AVC video visual quality
Vivek et al. Video steganography using chaos encryption algorithm with high efficiency video coding for data hiding
CN108683921B (en) Video reversible information hiding method based on zero quantization DCT coefficient group
CN114727112B (en) H.265/HEVC video self-adaptive information hiding method based on distortion compensation optimization
CN108024114B (en) High-capacity lossless HEVC information hiding method based on flag bit parameter modification
CN114598887A (en) Anti-recompression video watermarking method for controlling bit rate increase
CN107135391A (en) A kind of video-aware hash algorithm for H.264 compression domain
Sakib et al. A robust DWT-based compressed domain video watermarking technique
Yang et al. High-Capacity Adaptive Steganography Based on Transform Coefficient for HEVC

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant