CN101217670A - An audio self-adapting embedded video and drawing method for encoding and decoding purpose of synchronization about video and audio - Google Patents
An audio self-adapting embedded video and drawing method for encoding and decoding purpose of synchronization about video and audio Download PDFInfo
- Publication number
- CN101217670A CN101217670A CNA2008100502483A CN200810050248A CN101217670A CN 101217670 A CN101217670 A CN 101217670A CN A2008100502483 A CNA2008100502483 A CN A2008100502483A CN 200810050248 A CN200810050248 A CN 200810050248A CN 101217670 A CN101217670 A CN 101217670A
- Authority
- CN
- China
- Prior art keywords
- point
- audio
- video
- bit
- embedded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a method that audio is self-adaptively embedded in video and an extraction method thereof which are used in audio-video signal synchronous encoding and decoding. The invention relates to the signal embedding and extracting technology. The embedding process is that: coefficients of a current coding block being transformed and quantized are scanned through zig-zag; the position of a last nonzero coefficient is searched from the lower right corner of the coding block to a point (2, 0) near the upper left corner, scanning is not stopped until encountering a first nonzero coefficient which is then deemed as a point C; then audio coding bit needing to be embedded is embedded into a point B which is before the point C; when extracting, the embedded audio coding bit is determined according to the coefficient value of the point B. The embedding method of the invention fully takes into account the different distributing features of nonzero coefficients of different coding blocks and self-adaptive audio bit embedding is made, which ensures that the influence of embedded audio bit is reduced on code stream size after audio-video signal synchronous encoding and the influence on video quality recovery is reduced simultaneously.
Description
Technical field
The present invention relates to the embedding and the extractive technique of signal, relate in particular to the audio frequency that is used for the synchronous encoding and decoding of audio-video signal and embed video and extractive technique thereof.
Background technology
At present, the embedding of signal and extractive technique are mainly used in the watermark processing in the information security.Need in the watermark processing watermark information is embedded in the multi-medium data.In the video watermark technology, present several video watermarks embed with extractive technique as follows:
Use the video watermark scheme of Direct swquence spread spectrum model: one section video is made up of some frames, and each frame can be regarded as and is made up of several bit-planes (bit planes), like this, just to can be regarded as be the one-dimensional sequence of unit with the bit-plane on time shaft to this section video.One { 0, the 1}m-sequence acts on this one-dimensional sequence, and most of bit-plane remains unchanged, and has the change of a few bits face can not influence visual effect, and these positions just can be used to watermarked.
Watermarked in motion vector, watermark is embedded in the motion vector that range value is big and phase angle change is little.In the MPEG compression algorithm, the motion compensated prediction technology is used to reduce the temporal redundancy of interframe, and the image that only predicts error just is encoded.In the MPEG video sequence, most frame is the motion compensated predictive coding frame, so, in motion vector, hide the information of watermark information in can the more efficient use video bit stream.Can hide watermark information by the data sequence that trace is revised in the motion vector, watermark detection is very easy to.
Embed the scheme of visual watermark in MPEG-1 and MPEG-2 compressing video frequency flow: people such as Arena have proposed watermark directly is embedded in the MPEG-2 bit basin, thereby have avoided being embedded in the pixel domain watermark necessary with video code flow decoding and the heavy computing of coding again.Watermark only is embedded in the I frame in the video in this scheme, does not revise P frame and B frame, and this is based on and reduces algorithm complex and to the consideration of frame-skip and frame deletion robustness (because the I frame cannot be jumped or delete).Handle according to the MPEG-2 syntactic structure for easier, Scheme Choice macro block rather than pixel be as the operating unit of bit stream, and each bit of watermark information is expanded in the macro block of some.
In the watermarked scheme in DCT territory: many scholars consider the compatibility with standard such as MPEG, have proposed the technology of embed watermark information on the coefficient after the discrete cosine transform.Consider human-eye visual characteristic, by the ad-hoc location coefficient being made amendment to realize the embedding of watermark.For example, a kind of scheme watermarked in the DCT territory is: (1) represents to be converted to the YUV color mode with each frame I of original video stream V from rgb color, the Y component is carried out dct transform obtain coefficient F={f
1, f
2... f
Len, Len=Height*Width wherein, Width is the width of original image, Height is the height of original image.For the ease of arthmetic statement, we get Width and Height equates, and equal 2
n, n is a natural number; (2) conversion coefficient F is resequenced with Zig-Zag scanning, the DCT coefficient of establishing after the rearrangement is F '; (3) arrange from low to high because of F ' can be similar to regard as by frequency, in order to reach the balance of the watermark robustness and the transparency, we skip preceding L DCT coefficient, begin by formula 1. to add watermark from L+1 coefficient:
F″[I]＝F′[I]+α*|F′[I]*X[I] ①
Wherein α is the watermark strength parameter, and X satisfies N (0,1) to distribute, by P, and the real number pseudo random sequence that the key that K calculates produces.Under the certain situation of α, in order to improve the robustness of watermark, we limit the size by the watermark information amount that adds in the 1. formula, promptly
α*|F′[I]*X[I]＞T ②
Wherein T is a given threshold value, if both X[I in the DCT coefficient F ' [I] of pre-treatment and watermark sequence] value satisfies 2. formula, then carries out the watermark embedding; Otherwise, current DCT coefficient F ' [I] and X[I] do not handle, jump to the next one.So repeat, until length is the watermark sequence of M all be embedded in the DCT coefficient till; (4) the DCT coefficient after watermarked being carried out contrary Zig-Zag arranges; (5) the DCT coefficient of arranging through contrary Zig-Zag is carried out inverse dct transform, obtain the Y component after watermarked; At last this frame is returned the RGB pattern from the conversion of YUV color mode, obtain adding watermark rear video frame I '; (6) each frame in this video flowing is all carried out the above watermark operation of adding, obtain adding the video flowing V ' after the watermark.
At the applicant's patent formerly " inserted audio-video mixed signal synchronous coding technique " (application number: 2004100788730), be the 4th or the 3rd of the inverse that the unpressed digital audio and video signals that will have an error correcting code embeds corresponding coefficient in the four-dimensional coefficient matrix of video coding system.What this method embedded is the uncompressed coded digital audio signals, therefore needs the audio bit quantity of embedding very big, and it is a lot of that this just makes the quality of receiver, video descend inevitably.
Patent formerly " audio and video frequency signal synchronizing method " (application number: 200610017021.X) the applicant, be that the audio coding bit stream step-by-step after the compression is embedded two intermediate frequency coefficients through having minimum range in the coefficient block after quantizing in MPEG-2 or the AVS video coding system, selected intermediate frequency coefficient position immobilizes to different coefficient block, yet to different coefficient block, the distributional difference of its zero coefficient values is bigger, therefore the code stream after the audio bit that embeds is encoded to audio-visual synchronization increases more, and is also bigger to the influence that recovers video quality.
Summary of the invention
The object of the present invention is to provide the synchronous encoding and decoding of a kind of audio-video signal to embed video and extracting method with audio self-adaptation, this embedding grammar will take into full account the different characteristics of different coding piece nonzero coefficient distribution, guaranteeing to make the audio bit of embedding littler on the basis that the audio coding bit can be extracted by no error code ground to the influence of video.
The synchronous encoding and decoding of audio-video signal embed video and extracting method with audio self-adaptation, comprise that audio self-adaptation embeds the extracting method that video method and audio self-adaptation embed decoder sound intermediate frequency signal behind the video.
1. audio self-adaptation embedding video may further comprise the steps:
(1) by the data behind the zig-zag scanning present encoding piece process transform and quantization, search the position of last non-zero points, begin to point (2,0) from the lower right corner of piece near the upper left corner, promptly from after carry out zig-zag scanning forward, when running into first non-zero points, stop scanning, with this location definition is the C point, will a bit be defined as the B point before the C point simultaneously, if to the last also do not stop scanning during a point, then directly orientate point (2,0) as the C point.
(2) if audio coding bit to be embedded is 1,, then do not change the value that B is ordered if the B point is an odd number; If the B point is an even number, then make B=B+1; If audio coding bit to be embedded is 0, if the B point is an odd number, then make B=B+1, if the B point is an even number, then do not change the value that B is ordered.
2. the extracting method of decoder sound intermediate frequency signal may further comprise the steps behind the audio self-adaptation embedding video:
(1) scans the data of current decoding block before inverse quantization by zig-zag, search the position of last non-zero points, and be the C point, will a bit be defined as the B point before the C point simultaneously this location definition; If when last point, also do not stop scanning, then directly orientate point (2,0) as the C point.
(2) if the B point is an odd number, then the audio bit of Ti Quing is 1; If the B point is an even number, then the audio bit of Ti Quing is 0.
The synchronous encoding and decoding of audio-video signal of the present invention embed video with audio self-adaptation and extracting method has the following advantages:
In the present invention, audio signal behind the compressed encoding is embedded video, adopt adaptive embedding grammar, according to the non-zero through the coefficient block after quantizing in MPEG-2 or the AVS video coding system is distribution numerical value difference, carrying out adaptive audio bit embeds, the code stream size influence after thereby the audio bit that makes embedding is encoded to audio-visual synchronization reduces, and has reduced simultaneously recovering the influence of video quality.
Embodiment
Core content of the present invention is that the audio frequency that is used for the synchronous encoding and decoding of audio-video signal embeds video and extracting method thereof.In order to embed more bit number, make influence reach minimum simultaneously to video as far as possible, the present invention is that example is described as follows with the method that the audio coding bit is embedded each luminance frame 8 * 8 sub-piece:
1. the method for audio self-adaptation embedding video may further comprise the steps:
(1). by the coefficient behind zig-zag scanning present encoding Block Brightness frame 8 * 8 sub-pieces process transform and quantizations, search the position of last non-zero points coefficient, begin to point (2,0) from the lower right corner of piece near the upper left corner, promptly from after carry out zig-zag scanning forward, when running into first non-zero points, stop scanning, with this location definition is the C point, will a bit be defined as the B point before the C point simultaneously, if to the last also do not stop scanning during a point, then directly orientate point (2,0) as the C point.
(2) if audio coding bit to be embedded is 1,, then do not change the value that B is ordered if the B point is an odd number; If the B point is an even number, then make B=B+1; If audio coding bit to be embedded is 0, if the B point is an odd number, then make B=B+1, if the B point is an even number, then do not change the value that B is ordered;
2. the extracting method of decoder sound intermediate frequency signal may further comprise the steps behind the audio self-adaptation embedding video:
(1) scans the data of current decoding block before inverse quantization by zig-zag, search the position of last non-zero points, and be the C point, will a bit be defined as the B point before the C point simultaneously this location definition; If when last point, also do not stop scanning, then directly orientate point (2,0) as the C point.
(2) if the B point is an odd number, then the audio bit of Ti Quing is 1; If the B point is an even number, then the audio bit of Ti Quing is 0.
Claims (1)
1. the synchronous encoding and decoding of audio-video signal embed video and extracting method with audio self-adaptation, comprise that audio self-adaptation embeds the extracting method that video method and audio self-adaptation embed decoder sound intermediate frequency signal behind the video, is characterized in that:
(1) audio self-adaptation embedding video method may further comprise the steps:
(i) by the data behind the zig-zag scanning present encoding piece process transform and quantization, search the position of last non-zero points, begin to point (2,0) from the lower right corner of piece near the upper left corner, promptly from after carry out zig-zag scanning forward, when running into first non-zero points, stop scanning, with this location definition is the C point, will a bit be defined as the B point before the C point simultaneously, if to the last also do not stop scanning during a point, then directly orientate point (2,0) as the C point.
(ii),, then do not change the value that B is ordered if the B point is an odd number if audio coding bit to be embedded is 1; If the B point is an even number, then make B=B+1; If audio coding bit to be embedded is 0, if the B point is an odd number, then make B=B+1, if the B point is an even number, then do not change the value that B is ordered.
(2) extracting method of decoder sound intermediate frequency signal may further comprise the steps behind the audio self-adaptation embedding video:
(i) scan the data of current decoding block before inverse quantization by zig-zag, search the position of last non-zero points, and be the C point, will a bit be defined as the B point before the C point simultaneously this location definition; If when last point, also do not stop scanning, then directly orientate point (2,0) as the C point.
If (ii) the B point is an odd number, then the audio bit of Ti Quing is 1; If the B point is an even number, then the audio bit of Ti Quing is 0.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008100502483A CN101217670A (en) | 2008-01-14 | 2008-01-14 | An audio self-adapting embedded video and drawing method for encoding and decoding purpose of synchronization about video and audio |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008100502483A CN101217670A (en) | 2008-01-14 | 2008-01-14 | An audio self-adapting embedded video and drawing method for encoding and decoding purpose of synchronization about video and audio |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101217670A true CN101217670A (en) | 2008-07-09 |
Family
ID=39624023
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2008100502483A Pending CN101217670A (en) | 2008-01-14 | 2008-01-14 | An audio self-adapting embedded video and drawing method for encoding and decoding purpose of synchronization about video and audio |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101217670A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116132759A (en) * | 2023-04-19 | 2023-05-16 | 深圳市保凌影像科技有限公司 | Audio and video stream synchronous transmission method and device, electronic equipment and storage medium |
-
2008
- 2008-01-14 CN CNA2008100502483A patent/CN101217670A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116132759A (en) * | 2023-04-19 | 2023-05-16 | 深圳市保凌影像科技有限公司 | Audio and video stream synchronous transmission method and device, electronic equipment and storage medium |
| CN116132759B (en) * | 2023-04-19 | 2023-09-12 | 深圳市保凌影像科技有限公司 | Audio and video stream synchronous transmission method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101098473B (en) | Picture coding method and apparatus | |
| CN103152578B (en) | H.264 video watermark based on mixed encoding and decoding embeds and extracting method | |
| CN101711481B (en) | Method and apparatus for video coding using prediction data refinement | |
| KR101500781B1 (en) | Method for processing images and the corresponding electronic device | |
| CN103338376B (en) | A kind of video steganography method based on motion vector | |
| CN101651834B (en) | Digital watermark embedding method and device of video | |
| CN102006475A (en) | Video coding and decoding device and method | |
| CN105917650A (en) | Block vector prediction in video and image coding/decoding | |
| CN1757240A (en) | Video encoding | |
| CN101924943B (en) | Real-time low-bit rate video transcoding method based on H.264 | |
| CN102223540A (en) | Information hiding method facing to H.264/AVC (automatic volume control) video | |
| CN102685500B (en) | H.264 large-capacity information hiding method based on information variable-length packet structure | |
| CN109819260B (en) | Video steganography method and device based on multi-embedded domain fusion | |
| CN106101714A (en) | One and the tightly coupled H.264 video information hiding method of compression encoding process | |
| CN102025997A (en) | Method and device for concealing information as well as method and device for extracting concealed information | |
| CN101309410A (en) | Video coding and decoding architecture | |
| Jiang et al. | A CABAC based HEVC video steganography algorithm without bitrate increase | |
| CN108965887A (en) | A kind of video information hiding method and device based on uncoupling between block | |
| CN100341330C (en) | Audio-embedded video frequency in audio-video mixed signal synchronous compression and method of extraction | |
| CN112422989A (en) | Video coding method | |
| CN104702959B (en) | A kind of intra-frame prediction method and system of Video coding | |
| CN1643608A (en) | Editing of encoded A/V sequences | |
| CN102256126A (en) | Method for coding mixed image | |
| CN102685470A (en) | Video digital watermark embedding method and video digital water embedding device directing at AVS (audio video standard) video format | |
| CN109361926B (en) | Lossless reversible information hiding method for H.264/AVC video visual quality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20080709 |