KR101501106B1 - Apparatus and Method for Encoding Video, Apparatus and Method for Decoding Video - Google Patents

Abstract

An embodiment of the present invention relates to a video encoding apparatus and method, a video decoding apparatus and a method. A video encoding apparatus according to an embodiment of the present invention includes a watermarking module for generating watermark embedding video by inserting a watermark into a video and outputting the watermark embedding video; A video encoding unit that encodes the video into which the watermark is not inserted, into an arbitrary frame group, receives the watermark embedded video, and separately encodes the watermark embedded video in the same manner as the arbitrary frame group; And generating a personal information based video for generating and outputting a personal information based video by selecting one of the arbitrary frame groups of the video in which the watermark is not inserted and the arbitrary frame group of the watermark embedded video in accordance with the buyer information And the like.

Description

[0001] The present invention relates to a video encoding apparatus and method, a video decoding apparatus,

An embodiment of the present invention relates to a video encoding apparatus and method, a video decoding apparatus and a method. More specifically, it is possible to insert different watermarks into each image for each purchaser, to reduce a high computation amount generated in the encoding process, to extract buyer information from a leaked video when a video is leaked, To a video encoding apparatus and method capable of extracting a watermark even after editing and re-compressing a video by applying a watermarking method for inserting a watermark directly into a video decoding apparatus, and a video decoding apparatus and method.

It should be noted that the following description only provides background information related to the embodiment of the present invention and does not constitute the prior art.

Generally, in the case of video leakage through capture of the output image, since it is technically impossible to prevent the video leakage, a signal that is not visually invisible to the video image is inserted in advance, and a watermark is detected in the leaked video Video watermarking technology is a technique to track the outflow path of video.

Currently known video watermarking techniques include embedding a watermark signal in a frequency region that is not sensitive to human vision, a method of inserting a watermark signal in an edge that is not sensitive to human vision even when the HVS (Human Visual System) a method of inserting a watermark signal in an area such as an edge, and a method of inserting a watermark in compressed video information.

In order to trace the path of the spilled video, the information related to where the video came from must be inserted into the video as a watermark. Watermark information to be inserted into the video should be inserted according to each purchaser so that the user who purchases the content can be identified.

However, the method of inserting the watermark into the video source image requires a high computation because the watermark has to be inserted and compressed for each purchaser.

When a watermark is inserted into compressed video information, it is very easy to insert a watermark for each buyer. However, when a user edits and re-compresses a video, the inserted watermark is damaged and is difficult to detect.

It is an object of the present invention to provide a video encoding apparatus and method, a video decoding apparatus, and a method capable of inserting different watermark information for each purchaser while lowering an operation.

A video encoding apparatus according to an embodiment of the present invention includes a watermarking module for generating watermark embedding video by inserting a watermark into a video and outputting the watermark embedding video; A video encoding unit that encodes the video into which the watermark is not inserted, into an arbitrary frame group, receives the watermark embedded video, and separately encodes the watermark embedded video in the same manner as the arbitrary frame group; And generating a personal information based video for generating and outputting a personal information based video by selecting one of the arbitrary frame groups of the video in which the watermark is not inserted and the arbitrary frame group of the watermark embedded video in accordance with the buyer information And the like.

Further, a video decoding apparatus according to an embodiment of the present invention receives a personal information-based video in which a watermark-inserted frame group and a watermark-unframed frame group are combined and transmits the received personal information- And outputting the divided frame group; A decoding unit decoding the arbitrary frame group divided; A watermark detection unit for determining whether a watermark is detected in each of the decoded arbitrary frame groups and outputting different detection signals depending on whether the watermark is detected or not; And a buyer information generating unit for comparing the buyer information stored in the memory with the buyer identification signal obtained by combining the detection signals to identify the buyer and outputting information on the verified buyer.

A video encoding method according to an embodiment of the present invention includes: generating a watermarked video by inserting a watermark into video; Dividing and encoding the video into which the watermark is not inserted into an arbitrary frame group, receiving the watermark embedding video and encoding the watermark embedding video in the same manner as the arbitrary frame group; And generating and outputting a personal information based video by selecting one of the arbitrary frame group of the video in which the watermark is not inserted and the arbitrary frame group of the watermark embedded video according to the buyer information .

Further, a video decoding method according to an embodiment of the present invention includes receiving a personal information-based video in which a watermark-inserted frame group and a watermark-unframed frame group are combined, and the received personal information- And outputting the divided frame group; Decoding video in the arbitrary frame group divided; Determining whether a watermark is detected in each of the decoded arbitrary frame groups, and outputting different detection signals depending on whether the watermark is detected or not; And comparing the buyer identification signal stored in the memory with the buyer identification signal obtained by combining the buyer identification information and the detection signal to identify the buyer and outputting information on the verified buyer.

According to the embodiment of the present invention, it is possible to easily extract buyer information from a leaked video while eliminating a high computational amount generated in the process of inserting and encoding different watermarks into each image for each buyer.

In addition, since watermarking method of inserting watermark directly on the original image can be applied, watermark can be extracted even after video editing and re-compression.

1 is a block diagram of a video encoding apparatus according to an embodiment of the present invention,
2 is a block diagram of a video decoding apparatus according to an embodiment of the present invention,
3 is a diagram illustrating a method of encoding a video encoding apparatus of FIG. 1,
4 is a diagram showing a decoding method of the video decoding apparatus of FIG.

Hereinafter, some embodiments of the present invention will be described in detail with reference to exemplary drawings. It should be noted that, in adding reference numerals to the constituent elements of the drawings, the same constituent elements are denoted by the same reference numerals even though they are shown in different drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In describing the components of the present invention, terms such as first, second, A, B, (a), and (b) may be used. These terms are intended to distinguish the constituent elements from other constituent elements, and the terms do not limit the nature, order or order of the constituent elements. When a component is described as being "connected", "coupled", or "connected" to another component, the component may be directly connected to or connected to the other component, It should be understood that an element may be "connected," "coupled," or "connected."

1 is a block diagram of an encoding apparatus according to an embodiment of the present invention.

1, a video encoding apparatus according to an embodiment of the present invention includes a watermarking module 100, a video encoding unit 110, and a buyer video generating unit 120. [

The watermarking module 100 receives a video for the unit content, for example, and inserts a watermark signal into each frame of the input video. Here, a frame represents an information unit that can form a unit screen. At this time, a watermark is not inserted into a frame to be compressed as I or P that can be used as a motion prediction reference image of another frame. In other words, the watermark is inserted into a P or B frame which is not utilized as a reference image of motion prediction, and is provided to the second encoding unit 113. Here, I means Intra, a method of using information in the corresponding frame, P means a method of using the information of the preceding frame among the Inter, Is used. In the I and P frames used as reference images for motion prediction, watermark is not inserted, and I and P frames, which are used as reference images for motion prediction in the encoded video after watermark embedding and watermark embedding, Are encoded identically. Therefore, video decoding can be performed even if a watermarked video and a non-inserted video are divided into frame groups based on I and P frames used as reference images for motion prediction, and a new video composed of two videos is reconstructed . However, the reconverted video at this time means that one of two frame groups whose time information is matched in two videos is arbitrarily selected.

The video encoding unit 110 includes a first encoding unit 111 and a second encoding unit 113. The first encoding unit 111 encodes video without the watermark embedded therein and the second encoding unit 113 encodes The watermarking module 100 encodes the provided video by inserting watermarks into frames P and B frames that are not used for frame prediction, more precisely motion prediction. The first and second encoding units 111 and 113 may include a conversion unit, a quantization unit, and an encoding unit, and may further include a prediction unit and a decoding unit. For example, the transforming unit transforms a residual block of input video into a frequency domain as a DCT unit. The quantizing unit transforms the frequency-domain transformed information, and the encoder generates a bitstream using entropy coding. At this time, the first and second encoding units 111 and 113 of the video encoding unit 110 are compressed in the form of "IBBPBBPBB ...... BP" in the GOP layer during encoding. In the embodiment of the present invention, The group between the frames and between the P and P frames is divided into arbitrary groups to be used for generating the buyer video.

The buyer video generation unit 120 includes a personal information based video generation unit 121 and a buyer information DB 123.

Here, the personal information based video generation unit 121 may generate a personal information based video by using a watermarked video provided by the first encoding unit 111, a watermarked video provided by the second encoding unit 113, For example, key information expressing buyer information from the key information 123, and generates a new video by combining the watermark embedded video and the watermark embedded video according to the key information.

The buyer information DB 123 stores the key information and can provide the key information stored in the buyer information DB 123 upon request of the personal information based video generation unit 121. [ Here, the key information is a division signal for identifying each buyer, and is buyer information formed by combining "0" and "1", for example, "10100100100".

2 is a block diagram of a decoding apparatus according to an embodiment of the present invention.

2, a video decoding apparatus according to an embodiment of the present invention includes a frame division unit 200, a decoding unit 210, a watermark detection unit 220, a buyer information generation unit 230, (240).

Here, the frame division unit 200 receives the watermarked personal information based video provided by the encoding apparatus of FIG. 1 and divides the watermarked personal information based video by frame group. At this time, the number of frame groups will be the same as the number of buyer information, that is, the number of buyers.

The decoding unit 210 decodes the divided frames, i.e., the watermark embedded video and the non-watermarked video, in the frame division unit 200. [ Here, the decoding unit 210 may include a decoder, an inverse quantizer, an inverse transformer, and the like. Therefore, the decompressed watermarked personal information based video may be decoded, inverse-quantized, .

The watermark detection unit 220 determines whether a watermark is detected in the restored group-by-group frame, and extracts "0" if it is detected and "1" if it is not detected.

The buyer information generation unit 230 compares the buyer identification signal provided by the watermark detection unit 220 with the buyer information stored in the buyer information DB 240 to confirm who the buyer is and outputs the related buyer information.

Further, since the watermark signal is repeatedly inserted, the buyer information generating unit 230 may detect the buyer's classification signal repeatedly, and calculate the average value of the buyer's classification signal. Then, the buyer's information may be more accurately detected by comparing with the predetermined value. Accordingly, the buyer information generating unit 230 may further include an average value calculating unit.

The buyer information DB 240 stores buyer information corresponding to the buyer identification signal and the buyer identification signal, and provides the information when the buyer information generator 230 requests it. The buyer information DB 240 may further store information on a specific value.

3 is a diagram showing an encoding method of the encoding apparatus of FIG.

Referring to FIG. 3 together with FIG. 1, in order to insert user information for each temporal frame, the encoding apparatus generates watermark embedded video and non-watermarked video for the inputted video and then encodes it.

In addition, the encoding apparatus selects one group of watermark embedding video and non-embedding video grouped in units of I to P and P to P frames in encoding according to the buyer information, The personal information based video is generated by inserting the key information into the video having N frame groups (S303).

For example, if the encoding is performed in the form of "IBBPBBPBB ...... BP", the first "IBB" becomes the first group, the next "PBB" becomes the second group, When the kth bit of the buyer information key is "1 ", the personal information-based video selects a specific frame of the k-th frame group corresponding to the encoded watermark- , A kth frame group corresponding to each other among the encoded watermark embedding video is selected.

In this manner, while generating the personal information based video, the encoding apparatus determines whether the personal information based video to be generated is the N last frame group (S305).

If it is not the last frame group and the number N of the frame groups is larger than the length K of the buyer information key, the bit of the n% Kth buyer information key is inserted into the nth frame group (S307). Where n% K is the remainder value of n divided by K.

4 is a diagram showing a decoding method of the decoding apparatus of FIG.

As shown in FIG. 4, the decoding apparatus receives the watermarked personal information based video provided by the encoding apparatus of FIG. 1 (S401). At this time, the watermarked personal information based video may include the watermark un-inserted video.

The decoding apparatus then divides the received watermarked personal information based video by frame group (S403). In other words, since the encoding is performed in the form of "IBBPBBPBB ...... BP", the first "IBB" is divided into the first group, the next "PBB" is divided into the second group, Divide the frame group.

Since the criterion for dividing the frame group is divided not between the I and P frames but between the I and P frames or between the P and P frames during encoding, the video is edited and re-encoded, Can be avoided.

Then, the decoding apparatus decodes the video (S405). At this time, the decoding process may be performed through processes such as decoding, inverse quantization, and inverse transform.

Thereafter, the watermark is detected in the video of the frame group in which the decoding is performed, and different detection signals are output depending on whether or not the watermark is detected (S407). For example, if a watermark is detected as a result of detection of a watermark, a signal of "0" is detected. If no watermark is detected, a signal of "1" If N is larger than K, since the detection signal is repeatedly detected, a signal which is repeatedly detected among "0" and "1 "

The decoding device compares the buyer identification signal with the buyer information stored in the buyer information DB 240 to identify who the buyer is and provides information on the buyer (S409).

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

The terms "include", "comprise", or "have" in the specification do not exclude other components, unless the context clearly indicates otherwise. But should be construed to include other elements. All terms including technical or scientific terms have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. Commonly used terms, such as predefined terms, should be interpreted to be consistent with the contextual meanings of the related art, and are not to be construed as ideal or overly formal, unless expressly defined to the contrary.

The embodiments of the present invention are applicable to an encoding apparatus, a driving method thereof, a decoding apparatus, and a driving method thereof. According to an embodiment of the present invention, At the same time, the buyer information can be extracted from the leaked video while eliminating a high computational load. In addition, since watermarking method of inserting watermark directly on the original image can be applied, watermark can be extracted even after video editing and re-compression.

100: watermarking module 110: video encoding unit
111: first encoding unit 113: second encoding unit
120: Buyer Video Generation Unit 121: Personal Information Based Video Generation Unit
123, 240: Buyer information DB 200: Frame division unit
210: decoding unit 220: watermark detection unit
230: Buyer information generating unit

Claims (10)

A watermarking module for inserting a watermark into a video to generate and output a watermarked video;
A video encoding unit that encodes the video into which the watermark is not inserted, into an arbitrary frame group, receives the watermark embedded video, and separately encodes the watermark embedded video in the same manner as the arbitrary frame group; And
A personal information based video generation unit for generating a personal information based video by selecting one of a frame group of the video in which the watermark is not inserted and an arbitrary frame group of the watermark embedded video according to the buyer information, ;
Lt; / RTI >
Wherein the personal information based video generation unit comprises:
generating a personal information based video by inserting a buyer information key composed of k bits into a video having N frame groups,
When the kth bit of the buyer information key is "1 ", the personal information based video selects a k-th frame group corresponding to each other among the encoded watermark-
Wherein the personal information based video is generated by selecting a kth frame group corresponding to each other among the encoded watermark embedded video when the kth bit of the buyer information key is "0 ". The method according to claim 1,
Wherein the arbitrary frame group is divided into a frame group between I and P or between P and P when the compression is performed in the order of "IBBPBBPBBPBB ...... P" in the video encoding unit. Device. The method according to claim 1,
Wherein the arbitrary frame group and the number of the buyer information are equal to each other. The method according to claim 1,
The personal information based video generation unit is interlocked with the buyer information DB,
Wherein the buyer information DB stores the buyer information and provides the buyer information according to a request of the personal information based video generation unit. delete A frame division unit for receiving a personal information based video in which a watermarked frame group and a watermarked non-watched frame group are combined, dividing the received personal information based video into arbitrary frame groups, and outputting the divided personal information based video group;
A decoding unit decoding the arbitrary frame group divided;
A watermark detection unit for determining whether a watermark is detected in each of the decoded arbitrary frame groups and outputting different detection signals depending on whether the watermark is detected or not; And
A buyer information generating unit for comparing the buyer information stored in the memory with the buyer identification signal obtained by combining the detection signal to identify the buyer and outputting information about the confirmed buyer
The video decoding apparatus comprising: The method according to claim 6,
Wherein the watermark detection unit outputs a detection signal of "0" when the watermark is detected in each arbitrary frame, and outputs a detection signal of "1 & . The method according to claim 6,
The buyer information generating unit is interlocked with the buyer information DB,
Wherein the buyer information DB stores the buyer information and provides the buyer information according to a request of the buyer information generator. Inserting a watermark into a video to generate and output a watermarked video;
Dividing and encoding the video into which the watermark is not inserted into an arbitrary frame group, receiving the watermark embedding video and encoding the watermark embedding video in the same manner as the arbitrary frame group;
Generating and outputting a personal information based video by selecting one of the arbitrary frame groups of the video in which the watermark is not inserted and the arbitrary frame group of the watermark embedded video according to the buyer information;
Lt; / RTI >
Wherein generating and outputting the personal information based video comprises:
generating a personal information based video by inserting a buyer information key composed of k bits into a video having N frame groups,
When the kth bit of the buyer information key is "1 ", the personal information based video selects a k-th frame group corresponding to each other among the encoded watermark-
Wherein the personal information based video is generated by selecting a k-th frame group corresponding to the encoded watermark embedded video when the k-th bit of the buyer information key is "0 ". Receiving a personal information-based video in which a watermark-inserted frame group and a watermark-unframed frame group are combined, dividing the received personal information-based video into arbitrary frame groups, and outputting the divided video information;
Decoding video in the arbitrary frame group divided;
Determining whether a watermark is detected in each of the decoded arbitrary frame groups, and outputting different detection signals depending on whether the watermark is detected or not; And
Comparing the buyer identification signal stored in the memory with the detection signal to identify the buyer and outputting information on the verified buyer;
And decodes the video data.

Images