KR20170045154A - Method for Inserting Copyright's Information into Video Content based on Virtual Insertion - Google Patents

Abstract

Disclosed is a method of virtually inserting copyright information into video content. The method comprises the following steps: extracting at least one I-frame from digital content; selecting a macro block from the outer background part of the extracted at least one I-frame; dividing the selected macro block into multiple sub sampling blocks; selecting at least two block regions from the sub sampling block; calculating a difference value between an average value of a row vector of each block region and a direct current (DC) value of the sub sampling block in which the corresponding block region is included; detecting at least two row vectors with a relatively small difference value from the average value; and storing a difference value between a value of the at least two detected row vectors and a distribution log information value. Accordingly, copyright information can be interlocked without damaging the video content at all.

Description

[0001] The present invention relates to a method for inserting copyright information into a video content,

The present invention relates to a method for virtually embedding copyright information in a moving image content, and more particularly, to a method for virtually embedding copyright information in a moving image content, To a method of virtual insertion.

In general, digital content such as images, movies, multimedia, etc. is not easy to grasp the speed and range of movement and copying on the Internet, how much is used and distributed, and thus the rights of copyright holders of digital contents are likely to be infringed And it is true that it is difficult to make highly reliable settlement of royalties due to the uncertainty of distribution status.

Therefore, techniques for effectively inserting copyright information into digital contents are actively being developed. In most cases, the length of such copyright information is at least 50 bytes, and it is necessary to be able to accurately identify the digital content existing somewhere on the Internet and to grasp the usage status using the concealed information, Or can not be extracted and corrected.

Watermarking and fingerprinting techniques are used to automatically identify images. Watermarking can insert the relevant information either visually or invisibly into the image signal and extract it if necessary to identify the image. Fingerprinting technology extracts feature points inherently possessed by an image, stores them in a database form, extracts feature points of the image to be identified, and identifies the feature points by mutual comparison. Thus, the two techniques described above can implement a relatively robust algorithm for non-geometric transformations such as Gaussian noise, brightness changes, and geometric transformations such as enlargement and reduction, rotation, and aspect ratio change.

However, the two techniques described above are not so suitable from the viewpoint of the amount of information that can be inserted and the damage of the original. For example, considering the amount of information that can be embedded, the fingerprinting method can only identify the image and can not insert the information. The watermarking method does not insert the information in the form of image, It is not suitable for embedding a sufficient amount of information in the distribution information concealment.

Also, from the viewpoint of the original damage, the fingerprinting method does not cause any original damage, but the watermarking method inevitably causes the original damage and the stronger the attack, the more the damage becomes stronger. Distribution information needs to be updated from time to time due to copyright transactions, movement of images, etc. If image damage is continuously caused by frequent modification of watermarking, image quality is degraded and the meaning to be conveyed is distorted There is a concern.

Japanese Patent Laid-Open No. 2003-536113

The present invention provides a method for virtually inserting copyright information into moving picture content that can link copyright information related to the copyright of the content with high security without damaging the content of the moving picture content. .

In order to achieve the above object, the present invention provides a method of virtually embedding copyright information in moving picture content in an aspect. A method for virtually embedding copyright information in the moving picture content is performed by a copyright information inserting device, comprising: extracting at least one I-frame from digital content; Selecting a macroblock in a background portion of an outer angle in at least one extracted I-frame; Dividing the selected macroblock into a plurality of subsampling blocks; Selecting at least two block regions in the subsampling block; Calculating a difference value between a mean value of column vectors of each of the block regions and a DC value of a sub-sampling block including a corresponding block region; Detecting at least two column vectors having a relatively small difference value from the average value; And storing a difference value between the value of the detected at least two column vectors and the copyright information value of the digital content.

The selected macroblock may be a 16x16 YCbCr macroblock. The plurality of subsampling blocks may include four 8x8 Y blocks, one 8x8 Cb block, and one 8x8 Cr block.

Wherein selecting at least two block regions in the subsampling block comprises: selecting two 8x8 Y blocks of the four 8x8 Y blocks; Selecting at least two 4x4 Y block regions in each of the selected 8x8 Y blocks; Selecting a left 4x4 Cb block region and a right 4x4 Cb block region in the 8x8 Cb block; And selecting the 4x4 Cr block region in the lower left and the 4x4 Cr block region in the upper right in the 8x8 Cr block.

The step of calculating the difference value may include calculating the average value by dividing the sum of the cell values included in the column for each column of each of the block areas by the number of cells.

As described above, according to the present invention, it is possible to achieve the same effect as the actual insertion without damaging the moving image content with copyright information, for example, a distribution log or the like. Further, there is an advantage that security is very excellent because information is inserted in a sub-sampling step rather than information insertion in a coding step in which digital content is easily modulated.

1 is a block diagram for explaining a configuration of a copyright information inserting apparatus for performing a method of virtually embedding copyright information in moving picture content according to a preferred embodiment of the present invention.
2 is a flowchart illustrating a flow of a method of virtually embedding copyright information in moving picture content according to a preferred embodiment of the present invention.
3 is an exemplary diagram illustrating a state in which the entire I-frame existing in the moving image content is loaded into the memory.
4 is an exemplary diagram illustrating an exemplary object / background configuration of a selected I-frame.
5 is an exemplary diagram illustrating a selected 16x16 YCbCr macroblock as an example.
6 is an exemplary diagram illustrating four 8x8 Y blocks divided in the 16x16 YCbCr macroblock shown in FIG.
7 is an exemplary diagram illustrating one 8x8 Cb block and one 8x8 Cr block divided in the 16x16 YCbCr macroblock shown in FIG.
8 is an exemplary diagram for explaining the concept of calculating the average value of the column vectors by the calculation unit.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In order to facilitate the understanding of the present invention, the same reference numerals are used for the same constituent elements in the drawings and redundant explanations for the same constituent elements are omitted.

First, in a preferred embodiment of the present invention, a virtual shovel does not transform a file of digital content such as moving picture content, but does not perform binary manipulation for inserting copyright information of the moving picture, It is possible to check whether the file is transformed when the original data and the key value are computed as if the information was extracted as if the information was inserted into a specific block of the target file.

In other words, the fact that the copyright information is virtually inserted into the moving image content is not a matter of actually inserting copyright into the digital content and transforming it, but it is as if the copyright information is inserted into a specific part of the digital content, And the like.

FIG. 1 is a block diagram illustrating a configuration of a copyright information inserting apparatus for performing a method of virtually embedding copyright information in moving image content according to a preferred embodiment of the present invention. FIG. FIG. 8 is a flowchart for explaining a flow of a method of virtually inserting copyright information into content; FIG.

1, the copyright information inserting apparatus 10 includes a content input unit 12, a macroblock selecting unit 13, a sub-sampling unit 14, a block region selecting unit 16, a calculating unit 18, And may include a database 20. The leg portions 12 to 20 interlock with each other to exchange data.

The copyright information inserting apparatus 10 is implemented through a network computer device including a memory for storing programs and data, a processor for executing a program stored in the memory, an input unit, an output unit, and an interface for interfacing with an external terminal .

Referring to Figs. 1 and 2, the content input unit 12 of the copyright information inserting apparatus 10 can input digital content (step S1). The digital content may be moving picture content.

The macroblock selector 13 selects at least one I-frame from the input digital content (step S2), and selects a macroblock corresponding to the background part of the outer angle in the extracted at least one I-frame (Step S3).

For example, unlike image content, which is static data, is composed of a single frame, video content includes a concept of time, and therefore, a process of selecting one of a plurality of frames is required. According to a preferred embodiment of the present invention, an I-frame (i.e., Intra-Frame) having a relatively large amount of data among frames of moving picture contents is selected.

3 is an exemplary diagram illustrating a state in which the entire I-frame existing in the moving image content is loaded into the memory.

As shown in FIG. 3, the moving picture content includes a plurality of I-frames. For example, in the case of draft 27-28 frames, there are about three GOPs (Group of Pictures), and therefore three I-frames can be included.

The macroblock selector 13 can select one I-frame based on any one of a plurality of I-frames, a selection signal input from a user, an external selection signal, and a selection signal based on a pre-stored selection algorithm.

4 is an exemplary diagram illustrating an exemplary object / background configuration of a selected I-frame.

As shown in FIG. 4, the center portion of the selected I-frame has a high probability that an object such as a person or object is located, and a background having little change in time series is located. Therefore, the macroblock selecting unit 13 can select a macroblock corresponding to the edge portion corresponding to the background portion. For example, the macroblock selecting unit 13 can select a 16x16 YCbCr macroblock located at the upper left corner.

The macro-block selection unit 13 may display a macro-block selection user interface on the screen of the computer device for selection of the extracted I-frame and macro-block. For example, the macro-block selection user interface displayed by the macro-block selection unit 13 may include a section selection window for selecting an I-frame extraction section in the digital content, An I-frame selection window for selecting a target I-frame, and a macroblock selection window for selecting a macroblock to which the copyright information is to be virtually inserted in the selected I-frame.

The sub-sampling unit 14 may divide the selected macroblock into four luma (LUMA, Y) and two chroma (CHROMA, Cb / Cr) subsampling blocks (step S4). For example, the subsampling unit 14 may divide the selected 16x16 YCbCr macroblock into a plurality of subsampling blocks, for example, four 8x8 Y blocks, one 8x8 Cb block, and one 8x8 Cr block.

Fig. 5 is an exemplary diagram illustrating a selected 16x16 YCbCr macroblock, and Fig. 6 is an exemplary diagram exemplarily showing four 8x8 Y blocks divided in the 16x16 YCbCr macroblock shown in Fig. 5. Fig. Is an exemplary diagram exemplarily showing one 8x8 Cb block and one 8x8 Cr block divided in the 16x16 YCbCr macroblock shown in Fig.

5 to 7, a 16x16 YCbCr macroblock included in the digital content includes four 8x8 Y blocks MS1, MS2, MS3, and MS4, one 8x8 Cb block MS5, and one 8x8 Cr block (MS6). In the subsampling of each of Figs. 6 to 7, the cell located at the upper left corner (i.e., the cell located in the first column of the first row) is indicated by black as a cell corresponding to the DC value. The arithmetic operation unit 18 may store in the database 20 an identifier for identifying the 16x16 YCbCr macroblock as a 5-digit number combined with the DC values of the six subsampling blocks.

Subsequently, the block area selector 16 can select at least two block areas in the subsampling block (step S5).

For example, the block area selection unit 16 selects two 8x8 Y blocks out of the four 8x8 Y blocks shown in FIG. 4, for example, the 8x8 Y block MS1 in the upper left and the 8x8 Y block MS4 ) Can be selected. The block area selection unit 16 selects two 4x4 Y block areas in the 8x8 Y block MS1 at the upper left and the 8x8 Y block MS4 at the lower right as shown in Figure 6, Y block area, and the upper right 4x4 Y block area. Thus, a total of four 4x4 Y block areas can be selected.

7, the block region selection unit 16 selects the 4x4 Cb block region at the lower left end and the 4x4 Cb block region at the upper left end in the 8x8 Cb block MS5 and outputs the 8x8 Cr block MS6, A 4x4 Cr block area at the lower left and a 4x4 Cr block area at the upper right can be selected. Thus, two 4x4 Cb block regions and two 4x4 Cr block regions may be selected.

In this manner, the block area selector 16 can select a total of eight block areas by selecting four 4x4 Y block areas, two 4x4 Cb block areas, and two 4x4 Cr block areas through step S3.

Subsequently, the operation unit 18 can calculate the difference value between the average value of the column vectors of each selected block region and the DC value of the sub-sampling block including the corresponding block region (step S6). Where the value of the column vector may be a 4-bit value consisting of the sequential cell values of the column. That is, the average value is calculated by dividing the sum of the values of the cells included in the column for each column of each block area by the number of cells, and the difference between the average value and the DC value is calculated.

8 is an exemplary diagram for explaining the concept that the calculating unit 18 calculates the average value of the column vectors.

Referring to FIG. 8, the operation unit 18 may calculate an average value by first summing the 4-bit value of the first column of the 4x4 Y block area at the upper right of MS1 and dividing the value by the number of cells (i.e., 4) . Then, the calculated average value can be calculated from the DC value of the subsampling block including the block region. The operation unit 18 can sequentially perform this process up to the fourth column of the MS2. Accordingly, four difference values corresponding to four columns in the 4x4 Y block of the umbrella stage of MS1 can be derived.

Also, the operation unit 18 can perform the same operation as described above for the 4x4 Y block at the lower left end of the MS 1, and derive four difference values as a result. Therefore, the operation unit 18 can calculate eight difference values corresponding to eight columns in two block regions included in the MS 1. [

In addition, the operation unit 18 can perform the same operation as described above also for MS4, MS5, and MS6. Accordingly, 32 difference values corresponding to a total of 32 columns are calculated by the operation of the operation unit 18. [

Then, the operation unit 18 can detect a column vector to be used for the virtual insertion of the distribution log based on the calculated difference values (step S7). That is, the operation unit 18 detects at least two columns having the smallest difference value calculated as described above.

For example, the operation unit 18 can arrange the 32 difference values corresponding to the 32 columns in ascending or descending order according to the difference value, and detect the two columns having the smallest difference value. That is, two 4-bit columns can be detected through this process. Therefore, two 4-bit column vectors, i.e., a total of 8-bit column vectors are detected, and a position to which the copyright information is to be associated is determined.

Then, the operation unit 18 calculates the difference value between the detected 8-bit column vector values (i.e., the total of 8 bits as the cell values of the detected two 4-bit columns) and the copyright information value of the digital content (step S8 ), And can store it in the database 20 (step: S9). The copyright information value may be a value of distribution log information. For example, the operation unit 18 can calculate the difference value by XORing the detected 8-bit column vector value and the 8-bit distribution log information value.

The distribution log information is a total of 8 bits and may include identification information of the provider providing the content, identification information of the content, distribution information, and the like. For example, the distribution log information may be composed of 2-bit OSP (Online Service Provider) code, 3-bit UCI (Universal Content Identifier) serial number, 3-bit cumulative sales count, and the like.

The difference value between the 8-bit column vector value and the distribution log information value calculated by the calculation unit 18 is stored in the database 20. In addition, the database 20 stores identification information (I-frame position, macroblock position, and the like) from which the position of the 8-bit column vector value (i.e., the position of the column to which the log log information corresponds) Identification information and the like can be stored.

Therefore, when the distribution log information corresponding to the digital content is detected, the position of the column vector value is detected, and the value of the distribution log information can be calculated based on the detected column vector value and the difference value stored in the database have.

Meanwhile, in the present embodiment, an 8-bit column vector is detected and inserted in virtual connection with an 8-bit distribution log. However, the number of bits of the virtual inserted column vector and the distribution log may vary .

INDUSTRIAL APPLICABILITY As described above, according to the preferred embodiment of the present invention, it is possible to achieve the same effect as that in which the digital content is actually inserted without damaging the digital content with copyright information, for example, a distribution log or the like. Further, there is an advantage that security is very excellent because information is inserted in a sub-sampling step rather than information insertion in a coding step in which digital content is easily modulated.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. It will be understood that the invention may be practiced otherwise than as described herein. Accordingly, modifications of the embodiments of the present invention will not depart from the scope of the present invention.

10: Copyright information insertion device
12:
13: Macro block selection unit
14: Subsampling unit
16: Block area selector
18:
20: Database

Claims (2)

Is performed by a copyright information inserting device,
Extracting at least one I-frame from the digital content;
Selecting a macroblock in a background portion of an outer angle in at least one extracted I-frame;
Dividing the selected macroblock into a plurality of subsampling blocks;
Selecting at least two block regions in the subsampling block;
Calculating a difference value between a mean value of column vectors of each of the block regions and a DC value of a sub-sampling block including a corresponding block region;
Detecting at least two column vectors having a relatively small difference value from the average value; And
And storing a difference value between the value of the at least two column vectors detected and the copyright information value corresponding to the digital content.
The method of claim 1, wherein the selected macroblock is a 16x16 YCbCr macroblock,
The plurality of subsampling blocks include four 8x8 Y blocks, one 8x8 Cb block, and one 8x8 Cr block,
Wherein the step of selecting at least two block regions in the subsampling block comprises:
Selecting two 8x8 Y blocks of the four 8x8 Y blocks;
Selecting at least two 4x4 Y block regions in each of the selected 8x8 Y blocks;
Selecting a left 4x4 Cb block region and a right 4x4 Cb block region in the 8x8 Cb block; And
Selecting a left 4x4 Cr block region and a right 4x4 Cr block region in the 8x8 Cr block,
The step of calculating the difference value comprises:
And calculating the average value by dividing the sum of cell values included in the column by each column of each of the block regions by the number of cells. .

Images