JP2005109918A - Method for inserting secret data into image data, method for detecting secret data and method for displaying image data with secret data inserted - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image data displaying method for simultaneously displaying a plurality of pieces of information by using a secret data inserting method for efficiently inserting secret data into compressed image data, a secret data detecting method and the secret data. <P>SOLUTION: A partial decoding part 14 partially decodes compressed image data. A quantization transformation coefficient (a) obtained from partial decoding 14 is inputted to a secret data inserting part 11, and the secret data 12 is also inserted into the secret data inserting part 11. The secret data inserting part 11 inserts the secret data into the quantization transformation coefficient (a). A partial encoding part 15 partially encodes the quantization transformation coefficient b after the secret data insertion and outputs the quantization transformation coefficient and secret data inserted compressed image data. The secret data inserted compressed image data can be made to be, for example, media data as the secret data, and the medial data can be simultaneously displayed with image data. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a method for inserting secret data into image data, a method for detecting secret data, and a method for displaying image data into which secret data has been inserted. In particular, a large amount of secret data is inserted into image data in consideration of prevention of image quality degradation. The present invention relates to a method, a secret data detection method, and an image data display method that displays image data by reflecting detected secret data.

  As prior arts related to the present invention, there are those described in JP2003-235040A, JP2003-235040A, and the like.

  In Japanese Patent Laid-Open No. 2003-235040, a large or small value is given as a watermark value with respect to an average value of adjacent pixels in an input image. That is, as shown in FIG. 17, the MPEG data is decoded by the decoder 91, the digital watermark insertion unit 92 inserts the digital watermark data 93 into the average value of the neighboring pixels, and the encoder 94 It tries to become. In this conventional technique, the compressed moving image data is once decoded and returned to the image data, and the watermark data is inserted and recompressed. Therefore, image quality deterioration and processing load greatly increase due to re-encoding. Or a large-scale recording capacity for temporarily recording the decoded image.

  In Japanese Patent Laid-Open No. 2003-235040, a quantization scale value defined for one macroblock (16 × 16) is used as watermark information, and the watermark information is “1” depending on whether the value is even or odd. "Or" 0 ". In this case, since one bit of information per macroblock, the amount of information is limited. In addition, there is a possibility that the amount of encoded information can be greatly increased or decreased by changing one quantization scale. Therefore, it is difficult to control the amount of information when encoding at a fixed bit rate, and the compression rate is Since the optimum value is changed in units of blocks, there is a possibility that the image quality fluctuates in units of macro blocks and subjective image quality degradation occurs. Although this method can be inserted at the time of compression, it can be said that insertion into compressed image data is difficult because the compression rate of the entire image is changed again.

Next, SMIL (Synchronized Multimedia Integration Language) description standardized by the World Wide Web Consortium (W3C) can be used as a means of synchronously displaying other media such as telops and photos during video playback. . FIG. 18 shows a display example using the SMIL description. By using this description, for example, during playback of a moving image, it is possible to display a telop or the like on a screen at a specific place at a certain time (t = n to m). However, in this case: A video file and 2. In addition to the text file that stores telop information, 3. You need a SMIL description file that describes these actions. For this reason, when the number of media increases, the number of files increases and the handling becomes complicated.
JP 2003-244423 A JP 2003-235040 A

  An object of the present invention is to solve the above-described problems of the prior art and to use a secret data insertion method, a secret data detection method, and a secret data to efficiently insert secret data into compressed image data. An object is to provide a display method of image data to be displayed synchronously.

  In order to achieve the above-described object, the present invention provides a method for inserting secret data into image data, and includes means for partially decoding compressed image data using transform coding, and a quantized transform coefficient from the partially decoded data. A first feature is that it comprises means for extracting, means for embedding confidential data in the quantized transform coefficient, and means for re-partial encoding the image data embedded with the confidential data.

  The second feature is that the secret data embedding means divides the quantized transform coefficients of the transform block into grouped partial areas and inserts 1-bit secret data for each partial area. is there.

  The secret data embedding unit includes a unit that assigns a secret data insertion weight to the quantized transform coefficient, and the secret data insertion weight assigning unit changes the secret data insertion weight according to the frequency of the quantized transform coefficient. There is a third feature in this way.

  Further, the secret data embedding unit changes the representative value (quantized representative value) of the quantized transform coefficient of the entire transform block or a partial region in accordance with the secret data, and changes each representative value according to the changed quantized representative value. The fourth feature is that the quantized transform coefficient is changed.

  A secret data detection method for detecting secret data from image data into which secret data is inserted, and means for extracting quantized transform coefficients from compressed image data into which secret data has been inserted in a quantization transform coefficient decoding stage And a means for extracting secret data for each partial region in the block from the quantized transform coefficient in the block.

  Further, there is provided a display method for image data into which secret data is inserted, and means for extracting the secret data from the compressed image data into which the secret data is inserted in the quantization transform coefficient decoding stage, and quantization after extraction of the secret data A sixth feature is that it comprises means for decoding image data using a transform coefficient, and means for displaying secret data extracted from the compressed image data in synchronization with the image data.

  According to the present invention, the secret data can be efficiently inserted into the compressed image data only by partial decoding without completely decoding the compressed image data.

  Further, it is possible to perform coefficient grouping using the transform quantization coefficients that are partially decoded, insert secret data into each group, and generate compressed image data in which the secret data is inserted by partial encoding. Since a plurality of confidential data can be inserted into each 8 × 8 block, it is possible to insert data with higher efficiency than in the past. For example, confidential data of about 2 kbps can be inserted at high speed without impairing the image quality with respect to moving image data encoded at SIF (352 pel × 240 line) and 1.2 Mbps in the MPEG-1 system.

  Also, it becomes possible to effectively detect one or more secret data inserted per block.

  In addition, by inserting and displaying telops, images, masks, and link information in units of screens using confidential data, it is possible to display multiple media synchronously in units of screens without using separate files such as SMIL, Associations can be made on an object basis.

  Hereinafter, the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing a main part of a method for inserting confidential data into compressed image data according to an embodiment of the present invention.

  The compressed image data is partially decoded by the partial decoding unit 14. The quantized transform coefficient a obtained from the partial decoding unit 14 is input to the secret data insertion unit 11, while the secret data 12 is input to the secret data insertion unit 11. The secret data insertion unit 11 inserts the secret data into the quantized transform coefficient a by a method described later. The quantized transform coefficient b after the confidential data insertion is partially encoded by the partial encoding unit 15 and output as the confidential data insertion compressed image data. Note that the encoded information obtained from the partial decoding unit 14 is also input to the secret data insertion unit 11, but the description is omitted because it is not related to the insertion of the secret data.

  FIG. 2 is a block diagram showing the main part of a method for inserting confidential data into moving image data or image data compressed by the MPEG or JPEG method.

  MPEG (JPEG) data is input to a VLD (variable length decoding unit) and partially decoded. The secret data insertion unit 11 inserts the secret data 12 into the quantized transform coefficient a by the method described later, as described with reference to FIG. The quantized transform coefficient b after the insertion of the secret data is partially encoded by a VLC (variable length encoding unit) 13 and is output as confidential data inserted MPEG (JPEG) data.

  FIG. 3 is a block diagram showing detailed functions of the secret data insertion unit 11. The secret data insertion unit 11 includes a quantized transform coefficient extracting unit 31, a quantized transform coefficient grouping unit 32, a weighting factor determining unit 33, and a quantized transform coefficient changing unit 34.

  Hereinafter, the functions of the quantized transform coefficient extracting unit 31, the quantized transform coefficient grouping unit 32, the weighting coefficient determining unit 33, and the quantized transform coefficient changing unit 34 will be described using MPEG as an example. Of course, the present invention is not limited to MPEG.

  The quantized transform coefficient extraction unit 31 arranges the AC components of the quantized transform coefficients obtained from the VLD 10 in the zigzag scan order from the low frequency components to the high frequency components as shown in FIG. 4A (A (1)). , A (2), A (3), ..., A (9)). The scan order may be different depending on the compression mode, such as a vertical scan. In this case, the scan order is arranged in the designated scan order. In 8 × 8 DCT, the AC component is 63 coefficients as shown in FIG. A (1) to A (9) in FIG. 4 (a) indicate the quantized transform coefficients of the AC component. A (9) is a non-zero coefficient, and A (10) to A (63) are zero coefficients. This case is shown. A (1) to A (8) may be non-zero or zero coefficients.

  The arranged quantized transform coefficients are divided into partial areas by the quantized transform coefficient grouping unit 32 and grouped into G groups. Grouping is done in a unit from low frequency to high frequency. For example, as shown in FIG. 4B, the three components are grouped in the zigzag scan order (grouping example 1), or the components are sampled at regular intervals in the zigzag scan order as shown in FIG. Grouping (grouping example 2).

  The purpose of this grouping is to embed 1-bit confidential data in each group, so that a plurality of bits of confidential data can be embedded in one block. Although all AC coefficients can be targeted for grouping, as shown in FIG. 6, coefficients up to the last non-zero coefficient A (en) of the quantized transform coefficients arranged in scan order are used. It becomes possible to insert secret data more efficiently by targeting only. The group number G can be determined depending on the number of coefficients en up to the last non-zero coefficient (en = 18 in the example of FIG. 6).

  For example, when the number en up to the last non-zero AC coefficient is small, only the low frequency component exists in the block, and there is a possibility of image quality deterioration if the coefficient is changed. For this reason, if the G value is reduced and conversely en is large, it is possible to set the G value to be large because high frequencies exist. For example, G = 0 if e <6, G = 1 if 7 ≦ en <10, G = 2 if 11 ≦ en <15, G = 3 if 16 ≦ en <21, etc. is there.

  In the case of grouping example 1 shown in FIG. 4B, grouping is performed for each frequency band, so that the data insertion strength can be adjusted for each band. The frequency band can be considered as a scan order band as shown in FIG. Regarding the data insertion strength, for example, the low frequency coefficient has a large influence on the image quality due to the insertion of the secret data, so the insertion strength is lowered. Conversely, the high frequency coefficient has a little influence on the image quality, so the insertion strength can be increased. it can. Specifically, such adjustment is possible by changing the weight for each band.

  For example, if the quantized transform AC coefficients in scan order are A (1), A (2), ..., A (i), ..., A (en), the coefficients of each group and the coefficients in scan order The following formula holds between:

  AG1 (j, k) = A ((j-1) * G + k) (1)

  Here, AG1 (j, k) indicates a coefficient of each group, j is a group number (j = 1, 2,..., G), k is a coefficient number in the group (k = 1, 2,. .., (en / G + 1)). The weight of each band can be WG1 (j).

  In the case of grouping example 2 shown in FIG. 4 (c), since several frequency bands are mixed in each group, the insertion strength is adjusted by changing the weight from the low frequency to the high frequency with the coefficient in the group. Can do. The following formula is established between the coefficient of each group and the coefficient of the scan order.

  AG2 (j, k) = A ((k-1) * G + j) (2)

  Here, AG2 (j, k) indicates a coefficient of each group, j is a group number (j = 1, 2,..., G), k is a coefficient number in the group (k = 1, 2,. .., (en / G + 1)). Also, the weighting of each band and each coefficient position can be WG2 (j, k).

  Next, the weighting coefficient determination unit 33 in FIG. 3 determines the weighting coefficient WG. For example, in the case of WG1 (j), WG1 (j) = 0 can be set at a low frequency (for example, j = 0, 1), and WG (j) = 1, 2 can be set as the frequency becomes high. Also, in the case of WG2 (j, k), if both j and k are small, the frequency becomes low and becomes a high frequency component as j and k increase, so the weighting increases from low frequency to high frequency as in WG1. Is possible.

  It is also possible to change the weighting according to the value of the quantization coefficient. In particular, when the coefficient is zero, the effect of weighting is low, so by intentionally setting a low value, the zero component due to insertion of confidential data is not changed to a non-zero component, the image quality is maintained and the amount of data is reduced. It is possible to prevent the increase.

  FIG. 6 (b) shows the case where the last non-zero coefficient is number 18 and the number of groups G = 3 is divided into groups using the group division method of the grouping example 2 above, and weighted according to the band and coefficient values. This is an example.

  In the illustrated example, for example, the weight WG2 (1, k) for each coefficient (10,4,3,2,2,0) of the group AG2 (1, k) is (0,0,1,2,2,1). ). From this example, it can be seen that the weighting is increased from low frequency to high frequency. The reason why the weight for the last coefficient 0 is set to 1 regardless of the high frequency is that the effect of the weighting for the zero coefficient is low, so that a low value is intentionally set. In addition, it can be seen that WG2 (3, k) has a higher weight than WG2 (1, k).

  Next, confidential data is inserted using the weighted quantized transform coefficient. The quantized transform coefficient changing unit 34 in FIG. 3 changes the quantized transform coefficient in each group according to the value of the confidential data. This will be described below with reference to FIG.

  When the secret data 12 is 0 (Sk = 0), the quantized representative value Q (j) is changed to a nearby even number Q ′ (j), and each quantized transform coefficient is changed accordingly. On the other hand, when the secret data 12 is 1 (Sk = 1), the quantized representative value Q (j) is changed to a nearby odd number Q '(j), and each quantized transform coefficient is changed accordingly.

  Here, the quantized representative value Q (j) can be expressed as follows using the intra-group energy E (j) of the quantized transform coefficient and the secret strength m.

  Q (j) = E (j) / m (3)

  Q (j) is a real number. Further, as E (j), it is possible to use the absolute value sum of the intragroup quantized transform coefficients. The secret strength m is an integer of 1 or more, and the secret strength can be increased as it increases.

  In the illustrated example, the intra-group energy E (1) = 21 and the secret strength m = 4, so that the quantized representative value Q (1) = 5.2. Therefore, when the secret data is 0 (Sk = 0), the quantized representative value Q (1) is changed to an even number 6, and when the secret data is 1 (Sk = 1), the quantized representative value is changed. Change Q (1) to an odd number of 5.

  Next, the energy change ΔE in the group due to the change from Q (j) to Q ′ (j) can be obtained by the following equation.

  ΔE = Q ′ (j) * m−E (j)

  By reflecting this change in energy on each quantized transform coefficient, data concealment can be realized.

  AG2 ’(j, k) = AG2 (j, k) + ΔE * WG2 (j, k) (4)

  Thereby, a change in energy can be reflected and changed in each quantized transform coefficient with a weight. If the amount of energy change cannot be reflected due to truncation at the time of integer calculation, the amount of energy change is reflected using a process such as rounding off.

  In the example of FIG. 7, ΔE = 3 when the confidential data is 0 (Sk = 0). When this change in energy is reflected in the weighting of each quantized transform coefficient, [ΔE × WG2 (1, k)] = [0, 0, 1/2, 1, 1, 1/2]. If the quantized transform coefficient is not an integer, it is rounded off or rounded down to an integer to reflect the change in energy in the weighting. Then, [ΔE × WG2 (1, k)] = [0, 0, 1, 1, 1, 0] can be obtained. Next, when this change in energy is reflected in each quantized transform coefficient, each quantized transform coefficient AG2 '(1, k) becomes (10, 4, 4, 3, 3, 0). This AG2 ′ (1, k) = (10,4,4,3,3,0) is the original quantized transform coefficient AG2 (1, k) = (10,4,3,2,2,0) It can be seen that the third, fourth, and fifth terms are changed.

  When the secret data is 1 (Sk = 1), the energy change ΔE = −1. Thereafter, the same processing as described above is performed, and when this energy change is reflected in each quantized transform coefficient, each quantized transform coefficient AG2 ′ (1, k) becomes (10, 4, 3, 2, 1, 0). ). This AG2 ′ (1, k) = (10,4,3,2,1,0) is the original quantized transform coefficient AG2 (1, k) = (10,4,3,2,2,0) It can be seen that only the fifth term is changed.

  Next, these changed quantized transform coefficients are encoded by the VLC 13 and output as confidential data insertion MPEG (JPEG) data.

  In the method according to the present embodiment, only the VLD process as the partial decoding process and the VLC process as the partial encoding process are necessary as the compressed data process in addition to the secret data insertion process, and therefore a very high speed insertion process is possible. In particular, the IDCT required for the decoding process, the DCT required for the motion compensation process and the encoding process, and the motion compensation prediction process all have a heavy processing load, but the feature is that none of these processes is required.

  Further, the amount of data that can be inserted in units of blocks can be determined by changing the number of groups G. For this reason, by setting a plurality of groups for each block, it is possible to insert arbitrary plural bits of confidential data into each block (8 × 8).

  In addition, it is possible to control the influence on the image quality by changing the weighting coefficient. Further, as the secret data intensity m increases, the energy change ΔE also increases, and the change value of the quantization transform coefficient also increases. As a result, data error, screen copy, image change such as trans-encoding for conversion to another compression rate, and resistance to degradation are enhanced, and more robust detection can be performed.

  The secret data strength m can be changed to a block unit, a macro block unit, or a frame unit in addition to using a predetermined fixed value. In this case, the secret data strength m is separately set to the value of the compressed data. It is necessary to describe with a header or the like (frame header, macroblock header, etc.).

  Further, the value of the intensity m can be embedded as the first block of the frame, the first block of each macroblock, or the secret data of the block. In this case, it is necessary to determine in advance the structure of the value of the intensity m and other data. For example, when the first secret data of each block starts with “1”, it is possible to determine a rule such that data indicating the value of m follows, followed by user-specified secret data.

  Furthermore, a flag for embedding the secret data itself, that is, a flag indicating that the secret data is embedded can be embedded as the secret data in the first block of the frame or the like or in each macroblock or block. Also in this case, it is necessary to determine the data structure in the same manner as the value of the intensity m. For example, a flag such as “FFFF” is designated as the secret data flag, and the secret data extraction process is performed only when this code can be detected from the secret data. In order to prevent misrecognition with other data, it is conceivable to increase the code length or use an embedded code in a plurality of blocks and areas. It is also possible to describe this flag by a compressed data header or the like (frame header or the like).

  FIG. 8 is a block diagram showing a configuration of an apparatus in which an image encoding apparatus such as JPEG is provided with the secret data insertion function of the present invention.

  The image data is orthogonally transformed by the DCT unit 51 and input to the quantization unit Q52. The quantized data quantized by the quantizing unit Q52 is input to the secret data inserting unit 11. The secret data insertion unit 11 inserts the secret data 12 into the quantized data by the method described above. The quantized data into which the confidential data 12 is inserted is variable-length encoded by the VLC 13 and is output as the confidential data insertion compressed image data. In the quantizer Q52, the rate control unit 54 controls the encoding amount from the bit amount after VLC.

  FIG. 9 is a block diagram illustrating a configuration of an apparatus in which a moving image encoding apparatus such as MPEG is provided with a secret data insertion function.

  The operation of the moving picture coding apparatus is well known and will be briefly described. The moving picture data is input to the prediction signal subtracter 50 and the motion compensator (MC) 64. The motion compensator (MC) 64 obtains, from the frame memory (Mem) 63, image data specified by the motion vector obtained from the input moving image data and the reference image input from the frame memory (Mem) 63, and moves the motion. It is output to the prediction signal subtracter 50 and the local decoding adder as compensated prediction data. The motion compensation prediction data is subtracted from the input image data by the prediction signal subtracter 50, and the prediction error is input to the DCT 51 in order to obtain high coding efficiency. The data orthogonally transformed by the DCT 51 is input to the quantization unit Q52, quantized, and then input to the secret data insertion unit 11. The secret data insertion unit 11 inserts the secret data 12 into the quantized data by the method described above. The quantized data into which the secret data 12 is inserted is variable-length encoded by the VLC 13 and is output as the secret data insertion compressed moving image data. In the quantizer Q52, the rate control unit 54 controls the encoding amount from the bit amount after VLC. The quantized data into which the secret data 12 is inserted is inversely quantized by an inverse quantization unit (IQ) 61 and further inversely DCTed by an inverse DCT unit (IDCT) 62 and enters the local decoding adder.

  According to the configurations of FIGS. 8 and 9, the confidential data can be efficiently inserted simultaneously with the encoding.

  FIG. 10 is a block diagram showing a configuration of a JPEG-compatible device for decoding secret data insertion compressed image data and acquiring secret data and image data.

  The compressed image data into which the secret data is inserted as described above is input to the variable length decoder (VLD) 10. The image data partially decoded by the variable length decoder (VLD) 10 is input to the secret data extraction unit 71 to extract the secret data. The extracted secret data is output as secret data 72. The function and operation of the secret data extraction unit 71 will be described later with reference to FIGS. The image data that has passed through the secret data extraction unit 71 is inversely quantized by an inverse quantization unit (IQ) 61, further inversely DCTed by an inverse DCT 62, and output as image data.

  FIG. 11 is a block diagram showing a configuration of an MPEG-compatible device for decoding the secret data insertion compressed moving image data and acquiring the secret data and the image data. 10 is different from FIG. 10 in that a motion compensation (MC) 64, a frame memory 63, and an adder are provided. Since the secret data is extracted in the same manner as in FIG. 10, detailed description thereof is omitted.

  Here, the function of the secret data extraction unit 71 will be described with reference to FIG.

  As illustrated, the secret data extraction unit 71 includes a quantized transform coefficient extraction unit 81, a quantized transform coefficient grouping unit 82, and a secret data calculation unit 83. From the image data partially decoded by the variable length decoder (VLD) 10, a quantized transform coefficient containing secret data (watermark bits) is extracted by a quantized transform coefficient extracting unit 81. Next, the quantization transform coefficient grouping unit 82 performs the same grouping as described with reference to FIG. The secret data calculation unit 83 calculates the secret data inserted in each group by the same calculation as the equation (3).

  For example, as shown in FIG. 13, in the case of a certain group of quantized transform coefficients AG2 (1, k) = (10, 4, 4, 3, 3, 0), within the group that is the sum of these coefficients. The energy E (1) = 24 is divided (divided) by the embedding strength m = 4 to obtain a quantized representative value Q (1). Then, it is determined whether the integer part of the quantized representative value Q (1) is even or odd. In this example, since the quotient is 6.0 and the integer part is an even number, Sk = 0 is calculated as the confidential data (watermark bit). On the other hand, the quotient is 5.0 when the group quantization transform coefficient AG2 (1, k) = (10, 4, 3, 2, 1, 0). Therefore, since the integer part of the quantized representative value Q (1) is an odd number, the secret data calculation unit 83 calculates Sk = 1 as the secret data (watermark bit).

  Next, FIG. 14 shows a block diagram of an apparatus for performing synchronized image display by performing moving image reproduction and secret data extraction from the secret data insertion compressed moving image data.

  This apparatus includes a decoding unit 84 for decoding the secret data insertion compressed moving image data and a display unit 85 to which the secret data extracted by the secret data extraction unit 71 is input. Here, the decoding unit 84 represents the variable length decoding unit 10, the inverse quantization unit 61, the inverse DCT 62, and the like of FIG. The display unit 85 receives the screen data decoded by the decoding unit 84 and the secret data extracted by the secret data extraction unit 71, and displays the secret data synchronized with the playback screen.

  FIG. 15 shows two examples of the secret data display. (1) In the figure, area information (mask information) for masking objects other than the object of interest is expressed using the secret data of each block, and when displaying, the objects other than the object of interest are displayed in black, for example. Only the object of interest can be displayed. A decoding device without a secret data extraction function reproduces all videos, whereas a decoding device with a secret data extraction function can display only necessary objects as shown in FIG.

  FIG. 15 (2) is an example in which the confidential data is media data. Conventionally, a telop displayed using a description language such as SMIL stored in a separate file is converted into a moving image file by using the confidential data. A single function realizes the same function. By inserting telop information and information such as the display position into the secret data, it is possible to display telops in synchronization with the display screen. The media data is not limited to text data (such as telop), and can include moving images and still images.

  The media data may be link information that is object information (object name, attribute, description, etc.) related to the screen to be decoded.

  FIG. 16 is a flowchart illustrating an outline of an example of processing of the secret data extraction unit 71 (see FIGS. 10 and 11). In step S1, a secret data flag extraction process is performed, and in step S2, a secret data flag is detected. When the secret data flag is detected, the process proceeds to step S3 to perform secret data extraction processing. Specifically, for example, the process of FIG. 13 is performed. Subsequently, the process proceeds to step S4 performed in the decoding unit. On the other hand, if the secret data flag is not detected, the secret data extraction process is not performed and the process proceeds to the decryption process in step S4.

It is a block diagram which shows the structure of the principal part of one Embodiment of this invention. It is a block diagram which shows the structure of the principal part in the case of implement | achieving this invention by MPEG. It is a block diagram which shows the detail of the secret data insertion part of FIG. 1, FIG. It is explanatory drawing of grouping of a quantization transformation coefficient. It is a figure which shows an example of the index number and frequency band division | segmentation of AC component by zigzag scanning. It is explanatory drawing of an example of grouping of a quantization transformation coefficient, calculation of total energy in a group, and secret data insertion weight (weight vector). It is a figure which shows the specific example of correction of a data embedding rule and a coefficient value. It is a block diagram of the principal part structure at the time of applying the secret data insertion function of this invention to image coding apparatuses, such as JPEG. It is a block diagram of the principal part structure at the time of applying the secret data insertion function of this invention to image coding apparatuses, such as MPEG. It is a block diagram which shows the structure of the apparatus corresponding to JPEG for decoding confidential data insertion compression image data, and acquiring confidential data and image data. It is a block diagram which shows the structure of the apparatus corresponding to MPEG for decoding confidential image insertion compression image data, and acquiring confidential data and image data. It is a block diagram which shows the detail of the secret data extraction part of FIG. 10, FIG. It is a figure which shows the example of calculation of confidential data. It is a block diagram of an apparatus for performing synchronous image display by performing moving image reproduction and secret data extraction from secret data insertion compressed moving image data. It is a figure which shows two examples of confidential data display. It is a flowchart which shows the outline | summary of an example of a process of a secret data extraction part. It is a block diagram which shows the structure of the apparatus which has the conventional digital watermark insertion function. It is a figure which shows an example of the telop display displayed using description languages, such as conventional SMIL.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Secret data insertion part, 12 ... Secret data, 14 ... Partial decoding part, 15 ... Partial encoding part, 31 ... Quantization transformation coefficient extraction part, 32 ... Quantization Transform coefficient grouping unit, 33 ... Weight coefficient determination unit, 34 ... Quantized transform coefficient change unit, 71 ... Confidential data extraction unit, 72 ... Confidential data, 81 ... Quantized transform coefficient Extraction unit, 82 ... quantized transform coefficient grouping unit, 83 ... secret data calculation unit, 84 ... decoding unit, 85 ... display unit.

Claims (39)

A method of inserting secret data into image data,
Means for partially decoding compressed image data using transform coding;
Means for extracting quantized transform coefficients from the partial decoded data;
Means for embedding confidential data in the quantized transform coefficients;
A method for inserting secret data into image data, comprising means for re-encoding the image data in which the secret data is embedded. The method for inserting secret data into the image data according to claim 1,
The quantized transform coefficient is a component of a plurality of transform blocks,
The secret data embedding means inserts one bit of secret data for each quantized transform coefficient of each transform block. The method for inserting secret data into the image data according to claim 1,
The quantized transform coefficient is a component of a plurality of transform blocks,
The secret data embedding unit divides the quantized transform coefficient of the transform block into grouped partial areas, and inserts one bit of secret data for each partial area, and the secret data insertion into the image data method. In the secret data insertion method to the image data according to claim 3,
The method of inserting secret data into image data, wherein the partial area is divided according to frequency band. In the secret data insertion method to the image data according to claim 3,
The method of inserting secret data into image data, wherein the partial area is divided by sampling for each frequency band. In the secret data insertion method to the image data according to any one of claims 3 to 5,
The secret data insertion method for image data, wherein an intra-block region that is a division target of the partial region is a region from a low frequency component to a nonzero maximum frequency component of a quantized transform coefficient. In the secret data insertion method to the image data according to claim 6,
The number of partial areas to be grouped is determined by the position of the non-zero maximum frequency component of the quantized transform coefficient in the transform block. In the secret data insertion method to the image data according to claim 7,
The secret data insertion method for image data, wherein the number of partial areas to be grouped is increased or decreased according to the position of the non-zero maximum frequency component of the quantized transform coefficient. The method for inserting secret data into image data according to any one of claims 4 to 8,
The secret data insertion method for image data, wherein the order of arranging the frequency bands from low frequency to high frequency uses a scan order of quantization transform coefficients used in image coding. The method for inserting secret data into the image data according to claim 2,
The secret data embedding means has means for attaching secret data insertion weight to the quantized transform coefficient,
The secret data insertion weight assigning means changes the secret data insertion weight according to the frequency of the quantized transform coefficient. In the secret data insertion method to the image data according to claim 10,
The secret data insertion weight assigning means increases the insertion weight as the high-frequency quantization transform coefficient is increased. In the secret data insertion method to the image data according to claim 10 or 11,
The secret data insertion weight assigning means changes the insertion weight according to the magnitude of the value of the quantized transform coefficient. In the secret data insertion method to the image data according to claim 12,
The secret data insertion weighting means for secret data insertion into image data, wherein the secret data insertion weight assigning means lowers the insertion weight as the quantization transform coefficient value is smaller. In the secret data insertion method to the image data according to any one of claims 1 to 13,
The secret data embedding unit changes a representative value (hereinafter, referred to as a quantized representative value) of a quantized transform coefficient of the entire transform block or a partial region in accordance with the secret data, and according to the changed quantized representative value. A secret data insertion method for image data, wherein each quantized transform coefficient is changed. In the secret data insertion method to the image data according to claim 14,
The secret data insertion method for image data, wherein the quantized representative value is defined by a value obtained by dividing the total energy of quantized transform coefficients of the entire transform block or partial region by a secret strength value. The method for inserting secret data into the image data according to claim 15,
The secret data embedding means performs secret data embedding by embedding the secret data by making the quantized representative value even or odd according to 0 or 1 of the secret data. The method for inserting secret data into image data according to claim 15 or 16,
A secret data insertion method for image data, wherein an absolute sum of all quantized transform coefficients of the entire transform block or the corresponding partial region is used as the total energy. In the secret data insertion method to the image data according to claim 14,
The secret data embedding unit obtains an energy change amount of a corresponding region from the changed quantized representative value and the quantized representative value before the change, and changes each quantization transform coefficient according to the changed amount. A method for inserting confidential data into image data. The method for inserting secret data into image data according to claim 18,
The secret data embedding unit is a method for inserting secret data into image data, wherein each of the quantized transform coefficients is changed by weighting the change amount with the insertion weight. The method for inserting secret data into the image data according to claim 15,
The secret data insertion method for image data, wherein the secret strength value is changed in units of spatial regions such as frames, macroblocks, and blocks. The method for inserting secret data into image data according to claim 15 or 20,
A secret data insertion method for image data, wherein a flag indicating that the secret strength value or secret data is embedded is stored in an area such as a header of the compressed image data. The method for inserting secret data into image data according to claim 15 or 20,
The secret data insertion method for image data, wherein the secret strength value is embedded in the secret data. The method for inserting secret data into the image data according to claim 22,
A secret data insertion method for image data, wherein the secret strength value is embedded in a first block of a frame or a first block of each macro block. The method for inserting secret data into image data according to any one of claims 1 to 23,
A method for inserting secret data into image data, wherein a flag indicating that the secret data is embedded is embedded in the secret data. In the secret data insertion method to the image data according to claim 24,
A secret data insertion method for image data, wherein the flag is embedded in a first block of a frame or a first block of each macro block. A secret data detection method for detecting secret data from image data into which secret data is inserted,
Means for extracting the quantized transform coefficient from the compressed image data into which the confidential data is inserted in the quantized transform coefficient decoding stage;
A secret data detection method comprising: means for extracting secret data for each partial area in a block from a quantized transform coefficient in the block. The secret data detection method according to claim 26,
A secret data calculation unit for calculating the bit data of the secret data based on an even number and an odd number of values obtained by dividing the energy sum of the quantization transform coefficients in the partial region by the secret strength value. A secret data detection method characterized by this. The secret data detection method according to claim 26 or 27,
Means for detecting a flag indicating embedding of confidential data;
A secret data detection method, wherein secret data is extracted only when a flag indicating embedding is detected. An image data display method in which confidential data is inserted,
Means for extracting the secret data from the compressed image data into which the secret data is inserted in the quantized transform coefficient decoding stage;
Means for decoding the image data using the quantized transform coefficient after extracting the secret data;
A display method for image data into which confidential data is inserted, comprising: means for displaying the confidential data extracted from the compressed image data in synchronization with the image data. In the display method of the image data in which the confidential data according to claim 29 is inserted,
The means for extracting the secret data extracts the secret data for each partial area in the block from the quantized transform coefficient in the block. The display method of image data into which the secret data is inserted. In the display method of the image data in which the secret data according to claim 30 is inserted,
The bit data of the secret data is calculated by the even number and the odd number of values obtained by dividing the energy sum of the quantized transform coefficients in the partial area by the secret strength value. Display method of image data with inserted. In the display method of the image data in which the secret data according to any one of claims 29 to 31 is inserted,
The means for extracting the confidential data comprises means for detecting a flag indicating the embedded confidential data,
A display method of image data into which secret data is inserted, wherein secret data is extracted only when a flag indicating embedding is detected. In the display method of the image data in which the secret data according to any one of claims 29 to 31 is inserted,
A display method for image data into which secret data is inserted, further comprising means for acquiring data indicating a display position of the secret data. In the display method of the image data in which the secret data according to any one of claims 29 to 33 is inserted,
The display method of image data into which the secret data is inserted, wherein the secret data is media data. In the display method of the image data in which the secret data according to claim 34 is inserted,
The media data includes at least one of a moving image, a still image, and text data. An image data display method in which secret data is inserted. In the display method of the image data in which the secret data according to claim 34 is inserted,
The media data is object information related to a screen to be decoded, and a display method for image data into which secret data is inserted. In the display method of the image data in which the secret data according to claim 36 is inserted,
A display method of image data into which secret data is inserted, wherein the object information includes an object name, an attribute, and a description. In the display method of the image data in which the secret data according to any one of claims 29 to 37 is inserted,
The display method of image data into which the secret data is inserted, wherein the secret data is region information. In the display method of the image data in which the confidential data according to claim 38 is inserted,
The area information is mask information, and the non-attention area in the image data is masked with the mask information so as not to be displayed.

Images