JP2003134329A - Electronic watermark burying processor, electronic watermark burying processing method and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a processing constitution for burying an electronic watermark hardly recognizable in the usual observing condition without lowering the detection accuracy. SOLUTION: A plurality of electronic watermark algorithms are selectively applied to bury an electronic watermark and a user is allowed to select the algorithm. A first and second algorithm setting means are provided for determining the electronic watermark burying algorithm, based on combined information or selected information by these plurality of setting means. This constitution makes it possible to select an optimum burying algorithm, with taking the human's audiovisual properties into consideration, and hence ensures that burying additional information in target data, i.e., picture or sound data deteriorates the quality thereof.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for embedding or reading additional information such as copyright information and editing information in image data such as moving images and still images, or music, voice and various other data. For example, digital watermark (watermark: Digital Watermarkin) as additional information that is difficult to recognize in normal observation or listening condition in images and audio data.
g, or also referred to as Data Hiding), a digital watermark embedding processing device, a digital watermark embedding processing method, and a computer program.

[0002]

2. Description of the Related Art With the progress of digital technology, digital recording / reproducing apparatuses have been popularized which are free from image quality deterioration and sound quality deterioration caused by repetitive execution of recording / reproducing processing.
Various kinds of images, music, and other digital tattel contents have become available for distribution and distribution through media such as digital VTRs, DVDs, CDs, or networks.

Unlike analog recording / reproduction, digital recording / reproduction does not cause data deterioration even if recording / reproduction processing is repeatedly executed, and therefore the same quality as original data is maintained. The widespread use of such digital recording / reproducing technology results in a flood of illegal copies, which is a major problem from the viewpoint of copyright protection.

In order to deal with copyright infringement due to illegal duplication (copying) of digital contents, duplication control information for duplication control is added to the digital contents,
There has been proposed a configuration for preventing unauthorized copying by reading the copy control information at the time of recording / reproducing the content and executing a process according to the read control information.

There are various modes for controlling content duplication. For example, a typical method is CGMS (Copy).
Generation Management Sys
tem; copy generation management
System) method. In the CGMS system, if it is an analog video signal (called CGMS-A), a specific one horizontal section within the vertical blanking period of the luminance signal,
For example, in the case of an NTSC signal, 2 bits of the 20-bit additional information superimposed on the effective video portion of the 20th horizontal section are superimposed as information for duplication control, and are also called a digital video signal (CGMS-D). 2), the 2-bit information for copy control is transmitted as additional information to be inserted and added to the digital video data.

In the case of this CGMS system, the meaning content of 2-bit information (hereinafter referred to as CGMS information) is [00].
...... Duplicate is possible [10] ...... It is possible to duplicate once (only one generation can be duplicated) [11] ... Duplicate is prohibited (absolute duplicate is prohibited).

The above-mentioned CGMS system is an example of a typical copy control system, and there are various other systems for protecting copyright of contents. For example, in digital broadcasting performed by a broadcasting station, program sequence information (S) included in a transport stream (TS) packet that constitutes digital data.
There is a method in which a digital copy control descriptor (Digital Copy Control Descriptor) is stored in (I: Service Information), and copy generation control according to the descriptor is performed when data received by a receiving device is recorded in a recording device.

However, the above control information is added as bit data to, for example, the header of the content, and it is difficult to completely eliminate the possibility of tampering with the added data. A digital watermark (watermark) is an advantageous configuration in terms of eliminating the possibility of data tampering. Watermarks are difficult to see or perceive in the playback state of normal contents (image data or audio data), and the detection and embedding of digital watermarks can only be performed by executing specific algorithms or processing by specific devices. It will be possible. By detecting a digital watermark (watermark (WM)) at the time of content processing in a receiver, a recording / reproducing device, and the like, and performing control according to the digital watermark, more reliable control is possible.

Digital watermark (watermark (WM))
The information embedded in the content by the content is not limited to the above-mentioned copy control information, but various information such as content copyright information, content processing information, content configuration information, content processing information, content editing information, or content reproduction processing method. Can be embedded.

A digital watermark (watermark) that is directly superimposed on an information signal has a high resistance to tampering.
Expected as secure additional information. However, in this digital watermark (watermark) technology,
The image quality of an image in which a digital watermark (watermark) is embedded may be questioned. Since the electronic watermark (watermark) applies signal processing to embedding target data (for example, an image), there is a possibility that the original data may be deteriorated by causing the image quality deterioration and the statistical property of the image to be biased. There is a demand for a digital watermark embedding process configuration that does not adversely affect such contents.

Conventionally, as a structure for preventing deterioration of the original data, parameters for embedding the electronic watermark (watermark) have been set in each data area in the original data such as an image to be embedded in the electronic watermark. There is also known a control method in which a digital watermark superimposing amount adjustment parameter (global parameter) in the entire data area is set again in consideration of image quality deterioration.

[0012]

As a control method for embedding a digital watermark (watermark), a process of increasing the embedding amount by utilizing the property of an image or minimizing the embedding level and giving priority to the image quality. There are various processing methods, such as those that execute embedding processing, but both satisfying both digital watermark detection accuracy and image quality deterioration prevention at the same time,
There cannot be a common digital watermark embedding algorithm for all information signals such as images and sounds to be digital watermark embedding targets. Therefore, in some cases, the quality of data signals such as images and sounds may be deteriorated by the digital watermark embedding process, and in some cases, the reliability of the detection of the digital watermark in which the embedding process is performed is reduced. Occurs.

In the digital watermark superimposing amount control method using the global parameters as described above, the first algorithm for determining the initial embedding parameter is used to first determine the optimum watermark embedding amount in each data area. Then, after that, the adjustment is performed by applying the final global parameter. Therefore, in the first algorithm, the optimum parameters initially set in each data area are forced to be changed by setting the global parameters in consideration of image quality deterioration.

The global parameter setting process is as follows.
It may not be preferable from the viewpoint of detection of a digital watermark. That is, the initial optimum parameter is set as the optimum parameter for maintaining the embedding level for ensuring detection, but if this is changed by the setting of the global parameter, sufficient detection strength cannot be obtained. This is because a case occurs.

Further, in spread spectrum, which is generally known as a method of embedding additional information in an information signal, it is possible to superimpose, on an analog signal, information of any minute level on an original signal. However, in the case of a digital signal, it is easy to embed the original signal above the quantization level, but it is not possible to embed it below that level. For example, when the digital watermark embedding target data is 8 bits, If there is a level less than a bit, the process of embedding is executed by rounding off or distributing it inconspicuously based on some random number.

However, when the digital watermark is embedded by the method as described above, if the embedding target data is, for example, an image, the embedding is executed irrespective of the nature of the image. However, there is a problem in that it becomes visually obtrusive like false contours and noise, and is easily noticeable. Even when the embedded data is voice, there is a problem that noise is generated.

The present invention has been made in view of the above-mentioned problems of the prior art, and combines a digital watermark embedding algorithm that can be arbitrarily set by the user's selection and a preset digital watermark embedding algorithm. Additional information (digital watermark) embedded in the information signal such as image / audio data by performing digital watermark embedding using
It is an object of the present invention to provide a digital watermark embedding processing device, a digital watermark embedding processing method, and a computer program capable of reducing the deterioration of quality due to the above and ensuring the detection reliability of the additional information.

[0018]

The first aspect of the present invention is as follows.
A digital watermark embedding processing device for executing a digital watermark embedding process, wherein a digital watermark embedding algorithm to be applied to digital watermark embedding target data is selected and determined from a plurality of previously applicable algorithms based on setting information. A parameter setting means, a second parameter setting means for selecting and determining a digital watermark embedding algorithm to be applied to digital watermark embedding target data from a plurality of previously applicable algorithms based on user-specified information; Parameter setting means, output algorithm determining means for setting an execution algorithm based on the algorithm determined by the second parameter setting means, and digital watermark information signal generating means for generating digital watermark information based on additional information to be embedded as a digital watermark. And before A digital watermark level control means for generating a digital watermark pattern to which the digital watermark embedding algorithm determined by the output algorithm determination means is applied, based on the digital watermark information generated by the digital watermark information signal generation means, and the digital watermark level control means. And a digital watermark embedding unit that executes a process of embedding the digital watermark pattern output by the above in the digital watermark embedding target data.

Further, in an embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark embedding processing apparatus further comprises a superimposition part selecting means for dividing a data area of the digital watermark embedding target data, 1
At least one of the parameter setting means and / or the second parameter setting means selects and decides a digital watermark embedding algorithm to be applied to each of the divided data areas of the superposed portion selecting means from a plurality of previously applicable algorithms. It is characterized in that it has a configuration for executing the processing.

Further, in an embodiment of the digital watermark embedding processing device of the present invention, the superposed portion selecting means is
The data area of the digital watermark embedding target data is divided based on frequency characteristics, and at least one of the first parameter setting means and the second parameter setting means is data divided based on frequency characteristics. The digital watermark embedding algorithm applied to each of the areas is configured to execute a process of selecting and determining from a plurality of applicable algorithms in advance.

Further, in one embodiment of the digital watermark embedding processing device of the present invention, the superposed portion selecting means is
The data area of the electronic watermark embedding target data is divided based on the discrimination of the edge area, and at least one of the first parameter setting means and the second parameter setting means is divided based on the edge area. The digital watermark embedding algorithm applied to each of the data areas is selected from a plurality of applicable algorithms in advance, and the processing is executed.

Further, in an embodiment of the digital watermark embedding processing device of the present invention, the superposed portion selecting means is
The data area of the digital watermark embedding target data is configured to divide a time-series data frame into frame units, and at least one of the first parameter setting unit and the second parameter setting unit is a data frame. The digital watermark embedding algorithm to be applied to each of the data areas divided based on is selected from a plurality of algorithms that can be applied in advance.

Further, in an embodiment of the digital watermark embedding processing device of the present invention, the superposed portion selecting means is
The data area of the digital watermark embedding target data is divided based on the spatial position information, and at least one of the first parameter setting unit and the second parameter setting unit is divided based on the spatial position information. The digital watermark embedding algorithm applied to each of the data areas is selected from a plurality of applicable algorithms in advance, and the processing is executed.

Further, in an embodiment of the digital watermark embedding processing device of the present invention, the digital watermark superimposing means has a multi-gradation processing section for performing multi-gradation conversion processing of the digital watermark embedding target data, The multi-gradation processing unit is configured to execute a process of embedding the digital watermark pattern output from the digital watermark level control means into the data after the multi-gradation conversion process of the digital watermark embedding target data.

Further, a second aspect of the present invention is a digital watermark embedding processing method for executing a digital watermark embedding process, wherein a plurality of digital watermark embedding algorithms applicable to digital watermark embedding target data can be applied in advance. The first parameter setting step of selecting and deciding on the basis of the setting information from among the algorithms and the digital watermark embedding algorithm to be applied to the digital watermark embedding target data from among a plurality of previously applicable algorithms based on the user-specified information. A second parameter setting step for selecting and determining by the above, the first parameter setting step, an output algorithm determining step for setting an execution algorithm based on the algorithm determined in the second parameter setting step, and additional information to be embedded as a digital watermark. To Based on the digital watermark information generated in the digital watermark information signal generating step, a digital watermark pattern applying the digital watermark embedding algorithm determined in the output algorithm determining step And a digital watermark superimposing step of executing a process of embedding the digital watermark pattern output in the digital watermark level control step into the digital watermark embedding target data. There is a digital watermark embedding processing method.

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark embedding processing method further comprises a superimposing portion selecting step of dividing a data area of the digital watermark embedding target data, In one parameter setting step or in at least one of the second parameter setting step, a digital watermark embedding algorithm to be applied to each of the data areas divided in the superposed portion selecting step is selected from a plurality of previously applicable algorithms. It is characterized by executing a process of determining.

Further, in an embodiment of the digital watermark embedding processing method of the present invention, the superimposing portion selecting step executes a process of dividing a data area of the digital watermark embedding target data based on a frequency characteristic, In the parameter setting step and / or at least one of the second parameter setting step, a digital watermark embedding algorithm to be applied to each of the data areas divided based on frequency characteristics is selected from a plurality of previously applicable algorithms. It is characterized in that a process of selecting and determining is executed.

Further, in an embodiment of the digital watermark embedding processing method of the present invention, the superposed portion selecting step executes a process of dividing a data region of the digital watermark embedding target data based on a discrimination of an edge region, At least one of the first parameter setting step and the second parameter setting step is a digital watermark embedding algorithm applied to each of the data areas divided based on the edge area. It is characterized in that a process of selecting and determining from the inside is executed.

Further, in an embodiment of the digital watermark embedding processing method of the present invention, the superimposing portion selecting step executes division of the data area of the digital watermark embedding target data into time series data frames in frame units,
In at least one of the first parameter setting step and the second parameter setting step, a plurality of digital watermark embedding algorithms that can be applied in advance to each of the data areas divided based on the data frame can be applied. It is characterized by executing a process of selecting and determining from the algorithm.

Further, in an embodiment of the digital watermark embedding processing method of the present invention, the superposed portion selecting step executes a process of dividing a data area of the digital watermark embedding target data based on spatial position information, In one parameter setting step or in at least one of the second parameter setting step, a digital watermark embedding algorithm to be applied to each of the data areas divided based on the spatial position information can be applied in advance. It is characterized in that a process of selecting and determining from the inside is executed.

Further, in an embodiment of the digital watermark embedding processing method of the present invention, the digital watermark superimposing step includes a step of performing a multi-gradation conversion processing of the digital watermark embedding target data, and in the multi-gradation processing. It is characterized in that a process of embedding a digital watermark pattern output in the digital watermark level control step is executed in the data after the multi-gradation conversion process of the digital watermark embedding target data.

Further, a third aspect of the present invention is a computer program for executing a digital watermark embedding process, wherein a plurality of digital watermark embedding algorithms applicable to digital watermark embedding target data can be applied in advance. The first parameter setting step of selecting and determining from the algorithms based on the setting information and the digital watermark embedding algorithm to be applied to the digital watermark embedding target data are selected from a plurality of previously applicable algorithms based on the user designation information. A second parameter setting step for making a selective decision; the first parameter setting step; an output algorithm determining step for setting an execution algorithm based on the algorithm decided in the second parameter setting step; and additional information to be embedded as a digital watermark. Based on the digital watermark information generated in the digital watermark information signal generating step, a digital watermark pattern applying the digital watermark embedding algorithm determined in the output algorithm determining step And a digital watermark superimposing step of executing a process of embedding the digital watermark pattern output in the digital watermark level control step into the digital watermark embedding target data. It is in a computer program.

The computer program of the present invention is, for example, a storage medium or communication medium provided in a computer-readable format for a general-purpose computer system capable of executing various program codes, such as a CD or FD. , MO, etc., or a computer program that can be provided by a communication medium such as a network. By providing such a program in a computer-readable format, processing according to the program is realized on the computer system.

Further objects, features and advantages of the present invention are as follows.
It will be clarified by a more detailed description based on embodiments of the present invention described below and the accompanying drawings. In this specification, the system is a logical set configuration of a plurality of devices, and is not limited to a device in which each configuration is provided in the same housing.

[0035]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The details of the digital watermark embedding processing apparatus and the digital watermark embedding processing method of the present invention will be described below with reference to the drawings.

FIG. 1 shows an example of the configuration of the digital watermark embedding processing apparatus of the present invention. The digital watermark (WM) embedding target data 11 is images, audio data, program data, etc. as digital watermark embedding target data, and is read from a storage medium such as a hard disk or a DVD, or a scanner, a digital camera, or the like. It includes various data such as images supplied from the image capture device.

Digital watermark (WM) information signal generator 13
Performs coding processing of additional information to be embedded as a digital watermark, and generates coded digital watermark information. The process in the digital watermark (WM) information signal generation unit 13 is a process for encoding based on bit information that forms various additional information such as copy control information, copyright information, and edit information as additional information to be embedded in data. To be executed. The encoding process is executed based on, for example, spread spectrum process. Details of the processing in the digital watermark (WM) information signal generation unit 13 will be described later.

The digital watermark embedding processing apparatus of the present invention shown in FIG. 1 uses the additional information at a level lower than the data level (eg, bit level, quantization level) of the digital watermark (WM) embedding target data (information signal). A process of superimposing digital watermark (WM) information based on the information is executed. For example,
When the digital watermark (WM) embedding target data (information signal) is image data consisting of 8-bit pixel values, the digital watermark (WM) information based on the additional information is converted into 10-bit level LSB (Least Significant Bit) 2 bits. And processing to add it to digital watermark (WM) embedding target data.

Digital watermark (WM) embedding target data 1
1 is supplied to the multi-gradation processing unit 12, and the multi-gradation processing unit 12
In the digital watermark (WM) embedding target data 11
The multi-gradation conversion processing based on is executed. The multi-gradation conversion process is, for example, a process of converting the digital watermark (WM) embedding target data 11 into image data in which each pixel value is 8-bit data, for example, 10-bit data, A process of converting into bit data larger than data is shown.

As an example of the multi-gradation conversion processing executed on the digital watermark (WM) embedding target data 11 in the multi-gradation processing unit 12, DCT (Discrete Cosine) is given.
Transform: Discrete cosine transform) processing. In the multi-gradation processing unit 12, the DCT is applied to the input digital watermark (WM) embedding target data 11, for example, the image Vn (8 bits).
The total operation word length of the DCT coefficient obtained by executing the operation is 14 bits at the maximum.

As the multi-gradation conversion processing in the multi-gradation processing unit 12, filter processing such as LPF, BPF, HPF, DCT, wavelet conversion, JPEG,
MPEG, fractal conversion, ATRAC, MP3, AC
3, various types of encoding processing such as AAC, ADPCM, CELP, and TwinV, orthogonal transformation processing, and the like can be applied, and compression processing may be involved. Further, the multi-tone conversion process may be an irreversible conversion process or a reversible conversion process, and is requantized after superimposing digital watermark information, or decoded after superimposing digital watermark information,
Further, the data level (bit level, quantization level) of the original information signal may be restored by requantization, or it may be left as it is.

The multi-gradation information signal subjected to the multi-gradation conversion processing in the multi-gradation processing section 12 is supplied to the digital watermark embedding processing section 14. Digital watermark embedding processor 1
4 executes the embedding process of the digital watermark information received from the digital watermark (WM) information signal generation unit 13 on the extended information signal unit generated by the multi-gradation conversion process. That is, if the original digital watermark embedding data is 8 bits and multi-gradation processing is performed on 10-bit data, 1
The digital watermark embedding process is executed on the low-order 2-bit extended information signal portion generated by the 0-bit conversion. The data that has undergone the digital watermark embedding process is
The data is supplied to the data conversion unit 15 and converted into the original data level (for example, bit level or quantization level) of the digital watermark (WM) embedding target data (information signal), and then output as the digital watermark embedded data 16. .

In the digital watermark embedding processing apparatus of the present invention, the digital watermark based on the additional information is lower than the data level (eg, bit level, quantization level) of the digital watermark (WM) embedding target data (information signal). (WM) A process of superimposing information is executed.

For example, in the case of embedding a digital watermark in the multi-gradation data by the above DCT processing, 8 × 8 (=
When the bit information of the digital watermark is embedded as additional information (S) on the DCT coefficient (VDC) of 64), when the original digital watermark (WM) embedding target data is the image (Vn), the digital watermark embedded image data ( Vn ') is V
Since n ′ = (VDC + S) / 64, it is possible to add information at the level of 1/64 and prevent deterioration of the original image.

In this way, it is possible to superimpose additional information as a digital watermark at a level smaller than the original digital watermark (WM) embedding target data. Further, in this case, if the operation word length is held at or above the original quantized data (for example, 10 bits) in the process of operation processing such as multi-gradation conversion and encoding processing, it becomes 8 in each pixel-based conversion. Since the image data of the low gradation part of less than bits exists, even if the quantization level is returned to the original quantization level after addition of the additional information, only the additional information of less than the 8-bit level is deleted. There is no such thing. In this way, by ensuring the operation word length up to the level of additional information to be embedded, embedding can be realized in a very small unit.

Further, it becomes possible to reflect the additional information in accordance with the state of the image in accordance with the ratio of the level of the image which is the digital watermark (WM) embedding data, for example, and the additional information, and the compatibility with the original information is improved. Since the additional information is embedded one after another from the high portion, it is possible to embed the image information so that it is difficult to perceive deterioration of the image quality. In the multi-gradation processing section,
In this way, the conversion process of the digital watermark (WM) embedding target data is executed, and the gradation of the digital watermark (WM) embedding target data (information signal) is performed.

The concept of the low gradation part superimposing process will be described with reference to FIG. FIG. 2 shows an example in which the digital watermark embedding target data 51 is data having an 8-bit pixel value, and the multi-gradation processing unit 52 executes conversion processing from 8-bit data to 10-bit data. The lower part of FIG. 2 conceptually shows the bit information structure. The multi-gradation conversion processing of such data in the multi-gradation processing unit 52 is performed by, for example, LP.
It is realized by a filter process by F or a DCT process.

The digital watermark information signal is encoded in the digital watermark information signal generating section 53 on the basis of bit information that constitutes various additional information such as copy control information, copyright information, and edit information as additional information. Run as. This encoding processing can include, for example, spread spectrum processing. The encoding process including the spread spectrum process will be described later.

The digital watermark information signal is generated as 2-bit information in the digital watermark information signal generating section 53, and is generated in the digital watermark embedding processing section 54 in the digital watermark information signal generating section 53 as shown in the lower part of FIG. The digital watermark embedding process is executed as a process of adding the 2-bit information thus obtained to the low-order 2 bits which is the extended information signal part generated by multi-gradation processing by the multi-gradation processing part 52. The data conversion unit 55 executes the process of converting the digital watermark embedded 10-bit data generated by the digital watermark embedding processing unit 54 into the same 8-bit data as the original data.
This process is the reverse of the multi-gradation process, such as IDCT (In
verse Discrete Cosine Transform) processing and inverse filtering processing. In this way, the digital watermark information is embedded in the low-order bits of the original data that has been subjected to multi-gradation processing, and is subjected to another gradation conversion processing by inverse conversion, and is output as digital watermark embedded data.

FIG. 3 shows a detailed configuration example of the digital watermark embedding processing apparatus shown in FIG. The outline of the process of embedding a digital watermark pattern in an image will be described below with reference to FIG. The details of the processing in each processing means will be described later.

Digital watermark (WM) embedding target data 1
Reference numeral 01 is data such as images, audio data, and program data as embedding data of the digital watermark pattern, which is read from a storage medium such as a hard disk or a DVD or supplied from an image capturing device such as a scanner or a digital camera. Various data such as a captured image are included.

Digital watermark (WM) embedding target data 1
01 is output to the superimposed portion selection unit 102 of the digital watermark embedding processing device. The superposed portion selection unit 102 executes a process of separating the data into a plurality of portions based on the characteristics of the digital watermark (WM) embedding target data that is the input signal. For example, in the case of image data, it is divided into an edge portion and other portions, or a high frequency region and a low frequency region. The edge portion or high frequency area in the image data is an area in which the rate of change of the pixel values forming the image in a predetermined area is large, and generally in such an area,
Even if you embed a digital watermark at a strong level, it will not stand out. On the other hand, the low frequency region is, for example, an image region in which uniform pixel values spread. For example, it is an area occupied by uniform brightness and colors such as "sky". When embedding a digital watermark in such an area, if the embedding strength (level) is increased, the digital watermark (WM) is visually recognized even in a normal observation state, and in general, the embedding processing is performed by lowering the embedding strength. To be executed.

The superimposition portion selection unit 102 executes the data analysis of the digital watermark (WM) embedding target data as described above, and based on the characteristic of the digital watermark (WM) embedding target data, the superimposing portion selecting unit 102 stores the data in a plurality of portions, for example, A process of separating a high frequency part and a low frequency part into a plurality of regions is executed. Specific processing of the overlapping portion selection unit 102 will be described later.

The data separated into a plurality of parts by the superposed part selection unit 102 is output to the superposed amount determination unit 103. The first parameter setting unit 103 is a processing unit that executes a process of selecting an algorithm to be applied from among a plurality of digital watermark (WM) embedding algorithms prepared in advance, and the application parameters are set based on preset information.
That is, the applied digital watermark algorithm is set. First
The parameter setting unit 103 determines to apply a previously assigned algorithm according to the data output from the superposed portion selection unit 102. For example, when the data output from the overlapping portion selection unit 102 is separated into edge area data and non-edge area data, algorithm A is applied to the edge area data and algorithm B is applied to the non-edge area. Setting information for executing, etc. is stored in advance in the storage unit of the first parameter setting unit 103, and the applied algorithm is determined based on the setting information.

Further, the second parameter setting unit 104 applies a digital watermark (WM) embedding algorithm applied to each of the data separated into a plurality of parts by the superposed part selection unit 102 based on the input from the user input unit 111. To decide. The process of applying the plurality of algorithms will be described in detail later. First parameter setting unit 1
03, and the plurality of algorithms determined by the second parameter setting unit 104, for example, via an output algorithm determination unit that executes a synthesis processing calculation process such as addition,
It is output to the digital watermark (WM) level control unit 106.

Digital watermark (WM) information signal generator 107
Performs the encoding process of the additional information 110 to be embedded as a digital watermark to generate digital watermark information. The processing in the digital watermark (WM) information signal generation unit 107 is performed by processing the digital watermark corresponding to the bit information 110 forming various additional information such as copy control information, copyright information, and edit information as additional information to be embedded in data. It is executed as a modulation process and an encoding process based on various control information when embedding in, for example, image division information and control information such as bit array information. Encoding in the digital watermark (WM) information signal generation unit 107 can be performed as encoding including, for example, spread spectrum or patchwork method. Details of these processes will be described later.

Digital watermark (WM) information signal generator 107
The digital watermark information generated in
M) Output to the level control unit 106. Digital watermark (W
The M) level control unit 106 inputs the digital watermark information generated by the digital watermark (WM) information signal generation unit 107, and the digital watermark embedding algorithm selected by the superimposition amount determination unit 103 corresponding to each data area. The digital watermark embedding level is adjusted for each data area by inputting the superimposition level information based on the above, and the level adjustment is performed for each data area by applying the algorithm determined by the superimposition amount determination unit 103 described above. The watermark (WM) pattern is applied to the digital watermark (WM) superimposing unit 10.
Output to 8.

The digital watermark (WM) superimposing unit 108 inputs the digital watermark (WM) embedding target data 101, and performs filter processing such as the above-mentioned LPF, BPF, HPF, DCT, wavelet conversion, JPEG, M.
PEG, fractal conversion, ATRAC, MP3, AC
3, multi-gradation conversion processing is executed by various kinds of encoding processing such as AAC, ADPCM, CELP, TwinV, and orthogonal conversion processing, and the data digital watermark (WM) level control unit 10 is executed.
Input the level-adjusted digital watermark (WM) pattern from No. 6, and embed the digital watermark (WM) embedding data 1
The digital watermark embedding process for 01 is executed and output as digital watermark (WM) embedded data 109.

In the configuration shown in FIG. 3, a process of selecting an algorithm to be applied from among a plurality of digital watermark (WM) embedding algorithms prepared in advance according to preset setting information is executed. First parameter setting unit 103 and user input unit 11
1 is an example of a configuration for synthesizing information with the second parameter setting unit 103 that determines the algorithm to be applied based on the input from 1 and outputting it to the digital watermark (WM) level control unit 106, as shown in FIG. And a first parameter setting unit 103 that executes a process of selecting an algorithmically according to the setting information without executing the algorithm synthesizing process,
Based on the input from the user input unit 111, a switch 121 for selecting an output from the second parameter setting unit 103 that determines an algorithm to be applied is provided as an output algorithm determining means, and only one of the algorithms is electronically determined. The watermark embedding algorithm may be selected and applied.

The above is the outline of the digital watermark embedding process of the present invention. Hereinafter, details of the processing in each processing unit will be described.

[Processing in Superposed Portion Selection Unit] A specific example of processing in the superposed portion selection unit 102 shown in FIG. 3 will be described. The superimposed portion selection unit 102 displays the digital watermark (W
M) The data analysis of the embedding target data is executed, and based on the characteristics of the digital watermark (WM) embedding target data,
Perform the process of separating the data into multiple parts.

As described above, the overlapping portion selection unit 102
If the digital watermark (WM) embedding target data, which is an input signal, is image data, for example, the edge part and the other part are divided, or the high frequency region and the low frequency region are separated.

FIG. 5 shows a configuration example of a superposed portion selection unit having a configuration for performing frequency-based data area division. The superposed portion selection unit in this configuration example is a low-pass filter (L
PF) 201, bandpass filter (BPF) 202,
And a high-pass filter (HPF) 203, and digital watermark (WM) embedding target data is input to each filter. The outputs from the filters 201 to 203 are data obtained by extracting predetermined frequency domain data, and the low frequency domain, high frequency domain, and intermediate frequency domain data are separated and output. The separated data are output to the first parameter setting unit 103 shown in FIG. 3, and the digital watermark embedding algorithm to be applied to each separated data is determined in the first parameter setting unit 103.

FIG. 6 shows an example of the structure of a superposed portion selection unit having a structure for executing data area division based on edge detection.
The overlapping portion selection unit in this configuration example is the edge detection unit 30.
1, the digital watermark (WM) embedding target data is input to the edge detection unit 301. The edge detection unit 301 can be configured by frequency detection means. The edge detection unit 301 separates and outputs the edge area and the non-edge area of the input data. The separated data are shown in Figure 3.
Is output to the first parameter setting unit 103, and the first parameter setting unit 103 determines the digital watermark embedding algorithm to be applied to each separated data.

When the input data to be the digital watermark embedding process is a moving image, the superposed portion selection unit
It is possible to execute a process of separating the data frames forming the moving images input in time series at a predetermined number or at predetermined time intervals. FIG. 7 shows an example of superposed portion selection processing by frame division. The frame data that constitutes the moving image is shown in FIG.
As shown in FIG. 7, assuming that the frames are sequentially input from the frame k, the overlapping portion selection unit separates the frames at a predetermined number or at predetermined time intervals, and selects the selection data A, B, respectively.
C. ． ． The process of separating as is executed. The separated data are respectively stored in the first parameter setting unit 10 shown in FIG.
3, the digital watermark embedding algorithm to be applied to each separated data is determined by the first parameter setting unit 103.

The frame division is performed based on the number of frames and time, in addition to detecting a scene change, a delimiter portion of an image or a sound, and performing a separation process based on the delimiter portion, a frequency component distribution, It is possible to perform processing in various modes such as performing frame division based on edge / peak distribution, frames, and time difference amount.

When the input data to be the digital watermark embedding process is image data, as shown in FIG.
It is possible to execute the space division processing based on the space position information. In the example shown in FIG. 8, the embedding target data 50
1 shows an example in which 1 is divided into four areas, areas a, b, c and d. The overlapping portion selection unit separates the image data into a plurality of pieces by space division. The separated data are output to the first parameter setting unit 103 shown in FIG. 3, and the digital watermark embedding algorithm to be applied to each separated data is determined in the first parameter setting unit 103.

Note that the example shown in FIG. 8 shows an example of processing for spatially dividing the image data spatially. However, for example, a configuration for performing spatial division processing based on the difference in output level through the filter, etc. May be

The data division processing in the superposed portion selection unit 102 is not limited to the above processing example, and various processing modes according to the digital watermark (WM) embedding target data are possible. For example, if the digital watermark (WM) embedding target data is image data, data separation processing according to the brightness level of each pixel is performed. If the digital watermark (WM) embedding target data is audio data, the data level is set to the audio level. Accordingly, it is possible to perform processing such as separating the data into a plurality of parts.

[Processing in Parameter Setting Unit] The data separated into a plurality of parts by the superposed part selecting unit 102 is output to the first parameter setting unit 103. The first parameter setting unit 103 is a processing unit that executes a process of determining an algorithm to be applied from among a plurality of digital watermark (WM) embedding algorithms prepared in advance. This determination processing is determined based on preset information.
On the other hand, in the second parameter setting unit 104, based on the input from the user input unit 111, a digital watermark (WM) embedding algorithm to be applied to each of the data separated into a plurality of parts in the superimposed part selection unit 102 is determined. .

FIG. 9 shows an example of a plurality of algorithms. FIG. 9 shows examples of three digital watermark embedding algorithms. The digital watermark embedding process is a process of embedding bit information that constitutes copy control information, copyright information, edit information, etc., as additional information to be embedded in data, and how data corresponding to, for example, bit 1 or bit 0 is imaged. It is an electronic watermark embedding algorithm that defines whether to embed data into data such as voice.

Before describing each of the algorithms in FIG. 9, an example of digital watermark embedding processing using image data and detection processing will be described. Let P be the original image that is the target of the electronic watermark embedding, and let L be the electronic watermark pattern to be embedded in the original image P. At this time, the digital watermark pattern L satisfies the following equation.

[0073]

[Equation 1]

As an example, the original image P and the digital watermark pattern L are set as in the following equation. That is,

[0075]

[Equation 2]

However, in the above equation, for simplicity, the original image P
Has a size of 5 × 4 pixels. Since adjacent pixels in an image generally have a value close to each other, adjacent elements of the original image P are set as close values.

The digital watermark embedding process is executed based on the following equation.

[0078]

[Equation 3] M = P + L

Here, M represents an image in which the digital watermark pattern L is embedded in the original image P. The value of M is calculated as follows in the example shown in [Equation 2] above.

[0080]

[Equation 4]

This digital watermark pattern L is used to detect the digital watermark. The detection of the digital watermark in the original image P in which the digital watermark L is not embedded is defined by the following equation.

[0082]

[Equation 5] s = P · L

It is defined as Here, the operator “·” is the inner product of the matrix, and s is the inner product value of the original image P and the digital watermark pattern L.

Since the total sum of the elements of the digital watermark pattern is 0 (see [Equation 1]), and the adjacent pixels of the image tend to have generally close values, the inner product value s is close to 0. It becomes a value. In the example shown in [Equation 2] above,
The inner product value is as follows.

[0085]

[Equation 6]

Next, the same calculation is performed on the image M in which the digital watermark is embedded. In the detection of the digital watermark for the image M in which the digital watermark L is embedded, the inner product value s ′ is obtained according to the following equation, as in the above.

[0087]

[Equation 7]

While the inner product value of the original image P and the digital watermark pattern L becomes a value near 0, the inner product value s ′ of the image M in which the digital watermark is embedded and the digital watermark pattern L is
It is near the inner product value of the digital watermark pattern L itself. That is,

[0089]

[Equation 8] L / L

It becomes a value near the above formula [Equation 8]. The inner product value L·L can be used as a measure of the embedding strength of a digital watermark. When the target inner product value L·L when embedding the digital watermark pattern is large, the embedding strength of the digital watermark is expressed as “strong”, and when the inner product value L·L is small, the embedding strength of the digital watermark is expressed as “weak”. To do.

When the absolute value of the inner product value s of the original image P and the digital watermark pattern L and the inner product value s'of the image M in which the digital watermark is embedded and the digital watermark pattern L is a large value, the digital watermark is detected. The strength is expressed as “strong”, and the detection strength of the digital watermark is expressed as “weak” when the absolute value of the inner product value s or the inner product value s ′ is a small value.

Further, when the detection strength of the digital watermark is strong, the correlation between the image and the digital watermark pattern is “large” or “high”, and when the detection strength of the digital watermark is weak, the correlation between the image and the digital watermark pattern is “high”. It may be expressed as "small" or "low".

When the inner product value s ′ of the original image P and the digital watermark pattern L and the inner product value s ′ of the digital watermark embedded image M and the digital watermark pattern L are obtained in various images,
The relative frequency distributions thereof are represented by the probability density functions f and f ′, and are as shown in FIG.

When determining whether or not the digital watermark is embedded in the image, the inner product value s of the image P in which the digital watermark is not embedded and the digital watermark pattern L is distributed around 0, and The fact that the inner product value s ′ of the image M in which is embedded and the digital watermark pattern L is distributed around L·L, which is the inner product value of the digital watermark pattern L itself, is used. The inner product value s ″ of the image to be checked for the presence or absence of the digital watermark and the digital watermark pattern L is obtained, and the presence or absence of the digital watermark pattern is determined by comparison with a certain threshold value (th). Specifically, the following formula is applicable. Is.

[0095]

[Equation 9] s ”<th then no-watermark s ”≧ th then watermarked

In the above equation, the inner product value s ″ of the image for which the presence or absence of the digital watermark is to be checked and the digital watermark pattern L is the threshold value (t
When it is smaller than h), no watermark pattern is embedded. When the inner product value s ″ is equal to or larger than the threshold value (th), it is determined that the digital watermark pattern is embedded, and the illustration is as shown in FIG.

The method of embedding multi-bit information in an image with a digital watermark is roughly classified into a method of using a plurality of digital watermark patterns, a method of dividing an image into small regions, and a composite method of these.

In the method using a plurality of digital watermark patterns, a method of expressing desired information by embedding it in an image by giving different meanings to the plurality of digital watermark patterns and a plurality of digital watermark patterns are overlapped at the same time. A method of embedding desired information by embedding it in an image and combining it, and a method of combining these two methods are considered. FIG. 12 shows how a plurality of digital watermark patterns are embedded in the original image.

A method of expressing desired information by embedding in a picture exclusively by giving different meanings to a plurality of digital watermark patterns is necessary when the number of bits of the information to be embedded in the picture is b. The type n of the digital watermark pattern is n = 2 ^b . On the other hand, in the method of simultaneously embedding a plurality of digital watermark patterns and embedding them in an image to express desired information, the required digital watermark pattern type n is n = b. However,
Although the latter requires a small number of types of digital watermark patterns, it is often necessary to take appropriate measures against image deterioration because multiple digital watermark patterns are embedded in an image. Finally, in the method in which these two methods are combined, the required digital watermark pattern type n is b ≦ n ≦ 2 ^b , which has the characteristics of both methods.

The method of dividing an image into small areas is another method of embedding multi-bit information in an image with a digital watermark. By giving different roles to each small area, a plurality of electronic images can be provided in the image. The watermark is intended to exist at the same time. Various methods for arranging the small areas have been proposed. Here, an example will be described in which the small areas are arranged in a grid pattern as shown in FIG. I and j in FIG. 13 are non-negative integers.

When dividing an image into small areas, the number of divisions becomes a problem. When the information to be embedded in the image is b bits, a method of dividing the image into b small areas can be considered first. However, when embedding a digital watermark pattern in various images, the visual characteristics of the image are considered. Since this method often embeds a digital watermark pattern, this method is prone to problems. For example, when adding processing such as embedding strongly in the edge part of the embedded image and weakly embedding it in the flat part of the image,
If the small area corresponding to a certain bit happens to be a flat area, the digital watermark embedded in that area may not be detected. Even if there is a region in which digital watermark detection fails even in one region, even if a digital watermark embedded in the remaining region is detected, the meaning of the entire combination is lost. When dividing an image into small regions, dividing into smaller regions than b has the advantage that the digital watermark can be detected stably in various images. Even if the embedding strength of the digital watermark pattern becomes extremely weak in one small area, if the necessary amount of the digital watermark pattern is secured in the remaining small area in which the same bit information is embedded, the detection of the digital watermark as a whole is performed. Is possible.

FIG. 14 shows an example of division of a small area when the embedded information is 8 bits. A plurality of small areas corresponding to the same bit are allocated in the image.

Next, FIG. 15 shows a configuration example of a digital watermark detection processing device for detecting a digital watermark from an image in which a digital watermark pattern is embedded. The digital watermark detection process will be described below with reference to FIG.

An image 601 is processing target data in which a digital watermark pattern is embedded, and here, an example of an image is shown. The image data includes various images such as an image read from a storage medium such as a hard disk or a DVD or an image supplied via a communication medium.

The digital watermark pattern generation unit 603 generates a digital watermark pattern from the digital watermark pattern generation key (key) in the digital watermark pattern generation key (key) storage unit 602. The digital watermark pattern generation key (key) is specifically image division information when embedding a digital watermark pattern in an image, bit array information, and the like, and is information necessary for detecting a digital watermark pattern.

The detection section 604 detects the digital watermark of the input image 601 using the digital watermark pattern generated by the digital watermark pattern generation section 603. The detection process uses the digital watermark pattern generated as described above to acquire the correlation with the detection target image by the inner product value, and compares the acquired inner product value with the threshold value (th) (see Formula 9). Run. Further, when there is multi-bit information by a digital watermark as described above with reference to FIGS. 12 to 14, the multi-bit information is acquired. The information detected by the detection unit 604 is output as detection information 605.

Returning to FIG. 9, a digital watermark embedding algorithm applied in the superimposition amount determining unit 103 in the digital watermark embedding processing apparatus of the present invention will be described. In the superimposition amount determination unit 103 shown in FIG. 9, one of a plurality of algorithms, for example, an algorithm according to the following equation is selected corresponding to each data area separated in the above-described superposition portion selection unit 102. To be done.

[0108]

[Equation 10]

The algorithm of the above-mentioned algorithm identifier (1) gives the intensity (for example, the change of the brightness value) (-
1.0, 2.0, -1.0) is an algorithm added as information.

(2) is a matrix-type digital watermark embedding algorithm similar to the above description,
This is an algorithm for embedding a data amount having the intensity distribution shown in (2) for one central data (for example, pixel value) and seven data (for example, pixel value) around it.
(3) is a matrix-type digital watermark embedding algorithm similar to (2), but for one central data (eg pixel value) and horizontally (vertically) adjacent data (eg pixel value) This is an algorithm for embedding a data amount having the intensity distribution shown in (3).

The first parameter setting section 103 in the digital watermark embedding processing apparatus of the present invention corresponds to each data area separated by the above-mentioned superposed section selecting section 102 based on predetermined setting information. Above (1)
One of the digital watermark embedding algorithms of (3) to (3) is set as the application algorithm. In addition, the second parameter setting unit 104 corresponds to each of the data areas separated by the overlapping portion selection unit 102 according to the user input, and any one of the digital watermark embedding algorithms of (1) to (3) above. Is set as the applied algorithm.

FIG. 16 shows an example of algorithm selection. Figure 1
The example 6 is an example in which the digital watermark embedding target data is separated into two data areas and different algorithms are applied to the two data areas, and two selection processing examples (combination examples) are shown.

The data to be embedded in the digital watermark is
The first region is divided into a high frequency part (edge part) and the second region is divided into a low frequency part (flat part). These separation processes are executed by the above-mentioned overlapping portion selection unit 102.

The algorithm decision example shown in FIG.
The parameter setting unit 103 applies the algorithm of (3) described in FIG. 9 or the above equation [Equation 10] only to the high-frequency part (edge part), and the low-frequency part (flat part) has the electronic part. As a parameter determination process based on a user input in the second parameter setting unit 104, the application process is not set in the high frequency part (edge part), and the low frequency part (flat part) is executed. The processing example in which it is decided to apply the algorithm of (1) described in the above equation [Equation 10] is shown in FIG.

The example of FIG. 16 is an example in which the data area is divided into two and different algorithms are applied to each, but when more data areas are divided into three or more data areas, each area is The process of setting the digital watermark embedding algorithm to be applied is executed.

[Processing in Digital Watermark (WM) Information Signal Generation Unit] Next, processing in the digital watermark (WM) information signal generation unit shown in FIG. 3 will be described. The additional information 110 to be embedded as a digital watermark is encoded to generate digital watermark information. The processing in the digital watermark (WM) information signal generation unit 107 is performed by processing the digital watermark corresponding to the bit information 110 forming various additional information such as copy control information, copyright information, and edit information as additional information to be embedded in data. Various control information when embedding in
For example, it is executed as a modulation process and a coding process based on image division information and control information such as bit array information. Encoding in the digital watermark (WM) information signal generation unit 107 can be performed as encoding including, for example, spread spectrum or patchwork method. The spread spectrum processing will be described.

FIG. 17 is a block diagram for explaining the configuration of the spread spectrum processing section in the digital watermark information (WM) signal generation section 107. In FIG. 17, a PNa generating unit 651 generates a PN code string PNa and supplies the PN code string PNa to an SS spreading unit 652 (SS is an abbreviation for spread spectrum. The same applies hereinafter).

Further, the additional information generating section 653 generates additional information to be superimposed as digital watermark information, and
It is supplied to the diffusion unit 652. The SS spread unit 652 multiplies the additional information and the PN code string PNa to generate a spread spectrum signal. Then, the spread spectrum signal is output to the digital watermark (WM) level control unit.

FIG. 18 is a spectrum showing the relationship between the additional information to be superimposed as digital watermark information and the digital watermark embedding target data (eg, video signal). The additional information has a small amount of information contained therein, is a low bit rate signal, and is a narrow band signal as shown in FIG. When this is subjected to spread spectrum, a wide band signal as shown in FIG. 18B is obtained. At this time, the spread spectrum signal level decreases in inverse proportion to the band expansion ratio.

This spread spectrum signal, that is, S
In this case, the S additional information is superimposed on the electronic watermark embedding target data (for example, video signal).
As shown in (c), the SS additional information is superimposed at a level smaller than the dynamic range of the video signal as the information signal. By superimposing in this way, it is possible to prevent deterioration of the main information signal from occurring.

On the other hand, in order to detect the SS additional information,
Inverse spread spectrum is performed. By the inverse spread spectrum, as shown in FIG. 18D, the SS additional information is restored as a narrow band signal again. By providing a sufficient band spreading factor, the detection level of the additional information after despreading exceeds that of the information signal and can be detected.

As described above, the digital watermark (WM) information signal generation unit executes the encoding process of the additional information to be embedded as the digital watermark, and generates the encoded digital watermark information.
The process in the digital watermark (WM) information signal generation unit is executed as a process of encoding based on bit information that forms various additional information such as copy control information, copyright information, and edit information as additional information to be embedded in data. Then, the process of superimposing the digital watermark (WM) information based on the additional information is executed at a level lower than the data level (for example, the bit level or the quantization level) of the digital watermark (WM) embedding target data (information signal). For example, digital watermark (WM)
When the embedding target data (information signal) is image data consisting of 8-bit pixel values, the digital watermark (WM) information based on the additional information is converted into LSB (Leas
t Significant Bit) A process of forming the data as 2 bits and adding it to digital watermark (WM) embedding target data is executed.

[Processing in Digital Watermark (WM) Level Control Unit and Digital Watermark (WM) Superposition Unit] The digital watermark (WM) level control unit 106 shown in FIG. , The digital watermark information generated by the modulation and coding processing of the bit information 110 that constitutes the copy control information, the copyright information, the editing information, etc. is input, and the first parameter setting unit 103 and the second parameter setting unit 104 Input the superimposition level information corresponding to the digital watermark embedding algorithm selected corresponding to each data area, execute the digital watermark embedding level adjustment processing for each data area to generate the digital watermark pattern, and (WM) Output to the superimposing unit 108.

The digital watermark (WM) superimposing unit 108 inputs the digital watermark (WM) embedding target data 101 and the level-adjusted digital watermark (WM) pattern from the digital watermark (WM) level control unit 106. Then, a digital watermark embedding process (superimposing process) is executed on the digital watermark (WM) embedding target data 101,
The digital watermark (WM) embedded data 109 is output.

FIG. 19 shows a configuration example of a digital watermark (WM) level control unit and a digital watermark (WM) superposition unit.
The configuration example of FIG. 19 is a configuration example in which a low-pass filter (LPF) is used in a digital watermark (WM) superimposing unit to separate digital watermark (WM) embedding target data into a high-frequency part and a low-frequency part.

The low-pass filter (LPF) 721 of the digital watermark (WM) superimposing unit 720 outputs the low frequency band data of the digital watermark (WM) embedding target data. The low-pass filter (LPF) 721 executes the following calculation on the input data, and outputs low-pass data. V = (Vi-1, j + Vi, j + Vi + 1, j) / 3 In the above formula, Vi-1, Vi, Vi + 1 represent three consecutive data values (for example, pixel values), and the input data is 8-bit data. At this time, multi-gradation conversion is performed by setting the moving average calculation word length to 8 bits or more, such as 10 bits.

When the multi-gradation processed data is configured as 10-bit data as described above with reference to FIG. 2, the digital watermark (WM) is added in the adder 723.
An addition process with the 2-bit digital watermark information input from the level control unit 710 is executed.

Digital Watermark (WM) Level Control Unit 710
Is composed of a level control unit 711 and a limiter 712. The level control unit 711 receives the digital watermark information from the digital watermark (WM) information signal generation unit (FIG. 3, 107) and uses the first and second parameters. A digital watermark information pattern is generated according to the digital watermark algorithm information obtained by combining the first and second parameters (algorithm) received from the setting units 103 and 104. Further, the limiter 712 converts the digital watermark (WM) to be added into a data level corresponding to the lower 2 bits of the embedding target data, and the adder 723 converts the digital watermark (WM) level control unit 7 into a data level.
An addition process with the 2-bit digital watermark information input from 10 is executed. That is, the electronic watermark information is embedded in the extended information signal portion (low order 2 bits) of the electronic watermark embedding target data generated by the multi-gradation processing. The output of the adder 723 is input to the adder 724.

The subtractor 722 inputs the digital watermark (WM) embedding target data, and uses it as a low-pass filter (LPF).
By the subtraction process of the low frequency band data which is the output of 721, only the high frequency band data of the digital watermark (WM) embedding target data is output and input to the adder 724. For example, if the multi-gradation processed data is 10-bit data, the data input to the adder 724 will be 8-bit high frequency band data. The adder 724 executes a process of adding the 8-bit high-frequency part data input from the subtractor 722 and the 2-bit low-frequency part data with the electronic watermark input from the adder 724, and outputs the 10-bit high-frequency part data. The multi-gradation digital watermark embedding data is generated. The multi-tone digital watermark embedding data generated by the adder 724 is processed by the 8-bit quantizing unit 725.
Conversion from 10-bit to 8-bit data is executed and output.

The configuration example of FIG. 20 is a configuration example in which DCT is used in the digital watermark (WM) superimposing unit to execute multi-gradation conversion processing of digital watermark (WM) embedding target data.

DCT of Digital Watermark (WM) Superimposing Unit 760
The unit 761 performs DCT processing on digital watermark (WM) embedding target data and outputs multi-gradation processed data. For example, when the input data is 8-bit data, the DCT unit 761
The output data from is output as 10-bit data.

Digital Watermark (WM) Level Control Unit 750
Is composed of a level control unit 751 and a limiter 752. The level control unit 751 receives the digital watermark information from the digital watermark (WM) information signal generation unit (FIG. 3, 107) and uses the first and second parameters. A digital watermark information pattern is generated according to the digital watermark algorithm information obtained by combining the first and second parameters (algorithm) received from the setting units 103 and 104. Further, the limiter 752 converts the digital watermark (WM) to be added into a data level corresponding to the low-order 2 bits of the embedding target data, and the adder 762 converts it into a digital watermark (WM) level control unit 7.
The addition process with the low-order 2-bit digital watermark information input from 50 is executed. That is, the electronic watermark information is embedded in the extended information signal portion (low order 2 bits) of the electronic watermark embedding target data generated by the multi-gradation processing. The adder 762 executes a digital watermark superimposing process to generate 10-bit multi-tone digital watermark embedded data. The multi-tone digital watermark embedded data generated by the adder 762 is converted by the inverse DCT unit 763 from 10-bit data to 8-bit data and output.

As described above, the multi-gradation conversion processing includes filter processing such as LPF, BPF and HPF, DCT, wavelet conversion, JPEG and MPE.
G, fractal conversion, ATRAC, MP3, AC3, A
Various types of encoding processing such as AC, ADPCM, CELP, and TwinV and orthogonal transformation processing can be applied.

As described above, the digital watermark embedding processing apparatus of the present invention is configured to perform the multi-gradation processing on the data to be subjected to the digital watermark embedding processing and execute the processing of embedding the digital watermark information in the low-order bits. The deterioration of the quality of the information signal can be minimized. Therefore, even when the digital watermark is embedded in a portion (flat portion) where the gradation change is relatively small, such as an image or music, it is possible to embed the digital watermark so that it is hard to be perceived.

Further, since a plurality of digital watermark algorithms are applied and one of them is set by user selection, an optimum embedding algorithm can be selected including human viewing characteristics. In addition to minimizing the deterioration of quality due to information embedding, humans can perform quality control such as total quality control and detection performance improvement, and an overall optimum system can be configured.

Further, since another algorithm can be applied to an information signal which is difficult to embed by applying only one algorithm, embedding can be appropriately performed according to the data characteristic and the embedding processing target It is possible to embed additional information as a digital watermark while maintaining the data quality without deteriorating the image quality of data, for example, an image, and without deteriorating the sound quality of audio data.

Unlike the configuration in which a uniform global parameter is given to the entire data, the algorithm corresponding to each data area can be set arbitrarily, so that the detection accuracy can be maintained and the detection reliability and stability can be improved. It is possible to improve the image quality, improve the image quality, and perform a non-schematic control that the equal detection performance is reduced. As a result, it is possible to secure the overall performance as compared with the method that adjusts globally using global parameters.

In the above-described embodiment, the digital watermark embedding target data has been described focusing on the image data, but the digital watermark embedding target data is the video signal, the image information,
It may be music, voice signal, MIDI, or other information signal. The information signal may be a baseband signal or a compressed signal. Further, the embedding algorithm may be selected for each area of the digital watermark embedding target data, may be divided on the time axis or the frequency axis, or the digital watermark embedding target data may be directly divided without being divided. The embedding amount may be determined over the entire watermark embedding target data, and then the embedding algorithm may be changed only on the time axis based on a user instruction. In that case, the embedding may be turned on / off. Also, although it has been described that the embedding is performed after the multi-gradation processing is performed, the embedding processing may be directly performed on the original data without performing this, or the encoding is performed so as not to have the multi-gradation than the original data. Alternatively, the embedding process may be executed.

The division processing of the digital watermark embedding target data is various filter processing, DCT, wavelet conversion, JPEG, MPEG, fractal conversion, ATRA.
CK, MP3, AC3, AAC, ADPCM, CEL
P, TwinV, etc., for the data area converted on space, frequency, and time axis after signal conversion processing including any of various filter processing, encoding processing, orthogonal transformation processing, and compression processing It may be configured to execute the above.

[System Configuration] The series of processes described in the above embodiments can be executed by hardware, software, or a combined configuration of both. When processing by software, the program that records the processing sequence is installed in the memory in the data processing device built into the dedicated hardware and executed, or a general-purpose computer that can execute various processing is executed. It is possible to install and run the program. When the series of processes is performed by software, the program forming the software is installed in, for example, a general-purpose computer or a one-chip microcomputer. FIG. 21 shows
The series of processes described above, specifically, generation of a digital watermark,
The example of a system configuration of the apparatus which performs at least one process of an embedding and a detection is shown. The configuration of FIG. 21 will be described.

CPU (Central processing Unit) 802
Are various application programs and OS (Operat
ing System) is actually executed. ROM (Read-Only-Me
mory) 803 is a program executed by the CPU 802,
Alternatively, fixed data as a calculation parameter is stored. RAM (Random Access Memory) 804 is a CPU
It is used as a storage area and a work area for a program executed in the process of 802 and parameters that change appropriately in the program process. CPU 802, R
OM803, RAM804, and hard disk 80
5 are connected by a bus 801, and data can be transferred mutually. I / O interface 8
Data can be transferred to and from various input / output devices connected to 14.

A keyboard 812 and a mouse 813 are CPUs
It is operated by the user to input various commands to 802, operated by the user at the time of command input data input, and input via the keyboard / mouse controller 811.

The drive 809 is a floppy (registered trademark) disc or a CD-ROM (Compact Disc Read Only).
Memory), MO (Magneto optical) disk, DVD (Dig
Ital Versatile Disc), magnetic disk, semiconductor memory, or other removable recording medium 810 is a drive for executing recording / reproduction, and the program / data reproduction from each removable recording medium 810, removable recording medium 8
Execute program or data storage for 10.

The CPU 802 is the input / output interface 8
When a command is input via the keyboard 812, the mouse 813, etc. via the PC 14, the ROM (R
The program stored in the eadOnly Memory) 803 is executed.

Data such as images and sounds to be embedded in the digital watermark or data to be detected in the above-described embodiment are input to the camera 80 connected to the input unit 807.
71 other input device, such as a data input device such as a scanner, or a floppy disk or CD-ROM (Compact Disc Read Only Memor) connected to the drive 809
y), MO (Magneto optical) disc, DVD (Digital
It is possible to input from a removable recording medium 810 such as a Versatile Disc), a magnetic disc, a semiconductor memory. Note that this system has a configuration in which voice data can also be input via the microphone 8072. Further, the data received via the communication unit 808 can be processed as image data to be embedded in the digital watermark or image data to be detected.

The CPU 802 is not limited to the ROM storage program, but is also a program stored in the hard disk 805, a program transferred from a satellite or a network, received by the communication unit 808 and installed in the hard disk 805, or mounted in the drive 809. The program read from the removable recording medium 810 and installed in the hard disk 805 is stored in the R
It is also possible to load and execute in AM (Random Access Memory) 804.

In this specification, the program may be processed by one computer or may be processed by a plurality of computers in a distributed manner. Further, the program may be transferred to a remote computer and executed.

The present invention has been described in detail above with reference to the specific embodiments. However, it is obvious that those skilled in the art can modify or substitute the embodiments without departing from the scope of the present invention. That is, the present invention has been disclosed in the form of exemplification, and should not be limitedly interpreted. In order to determine the gist of the present invention, the section of the claims described at the beginning should be taken into consideration.

[0149]

According to the configuration of the present invention described above, various effects described below can be obtained. First, in the digital watermark embedding processing apparatus of the present invention, a plurality of digital watermark algorithms are selectively applied to embed a digital watermark, and at the same time, algorithm selection processing can be executed by a user. First and second setting means for selecting an algorithm are configured, and a digital watermark embedding algorithm is determined based on synthesis information or selection information of the plurality of setting means. With this configuration, it is possible to select an optimum embedding algorithm in consideration of human viewing characteristics, so that it is possible to deteriorate the quality due to the additional information embedding of the image and audio data that is the digital watermark embedding target data.

Further, since another algorithm can be applied to an information signal that is difficult to embed by applying only one algorithm, embedding can be appropriately performed according to the data characteristics and the embedding processing target It is possible to embed additional information as a digital watermark while maintaining the data quality without deteriorating the image quality of data, for example, an image, and without deteriorating the sound quality of audio data.

Unlike the configuration in which a uniform global parameter is given to the entire data, the algorithm corresponding to each data area can be set arbitrarily, so that the detection accuracy can be maintained, and the detection reliability and stability can be improved. It is possible to improve the image quality, improve the image quality, and perform a non-schematic control that the equal detection performance is reduced. As a result, it is possible to secure the overall performance as compared with the method that adjusts globally using global parameters.

Further, according to the configuration of the present invention, it is possible to improve the strength against attacks such as illegal reading and falsification of digital watermark embedded information. This is because it is possible to use multiple digital watermark embedding algorithms, and by executing algorithms for embedding digital watermarks by selecting algorithms with different attack resistances on the time axis, space, and frequency. The reason is that, even if one attack is received, the other embedded information cannot be read or tampered with, and the detection by a legitimate detection means can be guaranteed, and the stability and robustness of the digital watermark are achieved by the configuration of the present invention. Is improved.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration example of a digital watermark embedding processing device of the present invention.

FIG. 2 is a diagram illustrating a multi-gradation process and a digital watermark embedding process executed by the digital watermark embedding processing device of the present invention.

FIG. 3 is a block diagram showing a detailed configuration example of a digital watermark embedding processing device of the present invention.

FIG. 4 is a block diagram showing a detailed configuration example of a digital watermark embedding processing device of the present invention.

FIG. 5 is a block diagram showing a configuration example of a superposed portion selection unit of the digital watermark embedding processing device of the present invention.

FIG. 6 is a block diagram showing a configuration example of a superposed portion selection unit of the digital watermark embedding processing device of the present invention.

FIG. 7 is a block diagram showing a configuration example of a superimposition portion selection unit of the digital watermark embedding processing device of the present invention.

FIG. 8 is a block diagram showing a configuration example of a superimposition portion selection unit of the digital watermark embedding processing device of the present invention.

FIG. 9 is a diagram showing an example of an algorithm selected by a superimposition amount determination unit of the digital watermark embedding processing device of the present invention.

FIG. 10 is a diagram illustrating a relative frequency distribution of inner product values of digital watermark patterns.

FIG. 11 is a diagram illustrating criteria for determining the presence or absence of a digital watermark.

FIG. 12 is a diagram illustrating a process of embedding a plurality of digital watermark patterns in an image.

FIG. 13 is a diagram illustrating division of an original image into small areas.

FIG. 14 is a diagram explaining allocation of the same information bit to a plurality of small areas.

FIG. 15 is a diagram illustrating a process of a digital watermark detection device.

FIG. 16 is a diagram showing an example of combinations of algorithms selected by a superimposition amount determination unit of the digital watermark embedding processing device of the present invention.

FIG. 17 is a diagram showing a spread spectrum processing configuration of a digital watermark information generation unit of the digital watermark embedding processing device of the present invention.

FIG. 18 is a diagram for explaining the spread spectrum processing of the digital watermark information generation unit of the digital watermark embedding processing device of the present invention.

FIG. 19 is a diagram showing a configuration example of a digital watermark level control unit and a digital watermark superimposing unit of the digital watermark embedding processing device of the present invention.

FIG. 20 is a diagram showing a configuration example of a digital watermark level control unit and a digital watermark superimposing unit of the digital watermark embedding processing device of the present invention.

FIG. 21 is a diagram showing an example of a system configuration for executing a digital watermark embedding process.

[Explanation of symbols]

11 Digital watermark (WM) embedding target data 12 Multi-tone processing unit 13 Digital Watermark Embedding Processing Unit 14 Digital Watermark Information Signal Generation Unit 15 Data converter 16 Digital watermark embedded data 51 Digital watermark (WM) embedding data 52 Multi-tone processing unit 53 Digital Watermark Information Signal Generation Unit 54 Digital Watermark Embedding Processing Unit 55 Data converter 101 Digital Watermark (WM) Embedding Target Data 102 superposed portion selection unit 103 First Parameter Setting Section 104 second parameter setting unit 106 Digital Watermark (WM) Level Control Unit 107 Digital Watermark (WM) Generation Unit 108 Digital Watermark (WM) Superimposing Unit 109 Digital watermark (WM) embedded data 110 Additional information 111 User input section 121 switch 201 low pass filter 202 bandpass filter 203 High-pass filter 301 Edge detection unit 501 Digital watermark embedding target data 601 Digital watermark detection target image 602 Digital Watermark Pattern Generation Key Storage Unit 603 Digital watermark pattern generator 604 detector 605 Detection information 651 PNa generator 652 Spread spectrum unit 653 Additional information generator 710 Digital Watermark Level Control Unit 711 Level control unit 712 Limiter 720 Digital Watermark Superimposing Unit 721 LPF 722 Subtractor 723,724 adder 725 8-bit quantizer 750 Digital Watermark Level Control Unit 751 Level control unit 752 limiter 760 Digital Watermark Superimposing Unit 761 DVT section 762 adder 763 Inverse DCT section 802 CPU 803 ROM 804 RAM 805 hard disk 806 Output section 807 Input section 808 Communication unit 809 drive 810 Removable full recording medium 811 keyboard mouse controller 812 keyboard 813 mouse 8061 display device 8062 speaker 8071 camera 8072 Mike

Claims (15)

[Claims] 1. A digital watermark embedding processing device for executing a digital watermark embedding process, wherein a digital watermark embedding algorithm to be applied to digital watermark embedding target data is based on setting information from among a plurality of previously applicable algorithms. First choice
A parameter setting unit, a second parameter setting unit that selects and determines a digital watermark embedding algorithm to be applied to digital watermark embedding target data from a plurality of previously applicable algorithms based on user-specified information; Parameter setting means, output algorithm determining means for setting an execution algorithm based on the algorithm determined by the second parameter setting means, and digital watermark information signal generating means for generating digital watermark information based on additional information to be embedded as a digital watermark. A digital watermark level control means for generating a digital watermark pattern to which the digital watermark embedding algorithm determined by the output algorithm determining means is applied, based on the digital watermark information generated by the digital watermark information signal generating means, An electronic watermark pattern to output of the electronic watermark level control means, the electronic watermark embedding processing apparatus characterized by comprising: a digital watermark superimposing means for executing a process of embedding the electronic watermark embedding data. 2. The digital watermark embedding processing device further comprises a superposed portion selecting means for dividing a data area of digital watermark embedding target data, wherein the first parameter setting means or the second parameter setting means is provided. At least one of them has a configuration for executing a process of selecting and determining a digital watermark embedding algorithm to be applied to each of the divided data areas of the superposed portion selecting means from a plurality of previously applicable algorithms. The digital watermark embedding processing device according to claim 1. 3. The superimposing portion selecting means is configured to divide a data area of digital watermark embedding target data based on frequency characteristics, and at least one of the first parameter setting means and the second parameter setting means. Is characterized in that it is configured to execute a process of selecting and determining a digital watermark embedding algorithm to be applied to each of the data areas divided based on frequency characteristics from a plurality of algorithms that can be applied in advance. The digital watermark embedding processing device according to claim 2. 4. The superimposing portion selecting means is configured to divide a data area of digital watermark embedding target data based on a discrimination of an edge area, and the superimposing portion selecting means of the first parameter setting means or the second parameter setting means. At least one of them is configured to execute a process of selecting and deciding a digital watermark embedding algorithm to be applied to each of the data areas divided based on the edge area from a plurality of previously applicable algorithms. The electronic watermark embedding processing device according to claim 2. 5. The superimposing portion selecting means is configured to divide a data area of digital watermark embedding target data into frame units of a time series data frame, the first parameter setting means or the first parameter setting means. At least one of the two-parameter setting means executes a process of selecting and determining a digital watermark embedding algorithm to be applied to each of the data areas divided based on the data frame from a plurality of previously applicable algorithms. The digital watermark embedding processing device according to claim 2, wherein 6. The superimposing portion selecting means is configured to divide a data area of digital watermark embedding target data based on spatial position information, and at least the first parameter setting means or the second parameter setting means. One of them is configured to execute a process of selecting and determining a digital watermark embedding algorithm to be applied to each of the data areas divided based on the spatial position information from a plurality of previously applicable algorithms. The electronic watermark embedding processing device according to claim 2. 7. The digital watermark superimposing means has a multi-gradation processing section for executing multi-gradation conversion processing of the digital watermark embedding target data, and the multi-level gradation of the digital watermark embedding target data in the multi-gradation processing section. 2. The digital watermark embedding processing apparatus according to claim 1, wherein the digital watermark embedding processing device is configured to embed the digital watermark pattern output from the digital watermark level control means in the data after the tone conversion processing. 8. A digital watermark embedding processing method for executing a digital watermark embedding process, wherein a digital watermark embedding algorithm to be applied to digital watermark embedding target data is based on setting information from a plurality of previously applicable algorithms. First choice
A parameter setting step; a second parameter setting step of selecting an electronic watermark embedding algorithm to be applied to the electronic watermark embedding target data from a plurality of previously applicable algorithms based on user-specified information; A parameter setting step, an output algorithm determining step for setting an execution algorithm based on the algorithm determined in the second parameter setting step, and a digital watermark information signal generating step for generating digital watermark information based on additional information to be embedded as a digital watermark. And generating a digital watermark pattern to which the digital watermark embedding algorithm determined in the output algorithm determining step is applied, based on the digital watermark information generated in the digital watermark information signal generating step. A digital watermark embedding step, which comprises: a digital watermark level control step; and a digital watermark superimposing step of executing a process of embedding a digital watermark pattern output in the digital watermark level control step into digital watermark embedding target data. Processing method. 9. The method for embedding a digital watermark further comprises a step of selecting a superimposed portion for dividing a data area of digital watermark embedding target data, the step of setting the first parameter or the step of setting the second parameter. At least one of the digital watermark embedding algorithms applied to each of the data areas divided in the superposed portion selecting step,
9. The digital watermark embedding processing method according to claim 8, wherein a processing of selecting and determining from a plurality of applicable algorithms is executed in advance. 10. The superimposing portion selecting step executes a process of dividing a data area of digital watermark embedding target data based on frequency characteristics, and at least the first parameter setting step or the second parameter setting step. One of the above is characterized in that a process of selecting and determining a digital watermark embedding algorithm to be applied to each of the data regions divided based on frequency characteristics from a plurality of applicable algorithms in advance is performed. 9. The digital watermark embedding processing method according to item 9. 11. The superimposing part selecting step executes a process of dividing a data area of digital watermark embedding target data based on discrimination of an edge area, the first parameter setting step or the second parameter setting step. At least one of the above is characterized in that the digital watermark embedding algorithm to be applied to each of the data areas divided based on the edge area is selected from a plurality of algorithms that can be applied in advance. The digital watermark embedding processing method according to claim 9. 12. The superimposing portion selecting step executes division of a data region of digital watermark embedding target data in frame units of a time series data frame, and the first parameter setting step or the second parameter setting step. At least one of the steps is characterized by executing a process of selecting and determining a digital watermark embedding algorithm to be applied to each of the data areas divided based on the data frame from a plurality of previously applicable algorithms. The digital watermark embedding processing method according to claim 9. 13. The superimposing portion selecting step executes a process of dividing a data area of digital watermark embedding target data based on spatial position information, and the first parameter setting step or the second parameter setting step is performed. At least one of them is characterized by executing a process of selecting and deciding a digital watermark embedding algorithm to be applied to each of the data areas divided based on the spatial position information from a plurality of previously applicable algorithms. The digital watermark embedding processing method according to claim 9. 14. The digital watermark superimposing step includes a step of performing a multi-gradation conversion process on the digital watermark embedding target data, wherein the multi-gradation conversion process is performed on the digital watermark embedding target data in the multi-gradation process. 9. The digital watermark embedding processing method according to claim 8, further comprising: embedding a digital watermark pattern output in the digital watermark level control step. 15. A computer program for executing digital watermark embedding processing, wherein a digital watermark embedding algorithm to be applied to digital watermark embedding target data is selected from a plurality of previously applicable algorithms based on setting information. First to decide
A parameter setting step; a second parameter setting step of selecting an electronic watermark embedding algorithm to be applied to the electronic watermark embedding target data from a plurality of previously applicable algorithms based on user-specified information; A parameter setting step, an output algorithm determining step for setting an execution algorithm based on the algorithm determined in the second parameter setting step, and a digital watermark information signal generating step for generating digital watermark information based on additional information to be embedded as a digital watermark. And generating a digital watermark pattern to which the digital watermark embedding algorithm determined in the output algorithm determining step is applied, based on the digital watermark information generated in the digital watermark information signal generating step. A computer program, comprising: a digital watermark level control step; and a digital watermark superimposing step of executing a process of embedding a digital watermark pattern output in the digital watermark level control step into digital watermark embedding target data. .