JP2002320085A - Electronic watermark embedding processor, electronic watermark detection processor, method for electronic watermark embedding processing, method for electronic watermark detecting processing, program storage medium and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide constitution for embedding and detecting processing of a durable electronic watermark. SOLUTION: A plurality of electronic watermarks are generated by using different keys according to the feature or the time passage of contents and embedded to a processing object signal. The electronic watermark detection processing from an electronic watermark embedded signal becomes nearly impossible for a third party who does not know a plurality of keys, and illegal detection of electronic watermarks and dishonest alteration can be prevented. Furthermore, by extracting the feature of the contents in a right detector, correct electronic watermarks are carried out efficiently. By setting not only to differentiate keys but also by electronic watermarks electronic watermarks electronic watermarks but also to differentiate algorithm, more durable embedding of the electronic watermarks becomes possible and the detection and dishonest alteration of the electronic watermark by the third perty are effectively prevented.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for embedding or reading additional information such as copyright information and editing information in a signal such as sound or image. Digital watermark (Digital Watermarking or D
The present invention relates to a digital watermark embedding processing apparatus, a digital watermark detection processing apparatus, a digital watermark embedding processing method, a digital watermark detection processing method, a program storage medium, and a program for executing processing for embedding or detecting ata hiding.

[0002]

2. Description of the Related Art With the advancement of digital technology, digital recording / reproducing apparatuses that do not cause image quality deterioration and sound quality deterioration due to repeated execution of recording and reproduction processing have become widespread.
Various digital and digital contents such as music, DVD,
It can be distributed and distributed through media such as CDs or networks.

In digital recording / reproducing, unlike analog recording / reproducing, data deterioration does not occur even if recording / reproducing processing is repeatedly executed, so that the same quality as original data is maintained. The spread of such digital recording / reproducing technology has resulted in the proliferation of illegal copying, and is a serious problem from the viewpoint of copyright protection.

In order to cope with copyright infringement due to unauthorized duplication (copy) of digital content, copy control information for copy control is added to the digital content,
There has been proposed a configuration in which duplication control information is read at the time of recording and reproduction of content, and a process according to the read control information is executed to prevent unauthorized duplication.

There are various modes of content copy control. For example, as a typical method, CGMS (Copy
Generation Management Sys
tem; copy generation management
System) system. In the CGMS method, if an analog video signal (referred to as CGMS-A), a specific horizontal section within a vertical blanking period of the luminance signal,
For example, in the case of an NTSC signal, two bits of the 20-bit additional information to be superimposed on the effective video portion in the twentieth horizontal section are superimposed as duplication control information, and a digital video signal (referred to as CGMS-D). ), The transmission method includes 2-bit information for duplication control as additional information to be inserted and added to digital video data.

The meaning of 2-bit information (hereinafter referred to as CGMS information) in the case of the CGMS system is [00]
... Duplicatable [10]... Duplicate once (only one generation can be duplicated) [11]... Duplicate prohibited (absolute duplicate prohibited).

The above-mentioned CGMS system is an example of a typical copy control system, and there are various other systems for protecting the copyright of contents. For example, in digital broadcasting performed by a broadcasting station, program sequence information (S) included in a transport stream (TS) packet constituting digital data.
There is a method in which a digital copy control descriptor (Digital Copy Control Descriptor) is stored in I: Service Information, and the copy generation control according to the descriptor is performed when data received by the receiving device is recorded in the recording device.

However, the above-mentioned control information is added as bit data to, for example, a header of the content, and it is difficult to completely eliminate the possibility of falsification of the added data. An advantageous configuration in terms of eliminating the possibility of data tampering is a digital watermark. Digital watermarks (watermarks) are difficult to see or perceive during normal content (image data or audio data) playback, and detection and embedding of digital watermarks can only be performed by executing a specific algorithm or processing by a specific device. It becomes possible. By detecting a digital watermark (watermark (WM)) at the time of content processing in a receiver, a recording / reproducing device, and the like, and performing control in accordance with the digital watermark, control with higher reliability can be performed.

Digital watermark (watermark (WM))
The information embedded in the content is not limited to the above-described copy control information, and various information such as the copyright information of the content, the content processing information, the content configuration information, the content processing information, the content editing information, and the content reproduction processing method. Can be embedded. For example, the editing information is embedded at the time of editing the content, and in each editing step, the processing step is confirmed by referring to the digital watermark. For example, such editing information is embedded in the content as a new digital watermark in the content at each editing step, and is finally removed from the content.

[0010]

However, by taking the difference between the signal before digital watermark embedding and the signal after digital watermark embedding, only the digital watermark component may be extracted. There is still the possibility of falsification of the digital watermark, such as embedding a watermark in other content, for example, illegally embedding information different from the original content's copy control information and copyright information.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems in digital watermarking, and prepares a plurality of various digital watermark generating elements corresponding to a digital watermarking method and a key for generating a digital watermark. An object of the present invention is to provide a configuration for reducing the possibility of falsification of a digital watermark by selectively applying each element to embed and detect a digital watermark.

Further, the present invention solves the drawback of increasing the digital watermark detection processing time when a different digital watermark generation element is selectively applied, so as to solve the problem of digital watermarks associated with content features. An object of the present invention is to provide a configuration for selecting a watermark scheme and a generation element, and to provide a configuration for realizing detection of a digital watermark in a short time.

For example, in order to detect unauthorized redistribution of content distributed by broadcasting or the Internet by a user, a content identification ID, a content creator, a distributor, a content user ID, and the like are embedded in the content as a digital watermark. There is a method of searching for redistributed content on the Internet. By applying the configuration of the present invention to such a digital watermark, that is, by applying a digital watermark based on a plurality of methods and associated with the content,
The digital watermark can be detected in a short time. That is, by adopting a configuration in which the embedding and detection of digital watermarks of a plurality of systems are switched in accordance with the feature amount of the content, detection can be performed in the same processing time as in the case where the digital watermark of one system is embedded. Also, a general user who does not know the digital watermark embedding method or the feature amount applied for element selection cannot execute the appropriate digital watermark embedding according to the feature amount, so that an unauthorized user who does not correspond to the feature amount of the content. Extraction of redistributed content with an embedded digital watermark is also facilitated.

[0014]

SUMMARY OF THE INVENTION A first aspect of the present invention is as follows.
An electronic watermark embedding processing device that executes an electronic watermark pattern embedding process on a signal to be processed, a feature extracting unit that acquires a feature amount of the signal to be processed, and a plurality of feature extracting units based on the feature amount acquired by the feature extracting unit. Control information generating means for outputting a control signal for level control or selection processing of different digital watermarks, digital watermark generating means for generating different digital watermarks, and the digital watermark according to a control signal output from the control information generating means Level control means for performing level control or selection processing of the digital watermark generated by the generation means.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, when the signal to be processed is image data, the feature extracting means includes a luminance, a horizontal frequency, a vertical frequency, and a two-dimensional frequency. Including any,
When the processing target signal is audio data, a feature extraction process including an audio frequency is performed.

Further, in one embodiment of the digital watermark embedding processing device of the present invention, the digital watermark generation means has a configuration for executing different digital watermark generation processing using different pseudo random patterns as keys. And

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generation means has a configuration for executing different digital watermark generation processing by applying different digital watermark generation algorithms. Features.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generating means applies a different digital watermark generating algorithm according to a control signal output from the control information generating means to thereby obtain a different digital watermark. It is characterized by having a configuration for executing a watermark generation process.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generating means has an array generating means for setting a pseudo random pattern to a different array, and the array generated by the array generating means is provided. Is selected according to the embedded information to generate a digital watermark pattern.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generating means includes a size of a digital watermark pattern, a filter applied to digital watermark generation, or a signal to be processed or digital watermark data. Is characterized in that a different digital watermark generation process is executed by making at least one of the conversion modes different.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generating means is constituted as a plurality of digital watermark generating means for generating different digital watermarks respectively, and the control information generating means is And outputting a control signal for digital watermark level control or selection processing to a plurality of level control means provided corresponding to the plurality of digital watermark generation means, based on the characteristic amount obtained by the characteristic extraction means. It is characterized by having a configuration.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the feature extracting means is configured to execute feature extraction based on data after signal conversion processing of the processing target signal. And

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the signal conversion processing is performed by using FF
T (Fast Fourie Transform), DC
T (Discrete Cosine Transform),
Wavelet, fractal transform,
The conversion processing is any one of mDCT (modified DCT).

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generating means has a configuration for inputting the processing target signal and applying the signal to the digital watermark adaptive control in the digital watermark generation processing. It is characterized by.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generating means inputs data after the signal conversion processing of the processing target signal, and performs digital watermark adaptive control in the digital watermark generation processing. Characterized by having a configuration applied to

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the signal conversion processing is performed by using FF
T (Fast Fourie Transform), DC
T (Discrete Cosine Transform),
Wavelet, fractal transform,
The conversion processing is any one of mDCT (modified DCT).

Further, a second aspect of the present invention is a digital watermark embedding processing apparatus for executing a digital watermark pattern embedding process on a signal to be processed, a feature extracting means for acquiring a feature amount of the signal to be processed, Control information generating means for outputting a control signal for selecting a plurality of different digital watermark generation keys based on the characteristic amount obtained by the characteristic extracting means; A digital watermark embedding process comprising: a key conversion unit that executes a conversion process of a watermark generation key; and a digital watermark generation unit that executes a digital watermark generation process based on a key output by the key conversion unit. In the device.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the key conversion means selects one spare key from a plurality of spare keys according to a control signal output from the control information generating means. , An operation of an input key and a selection spare key is performed to generate a digital watermark generation key.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, when the signal to be processed is image data, the feature extracting means includes a luminance, a horizontal frequency, a vertical frequency, and a two-dimensional frequency. Including any,
When the processing target signal is audio data, a feature extraction process including an audio frequency is performed.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generating means applies a different digital watermark generating algorithm according to a control signal output from the control information generating means, thereby obtaining a different digital watermark. It is characterized by having a configuration for executing a watermark generation process.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generating means includes a digital watermark pattern size, a filter applied to digital watermark generation, or a signal to be processed or digital watermark data. Is characterized in that a different digital watermark generation process is executed by making at least one of the conversion modes different.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the feature extracting means is configured to execute feature extraction based on data after signal conversion processing of the processing target signal. And

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the signal conversion processing is performed by using FF
T (Fast Fourie Transform), DC
T (Discrete Cosine Transform),
Wavelet, fractal transform,
The conversion processing is any one of mDCT (modified DCT).

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generation means has a configuration for inputting the processing target signal and applying the signal to the digital watermark adaptive control in the digital watermark generation processing. It is characterized by.

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generating means inputs data after the signal conversion processing of the processing target signal, and performs digital watermark adaptive control in the digital watermark generation processing. Characterized by having a configuration applied to

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the signal conversion processing is performed by using FF
T (Fast Fourie Transform), DC
T (Discrete Cosine Transform),
Wavelet, fractal transform,
The conversion processing is any one of mDCT (modified DCT).

Further, a third aspect of the present invention is a digital watermark embedding processing apparatus for executing a digital watermark pattern embedding process on a signal to be processed, and performs level control or selection of a plurality of different digital watermarks based on time information. Control information generating means for outputting a control signal for processing;
Digital watermark generation means for generating a different digital watermark; and level control means for performing level control or selection processing of the digital watermark generated by the digital watermark generation means in accordance with a control signal output from the control information generation means. A digital watermark embedding processing device is characterized in that:

Further, in one embodiment of the digital watermark embedding processing apparatus of the present invention, the digital watermark generating means includes a digital watermark generating key or a digital watermark size,
Alternatively, a different digital watermark generation process is performed by changing at least one of a filter applied to digital watermark generation and a conversion mode of the processing target signal or digital watermark data.

Further, a fourth aspect of the present invention is a digital watermark detection processing device for executing a digital watermark pattern detection process on a signal to be processed, a feature extracting means for acquiring a feature amount of the signal to be processed, Control information generating means for outputting a control signal for level control or selection processing of a plurality of different digital watermarks based on the characteristic amount obtained by the characteristic extracting means, and correlation extraction for executing a correlation extraction processing based on the different digital watermarks Means, and a level control means for performing level control or selection processing of an extracted value of the correlation extraction means in accordance with a control signal output from the control information generation means. .

Further, in one embodiment of the digital watermark detection processing device of the present invention, when the signal to be processed is image data, the feature extracting means includes a luminance, a horizontal frequency, a vertical frequency, and a two-dimensional frequency. In any of the above-mentioned configurations, when the processing target signal is audio data, a feature extraction process including an audio frequency is performed.

Further, in one embodiment of the digital watermark detection processing device of the present invention, the feature extraction means is configured to execute feature extraction based on data after signal conversion processing of the processing target signal. And

Further, in one embodiment of the digital watermark detection processing device of the present invention, the signal conversion processing is performed by FFT.
(Fast Fourie Transform), DCT
(Discrete Cosine Transform), W
avelet (wavelet), fractal transform, m
The conversion processing is any of DCT (modified DCT).

Further, a fifth aspect of the present invention is a digital watermark detection processing device for performing a digital watermark pattern detection process on a signal to be processed, a feature extracting means for acquiring a feature amount of the signal to be processed, Control information generating means for outputting a control signal for selecting a plurality of different digital watermark generation keys based on the characteristic amount obtained by the characteristic extracting means; An electronic device comprising: a key conversion unit that executes a conversion process of a watermark generation key; and a correlation extraction unit that executes a correlation extraction process based on a different digital watermark based on a key output by the key conversion unit. In the watermark detection processing device.

Further, in one embodiment of the digital watermark detection processing device of the present invention, the key conversion means selects one spare key from a plurality of spare keys according to a control signal output from the control information generating means. , An operation of an input key and a selection spare key is performed to generate a digital watermark generation key.

Further, in one embodiment of the digital watermark detection processing apparatus of the present invention, when the processing target signal is image data, the feature extracting means includes a luminance, a horizontal frequency, a vertical frequency, and a two-dimensional frequency. In any of the above-mentioned configurations, when the processing target signal is audio data, a feature extraction process including an audio frequency is performed.

Further, in one embodiment of the digital watermark detection processing device of the present invention, the feature extracting means is configured to execute feature extraction based on data after signal conversion processing of the processing target signal. And

Further, in one embodiment of the digital watermark detection processing device of the present invention, the signal conversion processing is performed by FFT.
(Fast Fourie Transform), DCT
(Discrete Cosine Transform), W
avelet (wavelet), fractal transform, m
The conversion processing is any of DCT (modified DCT).

Further, a sixth aspect of the present invention is a digital watermark detection processing device for executing a digital watermark pattern detection process on a signal to be processed, and performs level control or selection of a plurality of different digital watermarks based on time information. Control information generating means for outputting a control signal for processing, and correlation extracting means for executing correlation extraction processing based on different digital watermarks according to the control signal output from the control information generating means. In the digital watermark detection processing device.

Further, a seventh aspect of the present invention is a digital watermark embedding processing method for executing a digital watermark pattern embedding process on a signal to be processed, wherein a feature extracting step of acquiring a feature amount of the signal to be processed, A control information generating step of outputting a control signal for level control or selection processing of a plurality of different digital watermarks based on the feature amount acquired in the feature extracting step, a digital watermark generating step of generating different digital watermarks, A digital watermark embedding processing method, comprising: a level control step of executing level control or selection processing of the digital watermark generated in the digital watermark generation step in accordance with a control signal output in the control information generation step.

Further, in one embodiment of the digital watermark embedding processing method according to the present invention, the feature extracting step includes:
When the processing target signal is image data, the luminance,
A feature extraction process including a horizontal frequency, a vertical frequency, or a two-dimensional frequency, wherein when the processing target signal is audio data, a feature extraction process including the audio frequency is performed.

Further, in one embodiment of the digital watermark embedding processing method according to the present invention, the digital watermark generating step is characterized in that different digital watermark generation processes are executed using different pseudo random patterns as keys.

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark generation step executes different digital watermark generation processing by applying a different digital watermark generation algorithm. .

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark generating step includes applying a different digital watermark generating algorithm in accordance with a control signal output in the control information generating step to obtain a different digital watermark. It is characterized by performing a watermark generation process.

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark generating step has an array generating step of setting a pseudo random pattern to a different array, and the array generated in the array generating step is provided. Is selected according to the embedding information to generate a digital watermark pattern.

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark generating step includes a step of: applying a size of a digital watermark pattern, a filter applied to the generation of the digital watermark, or a signal to be processed or digital watermark data. The digital watermark generation processing is performed by making at least one of the conversion modes different.

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark generating step is configured as a plurality of digital watermark generating steps each generating a different digital watermark, and the control information generating step is performed. Outputting a control signal for digital watermark level control or selection processing to a plurality of level control means provided in correspondence with the plurality of digital watermark generation means, based on the feature amount acquired in the feature extraction step. It is characterized by.

Further, in one embodiment of the digital watermark embedding processing method according to the present invention, the feature extracting step includes:
The apparatus is characterized in that feature extraction is performed based on data after signal conversion processing of the processing target signal.

Further, in one embodiment of the digital watermark embedding processing method according to the present invention, the signal conversion processing includes an FF
T (Fast Fourie Transform), DC
T (Discrete Cosine Transform),
Wavelet, fractal transform,
The conversion processing is any one of mDCT (modified DCT).

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark generating step is characterized in that the processing target signal is input and applied to digital watermark adaptive control in the digital watermark generation processing. I do.

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark generating step includes inputting data after the signal conversion processing of the processing target signal, and performing digital watermark adaptive control in the digital watermark generating processing. It is characterized by being applied to.

Further, in one embodiment of the digital watermark embedding processing method according to the present invention, the signal conversion processing includes an FF
T (Fast Fourie Transform), DC
T (Discrete Cosine Transform),
Wavelet, fractal transform,
The conversion processing is any one of mDCT (modified DCT).

Further, an eighth aspect of the present invention is a digital watermark embedding method for executing a digital watermark pattern embedding process on a signal to be processed, wherein a feature extracting step for acquiring a feature amount of the signal to be processed; A control information generating step of outputting a control signal for selecting a plurality of different digital watermark generation keys based on the feature amount acquired in the feature extracting step; A digital watermark embedding process, comprising: a key conversion step of executing a conversion process of a watermark generation key; and a digital watermark generation step of executing a digital watermark generation process based on the key output in the key conversion step. In the way.

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the key conversion step selects one spare key from a plurality of spare keys according to a control signal output in the control information generating step. , An operation of an input key and a selection spare key is performed to generate a digital watermark generation key.

Further, in one embodiment of the digital watermark embedding processing method according to the present invention, the feature extracting step includes:
When the processing target signal is image data, the luminance,
A feature extraction process including a horizontal frequency, a vertical frequency, or a two-dimensional frequency, wherein when the processing target signal is audio data, a feature extraction process including the audio frequency is performed.

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark generating step includes applying a different digital watermark generating algorithm in accordance with a control signal output in the control information generating step, thereby obtaining a different digital watermark. It is characterized by performing a watermark generation process.

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark generating step includes a step of: applying a size of a digital watermark pattern, a filter applied to the generation of the digital watermark, or the processing target signal or the digital watermark data. The digital watermark generation processing is performed by making at least one of the conversion modes different.

Further, in one embodiment of the digital watermark embedding processing method according to the present invention, the feature extracting step includes:
The apparatus is characterized in that feature extraction is performed based on data after signal conversion processing of the processing target signal.

Further, in one embodiment of the digital watermark embedding processing method according to the present invention, the signal conversion processing includes an FF
T (Fast Fourie Transform), DC
T (Discrete Cosine Transform),
Wavelet, fractal transform,
The conversion processing is any one of mDCT (modified DCT).

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark generating step is characterized in that the processing target signal is input and applied to digital watermark adaptive control in the digital watermark generation processing. I do.

Further, in one embodiment of the digital watermark embedding processing method of the present invention, the digital watermark generating step includes inputting data after the signal conversion processing of the processing target signal, and performing digital watermark adaptive control in the digital watermark generating processing. It is characterized by being applied to.

Further, in one embodiment of the digital watermark embedding processing method according to the present invention, the signal conversion processing includes an FF
T (Fast Fourie Transform), DC
T (Discrete Cosine Transform),
Wavelet, fractal transform,
The conversion processing is any one of mDCT (modified DCT).

Further, a ninth aspect of the present invention is a digital watermark embedding method for executing a digital watermark pattern embedding process on a signal to be processed. The digital watermark embedding processing method performs level control or selection of a plurality of different digital watermarks based on time information. A control information generating step of outputting a control signal for processing, a digital watermark generating step of generating a different digital watermark, and a digital watermark generated in the digital watermark generating step in accordance with the control signal output in the control information generating step. And a level control step of executing a level control or selection process.

Further, in one embodiment of the digital watermark embedding processing method according to the present invention, the digital watermark generation step includes a digital watermark generation key, a digital watermark size, a filter applied to digital watermark generation, or the processing. A different digital watermark generation process is performed by changing at least one of the conversion modes of the target signal and the digital watermark data.

Further, a tenth aspect of the present invention is a digital watermark detection processing method for executing a digital watermark pattern detection process on a signal to be processed, wherein a feature extracting step of acquiring a feature amount of the signal to be processed; A control information generating step of outputting a control signal for level control or selection processing of a plurality of different digital watermarks based on the feature amount obtained in the feature extracting step, and a correlation extraction for executing a correlation extraction processing based on the different digital watermarks And a level control step of performing level control or selection processing of an extracted value in a correlation extraction unit in accordance with a control signal output in the control information generation step.

Further, in one embodiment of the digital watermark detection processing method of the present invention, when the signal to be processed is image data, the feature extracting step includes the steps of luminance, horizontal frequency, vertical frequency, and two-dimensional frequency. Including any,
When the processing target signal is audio data, a feature extraction process including an audio frequency is performed.

Further, in one embodiment of the digital watermark detection processing method according to the present invention, the feature extraction step is characterized in that feature extraction is performed based on data after signal conversion processing of the processing target signal. And

Further, in one embodiment of the digital watermark detection processing method according to the present invention, the signal conversion processing is performed by FFT.
(Fast Fourie Transform), DCT
(Discrete Cosine Transform), W
avelet (wavelet), fractal transform, m
The conversion processing is any of DCT (modified DCT).

Further, an eleventh aspect of the present invention is a digital watermark detection processing method for performing a digital watermark pattern detection process on a signal to be processed, a feature extracting step of acquiring a feature amount of the signal to be processed, A control information generating step of outputting a control signal for selecting a plurality of different digital watermark generation keys based on the feature amount acquired in the feature extracting step; An electronic device comprising: a key conversion step of executing a conversion process of a watermark generation key; and a correlation extraction step of executing a correlation extraction process based on a different digital watermark based on a key output in the key conversion step. In the watermark detection processing method.

Further, in one embodiment of the digital watermark detection processing method of the present invention, the key conversion step selects one spare key from a plurality of spare keys according to a control signal output in the control information generating step. , An operation of an input key and a selection spare key is performed to generate a digital watermark generation key.

Further, in one embodiment of the digital watermark detection processing method according to the present invention, when the signal to be processed is image data, the feature extracting step includes the steps of luminance, horizontal frequency, vertical frequency, and two-dimensional frequency. Including any,
When the processing target signal is audio data, a feature extraction process including an audio frequency is performed.

Further, in one embodiment of the digital watermark detection processing method according to the present invention, the feature extraction step is characterized in that feature extraction is performed based on data after signal conversion processing of the processing target signal. And

Further, in one embodiment of the digital watermark detection processing method according to the present invention, the signal conversion processing is performed by FFT.
(Fast Fourie Transform), DCT
(Discrete Cosine Transform), W
avelet (wavelet), fractal transform, m
The conversion processing is any of DCT (modified DCT).

A twelfth aspect of the present invention is a digital watermark detection processing method for executing a digital watermark pattern detection process on a signal to be processed.
A control information generating step of outputting a control signal for level control or selection processing of a plurality of different digital watermarks, and a correlation extraction for executing a correlation extracting process based on the different digital watermarks according to the control signal output in the control information generating step And a digital watermark detection processing method.

A thirteenth aspect of the present invention is a program storage medium for providing a computer program for causing a computer system to execute a digital watermark embedding process for executing a digital watermark pattern embedding process for a signal to be processed. A feature extraction step of acquiring a feature amount of the signal to be processed, and control information for outputting a control signal for level control or selection processing of a plurality of different digital watermarks based on the feature amount acquired in the feature extraction step A generation step, a digital watermark generation step of generating a different digital watermark, and a level control step of performing level control or selection processing of the digital watermark generated in the digital watermark generation step according to a control signal output in the control information generation step. And having In the program storage medium characterized.

Further, a fourteenth aspect of the present invention is a program storage medium for providing a computer program for causing a computer system to execute a digital watermark detection process for performing a digital watermark pattern detection process on a signal to be processed. A feature extraction step of acquiring a feature amount of the signal to be processed, and control information for outputting a control signal for level control or selection processing of a plurality of different digital watermarks based on the feature amount acquired in the feature extraction step A generating step, a correlation extracting step of executing a correlation extracting process based on different digital watermarks, and a control signal output in the control information generating step,
A level control step of executing level control or selection processing of the extracted value in the correlation extracting means.

A fifteenth aspect of the present invention is a program for causing a computer system to execute a digital watermark embedding process for executing a digital watermark pattern embedding process on a signal to be processed, wherein the characteristic amount of the signal to be processed is A control information generating step of outputting a control signal for level control or selection processing of a plurality of different digital watermarks based on the feature amounts obtained in the feature extracting step. A digital watermark generation step of generating, and a level control step of performing level control or selection processing of the digital watermark generated in the digital watermark generation step in accordance with a control signal output in the control information generation step. You have a program to do.

A sixteenth aspect of the present invention is a program for causing a computer system to execute a digital watermark detection process for performing a digital watermark pattern detection process on a signal to be processed, wherein the characteristic amount of the signal to be processed is A control information generating step of outputting a control signal for level control or selection processing of a plurality of different digital watermarks based on the feature amount obtained in the feature extracting step, A correlation extraction step of performing a correlation extraction process based on
A level control step of executing level control or selection processing of an extracted value in a correlation extraction unit according to a control signal output in the control information generation step.

The program of the present invention is provided, for example, in a computer-readable medium to a general-purpose computer system capable of executing various program codes, for example, a storage medium such as a CD, an FD, and an MO. And a program that can be provided by being transmitted through a transmission medium such as a network.

Such a program regulates the execution of various functions of the system based on the reading of the program under the control of the processor, and exerts a cooperative action on the system. The same operation and effect as those of the aspect can be obtained.

Still other objects, features and advantages of the present invention are:
It will become apparent from the following more detailed description based on the embodiments of the present invention and the accompanying drawings. In this specification, a system is a logical set configuration of a plurality of devices, and is not limited to a configuration in which devices of each configuration are in the same housing.

[0091]

DESCRIPTION OF THE PREFERRED EMBODIMENTS First, an outline of a digital watermark embedding process and a detection process having a method applicable to the present invention will be described. In the embodiment described below,
An image signal will be described as an example of a signal to be subjected to digital watermark embedding and detection processing. However, the configuration of the present invention is not limited to an image signal, and all signals including audio and images as signals into which a digital watermark can be embedded are included. Applicable to

[Digital Watermark Embedding Processing Apparatus-First Embodiment] A first embodiment for executing digital watermark embedding processing to which a plurality of digital watermarks are applied will be described with reference to FIG.
The configuration example of FIG. 1 is a configuration example in which two digital watermarks are embedded by controlling the levels of two digital watermarks A and B according to the characteristics of the content to be embedded.

A signal source 101 is a signal to be embedded with a digital watermark pattern.
And various data such as images and sounds read from a storage medium such as a scanner, a digital camera and a microphone, and various signals supplied from a sound capturing device.

The feature extracting means 102 extracts features of a signal to be embedded with a digital watermark pattern input from the signal source 101. The characteristics of the signal include, for example, the luminance of each image frame when the embedding target signal is an image, the horizontal frequency, the vertical frequency, and the two-dimensional frequency as the frequency of the image. One or more features are extracted from various features of the target signal.

An example of processing for executing feature extraction based on the luminance distribution of an image when the signal to be processed is an image will be described with reference to FIG. FIG. 2 shows one frame of an image in which a digital watermark is to be embedded. Feature extraction means 102
Divides the area excluding the peripheral part of the image frame into two parts, left and right, compares the luminances of these divided areas 201 and 202, and uses the difference in luminance between the left image area 201 and the right image area 202 as a feature amount Extract.

The feature extracting means 102 calculates the ratio of the average luminance value of the right area 202 to the average luminance value of the left area 201 of the image frame as K, and expresses k = 20Lo by decibel expression.
Find k as gK. The feature extraction means 102 calculates the k
Is output to the control information generating means 103, and the control information generating means 103 controls the levels of the digital watermarks A and B based on the input value k.

As shown in FIG. 2, the surrounding area of the image is excluded when cropping processing for cutting off the surrounding area is performed at the time of image editing, or processing for inserting subtitle information when the image information is a movie or the like. This is to eliminate the influence of the case where the operation is performed.

The control information generating means 104 performs level control of the digital watermark A and the digital watermark B based on the characteristic amount of the processing target signal output from the characteristic extracting means 102. The control information generation means 104 generates a key P10
3 to output the level control values La and Lb of the digital watermark A and the digital watermark B to the respective level control means 113 and 123.

The key P103 is a key acting as a conversion function for outputting the level control values La and Lb based on the input k. For example, each digital watermark based on the input k as shown in FIG. A and B level control values La and Lb are output. FIG. 3A shows a pattern in which the level of the digital watermark A decreases and the level of the digital watermark B increases with an increase in the input k. FIG. 3B shows a pattern in which the level of the digital watermark A increases with an increase in the input k. And the level of the digital watermark B are randomly increased or decreased. Various other level control patterns are also possible, and this pattern is determined by the key P103 acting as a conversion function that outputs the level control values La and Lb based on the input k.

In FIGS. 3A and 3B, the two digital watermarks A and B are level-controlled and embedded in the data signal to be processed. Alternatively, the electronic watermark of only one of B may be embedded. In this case, the control information generation unit 104 outputs a selection signal to each digital watermark generation unit instead of the level control values La and Lb. Also, a configuration may be adopted in which three or more digital watermarks are level-controlled or selected and embedded according to the characteristics acquired from the content.

Further, in the present embodiment, the processing is described as an example of processing based on one characteristic amount, that is, luminance of an input signal (image), but a control signal is generated by extracting a plurality of different characteristic amounts from a signal. It may be configured. For example, in the example of FIG. 2, the luminance ratio of the left and right of the image frame is detected. However, the luminance ratio of the top and bottom of the image may be extracted and used as a feature amount. There is also a method in which the frequency is obtained and the feature is obtained by band division to obtain a feature amount. FFT (Fast Fou
rie Transform: Fast Fourier Transform, DCT (Discrete
Cosine Transform: Discrete Cosine Transform), Wavele
t (wavelet), fractal transform, mDCT (mo
(dified DCT) and the like, and a feature amount may be calculated based on coefficients obtained from the conversion result.

The level control values La and Lb of the digital watermark A and digital watermark B generated by the control information generating means 104 are output to the level control means 113 and 123. The level control units 113 and 123 control the levels of the digital watermarks A and B generated by the digital watermark generation units 112 and 122 based on the input level control values.

The digital watermark generating means 112 and 122 for digital watermark A and digital watermark B use different keys A and B respectively.
Is applied to generate a digital watermark. Note that the digital watermark algorithm applied in each of the digital watermark generation means 112 and 122 may be the same, but in order to make the digital watermark resistant, that is, a digital watermark strong against tampering, only the keys A and B are different. However, it is preferable that the digital watermark algorithm be different. Further, a configuration may be adopted in which a plurality of processing algorithms are set in an executable state in advance, and are appropriately selected and executed. Hereinafter, digital watermark A
And digital watermark generation means 112 and 122 for digital watermark B
Will be described with reference to FIGS. 4 to 7. FIG.

FIG. 4 shows a configuration example of the digital watermark A generation means 112. Upon input of an image signal as a signal source, the digital watermark A generation unit 112 extracts a high-frequency component of the input signal with a two-dimensional bandpass filter (BPF) 401 and reads the amplitude with a detection unit 402. In general, even if another signal (digital watermark) is added to a portion having many high-frequency components, the added signal is less noticeable due to a masking effect. Therefore, the level of a portion having a high frequency component of the image is high, and the level of a portion having a low frequency component is low, and the digital watermark is generated by the amplitude modulation means 403. That is,
An image signal as a signal source input to the digital watermark A generation unit 112 is used for digital watermark adaptive control in digital watermark generation processing.

The key generation means corresponding to the keys A and 111 in FIG. 1 is, for example, a pseudo random pattern generation means 411.
1 is regularly arranged by the arrangement means 412,
The modulation means 413 modulates according to information (payload) to be embedded as a digital watermark. Information to be embedded as a digital watermark includes, for example, copy control information, copyright information of content, content processing information,
It is various information such as content configuration information, content processing information, content editing information, or a content reproduction processing method, and is, for example, 1 to several tens of bits information.

The digital watermark embedding process will be described. For example, an 8 × 8 pseudo-random pattern as shown in FIG. 5A is set as the key A, and the upper half of the screen to be embedded with a digital watermark is embedded with the first bit of the payload, and the lower half is embedded with the second bit of the payload. In the case, FIG.
As described above, processing such as repeatedly arranging the pseudo-random pattern (A) in the upper half and repeatedly arranging the inverted (-A) of the pseudo-random pattern in the lower half is performed. FIG. 5 shows an example in which 2-bit digital watermark information is embedded in one image frame.
When embedding bit information in an image frame, the image is further divided and each bit is embedded in each divided area.

The digital watermark A generated by the amplitude modulation means 403 of FIG. 4 is further converted to the level control means A of FIG.
113, the level of the digital watermark A generated based on the level control signal La of the control information generating unit is controlled, and the signal (for example, an image) output to the adding unit 105 and input from the signal source 101; Further, an addition process is performed with the digital watermark B having undergone the level control input from the level control means B123, and is output as a digital watermark embedded signal.

Next, a configuration example of the digital watermark B generating means 122 will be described with reference to FIG. When receiving the image signal as a signal source, the digital watermark B
A high-frequency component of the input signal is extracted by a dimensional bandpass filter (BPF) 601, and an amplitude is read by a detection unit 602. In general, even if another signal (digital watermark) is added to a portion having many high-frequency components, the added signal is less noticeable due to a masking effect. Accordingly, the level of a portion having a high frequency component of the image is high, and the level of a portion having a low frequency component is low, and the digital watermark is generated by the amplitude modulation means 603.

The key generation means corresponding to the keys B and 121 in FIG. 1 is, for example, a pseudo random pattern generation means 611.
One sequence is regularly arranged by the array P generating means 612 and the array Q generating means 613, and the selecting means 614 selects either the array P or the array Q according to the information (payload) to be embedded as a digital watermark. It will be modulated.

For example, the array P indicates the payload [0] and the array Q indicates the payload [1]. A pseudo random pattern of 8 × 8 but different values as shown in FIG. 5A is set as the key B, and the upper half of the screen to be embedded with the digital watermark is the first bit of the payload and the lower half is the payload. When embedding the second bit of
When the first bit is [0], as shown in FIG.
Pseudo random pattern (B) as array P in the upper half,
Set (B, -B) of inverted pseudo random pattern (-B)
Are arranged in a size of, for example, 90 horizontally and 20 vertically. Further, when the second bit is [1], the lower half of the array Q
(−B, B) is repeated, for example, horizontal 90, vertical 2
Arrange in size of 0.

FIG. 7 shows an example in which 2-bit digital watermark information is embedded in one image frame.
For example, when embedding 8-bit information in an image frame,
The image is further divided so that each bit is embedded in each divided area.

The digital watermark B generated by the amplitude modulation means 603 of FIG. 6 is further converted to the level control means B of FIG.
A signal (for example, an image) input from the signal source 101, which is output to the control unit 123 and is generated based on the level control signal Lb of the control information generating unit, is controlled, and is output to the adding unit 105. Then, addition processing is performed with the level-controlled digital watermark A input from the level control unit A113, and is output as a digital watermark embedded signal. The addition means 1
05 indicates addition, subtraction,
The result of executing various operations based on the input data, such as multiplication, is output as a digital watermark embedded signal.

As described above, the digital watermark A and the digital watermark B
Is a setting with different keys, and it is almost impossible for a third party who does not know these multiple keys to detect a digital watermark from an image in which multiple watermarks are embedded with multiple keys applied. . Therefore, by taking the difference between the signal before digital watermark embedding and the signal after digital watermark embedding, the possibility of extracting only the digital watermark component is greatly reduced, and the extracted digital watermark is embedded in other contents. In addition to the above, it is possible to eliminate the illegal processing, and in the legitimate detection device, it is possible to efficiently detect an accurate digital watermark by extracting the features of the content.

Further, as described in the above-described embodiment, the digital watermark A and the digital
By setting different algorithms, the detection of digital watermarks from images in which multiple keys and multiple watermarks with multiple algorithms are embedded is almost impossible for a third party who does not know both the keys and the algorithms. Impossible.

In the above embodiment, a configuration example using two keys has been described. However, a configuration using three or more keys is also possible. The digital watermark is improved in resistance.

In the above-described embodiment, a configuration in which different pseudo-random patterns are applied to generate different digital watermarks has been described. The sizes of the digital watermark patterns are different from each other, the filters applied to the digital watermark generation are set differently, or FFT (Fast Fourie Transform: Fast Fourier Transform), DCT (Discrete Cosine Transform: Discrete Cosine Transform), Wavelet (Wavelet), fractal transformation, and various settings such as changing the conversion processing mode of digital watermark embedding processing target data or digital watermark data when executing various conversion processing such as mDCT (modified DCT) are possible. By performing the digital watermark level control in these different modes based on the features obtained from the digital watermark embedding processing target data, the same feature detection is performed in the legitimate detection device, that is, in the same way as the embedding processing device side. The detection device can detect an electronic watermark efficiently.

When the above-described algorithm change processing is executed, the control information from the control information generating means is output to the electronic watermark generating means 112 and 122 in the configuration of FIG. 12
2 is configured to select an execution algorithm according to the control signal and execute the digital watermark generation processing.

Further, not only the characteristic of the content but also the key change processing and the algorithm change processing according to the time may be executed. By executing the key update and the algorithm update according to such time, Further, it is possible to embed a highly resistant digital watermark.

In the configuration for executing the processing according to the time, the control information generating means 104 shown in FIG. 1 obtains time information from a clock built in the apparatus or from the outside, and
According to the acquired time information, a level control signal La, Lb or a selection signal is generated as a control signal and output to the level control means. Regarding the update of the digital watermark according to time, a processing mode will be described in the description of the flow described later.

[Digital Watermark Embedding Processing Apparatus-Second Embodiment] Next, the configuration of a second embodiment of the digital watermark embedding processing apparatus will be described with reference to FIG.

The configuration example of FIG. 8 is described as a configuration example in which the levels of two digital watermarks A and B are controlled in accordance with the characteristics of the content to be embedded with the digital watermark, and the two digital watermarks are embedded. This is a configuration example in which a signal conversion unit 801 and a signal inverse conversion unit 802 are added to the configuration of the first embodiment.

A signal source 101 is a signal to be embedded with a digital watermark pattern.
And various data such as images and sounds read from a storage medium such as a scanner, a digital camera and a microphone, and various signals supplied from a sound capturing device.

The signal conversion means 801 executes a signal conversion process for a signal to be embedded with a digital watermark pattern. The signal conversion processing includes, for example, FFT (Fast Fourie Transform: Fast Fourier Transform) and DCT (Discrete Cosine Transform).
m: discrete cosine transform), Wavelet (wavelet), fractal transform, mDCT (modified DCT), and various other types of transform processing.

The feature extracting means 802 is provided with the signal converting means 80
A feature is extracted based on a conversion signal of a signal to be embedded with a digital watermark pattern input from step 1. In the case of DCT conversion, for example, a coefficient obtained as a result of the conversion processing, such as a DCT coefficient, may be directly applied as a feature amount, or an arithmetic processing result based on the coefficient may be used as a feature amount.

The control information generating means 104 executes level control of the digital watermark A and the digital watermark B based on the characteristic amount of the processing target signal output from the characteristic extracting means 102. The control information generating means 104 determines the key P103
To output the level control values La and Lb of the digital watermark A and the digital watermark B to the respective level control means 113 and 123.

The key P103 is a key that acts as a conversion function for outputting the level control values La and Lb based on the input feature amount k. For example, the key P103 is input as shown in FIG. 3A or FIG. The level control values La and Lb of the digital watermarks A and B based on k are output.

The level control values La and Lb of the digital watermark A and digital watermark B generated by the control information generating means 104 are output to the level control means 113 and 123. The level control units 113 and 123 control the levels of the digital watermarks A and B generated by the digital watermark generation units 112 and 122 based on the input level control values.

In each of the digital watermark generation means 112 and 122 for digital watermark A and digital watermark B, the signal conversion means 801 inputs the result of conversion of the digital watermark pattern embedding target signal as a signal for digital watermark adaptation processing. , An electronic watermark generation process is executed. The signal conversion process
For example, various transformation processes such as FFT (Fast Fourie Transform: Fast Fourier Transform), DCT (Discrete Cosine Transform: Discrete Cosine Transform), Wavelet (Wavelet), Fractal Transform, mDCT (modified DCT) and the like are used. Is input as a signal for digital watermark adaptation processing, and digital watermark generation processing is executed.

In the first embodiment, as described with reference to FIGS. 4 and 6, a signal to be processed (for example, an image) is directly input to a digital watermark generation processing means, and an input signal is input to a two-dimensional band-pass filter (BPF). A high-frequency component is extracted, and the amplitude is read by the detection means, and the level of the high-frequency component of the image is high and the level of the low-frequency part is low, and the digital watermark is generated by the amplitude modulation means. However, for example, DCT (Discrete Cosine Transf
orm: discrete cosine transform) When the result of the conversion is input as a signal for digital watermark adaptation processing, high-frequency component data can be selected from DCT coefficients, and the level of the high-frequency component coefficient is high. A low-level digital watermark is generated for high-frequency components.

The digital watermark generation means 112 and 122 for the digital watermark A and the digital watermark B generate the digital watermark by applying different keys A and B, respectively, as in the first embodiment.
Note that the digital watermark algorithm applied in each of the digital watermark generation means 112 and 122 may be the same, but in order to make the digital watermark resistant, that is, a digital watermark strong against tampering, only the keys A and B are different. However, it is preferable that the digital watermark algorithm be different. The same processes as those in FIGS. 4 to 7 described in the first embodiment can be applied to the configurations of the digital watermark generation units 112 and 122 for the digital watermark A and the digital watermark B.

The adding means 105 shown in FIG. 8 includes the digital watermark embedding target signal subjected to the conversion processing from the signal conversion means 801, the digital watermark A subjected to the level control by the level control means A 113, and the level control by the level control means B 123. The digital watermark B is input, the respective input data are added, and output as a digital watermark embedded signal. Note that the addition means 105 outputs not only the addition processing of each input signal but also the results of executing various operations based on the input data, such as addition, subtraction, and multiplication, as a digital watermark embedded signal.

[Digital Watermark Embedding Processing Apparatus-Third Embodiment] Next, the configuration of a second embodiment of the digital watermark embedding processing apparatus will be described with reference to FIG.

In the configuration example of FIG. 9, in the configuration of the second embodiment described above, only the feature extraction by the feature extraction means 102 is extracted not from the signal after conversion of the processing target signal but from the signal before conversion. . Therefore, the feature extracting unit 102 in FIG.
Similarly to 02, for example, if the embedding target signal is an image,
The luminance of each image frame, the horizontal frequency, the vertical frequency, the two-dimensional frequency, etc. as the frequency of the image, and one or more of various characteristics of the signal to be processed, such as the audio frequency, if it is audio. Extract.

The other configuration is the same as that of the second embodiment. The embedding process of the two digital watermarks is controlled by controlling the levels of the two digital watermarks A and B according to the characteristics of the content to be embedded. Execute.

[Digital Watermark Embedding Processing Apparatus-Fourth Embodiment] Next, the configuration of a digital watermark embedding processing apparatus according to a fourth embodiment will be described with reference to FIG.

In the configuration example of FIG. 10, a signal for adaptive processing of feature extraction by the feature extraction means 102 and digital watermark generation input to the digital watermark generation means A and 112 and digital watermark generation means B and 122 is converted into a signal. This is a configuration example in which the signal is not taken from the signal after signal conversion by the conversion means 801 but from the signal before signal conversion.

The signal for the digital watermark generation adaptive processing is a combination before the signal conversion for the digital watermark generation means A and 112 and after the signal conversion for the digital watermark generation means B and 122, or The configuration may be reversed, or one or both may be configured not to use a signal for adaptive processing. In addition, the result of the feature extraction by the feature extraction unit 102 is stored in the
A configuration used for performing the digital watermark generation adaptive processing in the digital watermark generation units B and 122, or a part of the circuit is also used in the feature extraction unit 102, the digital watermark generation units A and 112, and the digital watermark generation units B and 122. It may be configured.

[Digital Watermark Embedding Processing Apparatus-Fifth Embodiment] Next, the configuration of a digital watermark embedding processing apparatus according to a fifth embodiment will be described with reference to FIG.

The example of the configuration shown in FIG.
3, the digital watermark A whose level is controlled is added to the signal-converted image by the adding unit 1101, and then inversely converted by the signal inverse converting unit 802, and then the electronic watermark whose level is controlled by the level controlling unit B 123. The watermark B is added to the digital watermark A-embedded image by the adding means 1102.

In the signal conversion processing, for example, FFT (Fast Fou
rie Transform: Fast Fourier Transform, DCT (Discrete
Cosine Transform: Discrete Cosine Transform), Wavele
t (wavelet), fractal transform, mDCT (mo
(dified DCT) and the like, and the signal inverse transform unit 802 performs inverse transform of these transform processes.

In the configuration shown in FIG. 11, the signal of the signal source 101 is input to the feature extraction / extraction unit 102, the digital watermark generation unit A112, and the digital watermark generation unit B122. A part or all of the signals may be converted by the signal conversion unit 801.

[Digital Watermark Embedding Processing Apparatus-Sixth Embodiment] Next, the configuration of a digital watermark embedding processing apparatus according to a sixth embodiment will be described with reference to FIG.

Embodiment 6 of the digital watermark embedding processing apparatus shown in FIG. 12 includes a plurality of keys A and B described in Embodiments 1 to 5.
And has only one key A111. The one key A is converted by the key conversion unit 1201 and input to the digital watermark generation unit A112.

The control information is input to the key conversion means 1201 from the control information generation means 104, and the key conversion means
Changes the key conversion mode according to the control information.

FIG. 1 shows a processing example in the key conversion means 1201.
3 will be described. The key conversion means 1201 has a plurality of spare keys J, K, L, M in advance. The control information generation unit 104 generates a selection signal of the spare keys J, K, L, and M based on the feature amount based on the processing target signal output from the feature extraction unit, and outputs the signal to the key conversion unit 1201. For example, when the value of the feature amount k described with reference to FIG.
If the value is 30 to -15, a selection signal of the spare key J is output. If the value of the feature amount k is -15 to 0, a selection signal of the spare key K is output. If it is, the selection signal of the spare key L is output, and if the value of the characteristic amount k is 15 to 30, the selection signal of the spare key M is output.

Upon receiving the selection signals for the spare keys J, K, L, and M output from the control information generating means 104, the key conversion means 1201 executes the operation of the key A and the selected spare key,
A digital watermark generation key of any of AJ, AK, AL, and AM is generated, and the generated key is output to the digital watermark generation unit 112.

The keys AJ, AK, AL, and AM obtained by executing the operation of the key A and the selected spare key are different keys as shown in FIG. Therefore, digital watermark patterns generated based on these keys differ depending on the keys.

The digital watermark A generating means 112 can have the same configuration as in the first embodiment. However, different digital watermark patterns are generated according to the input keys AJ, AK, AL, and AM, output to the adding means 105, and superimposed on the data of the signal source.

In the present embodiment, as in the configurations of the second to fifth embodiments, the feature extraction / extraction unit 102 and the digital watermark generation unit A112 are not limited to the configuration of inputting the signal of the signal source 101, and the FFT ( Fast Fourie Transform: Fast Fourier Transform, DCT (Discrete Cosine Transform), Wavelet (Wavelet), Fractal Transform, mDCT (modified DCT), etc. A configuration for inputting a later signal may be adopted.

According to the configuration of this embodiment, it is possible to generate and embed a plurality of digital watermark patterns corresponding to the characteristics of the content as the processing target data based on one key A.

In the above-described embodiment, a configuration in which a different key, that is, a pseudo-random pattern is applied to generate a different digital watermark has been described. However, different sizes of digital watermark patterns are used, filters applied to digital watermark generation are set differently, or FFT (Fast Fourie Transform: Fast Fourier Transform) and DCT (Discrete Cosine Transform) are used.
m: Discrete cosine transform), Wavelet (wavelet), fractal transform, and various other types of conversion processing, such as changing the algorithm for converting the data to be subjected to digital watermark embedding or the conversion processing mode of digital watermark data. Can be set. By performing the digital watermark generation selection control in these different modes based on features obtained from the digital watermark embedding processing target data, digital watermarks in various modes can be generated.

When the above-described algorithm change processing is executed, in the configuration shown in FIG. 12, the key conversion means 1201 which receives control information from the control information generation means generates an algorithm selection signal in accordance with the control information. By outputting the selection signal to the digital watermark generating means 112, the digital watermark generating means 112 performs a digital watermark generating process according to the selection algorithm.

Further, not only the characteristic of the contents but also the key change processing and the algorithm change processing according to the time may be executed. By executing the key update and the algorithm update according to such time, Further, it is possible to embed a highly resistant digital watermark.

The key change processing according to time as described above,
Alternatively, when executing the algorithm change processing, FIG.
In the configuration of 2, the key conversion unit 1201 that receives control information from the control information generation unit generates a key change process and an algorithm selection signal according to the control information, and converts the key or algorithm selection signal into the digital watermark generation unit 112.
, The digital watermark generation means 112 executes a digital watermark generation process in accordance with the selection algorithm.

In such a configuration that executes processing according to time, the control information generating means 104 shown in FIG. 12 obtains time information from a clock built in the apparatus or from the outside, and performs control in accordance with the obtained time information. A process selection signal is generated as a signal and output to the key conversion means.

[Digital Watermark Embedding Processing Flow] Next, a typical processing example executed in the digital watermark embedding processing apparatus will be described with reference to the processing flow shown in FIG.

First, in step S101, the digital watermark embedding processing device determines whether or not to execute a process for updating a digital watermark embedding algorithm. In the above-described embodiment, the processing algorithm is described as a configuration in which an algorithm corresponding to each different key is used when the key A is used and when the key B is used, but is applied when the key A is used. A plurality of algorithms may be prepared, and the applied algorithm may be changed based on time, content break, or the like. Step S101 performs this determination.

For example, processing such as changing an applied key or an applied algorithm is performed at a certain period of time, for example, one week after the content distribution start time. When the applied key or the applied algorithm is changed according to such date and time, it is necessary that the digital watermark embedding processing device and the digital watermark detection processing device execute notification processing of a change processing rule.

In the case of changing the algorithm, step S1
At 02, an algorithm change process is executed. If a plurality of algorithms are prepared for a plurality of keys A, B,..., Determination and update are performed for each key or collectively.

Next, in step S103, it is determined whether or not to execute a key update process. In the above embodiment,
Although the configuration using two keys A and B has been described, if the same key is continuously used, the possibility of detection by an unauthorized third party may be increased. Preferably, an updating process is performed to improve the performance. Step S103 is a step of determining execution of the key update processing. For example, a processing rule for changing an applied key or an applied algorithm is determined in advance after a certain period of time, for example, one week, has elapsed from the content distribution start time, and the determination is performed according to the specified rule.

In the case of executing the key update processing, step S10
At 4, the key is updated. Multiple keys A, B,
.. Are applied, judgment and update are performed for each key or collectively.

Next, in step S105, the digital watermark embedding processing device executes a feature extraction process for a digital watermark embedding target.

The characteristics of the signal include, for example, the luminance of each image frame when the embedding target signal is an image, the horizontal frequency, the vertical frequency, and the two-dimensional frequency as the frequency of the image. For example, one or more features are extracted from various features of the signal to be processed.
Also, features are extracted from original data such as images and sounds, FFT (Fast Fourie Transform: Fast Fourier Transform), DCT (Discrete Cosine Transform: Discrete Cosine Transform), Wavelet (wavelet),
This is conversion data obtained by performing various conversion processes such as fractal conversion and mDCT (modified DCT).

Next, in step S106, the digital watermark embedding processing device executes digital watermark generation and level control processing. The level control is control performed based on the characteristics of the digital watermark embedding target signal as described in the above embodiment. A plurality of digital watermarks whose levels are controlled based on the characteristics of the digital watermark embedding target signal are output to the adding means.

Next, in step S106, the digital watermark embedding processing device superimposes the level-controlled digital watermark on the digital watermark embedding target signal. Further, in step S108, it is determined whether or not there is a process end command. If there is no command, the digital watermark embedding process of step S107 is continuously executed, and if there is a finish command, the process ends.

[Digital Watermark Detection Processing Apparatus-First Embodiment] Next, an embodiment of a digital watermark detection processing apparatus to which the configuration of the present invention is applied will be described. FIG. 15 shows the configuration of the first embodiment of the digital watermark detection processing device. The configuration example of FIG. 15 is a configuration in which the levels of two digital watermarks A and B are controlled in accordance with the characteristics of the content to be embedded with the digital watermark, and a digital watermark detection process is performed on a signal in which the two digital watermarks are embedded. It is an example.

The signal source 1501 is an image to be processed in which a digital watermark pattern is embedded, and includes various images such as an image read from a storage medium such as a hard disk or a DVD or supplied via a communication medium. It is.

The feature extracting means 1502 includes a signal source 1501
Of the digital watermark pattern-embedded signal that is input from. The characteristics of the signal include, for example, the luminance of each image frame when the embedding target signal is an image, the horizontal frequency, the vertical frequency, and the two-dimensional frequency as the frequency of the image. One or more features are extracted from various features of the target signal.

For example, as described with reference to FIG. 2 in the item of [Digital Watermark Embedding Processing Apparatus-First Embodiment], when the signal to be processed is an image, the feature extraction is performed by the luminance distribution of the image. And so on. However, the feature extraction process on the detection device side needs to be executed as the same feature extraction process as that performed by the digital watermark embedding processing device.

For example, in a digital watermark embedding processing apparatus, when a frequency of image data such as a horizontal frequency, a vertical frequency, and a two-dimensional spatial frequency is acquired and the characteristic is acquired by band division to obtain a characteristic amount, The watermark detection processing device also extracts the same feature amount. Also, in the digital watermark embedding processing device, FFT (Fast Fourie
Transform: Fast Fourier Transform, DCT (Discrete Cos)
ine Transform: discrete cosine transform), Wavelet
(Wavelet), fractal transform, mDCT (modi
In the case where various conversion processes such as fied DCT) are executed and the feature amount is calculated based on the coefficients obtained from the conversion result, the corresponding feature amount is also extracted in the digital watermark detection processing device.

The control information generating means 1504 executes level control of the digital watermark A and the digital watermark B based on the feature amount of the processing target signal output from the feature extracting means 1502.
The control information generating means 1504 determines whether the key P
1503 to control the level control values La and Lb of the digital watermark A and the digital watermark B to each level control means 1513,1
523.

The key P1503 is a key that acts as a conversion function for outputting the level control values La and Lb based on the input feature value k. For example, each key P1503 is based on the input k as shown in FIG. Level control value L of digital watermarks A and B
a and Lb are output. FIG. 3A illustrates a pattern in which the level of the digital watermark A decreases and the level of the digital watermark B increases with an increase in the input k. FIG.
This is a pattern in which the level of the digital watermark A and the level of the digital watermark B are randomly increased or decreased with the increase in the number. Various other level control patterns are possible, but the key P1503 applied on the detection device side Needs to use the same key as the key P applied by the digital watermark embedding processing device.

The correlation extracting unit A1512 calculates a correlation between the key A and an input signal from the signal source 1501. Specifically, the inner product of the key A1511 and the input signal from the signal source 1501 is calculated. If the signal has the digital watermark pattern A embedded therein, the correlation with the key A is large. If the signal has no digital watermark pattern A embedded therein, the correlation with the key A is small. These differences are the key A and the signal source 1501
Is detected as the difference between the inner product value and the input signal from Note that the key A1511 needs to use the same key as the key A to which the digital watermark embedding processing device is applied.

On the other hand, in the correlation extracting means B1522, the key B
And the input signal from the signal source 1501. Specifically, the inner product of the key B1521 and the input signal from the signal source 1501 is calculated. If the signal has the digital watermark pattern B embedded therein, the correlation with the key B is large, and if the signal has no digital watermark pattern B embedded therein, the correlation with the key B is small. These differences are the key B and the signal source 1
It is detected as a difference between the inner product value and the input signal from the input signal 501. Note that the key B1521 needs to use the same key as the key B applied to the digital watermark embedding apparatus.

Next, the level control means A1513 controls the level of the inner product indicating the correlation output from the correlation extraction means A1512 according to the level control information input from the control information generation means 1504. The level control calculates the inner product value indicating the correlation output from the correlation extracting unit A1512,
This is executed as a process of correcting according to the level control information input from the control information generating unit 1504.

On the other hand, the level control means B1523 controls the level of the inner product indicating the correlation output from the correlation extraction means B1522 according to the level control information input from the control information generation means 1504. The level control calculates the inner product value indicating the correlation output from the correlation extracting unit B1522,
This is executed as a process of correcting according to the level control information input from the control information generating unit 1504.

Outputs from the level control means A 1513 and the level control means B 1523 are output from the accumulation means A 151 respectively.
4, and output to the accumulating means B1524, and the result of the level control is accumulated. For example, when the digital watermark is embedded in the image, the processing of the accumulating unit A1514 and the accumulating unit B1524 is performed by accumulating the detection values in each image frame and determining whether or not the digital watermark is embedded after acquiring predetermined accumulated data. Is a process for performing
The determining unit 1505 detects presence / absence of a digital watermark based on the outputs of the accumulating unit A 1514 and the accumulating unit B 1524, and when the digital watermark is embedded, acquires the embedded information based on the embedded digital watermark. .

The digital watermark embedding information is various information such as copy control information, content copyright information, content processing information, content configuration information, content processing information, content editing information, and content reproduction processing method.

As described above, the digital watermark detection processing device has a configuration in which a plurality of digital watermarks, that is, digital watermarks A and B with different keys are detected to acquire embedded information. If it is not known, it is impossible to detect a digital watermark from an image in which a plurality of digital watermarks are embedded.

In FIG. 15, the accumulation means A15
14 and the accumulating means B1524 are shown as separate constituent blocks, however, when the accumulating algorithm of the same algorithm is applicable, one accumulating means may execute the accumulating process of the correlation data of two digital watermarks. .

As described above, the digital watermark detection processing device
A plurality of digital watermarks embedded in the digital watermark embedding processing device (for example, digital watermark A and digital watermark B)
Is configured to extract the features of the content and execute the control according to the extracted features to execute the detection processing of a plurality of digital watermarks. Electronic watermark detection can be executed. In addition, a third party who does not know a plurality of keys can hardly detect a digital watermark, thereby reducing the possibility of falsification and unauthorized use of the digital watermark.

In the above embodiment, the configuration example using two keys has been described. However, a configuration using three or more keys is also possible. Further, by using many keys and many algorithms, the configuration is further improved. The digital watermark is improved in resistance.

In the above-described embodiment, an example has been described in which different digital watermarks are generated by applying different pseudo-random patterns. However, as described in the above-described embodiment of the digital watermark embedding processing device, different digital watermarks are generated. The configuration of the digital watermark generation processing includes different sizes of digital watermark patterns, different settings of filters applied to digital watermark generation, FFT (Fast Fourie Transform: Fast Fourier Transform), DCT (Discrete). Various settings are possible, such as different conversion processing modes when executing various conversion processing such as Cosine Transform (Discrete Cosine Transform), Wavelet (wavelet), fractal transform, and mDCT (modified DCT). Also in the digital watermark detection processing device, it is possible to adopt a configuration in which the above various characteristics similar to those of the embedding processing device side are obtained from the digital watermark embedded data, and control is performed based on the obtained characteristics.

Further, not only the characteristic of the content but also the key change processing and the algorithm change processing according to the time may be executed. By executing the key update and the algorithm update according to such time, Further, it is possible to embed and detect a highly resistant digital watermark.

[Digital Watermark Detection Processing Apparatus-Second Embodiment] Next, a second embodiment of a digital watermark detection processing apparatus to which the present invention is applied will be described. FIG. 16 shows the configuration of a second embodiment of the digital watermark detection processing device. The configuration example of FIG.
As in the first embodiment shown in FIG. 5, two digital watermarks A,
The level of B is controlled to execute a digital watermark detection process on a signal in which two digital watermarks are embedded, and further, a passive watermark detection process is performed as content identity identification, and the content identity identification process is performed. Is to execute.

The feature extracting means 1502 shown in FIG. 16 extracts the features of the digital watermark pattern embedded signal input from the signal source 1501. The characteristics of the signal include, for example, the luminance of each image frame when the embedding target signal is an image, the horizontal frequency, the vertical frequency, and the two-dimensional frequency as the frequency of the image. One or more features are extracted from various features of the target signal.

For example, as described with reference to FIG. 2 in the item of [Digital Watermark Embedding Processing Apparatus-First Embodiment], when the signal to be processed is an image, the feature extraction is performed by the luminance distribution of the image. And so on. However, the feature extraction process on the detection device side needs to be executed as the same feature extraction process as that performed by the digital watermark embedding processing device.

For example, in a digital watermark embedding processing apparatus, when a frequency of image data such as a horizontal frequency, a vertical frequency, and a two-dimensional spatial frequency is obtained and the characteristic is obtained by band division to obtain a characteristic amount, The watermark detection processing device also extracts the same feature amount. Also, in the digital watermark embedding processing device, FFT (Fast Fourie
Transform: Fast Fourier Transform, DCT (Discrete Cos)
ine Transform: discrete cosine transform), Wavelet
(Wavelet), fractal transform, mDCT (modi
In the case where various conversion processes such as fied DCT) are executed and the feature amount is calculated based on the coefficients obtained from the conversion result, the corresponding feature amount is also extracted in the digital watermark detection processing device.

The registered characteristic amount storage means 1601 previously stores characteristic amount measurement result data of the signal supplied from the signal source 1501, and the collation means 1602 outputs the characteristic amount output from the characteristic extraction means 1502. And a feature amount output from the registered feature amount storage unit 1601 are compared. In this comparison and matching process, when the feature data input from both match,
It is determined that the content supplied from the signal source 1501 is the content specified by the feature stored in the registered feature amount storage unit 1601.

The processing for detecting the digital watermarks A and B is the same as that in the first embodiment described with reference to FIG. It should be noted that the passive watermark detection processing as the above-described content identity identification,
The processing of detecting the digital watermark A and the digital watermark B is called active watermark detection processing. Information acquired by the active watermark detection process includes content distributor information, broadcast station identification information, copy control information, content copyright information, content processing information, content configuration information, content processing information, content editing information,
Or various information such as a content reproduction processing method.

Note that the identity detection processing based on the detection of the passive watermark is performed by the registered feature amount storage unit 160.
1 may be selectively executed only when the feature amount is stored.

In the case of AV content in which image and audio data are mixed, active watermark detection and passive watermark detection are individually performed on the image data, and the active watermark is also individually detected on the audio data. It may be configured to detect a mark and detect a passive watermark. Also in this case, the identity detection processing based on the detection of the passive watermark is selectively executed only when the registered feature amount storage unit 1601 stores feature data of image data or audio data as feature amounts. It can be.

[Digital Watermark Detection Processing Apparatus-Third Embodiment] Next, a third embodiment of a digital watermark detection processing apparatus to which the configuration of the present invention is applied will be described. FIG. 17 shows the configuration of a third embodiment of the digital watermark detection processing device. The configuration example of FIG. 17 is a configuration example of a digital watermark detection processing device corresponding to the above [Digital Watermark Embedding Processing Device-Sixth Embodiment], and has only one key A1511 without a plurality of keys A and B. The key A is converted by the key conversion unit 1701 and input to the digital watermark generation unit A 1712.

Control information is input to key conversion means 1701 from control information generation means 1504, and
1 changes the key conversion mode according to the control information.

In the key conversion means 1701, the digital watermark embedding processing apparatus-sixth embodiment shown in FIG.
The same processing as described with reference to FIG. That is, a plurality of spare keys J, K,
L and M (see FIG. 13). Control information generating means 15
04 generates a selection signal of the spare keys J, K, L, M based on the feature amount based on the processing target signal output from the feature extraction unit 1502, and outputs the signal to the key conversion unit 1701. For example, if the value of the feature value k described with reference to FIG. 3 in [Digital watermark embedding processing apparatus-first embodiment] is −30 to −15, a selection signal of the spare key J is output, and If the value is-
If the value is 15 to 0, a selection signal of the spare key K is output. If the value of the feature amount k is 0 to 15, a selection signal of the spare key L is output. If the value of the feature amount k is 15 to 30, the selection signal is output. It is possible to adopt a configuration such as outputting a selection signal of the spare key M.

When the key conversion means 1701 receives the selection signal of the spare keys J, K, L and M output from the control information generating means 1504, the key conversion means 1701 executes the operation of the key A and the selected spare key, and Generate any key of AK, AL, AM,
The generated key is output to correlation extracting means 1712.

The correlation extracting means A 1712 calculates a correlation between any one of the keys AJ, AK, AL and AM output from the key converting means 1701 and the input signal from the signal source 1501. Note that the key A1511 needs to use the same key as the key A to which the digital watermark embedding processing device is applied. Since the feature data extracted by the feature extraction unit 1502 is obtained based on the content, the same extraction method as the feature extraction method generated in the digital watermark detection processing device is applied to obtain the same feature data. Feature data is obtained. Therefore, the control information generating means 1
The selection signal of the spare keys J, K, L, and M output by 504 is
It becomes the same selection signal as the digital watermark embedding processing device,
The keys AJ, AK, AL, and AM obtained as a result of the operation of the key A and the spare key selected by the selection signal are the same keys as those of the electronic watermark embedding processing device.

In the correlation extracting means 1712, the keys AJ, A
One of K, AL, and AM is correlated with the input signal from the signal source 1501. Next, the accumulating unit 1713 accumulates the detection values, and after obtaining predetermined accumulated data, the judging unit 1714 judges whether or not the digital watermark is embedded. Acquire embedded information based on a digital watermark.

In the above-described embodiment, the configuration in which different keys are applied to generate different digital watermarks has been described. The different digital watermark generation processing configurations include not only such a configuration but also a digital watermark. The size of each pattern may be different, the filter applied to digital watermark generation may be set differently, or FFT (Fa
st Fourie Transform: Fast Fourier Transform, DCT (Di
screte Cosine Transform), Wav
elet (wavelet), fractal transform, mDC
Various settings can be made, such as changing the algorithm such as changing the conversion processing mode of digital watermark embedding processing target data or digital watermark data when performing various conversion processes such as T (modified DCT). By executing the digital watermark generation selection control in these different modes based on the features obtained from the digital watermark embedded data, it is possible to generate and detect digital watermarks in various modes.

Further, not only the characteristic of the content but also the key change processing and the algorithm change processing according to the time may be executed. By executing the key update and the algorithm update according to such time, Further, it is possible to embed a highly resistant digital watermark.

[System Configuration Example] The series of processing described in the above embodiment can be executed by hardware, software, or a combination of both. When executing processing by software, a program recording a processing sequence is installed in a memory in a data processing device built in dedicated hardware and executed, or a general-purpose computer capable of executing various processing is used. It is possible to install and run the program. When a series of processes is performed by software, a program constituting the software is installed in, for example, a general-purpose computer or a one-chip microcomputer. FIG.
A series of processes described above, specifically, generation of a digital watermark,
3 shows an example of a system configuration of a device that executes at least one of embedding and detection processing.

The system has a CPU (Central Processing).
Unit 1802). CPU (Central processing U
nit) 1802 is various application programs,
The OS (Operating System) is actually executed. ROM
A (Read-Only-Memory) 1803 stores a program executed by the CPU 1802 or fixed data as operation parameters. RAM (Random Access Memory)
Reference numeral 1804 is used as a storage area and a work area for a program executed in the processing of the CPU 1802 and parameters that change as appropriate in the program processing. CPU 1802, ROM 1803, RAM 180
4 and the hard disk 1805 are connected by a bus 1801 and can mutually transfer data. Further, data transfer with various input / output devices connected to the input / output interface 1811 is possible.

The keyboard 1812 and the mouse 1813 are C
It is operated by the user to input various commands to the PU 1802, and is operated by the user at the time of inputting command input data.
11 is input.

A drive 1809 is a floppy (registered trademark) disk, CD-ROM (Compact Disc Read Only M
emory), MO (Magneto optical) disk, DVD (Digi
tal Versatile Disc), a drive that performs recording and reproduction of a removable recording medium 1810 such as a magnetic disk and a semiconductor memory, and executes a program or data reproduction from each of the removable recording media 1810 and a storage of the program or data in the removable recording medium 1810. .

[0205] The CPU 1802 controls the keyboard 1812 and the mouse 181 via the input / output interface 1810.
When a command is input through 3 or the like,
A program stored in a ROM (Read Only Memory) 1803 is executed.

In the above-described embodiment, an image to be embedded with a digital watermark or an image to be detected is an input device other than the camera 1823 connected to the input unit 1807, for example, a data input device such as a scanner, or a drive 1809. Floppy disk and CD-
ROM (Compact Disc Read Only Memory), MO (Magnet
o optical) Disc, DVD (Digital Versatile Dis)
c), can be input from a removable recording medium 1810 such as a magnetic disk or a semiconductor memory. Note that the present system has a configuration in which audio data can be input via the microphone 1824. Further, data received via the communication unit 1808 can be processed as image data to be embedded with an electronic watermark or image data to be detected.

The CPU 1802 is not limited to a program stored in the ROM, but may be a program stored in the hard disk 1805, a program transferred from a satellite or a network, received by the communication unit 1808 and installed in the hard disk 1805, or a drive 1809.
It is also possible to load a program read from the removable recording medium 1810 attached to the hard disk 1805 and installed on the hard disk 1805 into a random access memory (RAM) 1804 and execute the program.

In the system having the configuration shown in FIG. 18, the CPU 1802 performs processing according to each of the above-described embodiments or processing performed according to the above-described block diagrams and flowcharts. And the CPU 1802
Can output the processing result to an LCD (Liquid CrySta
lDisplay), a display device 1821 such as a CRT, and a speaker 1222 via an output unit 1806. Further, the processing data can be transmitted from the communication unit 1808, and can be stored in a recording medium such as the hard disk 1805.

An execution program for various processes is stored in a hard disk 180 as a recording medium built in the system.
5 or ROM 1803 in advance.
Alternatively, the program is a floppy disk, CD-R
OM (Compact Disc Read Only Memory), MO (Magneto
optical) disc, DVD (Digital Versatile Disc),
It can be temporarily or permanently stored (recorded) in a removable recording medium 1810 such as a magnetic disk or a semiconductor memory. Such a removable recording medium 1810 can be provided as so-called package software.

The program can be installed in the computer from the removable recording medium 1810 as described above, can be wirelessly transferred from a download site to the computer via a digital satellite broadcasting artificial satellite, or can be connected to a LAN (Local Area Network). ), The program can be transferred to a computer via a network such as the Internet by wire, and the computer can receive the transferred program by the communication unit 1808 and install the program on the built-in hard disk 1805.

Here, in this specification, processing steps for writing a program for causing a computer to perform various processes do not necessarily need to be processed in chronological order in the order described in the flowchart, and may be performed in parallel. Alternatively, it also includes processing executed individually (for example, parallel processing or processing by an object).

The program may be processed by one computer, or may be processed in a distributed manner by a plurality of computers. Further, the program may be transferred to a remote computer and executed.

The present invention has been described in detail with reference to the specific embodiments. However, it is obvious that those skilled in the art can modify or substitute the embodiment without departing from the spirit of the present invention. In the embodiment, the image signal is mainly described as a target of the embedding and detection processing of the electronic watermark. However, the configuration of the present invention is not limited to the image signal.
The present invention can be applied to audio, image, and all other signals that are likely to be subjected to the digital watermark embedding process. That is, the present invention has been disclosed by way of example, and should not be construed as limiting. In order to determine the gist of the present invention, the claims described at the beginning should be considered.

[0214] The various processes described in the specification are as follows.
It may be executed not only in chronological order according to the description, but also in parallel or individually according to the processing capability of the device that executes the process or as necessary. Also, in this specification, a system is a logical set configuration of a plurality of devices,
The devices of each configuration are not limited to those in the same housing.

[0215]

According to the configuration of the present invention described above, a plurality of digital watermarks are generated by using different keys in accordance with the characteristics of content or the passage of time, and signals such as images and sounds to be processed are processed. , It is almost impossible for a third party who does not know a plurality of keys to detect a digital watermark from a digital watermark embedded signal, and to effectively prevent detection and tampering of an illegal digital watermark. In addition, the legitimate detection device can efficiently detect an accurate digital watermark by extracting the features of the content.

Further, according to the configuration of the present invention, a plurality of digital watermarks are embedded in a signal of an image, a sound, or the like to be processed, with not only a different key but also a different algorithm. Detection of a digital watermark from a signal is almost impossible for a third party who does not know both the key and the algorithm, and it is possible to effectively prevent detection and tampering of an illegal digital watermark.

[Brief description of the drawings]

FIG. 1 is a configuration diagram illustrating a first embodiment of a digital watermark embedding processing apparatus.

FIG. 2 is a diagram illustrating an example of detection processing of a feature to be embedded in a digital watermark.

FIG. 3 is a diagram illustrating a digital watermark level control process according to detection of a feature to be embedded in a digital watermark.

FIG. 4 is a diagram illustrating an example of a configuration of a digital watermark embedding process.

FIG. 5 is a diagram illustrating a key applied to the digital watermark embedding process and a mode of the digital watermark embedding process.

FIG. 6 is a diagram illustrating an example of a configuration of a digital watermark embedding process.

FIG. 7 is a diagram illustrating a digital watermark embedding processing mode.

FIG. 8 is a configuration diagram illustrating a second embodiment of the digital watermark embedding processing apparatus.

FIG. 9 is a configuration diagram illustrating a third embodiment of the digital watermark embedding processing apparatus.

FIG. 10 is a configuration diagram illustrating a fourth embodiment of the digital watermark embedding processing apparatus.

FIG. 11 is a block diagram showing a fifth embodiment of the digital watermark embedding processing apparatus.

FIG. 12 is a configuration diagram showing a sixth embodiment of the digital watermark embedding processing device.

FIG. 13 is a diagram illustrating a key conversion process in a sixth embodiment of the digital watermark embedding processing device.

FIG. 14 is a flowchart showing a digital watermark embedding processing flow.

FIG. 15 is a configuration diagram illustrating a first embodiment of a digital watermark detection processing device.

FIG. 16 is a configuration diagram illustrating a second embodiment of the digital watermark detection processing device.

FIG. 17 is a configuration diagram illustrating a third embodiment of the digital watermark detection processing device.

FIG. 18 is a diagram illustrating an example of a system configuration of a digital watermark embedding processing device and a digital watermark detection processing device.

[Explanation of symbols]

 Reference Signs List 101 signal source 102 feature extraction means 103 key 104 control information generation means 105 addition means 111, 121 keys 112, 122 digital watermark generation means 113, 123 level control means 401 two-dimensional BPF 402 detection means 403 amplitude modulation means 411 pseudo-random pattern generation Means 412 Arrangement means 413 Modulation means 601 Two-dimensional BPF 602 Detection means 603 Amplitude modulation means 611 Pseudorandom pattern generation means 612, 613 Arrangement means 614 Selection means 801 Signal conversion means 802 Signal inverse conversion means 1102 Addition means 1201 Key conversion means 1501 Signal Source 1502 Feature extraction unit 1503 Key 1504 Control information generation unit 1511, 1521 Key 1512, 1522 Correlation extraction unit 1513, 1523 Level control unit 1514, 1524 Cumulative Means 1505 Judgment means 1601 Registered feature quantity accumulation means 1602 Collation means 1701 Key conversion means 1712 Correlation extraction means 1713 Level control means 1714 Accumulation means 18202 CPU 1803 ROM 1804 RAM 1805 Hard disk 1806 Output section 1807 Input section 1808 Communication section 1809 Drive 1810 Remove full Recording medium 1811 Keyboard / mouse controller 1812 Keyboard 1813 Mouse 1821 Display device 1822 Speaker 1823 Camera 1824 Microphone

Claims (74)

[Claims] 1. A digital watermark embedding processing device for executing a digital watermark pattern embedding process on a processing target signal, wherein: a feature extracting unit for obtaining a characteristic amount of the processing target signal; Control information generating means for outputting a control signal for level control or selection processing of a plurality of different digital watermarks, digital watermark generating means for generating different digital watermarks, and a control signal output from the control information generating means And a level control means for executing level control or selection processing of the digital watermark generated by the digital watermark generation means according to the above. 2. The method according to claim 1, wherein when the processing target signal is image data, the feature extraction means includes one of luminance, a horizontal frequency, a vertical frequency, and a two-dimensional frequency, and the processing target signal is audio data. 2. The digital watermark embedding processing apparatus according to claim 1, wherein in the case, a feature extraction process including a voice frequency is executed. 3. The digital watermark embedding processing apparatus according to claim 1, wherein said digital watermark generation means has a configuration for executing different digital watermark generation processing using different pseudo-random patterns as keys. 4. The digital watermark embedding processing apparatus according to claim 1, wherein said digital watermark generation means has a configuration for executing different digital watermark generation processing by applying different digital watermark generation algorithms. . 5. The digital watermark generation means has a configuration for executing different digital watermark generation processing by applying different digital watermark generation algorithms according to a control signal output from the control information generating means. The digital watermark embedding processing device according to claim 1. 6. The digital watermark generating means includes an array generating means for setting a pseudo random pattern in a different array, and selects an array generated by the array generating means according to embedding information to generate a digital watermark pattern. 2. The digital watermark embedding processing device according to claim 1, comprising: 7. The digital watermark generating means according to claim 1, wherein at least one of a digital watermark pattern size, a filter applied to digital watermark generation, and a conversion mode of the processing target signal or digital watermark data is changed. 2. The digital watermark embedding processing device according to claim 1, further comprising a configuration for executing a watermark generation process. 8. The digital watermark generating unit is configured as a plurality of digital watermark generating units each generating a different digital watermark, and the control information generating unit is configured to generate a digital watermark based on a characteristic amount acquired by the characteristic extracting unit. 2. The apparatus according to claim 1, wherein a control signal for controlling or selecting a digital watermark level is output to a plurality of level control units provided corresponding to the plurality of digital watermark generation units. Digital watermark embedding processor. 9. The electronic watermark embedding processing apparatus according to claim 1, wherein the feature extracting means is configured to execute feature extraction based on data after signal conversion processing of the processing target signal. 10. The signal conversion processing includes: FFT (Fast Fourie Transform: Fast Fourier Transform);
The digital watermark embedding processing apparatus according to claim 9, wherein the processing is any one of DCT (Discrete Cosine Transform), Wavelet (wavelet), fractal transformation, and mDCT (modified DCT). 11. The digital watermark embedding process according to claim 1, wherein the digital watermark generating means has a configuration for inputting the processing target signal and applying the signal to the digital watermark adaptive control in the digital watermark generation process. apparatus. 12. The digital watermark generation means inputs data after signal conversion processing of the processing target signal,
2. The digital watermark embedding processing apparatus according to claim 1, wherein the digital watermark embedding processing apparatus has a configuration applied to digital watermark adaptive control in digital watermark generation processing. 13. The signal conversion process according to claim 1, wherein: FFT (Fast Fourie Transform: fast Fourier transform);
13. The electronic watermark embedding processing apparatus according to claim 12, wherein the processing is any one of DCT (Discrete Cosine Transform), Wavelet (wavelet), fractal transformation, and mDCT (modified DCT). 14. A digital watermark embedding processing device for executing a digital watermark pattern embedding process on a signal to be processed, a feature extracting means for acquiring a feature quantity of the signal to be processed, and a feature quantity acquired by the feature extracting means. A control information generating unit that outputs a control signal for selecting a plurality of different digital watermark generation keys based on the control signal, and performs a digital watermark generation key conversion process in accordance with the control signal output by the control information generation unit A digital watermark embedding processing device, comprising: a key conversion unit that performs a digital watermark generation process based on a key output by the key conversion unit. 15. The key conversion means selects one spare key from a plurality of spare keys according to a control signal output from the control information generating means, and executes an operation of an input key and a selected spare key. 15. The digital watermark embedding processing apparatus according to claim 14, wherein the digital watermark generation key is configured to generate a digital watermark generation key. 16. When the processing target signal is image data, the feature extraction means includes one of luminance, a horizontal frequency, a vertical frequency, and a two-dimensional frequency, and the processing target signal is audio data. 15. The digital watermark embedding processing apparatus according to claim 14, wherein in such a case, a feature extraction process including an audio frequency is performed. 17. The digital watermark generation means has a configuration for executing different digital watermark generation processing by applying different digital watermark generation algorithms in accordance with a control signal output from the control information generation means. 15. The digital watermark embedding processing device according to claim 14. 18. The digital watermark generating means according to claim 1, wherein at least one of a size of a digital watermark pattern, a filter applied to digital watermark generation, and a conversion mode of the processing target signal or digital watermark data is changed. 15. The digital watermark embedding processing apparatus according to claim 14, wherein the digital watermark embedding processing apparatus has a configuration for executing a watermark generation process. 19. The digital watermark embedding processing apparatus according to claim 14, wherein said feature extracting means is configured to execute feature extraction based on data after signal conversion processing of said processing target signal. 20. The signal conversion process according to claim 1, wherein the FFT (Fast Fourie Transform: Fast Fourier Transform),
20. The digital watermark embedding processing apparatus according to claim 19, wherein the processing is any one of DCT (Discrete Cosine Transform), Wavelet (wavelet), fractal transformation, and mDCT (modified DCT). 21. The digital watermark embedding process according to claim 14, wherein the digital watermark generating means has a configuration for inputting the processing target signal and applying the signal to the digital watermark adaptive control in the digital watermark generation process. apparatus. 22. The digital watermark generation means receives data after signal conversion processing of the processing target signal,
15. The digital watermark embedding processing apparatus according to claim 14, comprising a configuration applied to digital watermark adaptive control in digital watermark generation processing. 23. The signal conversion processing includes: FFT (Fast Fourie Transform: Fast Fourier Transform);
23. The digital watermark embedding processing apparatus according to claim 22, wherein the processing is any one of DCT (Discrete Cosine Transform), Wavelet (wavelet), fractal transformation, and mDCT (modified DCT). 24. A digital watermark embedding processing device for executing a digital watermark pattern embedding process on a signal to be processed, and outputs a control signal for level control or selection of a plurality of different digital watermarks based on time information. Control information generating means; digital watermark generating means for generating different digital watermarks; and level for executing level control or selection processing of the digital watermark generated by the digital watermark generating means in accordance with a control signal output from the control information generating means. A digital watermark embedding processing device, comprising: control means; 25. The digital watermark generation means, comprising: at least one of a digital watermark generation key, a digital watermark size, a filter applied to digital watermark generation, and a conversion mode of the processing target signal or digital watermark data. 25. The digital watermark embedding processing apparatus according to claim 24, wherein the digital watermark embedding processing apparatus is configured to execute different digital watermark generation processing by making the processing different. 26. An electronic watermark detection processing device for performing an electronic watermark pattern detection process on a signal to be processed, wherein: a characteristic extracting means for acquiring a characteristic amount of the signal to be processed; Control information generating means for outputting a control signal for level control or selection processing of a plurality of different digital watermarks, a correlation extracting means for executing correlation extraction processing based on different digital watermarks, A digital watermark detection processing device, comprising: level control means for performing level control or selection processing of an extracted value of the correlation extraction means in accordance with a control signal to be output. 27. When the processing target signal is image data, the feature extraction means includes one of luminance, a horizontal frequency, a vertical frequency, and a two-dimensional frequency, and the processing target signal is audio data. 27. The digital watermark detection processing device according to claim 26, wherein in such a case, a feature extraction process including an audio frequency is performed. 28. The digital watermark detection processing apparatus according to claim 26, wherein said feature extracting means is configured to execute feature extraction based on data after signal conversion processing of said processing target signal. 29. The signal conversion process according to claim 27, wherein: FFT (Fast Fourie Transform: fast Fourier transform);
29. The digital watermark detection processing apparatus according to claim 28, wherein the digital watermark detection processing is any one of DCT (Discrete Cosine Transform), Wavelet (wavelet), fractal transform, and mDCT (modified DCT). 30. A digital watermark detection processing device for executing a digital watermark pattern detection process on a signal to be processed, wherein: a feature extraction means for acquiring a feature quantity of the signal to be processed; Control information generating means for outputting a control signal for selecting a plurality of different digital watermark generation keys based on the control information, and performing conversion processing of the digital watermark generation key in accordance with the control signal output from the control information generation means A digital watermark detection processing device comprising: a key conversion unit that performs correlation extraction processing based on a different digital watermark based on a key output by the key conversion unit. 31. The key conversion unit, according to a control signal output by the control information generation unit, selects one spare key from a plurality of spare keys, and executes an operation of an input key and a selected spare key. The digital watermark detection processing device according to claim 30, wherein the digital watermark generation key is configured to generate a digital watermark generation key. 32. When the processing target signal is image data, the feature extraction means includes one of luminance, a horizontal frequency, a vertical frequency, and a two-dimensional frequency, and the processing target signal is audio data. 31. The digital watermark detection processing device according to claim 30, wherein in such a case, a feature extraction process including an audio frequency is performed. 33. The digital watermark detection processing apparatus according to claim 30, wherein said feature extraction means is configured to execute feature extraction based on data after signal conversion processing of said processing target signal. 34. The signal conversion processing includes: FFT (Fast Fourie Transform);
34. The digital watermark detection processing device according to claim 33, wherein the digital watermark detection processing device is any one of DCT (Discrete Cosine Transform), Wavelet (wavelet), fractal transform, and mDCT (modified DCT). 35. A digital watermark detection processing device for performing a digital watermark pattern detection process on a processing target signal, and outputs a control signal for level control or selection of a plurality of different digital watermarks based on time information. An electronic watermark detection processing device, comprising: control information generating means; and correlation extracting means for executing correlation extraction processing based on different electronic watermarks according to a control signal output from the control information generating means. 36. A digital watermark embedding method for executing a digital watermark pattern embedding process on a signal to be processed, a feature extracting step of acquiring a feature amount of the signal to be processed, and a feature amount acquired in the feature extracting step. A control information generating step of outputting a control signal for level control or selection processing of a plurality of different digital watermarks, a digital watermark generating step of generating different digital watermarks, and a control signal output in the control information generating step A level control step of executing level control or selection processing of the digital watermark generated in the digital watermark generation step according to the above. 37. The method according to claim 37, wherein, when the signal to be processed is image data, the feature extraction step includes the steps of:
37. A feature extraction process including one of a vertical frequency and a two-dimensional frequency, and when the processing target signal is audio data, performing a feature extraction process including the audio frequency.
2. A digital watermark embedding processing method according to (1). 38. The digital watermark embedding method according to claim 36, wherein in the digital watermark generating step, different digital watermark generation processes are executed using different pseudo-random patterns as keys. 39. The digital watermark embedding processing method according to claim 36, wherein in the digital watermark generating step, different digital watermark generating processes are executed by applying different digital watermark generating algorithms. 40. The digital watermark generating step executes different digital watermark generating processes by applying different digital watermark generating algorithms according to a control signal output in the control information generating step. 36. The digital watermark embedding processing method according to 36. 41. The digital watermark generating step includes an array generating step of setting a pseudo random pattern to a different array, and selecting an array generated in the array generating step according to embedding information to generate a digital watermark pattern. The digital watermark embedding processing method according to claim 36, wherein: 42. The digital watermark generation step, wherein different digital watermarks are obtained by changing at least one of a size of a digital watermark pattern, a filter applied to digital watermark generation, and a conversion mode of the processing target signal or digital watermark data. 37. The digital watermark embedding method according to claim 36, wherein a watermark generation process is performed. 43. The digital watermark generating step is configured as a plurality of digital watermark generating steps each generating a different digital watermark, and the control information generating step is based on the feature amount acquired in the feature extracting step. 37. The digital watermark embedding process according to claim 36, wherein a control signal for digital watermark level control or selection processing is output to a plurality of level control means provided corresponding to the plurality of digital watermark generation means. Method. 44. The digital watermark embedding processing method according to claim 36, wherein the feature extracting step is configured to execute feature extraction based on data after signal conversion processing of the processing target signal. 45. The signal transforming process includes: FFT (Fast Fourie Transform: Fast Fourier Transform);
The digital watermark embedding method according to claim 44, wherein the digital watermark embedding method is any one of DCT (Discrete Cosine Transform), Wavelet (wavelet), fractal transform, and mDCT (modified DCT). 46. The digital watermark embedding method according to claim 36, wherein in the digital watermark generating step, the processing target signal is input and applied to digital watermark adaptive control in digital watermark generation processing. 47. The digital watermark generating step, comprising inputting data after signal conversion processing of the processing target signal,
37. The digital watermark embedding method according to claim 36, wherein the method is applied to digital watermark adaptive control in digital watermark generation processing. 48. The signal conversion processing includes: FFT (Fast Fourie Transform);
48. The digital watermark embedding method according to claim 47, wherein the method is any one of DCT (Discrete Cosine Transform), Wavelet (wavelet), fractal transform, and mDCT (modified DCT). 49. A digital watermark embedding processing method for executing a digital watermark pattern embedding process on a processing target signal, comprising: a feature extracting step of obtaining a feature amount of the processing target signal; A control information generation step of outputting a control signal for selecting a plurality of different digital watermark generation keys based on the control information, and performing a digital watermark generation key conversion process in accordance with the control signal output in the control information generation step A digital watermark embedding process, wherein the digital watermark embedding process performs a digital watermark generation process based on a key output in the key conversion step. 50. The key conversion step, according to a control signal output in the control information generation step, selects one spare key from a plurality of spare keys,
50. A structure for generating a digital watermark generation key by performing an operation of an input key and a selection spare key.
2. A digital watermark embedding processing method according to (1). 51. When the signal to be processed is image data, the feature extraction step includes the steps of:
50. A feature extraction process including one of a vertical frequency and a two-dimensional frequency and performing a feature extraction process including an audio frequency when the processing target signal is audio data.
2. A digital watermark embedding processing method according to (1). 52. The digital watermark generation step executes different digital watermark generation processes by applying different digital watermark generation algorithms according to a control signal output in the control information generation step. 49. A digital watermark embedding processing method according to 49. 53. The digital watermark generation step, wherein different digital watermarks are obtained by changing at least one of a size of a digital watermark pattern, a filter applied to digital watermark generation, and a conversion mode of the processing target signal or digital watermark data. 50. The digital watermark embedding processing method according to claim 49, wherein the watermark generation processing is performed. 54. The electronic watermark embedding method according to claim 49, wherein said feature extracting step is configured to execute feature extraction based on data after signal conversion processing of said processing target signal. 55. The signal transforming process includes: FFT (Fast Fourie Transform: Fast Fourier Transform);
55. The digital watermark embedding method according to claim 54, wherein the digital watermark embedding method is any one of DCT (Discrete Cosine Transform), Wavelet (wavelet), fractal transform, and mDCT (modified DCT). 56. The digital watermark embedding method according to claim 49, wherein in the digital watermark generating step, the processing target signal is input and applied to digital watermark adaptive control in digital watermark generation processing. 57. The digital watermark generating step includes: inputting data after signal conversion processing of the processing target signal;
50. The digital watermark embedding method according to claim 49, wherein the method is applied to digital watermark adaptive control in digital watermark generation processing. 58. The signal conversion process according to claim 42, wherein: FFT (Fast Fourie Transform);
58. The digital watermark embedding processing method according to claim 57, wherein the digital watermark embedding processing is any one of DCT (Discrete Cosine Transform), Wavelet (wavelet), fractal transform, and mDCT (modified DCT). 59. A digital watermark embedding method for executing a digital watermark pattern embedding process on a signal to be processed, and outputs a control signal for level control or selection of a plurality of different digital watermarks based on time information. A control information generating step; a digital watermark generating step for generating a different digital watermark; and a level for performing level control or selection processing of the digital watermark generated in the digital watermark generating step in accordance with a control signal output in the control information generating step. A digital watermark embedding processing method, comprising: a control step. 60. The digital watermark generation step, wherein at least one of a digital watermark generation key, a digital watermark size, a filter applied to digital watermark generation, and a conversion mode of the processing target signal or digital watermark data is performed. 60. The digital watermark embedding method according to claim 59, wherein different digital watermark generation processing is executed by making them different. 61. A digital watermark detection processing method for performing a digital watermark pattern detection process on a processing target signal, comprising: a feature extraction step of obtaining a characteristic amount of the processing target signal; A control information generation step of outputting a control signal for level control or selection processing of a plurality of different digital watermarks, a correlation extraction step of executing a correlation extraction processing based on different digital watermarks, A digital watermark detection processing method, comprising: a level control step of executing level control or selection processing of an extracted value in a correlation extraction unit in accordance with a control signal to be output. 62. The feature extracting step, wherein when the processing target signal is image data, a luminance, a horizontal frequency,
62. A feature extraction process including one of a vertical frequency and a two-dimensional frequency and performing a feature extraction process including an audio frequency when the processing target signal is audio data.
3. A digital watermark detection processing method according to claim 1. 63. The digital watermark detection processing method according to claim 61, wherein the feature extraction step is configured to execute feature extraction based on data after signal conversion processing of the processing target signal. 64. The signal conversion processing includes: FFT (Fast Fourie Transform: fast Fourier transform);
62. The digital watermark detection processing method according to claim 61, wherein the digital watermark detection processing is any one of DCT (Discrete Cosine Transform: discrete cosine transform), Wavelet (wavelet), fractal transform, and mDCT (modified DCT). 65. A digital watermark detection processing method for performing a digital watermark pattern detection process on a signal to be processed, wherein: a feature extraction step of acquiring a feature value of the signal to be processed; A control information generation step of outputting a control signal for selecting a plurality of different digital watermark generation keys based on the control information, and performing a digital watermark generation key conversion process in accordance with the control signal output in the control information generation step A digital watermark detection processing method, comprising: a key conversion step of performing a correlation extraction process based on a different digital watermark based on a key output in the key conversion step. 66. The key conversion step, according to a control signal output in the control information generation step, selects one spare key from a plurality of spare keys,
The digital watermark detection processing method according to claim 65, wherein an operation of the input key and the selected spare key is performed to generate a digital watermark generation key. 67. When the signal to be processed is image data, the feature extracting step includes the steps of:
66. A feature extraction process including one of a vertical frequency and a two-dimensional frequency and performing a feature extraction process including an audio frequency when the processing target signal is audio data.
3. A digital watermark detection processing method according to claim 1. 68. The digital watermark detection processing method according to claim 65, wherein said feature extraction step is configured to execute feature extraction based on data after signal conversion processing of said processing target signal. 69. The signal conversion processing includes: FFT (Fast Fourie Transform: fast Fourier transform);
69. The digital watermark detection processing method according to claim 68, wherein the digital watermark detection processing is any one of DCT (Discrete Cosine Transform), Wavelet (wavelet), fractal transform, and mDCT (modified DCT). 70. A digital watermark detection processing method for performing digital watermark pattern detection processing on a processing target signal, and outputs a control signal for level control or selection processing of a plurality of different digital watermarks based on time information. A digital watermark detection processing method, comprising: a control information generation step; and a correlation extraction step of executing a correlation extraction process based on a different digital watermark according to a control signal output in the control information generation step. 71. A computer which executes a digital watermark embedding process for executing a digital watermark pattern embedding process on a processing target signal on a computer system.
A program storage medium that provides a program, comprising: a feature extraction step of acquiring a feature amount of the processing target signal; and a level control or selection process of a plurality of different digital watermarks based on the feature amount acquired in the feature extraction step. Control information generating step of outputting a control signal for generating a digital watermark, a digital watermark generating step of generating a different digital watermark, and a level of the digital watermark generated in the digital watermark generating step in accordance with the control signal output in the control information generating step And a level control step of executing a control or selection process. 72. A program storage medium for providing a computer program for causing a computer system to execute a digital watermark detection process for performing a digital watermark pattern detection process on a signal to be processed, wherein the feature amount of the signal to be processed is A feature extraction step to be acquired; a control information generation step of outputting a control signal for level control or selection processing of a plurality of different digital watermarks based on the feature amount acquired in the feature extraction step; A correlation extraction step of executing a correlation extraction process; and a level control step of executing a level control or selection process of an extracted value in a correlation extraction unit according to a control signal output in the control information generation step. Program storage medium. 73. A program for causing a computer system to execute a digital watermark embedding process for executing a digital watermark pattern embedding process on a signal to be processed, wherein: a feature extracting step of acquiring a feature amount of the signal to be processed; A control information generating step of outputting a control signal for level control or selection processing of a plurality of different digital watermarks based on the feature amount acquired in the feature extracting step; a digital watermark generating step of generating different digital watermarks; A level control step of executing level control or selection processing of the digital watermark generated in the digital watermark generation step in accordance with a control signal output in the control information generation step. 74. A program for causing a computer system to execute a digital watermark detection process for performing a digital watermark pattern detection process on a signal to be processed, wherein: a feature extracting step of acquiring a feature amount of the signal to be processed; A control information generating step of outputting a control signal for level control or selection processing of a plurality of different digital watermarks based on the feature amount obtained in the feature extracting step; and a correlation extraction for executing a correlation extraction processing based on the different digital watermarks And a level control step of executing level control or selection processing of an extracted value in a correlation extraction unit in accordance with a control signal output in the control information generation step.