JP2002006840A - Digital data processing method and digital data processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent the loss of the digital watermarking data of copyright information from output data when data is subjected to reproducing, fabricating and converting and to obtain information for chasing an illicit user who carries out such processing. SOLUTION: When the data embedded with the copyright information as the digital watermarking data is subjected to the processing, such as the reproducing, fabricating and converting, the copyright information is read out of this data and the reproducing information specific to the processing described above is read out and the reproducing information is added to the copyright information and is embedded as the digital watermarking data into the data after the processing.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital data processing method and a digital data processing apparatus for processing digital data in which copyright is generated.

[0002]

2. Description of the Related Art Conventionally, audio data, musical sound data,
Data such as image data and moving image data are copied without permission to the copyright holder who holds the above-mentioned data after the recording medium on which the data is recorded is once sold to the market. ) Could be circulated in large quantities, and such unauthorized copying would unduly infringe on the rights of the copyright owner, causing serious damage to the copyright owner.

[0003] However, there are few means for effectively preventing such illegal copying, and it is difficult to confirm the evidence even from the law. Many methods have been proposed to prevent the illegal copying described above. However, when a recording medium on which such a method is performed is reproduced, the quality of the obtained audio is reduced,
There were problems such as a decrease in image quality.

[0004] In order to solve this problem, security data such as encryption data, signature data, etc., consisting of digital data indicating that the digital data is genuine digital data permitted to be sold by the copyright holder or its licensor. Is embedded in the digital data itself as a digital watermark in a manner that has no visual or audio effect, and there is a method of preventing infringement of the copyright of the digital data.

[0005] Then, the digital watermark data is transmitted to the MID.
Japanese Patent Application Laid-Open Nos. 11-265179 and 11-2
No. 65180, JP-A-11-265181, JP-A-11-265181
Nos. 1-327546, JP-A-11-327747 and JP-A-2000-132165.

When copyright is protected by embedding the digital watermark data in MIDI data, the MIDI data is generally reproduced as shown in FIG.
The MIDI sequencer 1 reproduces MIDI data in sequence and outputs MIDI data, and the MIDI sound source 2 converts (synthesizes) the received MIDI data into audio data and outputs it, thereby reproducing the music as music.

[0007]

However, when digital watermark data is embedded as copyright information in the above-mentioned MIDI data, the MIDI sound source 2 does not interpret the digital watermark data, and a difference between the MIDI data and the audio data. Because of the incompatibility of digital watermark data,
The audio data output by the MIDI sound source 2 does not include digital watermark data. That is, when the audio data output by the MIDI sound source 2 is recorded by the recording device,
The digital watermark data is deleted, which makes copyright protection difficult. In particular, when the above audio data is recorded via digital audio such as USB or IEEE 1394, which has become popular in recent years, there is no deterioration in quality and audio data without digital watermark data as copyright information is recorded. There was a problem that data could be created.

[0008]

SUMMARY OF THE INVENTION In order to solve the above-mentioned problems, the present invention is a digital data processing method for converting and processing data in which copyright information is embedded, and reads copyright information from the data. A digital data processing method, comprising: converting the copyright information into data that has been subjected to conversion and processing; and embedding the copyright information again in the converted and processed data.

A digital data processing method for processing data in which copyright information is embedded, the method comprising: reading copyright information from the data; and performing the processing when the data is processed. Extracting information for tracing the user who has performed the processing, and embedding the copyright information and the information again as new copyright information in the processed data. I will provide a.

[0010] Further, there is provided a digital data processing method for processing a plurality of data in which copyright information is embedded, wherein the step of reading the copyright information from the plurality of data includes a step of connecting and / or synthesizing the plurality of data. Extracting information for tracking the user who performed the processing when processing; connecting and / or synthesizing copyright information read from the plurality of data; and A digital data processing method is provided wherein the combined copyright information and the information are re-embedded as new copyright information in the data after the processing.

4. The digital data processing method according to claim 1, wherein the copyright information is temporarily removed from the data when the copyright information is read. I will provide a.

Still further, a digital data processing apparatus for processing data in which copyright information is embedded, copyright information reading means for reading copyright information from the data, and processing means for processing the data Information extracting means for extracting information for tracking a user who has performed a process on the data by the processing means, and after the copyright information and the information have been subjected to the processing as new copyright information, And a digital watermark embedding means for embedding the data again in the digital data.

[0013] A digital data processing apparatus for processing a plurality of data in which copyright information is embedded, wherein copyright information reading means for reading the copyright information from the plurality of data; And / or a combining and / or combining means for performing a combining process;
Or information extracting means for extracting information for tracking a user who has performed processing on the data by the combining means, and data obtained after the processing has been performed using the copyright information and the information as new copyright information. And a digital watermark embedding unit for embedding the digital data into the digital data again.

[0014]

DESCRIPTION OF THE PREFERRED EMBODIMENTS A digital data processing method and a digital data processing apparatus according to the present invention will be described below with reference to the drawings. FIG. 1 is a digital data processing apparatus for realizing a digital data processing method according to the present invention. MIDI data in which digital watermark data as copyright information is already embedded is input to the MIDI sequencer 3, and the MIDI sequencer 3 supplies the MIDI data to the MIDI watermark decoder 4 by reproducing the MIDI data in sequence.

The MIDI watermark decoder 4 reads digital watermark data from MIDI data in real time,
Extract copyright information from the read digital watermark data,
MIDI required for reproduction while being supplied to the reproduction information adding unit 7
The data is supplied to the MIDI sound source 5. At this time MIDI
When it is necessary to remove the digital watermark data from the data, the MIDI watermark decoder 4 also removes the digital watermark data.

The MIDI sound source 5 converts MIDI data into audio data and supplies the audio data to the audio watermark encoder 6. Then, the reproduction information adding section 7 includes information on the copyright information of the digital watermark data read from the MIDI data and information associated with reproduction, such as a reproduction device for reproducing the audio data and a reproduction date and time, in order to track an unauthorized user. To the audio watermark encoder 6.

The audio watermark encoder 6 embeds the copyright information, to which the reproduction information has been added, into the audio data in real time as new electronic watermark data. That is, the audio data finally output is the original MID
In addition to the copyright information embedded in the I data, playback information useful for tracking unauthorized users is added. At this time, the reproduction information does not necessarily need to be added. In such a case, it is difficult to obtain clues to identify unauthorized users simply by adding new digital watermark data to the converted data, but copyright information may be deleted from the converted data. This has the effect of disappearing.

Here, regarding the data conversion, the following conversion is considered in addition to the audio data from the MIDI data described above. For images, there are conversion from Draw format to BMP format, conversion from CAD format to BMP format, etc. In addition, speech (speech synthesis) from text data
Format conversion, audio data sampling frequency and quantization bit conversion, and conversion from compressed audio data to audio data. Examples of effects that can be applied to data include effect effects such as delay, reverb, and chorus for audio data, and deformation, color conversion, and filtering such as blurring and sharpness for image data. Then we call it data processing.

In the configuration of the embodiment described above,
It is necessary to decode digital watermark data in real time. The simplest example of MIDI watermark data that can be decoded in real time is a method using note-on velocity shown in FIG. In this method, digital watermark data is divided into four lower bits of a third byte velocity value of a note-off message which is not generally used among MIDI messages, and is recorded. The MIDI watermark decoder 2 extracts digital watermark data every time a note-off message is received, connects them in chronological order, and reconstructs long-form digital watermark data.

Next, M which cannot be decoded in real time
When IDI watermark data is embedded in MIDI data, a configuration as shown in FIG. 3 can be considered. The same components as those in the first embodiment are denoted by the same reference numerals. The MIDI watermark decoder 4 decodes in advance the copyright information of the digital watermark data embedded in the MIDI data, and supplies it to the reproduction information adding unit 7. Also, MIDI
The data is supplied to the MIDI sequencer 3.

The reproduction information adding unit 7 adds information useful for tracking an unauthorized user, which is information accompanying the reproduction such as a reproduction device and a reproduction date and time to the copyright information, and supplies the information to the audio watermark encoder 6. I do. MIDI sequencer 3
Is played back by playing back MIDI data in sequence.
The DI data is supplied to the MIDI sound source 5.

The MIDI sound source 5 converts the MIDI data into audio data and supplies the audio data to the audio watermark encoder 6. The audio watermark encoder 6 embeds, in real time, the copyright information to which the reproduction information has been added into the audio data as digital watermark data.

In the first and second embodiments described above, M
Although an example in which digital watermark data is embedded in IDI data has been described, similar processing can be performed on image data. In the third embodiment shown in FIG. 4, copyright information embedded in a draw graphic data work composed of vector data and the like is added with processing information when visualized (rendered to a bitmap) and embedded again. The same is possible when rendering a 3D CAD data work.

The copyright information reading unit 13 extracts in advance the copyright information of the digital watermark data embedded in the draw image data and supplies it to the processing information adding unit 15. Also, the draw image data is transferred to the rendering engine 14.
To supply.

The processing information adding unit 15 adds, to the copyright information, information useful for tracking an unauthorized user accompanying the processing such as the rendering processing program name and the processing date and time.
The information is supplied to the copyright information embedding unit 16.

The rendering engine 14 renders the draw image data, converts it into bitmap image data, and supplies it to the copyright information embedding unit 16.
The copyright information embedding unit 16 embeds the copyright information to which the processing information has been added into the bitmap image as digital watermark data.

In the above description, a processing method and a processing device for converting certain data into data of a different format have been described as processes to be applied to a digital data work. In addition to this, data format conversion is also involved. The present invention can also be applied to non-process processing, for example, effect addition (effect), addition synthesis (mix), and the like.

FIG. 5 shows an example in which the present invention is applied to a process of synthesizing audio data in which digital watermark data is embedded.
In this example, the audio data to which digital watermark data as copyright information is added is combined with other audio data, and the copyright information is maintained even when the audio data is written back to the original audio data. Specifically, the audio data to which the digital watermark data is added is read by the copyright information reading unit, and the embedded copyright information is extracted in advance and supplied to the reproduction information adding unit. Also, the digital audio data is supplied to the synthesizer. The synthesizer combines other audio data with the audio data, and the copyright information embedding section embeds the copyright information again.

Further, FIG. 6 shows that when combining two or more pieces of digital audio data to which copyright information is added, both pieces of copyright information are connected or combined and re-embedded in the output digital audio data. Such a configuration is also possible.

Hereinafter, a modified example of the embodiment of the present invention will be described. FIG. 7 shows a MIDI watermark decoder and a MIDI sequencer integrated into a MIDI sequencer.
In this configuration, the sound source, the audio watermark encoder, and the reproduction information adding unit are integrated into a MIDI sound source. The feature of this embodiment is that it is possible to prevent the user from illegally copying the distribution music, and that the copyright information is provided as one MIDI input port as a MIDI signal such as a user-defined free system exclusive message. (There is no need to provide a separate interface).

FIG. 8 shows a MIDI watermark decoder, M
Since the IDI sound source, the audio watermark encoder, and the reproduction information adding unit are integrated into a MIDI sound source, it is possible to suppress a user from illegally copying a music piece in the same manner as in the above-described embodiment. The difference from the above-described embodiment is that only a digital watermark that can be decoded in real time can be used, but there is an advantage that an existing general MIDI sequencer can be used.

FIG. 9 shows a mixture of MIDI data and audio data.
The IDI sequencer is integrated with the MIDI sequencer, and the audio watermark encoder and the reproduction information adding unit are integrated into the audio watermark encoder. This is useful as a solution system for controlling copyright information embedded as an electronic watermark in a mastering system in which MIDI data and audio data are mixed.

FIG. 10 shows a case where MIDI data and audio data are mixed, the MIDI watermark decoder is independent, and the audio watermark encoder and the reproduction information adding unit are integrated into an audio watermark encoder. Here, the reproduction information adding unit may be independent and may be attached to the MIDI watermark decoder. This is useful as a solution for controlling copyright information embedded as an electronic watermark in a mastering system in which MIDI data and audio data are mixed, as in the above-described embodiment. The difference from the above-described embodiment is that only a digital watermark that can be decoded in real time can be used, but there is an advantage that an existing general MIDI sequencer and MIDI sound source can be used.

As described above, in the above-described modified example, the MIDI
Although only the configuration in the case of handling data has been described, it is needless to say that the watermark decoder and the reproduction information adding unit can be similarly treated as a part of other components when handling audio data and image data.

In the present invention, as the reproduction information that can trace an unauthorized user, the model number of the processing device, the name of the processing program, the serial number of the processing device or the processing program, the date and time of the processing, the processing device or the processing program are used. Various types of information can be considered, such as an ID and password for performing the processing and personal information collected when the processing device is provided with personal information collecting means such as a fingerprint, a voiceprint, and a retinal pattern.

[0036]

As described above in detail, according to the digital data processing method and the digital data processing apparatus according to the present invention, digital watermark data is processed into embedded data.
When outputting data by performing processing such as conversion, it has the effect of not losing the digital watermark data.
In addition to digital watermark data, playback information such as the equipment used and the date and time of processing / conversion when data is processed / converted is output in addition to the data, so such data is output and recorded Since the copyright information and the above-mentioned reproduction information are recorded as digital watermark data even if recorded on a medium, it is possible to obtain useful information for identifying the unauthorized user who has performed the above-mentioned processing and conversion. It works.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating an example of a digital data processing device according to the present invention.

FIG. 2 is a diagram showing an example of a method of embedding digital watermark data by a digital data processing method according to the present invention.

FIG. 3 is a block diagram showing a second embodiment of the digital data processing device according to the present invention.

FIG. 4 is a block diagram showing an example in which a digital data processing device according to the present invention is applied to image data.

FIG. 5 is a block diagram showing a third embodiment of the digital data processing device according to the present invention.

FIG. 6 is a block diagram showing a fourth embodiment of the digital data processing device according to the present invention.

FIG. 7 is a block diagram showing a first modification of the digital data processing device according to the present invention.

FIG. 8 is a block diagram showing a second modification of the digital data processing device according to the present invention.

FIG. 9 is a block diagram showing a third modification of the digital data processing device according to the present invention.

FIG. 10 is a block diagram showing a fourth modification of the digital data processing device according to the present invention.

FIG. 11 is a diagram showing a conventional digital data processing device.

[Explanation of symbols]

 1,3 MIDI sequencer 2,5 MIDI sound source 4 MIDI watermark decoder 6 Audio watermark encoder 13 Copyright information reading unit 14 Rendering engine 15 Processing information adding unit 16 Copyright information embedding unit

Claims (6)

[Claims] (1) converting data in which copyright information is embedded;
A digital data processing method for processing, comprising: reading copyright information from the data; converting and processing the data; and converting and processing the copyright information. A digital data processing method characterized in that the data is embedded again in the data. 2. A digital data processing method for processing data in which copyright information is embedded, comprising: reading copyright information from the data; and performing the processing when the data is processed. Extracting information for tracing the user who has performed the digital data processing, and re-embedding the copyright information and the information as new copyright information in the data after the processing. . 3. A digital data processing method for processing a plurality of data in which copyright information is embedded, the method comprising: reading copyright information from the plurality of data; concatenating and / or synthesizing the plurality of data. Extracting information for tracking the user who performed the processing when processing; connecting and / or synthesizing copyright information read from the plurality of data; and connecting and / or synthesizing. A digital data processing method, wherein the combined copyright information and the information are re-embedded as new copyright information in the data after the processing. 4. The digital data processing method according to claim 1, wherein when the copyright information is read, the copyright information is temporarily removed from the data. 5. A digital data processing device for processing data in which copyright information is embedded, copyright information reading means for reading copyright information from the data, and processing means for processing the data. An information extracting unit for extracting information for tracking a user who has performed a process on the data by the processing unit; and after the copyright information and the information have been subjected to the process as new copyright information. A digital data processing device comprising: a digital watermark embedding unit that embeds data again. 6. A digital data processing device for processing a plurality of data in which copyright information is embedded, a copyright information reading means for reading copyright information from the plurality of data, and a linking process for the plurality of data. And / or combining means for performing combining processing, and information extracting means for extracting information for tracking a user who has performed a process on the data by the combining and / or combining means; A digital watermark embedding unit for embedding the information again as new copyright information in the data after the processing is performed.