JP2000201269A - Data recording device, data reproducing device and data recording/reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a data recording device where the recording of sound data and picture data can be controlled by making use of electronic watermark technology. SOLUTION: A data recording device 1005 is provided with an input means 9 to which multimedia data consisting of input data containing sound data or picture data or both are inputted, a storage means 15 which sequentially and temporarily stores the multimedia data inputted to the input means 9, a detection means 16 detecting electronic watermark information embedded in the multimedia data which is temporarily stored in the storage means 15, an output means 18 outputting the multimedia data which is temporarily stored in the storage means 15 to a recording medium 1007 so as to record it and a micro processor unit(MPU) 14 being a recording control means outputting the multimedia data from the output means 18 when the detection means 16 detects electronic water mark information which designates copy permission.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus capable of controlling recording or reproduction of data such as sound data and image data using a digital watermarking technique.

[0002]

2. Description of the Related Art In the multimedia age in recent years, it is necessary to prevent illegal copying of digital works from the viewpoint of copyright protection. As a method of prohibiting the copy of digital data by the copyright owner, for example, copy control information (copy management information) is written in a write position different from the write position of the sound or image content in the data file. There is a method of automatically prohibiting the duplication of the digital data when the device detects the control information.

[0003]

However, in the above method, the user may be informed of the writing position of the control information (copy management information) for controlling the duplication, and the duplication is performed by falsifying that part. Sometimes. Further, even if the data is falsified, the original multimedia data is not affected, so that the content of the original multimedia data can be completely copied. The purpose of the present invention is
It is an object of the present invention to provide a device capable of controlling recording or reproduction of data such as sound data and image data using a digital watermark technique.

[0004]

A first data recording apparatus according to the present invention comprises: input means for inputting input data including one or both of sound data and image data; and input data input to the input means. Storage means for sequentially and temporarily storing the input data, detection means for detecting digital watermark information embedded in the input data temporarily stored in the storage means, and temporary storage in the storage means. Output means for outputting the input data stored in the storage medium to a recording medium for recording, and recording control means for outputting the input data from the output means when the detection means detects digital watermark information indicating duplication permission. And

[0005] A second data recording apparatus according to the present invention is characterized in that input means for inputting either or both of sound data and image data is input, and the input data input to the input means is sequentially transmitted to the input means. Storage means for temporarily storing, detection means for detecting digital watermark information embedded in the input data temporarily stored in the storage means, and input means temporarily stored in the storage means Output means for outputting and recording data on a recording medium; andrecording control means for prohibiting output of the input data from the output means when the detection means detects digital watermark information indicating duplication prohibition. .

A first data reproducing apparatus according to the present invention comprises: a reading means for reading input data containing one or both of sound data and image data from a recording medium on which the input data is recorded; Storage means for sequentially and temporarily storing the read input data; detection means for detecting digital watermark information embedded in the input data temporarily stored in the storage means; and the storage means Output means for outputting the input data temporarily stored in an external device, and output control means for outputting the input data from the output means when the detection means detects digital watermark information indicating permission for duplication. And

[0007] A second data reproducing apparatus according to the present invention is a reading means for reading input data including one or both of sound data and image data from a recording medium on which the input data is recorded. Storage means for sequentially and temporarily storing the read input data; detection means for detecting digital watermark information embedded in the input data temporarily stored in the storage means; and the storage means Output means for outputting the input data temporarily stored in an external device, and prohibiting output of the input data from the output means when the detection means detects digital watermark information indicating duplication prohibition. Output control means.

[0008] A first data recording / reproducing apparatus according to the present invention comprises: input means for receiving input data including one or both of sound data and image data; and input data input to the input means. A storage unit for temporarily storing sequentially, a detection unit for detecting digital watermark information embedded in the input data temporarily stored in the storage unit, and a storage unit for temporarily storing the digital watermark information in the storage unit. First output means for outputting input data to an external device, second output means for outputting the input data temporarily stored in the storage means to a recording medium for recording, and an electronic watermark indicating permission of duplication A recording control unit for outputting the input data from the second output unit when information is detected by the detection unit, and a digital watermark information indicating copy permission is detected by the detection unit And an output control means for outputting said input data from said first output means.

A second data recording / reproducing apparatus according to the present invention comprises: input means for inputting input data including one or both of sound data and image data; and input data input to the input means. A storage unit for temporarily storing sequentially, a detection unit for detecting digital watermark information embedded in the input data temporarily stored in the storage unit, and a storage unit for temporarily storing the digital watermark information in the storage unit. First output means for outputting input data to an external device, second output means for outputting the input data temporarily stored in the storage means to a recording medium for recording, and an electronic watermark indicating copy prohibition When the information is detected by the detection means, the recording control means prohibits the output of the input data from the second output means, and the detection means detects digital watermark information indicating duplication prohibition. If, and an output control means for inhibiting output of said input data from said first output means.

According to the present invention, control information for duplicating input data including sound data and image data can be hidden in the input data itself in a form that is difficult for humans to perceive using digital watermarking technology. It is possible to make it difficult to decode the control information. Also, by using the digital watermark technology to hide the digital watermark information in the input data itself, if the digital watermark information is decrypted and falsified,
Duplication can be made difficult by affecting the input data. In the data recording device and the data recording / reproducing device of the present invention, recording control of the recording medium can be performed using the digital watermark information embedded in the input data. In the data reproducing apparatus and the data recording / reproducing apparatus of the present invention, the output operation of the output means can be controlled using the digital watermark information embedded in the input data.

[0011]

Embodiments of the present invention will be described below with reference to the accompanying drawings.

Digital Watermarking Technique First, a digital watermarking (Watermark) technique will be described.
The digital watermark technique is used when digital watermark information is embedded and hidden in data such as multimedia data in a form that is hardly perceived by human eyes and ears. In recent years, CD (Co
With the spread of digital media such as mpact Discs and DVDs (Digital Versatile Discs), digital broadcasting, and the Internet, digital watermarking technology has attracted attention from the viewpoint of copyright protection of multimedia data. By using this digital watermarking technique, it is possible to prohibit a user (user) from copying data according to the intention of the copyright owner. Regarding digital watermark technology,
Nikkei Electronics (1997.2.24 (no.6)
83)), Nikkei Electronics (1997.3.10)
(No. 684)).

An advantage of using the digital watermark technique for content copy control is that even if the content is once converted into analog data, the digital watermark information remains embedded and survives. For example, music data in which digital watermark information is embedded is recorded on a CD. When music data of a CD is recorded on a cassette tape (analog recording), a detection unit for detecting digital watermark information and an output control unit are provided in the tape recorder, so that the digital watermark information indicating copy prohibition is detected. When detected, it is possible to prohibit reproduction of music data.

Various techniques have been proposed for embedding digital watermark information in multimedia data. Here, a method of embedding digital watermark information in image data expressed at a multi-value level will be described as an example.

FIG. 1 is an explanatory diagram showing the correspondence between the gradation of the luminance (density) of a pixel and the expression pattern of the luminance. Each pixel of the image data corresponds to 4 dots of 2 dots × 2 dots, and the density of each pixel is represented as a luminance of 0 to 4 using 4 dots. That is, as shown in FIG. 1, there are 1, 2, 6, 4, and 1 methods for expressing data when the luminance is 0, 1, 2, 3, and 4, respectively. Of these, when the luminance is 1, 2, or 3, one specific pattern (pattern S) is not normally used, but is used when electronic watermark information is hidden in image data. FIG.
In the above, the hatched pattern is the pattern S.

In order to conceal and hold the electronic watermark information, for example, when the pattern S is continuous using the pattern S, "0" is represented, and when one is left, "1" is represented, and two is left. In this case, the header part, which is the starting point of the digital watermark information, is represented. If a pixel having a luminance of 0 or a luminance of 4 is in the middle, the pixel is skipped and it is determined that there is no pixel. Digital watermark information to be kept secret
For example, the digital watermark information that is represented by 2 bits and indicates that copying is permitted is “00”, and the digital watermark information that indicates that copying is prohibited is “10”. The detection means for detecting the digital watermark information searches for the pattern S, and reads the two bits after searching for the header portion as the copy control information.

FIG. 2 is an explanatory diagram showing an example of a data hiding method for hiding digital watermark information in image data.
FIG. 2A is an explanatory diagram illustrating a relationship between an image and luminance. FIG. 2B shows the luminance of the pixel, the original image data,
FIG. 4 is an explanatory diagram showing a relationship with image data after digital watermark information is embedded. The image data here is, for example, image data representing a sphere.

This image is "12222341332 ..."
, And the luminance is pixel data, and the pixel data constitutes image data. The pixel of “1” that appears first in this image data is rewritten to a pattern S of luminance 1 in order to embed digital watermark information. 4
The second appearing pixel “2” is rewritten with a pattern S of luminance 2 in order to embed digital watermark information. The sixth “3” pixel is rewritten to a luminance S pattern S in order to embed digital watermark information. The 8th pixel of “1” is rewritten to the luminance S pattern S in order to embed digital watermark information.

Then, in the image data in which the digital watermark information is embedded, since the first and fourth patterns S have the pattern S, this portion becomes the header portion. In addition, since there is a pixel having a luminance of 2 between the fourth and sixth pixels of the pattern S and one space is left, this portion indicates the digital watermark information 1. In addition, there is a pixel having a density of 4 between the pixels of the sixth and eighth patterns S, and one pixel is vacant. This portion is skipped and indicates digital watermark information 0. Therefore, the digital watermark information “10” of which copying is prohibited is embedded in this image data.

Recording / Reproducing System FIG. 3 shows a configuration example of a system having a data recording device and a data reproducing device according to the present invention. The recording / reproducing system 1500 in FIG. 3 includes a speaker 1001, a television monitor 1002, an amplifier 1003, a data reproducing device 1004, a data recording device 1005, a disk-shaped recording medium 1006, and a recording medium 1007.

The speaker 1001 is a device for reproducing sound, receives the sound data amplified by the amplifier 1003, and generates a sound corresponding to the sound data. Speaker 10
01 are disposed on the left and right of the television monitor 1002, respectively. The television monitor 1002 is a device that displays a video or an image, receives image data amplified by the amplifier 1003, and displays an image corresponding to the image data. The amplifier 1003 is connected to the data reproducing device 1
Amplifying the multimedia data from 004 and supplying the amplified image data to the television monitor 1002;
The amplified sound data is supplied to the speaker 1001. Note that the multimedia data is composed of input data including one or both of sound data and image data, and electronic watermark information as control information (copy management information) for controlling duplication is included in the multimedia data. Embedded in

The data reproducing apparatus 1004 outputs multimedia data read and reproduced from a disk-shaped recording medium 1006 such as a DVD to the amplifier 1003 and the data recording apparatus 1005. The data reproducing device 1004
It has display means 27 such as a liquid crystal display for displaying digital watermark information embedded in multimedia data. The data recording device 1005 is
4 to input the multimedia data from the recording medium 10
Record at 07. The data recording device 1005 has display means 19 such as a liquid crystal display device for displaying digital watermark information embedded in multimedia data. In the system shown in FIG. 3, the data recording device 1005
Alternatively, a data recording / reproducing device may be connected. This data recording / reproducing apparatus has a function of recording multimedia data on a recording medium 1007,
007, has a function of reading and playing multimedia data, and plays the played multimedia data in the amplifier 1
003.

Data Recording Apparatus FIG. 4 is a schematic block diagram illustrating the data recording apparatus 1005. The data recording device 1005 includes an input unit 9
, A microprocessor unit (MPU) 14, a display unit 19, a storage unit 15, a detection unit 16, a data compressor 17, an output unit 18, and a data bus 10.

The input means 9 externally inputs multimedia data including one or both of audio data and image data, and controls the data bus 1 under the control of the MPU 14.
The multimedia data is supplied to the storage means 15, the detection means 16, the data compressor 17 or the output means 18 via the control unit 0. The input means 9 includes input interface circuits 11, 1
2 and analog / digital converter (A / D converter) 1
And 3. The input interface circuit 11 receives multimedia data composed of digital data from an external device and supplies the input multimedia data to the data bus 10. The input interface circuit 12
Multimedia data consisting of analog data is input from an external device, and the input multimedia data is
Output to the / D converter 13. The A / D converter 13 converts analog data from the input interface circuit 12 into digital data and supplies the digital data to the data bus 10. The input unit 9 may be configured to receive the broadcast and input the multimedia data, or may be configured to input the multimedia data from the Internet.

The storage means 15 has a memory or a buffer memory, for example, and temporarily stores the multimedia data input to the input means 9 via the data bus 10 sequentially. The detection unit 16 is configured to include, for example, a digital watermark detector (watermark decoder), and detects digital watermark information embedded in the multimedia data temporarily stored in the storage unit 15. Supply to MPU14. The MPU 14 is a controller that controls the entire data recording device 1005.
The detection result of the detection means 16 is input to the MPU 14 via the data bus 10. The MPU 14 includes a recording medium 100
7 and the display of the display means 19 is controlled.
The MPU 14 has a DMA (Direct Memory Access) controller for controlling data transfer, a counter for measuring the data transfer amount, and the like. The MPU 14 transfers the multimedia data temporarily stored in the storage unit 15 to the output unit 18 and writes and records the multimedia data in the storage medium 1007 when the detection unit 16 detects digital watermark information indicating duplication permission. .

The display means 19 is constituted by a liquid crystal display device or the like.
5 and the digital watermark information are displayed. Output means 18
Is configured to include, for example, an output interface circuit and a writing device (writer) that writes output data of the output interface circuit on the recording medium 1007 and records it. The output unit 18 receives the multimedia data temporarily stored in the storage unit 15 under the control of the MPU 14 and outputs the multimedia data to the recording medium 1007. Recording medium 1
Reference numeral 007 allows writing of multimedia data, and records the multimedia data from the output means 18. The recording medium 1007 may be constituted by an optical disk, a magnetic disk, or a semiconductor memory. The recording medium 1007 is detachable from the data recording device 1005. The data compressor 17 compresses multimedia data. The data compressor 17 receives multimedia data under the control of the MPU 14, generates multimedia data compressed by a predetermined compression method, and outputs the multimedia data to the output unit 18.

The MPU 14 has means for detecting the amount of data transferred to the storage means 15. When a predetermined amount of data is transferred to the storage unit 15, the MPU 14
5 to transfer the multimedia data to the internal memory of the detecting means 16, and the detecting operation of the digital watermark information is performed by the detecting means 1.
Start at 6. The predetermined data amount is determined by detecting means 16.
Is the amount of data required to detect digital watermark information. The result of the detection operation of the detection means 16 is MPU1
4, when the detecting means 16 detects the digital watermark information indicating that the copy is prohibited, the display means 19 is controlled to display that the multimedia data is prohibited from being copied, and the data transfer to the output means 18 is performed. Is prohibited and the recording medium 1007
Prohibits writing data to

On the other hand, when the detecting means 16 detects the digital watermark information indicating the permission of copying, the MPU 14 displays the
9 to display that the multimedia data can be copied, transfer the multimedia data from the storage means 15 to the output means 18 and cause the recording medium 1007 to record the data (multimedia data). When multimedia data is recorded on the recording medium 1007, the data is transferred to a JPEG (Joint Photographic Expert Group).
Alternatively, when compressing using a compression method of MPEG (Motion Picture Expert Group), the MPU 14 transfers data from the storage means 15 to the data compressor 17 and transfers compressed data from the data compressor 17 to the output means 18. Then, it is recorded on the recording medium 1007. The MPU 14 repeats the above operation until the multimedia data input to the input unit 9 ends. Note that once digital watermark information indicating permission to copy is detected, if it is not necessary to further detect digital watermark information, the multimedia data input to the input means 9 is directly transferred to the output means 18. Alternatively, it may be transferred directly to the output means 18 through the data compressor 17.

When a predetermined amount of data is accumulated in the storage means 15, the detection means 16 starts the operation of detecting the digital watermark information. If the digital watermark information cannot be detected, the subsequent data is deleted. Attempt to detect digital watermark information. The MPU 14 counts the number of tries for which the detection has been attempted. For example, although the digital watermark information indicating the permission to copy is embedded in the multimedia data, or may be embedded, the digital watermark information is detected. If the digital watermark information is not detected even after the work is repeated a specified number of times, it is determined that copying is prohibited, and data writing to the recording medium 1007 is prohibited.
Prohibits recording of the data. Conversely, if the digital watermark information indicating that copying is prohibited is embedded, or may be embedded, but the digital watermark information is not detected even after the digital watermark information detection operation is repeated a specified number of times, Then, it is determined that the copy is permitted, and the writing of data to the recording medium 1007 is started.
At 007, the data is recorded.

The data reproducing apparatus Figure 5 is a schematic block diagram illustrating a data reproducing apparatus 1004. The data reproducing device 1004 includes a reading unit 34
An input interface circuit 22, an MPU 26, a display means 27, a data decompressor 23, a storage means 24,
It has a detection unit 25, an output unit 33, and a data bus 40.

The reading means 34 has a device (reader) for accessing the recording medium 1006 and reading the recorded data. The recording medium 1006 stores the data
4 is detachable. The reading unit 34 reads input data (multimedia data) including one or both of acoustic data and image data from the recording medium 1006 on which the input data is recorded, and outputs the input data to the input interface circuit 22. Input interface circuit 2
2, the storage unit 24, the data decompressor 23, or the output unit 33, which receives multimedia data from the read unit 34 and controls the MPU 26 via the data bus 40.
To the multimedia data.

The storage means 24 has a memory or a buffer memory, for example, and temporarily stores the multimedia data input to the input interface circuit 22 via the data bus 40 sequentially. The detecting means 25 includes:
For example, it is configured to have a digital watermark detector,
4 detects digital watermark information embedded in the multimedia data temporarily stored in the MPU 26.
To supply. The MPU 26 is a controller that controls the overall operation of the data reproducing device 1004. The MPU 26
The detection result of the detection means 25 is input via the data bus 40. Further, the MPU 26 controls display of the display unit 27 and output control of the output unit 33. The MPU 26 has a DMA (Direct Memory Access) controller for controlling data transfer, a counter for measuring the data transfer amount, and the like. The MPU 26 prohibits the output of the data from the output unit 33 when the detection unit 25 detects the digital watermark information indicating that the duplication is prohibited.

The display means 27 is composed of a liquid crystal display device or the like.
4 and the digital watermark information are displayed. Data decompressor 2
3. Decompression (decompression) of compressed multimedia data
I do. The data decompressor 23 receives the multimedia data under the control of the MPU 26, generates multimedia data decompressed by a predetermined decompression method, and outputs it to the storage means 24 or the output means 33.

The output unit 33 receives the expanded multimedia data from the data decompressor 23 or the multimedia data from the storage unit 24, and outputs the multimedia data to an external device. The output means 33 is connected to an external output terminal to which an external device is connected, and to the data bus 40. The output means 33 has output interface circuits 28 to 30 and D / A converters 31 and 32.
The output interface circuit 28 receives multimedia data including digital data and outputs the multimedia data to an external device via a first external output terminal 28T. The output interface circuit 29 inputs multimedia data composed of digital data and outputs the multimedia data to the D / A converter 31.
The D / A converter 31 receives the multimedia data from the output interface circuit 29, converts the input multimedia data into analog data, and outputs the analog data to an external device via a second external output terminal 31T. The output interface circuit 30 receives multimedia data composed of digital data and outputs the multimedia data to the D / A converter 32. The D / A converter 32 includes the output interface circuit 3
Multimedia data from 0 is input, converted to analog data, and output to an external device via a third external output terminal 32T.

The input interface circuit 22 includes a package medium (recording medium) such as a CD or a DVD.
From 1006, the multimedia data read by the reading means 34 is input. The data input to the input interface circuit 22 is sequentially written and stored in the storage means 24 under the control of the MPU 26. Note that the data input to the input interface circuit 22 is, for example, J
If the data is compressed by a compression method such as PEG or MPEG, the data may be transferred to a data decompressor (data decompressor) 23, decompressed (decompressed), and then written to the storage means 24.

The MPU 26 has means for detecting the amount of the data transferred to the storage means 24. When the predetermined amount of data is transferred to the storage means 24, the multimedia data is transferred from the storage means 24 to the internal memory of the detection means 25, and the detection work (detection processing) of the digital watermark information is started by the detection means 25. The predetermined data amount is a data amount required for the detection unit 25 to detect digital watermark information. The result of the detection operation of the detection means 25 is MPU
If the digital watermark information indicating transfer of the multimedia data is prohibited and detected, the display unit 27 is controlled to display that the multimedia data is prohibited from being copied.

When digital watermark information indicating duplication inhibition is detected by the detecting means 25, the MPU 26 inhibits the data output of the output interface circuit 28 capable of digital output so that the data cannot be output. Thus, it is possible to prevent multimedia data from being supplied to and recorded on a device that records digital data. However, for example, output interface circuits 29 and 3 capable of analog output connected to speakers or headphones
To 0, data can be output. When a data recording device capable of analog input is connected to the analog output terminal of the data reproducing device 1004, data can be copied. However, since digital watermark information is also copied by copying multimedia data, copying is performed. The prohibition function is preferably provided on the data recording device side from the viewpoint of copy control. On the other hand, when the detecting means 25 detects the digital watermark information indicating the permission of duplication, the MPU 26 controls the display means 27 to display that the multimedia data can be duplicated. Also, the MPU 26 transfers the data stored in the storage means 24 to the output means 33 and outputs the data to the output interface circuit 2.
The multimedia data is output to the outside through 8 to 30 and D / A converters 31 and 32.

The MPU 26 has the input interface circuit 2
The above procedure is repeated until the multimedia data input to 2 is completed, and the data is transferred to the output interface circuit for which data output is permitted. In addition,
After the detecting means 25 once detects the digital watermark information indicating that copying is permitted, if it is not necessary to detect further digital watermark information, the multimedia data is directly transferred from the input interface circuit 22 to the output means 33. Alternatively, the data may be directly transferred only to the output interface circuits 29 and 30 of the output unit 33.

When a certain amount of data is stored in the storage means 24, the detection means 25 starts the operation of detecting the digital watermark information. Attempt to detect watermark information. The MPU 26 counts the number of tries for which detection has been attempted. For example, although the digital watermark information indicating the copy permission is embedded in the multimedia data or may be embedded, the detection operation is repeated a specified number of times. If the digital watermark information is not detected, it is determined that copying is prohibited, and the data output from the output interface circuit 28 capable of digital output is prohibited. Conversely, if digital watermark information indicating copy prohibition is embedded or may be embedded, but the digital watermark information is not detected even after the detection operation is repeated a specified number of times, copying is permitted. Thus, data output from the output interface circuit 28 capable of digital output is permitted.

Operation of Data Recording Apparatus and Data Reproducing Apparatus The operation and control processing of the data recording apparatus 1005 and the data reproducing apparatus 1004 will be described with reference to the schematic flowcharts shown in FIGS. FIGS. 6 and 7 show the operation of the devices 1004 and 1005 and the control processing of the MPU in the device when digital watermark information indicating duplication prohibition is embedded or possibly embedded in the multimedia data. FIG.

When the recording button (recording start button) of the data recording device 1005 or the reproduction button of the data reproducing device 1004 is pressed, the processing shown in the flowcharts of FIGS. 6 and 7 is started. In step S301, the number of tries Dec_time for which the detection of digital watermark information has been attempted is cleared to zero. Further, the count value Mdec indicating the amount of data stored in the storage means is cleared to zero. In step S302, it is determined whether or not the multimedia data has ended, and whether or not the stop button has been pressed. If the multimedia data has ended or if the stop button has been pressed, the processing of this flowchart ends. If the multimedia data has not been completed and the stop button has not been pressed, the process proceeds to step S303.

In step S303, the MPU sequentially transfers and stores data (multimedia data) in a memory serving as storage means. Here, one data transfer amount is n
Byte. In step S304, the number of tries to detect digital watermark information Dec_time is set to the specified number of times DEC.
It is determined whether it is equal to or greater than _LIMIT. Dec number of trials
If _time is greater than or equal to the specified number of times DEC_LIMIT, that is, if the digital watermark information for which duplication is prohibited cannot be detected even after performing the detection work a certain number of times, step S31
Proceeding to 1, the MPU displays on the display means that the duplication is permitted. Subsequently, in step S312, the multimedia data stored in the storage unit is transferred to the output unit, and the process returns to step S302. In step S312, in the case of the data recording device 1005, the storage unit 15 outputs the output unit 1
8 and sequentially transfers the data from the storage means 24 to the output means 33 in the case of the data reproducing apparatus 1004.

The number of tries Dec_time is equal to the specified number of times D.
If not more than EC_LIMIT, step S305
The count value Mdec is set to the predetermined data amount DEC_
It is determined whether it is OK or more. Here, the predetermined data amount is a data amount in which one or more digital watermark information of duplication permission or duplication is embedded. Count value Md
If ec is less than the data amount DEC_OK and the data amount is insufficient, the process proceeds to step S306, where the count value M
n is added to dec, and the process returns to step S303. When the count value Mdec is equal to or larger than the data amount DEC_OK,
Proceeding to step S307, the count value Mdec is cleared to zero.

In step S308, the MPU causes the detecting means to start detecting digital watermark information. The detecting means starts a detecting operation on the data stored in the internal memory or the storage means of the detecting means. Step S309
Then, the result of the detection work is determined. If digital watermark information indicating duplication prohibition has not been detected, step S31 is performed.
The process proceeds to 0, the number of trials Dec_time is incremented and added by 1, and the process proceeds to step S303. If digital watermark information indicating that copying is prohibited is detected, the flow advances to step S313 to clear the data held in the storage unit and prohibit the multimedia data from being output to the outside. Subsequently, in step S314, the fact that duplication is prohibited is displayed on the display means, and the processing of this flowchart ends.

FIGS. 8 and 9 show the operation of the devices 1004 and 1005 and the MPU in the device when digital watermark information indicating permission to copy is embedded in the multimedia data or when there is a possibility that it is embedded. 6 is a schematic flowchart for explaining the control operation of FIG.

When the recording button (recording start button) of the data recording device 1005 or the reproduction button of the data reproducing device 1004 is pressed, the processing shown in the flowcharts of FIGS. In step S401, the number of trials Dec_time for which the detection of digital watermark information has been attempted is cleared to zero. Further, the count value Mdec indicating the amount of data temporarily stored in the storage means is cleared to zero.
Further, the flag Flag_copy_en indicating whether or not the copy of the multimedia data is permitted is cleared to 0. When the flag Flag_copy_en = 1, the copy is permitted.

In step S402, it is determined whether or not the multimedia data has ended, and whether or not the stop button has been pressed. If the multimedia data has ended or if the stop button has been pressed, the processing of this flowchart ends. If the multimedia data has not been completed and the stop button has not been pressed, the process proceeds to step S403.

In step S403, the MPU sequentially transfers and stores data (multimedia data) in a memory serving as storage means. Here, one data transfer amount is n
Byte. In step S404, the flag Flag
It is determined whether or not the value of _copy_en is 1. When the value of the flag Flag_copy_en is 1,
Proceeding to step S414, the data stored in the storage means is transferred to the output means. In step S414, in the case of the data storage device 1005, the data is sequentially transferred from the storage means 15 to the output means 18, and
In the case of 004, data is sequentially transferred from the storage means 24 to the output means 33. If the value of the flag Flag_copy_en is not 1, the process proceeds to step S405.

In step S405, the number of trials Dec
It is determined whether or not _time is equal to or greater than a specified number of times DEC_LIMIT. The number of tries Dec_time is the specified number of times DE
If not more than C_LIMIT, the process proceeds to step S406. The number of tries Dec_time is the prescribed number of times DEC_L
If it is equal to or greater than IMIT, that is, if the digital watermark information for which copying is permitted cannot be detected even after performing the detection work a fixed number of times, the process proceeds to step S415 to clear the data held in the storage unit. Then, in step S416, the MPU displays on the display means that duplication is prohibited, and ends the processing of this flowchart.

In step S406, the count value Mde
It is determined whether or not c is equal to or larger than the data amount DEC_OK. If the count value Mdec is not equal to or larger than the data amount DEC_OK, the process proceeds to step S407, and the count value Md
ec is added with n, and the process proceeds to step S403. When the count value Mdec is equal to or larger than the data amount DEC_OK,
Proceeding to step S408, the count value Mdec is cleared to zero.

In step S409, the MPU causes the detecting means to start the work of detecting digital watermark information. The detecting means starts a detecting operation on the data stored in the internal memory or the storage means of the detecting means. Step S410
Then, the result of the detection work is determined. If no digital watermark information indicating permission to copy is detected, step S4
The process proceeds to 11, the number of trials Dec_time is incremented and added by 1, and the process proceeds to step S403. If digital watermark information indicating that copying is permitted is detected, the flow advances to step S412 to set the value of the flag Flag_copy_en to 1. Subsequently, in step S413,
The MPU displays on the display means that the copy is permitted, and proceeds to step S403.

Display Means FIG. 11 is an explanatory diagram for explaining an example of the display means. FIG.
Reference numeral 1 denotes a part of a modification of the data reproducing apparatus 1004, which includes a display unit 27A and a volume control knob 27B.
And an operation switch 27C. Display means 2
7A, the characters “Oct 30, 1998”, the characters “FRI”, and “COPY In”
"hibited" is displayed. The display means may be constituted by using an LCD, a CRT, or the like provided in the data recording device or the data reproducing device, and may display a message indicating that copying is prohibited or permitted, or a light emitting diode may be used. , Computer GUI (Graphi
cal User Interface), or a voice display using a speaker. The display means may display "COPY Inhibited" when displaying that copying is prohibited, and displaying "CO" when displaying that copying is permitted.
"PY OK" may be displayed. The display means may display "WM not detected" when the digital watermark information is not detected.

Data Recording / Reproducing Apparatus As another embodiment, there is a data recording / reproducing apparatus as shown in FIG. 11 in which a data recording apparatus and a data reproducing apparatus are integrated. The data recording / reproducing apparatus 1105 includes an input unit 9, an MPU 802, a display unit 19, and a storage unit 15.
, Detecting means 16, digital watermark input device 806, output means 33, input / output means 807, data decompressor 23
, A data compressor 17 and a data bus 10.
The basic configuration of the data recording / reproducing apparatus 1105 is as follows: the data recording apparatus 1005 in FIG. 4 and the data reproducing apparatus 1004 in FIG.
Are the same as those of the first embodiment, and the same portions are denoted by the same reference numerals and description of the same portions will be omitted. MPU802
Has both the function of the MPU 14 of the data recording device 1005 and the function of the MPU 26 of the data reproducing device 1004.
The input / output unit 807 can access the recording medium 1007 to perform writing and reading of data. The recording medium 1007 is detachable from the data recording / reproducing device 1105.

The data recording / reproducing device 1105 has a digital watermark input device 806. This is used when it is necessary to change the digital watermark information detected from the data and record it on the recording medium 1007. As an example, “11
01 "means that the copying of the multimedia data is permitted only once.
When the digital watermark information is detected by the detection unit 16, the digital watermark input device 806 changes the digital watermark information to “1110” meaning copy prohibition, and then records the data on the recording medium 1007 through the input / output unit 807. Note that the digital watermark input device may be provided in the data recording device 1005.

When the detecting means 16 detects the digital watermark information indicating the permission for copying, the MPU 802 stores
The data temporarily stored in the storage medium 1007 may be recorded on the recording medium 1007. The MPU 802 detects digital watermark information indicating duplication permission in a predetermined amount of data among the data temporarily stored in the storage unit 15.
If the data 6 is not detected, the data temporarily stored in the storage means 15 may be prohibited from being recorded on the recording medium 1007. When the detection unit 16 detects the digital watermark information indicating the copy permission, the MPU 802
The display unit 19 displays a message indicating that copying is permitted, and if the detection unit 16 does not detect digital watermark information indicating that copying is permitted,
It may be configured to display on the display unit 19 that no digital watermark information is detected.

When the detecting means 16 detects the digital watermark information indicating that copying is prohibited, the MPU 802
It is also possible to prohibit the recording of the data temporarily stored in the recording medium 1007 and prohibit the output of data from the output interface circuit 28 of the output means 33. The MPU 802 is temporarily stored in the storage unit 15 when the detection unit 16 does not detect digital watermark information indicating copy prohibition in a certain amount of data among the data temporarily stored in the storage unit 15. The data may be recorded on the recording medium 1007. M
When the detecting unit 16 detects the digital watermark information indicating the duplication prohibition, the PU 802 displays the duplication prohibition display unit 19.
May be displayed, and when the digital watermark information indicating that copying is prohibited is not detected by the detecting unit 16, the display unit 19 may display that digital watermark information is not detected.

In the data reproducing apparatus 1004 or the data recording / reproducing apparatus 1105, the output interface circuit 28 in the output means 33 may be configured to be capable of bidirectional data transfer. Then, when an external device is connected to the data output terminal, the output interface circuit 28 receives information on the type of the external device and, if necessary, information such as the name and the manufacturer from the external device, and the MPU receives the information. The data output of the output interface circuit 28 may be controlled by the input information. In this case, the connected external device has a function of transmitting its own information. When the type of the connected external device indicates a recording device, the MPU prohibits data output to the external device of the multimedia data in which the digital watermark information for which duplication is prohibited is detected. On the other hand, data output to an external device having no recording function is permitted, and data output to an unknown external device is prohibited. To connect devices using a bidirectional bus, use a USB (Universal Serial Bus).
s), IEEE (Institute of Electrical and Electro
nics Engineers) 1394.

According to the data recording device 1005 and the data recording / reproducing device 1105, the copyright holder of the multimedia data can restrict the recording of the data by using the digital watermark technology. Also, the digital watermark information hidden in the data can be shown to the user, and the permission or prohibition of copying can be notified to the user. According to the data reproducing apparatus 1004 and the data recording / reproducing apparatus 1105, the copyright holder of the multimedia data can restrict the reproduction of the data by using the digital watermark technology. Also, the digital watermark information hidden in the data can be shown to the user, and the permission or prohibition of the reproduction can be notified to the user. Also,
A configuration in which multimedia data is held in the storage unit but is not output to a recording medium or an external device until the detection unit detects or cannot detect the digital watermark information in the devices 1004, 1005, and 1105. Therefore, it is possible to prevent a part of the multimedia data from being recorded on the recording medium when the duplication is prohibited. Also, the devices 1004, 1005, 11
Since the storage device 05 uses a storage device for sequentially and temporarily storing data, the storage capacity of the storage device can be reduced.

[0059]

In the first data recording apparatus according to the present invention, when the detecting means detects the digital watermark information indicating the permission of duplication, the data temporarily stored in the storing means is recorded on the recording medium. . As described above, according to the first data recording device of the present invention, the duplication of data can be controlled using the digital watermark information embedded in the data. Further, when the detection means detects the digital watermark information indicating the permission of duplication, the storage data of the storage means is recorded on the recording medium, so that a part or all of the storage data of the storage means is recorded before the detection of the digital watermark information. It can be prevented from being recorded on a medium.

In the second data recording device according to the present invention,
When the detecting means detects the digital watermark information indicating the copy prohibition, it is prohibited to record the data temporarily stored in the storage means on the recording medium. As described above, according to the second data recording device of the present invention, data duplication can be controlled using digital watermark information embedded in data.

In the first data reproducing apparatus according to the present invention,
The data is output from the output unit when the detection unit detects the digital watermark information indicating the copy permission. As described above, according to the data reproducing apparatus of the present invention, it is possible to control the reproduction of the data using the digital watermark information embedded in the data. Further, when the detection means detects the digital watermark information indicating the permission of copying, the storage data of the storage means is output from the output means. Output to the device can be prevented.

In the second data reproducing apparatus according to the present invention,
When the detection unit detects the digital watermark information indicating that copying is prohibited, the data output of the output unit is prohibited. As described above, according to the data reproducing apparatus of the present invention, it is possible to control the reproduction of the data using the digital watermark information embedded in the data.

In the first data recording / reproducing apparatus according to the present invention, when digital watermark information indicating permission for copying is detected by the detecting means, the data is recorded on the recording medium and the output means outputs the data. Thus, the first embodiment of the present invention
According to the data recording / reproducing apparatus, the duplication and reproduction of data can be controlled using the digital watermark information embedded in the data. Further, when the detection means detects the digital watermark information indicating the permission of duplication, the storage data of the storage means is recorded on the recording medium, so that a part or all of the storage data of the storage means is recorded before the detection of the digital watermark information. It can be prevented from being recorded on a medium. Further, when the detection unit detects the digital watermark information indicating the permission of the copy, the storage unit outputs the storage data of the storage unit from the output unit.
It is possible to prevent some or all of the data stored in the storage unit from being output to an external device before the detection of the digital watermark information.

In the second data recording / reproducing apparatus according to the present invention, when the detecting means detects the digital watermark information indicating the prohibition of duplication, the recording medium is prohibited from recording the data and the data output of the output means is performed. Is forbidden. Thus, according to the second data recording / reproducing device according to the present invention,
Data duplication and reproduction can be controlled using digital watermark information embedded in the data.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram showing a correspondence between a luminance gradation of image data and an expression pattern.

FIG. 2 is an explanatory diagram showing an example of a data hiding method for hiding digital watermark information in image data.

FIG. 3 is an explanatory diagram showing a configuration example of a system having a data recording device and a data reproducing device according to the present invention.

FIG. 4 is a schematic block diagram illustrating an embodiment of a data recording device according to the present invention.

FIG. 5 is a schematic block diagram illustrating an embodiment of a data reproducing device according to the present invention.

FIG. 6 is a schematic flowchart for explaining the operation of the apparatus and the control operation of an MPU in the apparatus, and shows an operation example in the case where data recording or reproduction is controlled based on digital watermark information indicating that copying is prohibited.

FIG. 7 is a view showing the operation of the apparatus and the MP in the apparatus, following FIG. 6;
6 is a schematic flowchart for explaining a control operation of U, and shows an operation example in a case where recording or reproduction of data is controlled based on digital watermark information indicating duplication prohibition.

FIG. 8 is a schematic flowchart illustrating an operation of the apparatus and a control operation of an MPU in the apparatus, and illustrates an example of an operation in a case where data recording or reproduction is controlled based on digital watermark information indicating permission for duplication.

FIG. 9 is a view showing the operation of the apparatus and the MP in the apparatus, following FIG. 8;
6 is a schematic flowchart for explaining the control operation of U, and shows an operation example in the case where data recording or reproduction is controlled based on digital watermark information indicating duplication permission.

FIG. 10 is an explanatory diagram illustrating a modification of the display means.

FIG. 11 is a schematic block diagram illustrating an embodiment of a data recording / reproducing apparatus according to the present invention.

[Explanation of symbols]

9 input means, 10, 40 data bus, 11, 12,
Reference numeral 22: input interface circuit, 13: analog / digital converter, 14: microprocessor unit (recording control means), 15, 24 ... memory (storage means), 1
6, 25 digital watermark detector (detection means), 17 data compressor, 18 output means, 19, 27, 27A display means, 23 data decompressor, 26, 802 microprocessor unit (recording control means) , Output control means), 2
7B: knob, 27C: operation switch, 28-30: output interface circuit, 31, 32: digital / analog converter, 33: output means, 34: reading means, 806
... Electronic watermark input device, 807 ... Input / output means, 1004
... data reproducing apparatus, 1005 ... data recording apparatus, 100
6: Package media (recording medium), 1007: Recording medium, 1105: Data recording / reproducing device, 1500: Recording / reproducing system.

 ────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Yumi Kato 6-7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo Sony Corporation F-term (reference) 5C053 FA13 FA24 GB06 GB11 GB21 HA27 HA29 JA03 JA07 KA05 KA20 KA21 KA21 KA24 KA25 LA06 5C076 AA14 AA40 BA05 5D044 AB05 AB07 DE14 GK17 HH02 HH05 HH13 HH15 HL04 HL08 5J104 AA14 PA14 9A001 BB02 BB03 BB04 DD13 EE03 EE04 EE05 HH27 JJ19 KK37 KK43 LL03

Claims (32)

[Claims] 1. An input unit to which input data including one or both of sound data and image data is input; a storage unit for sequentially and temporarily storing the input data input to the input unit; Detecting means for detecting digital watermark information embedded in the input data temporarily stored in the storage means; and outputting the input data temporarily stored in the storage means to a recording medium for recording A data recording device, comprising: an output unit; and a recording control unit configured to output the input data from the output unit when the detection unit detects digital watermark information indicating permission for duplication. 2. The apparatus according to claim 1, further comprising means for detecting an amount of said input data stored in said storage means, wherein said recording control means includes a predetermined amount of data of said input data temporarily stored in said storage means. 2. The data recording apparatus according to claim 1, wherein output of said input data from said output means is prohibited when said detection means does not detect digital watermark information indicating that copying is permitted. 3. The data recording apparatus according to claim 1, further comprising display means for displaying a message indicating that copying is permitted when said detecting means detects digital watermark information indicating permission for copying. 4. When the detecting means does not detect digital watermark information indicating duplication permission in a predetermined amount of data of the input data temporarily stored in the storage means, the digital watermark information is not detected. 3. The data recording apparatus according to claim 2, further comprising a display means for displaying the data. 5. The data recording apparatus according to claim 1, wherein said recording medium is detachable from said data recording apparatus. 6. An input unit to which input data including one or both of sound data and image data is input; a storage unit for temporarily temporarily storing the input data input to the input unit; Detecting means for detecting digital watermark information embedded in the input data temporarily stored in the storage means; and outputting the input data temporarily stored in the storage means to a recording medium for recording A data recording apparatus, comprising: an output unit; and a recording control unit that inhibits output of the input data from the output unit when the detection unit detects digital watermark information indicating that copying is prohibited. 7. An apparatus according to claim 1, further comprising means for detecting an amount of said input data stored in said storage means, wherein said recording control means includes a predetermined amount of data of said input data temporarily stored in said storage means. 7. The data recording apparatus according to claim 6, wherein the output unit outputs the input data when the detection unit does not detect digital watermark information indicating that copying is prohibited. 8. The data recording apparatus according to claim 6, further comprising display means for displaying a message that duplication is prohibited when said detection means detects digital watermark information indicating duplication prohibition. 9. When the detecting means does not detect digital watermark information indicating duplication inhibition in a predetermined amount of data of the input data temporarily stored in the storage means, the digital watermark information is not detected. 8. The data recording apparatus according to claim 7, further comprising a display unit for displaying the data. 10. The data recording apparatus according to claim 6, wherein said recording medium is detachable from said data recording apparatus. 11. A reading means for reading input data including one or both of sound data and image data from a recording medium on which the input data is recorded, and sequentially and temporarily storing the input data read by the reading means. Storage means for temporarily storing digital watermark information embedded in the input data temporarily stored in the storage means; and the input data temporarily stored in the storage means A data reproducing apparatus comprising: an output unit that outputs the input data to an external device; and an output control unit that outputs the input data from the output unit when the detection unit detects digital watermark information indicating permission for copying. 12. An apparatus according to claim 11, further comprising means for detecting an amount of said input data stored in said storage means, wherein said output control means includes a predetermined amount of data of said input data temporarily stored in said storage means. 12. The data reproducing apparatus according to claim 11, wherein the output unit outputs the input data when the detection unit does not detect digital watermark information indicating that copying is prohibited. 13. An output control means for detecting an amount of the input data stored in the storage means, wherein the output control means includes a predetermined amount of data of the input data temporarily stored in the storage means. When the detecting means detects the digital watermark information indicating the copy permission during,
2. The output unit outputs the input data.
2. The data reproducing device according to 1. 14. A display means for displaying a message indicating that copying is permitted when said detecting means detects digital watermark information indicating copying permission in said input data temporarily stored in said storage means. 12. The data reproducing device according to item 11. 15. A display means for displaying a message indicating that copying is prohibited when the detecting means detects digital watermark information indicating that copying is prohibited in the input data temporarily stored in the storage means. 12. The data reproducing device according to item 11. 16. When the detecting means does not detect digital watermark information indicating duplication inhibition in a fixed amount of data of the input data temporarily stored in the storage means, the digital watermark information is not detected. 13. The data reproducing apparatus according to claim 12, further comprising a display unit for displaying the data. 17. When the detecting means does not detect digital watermark information indicating duplication permission in a predetermined amount of data of the input data temporarily stored in the storage means, the digital watermark information is not detected. 14. The data reproducing apparatus according to claim 13, further comprising a display unit for displaying the data. 18. A system comprising: means for inputting information of the external device from the external device and supplying the information to the output control means, wherein the output control means is provided when the external device has a recording function, and 12. The data reproducing apparatus according to claim 11, wherein output of said input data from said output means is prohibited when said detection means does not detect digital watermark information indicating permission. 19. A first output interface circuit to which said input data is inputted from said storage means and outputs said input data composed of digital data to a first external output terminal, and said storage means. A second output interface circuit to which the input data is input, and a digital / analog converter for converting the output data of the second output interface circuit from digital data to analog data and outputting to a second external output terminal 12. The output control means, wherein the output control means prohibits output of the input data from the first output interface circuit when the detection means detects digital watermark information indicating duplication prohibition. Data playback device. 20. The data reproducing apparatus according to claim 11, wherein said recording medium is detachable from said data reproducing apparatus. 21. A reading means for reading input data including one or both of sound data and image data from a recording medium on which the input data is recorded, and sequentially and temporarily storing the input data read by the reading means. Storage means for temporarily storing digital watermark information embedded in the input data temporarily stored in the storage means; and the input data temporarily stored in the storage means A data reproducing apparatus comprising: an output unit that outputs the input data to an external device; and an output control unit that prohibits output of the input data from the output unit when the detection unit detects digital watermark information indicating that copying is prohibited. 22. A system comprising: means for detecting the amount of the input data stored in the storage means; and the output control means includes a predetermined amount of data of the input data temporarily stored in the storage means. When the detecting means detects the digital watermark information indicating that copying is prohibited,
22. The data reproducing apparatus according to claim 21, wherein output of the input data from the output unit is prohibited. 23. Means for detecting an amount of the input data stored in the storage means, wherein the output control means includes a predetermined amount of data of the input data temporarily stored in the storage means. 22. The data reproducing apparatus according to claim 21, wherein output of the input data from the output unit is prohibited when the detection unit does not detect digital watermark information indicating that copying is permitted. 24. Display means for displaying a message indicating that copying is permitted when said detecting means detects digital watermark information indicating copying permission in said input data temporarily stored in said storage means. 22. The data reproducing apparatus according to 21. 25. A display means for displaying a message indicating that copying is prohibited when the detecting means detects digital watermark information indicating that copying is prohibited in the input data temporarily stored in the storage means. 22. The data reproducing apparatus according to 21. 26. When the detecting means does not detect digital watermark information indicating duplication prohibition in a predetermined amount of data of the input data temporarily stored in the storage means, the digital watermark information is not detected. 23. The data reproducing apparatus according to claim 22, further comprising a display means for displaying the data. 27. If the detecting means does not detect digital watermark information indicating permission of copying in a predetermined amount of data of the input data temporarily stored in the storage means, the digital watermark information is not detected. 24. The data reproducing apparatus according to claim 23, further comprising a display unit for displaying the data. 28. A system comprising: means for inputting information of the external device from the external device and supplying the information to the output control means, wherein the output control means is provided when the external device has a recording function; 22. The data reproducing apparatus according to claim 21, wherein output of said input data from said output means is prohibited when said detection means does not detect digital watermark information indicating permission. 29. A first output interface circuit to which said input data is inputted from said storage means and outputs said input data composed of digital data to a first external output terminal, said storage means. A second output interface circuit to which the input data is input, and a digital / analog converter for converting the output data of the second output interface circuit from digital data to analog data and outputting to a second external output terminal 22. The output control means, wherein the output control means prohibits the output of the input data from the first output interface circuit when the detection means detects digital watermark information indicating duplication prohibition. Data playback device. 30. A data reproducing apparatus according to claim 21, wherein said recording medium is detachable from said data reproducing apparatus. 31. An input unit to which input data including one or both of sound data and image data is input; a storage unit for temporarily temporarily storing the data input to the input unit; Detecting means for detecting digital watermark information embedded in the input data temporarily stored in the means; and a first output for outputting the input data temporarily stored in the storage means to an external device Means, a second output means for outputting the input data temporarily stored in the storage means to a recording medium and recording the input data, and when the detection means detects digital watermark information indicating permission for duplication, Recording control means for outputting the input data from the second output means; and when the detection means detects digital watermark information indicating permission for duplication, the first output means outputs the input data from the first output means. Data recording and reproducing apparatus and an output control means for outputting. 32. An input unit to which input data including one or both of sound data and image data is input; a storage unit for sequentially and temporarily storing the input data input to the input unit; Detecting means for detecting digital watermark information embedded in the input data temporarily stored in the storage means, and a first means for outputting the input data temporarily stored in the storage means to an external device An output unit, a second output unit that outputs the input data temporarily stored in the storage unit to a recording medium and records the input data, and when the detection unit detects digital watermark information indicating copy prohibition, A recording control unit for prohibiting the output of the input data from the second output unit; and, when the detection unit detects digital watermark information indicating duplication prohibition, the first output unit outputs Data recording and reproducing apparatus and an output control means for inhibiting output of the entry force data.