MXPA00005584A - Data processor and data recorded medium - Google Patents

Abstract

A data processor, comprises an acquiring unit (111) for receiving a network signal Sn from a network (N) and acquiring delivered audio data Dau in which information such as copyright information is embedded, and a control unit (115) for acquiring information representing the electronic watermark method used when the information such as copyright information is embedded. The embedded information is extracted by using an appropriate electronic watermark method according to the acquired electronic watermark information, and thereby the delivered audio data Dau in which the embedded information is embedded by using a predetermined electronic watermark method is recorded on a recording medium. As a result, delivered audio data Dau which is supplied through a network (N) and in which information is embedded even by using any electronic watermark method can be properly reproduced according to the embedded information such as copyright information by a reproducing device, which is a household appliance.

Description

DATA PROCESSING DEVICE AND MEANS FOR REGISTRATION OF DATA TECHNICAL FIELD The present invention relates to data processing apparatuses and data recording means and, more particularly, to a watermark input process (the information to be entered) into digital data such as the audio data obtained. by electronic distribution or recording means, by using a specific watermark method as a predetermined watermark method that is employed for versatile data reproduction apparatuses.

BACKGROUND OF THE ART With the progress of the digitization of video and audio data, the ease of forming a perfect copy of original digital data has become a major problem in recent years. As a measure against the problem, a watermark technique has been employed. The watermark technique is described in detail in the Patent Applications Published in Japanese Numbers Hei.9-191394 and Hei.9-191395.

REF .: 120748 The watermark technique is not a direct method to prevent original digital data to be reproduced, with video or audio data, to be copied, but a method to restrict the copying of the original digital data by entering, the rights information of literary property that relates to the copyright for digital data, in digital data. For example, introducing, as a watermark, the information of the copyright that indicates the name of the holder of the rights (source of information) in digital data such as video data and audio data, the information of the Copyright (watermark) is also copied when the digital data is copied. Therefore, when the owner of the copyright has found the digital data such as video data or audio data formed by illegal copying, the holder of the copyright can demonstrate the illegality of the rights information. of author entered in the digital data. Subsequently, the watermark technique will be specifically described.

Figures 18 (a) and 18 (b) are diagrams for explanation, such as an example of a watermark technique for video, a process of entering information that relates to the holder of the copyright of the video data digital (relevant information Dwmi) in this digital video data that will be provided from the distributor to the user (digital data supply). Then, this relevant information is called "watermark" or "information entered." To simplify the description, as shown in Figure 18 (a), it is assumed that an image F is still a gray scale image, and its size It is 50 pixels long X 50 pixels wide. In addition, each of the pixels P constituting the image F has an integral value within a range of 0 to 99, as a luminance level (pixel value) that indicates its brightness. In the watermark input process, initially, the image F is divided into a plurality of blocks B where each comprises a predetermined number of pixels (10 pixels in length x 10 pixels in width). That is, the original immobile image F is divided into 25 blocks (5 blocks long x 5 blocks wide) as shown in Figure 18 (b).

At this time, the pixel value constitutes the image data corresponding to each B block (sub-image) are represented as the values of the respective components of a matrix that has 10 rows x 10 columns. . Then, this matrix is subjected to transform to the discrete cosine (DCT) to obtain a transformed matrix of 10 rows x 10 columns. The numerical values set to the lower right portion of the transformed matrix are values representing the high frequency components of the image data corresponding to the original image. By the way, it is known that the human sense of sight is less sensitive to a change of high frequency components of the image data than to a change of the low frequency components thereof. In other words, even though the original image undergoes image processing to change the values of the high-frequency components to slightly different values, it is very difficult for the human sense of sight to recognize the difference between the processed image (reconstructed image ) and the original image. The reconstructed image is, to be specific, an image that corresponds to the data of the reconstructed image from an inverted matrix that is obtained by submitting the transformed matrix to the inverse DCT. The watermark technique for the video uses the features described above from the human view, and is able to enter the information in the image data corresponding to the original image, controlling the high frequency components of the original image , without making the viewer aware of the degradation of image quality. Although the watermark technique for the video has been described above, there is a watermark technique for audio. In addition, there is a watermark technique that can extract or remove information from the video or audio data where the information is entered. Furthermore, according to the watermark technique, when the digital data recorded in a digital recording medium is copied to another digital recording medium, the information entered in the digital data can also be copied. In addition, when the digital data recorded in the digital recording medium is converted to analog data via a DA converter and then recorded on an analog recording medium, the information entered can be recorded.

Retained in analog data recorded in the analog record medium. Subsequently, a description will be provided of the watermark technique for the audio. . Figure 19 is a diagram that conceptually illustrates a process of entering information and • a process of extracting information for digital audio data. Initially, a Pad process is performed where the signature data (information to be entered) Dwmi are included in the recorded digital audio data as archived audio data ODau, and then the digital audio data where the signature data is entered, is recorded as audio data included with the SDau archived signature data. Then, a Pex process is performed where the Dwmx signature data entered into the digital audio data is extracted, based on the digital audio data that is recorded as the ODau archived audio data and the digital audio data that is recorded. they are recorded as the audio data included with the SDau archived signature data.

Figure 20 is a flowchart of the information entry process. Initially, digital audio data is submitted to block (SI stage). This process is to divide the digital audio data into. a plurality of data groups (blocks) each comprising a predetermined number of test data, for convenience in the subsequent process. Then, each block is subjected to the Fourier transformation (step S2). The arithmetic operation for the Fourier transformation will be described later in detail. After this, the following data transformation is carried out "like the process of introducing watermark (information to be entered) by inserting process." The watermark consists of multiple bits of digital data (signature data), and Each bit of the signature data corresponds to each block Initially, it is confirmed that the value of each bit as a component of a block sequence (bit sequence) of the data of the signature "0" or "1" are (step S3). A block that corresponds to a bit of "0" is not submitted to the watermark introduction process. A block corresponding to a bit of "1" is submits to the watermark input process, where an imaginary part and a real part of a function that has been obtained by submitting the audio data corresponding to this block for Fourier transformation (afterwards, referred to as the transformed function of Fourier) are replaced with each other, and the real part is multiplied by -1 (step S4). This process is done for each block. Then, the transformed Fourier function corresponding to each block is subjected to the inverse Fourier transformation (step S5). Whereby, the audio data of each block is restored. . The inverse Fourier transformation will be described later in more detail. Through the processes described above, the information to which a normal human ear does not respond is included in the audio data. Then, the respective processes of the watermark technique described above will be described in greater detail. Initially, the Fourier transformation and the inverse Fourier transformation will be briefly described. The Fourier transformation used in the process of introducing a watermark (information to introduced) is called "discrete Fourier transformation" which is defined as follows. When a function of the discrete one-dimensional real number f (n) (neZ, 0 = n <N) is given, a function is obtained by subjecting this f (n) to the discrete Fourier transformation that is defined by a function of the complex number one-dimensional discrete F (k) (keZ, 0 = k <N) which is given by formula (1). In the present, Z denotes the group of total integers. In addition, formula (1) satisfies the conditions given by formulas (2) and (3).

F (k) =? / WY7"0.1, N-l) (1) J2 = -i (2) W = e j lx 'N = cos (2p /?) + Jsin (2p / N) (3) In addition, the discrete inverse Fourier transformation will be described later. When a function of discrete one-dimensional real numbers f (n) (neZ, 0 = n &?) Is given and a discrete one-dimensional complex number function F (k) (keZ, 0 = k <?) Is a function obtained performing the discrete Fourier transformation in f (n), the following formula (4) sustains it.

In the present, Z denotes the group of total integers. In addition, formula (4) satisfies the conditions given by formulas (5) and (6). = -1 (5) ¡v_ jlplN cos. { 2p / N) + jsin (2p / N) (6) Then, the process for entering the watermark for the audio data more specifically will be described. First, audio data blocking will be described with reference to Figure 21. Blocking is a process to represent the sample values of the Sound (i) of the digital audio data in which a watermark will be introduced (hereinafter, referred to as the designated audio data) as a group of blocks where each comprises samples as well as the n-th energy of 2 (2n). In the present, it is assumed that the total number of blocks obtained by blocking the designated audio data is (t + 1), the first block is the block Bo. the block of k-th (k: arbitrary number) is the block B,:, and the last block is the Bt block. In addition, the Sample values of the block of k-th are represented by B (j). The relationship between the sample values of the Sound (i) of the designated audio data and the respective sample values Bk (j) in the block is represented by the following formula (7). Bk (j) = Sound (i) where Z denotes the group of total integers, k and j satisfy k, jeZ, and i satisfies i = 2nk + j (0 <j <2n). It is unnecessary to say that the variables n and. k used here are different from the variables n and k used in the formula (1) that defines. the general discrete one-dimensional inverse transformation of Fourier and the formula (4) that defines the inverse one-dimensional inverse Fourier transformation. Subsequently, the process of introducing a watermark will be described. Initially, the audio data (sample values) B ,. (j) of block B? of k-th undergo the discrete Fourier transformation to obtain the data of Fk (m). Here, k is a variable that indicates an arbitrary block between blocks B0-Bt, and satisfies keZ, ke [0, t (total number of blocks)]. In addition, a sequence of data bits to be entered is defined by a number function one-dimensional discrete integral U (d), and data that is obtained by entering the information in the data Fk (m) (meZ, me [1, 2n]) according to the value of each bit in the data bit sequence defined by the function U (d), are represented by F'k (m). . In the present, d and dn satisfy the condition (d, dneZ). When dn satisfies dn < 2n_1, U (d) is 1 or 0. When d does not satisfy [l, dn]), U (d) is 0. Then, F'k (m) is represented by the following formulas (8) ~ (15) ), where m satisfies meZ, me [l, 2p]. Re (F'k (m)) = -lm (Fk (m)) (when ü (m) = 1) (8) Re (F * k (m)) = Re (Fk (m)) (when U (m) = 0) (9)? m (F'k (m)) = Re { F? (m)) (when U (m) = 1) (10) Im (F'k (m)) = Im (F? (M)) (when U (m) = 0) (11) Re (F'k (2 - m + 1)) = -Im (Fk (m)) (when U (m) = 1) (12) Re (F'k (2n - m + 1)) = Re ( Fk (m)) (when ü (m) = 0) (13) Im (F't. (21 - m + 1)) = Re (Fk (m)) (when U (m) = 1) (14 ) Im (F * (2r '- m + 1)) = Im (F> (m)) (when U (m) = 0) (15) The formulas described above (8) ~ (11) are applied to the low frequency components between the data parts 2 '(frequency components) Fk (m) was obtained by submitting the data parts 2r' (sample values) B ,. (j) to the discrete Fourier transformation.

On the other hand, in the formulas described above (12) ~ (15) are applied to the high frequency components of the data parts 2n (frequency components) Fk (m) was obtained by submitting the data parts 2n (values of sample) of Bk (j) to the discrete Fourier transformation. Also, as represented by the formulas (9), (11), (13) and (15), a block corresponding to a bit of 0 in the data bit sequence of the signature, is not subjected to the watermark input process.

On the other hand, as represented by the formulas (8), (10), (12) and (14), a block that corresponds to a bit of 1 in the data bit sequence of the signature, it is submitted to the watermark input process, where the imaginary part and the real part of the data Fk (m) obtained by the Fourier transformation in the audio data Bk (j) (sample values) that correspond to this block, are replaced with each other, and the real part is multiplied by -1. In addition, the watermark input process is performed on the pairs of the Fourier transformed data on the low frequency side and the corresponding Fourier transformed data on the high frequency side so that the designated audio data where the information is included do not be offensive to the listener's ear. Here, the transformed Fourier data F'k (m) of -th which have been subjected to the watermark input process correspond to the Fourier transform data F'k (2n-m + 1) (2n- m + l) th that have undergone the watermark introduction process. Next, the watermark extraction process will be described. Figure 22 is an organization chart of the watermark extraction process. Initially, the audio data that has been subjected to the information input process is divided into plural blocks (step Slla), and each block is subjected to the Fourier transformation (step 512a). In addition, the audio data that has not been submitted to the information input process is divided into the plural blocks (step Sllb), and the audio data of each block is subjected to the Fourier transformation (step S12b). Then, the data obtained as the results of the Fourier transformation stages are compared, block by block, between the blocks of the audio data that have been subjected to the information input process and the corresponding blocks of the data of audio that have not been submitted to the information input process (step S13). As a result of the comparison, when the data of the corresponding blocks are equal to each other, it is decided that no information is included in the block that has been submitted to the process of entering information, and the data bit of the signature is 0 ( stage S14). When the data of the corresponding blocks are different from each other, it is decided that the information is included in the block that has undergone the process of entering information, and the data bit of the signature is 1 (step S15). This process is repeated block by block to extract the sequence of the bit (information included) that constitutes the data of the signature. Subsequently, the watermark introduction process (information to be introduced) and the watermark extraction process (information entered) will be described more specifically. Initially, the process of entering the information in each block will be described. In the following description, the Sound (n) represents the 'audio data (sample values) in a block where the signature data will be entered, and syomei [u] represents a sequence of data bit of the signature to be entered in the data obtained by submitting the audio data Sound (n) in a block to the Fourier transformation. further, F [Sound] (p) represents the data obtained by submitting the audio data designated Sound (n) to the discrete Fourier transformation, and F [Sound] (p) represents the data obtained by entering the data bit sequence of the sign in F [Sound] (p). Here, audio data Sound (n) is a function defined in the integral space and that has an integer as its value, and n = 0,1, ..., N. In addition, the data bit sequence of the signature syomei.u] is also a function defined in the integral space (refer to the formula (16)) and that has only 0 or 1 as its value, yu = 0,1. syomei [u] =. { 1.0} (16) When the audio data Sound (n) is subjected to Fourier transformation, the corresponding Fourier transform data FfSound] (p) is obtained as indicated below.

This F [Sound] (p) is a function defined in the integral space and has a complex number as its value, and p = 0,1, ... N. Assuming that the real part of the transformed Fourier data FfSound] (p) that is a complex number is Re { F [Sound] (p)} while the imaginary part of them is Im. { F [Sound] (p)} , the data F '[Sound] (p) can be represented using the formulas described above (8) ~ (15) according to the value of the data bit sequence of the signature syomei [u]. Assuming that the data bit sequence of the signature to be entered in the transformed, Fourier F [Sound] (p) data corresponding to a block is syomei [0] = 1, the first bit value F [Sound] ( 1) of the transformed Fourier data F [Sound] (p) and the N-th of the F-value [Sound] (N) thereof is subjected to the process of entering information using the formulas described above (8), (10), (12) and (14). The following formulas (18) ~ (21) represent the transformed Fourier data F '[Sound] (1) and F' [Sound] (N) is obtained in the process of entering information.

Re.F '[Soni do] (1)} = -Im. { F [Soni do] (1)} ... (18) Im. { '[Soni do] (1)} = Re. { F [Soni do] (1)} ... (19) Re { F '[Sound] (1)} = -Im. { [Sound] (N)} (20) Im. { F '[Sound] (1)} = Re { F [Sound] (N)} (twenty-one) where Re and Im indicate the real part and the imaginary part of the complex number in. { } , respectively. On the other hand, assuming that the data bit sequence of the signature is entered into the audio data Sound (n) corresponding to a syomei block [1] = 0, the second beep value F [Sound] (2) of the Fourier transformed data F [Sound] (p) and the (? -l) th of the F-value [Sound] (? -l) thereof are subjected to that of the information input process using the formulas described above (9), (11), (13) and (15). The following formulas (22) - (25) represent the transformed Fourier data F '[Sound] (2) and F' [Sound] (? -l) was obtained in the information input process.

Re. { F '[Sound] (2)} = Re. { F [Sound] (2)} (22; Im { F '[Sound] (2).}. = Im { F [Sound] (2).}. (23) Re { F' [Sound] (Nl).} . = Re {F [Sound] (Nl).}. (24! Im { F '[Sound] (Nl).}. = Im {F [Sound] (Nl).}. ( 25) Performing the discrete inverse Fourier transformation in the F "[Sound] (p) data that has been obtained by submitting the transformed Fourier data F [Sound] (p) corresponding to the audio data Sound (n) in a block for the process of entering information using the formulas described above (8) - (15), the data . audio input information Sound '(n) are obtained as represented by the following formula (26).

Sound '(//) =? F [Sound p) ß} 2apn l N (26; n-0 Later, the process of extracting the information entered will be briefly described. In this process, the Sound (n) and the Sound '(n) are respectively subjected to the Fourier transformation, and the respective transformed Fourier data are compared. When the values of these data are different from each other, the data bit sequence of the signature is extracted with the bit data of the signature which is 1. When the values of these data are identical, the data bit sequence of the the signature is extracted with the bit data of the signature that is 0. The algorithm will be briefly described in the following. In . { } , n moves from 1 to N in order.

If F [Sound] (n) = F [Sound '] (n) does not hold, syo ei [nl] = 1 If F [sound] (n) = F [Sound'] (n) remains, syomei [ nl] = 0,} As described above, in recent years, the method to protect literary property rights for video data or audio data, has been put to practical use the watermark technique to enter the information that tells the holder of literary property rights or similar (relevant information) in these data to clarify the source of the data. Nevertheless, there are several watermark methods, to include such relevant information in the digital data and, under the existing circumstances, it is difficult to handle the digital data where the information of the literary property rights is introduced, by an apparatus of reproduction or the like that employs a predetermined watermark method. Meanwhile, an electronic distribution system has been proposed, where video data or audio data is not distributed through a distribution medium (data recording medium) but through a network.

In the electronic distribution system, the distribution of video data has a considerable technical problem because the amount of video data is very large. However, the distribution of audio data can be easily performed even in the existing limited network band because the amount of audio data is smaller than the amount of video data and, therefore, the distribution of audio data. It will be carried out more quickly. Therefore, there will be a claim for a system of introduction of pertinent information that specifies to the holder of the copyright or similar rights in the audio data to be distributed, using a watermark method, to identify the data source of audio The present invention was made to solve the problems described above and has for its purpose to provide a data processing apparatus that can perform the electronic distribution of audio data appropriately and, in addition, that can protect the literary property rights for the data of audio distributed electronically. It is another object of the present invention to provide a data processing apparatus that can convert digital data to where the Information has been included using various watermark methods, for data that can be processed by a predetermined watermark method. It is still another object of the present invention to provide a data recording medium containing the digital data having a data structure by means of which the appropriate electronic distribution of audio data is made and literary property rights are protected for the audio data distributed electronically. It is a further object of the present invention to provide a data recording medium containing, as digital data in which the information has been included by various watermark methods, the digital data having a data structure that can be processed by a predetermined watermark method.

DESCRIPTION OF THE INVENTION A data processing apparatus according to the present invention (Claim 1) is a data processing apparatus for receiving various types of digital data from the information entered corresponding to the different watermark methods and which have been obtained by entering the information Relevant that relates to provide the digital data in the digital data supply to be provided from the final distribution to the user, and processing this digital data from the included information. This apparatus comprises: means for obtaining data to obtain the digital data of the desired information entered as the digital data input; means that obtain the method information to obtain the information of the method used that corresponds to the digital input data, and indicates the watermark method used for the process of entering the relevant information; means of extracting information to extract the relevant information from the digital input data using the watermark method, based on the information obtained from the method used; and the means of entering the information to include the relevant extracted information or the processed information obtained, processing the pertinent information, in the digital input data or in the processed digital data obtained by submitting the digital input data to a predetermined data processing , using a predetermined watermark method.

According to the present invention (Claim 2), in the data processing apparatus described in Claim 1, the relevant information entered in the digital data of the included information is the information that is related to the holder of the copyright. of the provision of digital data. In accordance with the present invention (Claim 3) in the data processing apparatus described in Claim 1, the means of entering the information that introduce the relevant information or the information processed into the digital input data using the predetermined watermark method, whereby the digital output data is generated. In accordance with the present invention (Claim 4), the data processing apparatus described in Claim 3 further comprises a data reproduction unit for reproducing the digital output data. In accordance with the present invention (Claim 5), the data processing apparatus described in Claim 3 further comprises the data recording unit for recording the digital output data.

In accordance with the present invention (Claim 6), the data processing apparatus described in Claim 1 additionally comprises the means for withdrawing the information to withdraw the pertinent information from the digital input data based on the method information. used obtained by the means of obtaining the information of the method, whereby the digital data of the withdrawn information is generated as the processed digital data. The means of entering information that enter the relevant information or information processed into the digital data of the information withdrawn using the predetermined watermark method, whereby the digital output data is generated. In accordance with the present invention (Claim 7), the data processing apparatus described in Claim 6 further comprises a data reproduction unit for reproducing the digital output data. In accordance with the present invention (Claim 8), the data processing apparatus described in Claim 6 further comprises a data recording unit for recording the digital output data.

According to the present invention (Claim 9), in the data processing apparatus described in Claim, the digital data of the included information comprises a first data portion having a fixed length- and a second portion of data having a variable length; the information of the method used that indicates the watermark method used is included in the first data portion by means of the watermark method used; and the means that obtain the information of the method obtain the information of the method used that indicates the watermark method used, from the first data portion of the digital input data. In accordance with the present invention (Claim 10), in the data processing apparatus described in Claim 1, the digital data of the information entered have a data structure that includes a plurality of data packets; the method information used that indicates the watermark method used is included in a predetermined data packet loader between the plural data packets; and the means that obtain the information of the method obtain the information of the used method that indicates the watermark method used from the default data packet loader of the digital data of the information entered.

In accordance with the present invention (Claim 11), in the data processing apparatus described in Claim 1, the digital data including the information is followed by an auxiliary data portion; the method information used that indicates the watermark method used is included in the auxiliary data portion; and the information obtaining means of the method obtains the information of the method used that indicates the watermark method used of the auxiliary data portion that follows the digital data that includes the information. In accordance with the present invention (Claim 12), in the data processing apparatus described in Claim 1, the data acquisition means can obtain the digital data including the information of at least one of the plural data recording means and the trajectories of plural data transmission; and the unit that obtains the method information decides the watermark method used in accordance with any of the data recording means and the data transmission paths from where the digital data that includes the information has been obtained, and the information of the method used corresponding to the result of the decision is obtained. In accordance with the present invention (Claim 13), in the data processing apparatus described in Claim 1, the digital data that includes the information is the digital audio data, or the digital video data, or the multiplexed data obtained by multiplexing the digital audio data and the data digital video In accordance with the present invention (Claim 14), in the data processing apparatus described in Claim 1, the data obtaining means have an antenna for receiving a transmit wave from a transmitter, and a wave receiving decoder. to decode the wave received by the antenna to generate the digital data that includes the information. According to the present invention (Claim 15), in the data processing apparatus described in Claim 1, the data obtaining means have the unit that reads the data, from a wide memory, the digital data that They include the information stored in the broad memory. In accordance with the present invention (Claim 16), in the data processing apparatus described in Claim 15, the data reading unit has an access unit for reading the digital data that includes the information from a data source.

DVD-ROM, DVD-RAM, or a semiconductor recording medium. In accordance with the present invention (Claim 17), in the data processing apparatus described in Claim 1, the digital data that includes the information is obtained by entering the plural portions of the relevant information into the digital data supplied using a plurality of data. watermark methods; the plural parts of the method information used that correspond to the plural watermark methods are included in the digital data that include the information, as the method information used indicates the watermark method used; and the media that extracts the information can extract the pertinent information that corresponds to each of the plural watermark methods from the digital input data, based on the information of the method used that corresponds to the plural watermark methods. According to the present invention (Claim 18), in the data processing apparatus described in the Claim. 1, the digital data that includes the information is obtained by entering the plural portions of the relevant information into the digital data provided using a plurality of watermark methods; and the means introducing the information introduce one of the predetermined plural portions of the relevant information into the digital input data using the predetermined watermark method, whereby the digital output data is generated. In accordance with the present invention (Claim 19), in the data processing apparatus described in Claim 1, the digital data that includes the information is obtained by entering plural portions of the relevant information into the digital data provided using a plurality of data. watermark methods; and the means that introduce the information introduce a predetermined number of pertinent information between the plural parts of the relevant information, in the digital input data, using the methods of corresponding watermark between plural watermark methods or a watermark method different from plural watermark methods, whereby the digital output data is generated. In accordance with the present invention (Claim 20), in the data processing apparatus described in Claim 6, the digital data that includes the information is obtained by entering plural portions of the pertinent information into the digital data provided using a plurality of watermark methods; and the means introducing the information introduce one of the predetermined plural portions of the relevant information into the processed digital data using the predetermined watermark method, whereby the digital output data is generated. According to the present invention (Claim 21), in the data processing apparatus described in Claim 6, the digital data that includes the information is obtained by entering the plural portions of the relevant information into the digital data supplied using a plurality of watermark methods; and the media that introduce the information introduce a predetermined number of pertinent information between the plural parts of the relevant information, in the processed digital data, using the corresponding watermark methods between the plural watermark methods or a watermark method different from the plural watermark methods, whereby the digital output data is generated A data recording medium according to the present invention (Claim 22) is a means of data recording wherein the digital data including the information is recorded, where it has been obtained the digital data that includes the information, introducing the pertinent information that is related to provide the digital data in the digital data supply to be supplied from the final distribution to the user. The digital data that includes the information has a data structure where the digital data that includes the information is composed of a first data portion that has a fixed length and a second portion of data that has a variable length; the information of the method used that indicates the watermark method used to enter the relevant information in the supply of the digital data is entered into the first data portion; the relevant information is included in the second portion of data through the watermark method used indicated by the information of the method used; and the pertinent information can be extracted or removed from the second portion of data using an appropriate watermark method based on the information of the method used. In accordance with the present invention (Claim 23), in the data recording medium described in Claim 22, the information of the method used is entered into the first data portion of the digital data that includes the information by a predetermined watermark method. In accordance with the present invention (Claim 24), in the data recording medium described in Claim 22, the plural portions of the method information used indicating the different watermark methods used, which have been used to introduce the Relevant information in the provision of digital data is introduced in the first data portion of the digital data that includes the information. A data recording medium according to the present invention (Claim 25) is a means of recording data where digital data including information and information is recorded. of the method used, where the digital data has been obtained that include the information introducing the pertinent information that is related to provide the digital data in the supply of the digital data to be provided from - the final distribution to the user, and where the information of the method used indicates the watermark method that has been used to enter the relevant information in the provision of digital data and followed the digital data that includes the information. In this medium, the digital data that includes the information has a data structure in which the relevant information can be extracted or removed using an appropriate watermark method based on the information of the method used. According to the present invention (Claim 26), in the data recording medium described in Claim 25, the plurality of information of the method used that indicates the different methods of trademark marking are recorded as the information of the method used. water that have been used to enter relevant information in the provision of digital data. As described above, the data processing apparatus according to the present invention (Claim 1) is provided with the means that obtain the data, to obtain, like the digital input data, the digital data that includes the information that has been obtained by entering the pertinent information that relates to the digital data supplied in the supply of digital data to be provided from the final distribution to the user; the means that obtain the information of the method to obtain the information of the method used that corresponds to the digital input data and indicates the watermark method used for the process of entering the pertinent information; and the means of extracting information to extract the pertinent information from the digital input data using the watermark method used, based on the information of the method used that has been obtained. The relevant extracted information or the processed information obtained by the processing of the pertinent information is entered into the digital input data or processed digital data obtained by submitting the digital input data to a predetermined data process. Accordingly, the apparatus can detect the watermark method by which relevant information has been entered into the digital data supply.

Therefore, by extracting or removing the relevant information, it is avoided that the misinformation is extracted using another method and that a portion instead of the relevant information introduced is undesirably changed using another method.As a result, in the final distribution from where the digital data such as the audio data is distributed to the user, the relevant information can be entered as a watermark in the supply of the digital data to be provided, using a brand-name method. desired water. In other words, especially when the digital data is recorded in a recording medium to the end user, the final distribution of the digital data can select a watermark method that provides the least degradation - due to the process of entering information, according to the content of the digital data. In addition, the final distribution can select the optimal method according to communication speed or similar when transmitting digital data. In addition, when the digital data that includes the information obtained from the network is recorded in a writing record means, a watermark method, which is different from the watermark method used to enter the information in the supply of the digital data in the final distribution, can be used to enter the information in the digital data to be written in the record medium. Accordingly, the information can be introduced into the digital data by a watermark method adapted to an apparatus that reproduces the digital data. According to the present invention (Claim 2), in the data processing apparatus described in Claim 1, the relevant information entered in the digital data. which include the information is the information that relates to the possessor of the literary property rights of the digital data supply. Accordingly, literary property rights for the provision of the digital data to be provided from the final distribution to the user can be protected. According to the present invention (Claim 3), in the data processing apparatus described in Claim 1, the means that enter the information enter the pertinent information or the processed information into the digital input data using the method of mark of water redetermined, whereby the data is generated digital Therefore, without taking into account the watermark method by which the relevant information has been entered into the digital data obtained, the reproduction apparatuses as a domestic electrical equipment, can appropriately reproduce the digital data that include the information, of I agree the information entered as the information of the literary property rights, based on the digital output data. According to the present invention (Claim 4), the data processing apparatus described in Claim 3 further comprises a data reproduction unit for reproducing the digital output data. Accordingly, the reproduction of the digital data that includes the information obtained can be controlled according to the pertinent information. In accordance with the present invention (Claim 5), the data processing apparatus described in Claim 3 further comprises a data recording unit for recording the digital output data. Therefore, without taking into account the watermark method used for the digital data that includes the information, the digital data that includes the information can stored, as the digital data corresponding to a predetermined watermarking method, in recording media that are used in the reproduction apparatuses as domestic electrical equipment. According to the present invention (claim 6), in the data processing apparatus described in Claim 1, the relevant information or processed information is input into the processed digital data that has been obtained by submitting the digital input data to a predetermined data processing, using the default watermark method. Accordingly, the relevant information in the digital input data, which corresponds to various watermark methods, can be replaced with that which corresponds to the predetermined watermark method. In accordance with the present invention (Claim 7), the data processing apparatus described in Claim 6 further comprises a data reproduction unit for reproducing the digital output data. Accordingly, the reproduction of the digital data that includes the information obtained can be controlled according to the pertinent information. In addition, when digital data processed is digital audio data that have been obtained by removing the information entered from the digital input data, the reproduction of the digital data that includes the information can be done according to the processed digital data, with the minimized degradation of the sound quality.

According to the present invention (Claim 8), the data processing apparatus described in Claim 6 further comprises a data recording unit for recording the digital output data. Therefore, without taking into account the watermark method used for the digital data obtained that includes the information, the digital data that includes the information can be stored in the recording media used in reproduction apparatuses such as domestic electrical equipment, as the digital data have less noise and correspond to the default watermark method. According to the present invention (Claim 9), in the data processing apparatus described in Claim, the digital data including the information comprises a first data portion having a fixed length and a second data portion having a length variable; and the means that obtain the method information obtain the information of the method used from the first data portion of the digital data that includes the information. Therefore, the means that obtain the information of the method. they can easily detect the position of the information of the method used in the digital data that includes the information. According to the present invention (Claim 10), in the data processing apparatus described in Claim 1, the digital data that includes the information has a data structure that includes a plurality of data packets; and the means that obtain the method information obtain the information of the method used that indicates the watermark method used from the predetermined data packet loader of the digital data that includes the information. Accordingly, the means that obtain the method information can detect the position of the method information easily used in the digital data that includes the information. According to the present invention (Claim 11), in data processing apparatus described in Claim 1, the data digitals that include the information are followed by an auxiliary data portion; and the means that obtain the information of the method obtain the information of the method used that indicates the watermark method used from the auxiliary data portion that follows the digital data that includes the information. Accordingly, the means that obtain the method information can easily detect the position of the method information used in the digital data that includes the information. In accordance with the present invention (Claim 12), in the data processing apparatus described in Claim 1, the watermarking method used is decided according to the trajectory through which the digital data that includes the information has been obtained, and you get the information of the method used that corresponds to the decision. Therefore, it is not necessary to enter the watermark method information in the digital data to be distributed from the final distribution to the network. In addition, it is not necessary to enter the watermark method information in the distributed digital data to be stored in the recording medium. Therefore, the data processing for data provision can be reduced digital to be provided from the final distribution to the user. According to the present invention (Claim 13), in the data processing apparatus described in Claim 1, the digital data that includes the information is the digital audio data, or the digital video data, or the multiplexed digital data. obtained by multiplexing digital audio data and digital video data. Accordingly, the relevant information introduced in the different types of digital data (for example, digital audio data, digital video data, multiplexed digital data) that corresponds to the different watermark methods, can be converted to correspond to the predetermined watermark method. In accordance with the present invention (Claim 14), in the data processing apparatus described in Claim 1, the data obtaining means has an antenna for receiving a transmission wave from a transmitter, and a receiving decoder for receiving a transmitter. wave to decode the wave received by the antenna to generate the digital data that includes the information. Accordingly, digital data can be obtained they include the information of the transmission wave transmitted from the transmission station. According to the present invention (Claims 15 and 16), in the data processing apparatus described in Claim 1, the means that obtain the data has a unit that reads the data to read the digital data that includes the information from a volume memory. Accordingly, the digital data that includes the information can be obtained from the DVD-ROM, DVD-RAM, or a semiconductor recording medium. In accordance with the present invention (Claim 17), in the data processing apparatus described in Claim 1, the digital data that includes the information is obtained by entering plural portions of the relevant information into the digital data supply using the plural watermark methods, and each of these relevant information is extracted by the corresponding watermark method. Accordingly, various types of pertinent information can be introduced into the provision of digital data by appropriate watermark methods. According to the present invention (Claim 18), in the processing apparatus of As described in Claim 1, the digital data that includes the information is obtained by entering the plural parts of the relevant information into the digital data supply using the watermark methods - plurals, and a predetermined information of the relevant information is entered into the digital input data by the default watermark method. Accordingly, desired pertinent information can be adapted between the different types of pertinent information introduced in the digital data to the predetermined watermark method. According to the present invention (Claim 19), in the data processing apparatus described in Claim 1, the digital data that includes the information is obtained by entering the plural parts of the relevant information into the digital data supply using the plural watermark methods, and a predetermined number of relevant information between the plural parts of the relevant information is included in the digital input data using the corresponding watermark methods among the plural watermark methods or a method of watermark different from watermark methods plural Accordingly, desired desired information can be adapted between the different types of relevant information introduced in the digital data to a required watermark method. According to the present invention (Claim 20), in the data processing apparatus described in Claim 6, the digital data that includes the information is obtained by entering the plural parts of the relevant information into the digital data supply using the plural watermark methods, and a predetermined plural part of the relevant information is entered into the processed digital data using the predetermined watermark method. Accordingly, the digital data including the information containing various types of pertinent information can be converted to the new digital data where it is desired that one of the various types of relevant information suits the predetermined watermark method. In accordance with the present invention (Claim 21), in the data processing apparatus described in Claim 6, the digital data that includes the information is obtained by entering the plural portions of the information relevant in the provision of digital data • using plural watermark methods, and a predetermined number of pertinent information between plural parts of relevant information is entered into the processed digital data using the corresponding watermark methods between the methods plural watermark or a watermark method different from the plural watermark method. Therefore, digital data that includes information containing various types of information can be converted into new digital data where one of the different types of relevant information is desired to adapt to a required watermark method. A data recording medium according to the present invention (Claim 22) is a data recording medium in which the digital data that includes the information is recorded, where the digital data that includes the information has been obtained by entering the pertinent information which relates to provide the digital data in the provision of the digital data to be provided from the final distribution to the user. The digital data that includes the information is composed of a first portion of data of fixed length where the information on the method used that indicates the watermark method used is entered, and a second portion of variable length data where the relevant information is entered by the watermark method used. Accordingly, an apparatus that obtains the digital data that includes the information can decide the watermark method used to enter the information in the digital data. Therefore, the device can perform the extraction or removal of the information entered, without extracting the bad information using another method when the entered information is extracted, or without changing a portion instead of the information entered using another method when the information is removed. information entered. In addition, the apparatus that obtains the digital data that includes the information can easily detect the position of the method information used in the digital data that includes the information. As a result, in the final distribution from where the digital data as the audio data is distributed to the user, the relevant information can be entered as a watermark in the provision of the digital data to be provided, using a desired watermark method . In other words, especially when the digital data is recorded in a medium of To the end user, the final distribution of the digital data can select a watermark method that provides the least degradation due to the process of entering information, according to the content of the digital data. - In addition, the final distribution can select the optimal method according to communication speed or similar when transmitting digital data. In addition, when the digital data that includes the information obtained from the network, a watermark method, which is different from the watermark method used to enter the information in the supply of water, is recorded in a writing record means, it is recorded. The digital data in the final distribution can be used to enter the information in the digital data to be written in the recording medium. Therefore, the information can be entered into the digital data by a watermark method adapted to an apparatus that reproduces the digital data. In accordance with the present invention (Claim 23), in the data recording medium described in Claim 22, the information of the method used is input into the first data portion of the digital data that includes the information by a predetermined watermark method. Accordingly, the extraction of the information from the method used that indicates the watermark method used is facilitated. According to the present invention (Claim 24), in the data recording medium described in Claim 22, the plural portions of the information of the method used that indicates the different watermark methods used, are entered as the information of the method used. Accordingly, an apparatus that obtains the digital data that includes the information, can control the reproduction of the digital data based on the plural parts of the information of the method used. A data recording medium according to the present invention (Claim 25) is a data recording medium in which the digital data including the information and the information of the method used is recorded, where the digital data including the information is stored. have obtained by entering the relevant information that is related to provide the digital data in the supply of the digital data to be provided from the final distribution to the user, and where the information of the method used indicates the method of watermark that has been used to enter the relevant information in the provision of digital data and continue with the digital data that includes the information. In this medium, the digital data that includes the information has a data structure where the relevant information can be extracted or can be removed using an appropriate watermark method based on the information of the method used. Accordingly, an apparatus that obtains the digital data that includes the information can perform the processing or reproduction of the digital data based on the information of the method used. In addition, as in Claim 22, the apparatus can decide the watermark method used to enter the information in the digital data. Accordingly, the apparatus may perform the extraction or removal of the entered information without extracting the misinformation using another method by extracting the entered information, or without changing a portion instead of the information entered using another method when the entered information is removed. In accordance with the present invention (Claim 26), in the data recording medium described in Claim 25, the plural parts of the information of the method used that indicates the Different methods of watermark are introduced as the information of the method used. Accordingly, an apparatus that obtains the digital data that includes the information can perform the processing or reproduction of the digital data based on the plural parts of the information of the method used.

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a block diagram for explaining a data processing apparatus according to a first embodiment of the present invention. Figure 2 is a diagram illustrating the data structure of the distributed Dau audio data provided by a signal from the network to the data processing apparatus of the first mode. Figure 3 is a diagram for explaining the watermark method information used included in the Dau distributed audio data. Figure 4 is a block diagram for explaining a data processing apparatus according to a second embodiment. Figure 5 is a diagram illustrating the data structure of the information data of the watermark method used included in the audio data • attributed to the information provided to the data processing apparatus of the second mode. Figure 6 is a block diagram for explaining a data processing apparatus according to a third embodiment. Figure 7 is a block diagram for explaining a data processing apparatus according to a fourth embodiment. Figure 8 is a diagram illustrating the data structure of an object video to be processed by the data processing apparatus of the fourth embodiment. Figure 9 is a diagram illustrating the data structure of an audio package included in the object video. Fig. 10 is a diagram illustrating the values of the 2-bit data stored in the audio packet charger Pah as the information of the watermark method used lum, and the meaning of each value. Figure 11 is a block diagram for explaining a data processing apparatus according to a fifth embodiment.

Figure 12 is a diagram illustrating the data structure of the distributed audio data recorded in a data recording medium, where the data will be processed by a data processing apparatus of the fifth embodiment. Figure 13 is a diagram illustrating the data structure of the information of the watermark method used lum included in the TOK information in the distributed audio data. Figure 14 is a block diagram for explaining a data processing apparatus according to a sixth embodiment. Figures 15 (a) is a diagram illustrating the data structure of the information entered (first information included) in the distributed audio data provided by a transmission wave to data processing apparatus of the sixth embodiment, and Figure 15 (b) is a diagram that illustrates the data structures of the information entered processed (second information entered) that is obtained by processing the first information entered. Figure 16 (a) is a diagram illustrating the Irm information values of the watermark method used in the record which is included in the first information entered I ml, and the meaning of each value, and Figure 16 (b) is a diagram illustrating the lum information values of the watermark method used in the record which is included in the second I m2 information, and the meaning of each value. Figure 17 is a block diagram for explaining a data processing apparatus according to a seventh embodiment of the present invention. Figures 18 (a) and 18 (b) are diagrams to explain the method for entering the information (watermark) relating to the holder of the copyright of the digital video data, using the watermark technique, where 18 (a) shows a pixel matrix that constitutes an image, and 18 (b) shows a matrix of pixels in each of the plural blocks obtained by dividing the image. Figure 19 is a diagram illustrating conceptually a process that introduces information and a process of extracting information in / from digital audio data. Figure 20 is an organization chart of the process to enter the information. Figure 21 is a diagram to explain the blocking of audio data in the process of entering information.

Figure 22 is a flow chart of the information extraction process. Figure 23 is a conceptual diagram illustrating the flow of digital audio data in an electronic distribution system that is a premise of the present invention.

BEST MODE FOR EXECUTING THE INVENTION The inventors of the present invention have seriously studied the recent watermarking technique and the electronic distribution system for digital data, and discovered that by employing the watermark technique for the distribution system electronic, the variety of existing watermark methods will be a big problem. To be more specific, the provision of audio data by electronic distribution can be performed very easily as compared to the provision of audio data by the data recording medium, and also that the number of data sources will increase considerably. Accordingly, it is impossible to unify the watermark methods between the distributors of the respective audio data. On the other hand, in the electronic distribution system, it is very easy to obtain audio data and it is also high possibility of copying illegally. Therefore, unifying the watermark methods between the different distributors is undesirable because, in this case, the illegal use of the audio data can not be monitored when the watermark method is executed. Then, the problem in the electronic distribution system and the measure taken against the problem will be described in more detail. Figure 23 is a diagram illustrating the flow of digital audio data in the electronic distribution system. With reference to Figure 23, a unit that receives / registers 200 is connected to a network N. The digital data that includes the information where the information is entered by various watermark methods, exist in the network N. In the Figure 23, three watermarking methods (method A, method B and method C) are employed, and the digital audio data Da, Db, and De where the information is entered by the respective methods are supplied to the receiving unit / register 200. In addition, the registration / recording unit 200 records the digital data received Dol in a data registration medium Rd. This system also includes a reproduction unit 300 wherein the means of Data record Rd is mounted, where the digital Do2 data recorded in the data record medium Rd record element is reproduced. It is assumed that a personal computer is used as the receiving / recording unit 200, - and semiconductor player or a DVD player (domestic electrical equipment) is used as the reproduction unit 300. In the electronic distribution system to be constructed, initially , the digital audio data Da, Db, and De are received by the receiving / registration unit 200, and the received digital audio data is generated to the data recording medium Rd as the digital output data Dol. Then, the digital output data Dol is recorded in the data registration medium Rd. Subsequently, in the reproduction unit 300 where the data registration means Rd is mounted, the digital Do2 data that has been read from the data registration means Rd. Therefore, the specification in the reproduction unit 300, which is a home computer, is that it can not be changed. easily after the commercialization of this has started and, consequently, it is difficult to change the watermark method employed in the reproduction unit 300.

Accordingly, in the electronic distribution system for the audio data, although it is necessary to provide the digital audio data adapted to the predetermined watermark method to the reproduction unit 300, it is impossible to unify the watermark methods between the distributors of the respective digital audio data. To solve this problem, the inventors of the present invention noted that the personal computer used as the receiving / registration unit 200 can be adapted to digital data that has been processed by various watermark methods, by changing the set of programs. However, even when the set of programs is changed, the receiving / registration unit 200 can not specify the watermark method by which the information has been entered into the received digital data and, therefore, the information entered does not It can be extracted by the convenient watermark method for the received digital data. To be more specific, the arithmetic process to extract or remove the information entered from the digital data is the inverse of the arithmetic process to enter the information in the digital data, and the same method of watermark is used for the process of information introduction and information extraction process. Therefore, if the watermark method used for the information entry process can not be specified, the process of extracting information -or withdrawal- can not be performed. Also, the inventors of the present invention who have seriously studied the electronic distribution system and finally discovered the following factor. That is, in the electronic distribution system, when the receiving / registration unit 200 constituted by a personal computer is provided with the function of specifying the watermark method used to enter the information in the received digital data, the digital data where the information has been introduced by various watermarking methods to data adapted to a specific watermark method used for the reproduction unit 300 as a household equipment. For example, the digital data Da, Db, and De registered by the three methods described above A, B. and C, respectively, can be converted to digital data Dx adapted to the specific watermark method used by the reproduction unit 300. .

More specifically, the information entered is extracted from the digital data received using the same watermarking method as that used to enter the information in the digital data, and then the extracted information that - corresponds to the watermark method used is of introduced into the digital data received using a specific watermark method used in the reproduction unit 300. Therefore, without taking into account the watermark method used to enter the information in the received digital data, the unit 300 as a home computer can reproduce the digital data received properly. Subsequently, the embodiments of the present invention will be described in detail.

Modality 1. Figure 1 is a block diagram for explaining a data processing apparatus 110 according to a first embodiment of the present invention. The data processing apparatus 110 obtains several types of digital data including the Dau information corresponding to watermark methods other than a network signal Sn in a network N, processes each of the digital data including the information to correspond to a predetermined watermark method, and records the digital data corresponding to the predetermined watermark method in a data recording medium. In this first mode, simplification, it is assumed that the data processing apparatus 110 receives, as the different types of digital data including the Dau information, the digital data Da, Db, and De corresponding to the three methods of watermark (method A, method B. and method C) shown in Figure 23, respectively. To be specific, the digital data Da is the distributed audio data that is obtained by entering, as a watermark, the relevant information (information to be entered) into the audio data supply to be provided from the final distribution to the user, using the watermark method A. The digital data Db is the distributed audio data that is obtained by entering the relevant information in another digital audio data supply using the B method. The digital data De is distributed audio data that is they obtain by entering the relevant information into yet another digital audio data supply using the C method. In addition, the default watermark method is a versatile watermark method used for reproduction devices that are domestic electrical equipment, such as semiconductor players or DVD players. Turning to Figure 1, the data processing apparatus 110, includes a unit (data acquisition unit) 111 to obtain, as the digital input data, the digital data that includes the Dau information (any of the digital data Da, Db, and De) from the network signal Sn in the network N. This unit that obtains the data 111 comprises a network interface 111 exchanging a transmission signal with the network N, and a received signal decoder lllb which converts the network signal Sn received through the interface Illa to the digital data by decoding. That is, the received signal decoder lllb decodes the network signal Sn and generates the digital data that includes the Dau information as the digital input data (distributed audio data). In addition, the data processing apparatus 110 includes a control unit 115 having a function (means that obtain the method information) to obtain, from the digital input data, the information of the method used that indicates the method of marking water used to enter the information relevant in the provision of digital data; and an extraction unit 112 that extracts the information entered (pertinent information) from the digital input data, by the watermark method used in accordance with the information of the method used. The control unit comprises a CPU which controls various types of arithmetic processing and data processing, and a RAM which contains the operation program of the CPU and which also serves as an execution memory. Accordingly, in the control unit 115, the means that obtain the method information are mounted in the CPU. In addition, the extraction unit 112 is constituted by an LSI design. The extraction unit 112 comprises an extractor method 112a that extracts the information entered from the digital data Da by the watermark method A, a method B extractor 112b that extracts the information entered from the digital data Db by the brand method of water B, and a method C extractor 112c which extracts the information entered from the digital data De by the watermark method C. The data processing apparatus 110 further includes an insertion unit (information input means) 113 that inserts the extracted information in the digital input data (distributed audio data) by the predetermined watermark method to generate the digital output data; and a register unit 114 that stores the digital output data. The insert unit 113 is constituted by an LSI model, and the register unit 114 is provided with a DVD-RAM unit that writes and reads the digital output data to / from a DVD-RAM disc. In the data processing apparatus 110, the data acquisition unit 111, the extraction unit 112, the insertion unit 113, the registration unit 114, and the control unit 115 are connected to each other by a data collector. Dbus, and the control unit 115 controls the operations of the unit that obtains the data 111, the extraction unit 112, the insertion unit 113, and the registration unit 114. That is, the control unit controls, not only the operation to obtain the information of the watermark method used from the digital input data, but also the following processes: the process of obtaining digital data that includes the Dau information from the network signal Sn by the unit that obtains the data. data 111, the process of extracting the information entered by the extraction unit 112, the process of entering the information extracted by the insertion unit 113, and the process of writing the digital output data in the registration unit 114. In the data processing apparatus 110 of this first embodiment, the unit that obtains the digital data 111 comprises the network interface Illa and the received signal decoder lllb, that is, is constructed to receive the network signal Sn from the network N through a communication line and decode this signal to obtain the data which include the Dau information. However, the construction of the unit that obtains the digital data is not restricted for it. For example, the digital data acquisition unit 111 can comprise an antenna that receives a transmission wave, and a received wave decoder that decodes the received wave generated from the antenna, and the generation from the received wave decoder is It gets like the digital data that includes the Dau information. In addition, the digital data acquisition unit may comprise a modem connected to a telephone line or a coaxial cable. In this case, an analog transmission signal from the line Telephone or coaxial cable is converted to digital data that includes the information by the modem, and this digital data that includes the information is obtained as the digital input data. In addition, the digital data acquisition unit 111 may be a volume storage that reads digital data including the Dau information from the volume data storage medium capable of handling the multimedia data., such as disk storage media such as DVD-ROM, DVD-RAM, and CD-ROM, or semiconductor media. While in this first embodiment the extraction unit 112 and the insertion unit 113 are constituted by individual LSI design circuits, these units can be constituted by a sol design LSI. Since the extraction units 112 and the insertion unit 113 perform a number of common processes, in order to constitute these units by a single LSI design, the reduction in the number of components is desirable. Furthermore, while in this first embodiment the extraction unit 112 and the insertion unit 113 are constituted by circuits of the LSI model, these units can be constituted by a CPU that performs arithmetic processing and a RAM that stores the arithmetic program and serves as a memory of execution. Especially in this case, the extraction unit 112 and the insertion unit 113 can share the constituents such as the CPU and the memory with the control unit 115, whereby the number of components can be effectively reduced. - Furthermore, while in this first embodiment the registration unit 114 is constituted by a DVD-RAM unit, this registration unit 114 can be constituted by any storage that is as large as a write volume storage capable of handling the multimedia data , as a CD-R unit or a semiconductor means of a writing unit, (data structure of the digital data) Subsequently, a description will be given of the data structure of the digital data that includes the Dau information that is obtained from the network signal Sn in the network N, and the digital output data that is generated from the insertion unit 113. These digital data have the same data structure, and Figure 2 shows the data structure of the digital data that They include the Dau information. The digital data that includes the Dau information is composed of a first Daul data section and a second Dau2 data section. Although the size (length) of the digital data that includes the Dau information is variable, the size of the first Daul data section is fixed. Therefore, the data processing apparatus that has received the digital data that includes the Dau information can distinguish the first Daul data section from the second Dau2 data section. In the digital data corresponding to the first Daul data section, the information of the method used indicating the watermark method used is introduced by a versatile watermark method among the watermark methods described above A, B and C. On the other hand, in the digital data corresponding to the second Dau2 data section, the relevant information such as the information of the copyright is registered as a watermark by the indicated watermark method. for the information of the method used. Although the digital output data of the insert unit 113 is not shown in Figure 2, in this first embodiment the data structure of the digital output data is identical to that of the digital data including the Dau information. That is, the digital output data are composed of a first fixed-length data section and a second variable-length data section, and the used method information indicating the watermark method used in the digital data corresponding to the first data section is inserted while the relevant information is inserted (information to be registered) is entered in the digital data corresponding to the second section of data by the watermark method used. While in this first mode the first section of data in the digital data that includes the information or the digital output data has a fixed length, the first section of data may have a variable length when it attributes the information indicating the attribution of the data. Digital data is included in the digital data. In this case, however, the size information indicating the size of the first data section in the attributed information must be entered. In addition, also when the digital data including the digital output information or data includes the information indicating the end point of the first data section, the first data section may have a variable length.

In addition, in the digital data that includes the digital output data or information, the first and second data sections are positioned such that the first fixed length data section is followed by the second variable length data section. However, these data sections can be positioned such that the second section of variable length data is followed by the first section of the fixed length data. further, a plurality of the first fixed length data sections and a plurality of the second variable length data sections can be dispersed in the digital data, (data structure of the method information used) After, a description will be given of the data structure of the information of the method used lum indicating the watermark method used. This information of the method used is introduced into the first data section of the digital data that includes the Dau information by a watermark method (eg, the watermark method A). The information of the method used is the 2-bit data. In the control unit 115 of the data processing apparatus 110, according to value of this data, you get the information of the method used that indicates the watermark method used to enter the relevant information in the supply of audio data. Figure 3 shows the values of the first and second bits of the two-bit data as the information of the method used. The value "00" of the information of the method used indicates that the digital input data do not have the information entered according to the watermark method. In addition, the values "01", "10", and "11" of the method information used indicate that the digital input data has the information entered according to the watermark methods A, B and C, respectively. Subsequently, the operation of the data processing apparatus 110 will be described, (acquisition of digital data) Initially, in the data processing apparatus 110, the data acquisition unit 111 obtains the desired digital data from the network signal Sn in the N network. It is assumed that the desired digital data is the digital audio data that includes the information (distributed audio data) Dau, where the relevant information -such as the information of the Literary property rights has been introduced, as a watermark, in the provision of audio data to be provided from the final distribution to users, by a predetermined watermark method (eg, the watermark method). -). To be specific, the signal of the network (transmission signal) Sn corresponding to the desired digital data, which has been transmitted from the network N through the network cable, is received by the network interface Illa of the unit. data acquisition 111. The signal of the received network Sn is converted to the desired digital data Dau by decoding in received signal decoder lllb. The desired digital data Dau to be obtained is transmitted through the data collector Dbus to the extraction unit 112, the insertion unit 113, and the control unit 115. While in this first mode all the digital data obtained by the apparatus of data processing 110 are subjected to the data conversion process, only some of the digital audio data obtained selected by the user of the apparatus can be subjected to the data conversion process. While in this first mode the digital data received by the processing apparatus of data 110 is only the digital data that includes the Dau information, the data processing apparatus 110 can receive other types of digital data than the digital data that includes the Dau information as long as the apparatus 110 can identify the digital data received as the digital data to be subjected to the data conversion process, (acquisition of the information of the method used) Then, the digital data including the Dau information obtained by the data acquisition unit 111 is transmitted through the Dbus data collector to the extraction unit 112 and the control unit 115. In the control unit 115, since the digital data including the Dau information are composed of the first fixed length Daul data section and the second Dau2 data section of the variable length, the first data section is distinguished from the second data section, and the extraction unit 112 extracts the information of the method used from the first data section according to a control signal of the control unit 115. To be specific, in the extraction unit 112, the information of the used method that has been introduced by the marking method is extracted. of predetermined water, from the first Daul data section of the digital data including the Dau information, according to the control signal of the control unit 115. Since the data of two bits having the value of "01" are included as the information of the method used in the digital data that correspond to the first section of data, the extraction unit 112 obtains the information of the method used that indicates the watermark method used A from the first data section. The information of the method used thus obtained is stored in the execution memory of the control unit 115. While in this first embodiment the predetermined watermark method is the versatile watermark method A, any of the methods A, B and C, can be used to enter the information of the method used, according to the construction of the control unit 115. In addition, an arbitrary watermark method can be employed instead of these methods. Furthermore, while in this first mode the first data section contains only the information of the method used it may contain other information, (extraction of the information entered) In the second data section Dau2 of the digital data including the Dau information transmitted from the data collection unit 111 a Through the data collector Dbus to the extraction unit 112, the relevant information has been introduced by the watermark method A which is indicated by the information of the method used obtained. . In the extraction unit 112, the relevant information (information entered) is extracted from the digital data that includes the Dau information according to the method information used stored in the execution memory of the control unit 115. The information pertaining to it is stored once in the execution memory of the control unit 115. (re-entry of the information entered) In the insertion unit 113, the relevant information that is stored in the execution memory of the control unit 115 it is again introduced into the digital data that includes the Dau information from the data acquisition unit 111, by the predetermined watermark method, whereby the digital output data is created. At this time, the relevant information that was entered in the second Dau2 data section of the digital data that includes the Dau information is again entered into the second Dau2 data section, by the watermark method predetermined. In addition, during this process of reintroducing the information, the information of the method used that indicates the watermark method used in the first Daul data section of the digital data that includes the Dau information to define that the information is entered is inserted. by the default watermark method. In this case, the watermark method used is the predetermined watermark method. Then, the digital output data thus created is provided to the registration unit 114 through the Dbus data collector. (recording of the digital output data) When the digital output data is provided from the insert unit 113 through the Dbus data collector to the registration unit 114, the digital output data is stored on the DVD-RAM disc in the register unit 114. Since a file system is built into the DVD-RAM disk, the digital output data is given an arbitrary file name and recorded in the DVD-RAM disk. Although digital audio data is recorded with an arbitrary file name using the file system of the DVD-RAM disc, the way of recording is not restricted in it.

For example, digital audio data can simply be recorded from the recording device of the DVD-RAM media registration area. In addition, digital audio data can be written to a free area of the DVD-RAM disc that is detected at the time of recording the data on the disc. In addition, digital audio data can be written to an area of the DVD-RAM disc that is specified by the user of the device. While in this first mode the name of the file used when the digital audio data is recorded on the DVD-RAM is an arbitrary one, the user can specify the file name. In addition, a file name described in the attributed information that is followed or included in the digital data may be used. As described above, the data processing apparatus 110 according to this first embodiment is provided with the data acquisition unit 111 that obtains the digital data that includes the Dau information where the relevant information such as the rights information of literary property is introduced as a watermark, from the network signal Sn in the network N, and the control unit 115 that obtains the information of the method used that indicates the watermark method that has been used when entering information on literary or similar property rights. According to the information of the method used obtained, the information entered is extracted such as the information of - the literary property rights from the digital data that include the Dau information using an appropriate watermark method, and the information extracted such as the information of the copyright is again introduced in the digital data that includes the Dau information using a predetermined watermark method, whereby the digital output data to be registered in the means of registration. Therefore, without taking into account the watermark method by which the relevant information has been entered into the Dau digital data received, a reproduction apparatus such as a domestic electrical appliance can properly reproduce the digital data including the recorded Dau information. in the middle of registration, according to the information entered such as the information of the copyright. To be specific, since the information of the watermark method used is entered into the digital data that includes the information where the relevant information has been introduced by a watermark method, the data processing apparatus that obtains this digital data including the information, can distinguish the watermark method used to enter the relevant information into the digital data. Therefore, in the data processing apparatus, the extraction or removal of the entered information can be done without extracting the bad information using another method or without changing a portion instead of the information introduced using another method. As a result, in the final distribution from where the digital data such as the audio data is distributed to the user, the relevant information can be entered as a watermark in the digital data supply to be provided, using a desired watermark method . In other words, especially when the digital data is recorded in a recording medium to the end user, the final distribution of the digital data can select a watermark method that provides the least degradation due to the process of entering the information. In addition, the final distribution can select the optimal method according to communication speed or similar when transmitting digital data.

In addition, when the digital data that includes the information obtained from the network N is recorded in a writing record means, a watermark method that is different from the watermark method used to enter the information in the supply of the Digital data to the final distribution, can be used to enter the information in the digital data to be written in the recording medium. Accordingly, the information can be entered into the digital data by a watermark method adapted to an apparatus that reproduces the digital data.

Modality 2. Figure 4 is a block diagram for explaining a data processing apparatus 120 according to a second embodiment of the present invention. This data processing apparatus 120 obtains, from a signal of the network Sn in a network N, the digital audio data including the information (distributed audio data) Dau as input audio data, and the information of allocation of data. audio data (later also simply referred to as attributed information) that indicates the attribute of the distributed audio data Dau. At the reception of In this data, the data processing apparatus 120 inputs the information into the input audio data and reproduces the input audio data, according to the control information included in the allocated information. . The digital audio data that includes the Dau information is obtained, in the final distribution, by entering the information in the digital audio data to be provided from the final distribution to the user, (providing audio data) using various watermark methods . The attributed information of the audio data is transmitted from the final distribution along with the digital audio data that includes the Dau information. There are several transmission modes for the attributed information of the audio data, for example, the allocated information is placed in a predetermined position (fixed position) in the Dau audio data to be transmitted, or the allocated information is multiplexed in the data of Dau audio to be transmitted, or the information attributed is transmitted as a data file separate from the data of the Dau audio to be transmitted. Then, an electronic distribution system for the audio data, which includes the apparatus of data processing 120 of this second embodiment will be described in detail.

In the electronic distribution system, the digital audio data that includes the Dau information and the attributed information of the corresponding audio data is electronically distributed from the final distribution by the network signal Sn through the network N. The information attributed of the audio data has a data structure that includes at least the watermark method information used (information on the method used). The information of the method used indicates the watermark method that has been used to enter the relevant information in the audio data supply to the final distribution (used watermark method). It is unnecessary to say that the information attributed to the audio data may include other information in addition to the information of the method used. In addition, by employing a specific method for constructing watermarking methods, even when the plural portions of the information are entered into a designated piece of audio data using the corresponding watermarking methods, the plural parts of the the information does not affect each other. For example, when the information is entered into a high-frequency domain of the designated audio data using a watermark method while the information is entered into a low frequency domain of the designated audio data using another brand-name method. water, the two introduced parts of the information do not affect each other. (data structure of the watermark method information used) In this second embodiment, to comply with the case described above, the watermark method information used has a data structure that is capable of indicating the information of the watermark method used. state of the method of use that indicates whether or not, if each of the plural watermark methods has been used to enter the information in the supply of the audio data. Figure 5 is a diagram illustrating the data structure of the watermark method information used lum. This information of the used watermark method lum consists of plural parts of the information of the state of use of the method lum (1), lum (2), ..., Ium (n) corresponding to the methods of brand of plural water (n parts of the brand methods of water) that can be used in the process of entering information at the end of the distribution. To be specific, the use status information (1) of the Ium (l) method indicates whether a watermark method (1) has been used to enter the information in the delivery of the audio data. The value "1" of this Ium (l) information indicates that the watermark method (1) has been used for the process of entering information at the end of the distribution, while the value "0" indicates that the method watermark (1) has not been used for the process of entering information in the final distribution, as well as information (2) on the use status of the lum (2) method, ..., the information (n) of the state of use of the Ium (n) method indicate whether the watermarking methods' (2), ..., (n) have been used to enter information in the audio data supply, the value "1" of the information Ium (2), ..., Ium (n) indicates that the corresponding watermark methods (2), .... (n) have been used for the process of entering information in the final distribution while the value "O" of the information lum (2), ..., Ium (n) indicates that the corresponding watermark methods (2), ..., (n) have not been used for the process of introducing information in the final distribution. (data structure of the information entered) The information entered in the digital audio data that includes the information includes at least the reproduction permission information. This reproduction permission information indicates whether or not the reproduction of the digital audio data including the Dau information obtained as the input digital audio data is allowed or not. The value "1" of this information indicates that the reproduction of the Dau audio data is allowed while the value "0" of this information indicates that the reproduction of the Dau audio data is not allowed. (construction of the data processing apparatus) The data processing apparatus 120 of this second embodiment includes a data acquisition unit 121 which obtains, from the signal of the network Sn in the network N, the digital audio data including the information (distributed audio data) Dau as the input digital audio data, and the information attributed from the audio data is transmitted together with the distributed audio data Dau; and an extraction unit 122 that extracts the information entered from Dau digital audio data according to a control signal. The data acquisition unit 121 comprises a network interface 121a which exchanges the signal from the network to the signal Sn with the network N; and a received signal decoder 121b decoding the signal of the network Sn provided from the interface 121a to generate the digital audio data including the Dau information and the attributed information of the audio data. In addition, the extraction unit 122 comprises an extractor 121al of method (1), an extractor 121a2 of method (2), ..., an extractor 121an of method (n) corresponding to the corresponding watermark methods described above. (1), (2), ..., (n), respectively, and the information entered is extracted from the digital audio data including the Dau information by a desired extractor according to a control signal. For example, the extractor 121al of the method (1) extracts the information entered from the Dau digital audio data using the watermark method (1). The extractor 121a2 of the method (2) extracts the information entered from the Dau digital audio data using the watermark method (2). The 121an extractor of the method (n) extracts the information introduced from Dau digital audio data by the watermark method (n). In addition, the data processing apparatus 120 includes an insertion unit 124 that inserts the extracted information back into the digital data that includes the Dau information using a predetermined watermark method employed in reproduction apparatuses such as domestic electrical equipment for generate the digital output data, and the recording unit 125 that stores the digital output data. In addition, the data processing apparatus 120 includes a playback unit 123 that reproduces the digital audio data that includes the Dau information obtained in the data acquisition unit 121, according to a control signal; and a control unit 126 that controls the respective units 121-125 using the corresponding control signals. The playback unit 123 comprises an audio decoder 123a that converts the digital data that includes the Dau information to an audio signal, and a speaker 123b that converts the audio signal to sound. In addition, the control unit 126 comprises a CPU that performs various types of arithmetic processing and data processing, and a RAM (Random Access Memory) that stores the operating program of the CPU, whereby the operations of the respective units 121-125 are controlled. The RAM also serves as an execution memory for temporarily storing the audio data or information allocated from the audio data. To be specific, the control unit 126 decides the value of each information of the state of use of the method in accordance with the information of the watermark method that is included in the information attributed to the audio data obtained by the obtaining unit. of data 121, and controls the process of extracting the information entered by the extractor from the method that corresponds to each watermark method, according to the result of the decision. In addition, the control unit 126 controls the process of reproducing the Dau audio data by the playback unit 123, according to the reproduction permission information included in the extracted information. For example, when "1" the value of the reproduction permission information includes information on the state of use of the method constituting the information of the watermark method, the control unit 126 allows the reproduction unit 123 to reproduce the Dau audio data, and controls the playback unit 123 so that the Dau audio data is reproduced.

In addition, in the data processing apparatus • 120, the respective units are connected to each other in a Dbus data collector, and the control unit 126 controls not only the extraction unit 122 and the reproduction unit 123 but also the data acquisition unit 121, the insertion unit 124, and the recording unit 125. In addition, the extraction unit 122 and the insertion unit 124 are implemented by the LSIs model, respectively. The registration unit 125 is carried out by a DVD-RAM unit, where the digital output audio data is recorded on a DVD-RAM disc. Next, a description will be given of the operation of the data processing apparatus 120. (Dau audio data acquisition and the allocated information Dpr) When a signal from the network Sn provided from the network N through the network cable is received by the network interface 121a of the data acquisition unit 121, the signal of the received network Sn is generated to the received signal decoder 121b. The signal decoder 121b decodes the signal from the network Sn to generate the digital audio data including the Dau information and the information allocated of the Dpr audio data that follows the Dau audio data. The Dau audio data thus obtained is sent to the extraction unit 122 and the insertion unit 121 through the data bus Dbus, while the information allocated from the audio data Dpr is sent to the control unit 126 through the Dbus data collector. In the control unit 126, the allocated information of the audio data Dpr is temporarily stored in the RAM which serves as an execution memory. (extraction of the entered information) The control unit 126 controls the extraction unit 122 by a control signal, according to the information of the watermark method included in the information attributed to the audio data Dpr. That is, according to the value of each information of the state of use of the method introduced in the watermark method information, the control unit 126 generates a control signal to the extractor of the corresponding method. To be specific, in the control unit 126, initially, the value of the state of use information of the method (1) in the watermark method information is sent to. When the value of the information on the state of use of the method (1) is "1", the control unit 126 generates a control signal which instructs the extractor 122al of the method (1) in the extraction unit 122 to extract the information entered from the data of input audio Dau using the watermark method (1). Therefore, in the extractor 122al of the method (1), the information that has been introduced by the watermark method (1) is extracted from the Dau audio data by the watermark method (1). The information thus extracted is temporarily stored in the execution memory of the control unit 126 by means of the Dbus data collector. On the other hand, when the value of the data of the state of use of the method (1) is "0", the control unit 126 does not generate a control signal that instructs the extraction of the information entered from the audio data of Dau input, to extractor 122al of method (1). Then, in the control unit 126, the value of the state information of the method (2) used included in the watermark method information is sent to. When the value of the state of use data of the method (2) used is "1", the control unit 126 generates a control signal which instructs the extractor 122a2 of the method (2) in the extraction unit 122 to extract the information entered of the Dau input audio data by the watermark method (2). Therefore, in the extractor 122a2 of the method (2), the information that has been introduced by the watermark method (2) is extracted from the input audio data Dau by the watermark method (2). The information thus extracted is temporarily stored in the execution memory of the control unit 126 by means of the Dbus data collector. On the other hand, when the value of the information of the state of the method (2) is "0", the control unit 126 does not generate a control signal that instructs the extraction of the information entered from the Dau input audio data, to extractor 122a2 of method (2). In this way, in the control unit 126, the process of providing a control signal to the extractor of the corresponding method according to the value of the data of the state of use of the method is carried out for each of the plural parts of the information of the state of use of the method (information on the state of use of the method (1) - information on the state of use of the method (n)) that can be used in the final distribution, and consequently, each extractor of the method extracts the information entered from the Dau input audio data in response to the control signal of the control unit 126. Therefore, the plural parts of the information entered, (reproduction of Dau audio data) After this, the control unit 126 decides the values of the reproduction permission information included in all the information obtained by the information extraction process described above. According to the result of the decision, the control unit 126 generates a control signal that indicates whether the input Dau digital audio data has been reproduced or not, to the playback unit 123. To be specific, when the values of the reproduction permission information included in all the state of use information of the method constituting the information of the watermark method is "1", the control unit 126 allows the reproduction unit 123 to reproduce the Dau audio data. Then, under the control of the control unit 126, the Dau audio data is transmitted from the data acquisition unit 121 through the data bus Dbus to the playback unit 123. In the playback unit 123, the data received Dau audio are decoded by the audio decoder 123a to convert to an audio signal, and the sound corresponding to this audio signal is the speaker output 123b. (re-introduction of the information entered) In addition, in the data processing apparatus 120, regardless of the process of reproducing the Dau audio data obtained by the data acquisition unit 121, the information (information entered) extracted from the data Dau audio is again introduced into the Dau audio data by a predetermined watermark method. The default method of watermark is a method used in reproduction equipment such as domestic electrical equipment. As described above, in the control unit 126, the watermark method that has been used to enter the information in the audio data designated in the final distribution decides according to the value of each of the state data of use of the method included in the information of the watermark method used, and according to the result of the decision, the information introduced by the watermark method corresponding to the insertion unit 124. is provided. In the insertion unit 124, the information provided from the control unit 126 is again entered into the Dau audio data provided from the data acquisition unit 121, by the predetermined watermark method, whereby the output digital audio data is generated. (recording of the output digital audio data) The output digital audio data generated in the insertion unit 124 is provided to the registration unit 125 and recorded in a recording medium, according to a control signal of the control unit 126. The recording unit 125 is carried out by a DVD-RAM unit, and the digital output audio data is stored on a disc of the DVD-RAM. In this second embodiment, the control unit 126 allows the reproduction unit 123 to only reproduce the Dau audio data when the values of the reproduction permission information included in all the information of the state of use of the method that is "1" are "1". constitutes the information of the watermark method used. However, the low condition that the control unit 126 allows the playback unit 123 to reproduce the Dau audio data is not restricted therein.

For example, the reproduction of the Dau audio data may be allowed when the value of at least a part of the reproduction permission information included in the method usage status information is "1". Alternatively, the permission for the reproduction of Dau audio data can be decided as indicated below. That is, a weight factor is set for each information of the state of use of the method that constitutes the information of the watermark method used, and the product of this weight factor and the value of the information of the reproduction permit is obtained included in each information of the state of use of the method, and then the obtained products are added for all the information of the state of use of the method. Agree- if this sum exceeds a predetermined threshold or not, reproduction of the audio data that Dau is allowed. As described above, according to the second embodiment of the present invention, the data processing apparatus 120 is provided with the data acquisition unit 121 which receives a signal from the network Sn of the network N and obtains the data of digital audio that include the Dau information and the information attributed to the Dpr audio data. HE extracts the information entered, which has been entered into the Dau audio data by various watermark methods, from the Dau audio data according to the state of use information of the method included as the watermark method information used in the information attributed to the Dpr audio data, and the reproduction of the Dau audio data is controlled according to each extracted information. Thus, in the data processing apparatus 120 that receives the Dau audio data, the reproduction of the Dau audio data can be correctly controlled according to the information entered that has been inserted in. Dau audio data by various watermark methods in the final distribution. In addition, since the extracted information is again entered into the Dau audio data by a predetermined watermark method and then recorded in the recording medium, even when the information has been included using various watermark methods in the final distribution of the Dau audio data, the information entered in the Dau audio data corresponding to the respective watermark methods can be converted to the information corresponding to the predetermined watermark method. Therefore, as in the first modality of the invention, even in a reproduction apparatus such as a home computer employing the predetermined watermark method, the digital audio data which include the information provided from the network can be reproduced satisfactorily according to the information entered which has been inserted by the different methods of watermarking. While in this second embodiment, the reproduction unit 123 reproduces the obtained digital audio data including the information (distributed audio data) Dau, the reproduction unit 123 can reproduce the data that is obtained by inserting the information introduced in Distributed audio data Dau. In this second embodiment, the digital data that includes the information can be obtained by entering the plural portions of pertinent information in the digital data supply using a plurality of watermark methods, and the insertion unit can enter a predetermined number of information relevant between the plural parts of relevant information, in the digital input data, using the corresponding watermark methods between the plural watermark methods or using a watermark method that is different from these watermark methods, whereby the digital output data is generated.

Mode 3. Figure 6 is a block diagram for explaining a data processing apparatus 130 according to a third embodiment of the present invention. The data processing apparatus 130 obtains the audio data that includes the information (distributed audio data) Dau that has been obtained by entering the information in the digital audio data to be provided from the final distribution to the user (audio data supply) ) using various watermark methods, from a signal from the network Sn in a network N or the different types of data recording means. Then, the apparatus 130 decides whether or not the information is entered into the Dau distributed audio data by a predetermined watermark method and, according to the result of this decision, it enters the information back into the Dau distributed audio data. . The default method of watermark is a versatile method used for reproduction apparatuses that are domestic electrical equipment. In addition, in the data processing apparatus 130, when the information entered in the audio data obtained Dau has been introduced by the watermark default method, this Dau audio data is recorded in a record medium like this. On the other hand, when the information entered in the audio data obtained Dau has been inserted by a watermark method instead of the predetermined watermark method, the information entered is extracted from the Dau audio data using the method of corresponding watermark. Then, the extracted information is again entered into the Dau audio data using the predetermined watermark method, and the resulting audio data is recorded in the recording medium. Next, a description will be given of an audio data delivery system that includes data processing apparatus 130 of this third embodiment. In the delivery system, there are two cases where the audio data has been provided by the electronic distribution from the N network and where they are provided by distribution from the data recording medium, (data structure of the audio data) In this third modality, the audio data to be provided has a data structure that does not include any information that relates to a method of watermark. Accordingly, the data processing apparatus 130 distinguishes the watermark method that has been used to enter the information in the audio data provided, according to the route through which the data is obtained. audio data To be specific, for digital data such as the aforementioned audio data, a watermark method is decided in advance according to its mode of supply, and so that the watermark method that has been used to enter the information into this data can be specified by specifying the route that obtains the data. For example, when audio data is provided through a network, a watermark method according to a protocol used for communication is employed. In addition, when the audio data is provided from a recording medium, a watermark method is employed according to the type of the recording medium. Accordingly, the audio data delivery system of this third mode does not require the following methods: the method of entering the information indicating the watermark method that corresponds to the digital audio data that includes the information to be distributed electronically (information from the watermark method used) of according to the first modality; and the method of entering the information of the watermark method in the information attributed to audio data that follows the digital audio data to be electronically distributed according to the second modality. (construction of the data processing apparatus). The data processing apparatus 130 of this third embodiment includes a data acquisition unit 131 and an extraction unit 132. The data acquisition unit 131 obtains, like the distributed audio data, the digital audio data that includes the information from the signal of the network Sn in the network N, and the digital audio data that includes the information from the data recording medium. The extraction unit 132 extracts the information entered from the distributed audio data according to a control signal. The data acquisition unit 131 comprises a network interface 131a which exchanges the signal of the network Sn with the network N; a received signal decoder 131b de-coding the signal from the network Sn of the interface 131a to generate the digital audio data including the information (distributed audio data); a DVD-ROM unit 131c that reads the digital audio data that includes the information from a DVD-ROM disc; and a semiconductor memory access unit 131d that reads the digital audio data that includes the information from a semiconductor recording medium. In addition, the extraction unit 132 comprises extractor 132a of the method (A), an extractor 132b of the method (B), and an extractor 132c of the method (C) corresponding to the watermarking methods (A), (B) , and (C), respectively. In the extraction unit 132, the information entered in the digital audio data including the information is extracted by a desired extractor according to a control signal. For example, the extractor 132a of the method (A) extracts the information entered. from the digital audio data that includes the information using the watermark method (A). The extractor 132b of the method (B) extracts the information entered from the digital audio data that includes the information using the watermark method (B). The extractor 132c of the method (C) extracts the information entered from the digital audio data that includes the information using the watermark method (C). In addition, the data processing apparatus 130 includes an insertion unit 133 that inserts the extracted information again by the unit of data. extraction 132 in the digital audio data including the information using a predetermined watermark method employed in reproduction apparatuses such as domestic electrical equipment to generate the output audio data; and a register unit 134 that stores the output audio data. The insert unit 133 includes the insert unit 133a of the method (A) that inserts the extracted information into the digital audio data that includes the information using the watermark method (A). In addition, the data processing apparatus 130 includes a control unit 135 which controls the respective units 131-134 by the corresponding control signals. In this data processing apparatus 130, the respective units 131-135 are connected to each other via a Dbus data collector. The extraction unit 132 and the insertion unit 133 are implemented by the LSI model, respectively. The registration unit 134 is provided with a DVD-RAM unit, where the digital audio output data is recorded on a DVD-RAM disc. The control unit 135 comprises a CPU that performs various types of arithmetic processes and data processing, and a RAM (Access Memory) Random) that contains the operating program for the CPU. The control unit 135 controls the operations of the respective units 131-134. The RAM also serves as an execution memory that temporarily stores the audio data output from the respective units, and the information of the watermark method used. In addition, the control unit 135 has a table 135a where the routes that obtain the data are correlated with the watermark methods. This table 135a is stored in a non-volatile memory in the control unit 135. The control unit 135 further includes a means of information decision of the method that decides the information indicating the watermark method that has been used when introducing the information in the audio data obtained (information from the watermark method used) in accordance with the information indicating the route through which the audio data has been obtained (route information); and a re-insertion decision means that decides whether the extracted information will be re-entered into the audio data obtained or not, according to the watermark method information used. The watermark method used for digital audio data obtained from the network signal Sn in the network N it depends on the information that relates to a server connected to the network N through which audio data is obtained (URL: Uniform Resource Locator), a communication protocol used when audio data. they are obtained, and similar. In addition, the watermark method for the digital audio data stored in the data recording medium depends on the type of data recording means. Therefore, if the data collection path is found, the control unit 135 can decide a watermark method that corresponds to the audio data by referring to the table 135a. In this third embodiment, the data acquisition unit 131 decides the path for obtaining the audio data, and the information indicating the path for obtaining the audio data from the data acquisition unit 131 to the unit is provided. In addition, in this third embodiment, the watermark method B corresponds to the audio data obtained from the signal of the network Sn in the network N, the method of watermark A corresponds to the audio data obtained from the DVD-ROM, and the watermark method C corresponds to the audio data obtained from the semiconductor recording medium. In addition, the default method of watermark that is used in reproduction apparatuses or similar to a domestic electrical equipment, is the method of watermark A. While in this third mode a DVD-ROM disk and a semiconductor memory are used as data recording media, other means as a disk DVD-RAM and a CD-ROM disc can be used. Since a predetermined watermark method is used for each of these three recording means, the digital data receiver stored in each of these recording means can distinguish the corresponding method of watermark according to the route of obtaining data. Subsequently, the operation of the data processing apparatus 130 will be described. (acquisition of digital audio data) In the data processing apparatus 130 of this third embodiment, the digital audio data is obtained from the signal of the network Sn in the network N, or from the recording medium. For example, the signal of the network Sn in the network N is transmitted through the cable of the network and is received by the network interface 131a of the data acquisition unit 131. The signal of the received network Sn is decoded by the received signal decoder 131b by which the digital audio data including the information is generated (data from distributed audio) Dau. On the other hand, the digital audio data recorded in the DVD-ROM disc is read by the DVD-ROM unit 131c in the data acquisition unit 131. In addition, the digital audio data recorded in the semiconductor memory are read by the semiconductor memory access unit 131d in the data acquisition unit 131. The distributed audio data obtained in the data acquisition unit 131 is provided to the extraction unit 132 and to the insertion unit 133. In addition, these Digital audio data is provided to the control unit 135, together with the route information indicating the route through which they are obtained. In the control unit 135, the digital audio data is stored in the execution memory. (acquisition of the watermark method information used) In the control unit 135, it is decided which of the plural watermark methods in the table 135a has been used to enter the information in the digital audio data provided from the data acquisition unit 135, based on the route information, by referring to the mapping of the data collection routes and the watermark methods in Table 135a. The result of this decision is temporarily stored in the execution memory of the control unit 135. (extraction of information entered) In the extraction unit 132, the information entered is extracted from the digital audio data obtained in the data acquisition unit 131, by a watermark method according to a control signal from the control unit 135. For example, when it is decided that The digital audio data obtained corresponds to the watermark method A, the extraction unit 132 is controlled so that the extraction of the information entered from the digital audio data is carried out by the watermark method A. To be specific , the extraction of the entered information is done by the extractor 132 of the method A under the control of the control signal of the control unit 135. Furthermore, when it is decided in the control unit 135 that the digital audio data obtained correspond to the watermark method B, in the extraction unit 132, the extraction of the information entered is done by the extractor 132b of method B. When it is decided that the data digital audio obtained correspond to the watermark method C, the extraction of the information entered is done by the extractor 132c of method C. (decision on the re-introduction of the information entered) When the digital audio data obtained in the data acquisition unit 131 correspond to the watermark method A , the control unit 135 decides that it is not necessary to enter the information inserted in this digital audio data back into this digital audio data using another watermark method. The reason is as follows. The information inserted in this digital audio data can be extracted by a reproduction apparatus using the predetermined watermark method (in this case, method A), for example, a reproduction apparatus that exists to run a DVD disc -RAM. On the other hand, when the digital audio data obtained in the data acquisition unit 131 corresponds to the watermark method B, the control unit 135 decides that it is necessary to enter the information entered back into the digital audio data by the watermark method A. (the re-introduction of the information entered) When the digital audio data corresponds to the watermark method A and the control unit 135 decides that reintroduction of the information into the digital audio data is not necessary, no control signal is provided from the control unit 135 to the insertion unit 133, and the digital audio data stored in the execution memory of the control unit 135 are provided to the recording unit 134. On the other hand, when the digital audio data corresponds to the watermark method B and the control unit 135 decide that reintroduction of the information in the digital audio data is necessary, in the insertion unit 133, the information entered in the digital audio data including the information (distributed audio data) is again introduced into the audio data distributed by the watermark method A according to a control signal from the control unit 135. (record of the digital audio data) The digital audio data which is determined in the control unit 135 to correspond to the watermark method A are recorded in the recording unit 134 without undergoing the reintroduction process in the insertion unit 133. By On the other hand, data from digital audio which are decided on the control unit 135 to correspond to a watermark method instead of the method A are subjected to the reintroduction process in the insertion unit 133 and then stored in the recording unit 134.. As described above, according to the third embodiment of the invention, the data processing apparatus 130 includes, in addition to the constituents of the apparatus 110 of the first embodiment, the control unit 135 having the means for receiving the data of digital audio where the information is introduced by a watermark method, and deciding which of the watermark methods has been used for this digital audio data, according to the information that indicates the route through which the audio data is obtained. Accordingly, it is not necessary to provide the audio data to be transmitted from the final distribution to the network N with the corresponding information of the watermark method. In addition, it is not necessary to provide the audio data to be stored in the recording medium with the corresponding watermark method information. In addition, when the distributed audio data corresponds to a predetermined watermark method used in reproduction equipment or similar as a • domestic electrical equipment, this audio data is recorded when it is in the recording medium. On the other hand, when the distributed audio data corresponds to a watermark method other than the predetermined method, the information entered in the distributed audio data is again introduced into this audio data by the predetermined watermark method , and the data thus obtained are recorded in the recording medium. Accordingly, digital audio data for which the reintroduction process is not required to prevent it from being held back to the process that writes the information, thus minimizing the process for digital audio data that causes the degradation of sound quality .

Modality 4. Figure 7 is a block diagram for explaining a data processing apparatus 140 according to a fourth embodiment of the present invention. The data processing apparatus 140 reads the multiplexed digital data obtained by the multiplexed digital video data and the digital audio data, from a data recording medium, and the entered information extracted from the audio data. digital using a watermark method. Then, the apparatus 140 displays the information extracted as an image, and enters the extracted information back into the digital audio data. In this fourth modality, the data of. Digital audio inputs into the multiplexed digital data are obtained data that introduce the relevant information into the supplied audio data provided from the final distribution to the user using a watermark method (distributed audio data). In addition, the extraction of the information entered is carried out using an appropriate watermark method, and the re-introduction process carried out uses a predetermined watermark method that is employed in reproduction apparatuses or the like as a domestic electrical equipment. . The appropriate watermark method is identical to the watermark method used to enter the relevant information in the audio data provided. In addition, the multiplexed digital data corresponds to a program or a movie, and this is called an object video. In the following description of the fourth embodiment, the digital video data and the data of Digital audio are referred to video data and audio data, respectively. (data structure of the object video) Figure 8 shows the data structure of the object video. In this fourth modality, the object video corresponds to a stream of programs in MPEG-2 (Group of Experts of Films of Phase 2), and is composed of plural object video units (VOBU). Furthermore, in a portion of the multiplexed digital data corresponding to a VOBU, the video data and the audio data are multiplexed by a time division multiplexer. The digital data that corresponds to a VOBU has a quantity of data equivalent to a playback time required by approximately 15 frames (= 0.5 sec). In this fourth embodiment, the time division unit for the data in a VOBU is 2048 bits, and a portion comprising 2048 bits of data is called a packet. In addition, a packet comprising video data is called a video packet while a packet comprising audio data is called an audio packet.

For example, the Vob object video is composed of the first V0BU (# 1) Vobl ~ the n-th VOBU (#n) Vobn, and the first V0BU (# 1) Vobl is composed of the first video packet (#l) Pvl ~ the k-th video package (#k) Pvk, and the first audio package (#l) Pal ~ the audio package of th (#m) Pam. Figure 9 shows the data structure of an audio package. An audio packet Pa is composed of a packet loader Pah and an audio data section pad. An audio stream, which is a sequence code that constitutes the audio data, stored in the audio data section Pad, and the information is input into the audio stream by an appropriate watermark method. On the other hand, the various types of information required to reproduce the audio data in the Pah packet loader are stored. To be specific, the packet loader Pah contains a type of packet flag Fpk, playtime information Irt, information Iss of substream ID, and which uses the lum information of the watermark method. The Fpk package type flag is information to identify the corresponding package type. The Playtime information Irt indicates the time required to play the data stored in the corresponding package, and a relative time based on the playing time for the data in the recording device of the video object used as the playing time. In addition, in the object video as multiplexed digital data can be multiplexed from plural types of audio streams, information is required to identify each audio stream. For that, the packet loader Pah containing the undercurrent information ID Iss to identify each of the plural types of audio streams introduced in the object video. For example, the undercurrent ID of information Iss indicates a group of serial number for each audio stream. In addition, the lum information of the watermark method used indicates a watermarking method for the information entered in the audio streams stored in the audio data section Pad of the audio pack Pad. Figure 10 shows the values stored in the packet loader Pah as the use of the lum method information of the watermark.

In Figure 10, the use of the lum information of the watermark method is represented by the 2-bit values (value of the 1st bit and 'value of the 2nd bit). The value "00" of this lum information of the method indicates that the watermark method A has been used to enter the information in the audio data. Likewise, the values "01", "10" and "11" of the lum method information indicate that the methods marked with water B, C, and D have been used to enter the information in the audio data. In the structure of the data of the object video according to the fourth modality, the information. of the watermark method used that corresponds to the audio data supplied are stored in the audio packages that constitute the object video. However, watermark method information can be stored in video packages or other types of packages. In addition, although the information of the watermark method used corresponds to the supplied audio data stored in the packet loader Pah of each audio pack Pad, the storage location use of the watermark method information does not It is restricted in it.

For example, the information-of the watermark method used in some audio packets between the audio packets constituting the object video can be stored. In addition, the can be stored. information of the watermark method used in a recording area of a DVD-ROM disc, separately from the subject video. In addition, the watermark method information used in the audio streams stored in the audio data section can be entered by an appropriate method. In this fourth embodiment, the Pa audio pack contains, in its packet loader Pah, the packet type flag Fpk, the reproduction, of the Irt information time, the Iss information of the ID substream, and the information of the watermark used lum. However, other types of information that can be stored in the packet loader Pah as the aforementioned Fpk, Irt, Iss and lum of the audio pack Pa. (Construction of the apparatus that processes the data 140) The apparatus that processes the data 140 it includes a unit that obtains data 141 that has a DVD-ROM to read the video object of a DVD-ROM disc, and obtains the object video according to a signal of control; and a separation unit 142 that is constituted by an LSI design, and separates the video data and the audio data of the obtained object video, according to a control signal. In addition, the data processing apparatus 140 includes an extraction unit 143 which is constituted by an LSI design, and which extracts the information entered from the lum information of the used watermark method that is stored in the Pah Packet Loader of each audio pack Pa of the separated audio data, according to a control signal, and an insert unit 146 which consists of an LSI design, and fixes the extracted information back into the separate audio data using a branding method of predetermined water, according to a control signal, thereby generating the output audio data. Extraction unit 143 comprises an extraction method A 143a, an extraction method B 143b, an extraction method C 143c, and an extraction method D 143d corresponding to the aforementioned watermarking methods (A), ( B), (C), and (D), respectively. In the extraction unit 143, the information entered in the input audio data It is extracted by a desired extraction, according to a control signal. For example, the extraction method A 143a extracts the input information from the input audio data (distributed audio data) by the watermark method A. The B extraction method 143b extracts the information entered from the audio data. of input by the watermark method B. The extraction method C 143c extracts the information entered from the input audio data by the watermark method C. The extraction method D 143d extracts the information entered from the data input audio by the watermark method D. The data processor apparatus 140 further includes a video playback unit 144 which performs the image display of the separate video data, and displays the image of the information as the copyright information extracted from the audio data, according to a control signal; and an audio reproduction unit 145 that reproduces the output audio data. The video playback unit 144 comprises a video decoder 144a which converts the video data to an analog video signal by signals processed as decoded, and decodes the information as the information of the copyright provided from extraction unit 143; and a television receiver 144b that performs the display of the analog video input signal image, and displays the image of the decoded information. Further, -. unit. Audio reproduction 145 comprises an audio decoder 145a which decodes the audio data at the output of an audio signal, and a speaker 145b which converts the audio signals into an output sound. The data processor apparatus 140 further includes a register unit 147 that stores the output audio data of the insert unit 146 according to a control signal; and a control unit 148 which comprises a CPU that performs various types of arithmetic processes and data processes and a RAM (Random Access Memory) for storing the operation program of the CPU. The control unit 148 controls the operations of the respective units 141-147 using the control signals. The RAM of this control unit 148 also serves as an execution memory by temporarily storing the data of the separation unit 142, the information of the extraction unit 143, and the data of the insertion unit 146.

While in this fourth embodiment the audio reproduction unit 145 reproduces the input audio data obtained (distributed audio data), the audio reproduction unit 145 can reproduce the output audio data that is obtained by entering the information entered from New in the audio input data using a predetermined watermark method. In addition, in this fourth embodiment, the data processor apparatus 140 includes the data acquisition unit 141 that has a DVD-ROM drive. However, the unit that obtains data 141 can have any storage unit, such as a DVD-RAM unit, a CD-ROM drive, or a unit that reads the memory of the semiconductor, as long as it is a storage unit. of volume capable of handling multimedia data. Furthermore, in this fourth embodiment, the data processing apparatus 140 includes, as units for reproducing the obtained video object, both the video playback unit 144 for reproducing the video data and the audio reproduction unit 145 for reproducing the data. of audio However, the signal processing apparatus 140 may include one of the video playback unit 144 and the audio reproduction 145. In addition, apparatus 140 may include, in addition to these units 144 and 145, a unit for reproducing data as subtitles. Furthermore, in this fourth embodiment, the separation unit 142, the extraction unit .43, and the insertion unit 144 are constituted by the design circuits LSI, respectively. However, these units 142-144 can be constituted by a CPU which performs various types of arithmetic processing and a RAM for storing the operation program of the CPU and also serves as an execution memory. In this case, these units 142-144 may share the components with the control unit 148. The operation of the signal processing apparatus 140 will be described later. In the following description, for simplification, it is assumed that the object video it is continuously recorded in the DVD-ROM drive, starting from the recorder device in the disk data recording area. (reading of the video .object) In the unit that obtains data 141, the multiplexed digital data is read consecutively as the video objects, in the package units, of the recorder device of the disc reading area of • DVD-ROM, according to the control signals of the control unit 148, and the read data is transmitted consecutively to the separation unit 142 in the package units. . (separation of the object video) In the separation unit 142, the packet type flags Fpk that are stored in the main packets of the respective packets are read. (packages of videos and audio packages). Then, the video packets and the audio packets are identified according to the flags of packet type Fpk, and these packets are separated from the object video. After this, under the control of the control units 148, the determined packets are sent as video packets in the video playback unit 144 and the control units 148, while the packets determined as audio packets sent to the unit extraction 143, the insertion unit 146, the audio reproduction unit 145, and the control unit 148. (extraction of the entered information) In the control unit 148, the Irm information of the used watermark method stored in the Pahloader Pah of the audio pack Pa (referred to in Figure 9) is stored. Then, the value of the Irm information of the watermark method used is decided, and a control signal according to the value of the method information generated in the extraction unit 143. In the extraction unit 143, according to the control signal, the information entered is extracted from the audio stream stored in the Pad audio data section of the Pa audio pack, by an extraction method according to an appropriate watermark method. The information entered includes information corresponding to a sequence of unfolded nature of the copyrights of the owner's copyright. For example, when the value of the lum information of the watermark method used is "00", the extraction method A 143a extracts the information entered using the watermark method A, according to the control signal. Likewise, when the value of the lum information of the watermark method used is "01", "10", or "11", the method B of extraction 143b, extraction method C 143c, or extraction method D 143d extract the information entered using the watermark method B, C, or D, according to the control signal, respectively, (reproduction of the video data) When the separate video packets in the separation unit 142 are provided in the video playback unit 144, the video decoder 144a performs the decoding of the MPEG2 system in the video data stored in each video packet, which the data has been entered into the coding of the MPEG2 system, according to the control signal of the control unit 148. When a video signal obtained by the decoding process in the video decoder 144a enters the TV receiver 144b, 'the video signal is played and displayed. (display of copyright information) When information from the displayed character sequence of the copyright (information entered) is provided from the extraction unit 143 to the video reproduction unit 144, this information becomes in a signal displayed by the decoder 144a to be output to the TV receiver 144b. In the TV receiver 144b, the Information of the unfolding character sequence of the copyright is displayed so that it is placed on the displayed image corresponding to the video signal. Although the information - from the displayed character sequence of the copyright as information of the copyright on the displayed image of the video signal - is placed, it may be displayed by another means of display than the TV receiver. The display of the image of the copyright information is not necessarily done. (reproduction of the audio data) When the Pa audio packet separated from the subject video by the separation unit 142 is provided in the audio reproduction unit 145, the audio decoder 145a performs the decoding of LPCM in the audio streams. audio stored in the Pad audio data section of the Pa audio packet (ie, the audio data that has been submitted to the LPCM encoding), thus generating an audio signal. This output audio signal becomes sound in the speaker 145b. In signal processing apparatus 140, while performing the described reproduction previously of the video data and the audio data, the re-entry of information entered into the distributed audio data and the recording of the output audio data obtained by the reintroduction process is carried out in a manner. similar as described for the first to third modes, (decision on the re-entry of information) When the audio data in the Pa audio packet provided from the separation unit 142 correspond to the watermark method A, the control unit 148 decides that it is not necessary to enter the information introduced in this digital audio data back into this digital audio data using another watermark method. The reason is as follows. The information introduced in this audio data can be extracted by a reproduction apparatus which employs the predetermined watermark method (in this case, method A), for example, an existing reproduction apparatus for a disc of DVD-RAM. On the other hand, when the audio data in the Pa Audio Package provided from the separation unit 142 corresponds to the watermark method B, the control unit 148 decides that it is necessary to enter the information entered again in the digital audio data using the watermark method A. (re-entry of information entered) When the audio data corresponds to the watermark method A and for the control unit 148 they decide that the re-entry of information into the digital audio data is not necessary, no control signal it is provided from the control unit 148 to the insertion unit 146, and the audio data stored in the execution memory of the control unit 148 provided in the registration unit 147. On the other hand, when the audio data corresponds to the watermark method B and for the control unit 148 to decide that the re-entry of information into the digital audio data is necessary, in the insertion unit 146, the information entered is again entered into the data of audio by the watermark method A, according to the control signal of the control unit 148. (recording of digital audio data) The audio data that is decided on the control unit 14 8 as they correspond to the watermark method A are registered in the registration unit 147 without undergoing the re-introduction process in the unit of insertion 146. On the other hand, the audio data which is decided on the control unit 148 as corresponding to a watermark method other than method A is subject to the process of re-insertion in the insertion unit 146 and , subsequently, stored in the registration unit 147. As described above, the data processing apparatus 140 of this fourth embodiment includes the unit that obtains data 141 that has the DVD-ROM unit, instead of the unit that obtains data. 111 of the apparatus 110 according to the first embodiment, and further, the apparatus 140 includes the separation unit 142 for the separation video packets and the audio packets of the video object read from the DVD-ROM disc, and the video playback 144 for reproducing the video data "The information entered from the data section of each audio packet in the video playback unit 144 is displayed according to the information of the method. used watermark stored in the packet loader of the audio package in this construction, whereby the copyright information can be confirmed with an image. Also, when the digital audio data corresponds to a predetermined watermark method which is used in reproduction equipment or the like as a domestic electrical equipment, this digital audio data is recorded in the recording medium. On the other hand, when the digital audio data corresponds to a watermark method different from the predetermined method, the information entered in this audio data is again introduced into this audio data using the predetermined watermark method, and thus the data obtained is recorded in the recording medium. Therefore, digital audio data so that the re-entry process is not required is prevented from being re-entered into the process that writes the information, therefore minimizing processing for the audio data, which causes the degradation of the sound quality. In this fourth embodiment, the object video registers from the recording device of the recording area of the DVD-ROM disc. However, when auxiliary information is recorded as address information in the recording device of the recording area of the DVD-ROM disc, the object video may be registered after the auxiliary information. In addition, while in this fourth mode the object video is continuously recorded in the area of DVD-ROM disc registration, the registration form of the video object on the DVD-ROM disc is not restricted in it. For example, when the address information includes the TOC information (Table of Contents) indicating the initial registration position of the video object on the DVD-ROM disc and the record size, the object video may be recorded dispersibly in positions arbitrary in the registration area of the DVD-ROM disc. Furthermore, in this fourth embodiment, the object video is read sequentially, starting from the recording device of the recording area of the DVD-ROM disc. However, when the address information includes sketched information indicating the order "of access to the respective record areas on the disk, the object videos that are dispersibly stored in the plural record areas on the disk can be read by accessing the areas of registration in an arbitrary order, especially when the data processing apparatus 140 is provided with a function of accepting a signal under the control of the user, the order of access in the respective recording areas can be changed according to this signal when reading the videos object.

Furthermore, while in this fourth embodiment the separate audio packets of the object video in the separation unit are provided directly to the audio reproduction unit, these audio packets can be transmitted through the extraction unit to the audio unit. audio playback unit. While in this fourth mode only the audio data contains the information entered, the video data may contain. the information entered. In this case, the data processing apparatus 140 is provided with a video extraction unit for extracting the information entered from the video data, and the separate video packages of the object video is provided in the video playback unit through the video data unit. this video extraction unit. Furthermore, while in this fourth modality the information introduced in the audio data includes the information indicating the character sequence displaying the copyright for the owner of the copyright, the information entered may include, in addition to the information of the copyright, information indicating the names of the persons authorized to reproduce the audio data by the owner of the copyright, the dates of authorizations, etc. Especially when the video object can be copied, the information entered in the audio data may include copy generation information or the like.

Modality 5. Figure 11 is a block diagram for explaining a data processing apparatus 150 according to a fifth embodiment of the present invention. The data processing apparatus 150 performs the following processing: an extraction process to obtain, from a data recording medium, digital audio data (distributed audio data) which has been obtained by information entered into the digital audio data provided from the final distribution 'to the user (supply) using a watermark method, together with the information indicating the watermark method used for the process that enters the information, and then extracting the information entered from the data audio input; a deletion process to eliminate the information entered from the input audio data that obtains processed audio data; a reproduction process to reproduce the processed audio data; and a re-introduction process for enter again the information extracted into the audio information processed using a predetermined watermark method. The data processor apparatus 150 is adaptable to plural watermark methods - because it is a case where plural watermark methods are used for an audio data. To be specific, by using a specific method to construct watermarking methods, even when the plural parts of information are entered into an audio data using the corresponding watermarking method, the plural parts of information introduced do not affect each other. For example, when the information is entered into the high frequency components of the audio data using a watermark method that while the information is entered into the low frequency components of the audio data using another watermark method , the information introduced in the high frequency components and the information introduced in the low frequency components do not affect each other. The data processing apparatus 150 of this fifth embodiment is adaptable in such a case. In this fifth modality, the watermark method used to enter information into the data of audio supplied in one of the four methods of watermarking A, B, C, and D. In addition, the extraction of information entered using an appropriate watermarking method which is employed in reproduction apparatus or the like . as a domestic electrical equipment. In addition, the appropriate watermark method described above is identical to the watermark method used to enter information into the distributed audio data. (data structure of the distributed audio data) Figure 12 shows the data structure of the distributed audio data recorded in the data recording medium. Distributed audio data Dde comprises the Ito information of the TOC (Table of Contents) that indicates the music contents, and various Dal-Dan discrete audio data types that have been encoded by the LPCM (Modulation of Linear Pulse Code ) The Ito Ito information that is recorded in the recording device of the recording area of the data recording medium, and includes the plural portions of information used when the Dal-Dan audio data recorded in the recording medium is reproduced. They specify, the plural parts of information used to reproduce the audio data as follows: the information Isp in the position of the recording device is recorded in the audio data, the information Iep in the final position is recorded in the audio data, the Ina information of the music title , the information Iqu of the quantization number, the information Isa of the test speed, the Ich information of the number of channels, and the lum information of the watermark method. In the recording area of the data recording medium, the TOC Ito information that is followed by the Dal-Dan audio data that has been encoded by the LPCM. While the audio data of the encoding method is used in this fifth LPCM mode, other encoding methods may be used, such as AC3, MPEG-audio, and DTS (Digital Theater System). The AC3 is a method of compressive audio coding to process the audio of the movie (5. Ich, 2ch, etc.), and this method is used in the DVD-VIDEO and the like. Likewise, DTS is a method of compressive audio coding to process the audio of the film (5. Ich, 2ch, etc.), and this method is used in cinemas and DVD-VIDEO.

Figure 13 shows the data structure of the lum information of the watermark method used. In this fifth mode, from the watermark method used to enter information into the supplied audio data is any of the four methods mentioned above (method A, method B, method C, and method D), the information lum of the method The watermark used is composed of four parts of Ius status information used that correspond to the respective watermark method, that is, method A uses lusa status information, method B uses IuSb status information, method C uses Iusc status information, and method D uses Iusd state information. For each state information used, "0" or "1" is fixed. For example, when the value of the status information used is fixed at "1", this means that a watermark method corresponding to this used status information has been used to enter information into the supplied audio data. On the other hand, when the value of the use of status information is fixed at "0", this means that a corresponding watermark method This used status information has not been used to enter information in the audio data supplied. The data recording medium can not only contain the TOC information and the audio data but also other information. In addition, the TOC information can not only include audio data playback information but also other information, like the information that indicates the order of reproduction of the audio data. In addition, the audio data reproduction information may include composer information, copyright information and the like, in addition to the Isp information in the initial position recorded in the audio data, the Iep information in the final position recorded in the audio data. the audio data ', the Ina information of the music title, the Iqu information of the quantization number, the information Isa of the test speed, the Ich information of the number of channels, and the lum information of the watermark method used . While in this fifth mode the audio data that has been encoded is recorded in the data recording medium, the audio data is recorded in the recording medium and can be multiplexed with other data by a multiplexing method based on MPEG2 or similar.

Furthermore, while in this fifth mode the TOC information is recorded in the recording device of the recording area of the data recording medium, the TOC information can be recorded in an arbitrary position in the data recording medium provided that the media read the data (in this case, the unit that obtains the data) can recognize the storage position of the TOC information in the data recording medium. (construction of the data processing apparatus) The data processing apparatus 150 includes a data obtaining unit 151 having a DVD-ROM drive to read the information or data recorded on a DVD-ROM disc, and obtains the Ito information. of TOC and the plural parts of the Dal-Dan audio data of the DVD-ROM disc according to a control signal; and a storage unit 152 having a TOC information storage region 152a where the TOC Ito information that can be obtained by the data obtaining unit 151 is stored, and stores the TOC Ito information in this storage region 152a according to a control signal. The storage unit 152 is provided with a DRAM (Dynamic Random Access Memory).

In addition, the data processor apparatus 150 includes an extraction unit 153 which is constituted by an LSI design and the input information extracted from the audio data, with reference to the use of the lum information of the watermark method introduced in the information. Ito of TOC obtained, according to a control signal; an elimination unit 154 which is constituted by an LSI design and removes the information entered from the distributed audio data, with reference to the use of the TOC lum information of the watermark method introduced in the obtained TOC Ito information, according to a control signal, thus generating the processed audio data; and an insertion unit 155 which is constituted by an LSI design and introduces the extracted information back into the processed audio data using a predetermined watermark method, according to a control signal, thereby generating the data audio output. The extraction unit 153 comprises a method A extraction 153a, extraction method B 153b, extraction method C 153c, and extraction method D 153d corresponding to the aforementioned watermarking methods A, B, C, and D, respectively. In the extraction unit 153, the information entered into the distributed audio data extracted by a desired extractor, according to a control signal. For example, the extraction method A 153a extracts the information entered from the distributed audio data (input audio data) by the watermark method A. The extraction method B extracts the information entered from the audio data. of input by the watermark method B. The extraction method C 153c extracts the information entered from the input audio data by the watermark method C. The extraction method D 153d extracts the information entered from the data input audio by the watermark method D. In addition, the elimination unit 154 comprises an elimination method A 154a, an elimination method B 154b, an elimination method C 154c, and an elimination method D 154d which corresponds to the watermark methods mentioned above A, B, C, and D, respectively. In the elimination unit 154, the information entered in the audio data are distributed and eliminated by a desired eliminator according to a control signal. For example, elimination method A 154a removes the information entered from the audio data distributed (input audio data) by the watermark method A. The elimination method B 154b removes the input information from the input audio data by the watermark method B. The elimination method C 154c eliminates the input information of the input audio data by the watermark method C. The deletion method D 154d removes the input information of the input audio data by the watermark method D. The data processing apparatus 150 further includes an audio reproduction unit 156 for reproducing the processed audio data according to a control signal, and a register unit 157 for recording the output audio data according to a control signal. The audio reproduction unit 156 comprises an audio decoder 156a for decoding the output audio data or the output audio signals, and a speaker 156b for converting the audio signals to output sound. In the audio reproduction unit 156, the discrete audio data is reproduced in order of the Dal-Dan audio data reproduction information included in the TOC information. The data processor apparatus 150 further includes a control unit 158 comprising a CPU that performs various types of arithmetic processes and data processes and a RAM (Random Access Memory) to store the CPU's operation program. The control unit 158 controls the operations of the respective units 151-157 - using the control signals. The RAM of this control unit 158 also serves as an execution memory for temporarily storing the audio data from the unit that obtains the data obtaining unit 151 and the elimination unit 154, and the information extracted from the extraction unit. 153. While in this fifth embodiment the audio reproduction unit 156 reproduces the processed audio data, the audio reproduction unit 156 can reproduce the output audio data that has been obtained by entering the information entered in the distributed audio data. , back into the processed audio data, using the default watermark method. In addition, in this fifth embodiment, the data processor apparatus 150 includes the data obtaining unit 151 having a DVD-ROM drive. However, the unit that obtains data 151 can have any storage unit, such as a DVD-RAM drive, a CD-ROM drive, or a unit that reads memory semiconductor, as long as it is a volume storage capable of handling multimedia data. Furthermore, while in this fifth embodiment the extraction unit 153, the elimination unit 154, and the insertion unit 155 are constituted by the design circuits LSI, respectively, each of these units 153-155 can be constituted by a CPU which performs various types of the arithmetic process and a RAM to store the operation program of the CPU and also serve as an execution memory. In this case, these units 153-155 may share the components with the control units 158. Furthermore, while in this fifth mode the storage unit 152 is provided with a DRAM, it may provide some memory as long as it is appropriate for - temporary storage, for example, an SRAM can be employed. Hereinafter, the operation of the signal processing apparatus 150 will be described. In the following description, for simplification, it is assumed that the TOC Ito information is continuously recorded in the recording device of the recording area of the DVD-ROM disc, as information of a predetermined size. (reading of TOC information) In the unit that obtains data 151, information of a predetermined size is read from the recording device of the recording area of the DVD-ROM disk, according to a Gontrol signal from the control unit 158 , and the information read, i.e., the TOC Ito information, is provided to the storage unit 152. (storage of TOC information) In the storage unit 152, according to a control signal from the control unit 158, the entire TOC information Ito obtained in the unit that obtains data 151 (ie, all the parts of the Irl-Irn audio data reproduction information entered in the TOC Ito information) is stored when it is (ie, unless it is processed) in the DRAM. Alternatively, a portion of the Irl-Irn audio data reproduction information entered into the TOC Ito information (eg, only the audio data reproduction information corresponding to the audio data to be reproduced afterwards) can be stored. in the DRAM. (reading of the audio data) Then, in the control unit 158, the Irl ~ Irn information of the reproduction of audio data corresponding to the Dal ~ Dan discrete audio data reproduced from the TOC Ito information is obtained sequentially. stored in the storage unit 152, in order of reproduction of the discrete audio data. Furthermore, in the control unit 158, the information Isp in the recording device position of the audio data record and the information lep in the final audio data recording position are obtained from the obtained audio data reproduction information. So, a control signal according to the information Isp in the recording device position of the audio data record is provided from the control unit 158 to the unit that obtains data 151. In unit that obtains data 151, according to the signal control of the control unit 158, the reproduced discrete audio data is obtained from the DVD-ROM disc. The thus obtained discrete audio data provided in the extraction unit 153 and the elimination unit 154. While the processed obtained data is made, the control unit 158 monitors where the data are reading from the recording area of the DVD-ROM disc, and when the position where the data is being read according to the position indicated by the information lep in the final position of the audio data record, the unit that obtains data 151 it is controlled by the control unit 158 to stop the reading of the discrete audio data. After this, in the control unit 158, to obtain the discrete audio data to be played later, the audio data reproduction information corresponding to this audio data of the storage unit 152 is obtained, followed by the process to get the next discrete audio data. (extraction of information entered) In the control unit 158, the information of the watermark method used is extracted from the audio data reproduction information corresponding to the discrete audio data to be reproduced. Then, the value of the used status information corresponding to each watermark method in the lum information of the watermark method used is decided in the control units 158. Then, a control signal according to the decided value of the used status information generated from the unit control 158 to the extraction unit 153. In the extraction unit 153, according to the control signal, the information entered is extracted from the audio data to be reproduced, by an extractor corresponding to an appropriate watermark method . . For example, when the value of the method A uses the status luminance information is "1", the extraction method A 153a extracts the information entered using the watermark method A, according to the control signal. On the other hand, when the value of the method A uses the state Iuma information is "0", the extraction of the information entered using the extraction method A 153a is not carried out. Likewise, also the extraction method B, the extraction method C, 153c, and the extraction method D, 154d carry out the extraction of the information introduced using the corresponding watermark methods B, C and D, according to the values of method B uses the status Iumb information, method C uses the status Iumc information, and method D uses the state Iumd information, respectively. (deletion of the information entered) The control unit 158 generates a control signal according to the use of the watermark method information obtained from the audio data reproduction information that corresponds to the audio data to be reproduced, to the elimination unit 154. In the elimination unit 154, according to the control signal, the information entered is extracted from the audio data to be reproduced by a method of elimination corresponding to an appropriate watermark method. For example, in control unit 158, the value of method A is used to use the luma status information in the lum information of the watermark method used. Based on the result of the decision, when the value of method A uses the luma status information is "1", in the elimination unit 154, the information entered is eliminated by the method of watermark A, according to the control signal of the control unit 158. On the other hand, when the value of method A uses the luma status information is "0", the deletion of the information entered by the watermark method A is not performed in the elimination unit 154.

Similarly, in the control unit 158, the values of other method information of the method are consecutively decided. When the value is "1", the information entered is eliminated by the elimination of the method corresponding to the method that uses the status information whose value has been decided. On the other hand, when the value is "0", the elimination of the information introduced by the elimination of the method corresponding to the method that uses the state information whose value has been decided, is not carried out. Distributed audio data that has been subjected to the deletion process in the deletion unit 154, i.e., the processed audio data, is provided in the audio reproduction unit 156. (reproduction of the discrete audio data) The transmitted discrete audio data provided in the audio playback unit 156 is attached to the LPCM which decodes it to convert it into an audio signal through the audio decoder 156a, and this audio signal it becomes sound for the 156b spokesperson.

In signal processing apparatus 150, while reproducing the audio data as described above, the re-entry of information into the discrete audio data and the recording of the output audio data obtained by the reintroduction process is brought to performed in a similar manner as described above by the fourth mode, (decision on the re-entry of the information) When the discrete audio data of the unit obtaining data 151 corresponds to the watermark method A, the control unit 158 decides that it is not necessary to re-enter the information entered in this discrete audio data in this audio data using another watermark method. The reason is as follows. The information introduced in this discrete digital audio data can be extracted by a reproduction apparatus which employs the predetermined watermark method (in this case, method A), for example, an existing playback device for a DVD-RAM disc. On the other hand, when the discrete audio data of the data obtaining unit 151 corresponds to the watermark method B, the control unit 158 decides that it is necessary to enter the information introduced again in this audio data by the watermark method A. (re-entry of information) When the discrete audio data corresponds to the watermark method A and for the control unit 158 to decide that the reintroduction of information into this audio data is not necessary, no control signal is received. provides the control unit 158 in the insertion unit 155, and the discrete audio data stored in the execution memory of the control unit 158 are provided in the registration unit 157. On the other hand, when the discrete audio data corresponds to the watermark method B and for the control unit 158 to decide that the re-entry of information into this audio data is necessary, in the insertion unit 155, the The information entered is again introduced into the discrete audio data by the watermark method A, according to the control signal of the control unit 158. (recording of discrete audio data) The discrete audio data that is determined by the control unit 158 corresponding to the watermark method A are recorded in the recording unit 157 without undergoing the process of reintroduction into the unit 155. On the other hand, the discrete audio data that is determined by the control unit 158 corresponds to a watermark method other than the method A subjected to the re-introduction process in the insertion unit 155 and , after this, stored in the registration unit 157. As described above, the data processing apparatus 150 of this fifth embodiment includes, instead of a unit that obtains data 111 from the apparatus 110 according to the first mode, the unit that obtains data 151 that the DVD-ROM drive has to read the distributed audio data from the DVD-ROM disc, and obtains the Ito information from TOC and the plural parts of the discrete audio data Da l-Dan that are included in the audio data read from the DVD-ROM disc. According to the lum information of the watermark method used that is stored in the TOC Ito information as the Irl-Irn information of audio data reproduction corresponding to the respective discrete audio data, the information entered in the discrete audio data, such as copyright information, is removed from the audio data before playing the audio data. Therefore, the reproduction of the discrete audio data distributed by the recording medium is carried out satisfactorily without degradation of the sound quality due to the information entered as the information of the copyright. In addition, when the discrete audio data corresponds to a predetermined watermarking method that is employed in the reproduction apparatus or the like as a domestic electrical equipment, this discrete audio data is recorded when it is in the recording medium. On the other hand, when the discrete audio data corresponds to a watermark method different from the predetermined method, the information entered in this audio data is again input into this audio data using the predetermined watermark method and thus obtaining the audio data recorded in the recording medium. Therefore, the discrete audio data for which the re-introduction process does not require to prevent submitting to the process of writing the information again, of thismode minimizes the process for digital audio data, which causes the degradation of sound quality. In this fifth mode, the TOC information is recorded in the recording device of the recording area of the DVD-ROM disc. However, if the control unit 158 can recognize the position where the TOC information is registered in the record area of the disk, the TOC information can be recorded at any position in the registration area. For example, when a file system is built on the DVD-ROM disk and the information registered on the disk is accessible according to its file name, the TOC information is given a file name when registering on the disk , whereby 'TOC information can be read without taking into account the physical location of the TOC information on the disk. Furthermore, in this fifth embodiment, the reproduction of the discrete audio data is carried out in the order of the audio data reproduction information corresponding to the respective discrete audio data recorded in the TOC information. However, when the data processing apparatus 150 has a function of accepting the selection of the user for the discrete audio data reproduced later, the user can specify the discrete audio data reproduced later. In addition, when the information indicating the order of reproduction of discrete audio data (playback order information) entered in the TOC information, the control unit 158 can - decide the order of reproduction of the discrete audio data referring to the reproduction order information. Further, in this fifth embodiment, the audio reproduction unit 156 decodes the discrete audio data provided by the audio decoder 156a and reproduces the data decoded by the speaker 156b. However, the construction of the audio reproduction unit 156 is not restricted to this. For example, the audio reproduction unit having the audio decoder and the speaker can be constructed such that an analog audio signal obtained by decoding the discrete audio data by the audio decoder can be generated in another recording unit through a audio collector or similar. In addition, the data processing apparatus 150 of this fifth embodiment can be constructed such that discrete audio data is generated. provided in the audio reproduction unit, such as digital data, in another digital data recording unit through a digital transmission collector or the like. Furthermore, in this fifth mode, the recording medium (DVD-ROM disc) mounted on the DVD-ROM unit of the unit that obtains data 151 can be a recording medium in which the following data and information are recorded: digital data that includes the information obtained by entering the relevant information entered in the digital data supplied to be supplied from the final distribution to the user, and using the method information indicating the watermark method used to enter the relevant information in the data supplied, and following the digital data of information entered. In this case, the digital data of the information entered has the data structure that allows the extraction or removal of the relevant information using an appropriate watermark method based on the information of the method used. In addition, in the recording medium (DVD-ROM disc), the plural parts of the information of the method used that indicates the different watermark methods that can be registered can be recorded. they have been used to enter the relevant information into the digital data provided.

Modality 6. Figure 14 is a block diagram for clarifying a data processing apparatus 160 according to a sixth embodiment of the present invention. This data processor apparatus 160 receives a transmission wave from a transmission station and obtains, of the received transmission wave, first digital audio data (distributed audio data) that has been obtained by entering information into the digital audio data provided from the final distribution to the user (audio data supplied) using a mark-up method Water. Then, the apparatus 160 performs the extraction and elimination of the information introduced (afterwards also called first input) of distributed audio data, and the processing of the extracted information (first information entered) creating the processed information (second information). Then, the apparatus 160 inputs the processed information into the second digital audio data (processed audio data) obtained by the deletion process performed on the distributed audio data, using a watermark method different from the aforementioned watermark method, thus generating the third digital audio data (output audio data). The watermark method - used to enter information into the supplied audio data is one of method A, method B, and method C. In addition, the extraction of the first information entered was done using an appropriate watermark method, and the re-introduction process performed using at least one predetermined watermark method employed in the reproduction apparatus as a domestic equipment. In addition, proper watermark method is identical to the watermark method used to enter information into the audio data provided. Distributed audio data has been submitted to the LPCM encoder, and the first information entered has been entered into the audio data distributed by a predetermined watermark method (method A). (data structure of the first information entered) Figure 15a shows the data structure of the first information I ml entered.

The first Iwml information entered contains the Icr information of the owner of the copyright, the information of a watermark method used in the registration Irm (later simply referred to as the Irm information of the registration watermark method), the Idi information of the recording device ID, copy of the generation Icg information, and copy of the information of the source ID. The first I ml information entered contains a fixed data length. So that, in the distributed audio data whose length of the data varies according to the length of music or similar, the same information is repeatedly introduced as the first information entered. Figure 16 (a) shows the values of the Irm information of the registered watermark method included in the first I ml information entered. The Irm information of the registered watermark method is the information to identify the watermark method that is used to input information into audio data recorded in the signal processing apparatus 160. To be specific, the first Iwml information entered in the audio data distributed by a predetermined watermark method. When the Distributed audio data or processed audio data obtained by processing the distributed audio data are recorded in the recording medium, the information corresponding to the first information entered is again introduced by another watermark method. The Irm information of the registered watermark method is the information to identify the watermark method used for this re-introduction process. The Irm information of the registered watermark method is represented by two bits. More specifically, the "00" value of this Irm information indicates that no information entry process will be performed on the audio data recorded in the recording medium. The value "01" of this information Irm indicates that the information will be entered in the recorded audio data, using the watermark method A. Likewise, the values "10" and "11" of this information Ir indicate that the information will be introduced into the recorded audio data, using the watermark method B and C, respectively. While in this sixth modality the LPCM is used as the data coding method of audio, other encoding methods can be used, such as AC3, MPEG-audio, and DTS. Furthermore, while in this sixth embodiment the audio data transmitted independently by a transmission wave to the signal processing apparatus 160, the mode of audio data transmission is not restricted to this. For example, a video object (multiplexed digital data) in which the video data and the audio data are multiplexed and can be transmitted to the apparatus 160. In addition, while in this sixth mode the generated distributed audio data inputs the information into the audio data provided by a predetermined watermark method, if the information indicating the type of watermark method used for - the introduction process of information transmitted to the data processing apparatus 160, any method of watermarking may be employed in the process of entering information. Furthermore, while in the sixth modality the same information is repeatedly introduced as in the first Iwsl information introduced in the distributed audio data, different types of information can be introduced as the first Iwml information introduced.

On the other hand, while in this sixth embodiment the first Iwml information entered includes the Icr information of the owner of the copyright, the Irm information of the registered watermark method, the Idi information of the registration ID device, copy of the Generation Icg information, and copy of the Isc information from the source of ID, other information, such as Ird information from the registration date, can be included in the first Iwml information entered. (data structure of the second information entered) Figure 15 (b) shows the data structure of the second Iwm2 information entered which is entered into the recorded audio data in the recording medium (distributed audio data or audio data processed) by a watermark method. The second I m2 information introduced includes using the lum information of the watermark method, instead of the Irm information of the registered watermark method introduced in the first Iwnl information. The use of the lum information of the watermark method indicates the watermark method that is used for the information entered in the data.

Distributed audio or audio data processed. The values of the use of the lum information of the watermark method and the meaning of each value are identical to those described for the Irm information of the registered watermark method. - That is, as shown in Figure 16 (b), the use of the lum information of the watermark method represented by two bits. The value "00" of this lum information indicates that no information entry process has been performed by a watermark method on the audio data recorded in the recording medium. The value "01" of this lum information indicates that the information has been entered into the recorded audio data, using the watermark method A. Similarly, the values "10" and "11" of this lum information indicate that the information has been entered into the recorded audio data, using the watermark method B and C, respectively. While in this sixth mode the data structure of the second I m2 information entered is identical to that of the first I ml information entered, the second I m2 information entered may have a data structure in which the information of another title is added. , as the copy of the information of the date, the first information entered, or a data structure in which part of the first information entered, such as the copy of generation information, is canceled from the first information entered. • In addition, while in this sixth mode the use of the lum information of the watermark method introduced by the second Im2 information entered, when recording the information attributed to the audio data in the recording medium separately from the data of Distributed audio or processed audio data, the use of the lum method information of the watermark can be recorded as the attribute information. In this case, no information of the watermark method is included in the second Iwm2 information entered. (construction of the data processing apparatus) The data processing apparatus 160 includes a data obtaining unit 161 comprising an antenna 161a receiving a transmission wave B from a transmission station Be, and a receiver decoder 161b decoding the wave received Bw transmission to generate the distributed audio data described above (first audio data digital). The data obtaining unit 161 obtains the distributed audio data of the transmission wave Bw according to a control signal. The data processor apparatus 160 further includes an extraction unit 162 which is constituted by an LSI design and extracts the entered information (first input Iwml) of the distributed audio data, according to a control signal; an elimination unit 163 which is constituted by an LSI design and removes the introduced Iwml information from the distributed audio data according to a control signal, thus generating the processed audio data (second digital audio data); and an insertion unit 164 which is constituted by an LSI design and introduces the processed information (second Iwm2 information entered) obtained by processing the first Iwml information entered, again into the processed audio data, using various watermark methods, in this way generating the output audio data (third digital audio data). The extraction unit 162 comprises an extraction method A 162a, an extraction method B 162b, and an extraction method C 162c corresponding to the aforementioned watermarking methods A, B, and C, respectively. In the extraction unit 162, the I ml information entered in the distributed audio data extracted by a desired extractor, according to a control signal. For example, the extraction method A 162a extracts the introduced Iwml information from the distributed audio data (input audio data) by the watermark method A. The B extraction method 162b extracts the introduced Iwml information from the input audio data by the watermark method B. The extraction method C 162c extracts the entered Iwml information from the input audio data by the watermark method C. In addition, the elimination unit 163 comprises a elimination method A 163a, elimination method B 163b, and elimination method C 163c corresponding to the watermark methods described above A, B. and C, respectively. In this deletion unit 163, the Iwml information introduced in the distributed audio data is eliminated by a desired eliminator according to a control signal. For example, the deletion method A 163a removes the entered Iwml information from the audio data distributed by the watermark method A. The deletion method B eliminates the Ibml information. introduced from the audio data distributed by the watermark method B. The elimination method C 163c removes the introduced Iwml information from the audio data distributed by the watermark method C. The data processor apparatus 150 also includes a register unit 166 which stores the output audio data according to a control signal; a storage unit of the apparatus 165 which stores the device number information to identify this apparatus 160; and a control unit 167 comprising a CPU that performs various types of arithmetic processes and processes data and a RAM (Random Access Memory) for storing the CPU's operating program. The control unit 167 controls the operations of the respective units 161-166 using the control signals. The information storage unit of the apparatus 165 is provided with an EEPROM, and the information of the number of apparatuses is stored in a storage region of the number of apparatuses 165a of the EEPROM. In addition, the registration unit 166 is provided with a DVD-RAM unit, where the output audio data is recorded on a DVD-RAM disc. In addition, the control unit 167 processes the first information entered according to the information of the number of devices stored in the EEPROM registration area, thus producing the second information entered. In addition, the RAM of the control unit 167 also serves as an execution memory for temporarily storing the audio data provided from the deletion unit 163 and the insert unit 164, the first introduced Iwml information extracted by the extraction unit. 162, and the second introduced Iwm2 information generated in the control unit 167. While in this sixth embodiment the unit that obtains data 161 includes the antenna and the decoder, the construction of the unit that obtains the data 161 is not restricted therein. . For example, the unit that obtains the data 161 may have a receiving unit that receives a signal transmitted via a collector line, such as a network interface or a modem (modulator-demodulator). In addition, the unit that obtains the data 161 may have a volume storage unit capable of accessing multimedia data, such as a DVD-ROM drive, a DVD-RAM drive, a CD-ROM drive, or a drive. semiconductor memory access.

Furthermore, in this sixth embodiment, the extraction unit 162, the elimination unit 163, and the insertion unit 164 is constituted by the separate design circuits of LSI. However, since these units perform similar processes, these units are desired to be constituted by a simple design circuit of LSI, for the reduction in the number of components. Furthermore, while in this sixth embodiment the extraction unit 162, the elimination unit 163, and the insertion unit 164 are constituted by the LSI design circuits, each of these units 162-164 can be constituted by a CPU that performs several types of arithmetic processes and a RAM to store the CPU's operation program and also serve as a running memory. In this case, these units 162-164 can share the components with the control unit 167. Furthermore, while in this sixth embodiment the information storage unit of the apparatus 165 is equipped with an EEPROM, the storage unit 165 can be equipped with any memory as long as it is a non-volatile memory. In addition, while the information storage unit of the apparatus 165 stores the information of Device number to identify the device, you can store an identification number to identify the user of the device. In this case, the information storage unit of the apparatus is equipped with a reader for an IG card or a magnetic card, and the user of the device inserts the card in which the user's identification number is recorded, in the reader to inform the device of the user identification number. While in this sixth embodiment the registration unit 166 is equipped with a DVD-RAM unit, the registration unit 166 can be equipped with any storage unit, such as a CD-R unit or a semiconductor memory access unit, with such that it is a writable volume storage capable of accessing multimedia data. Further, a description of the operation of the data processor apparatus 160 will be given. (reading of audio data) In the unit obtaining the data 161, the transmission wave Bw of the transmission station Be is received by the antenna 161a. When the transmission wave Bw is the input to the decoder 161b, converting the audio data distributed by decoding (first digital audio data). This distribution of audio data is provided in the extraction unit 162 and the elimination unit 163. (extract of information entered) In the extraction unit -162, the first introduced Iwml information is extracted from the distributed audio data obtained in the unit that obtains the data 161, using a predetermined watermark method, according to a control signal of the control unit 167. The extracted information (first Iwml information) is temporarily stored in the unit's execution memory control 167. (deletion of the entered information) In the deletion unit 163, the first Iwml information entered is removed from the distributed audio data, using a predetermined watermark method, according to a control signal from the unit control 167, thus generating the processed audio data. The processed audio data is provided in the insert unit 162. (processing of the information entered) In the control unit 167, the first Iwml information stored in the execution memory is processed to create the second Iwm2 information.

To be specific, the second Iwm2 information created according to the information of the owner of the copyright, the information of the registered watermark method, the registered device ID information, the copy of the generation information, and the copy of the information of the source ID which are included in the first Iwml information stored in the execution memory, and the information of the apparatus number stored in the information storage of the apparatus 165. With respect to the information of the owner of the rights of author and information of the registered watermark method, the values described in the first Iwml information copied at this time, when they are in the second Iwm2 information. Since the information of the device ID registered in the second Iwm2 information, the device number registered in the information storage unit of the apparatus 165 is registered. In this way, the owner of the copied audio data can be specified. In addition, in the second Iwm2 information, such as the value of the copy of the generation information, a value obtained by adding 1 to the value recorded in the first Iwsl information is recorded. In this way, when a copy of the distributed audio data is found, the generation of this copy, that is, you can specify how many times the original audio data has been copied. In addition, as the source ID information of the copy of the second Iwm2 information, the registered device ID information is recorded in the first Iwnl information. Thus, the - device that has copied the distributed audio data.

By tracing back the copy of the source ID information, the user or device that / has illegally copied the audio data can be specified. The second Iwm2 information for which it was created is sent to the insertion unit 164. (re-introduction of the second information) In the insertion unit 164, the second Iwm2 information generated in the control unit 167 is entered into the data of processed audio provided from the elimination unit 163, using a watermark method, according to a control signal, thus generating the output audio data (third digital audio data). At this time, the second Iwm2 information is repeatedly included on the processed audio data, of the recording device at the end, according to the length of the audio data.

Especially, the first introduction of the second Iwm2 information is performed by the predetermined watermark method. The second and subsequent introductions are made using the watermark method indicated by the watermark method information introduced in the first Iwsl information. From the first introduction or the second Iwm2 information made by the predetermined watermark method, when the second Iwm2 information entered extracted from the output audio data, the Iwm2 information input into the recording device of the output audio data may be extracted using the default watermark method. In addition, based on the second Iwm2 information for extraction, the information introduced in other regions of the output audio data can be extracted or deleted. The created output audio data is provided in the register unit 166. (recording of the output audio data) In the recording unit 166, the output audio data provided from the insert unit 164 stored in the DVD-RAM disk according to a control signal of the control unit 167. The data Output audio are sequentially stored from the recording device of the DVD-RAM disc registration area. As described above, according to the sixth embodiment of the present invention, the data processing apparatus 160 included, instead of the unit that obtains data 111 of the first mode, the unit that obtains data 161 which has the antenna for receiving a transmission wave from a transmission station and the decoder pair decoding the received transmission wave Bw, and obtaining the distributed audio data as the generation of the decoder. Then, the apparatus 160 performs the extraction and elimination of the entered information (first Iwal information entered) of the distributed audio data, and processes the extracted information (first Iwml information) to create the processed information (second Iwm2 information). Then, the apparatus 160 inputs the processed information (second Iwm2 information) into the second digital audio data (processed from the audio data) obtained by the input process performed on the distributed audio data, using a watermark method different from the aforementioned watermark method, thus generating the third audio data digital (output audio data). Therefore, the addiction or elimination of a / of the information introduced in the distributed audio data is possible. In addition, when the processed audio data is recorded, additional information such as an apparatus identification number (for example, the CPU identification number) assigned to the recording apparatus or the registration date is entered into the audio data processed. Thus, if the owner of the copyright has found an illegal copy of the digital data, the copyright owner can extract more specific information to demonstrate the illegality of the digital data. further, when the information of the copy permission or the like is recorded in the digital data by a predetermined watermark method, a recording apparatus adapted to the predetermined watermark method can perform the restriction of the direct copy, such as inhibiting the copying of the digital data, according to the contents of the copy of the permit information. In this case, however, a recording apparatus that performs copying without referring to the copy permission information entered by the watermark method, you can not restrict illegal copying. While in this sixth mode the obtained distributed audio data receives a transmission wave, it can be obtained by receiving a signal, which has been transmitted through a collector (for example, internet (communication network) or telephone line), with a card of the network or a modem. Further, in this sixth embodiment, the user of the data processing apparatus 160 may select some portions of processed distributed audio data from the plural portions of the distributed audio data obtained from the received transmission wave. In addition, the distributed audio data provided by the transmission wave may be in the state where the audio data is multiplexed with the video data. In this case, the audio data can be extracted from the multiplexed digital data as a video object transmitted by the transmission wave. While in this sixth embodiment, the output audio data is sequentially recorded from the recording device of the recording area of the DVD-RAM disc in the register unit 166, the method of record of the audio data output in the record unit • is not restricted in it. For example, the output audio data can be written to a free area of the disc which is detected according to the registration status. Alternatively, the output audio data may be written to an area of the disc specified by the user of the apparatus. Also, when a file system is built into the DVD-RAM disk, the output audio data is written to the disk according to the file name. In this case, since the output audio data is recorded through the file system, the output audio data can be written to any position in the record area of the disc.

Modality 7. Figure 17 is a block diagram for explaining a data processing apparatus 170 according to a seventh embodiment of the present invention. This data processing apparatus 170 includes a deletion unit 173 for removing the information entered from the distributed audio data, in addition to the components of the data processing apparatus 120 according to the second embodiment.

The data processing apparatus 170 of this seventh embodiment includes a unit that obtains data 171 that obtains, from a network signal in a network N, the entered digital audio information data (distributed audio data) Dau as audio data. digital input, and the characteristic information of the audio data which is transmitted together with the distributed audio data Dau; an extraction unit 172 that extracts the information entered from the digital audio data Dau according to a control signal; and an elimination unit 173 which removes the information entered from the Dau digital audio data according to a control signal. The data obtaining unit 171 comprises an interface network 171a exchanging the network signal Sn with the network N, and a received signal decoder 171b which decodes the network signal Sn provided from the interface 171a to generate the digital audio data of the information entered Dau and the characteristic information of the audio data. In addition, the extraction unit 172 comprises an extraction method 172al, an extraction method 2 172a2, ..., an extraction method 172a corresponding to the watermark methods described above (1), (2) , ..., (n), respectively. In the extraction unit 172, the information entered is extracted from the digital audio information data input Dau by a desired extraction according to a control signal. These extraction methods are identical to those described for the second embodiment. In addition, the elimination unit 173 comprises a method of elimination 173al, a method 2 of elimination 173a2, ..., an elimination method n that corresponds to the watermark methods described above (1), (2), ..., (n), respectively. In the elimination unit 173, the entered information is removed from the digital audio data of information input Dau by a desired eliminator according to a control signal. For example, the elimination method 1al eliminates the information entered from the Dau digital audio data by the watermarking method (1). The method of elimination 173a2 removes the information entered from the digital audio data Dau by the watermark method (2). The elimination method n eliminates the information entered from the Dau digital audio audio data by the watermark method (n). In addition, the data processing apparatus 170 includes an input unit 174 that introduces the information extracted again in the digital information data deleted using a predetermined watermark method used in the reproduction apparatuses as a domestic electrical equipment, thus the digital output data are generated; and a register unit 176 that stores the digital output data. In addition, the data processor apparatus 170 includes a playback unit 175 that reproduces the digital information audio data deleted from the elimination unit 173, according to a control signal; and a control unit 177 that controls the respective units 171-176 using the corresponding control signals. The playback unit 175 comprises an audio decoder 175a which converts the digital information data input Dau to an audio signal, and a speaker 175b which converts the audio signals into sound. In addition, the control unit 177 comprises a CPU that performs various types of arithmetic processes and data processes, and a RAM (Random Access Memory) that stores the operation program of the CPU, thus controlling the operations of the respective units 171-176. The RAM also serves as an execution memory to temporarily store the audio data or information attributed to the audio data.

To be specific, the control unit 177 decides the value of each method using the status information according to the information of the watermark method used that is entered in the information attributed to the audio data obtained by the unit they obtain. data 171, and controls the process of extracting or deleting the information entered by the extraction or elimination method corresponding to each watermark method, according to the result of the decision. In addition, the control unit 177 controls the process of reproducing the audio data for the reproduction unit 177, in accordance with the reproduction permission information entered in the extracted information. To be specific, when the values of the reproduction permission information entered throughout the method used in the state information constituting the information of the watermark method used is "1", the control unit 177 allows the unit 175 plays the audio data, and controls the playback unit 175 so that the audio data is reproduced. In addition, in the data processor apparatus 170, the respective units are connected to each other by a DbuS data collector, and the control unit 177 it controls not only the extraction unit 172, the elimination unit 173, and the reproduction unit 175 but also the unit that obtains the data 171, the insertion unit 174, and the registration unit 176. In addition, the extraction unit 172, the insert unit 174, and the elimination unit 173 are executed by the LSIs design, respectively. The registration unit 176 is executed by a DVD-RAM unit, where the digital output audio data is recorded on a DVD-RAM disc. A description of the operation of the data processing apparatus 170 will be given below. (audio data acquisition Dau and its allocated information Dpr) When a signal network Sn supplied from the network N through the network collector is received by the interface network 171a of the unit obtaining data 171, the network of received signal Sn is generated in the received signal decoder 171b. The signal decoder 171b decodes the signal network Sn to generate the digital audio data of the input data Dau and the information allocated from the audio data Dpr that follow the audio data Dau.

The obtained Dau audio data is sent to the extraction unit 172 and the elimination unit 173 via the data bus Dbus, while the information attributable to the audio data Dpr is sent to the control unit 177 via the Dbus data collector. In the control unit 177, the information attributable to the audio data Dpr is temporarily stored in the RAM which serves as an execution memory. (extraction of information entered) The control unit 177 controls the extraction unit 172 by a control signal according to the information of the watermark method used introduced in the information attributable to the audio data Dpr. That is, according to the value of each of the method using the status information entered in the watermark method information used, the control unit 177 generates a control signal to the extractor of the corresponding method. To be specific, as described for the second embodiment, in the control unit 177, the process of providing a control signal to the extractor of the corresponding method according to the value of the method using state data performed for each of the plural parts of the method using state information (method (1) uses state information - method (n) uses status information) that can be used in the final distribution, and according to each extraction method that extracts the input information from the input audio data Dau in response to the control signal from the control unit 177. In this way, the plural parts of the entered information are extracted. (elimination of the entered information) The control unit 177 controls the elimination unit 173 with a control signal, according to the use of the water measurement method information entered in the information attributable to the audio data Dpr. That is, according to the value of each method using the status information entered in the watermark method information used, the control unit 177 generates a control signal to the elimination of the corresponding method. To be specific, in the control unit 177, initially, the value of the method 1 that uses state information in the watermark method information used is sent. When the value of method 1 uses state information is "1", the control unit 177 generates a control signal that informs the elimination method 1a in the elimination unit 173 to delete the information entered from the input data Dau using the method of watermark (1). Accordingly, in the elimination method 1a, the information that has been introduced by the watermark method (1) is removed from the Dau audio data by the watermark method (1). On the other hand, when the value of the method 1 that uses state data is "0", the control unit 177 does not generate a control signal that reports deleting the input information of the input data Dau, to method 1 of elimination 173al. Then, in the control unit 177, the value of method 2 that uses state information in the watermark method information used is sent. When the value of method 2 that uses status information is "1", the control unit 177 generates a control signal that informs the elimination method 173a2 in the elimination unit 173 to delete the information entered from the audio data of the control unit. Dau input using the watermark method (2). In this way, in elimination method 2 173a2, the information that has been introduced by the watermark method (2) is removed from the Dau audio data by the watermark method (2). On the other hand, when the value of the method 2 that uses state data is "0", the control unit 17r7 does not generate a control signal that informs to eliminate from the entered information the input audio data Dau, to the method 1 of elimination 173a2. In this way, in the control unit 177, the process of providing a control signal in the elimination of the corresponding method according to the value of the methods using data performing for each of the plural parts of the method using state information (method 1 that uses state information - method n uses status information) that can be used in the final distribution, and according to, each elimination method delete the information entered from the Dau input audio data in response to the signal control unit control 177. (reproduction of the Dau audio data) After this, the control unit 177 decides the values of the reproduction permission information included in all the information obtained by the information extraction process described above. According to the result of the decision, the control unit 177 generates a control signal which indicates whether the digital audio input data Dau will be reproduced or not, in the reproduction unit 175. To be specific, when the values of the reproduction permission information included throughout the method using state information constituting the information of the watermark method used is "1", the control unit 177 allows the reproduction unit 175 to reproduce the Dau audio data. Then, under the control of the control unit 177, the audio data Dau is transmitted from the elimination unit 173 through the data bus Dbus to the playback unit 175. In the playback unit 175, the audio data received Dau are decoded by the audio decoder 175a converted into an audio signal, and the sound corresponding to this audio signal is generated from the speaker 175b. (re-entry of information) In addition, in the data processing apparatus 170, the information extracted independently of the process which reproduces the audio data Dau of the deletion unit 173, the audio data Dau is again input to the audio data Dau of the elimination unit 173 by a predetermined watermark method. The predetermined watermarking method is a watermarking method employed in reproduction apparatuses as a domestic electrical equipment. In the control unit 177, as described above, the watermarking method that has been used to enter information into the target audio data in the final distribution is decided according to the value of each method using entered status information in the information of the watermark method used, and according to the result of this decision, the information introduced by the watermark method corresponding to the insertion unit 174. is provided. In the insertion unit 124, the information provided of the control unit 177 is again entered into the audio data provided from the elimination unit 173, by the predetermined watermark method, in this way the digital output audio data is generated. (recording of digital audio data output) The digital output audio data generated in the insertion unit 174 is provided in the registration unit 176 and recorded in a recording medium according to a control signal of the control unit 177. The registration unit 176 It is run by a DVD-RAM drive, and the digital audio output data is stored on a DVD-RAM disc. In this seventh embodiment, the control unit 177 allows the reproduction unit 175 to only reproduce the Dau audio data when the values of the reproduction permission information included in the whole method using state information constituting the information of the method of watermark is "1". However, the condition under which the control unit 177 allows the reproduction unit 175 to reproduce the Dau audio data is not restricted therein. For example, the reproduction of Dau audio data may be allowed when the value of at least one piece of reproduction permission information included in the method using state information is "1". Alternatively, the permission for the reproduction of Dau audio data can be decided as follows. That is, a factor of the watermark is fixed for each method using state information that constitutes the watermark method information used, and the product of this watermark factor and the value of the reproduction permission information is obtained -included in every method that uses status information, and then the products obtained for the whole method that uses state information are summarized. According to whether this sum exceeds a predetermined threshold or not, reproduction of the Dau audio data is allowed. As described above, according to the seventh embodiment of the present invention, the data processing apparatus 170 is provided with the data obtaining unit 171 that receives a network sign from the network N and obtains the digital audio data from the network. the information entered Dau and the information attributed to the audio data Dpr. The extraction and deletion of the information entered from the Dau audio data is done according to the method using state information entered as the information of the watermark method used in the information attributed to the Dpr audio data, and the reproduction Processed audio data is controlled according to each information entered. Accordingly, in the data processing apparatus 170 that receives the data from Dau audio, the reproduction of Dau audio data can be properly controlled according to the information entered that has been entered into Dau audio data by various watermark methods in the final distribution. . In addition, the information introduced in the distributed audio data is again introduced into the processed audio data obtained by eliminating the information entered from the distributed audio data, using a predetermined watermark method. Accordingly, even in a reproduction apparatus such as a home computer employing the predetermined watermark method, the reproduction of the distributed audio data recorded in the recording medium can be controlled according to the information entered. In addition, the amount of information entered in the distributed audio data recorded in the recording medium can be reduced compared to that of the second mode, whereby the degradation of sound quality due to the information introduced can be reduced by reproducing the Distributed audio data recorded in the recording medium. While in this seventh mode the reproduction unit 175 reproduces the audio data processed, being able to reproduce the output audio data that is obtained by entering the information (information entered) extracted again by the extraction unit 172 in the processed audio data. -. In this seventh embodiment, the digital data that includes the information can be obtained by entering plural portions of pertinent information into the digital data supplied using a plurality of watermark methods, and the insertion unit can enter a predetermined number of pertinent information among the plural parts of relevant information, in the digital input data, using the corresponding watermark methods between plural watermark methods or using a watermark method that is different from these watermarking methods; this mode generating the digital output data.

FIELD APPLICABLE IN THE INDUSTRY The present invention relates to data processing apparatus and data recording communication means and, more particularly, to a process that introduces a watermark (information entered) into digital data such as audio data. obtained by electronic distribution or record media, using a specific watermark method as a predetermined watermark method that is employed for versatile data reproduction apparatuses. -. Particularly, a data processing apparatus according to the present invention that converts various types of digital information data introduced corresponding to different watermark methods, which are obtained by entering pertinent information in the digital data provided from the distributor to the user, in those that correspond to a versatile watermark method that is employed for reproduction apparatuses that are household electrical equipment, and this data processing apparatus is very useful for protecting the copyright of digital data by the watermark method . It is noted that in relation to this date, the best method known to the applicant to carry out the aforementioned invention, is the conventional one for the manufacture of the objects or products to which it refers. Having described the invention as above, property is claimed as contained in the following:

Claims (26)

1. A data processing apparatus for receiving various types of digital data that include the information that corresponds to the different watermark methods and that have been obtained by entering the relevant information that is related to provide the digital data in the digital data supply to be provided from the final distribution to the user, and by processing this digital data including the information, the apparatus comprises: means of obtaining data to obtain -the digital data that includes the desired information as the input of digital data; means that obtain the information of the method to obtain the information of the method used that corresponds to the digital input data and indicates the watermark method used for the process of entering the pertinent information; means of extracting information to extract the relevant information from the digital input data using the watermark method, based on the information obtained from the method used; Y the means of entering the information to include the relevant extracted information or the processed information obtained, processing the pertinent information, in the digital input data or in the processed digital data obtained by submitting the digital input data to a predetermined data processing, using a predetermined watermark method.

2. A data processing apparatus according to claim 1, characterized in that the relevant information introduced in the digital data that includes the information is the information that relates to the holder of the literary property rights of the digital data supply.

3. A data processing apparatus according to claim 1, characterized in that the means for entering the information that enter the relevant information or processed information into the digital input data using the predetermined watermark method, whereby generate the digital output data.

4. A data processing apparatus according to claim 3, characterized in that it additionally comprises a data reproduction unit for reproducing the digital output data. •

5. A data processing apparatus according to claim 3, in accordance with the claim further comprises the data recording unit for recording the digital output data.

6. A data processing apparatus according to claim 1, characterized in that it additionally comprises: means for eliminating information to eliminate the pertinent information of the digital input data based on the information of the method used obtained by the means of obtaining the data. information on the method, whereby the digital data of the withdrawn information is generated as the processed digital data; and the means of introducing information that introduce the relevant information or information processed into the digital data of the Information retrieved using the default watermark method, whereby the digital output data is generated.

7. A data processing apparatus according to claim 6, characterized in that it additionally comprises a data reproduction unit for reproducing the digital output data.

8. A data processing apparatus according to claim 6, characterized in that it additionally comprises a data recording unit for recording the digital output data.

9. A data processing apparatus according to claim 1, characterized in that the digital data including the information comprises a first data portion having a fixed length and a second data portion having a variable length; the information of the method used that indicates the watermark method used is included in the first data portion by means of the watermark method used; Y the means that obtain the information of the method obtain the. information on the method used that indicates the watermark method used, from the first data portion of the digital input data.

10. A data processing apparatus according to claim 1, characterized in that the digital data that includes the information has a data structure that includes a plurality of data packets; the method information used indicating the used watermark method is entered into a loader of a predetermined data packet among the plural data packets; and the means that obtain the information of the method obtain the information of the method used indicating the watermark method used from the loader of the predetermined data packet of the digital data including the information.

11. A data processing apparatus according to claim 1, characterized in that: the digital data including the information is followed by an auxiliary data portion; the method information used that indicates the watermark method used is entered into the auxiliary data portion; and the information obtaining means of the method obtains the information of the method used indicating the used watermark method of the auxiliary data portion that follows the digital data that includes the information.

12. A data processing apparatus according to claim 1, characterized in that: the data acquisition means can obtain the digital data that includes the information of at least one of the plural data recording means and "the trajectories of plural data transmission, and the unit that obtains the method information decides the watermark method used in accordance with any of the means of data recording and data transmission paths from where the digital data including the information have been obtained, and the information of the method used that corresponds to the result of the decision is obtained.

13. A data processing apparatus according to claim 1, characterized in that the digital data that includes the information is the digital audio data, or the digital video data, or the multiplexed data obtained by multiplexing the digital audio data and the digital data. digital video data.

14. A data processing apparatus according to claim 1, characterized in that the means that obtain the data have an antenna for receiving a transmit wave from a transmitter, and a wave receiving decoder for decoding the wave received by the antenna for generate the digital data that includes the information.

15. A data processing apparatus according to claim 1, characterized in that the means that obtain the data have the unit that reads the data, from a wide memory, the digital data that includes the information stored in the wide memory.

16. A data processing apparatus in accordance with the. Claim 15, characterized because the data reading unit has a unit of • access to read digital data that includes information from a DVD-ROM, DVD-RAM, or a semiconductor recording medium.

17. A data processing apparatus according to claim 1, characterized in that: the digital data including the information is obtained by entering the plural parts of the relevant information into the digital data supplied using a plurality of watermark methods; the plural parts of the method information used that correspond to the plural watermark methods are entered into the digital data that include the information, as the method information used indicates the watermark method used,; and the media that extracts the information can extract the pertinent information that corresponds to each of the plural watermark methods from the digital input data, based on the information of the method used that corresponds to the plural watermark methods .

18. A data processing apparatus according to claim 1, characterized in that: the digital data including the information is obtained by entering the plural parts of the relevant information into the digital data supplied using a plurality of watermark methods; and the means introducing the information introduce one of the predetermined plural portions of the relevant information into the digital input data using the predetermined watermark method, whereby the digital output data is generated.

19. A data processing apparatus according to claim 1, characterized in that: the digital data including the information is obtained by entering the plural parts of the relevant information into the digital data supplied using a plurality of watermark methods; and the media that enter the information introduce a predetermined number of information relevant between the plural parts of the relevant information, in the digital input data, using the corresponding watermark methods between the plural watermark methods or a watermark method different from the plural watermark methods, whereby the digital output data is generated.

20. A data processing apparatus according to claim 6, characterized in that: the digital data including the information is obtained by entering the plural parts of the relevant information into the digital data supplied using a plurality of watermark methods; and the means introducing the information introduce one of the predetermined plural portions of the relevant information into the processed digital data using the predetermined watermark method, whereby the digital output data is generated.

21. A data processing apparatus according to claim 6, characterized in that: the digital data including the information is obtained by entering the plural parts of the relevant information into the digital data supplied using a plurality of watermark methods; and the media that enter the information introduce a predetermined number of pertinent information between the plural parts of the relevant information, into the processed digital data, using the corresponding watermark methods between the plural watermark methods or a brand method of water different from plural watermark methods, whereby the digital output data is generated

22. A means of recording data in which the digital data that includes the information is recorded, where the digital data that includes the information has been obtained, by entering the pertinent information that is related to provide the digital data in the supply of data. digital data to be supplied from the final distribution to the user, the digital data including the information have a data structure characterized in that: the digital data including the information is composed of a first data portion having a fixed length and a second portion of data that has a variable length; the information of the method used that indicates the watermark method used to enter the relevant information in the supply of the digital data is entered into the first data portion; the pertinent information is introduced in the second data portion through the watermark used method indicated by the information of the method used; and the pertinent information can be extracted or can be removed from the second portion of data using an appropriate watermark method based on the information of the method used.

23. A data recording medium according to claim 22, characterized in that the information of the method used is entered into the first data portion of the digital data that they include the information by a predetermined watermark method.

24. A data recording medium according to claim 22, characterized in that the plural parts of the information of the method used indicate the different watermark methods used, which have been used to enter the pertinent information in the provision of the data. digital, are introduced into the first data portion of the digital data that includes the information.

25. A means of recording data where digital data are recorded that include the information and information of the method used, where the digital data has been obtained that include the information by entering the pertinent information that is related to provide the digital data in the supply of the digital data to be provided from the final distribution to the user, and where the method information used indicates the watermark method that has been used to enter the relevant information in the provision of the digital data and followed by the digital data including the information, characterized in that, the digital data that includes the information has a data structure in which the relevant information can be extracted or deleted - using an appropriate watermark method based on the information of the method used.

26. A data recording medium according to claim 25, characterized in that the plural information parts of the method used that indicate the different watermark methods that have been used to enter the information are recorded as the information of the method used. relevant in the provision of digital data.