JP2002073017A - Method for embedding digital watermark, method for distributing musical composition data, method for recording musical composition data, method for reproducing musical composition data - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method for embedding digital watermark data in musical composition data and for certainly preventing an illegal copy. SOLUTION: The method for embedding a digital watermark which embeds digital watermark data in musical composition data is characterized by embedding intrinsic musical composition information of the musical composition data in the musical composition data as digital watermark data, and recording the musical composition information on a file provided in further than the musical composition data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital watermark embedding method for preventing unauthorized use of data recorded on a recording medium such as a memory card, particularly music data such as music, a music data distribution method, and a music data recording method. And a music data reproduction method.

[0002]

2. Description of the Related Art In recent years, music distribution in which music data such as music is distributed via a network such as the Internet without using a recording medium such as a CD has been performed. In such music distribution, a user downloads and purchases music data distributed through a network or the like. The downloaded music data is stored in a memory card, and the user can enjoy the music with a playback device that plays the music data. At this time, the music data is a music signal which is digitized and recorded as it is, compressed, or
It may be distributed as performance data such as IDI. M
In the case of distribution by IDI, music reproduction is performed using a MIDI sound source or the like on the reproduction side.

[0003]

By the way, music distribution includes file formats such as MP3 and MF which are not originally provided with a copy guard function for preventing illegal copying, and these files are copied to the Internet. Due to such illegal distribution, uploading to a homepage, etc., illegal copying of these music data has become a problem. Therefore, an object of the present invention is to prevent unauthorized use and illegal copying of music data used for music distribution.

[0004]

According to another aspect of the present invention, there is provided a digital watermark embedding method for embedding digital watermark data in music data, wherein unique music information of the music data is used as digital watermark data. A digital watermark embedding method characterized by embedding in music data and recording the music information in a file provided other than the music data.

In addition, the unique music information of the music data is embedded in the music data as digital watermark data, and the music information is recorded in a file provided other than the music data, and the digital watermark data is embedded. A music data distribution method for distributing music data and a file in which the music information is recorded is provided.

Further, the unique music information included in the music data is embedded in the music data as digital watermark data, and the music information is recorded in a file provided other than the music data, and the digital watermark data is embedded. A music data recording method characterized by recording music data and a file in which the music information is recorded.

Further, when reproducing music data in which unique music information included in music data is embedded as digital watermark data and a file provided in addition to the music data and recording the music information, the music data is reproduced. A music data reproduction method, characterized in that the music data is reproduced only when the music information embedded as electronic watermark data in the music data matches the music information recorded in a file provided in addition to the music data. provide.

[0008]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a digital watermark embedding method, a music data distribution method, a music data recording method, and a music data reproduction method according to the present invention will be described. In recent years, a system has been proposed in which a recording medium such as a memory card for storing music data is mounted on a portable terminal such as a mobile phone or a PHS to download music data.

There is an SD memory card as a format in which such music data can be described. Hereinafter, an SD memory card and a playback device for the SD memory card will be described with reference to the drawings. FIG. 1 is a block diagram showing a sound format of SD audio, FIG. 2 is an explanatory diagram schematically showing the management of sound data, FIG. 3 is an explanatory diagram schematically showing the management of still image data and moving images, and FIG. FIG. 5 is an explanatory diagram schematically showing management of audio data and audio data, and FIG.
FIG. 4 is an explanatory diagram schematically showing management of LS data.

FIG. 6 is a block diagram of a reproducing apparatus, and FIG.
FIG. 4 is an explanatory diagram schematically showing track management of a play list. FIG. 8 is an explanatory view showing in detail the playlist manager (PLMG) of the PLM which is the management area of FIG. 1, and FIG. 9 is a playlist manager information (PLMG) of FIG.
FIG. 10 is a diagram showing in detail the format of the MGI), FIG. 10 is a diagram showing in detail the track information manager (TKMG) and its track information # 1 (TKI # 1) as the management area of FIG. 1, and FIG. 11 is the track general of FIG. FIG. 12 is an explanatory diagram showing the format of the information (TKGI) in detail, FIG. 12 is a diagram showing the POB manager (POBMG) in detail, and FIG.
FIG. 1 is an explanatory diagram showing the OB manager (VOBMG) in detail.
4 is an explanatory diagram showing the WOB manager (WOBMG) of FIG. 1 in detail; FIG. 15 is a diagram showing the format of the WOB count information (WOBCI) of FIG. 14 in detail;
FIG. 16 is a diagram showing the AOB Manager (AOBMG) of FIG. 1 in detail, and FIG. 17 is the DOB Manager (DOBMG) of FIG.
FIG. 18 is a diagram collectively showing each presentation data of FIG. 1, FIGS. 19A and 19B are diagrams showing the still image object POB of FIG. 18 in detail, FIGS. 21B is a diagram showing the video (moving image) object VOB in FIG. 18 in detail, FIGS. 21A and 21B are diagrams showing the wave form object WOB in FIG. 18 in detail, and FIGS. 22A and 22B are diagrams. FIG. 18 is a diagram specifically showing a downloadable sound object DOB 18.

FIG. 1 shows the file formats of an SD sound directory (sound object set) and a conventional SD audio directory (audio object set) in parallel.

The PLMG (playlist manager) and the TKMG (track information manager) in the SD sound directory constitute a second management area, and the sound PLMG in the SD sound directory is shown in FIG. 9 as shown in FIG. Playlist manager information (PLMGI), default playlist information (DPLI), and playlist information # 1 to #n (where n ≦ 9)
9).

The above-mentioned PLMGI (Playlist Manager Information), as shown in detail in FIG.
PLMG ID (PLMG_ID): 2 bytes, reserved area: 2 bytes, SD sound ID (SDS_ID):
8 bytes, standard version number: 2 bytes, number of playlists: 2 bytes, track number to be reproduced first (PLMG_AP_PL): 4 bytes, track number to be reproduced last, and time from beginning of music ( P
LMG_RSM_PL): 8 bytes (data used for so-called resume playback, which starts playback from the last playback when power was turned off during playback and then turned on again), PLMG application attribute: 2 Bytes, reserved area: 6 bytes.

Also, the TKM of the SD sound directory
G is track information (TKI) # 1 to #n (where n ≦ 9999), as shown in detail in FIG.
Having. Furthermore, track information # 1 to #
n is the track general information (TKGI) shown in FIG. 11 and the track text information data area (TKT) as shown in FIG.
XTI_DA). As shown in detail in FIG. 11, TKGI (track general information) has a TKI ID (TKI_ID): 2 bytes,
KI number (TKIN): 2 bytes, TKI block attribute (TKI_BLK_ATR): 2 bytes, reserved area: 2 bytes, and TKI size (TKI)
_SZ): 4 bytes and track playback time (TKI_
PB_TM): 4 bytes, TKI sound attribute (TKI_SOB_ATR): 4 bytes, reserved area: 4 bytes, track POB / VOB attribute (TKI_PVOB_ATR): 2 bytes, reserved area: 2 bytes, copyright management information Reserved area: 7 bytes, reserved area: 1 byte, text 1 attribute (TKI_TI1_ATR): 2 bytes, and text 2 attribute (TKI_TI1_ATR):
2 bytes, reserved area: 4 bytes, ISRC code (ISRC): 10 bytes, TKI application attribute (TKI_APP_ATR): 2 bytes, reserved area: 20 bytes, track POB / VOB
Search pointer (TKI_PVOB_SRP): 80 bytes, track WOB / AOB search pointer (TK
I_WAOB_SRP): 80 bytes and track DO
B search pointer (TKI_DOB_SRP): composed of 20 bytes. In addition, the ISRC code (ISR
C) is configured as shown in detail in FIG.

The still picture object manager POM in the SD sound directory is, as shown in FIG.
POB Manager Information (POBMGI)
And POB count information (POBCI)
(However, n ≦ 999). This POBCI (P
OB count information) is the above n POBs
Reference count number (POB_RCN): 2 bytes each and others.

The video object manager VOM (= VOBMG) in the SD sound directory is shown in FIG.
As shown in the figure, VOB manager information (V
OBMGI) and VOB count information (VOBCI) (where n ≦ 999). This VOBCI (VOB count information) is a reference count number (VOB_RCN) of the n VOBs:
It consists of 2 bytes each and others.

As shown in FIG. 14, the wave object manager WOM (= WOBMG) of the SD sound directory is WOB manager information (WOB manager information).
MGI) and WOB count information (WO
BCI), where n ≦ 999. This WOB
CI (WOB count information) is the above n
Reference number of WOBs (WOB_RCN): 2 each
Bytes, and other reserved areas: 42 bytes. This WOB_RCN (WOB reference count number) is composed of 14 bits of reference count and 2 bits of data presence flag, as shown in FIG.
When OB does not exist, it is set to 00b, and when it exists, it is set to 01b.

The audio object manager AOM (= AOBMG) in the SD sound directory constitutes a first management area, and as shown in FIG. 16, AOB manager information (AOBMGI) and AOB count information (AOBCI) (where n ≤
999). This AOBCI (AO count information) is composed of the reference count number (AOB_RCN) of the n AOs: 2 bytes each, and other reserved areas: 42 bytes. This AOB_RCN (W
The OB reference count number) includes a reference count of 14 bits and a data presence flag of 2 bits. The data presence flag is 00b when AOB does not exist and 0 when AOB exists.
1b.

As shown in FIG. 17, the DLS object manager DOM (= DOBMG) in the SD sound directory has the DOM manager information (DOBM).
GI) and DOB count information (DOB
CI) (where n ≦ 999). This DOB
CI (DOB count information)
Reference count number of DOBs (DOB_RCN): 2 each
Bytes, and other reserved areas: 42 bytes. This DOB_RCN (DOB reference count number)
Is composed of a reference count 14 bits and a data presence flag of 2 bits. The data presence flag is 00b when the DOB does not exist and 01b when the DOB exists.

As shown in FIG. 18, each presentation data in the SD sound directory includes a sound object SOB, a still picture object POB, a video object VOB, and a wave object WO.
B, DLS object DOB. The sound object SOB is described in the standard MIDI file format (SMF) format 1.0. In addition,
SMF supports meta-events. Also, compression and digital watermarking are performed.

The above-described still picture object POB is recorded in the following three types. (1) Encrypted JPEG (FIG. 19A): Consists of only one still image. (2) Reference pointer of JPEG file (FIG. 19)
(B)) (3) JPEG (Exif Ver.
2.1 format) Then, the above-mentioned video object VOB includes the following 3
Recorded in one type. (1) Encrypted MPEG-4 (FIG. 20A): Consists of only one continuous moving image. (2) Reference pointer of MPEG-4 file (FIG. 20)
(B)) (3) MPEG-4 having no header (especially in the format of level 1/2/3 of the simple profile) Further, the wave object WOB is recorded in the following three types. (1) Encrypted Windows (registered trademark) WAVE file (FIG. 21A): It consists of only one sound effect. (2) Reference pointer of Windows WAVE file (FIG. 21 (B)) (3) Windows WAVE file without header (especially, 8 bits / 11 kHz /
DLS (downloadable sound) object DOB is recorded in the following three types. (1) Encrypted DLS file (FIG. 22A): tone 1
Consists of only one. (2) DLS file reference pointer (FIG. 22 (B)) (3) DLS file without header (especially in Level 2, Ver. 1.0 format) Note that the sound melody SOB contains an incoming melody. An identifier for identification is provided. For example, FIG.
Default playlist information DPLI
DPL arranged in the general information in the
I application attribute DPLI_APP_
The application category ID can be identified by the ATR by being defined by 01h: music 02h: karaoke 03h: presentation 04h: reading 05h: ringtone melody

Next, the reproduction processing of the reproduction apparatus of the first embodiment will be schematically described with reference to FIG. First, FIG.
, When a default playlist DPLI (shown in FIG. 8) is selected as a playlist related to reproduction,
The default playlist track search pointer DPL_TK_SRP # 1 disposed there refers to the track information TKI # 1 of the track manager TKMG (shown in FIG. 10), and TKI # 1 is a corresponding sound object SOB, for example, SOB0001. SS1
See Similarly, the default playlist track search pointer DPL_TK_SPR # 2 refers to the TKI # 2 of the track manager TKMG, and the track information TKI # 2 has a corresponding sound object SOB, for example, SOB0002. Refer to MID. In this way, the sound object SOB is continuously reproduced according to the specified list.

Next, referring to FIG. 3, a reproducing process of the reproducing apparatus according to the second embodiment will be schematically described. First, in FIG. 3, when a playlist PLI # 1 (shown in FIG. 8) is selected as a playlist relating to the mixed reproduction of a still image and a moving image, the playlist POB / VOB arranged there is selected.
The search pointer PLI_PVOB_SRP # 1 refers to the track information TKI # i of the track manager TKMG (shown in FIG. 10), and the default playlist POB / VOB search pointer DPLI_PV.
The OB_SRP # 1 (disposed in the general information DPLGI at the head of the default playlist information DPLI in FIG. 8) refers to the track information TKI # i of the track manager TKMG (shown in FIG. 10), and the corresponding still image object P
OB, for example POB003. Refer to SP1. on the other hand,
Similarly, a moving image object VOB, for example, VOB003.
Reference is made to SV1. In this way, when the sound object SOB is reproduced according to the specified list, the still image and the moving image can be reproduced simultaneously.

The reproduction process of the reproduction apparatus according to the third embodiment will be schematically described with reference to FIG. First, in FIG. 4, when a playlist PL # i (shown in FIG. 7) desired by the user is selected as a playlist related to reproduction, a playlist track search pointer PL_TK_SRP # 1 arranged there corresponds to a corresponding track. Referring to the track information TKI # k of the manager TKMG (shown in FIG. 10), TKI # k is TK
A corresponding web object WOB by I_WAOB_SRP (shown in FIG. 11), for example, when k = 1, WO
B001. Refer to WAV. On the other hand, referring to the audio manager AOM / AOBMG (FIG. 16), the designated audio object AOB in the audio directory is accessed as described by the arrow in FIG. SA1 (audio signal) is read out, and the Web object WOB001. Plays back in synchronization with WAV (sound effect). The same applies to the playlist PL
#I, the audio object AOB is accessed according to, for example, AOB002. SA1 is read, and the web object WOB is accessed again, for example, WOB0.
02. Playback is performed in synchronization with SW1.

Note that the audio object AOB may be deleted or rewritten by a device such as an audio-only player that does not support sound. The lower 12 bits of the byte size of the AOB are stored in the track WOB / AOB search pointer TKI_WAOB_SRP in the TKI in order to confirm whether or not the AOB that the track information TKI expects and references is present. By testing whether this value is correct before reproduction, it is possible to prevent a different AOB from being reproduced.

Next, referring to FIG. 5, a reproducing process of the reproducing apparatus according to the fourth embodiment will be schematically described. First,
In FIG. 4, when a playlist PL # i (shown in FIG. 7) desired by the user is selected as a playlist related to reproduction, a playlist track search pointer PL_TK_SRP # 1 arranged there corresponds to a corresponding track manager TKMG. Referring to track information TKI # k (shown in FIG. 10), TKI # k is TKI_
DSL corresponding to DOB_SRP (shown in FIG. 11)
Object DOB, for example, when k = 1, DOB00
1. Reference is made to DLS (timbre information of a sound source). Thereafter, the audio object DOB is accessed according to the play list PL # i in the same manner. SD1 is read out and continuously reproduced together with the sound signal.

The above embodiment is specifically described in FIG.
Are processed by the playback device shown in FIG. First, the SD memory card 51 is operated by the operation unit 56 to control the control unit 57.
Are accessed by the access unit 52 in order. The access unit 52 takes out the SOB, which is the main data, and supplies it to the sequencer 53 to obtain a tone control signal. The access unit 52 extracts the wave object WOB, the DLS object DOB, the audio object AOB, the still image object POB, and the video object VOB, and supplies them to the decode processing unit 54 together with a sound generation control signal. The specific processing of the control unit 57 will be described with reference to FIG. In FIG. 23, first, the management area is referred to (step S51), sound data is accessed based thereon (step S52), still image data is accessed (step S53), and if moving image data is recorded, Is accessed (step S54), and if audio data is required, it is accessed (step S55), and the data is uniformly processed by the decoding processing unit 4 (step S56). If not completed (N in step S57), the process is repeated. If completed (Y in step S57), the process ends. Therefore, the playback device for the SD memory card according to the present invention uses the SD memory card shown in FIG.
Playback is performed with reference to the management area of the memory card.

Although one MIDI device can basically only play 16 musical instruments at the same time, a meta-event for instructing that a part of the sound object SOB be switched to another port and output is provided. Described in the SOB, the meta-event is interpreted during playback, and the portion assigned to another port is distributed and output to another added MIDI device, thereby simultaneously outputting 16 or more musical instruments. It is also possible to play gorgeous music like playing.

Next, a recording method for an SD memory card according to the present invention will be described. FIG. 24 is a flowchart for explaining the recording operation to the SD memory card in FIG. In FIG. 24, referring to the management area (step S
61), create sound data (step S62),
Still image data is created (step S63), moving image data is created (step S64), management data is created based on each data (step S65), and the created data is recorded on an SD memory card (step S66). ),
If not finished (N in step S67), the process is repeated. Therefore, in the method of recording on an SD memory card according to the present invention, when the SD memory card shown in FIG. 1 is used as a recording medium, recording is performed with reference to the management area. The scrambled ISRC code (ISRC) shown in FIG. 25 may be added to 56 to 75 reserved areas. The digital watermark may be included in a still image or a moving image, and may be used for reproduction by judging coincidence or non-coincidence.

FIG. 26 is a diagram showing a configuration of a terminal to which such an SD memory card 1 is mounted. Reference numeral 1 denotes an SD memory card, and an SD_SO
UND. PLM file 2, SD_SOUND. TKM
File 3, Standard MIDI File (SMF)
SOB1234. The MID file 4 is stored. And ISR from these files 2, 3 and 4
CSR and ISR in SMF digital watermark
Music playback is performed by the music playback sequencer unit 5, the MIDI sound source 6, and the speaker (or headphones) 7, which play the music only when C matches.

Next, the operation of the apparatus shown in FIG. 26 will be described with reference to FIG. When reproduction of a music piece is requested (step S1), SD_SOUND. The PLM file 2 is read (step S2), and then SD_SOUN
D. The TKM file 3 is read (step S3). Furthermore, SD_SOUND. The music information (ISRC) described in the TKI of the TKM file 3 is read (step S
4) At the same time, the music information is stored as music information A (step S5). Next, SOB123 which is SMF
4. The MIDI file 4 is read (step S6),
SOB1234. The digital watermark described in the MID is read (step S7). At the same time, the music information (ISRC) described in the digital watermark is stored as music information B (step S8). Then, the music information A is compared with the music information B (step S9). If the ISRCs match (Y in step S9), the music is reproduced. If they do not match (N in step S9), the music is reproduced. Stop playback of.

Next, with reference to FIG. 28, an embodiment for decrypting the music information A using the terminal ID as a password will be described.
When the reproduction of the music is requested (step S11), SD_
SOUND. Read the PLM file 2 (step S
12) Then, SD_SOUND. TKM file 3
Is read (step S13).

Further, the terminal ID is read (step S
14), SD_SOUND. TKI of TKM file 3
Is read (step S15). The music information A is decrypted using the terminal ID as a password (step S16).
Is stored (step S17). Next, SMF, S
OB1234. The MIDI file 4 is read (step S18), and the SOB 12
34. The digital watermark described in the MID is read (step S19). At the same time, the music information (ISRC) described in the digital watermark is stored as music information B (step S20). Then, the music information A is compared with the music information B (step S21). If the ISRCs match (Y in step S21), the music is reproduced. If they do not match (N in step S21), the music is reproduced. Stop playback of. The music information permitted to be reproduced is played by the reproduction sequencer unit 5 and used for karaoke, BGM, and the like.

As described above, since the digital watermark technique changes a part of the content and directly embeds the digital watermark data relating to the copyright into the content, it is necessary to partially destroy the content itself when removing the digital watermark data. Since the quality of the content is impaired, when the digital watermark data is reproduced without being removed, the value of the content is greatly reduced without complete restoration. In such a digital watermark technology, illegal copy is prevented by utilizing this point.

In this embodiment, the music file is M
Although IDI data is used, this may be a normal digitized audio file. That is, PC
Record music signal as it is with M signal, or use AAC
(Advanced audio coding) or the like may be recorded.

Next, the manner of downloading a music file will be described. In FIG. 29, the user selects a desired music piece from a music list of the music file displayed on the mobile phone 11 as the terminal side, and makes a request to the server 12 of the service provider that distributes the music file ( Step S100). At this time, the music list may be stored in the terminal (the mobile phone 11 or a device connected to the mobile phone 11, or a personal computer used by the user) or may be stored in the server 12. Furthermore, the terminal that makes the request need not be the mobile phone 11 that downloads music, but may be a dedicated terminal or a personal computer used by the user. The connection between the server 2 and the terminal may be wired or wireless, or may be connected through the Internet or the like. It should be noted that the user may be allowed to search for and directly select a desired music without being in the form of the list described above.

Here, it is assumed that, for example, a user whose telephone number of the portable terminal 11 is 090-1234-5678 requests a song "B" of the artist A. Music files are not just music files,
Since there is a possibility of being used as karaoke or BGM, the incoming mobile phone 11 has a MIDI sound source, a MIDI
A lyric character display function used in a sequencer or karaoke, a background image display function also used in a karaoke or the like may be provided. Of course, when not used as a karaoke, the lyrics character display function and the background image display function need not be provided.

First, when using various information providing services from the menu screen of the mobile phone 11, a screen for connection required for calling is displayed, and a connection menu is displayed. Then, the connection from the mobile phone 11 to the server 12 is started, and the basic menu is displayed. Here, from the list displayed in the basic menu, a music file download list, a karaoke download list, a BGM download list, and a list for selecting music are selected, and when selected, the music is displayed in a list format. The user can select the song "B" of the artist A. Here, when the song “B” of the artist A is found, the mobile phone 11 requests the server 12 to download the song file. Server 12
In this case, the request is received. At this time, the user authentication unit (not shown) of the server 2 may perform a billing process for each music every time the user requests the download. At this time, billing processing can be performed at the time of starting the download or at the middle of the download. Further, in consideration of a case where the line is disconnected during the download, the actual billing processing should be performed after the download is completed. Can also be considered. It is also possible to perform a billing process combining these.

Further, if the download service is a membership system, the security may be enhanced by prompting the member to input a password. Also, a mobile phone 1 as a terminal
For example, when the user is going to use 1, the identification of whether or not the user is a member may be automatically performed based on the telephone number of the mobile phone 11 (090-1234-5678 in this embodiment).

Next, an embodiment in which a password is used will be described with reference to FIG. Necessary data is distributed according to the flowchart of FIG. 30, and at the same time, necessary data is written to a memory card (here, an SD memory card is described as an example) mounted on the terminal side.

First, on the server 12 side, the digital watermark data described above is embedded by the watermark embedding encoder 13 into the music file "B" of the artist A. This is to temporarily embed in a music file to be downloaded to the user, and does not embed digital watermark data in the music file itself stored in the server 2. Therefore, the music file of the music “B” of the original artist A does not change. Since the terminal ID is different for each terminal, the server 12
If it is difficult for the server to perform watermark encoding and music information encryption every time, a specific password is determined for each music, so that the server 12
Music files.

Thus, it is possible to avoid changing the password for each terminal, and to eliminate the complexity of encoding a watermark for each terminal.

In this way, the music file in which the digital watermark data is embedded is downloaded to the SD memory card on the user's terminal side (mobile phone 11).

When the music file is taken out to a different terminal by an illegal copy of the user, even if the music file is reproduced on a terminal other than the user terminal requesting the download, the SD_SOUND. Since the content described in TKM is different, it cannot be reproduced.

The music file in which the digital watermark data is embedded by the digital watermark embedding method according to the present invention is copied to a hard disk device or the like used for a personal computer or the like, and used by a mobile phone other than an authorized user. In such cases, once the digital watermark data is removed, the telephone number of the mobile phone to be used must be re-embedded as digital watermark data, but this is a technically difficult task, and even if it could be performed, Since the quality of the music greatly deteriorates, the value of the music file is lost. Also, an ID unique to the hardware of the mobile phone that is actually used
If digital data is used as digital watermark data, or the above-described individual data (for example, telephone number) is used as a password, it is possible to further prevent illegal copying. Note that S
D_SOUND. Music information (IS
Since RC) is written, a decoder for decoding this is needed on the terminal side. If this substantially affects the cost, you can write the TSRC without encryption,
A simple scramble may be used.

Next, a specific example of providing a music file will be described with reference to FIG. First, a packet communication connection is started on the terminal side such as the mobile phone 11 (step S1).
11). In response to a connection request from the terminal, the server 12
The side permits the connection and transmits the basic service menu (step S112). In the mobile phone 11, the server 12
Is displayed (step S113), and a menu for downloading a music file is requested (step S114).

In response to the request, the server 12 transmits a music file search menu to the mobile phone 11 (step S115). The search menu is displayed on the mobile phone 11, and the user selects a desired music file based on the search menu (steps S116 to S11).
8).

The terminal requests the server 12 for a request for the selected music file, and the server 12 performs processes such as user authentication, member authentication, charging and download permission (step S120), and download is not permitted. In this case, necessary procedures and warnings are displayed on the mobile phone 11 (step S121). If the download is permitted, the server 12 acquires the user's unique data, here, for example, the telephone number of the mobile phone 11 and the terminal-specific ID (step S122), and uses the unique data as a password for music information (eg, ISRC)
Is embedded in the music file as digital watermark data (step S124). Then, the terminal takes in the music file in which the watermark data is embedded (step S12).
5).

Next, a specific embedding method of digital watermark data will be described. In this embodiment, the password for the digital watermark data and the TKI is, for example, the telephone number of the mobile phone 11 or the terminal-specific ID, and the music file is the MIDI data. For example, the above-described digital watermark data is added to or replaced with a MIDI event in MIDI data.
The algorithm for embedding digital watermark data in MIDI data is not limited to this.

When encrypting the above-mentioned digital watermark data or encrypting the MIDI data in which the digital watermark data is embedded, the digital watermark embedding algorithm can be concealed by using the common key.

Here, as the common key, an ID or password set by the user, a unique hardware identification number owned by the mobile phone 11, or the like can be used. By using such a common key, even when MIDI data in which digital watermark data is embedded outside is extracted, it is possible to make the digital watermark data resistant to attacks. If there is no need to educate the common key, "000
It may be set to a fixed value such as "0", or an individual password may be prepared for each song. Instead of each song, a certain password may be prepared for each month when the song is released, for each genre of the song, or for each distributor that distributes the song.

Also, Japanese Patent Application No. Hei 11-302 filed by the present applicant.
No. 095, data obtained by adding an error detection code to watermark data may be provided with the above-mentioned common key as a password for encryption.

For example, when the data that can be embedded as digital watermark data is 8 bytes, the data can be divided into 4 bits and a telephone number of up to 16 digits can be described. Alternatively, a telephone number once encrypted with the above-described common key may be used as 8-byte digital watermark data. In general, an algorithm for embedding digital watermark data gives an attacker of digital watermark data an algorithm for embedding digital watermark data and data with embedded digital watermark when the algorithm is made public. To easily decipher the digital watermark data. A code that cannot be directly known from the user, such as an ISRC or a music management number in a company, is better.

As described above, in order to make the MIDI data embedded with the digital watermark data usable by another terminal, first, the data embedded as the digital watermark is erased, and further, the mobile phone's own mobile phone is used. Phone number and terminal I
It is necessary to obtain D and use it as a password to embed music information such as ISRC again as digital watermark data. Since the music information such as ISRC is not disclosed, it is difficult to obtain it, and thus these operations are almost impossible.
It is much cheaper to purchase DI data, so that fraudulent poppies can be prevented.

In the above description, the case where a music file is reproduced has been described as an example. However, when a music file is used for karaoke or the like, digital watermark data is individually added to each data such as lyrics character display data which is downloaded at the same time. Embedded in the file, and can be reproduced only when they all match, thereby making it possible to more reliably prevent unauthorized copying.

In a music file format such as SMF, the MID in which digital watermark data is embedded is used.
I data is a track chunk
k).

[0057]

As described above in detail, according to the digital watermark embedding method, the music data distribution method, the music data recording method, and the music data reproducing method according to the present invention, the general information description area and the file of the SD memory card can be used. The same information is described in the watermark information, and when it matches, it can be played back.Furthermore, the unique data and telephone number of the terminal such as a mobile phone are used as a common key in the digital watermark and the general information description area of the memory card. By describing the music information data to be described in the music file, it is possible to prevent illegal copying of the music file.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram showing one form of an audio format of SD audio and a sound format of SD audio recorded on an SD memory card.

FIG. 2 is an explanatory diagram schematically showing management of sound data.

FIG. 3 is an explanatory diagram schematically showing management of still image data and moving images.

FIG. 4 is an explanatory diagram schematically showing management of a wave form and audio data.

FIG. 5 is an explanatory diagram schematically showing management of DLS data.

FIG. 6 shows a block diagram of a playback device.

FIG. 7 is an explanatory diagram schematically showing track management of a play list.

FIG. 8 is an explanatory diagram showing a playlist manager (PLMG) in detail.

FIG. 9 shows playlist manager information (P
FIG. 4 is an explanatory diagram showing a format of an LMGI) in detail.

FIG. 10: Track information manager (TK
MG) and its track information # 1 (TKI
It is a figure which shows # 1) in detail.

FIG. 11 Truck General Information (T
FIG. 4 is an explanatory diagram showing the format of a KGI) in detail.

FIG. 12 is a diagram showing a POB manager (POBMG) in detail.

FIG. 13 is an explanatory diagram showing a VOB manager (VOBMG) in detail.

FIG. 14 is an explanatory diagram showing a WOB manager (WOBMG) in detail.

FIG. 15 shows WOB count information (WOB count information);
FIG. 3 is a diagram showing the format of CI) in detail.

FIG. 16 is a diagram showing an AOB manager (AOBMG) in detail.

FIG. 17 is an explanatory diagram showing a DOB manager (DOBMG) in detail.

FIG. 18 is a diagram collectively showing presentation data.

FIG. 19 is a diagram showing a still image object POB in detail.

FIG. 20 is a diagram showing a video (moving image) object VOB in detail.

FIG. 21 is a diagram showing a wave form object WOB in detail.

FIG. 22: Downloadable sound object DO
FIG.

FIG. 23 is a flowchart for explaining the operation of the playback device of the SD memory card.

FIG. 24 is a flowchart for explaining a recording operation to an SD memory card.

FIG. 25 is a diagram showing ISRC in detail.

FIG. 26 is a diagram showing an embodiment of the terminal device according to the present invention.

FIG. 27 is a flowchart showing the operation of the music playback sequencer unit of the terminal device according to the present invention.

FIG. 28 is a flowchart showing another operation of the music playback sequencer unit of the terminal device according to the present invention.

FIG. 29 is a block diagram showing a music encoding unit according to the present invention.

FIG. 30 is a flowchart showing the operation of the music encoding unit according to the present invention.

FIG. 31 is a flowchart showing a data distribution method according to the present invention.

[Explanation of symbols]

 1 SD memory card 2 SD_SOUND. PLM 3 SD_SOUND. TKM 4 SOB1234. MID 5 Music playback sequencer 6 MIDI sound source 7 Speaker

Claims (4)

[Claims] 1. A digital watermark embedding method for embedding digital watermark data in music data, comprising: embedding unique music information of the music data in the music data as digital watermark data; A digital watermark embedding method characterized in that the electronic watermark is recorded in a file provided in the electronic document. 2. Embedding unique music information of music data as digital watermark data in the music data,
A music data distribution method, wherein the music information is recorded in a file provided other than the music data, and music data in which the digital watermark data is embedded and a file in which the music information is recorded are distributed. 3. Embedding unique music information of music data as digital watermark data in the music data,
A music data recording method, comprising: recording the music information in a file provided other than the music data; and recording music data in which the digital watermark data is embedded and a file in which the music information is recorded. 4. When playing back music data in which unique music information included in music data has been embedded as electronic watermark data in advance and a file provided in addition to the music data and recording the music information, the music data Wherein the music data is reproduced only when the music information embedded as electronic watermark data in the music data matches the music information recorded in a file provided other than the music data.