JP2004310054A - Music file generation apparatus, music file generation method, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To permit the utilization of music consisting of a singing voice and a BGM (background music), as the ringing tone, even in the present kind of mobile phone that is not equipped with a large-capacity memory, the MP3 (MPEG 1-Audio Layer-3) recorder, or the like. <P>SOLUTION: There are provided with a singing voice extraction part 2 for extracting the singing voice of a person from digital sound source data 11 and for obtaining singing voice data 12 according to the ADPCM (adaptive differential pulse code modulation) format, a BGM generation part 13 for generating the BGM data 13 according to the MIDI (music instrument digital interface) format, an MIDI adjustment part 4 for generating simulated singing voice data according to the MIDI format matching with the extracted singing voice and for adding it to the BGM data 13, and a file generation part 5 for processing the singing voice data 12 and the BGM + simulated singing voice data 14 into one music file 15. The overall amount of the data is reduced by heavily limiting the band with respect to the singing voice part and by generating the BGM part according to the MIDI format, and the quality of the reproduced singing voice can be maintained so as to be not less than a prescribed level, by supplementing the deteriorated singing voice part due to the band limitation with the MIDI data. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a music file generation device, a music file generation method, and a music file recording medium having a specific data structure, and more particularly to a music file generation method including a human singing voice and BGM (Back Ground Music) and the music file. This is related to the data structure.

  Now, mobile phones have exploded and become one of the devices that everyone has. In the early days of mobile phones, the only ring tone was that of repeating a very monotonous pattern sound. In time, however, a so-called “ringing melody,” in which a melody created using MIDI (Music Instrument Digital Interface) data sounds a ringtone in response to a market need for a more individual thing, has appeared.

  A few years ago, a mobile phone with a built-in PCM sound source also appeared, and a so-called “ringing voice” that uses the PCM sound source to sound a ringtone with the voice of an artist or the like has been realized. These ringtones and voices can be downloaded and used from sites on the Internet. The user can tailor the mobile phone to his / her own by downloading the content he / she likes to the mobile phone.

  Recently, with the progress of mobile phones, music recorded on a compact disk (CD) or the like is used as a ringtone of the mobile phone (not just a melody sound or a mere human voice, but a human singing voice and BGM). A system (hereinafter, referred to as a “ringing song” system) in which the integrated music itself is used as a ringtone is newly provided. In this kind of ringing song system, a part is cut out from a CD sound source, and the data is compressed in a format such as MP3 (MPEG1 Audio Layer-3) and used as content for distribution.

  However, in the conventional ringing song system, a part of the CD sound source is simply cut out and used as distribution content. Therefore, compared to the conventional ring tone melody (MIDI data) and ring tone voice (PCM data), the amount of data of the ringing song becomes very large, and a large-capacity memory is required in the mobile phone in order to download and use it. Will be needed.

  In order to reproduce a ringing song to the extent that it can be recognized as at least one music piece, it is necessary to cut out a CD sound source for a certain amount of time. Therefore, even if the clipped data is compressed in the MP3 format, it cannot be coped with with a small capacity memory provided in the existing mobile phone. Existing mobile phones have a function of playing back MIDI sound sources and PCM sound sources, but do not have a function of playing back data in MP3 format.

  As described above, the conventional ringing song system has a problem that the service cannot be used unless it is a new model having a very large capacity memory and an MP3 format decoder. One of the reasons why the ringing melody and the ringing voice became large boom was that the reproduction function of the MIDI sound source and the reproduction function of the PCM sound source, which were provided as standard in the mobile phone, could be used as they were. Therefore, it is desired that the service can be used even with the existing model for the ringing song.

  The present invention has been made in view of such circumstances, and enables a current mobile phone not provided with a large-capacity memory, an MP3 decoder, or the like to use a tune composed of singing voice and BGM as a ring tone. The purpose is to.

  The music file generation device of the present invention extracts singing voice from digital voice data composed of a mixture of singing voice and voice other than the singing voice, and obtains singing voice data in PCM format and BGM data in MIDI format. MIDI generating means for generating, simulating singing voice data in MIDI format in accordance with the singing voice extracted by the singing voice extracting means, and adding the simulated singing voice data to the BGM data to adjust the MIDI data; File generating means for processing the singing voice data in the PCM format generated by the singing voice extracting means and the BGM + simulated singing voice data in the MIDI format generated by the MIDI generating means into one music file. . The voice other than the singing voice is, for example, BGM or noise.

  In another aspect of the present invention, the singing voice extracting means performs a process of band-limiting digital voice data obtained by mixing the singing voice and voices other than the singing voice to a predetermined frequency band corresponding to the singing voice. It is characterized by performing.

  In another aspect of the present invention, the music file generated by the file generating means includes MIDI reproduction control information for reproducing the MIDI format BGM + simulated singing voice data generated by the MIDI generating means, and the singing voice extracting means. And PCM reproduction control information for reproducing the singing voice data in the PCM format generated by the above in synchronization with the simulated singing voice data.

  The music file generating method according to the present invention further includes a first step of extracting the singing voice from digital voice data obtained by mixing a singing voice and a voice other than the singing voice to obtain PCM format singing voice data; A second step of generating BGM data; generating simulated singing voice data in MIDI format in accordance with the singing voice extracted in the first step; and simulating the singing voice data with respect to the BGM data generated in the second step. A third step of adjusting the MIDI data by adding the singing voice data, the PCM-format singing voice data generated in the first step, the MIDI-format BGM + simulated singing voice data adjusted in the third step, and Into a single music file.

  In another aspect of the present invention, in the first step, a process of band-limiting digital voice data composed of a mixture of the singing voice and voices other than the singing voice to a predetermined frequency band corresponding to the singing voice. Is performed.

  In another aspect of the present invention, in the fourth step, the singing voice data in the PCM format generated in the second step and the BGM + simulated singing voice data in the MIDI format generated in the third step are reproduced. An adjustment process for synchronizing timing is performed.

  In another aspect of the present invention, the music file generated in the fourth step includes MIDI reproduction control information for reproducing the MIDI format BGM + simulated singing voice data generated in the third step; PCM reproduction control information for reproducing the PCM format singing voice data generated in step 2 in synchronization with the simulated singing voice data.

  Further, the computer readable recording medium of the present invention is a computer readable singing voice data in the MIDI format generated according to the singing voice of the PCM data with respect to the PCM data including the singing voice data in the PCM format and the BGM data in the MIDI format. And music data having a data structure in which the PCM data and the MIDI data are integrated into one file.

  In another aspect of the present invention, the music file includes MIDI playback control information for playing back the MIDI data, and PCM playback control information for playing back the PCM data in synchronization with the MIDI data. It is characterized by.

  As described above, according to the present invention, it is possible to reduce the data amount of the music file to the extent that it falls within the limited range of the file capacity for the ringtone of the current mobile phone type, and the quality of the reproduced sound is also at a predetermined level. The above can be maintained. As a result, it is possible to use the ringtone service even with the current mobile phone type that does not include a large-capacity memory, an MP3 decoder, and the like.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram illustrating a configuration example of a music file generation system according to the present embodiment. As shown in FIG. 1, the music file generation system 100 of the present embodiment includes a recording unit 1, a singing voice extraction unit 2, a BGM generation unit 3, a MIDI adjustment unit 4, and a file generation unit 5.

  The recording unit 1 records digital sound source data such as a CD (Compact Disc) and a DVD (Digital Versatile Disk) on a hard disk or the like of a computer in a WAV format. For example, by setting a commercially available CD in a CD drive of a personal computer (hereinafter, a personal computer) and recording the data on a hard disk built in the personal computer, the digital sound source data 11 in the WAV format can be obtained.

  The WAV format is a Windows (registered trademark) standard audio file format, and is also called a WAVE format. It is defined as a storage format for recording digital audio signals. Any compression method can be used. By default, it supports compression methods such as the PCM (no compression) method and the ADPCM (Adaptive Differential Pulse Code Modulation) method.

  The singing voice extracting section 2 cuts out a desired few measures (for example, the beginning or climax part of a music piece) from the WAV format digital sound source data 11 in which human singing voice and BGM are mixed, and then discards the BGM. Extract only the human singing voice part. At this time, the digital audio data 11 in the WAV format is converted into the singing voice data 12 in the ADPCM format according to the reproduction format implemented in the mobile phone.

  Specifically, for example, in the case of a CD, the digital sound source data 11 sampled at 44.1 KHz is subjected to band limitation up to a predetermined frequency band (4 KHz or 8 KHz) corresponding to a human singing voice. That is, the digital sound source data 11 is sampled at regular intervals corresponding to 4 KHz or 8 KHz. Although the PCM format is used for simple sampling, the amount of data is reduced by recording the difference from the immediately preceding sampled data by utilizing the fact that the sound continuously changes. This is the ADPCM format.

  The BGM generation unit 3 generates BGM data 13 in the MIDI format. Here, for example, a personal computer is provided with a MIDI sound source, and BGM is generated by DTM (Desk Top Music) using an application program called sequence software installed in the personal computer. The BGM data 13 generated here is BGM corresponding to the portion discarded by the singing voice extraction unit 2. Note that DTM is an example of a method of generating MIDI data, and the present invention is not limited to this method.

  If the singing voice data 12 extracted by the singing voice extraction unit 2 and the BGM data 13 generated by the BGM generation unit 3 are combined, the same original music as a digital sound source such as a CD can be created. The singing voice data 12 is generated by greatly band-limiting the original digital sound source data 11, and the data amount is considerably reduced. Further, since the BGM data 13 is in the MIDI format, the data amount is originally small. Therefore, the data amount is much smaller than that of data simply cut out from a CD sound source and compressed in the MP3 format.

  However, the singing voice data 12 extracted by the singing voice extraction unit 2 is deteriorated, and can be hardly recognized as a human voice even if reproduced as it is. Although the deterioration can be suppressed by increasing the sampling frequency, the data amount of the singing voice data 12 increases. Therefore, in the present embodiment, a method is used in which the quality of the output singing voice is maintained at a certain level or more while boosting the singing voice of the human with MIDI data, thereby avoiding an increase in the data amount of the singing voice data 12. . The MIDI adjusting unit 4 is used for that purpose.

  The MIDI adjusting unit 4 generates simulated singing voice data in the MIDI format that simulates the singing voice in accordance with the pitch, tempo, tone, volume, etc. of the singing voice extracted by the singing voice extracting unit 2. Then, the simulated singing voice data is added to the BGM data to adjust the MIDI data. The adjustment of the MIDI data is also performed by, for example, DTM.

  Even if the simulated singing voice data generated here is reproduced alone, it cannot be heard as a human singing voice. However, when played back simultaneously with the singing voice data 12 extracted by the singing voice extracting unit 2, the portion degraded by the singing voice data 12 in the ADPCM format is complemented by the simulated singing voice data in the MIDI format, and can be heard well as human singing voice. .

  The file generation unit 5 processes the singing voice data 12 in ADPCM format generated by the singing voice extraction unit 2 and the BGM + simulated singing voice data 14 in MIDI format adjusted by the MIDI adjustment unit 4 into one music file 15. Perform processing. The music file 15 generated here is written out according to a format unique to the carrier of the mobile phone. For example, in the case of DOCOMO, the music file 15 in the MLD format is generated according to MFi (Melody Format for i-mode: i-mode is a registered trademark).

  As described above, it is important to reproduce the singing voice data 12 of ADPCM and the simulated singing voice data of MIDI at the same time without deviation. Therefore, when generating the music file 15 in the MLD format, an adjustment is made to synchronize the reproduction timing of the singing voice data 12 and the BGM + simulated singing voice data 14. Specifically, binary performance position information (start position and end position of performance, sounding time, etc.) defined in the MLD format is appropriately set for both the singing voice data 12 and the BGM + simulated singing voice data 14.

  Each of the functional blocks 1 to 5 of the music file generation system 100 configured as described above is actually configured to include a CPU or an MPU, a RAM, a ROM, and the like of a computer, and a program stored in the RAM or the ROM operates. This can be achieved by:

  FIG. 2 is a conceptual diagram conceptually showing the data structure of the music file 15. Generally, an MLD file has three parts: a file header part containing an identifier of the file itself, a data information part containing information on data of the file, and a track part containing actual music data. 4 schematically shows the structure of a track portion.

  As shown in FIG. 2, the music file 15 includes singing voice data 12 in ADPCM format and BGM + simulated singing voice data 14 in MIDI format. In FIG. 2, the horizontal axis indicates the time direction, and the hatched portions indicate the reproduction timing of the BGM 21, the simulated singing voice 22, and the singing voice 23, respectively. In the example of FIG. 2, the MIDI BGM 21 flows continuously from the beginning to the end, and the MIDI singing voice 22 flows at two points in the middle. The image shows that the singing voice 23 of ADPCM also flows at the same time as the simulated singing voice 22 flows.

  In the BGM + simulated singing voice data 14 in the MIDI format, the portion of the BGM 21 and the portion of the simulated singing voice 22 may be generated as separate MIDI data, or may be generated as one piece of MIDI data. In the former case, the performance position information of the BGM 21 and the performance position information of the simulated singing voice 22 are set separately. In the latter case, the BGM 21 and the simulated singing voice 22 are defined as chord data. That is, one MIDI data is defined as a chord of the BGM 21 only at a timing when the simulated singing voice 22 does not flow, and as a chord combining the BGM 21 and the simulated singing voice 22 at a timing at which the simulated singing voice 22 flows. In this case, performance position information is set for the one MIDI data.

  On the other hand, with respect to the singing voice data 12 in the ADPCM format, the performance position information of the singing voice 23 is set so that the singing voice 23 flows simultaneously with the simulated singing voice 22.

  As described above, the music file 15 of the present embodiment includes the MIDI reproduction control information necessary for reproducing the BGM + simulated singing voice data 14 in the MIDI format at an appropriate timing, and the singing voice data 12 in the ADPCM format as the BGM + simulated singing voice data 14. And PCM reproduction control information necessary for reproducing at an appropriate timing in synchronization with.

  FIG. 3 is a flowchart illustrating a processing procedure of the music file generation method according to the present embodiment. In FIG. 3, the recording section 1 first records digital sound source data 11 such as a CD or DVD on a hard disk or the like of a computer in a WAV format (step S1). Next, the singing voice extracting unit 2 cuts out a desired portion (such as a head portion or a chorus portion) of the recorded WAV format digital sound source data 11 (step S2). The cut-out portion is not limited to one location, but may be a plurality of locations. Also, a plurality of cut out portions may be connected to be combined into one.

  This cutout process may be performed according to a user's instruction made using a keyboard, a mouse, or the like, or may be automatically performed by a computer. When the computer automatically performs, for example, when cutting out the beginning of a song, it is possible to automatically cut out the corresponding portion by designating the number of measures to be cut out. Further, when cutting out the rust portion, it is possible to predict the rust portion by detecting the start of the back chorus, a change in volume, a change in tune, and the like, and to cut out the rust portion automatically.

  The singing voice extracting unit 2 further performs a process of band-limiting the cut-out digital sound source data 11 to a predetermined frequency band (4 KHz or 8 KHz) corresponding to a human singing voice, thereby discarding the BGM and discarding the human singing voice. Is extracted (step S3). Thereby, the singing voice data 12 in the ADPCM format is generated. When the cutout process is performed based on an instruction from the user, the order of steps S2 and S3 may be reversed.

  The BGM generator 3 generates BGM data 13 corresponding to the portion discarded by the singing voice extractor 2 in the MIDI format by, for example, DTM (step S4). The BGM data 13 in the MIDI format largely depends on the built-in sound source of each model of the mobile phone. Therefore, the expression method is adjusted for each model in MML (Music Markup Language) (step S5). Next, the MIDI adjustment unit 4 generates simulated singing voice data in the MIDI format that simulates the singing voice extracted by the singing voice extraction unit 2, adds the simulated singing voice data to the BGM data, and adjusts the MIDI data (step S6). Note that the order of the processing of steps S1 to S3 and the processing of steps S4 to S6 may be reversed.

  Lastly, the file generation unit 5 processes the singing voice data 12 in ADPCM format generated in steps S1 to S3 and the BGM + simulated singing voice data 14 in MIDI format generated in steps S4 to S6 into one music file 15. (Step S7). Here, a file is written in binary data according to the format of the carrier of the mobile phone. In the above example, the MLD format of DoCoMo was described, but the music file 15 is generated according to the PMD format for au, and the SMD format for J-phone. A music file 15 of a plurality of carriers may be generated for one music.

  FIG. 4 is a diagram illustrating a configuration example of a music distribution system according to the present embodiment using the music file 15 generated as described above. In FIG. 4, reference numeral 300 denotes a music distribution server that distributes the music file 15, and 400 denotes a mobile phone that receives the distribution of the music file 15, which can be connected to the Internet 500.

  As shown in FIG. 4, the music distribution server 300 includes a music file acquisition unit 31, a reproduction program acquisition unit 32, a customer information acquisition unit 33, a database (DB) registration unit 34, a distribution music DB 35, a distribution program DB 36, a customer DB 37, It comprises an encapsulation unit 38, a customer information reference unit 39, and a communication unit 40.

  The music file acquisition unit 31 acquires the music file 15 generated by the music file generation system 100 into the music distribution server 300. The reproduction program acquisition section 32 acquires the music reproduction program (music reproduction player) generated by the reproduction program generation system 200 into the music distribution server 300.

  More specifically, the music file acquisition unit 31 and the reproduction program acquisition unit 32 import the music file 15 and the music reproduction program into the music distribution server 300 via a recording medium such as a CD or a flexible disk, or use the Internet 500 Alternatively, the music file 15 and the music reproduction program are loaded into the music distribution server 300 via another network (not shown).

  The music reproduction program is for instructing the performance of the BGM 21, the simulated singing voice 22, and the singing voice 23 in accordance with the performance position information recorded in the music file 15. The PCM playback control program instructs the synthesizer built in the mobile phone to play the singing voice data 12 in the ADPCM format, the MIDI playback control program instructs the synthesizer to play the BGM + simulated singing voice data 14 in the MIDI format. Contains. This music playback program is also tailored to the differences in the specifications of each mobile phone carrier.

  The customer information acquisition unit 33 acquires various information about the customer (for example, name, user ID, password, carrier and model of the mobile phone 400 used by the customer). Specifically, when the user first accesses the music distribution server 300 from the mobile phone 400 via the Internet 500, the user requests information input (for example, presents an information input screen). , Get the required customer information.

  The DB registration unit 34 registers the music files 15 corresponding to various specifications acquired by the music file acquisition unit 31 in the distribution music DB 35 as music data files for ringing songs. In addition, music playback programs corresponding to various specifications acquired by the playback program acquisition unit 32 are registered in the distribution program DB 36. In addition, the customer information acquired by the customer information acquisition unit 33 is registered in the customer DB 37. The distribution music DB 35 constitutes a recording medium of the present invention.

  In response to the distribution request from the user, the encapsulation unit 38 reads the music file 15 corresponding to the carrier and model of the mobile phone 400 used by the user from the distribution music DB 35, and reads the music file 15 with the carrier of the mobile phone 400. The music reproduction program corresponding to the model is read from the distribution program DB 36, and the music reproduction program is encapsulated to create a concatenation file. When there is a music distribution request from the user, the customer information reference unit 39 refers to the customer DB 37 to grasp the carrier and model of the mobile phone 400 used by the requesting user, and the encapsulation unit 38 Perform the process of telling

  Encapsulation is a process in which the binary data of the music file 15 and the binary data of the music reproduction program are combined into a single file, and the generated object is a self-contained, unified management of Java (registered trademark). Implement as a mechanism to start the program when a call arrives using the class distribution process of As a method of encapsulating the music reproduction program in the music file 15, there are a method of dynamically combining at the time of a music distribution request and a method of preparing a static combination in advance by batch processing in advance. This embodiment can deal with any of them.

  Further, the file to be distributed can adopt either a method according to a Java file or a method according to a protocol for reproducing an own file by establishing an arbitrary file format. Regarding the file to be distributed, the physical division configuration is not a problem, and it is necessary that the file be a logical single file configuration. Regarding logical unity, it is only necessary that the process of constructing the mounting environment satisfies the completeness in the operability when the user downloads the music.

  The communication unit 40 performs processing related to communication with the mobile phone 400 via the Internet 500. For example, a process of transmitting the customer information sent from the mobile phone 400 to the customer information acquisition unit 33 is performed. In addition, a process of receiving a distribution request of a desired music sent from the mobile phone 400 and transmitting the request to the encapsulation unit 38 and the customer information reference unit 39 is performed. Further, a process of distributing the concatenation file generated by the encapsulation unit 38 to the mobile phone 400 of the request source is also performed. A memory (not shown) in the mobile phone 400 that stores the music file 15 included in the concatenation file also constitutes a recording medium of the present invention.

  The operation of each of the functional blocks 31 to 34, 38 to 40 in the music distribution server 300 described above is controlled by a control unit (not shown) including a CPU or an MPU, a ROM, a RAM, and the like. It has become. Each of the DBs 35 to 37 is configured by a recording medium such as a hard disk, for example.

  Next, the operation of the music distribution system according to the present embodiment configured as described above will be described with reference to the flowchart of FIG. FIG. 5 is a flowchart showing the operations of music distribution and customer registration in the music distribution server 300.

  As shown in FIG. 5, a control unit (not shown) in music distribution server 300 determines whether or not mobile phone 400 has accessed communication unit 40 (step S11). If there is access from the mobile phone 400, the control unit further determines whether a password has already been set for the user of the mobile phone 400 (step S12). Here, it is determined whether or not access has been performed with password input.

  If a password has not been set for the user, the control unit uses the communication unit 40 to present a predetermined information input screen to the mobile phone 400, thereby prompting the user to input customer information. Then, the customer information acquisition unit 33 acquires the customer information input correspondingly, and the DB registration unit 34 registers the customer information in the customer DB 37 (step S13). After that, the control unit issues a unique password to the user (step S14).

  If it is determined in step S12 that a password has already been issued to the user (if access has been performed with password input) and if a new password has been issued in step S14, the control unit determines that password. An approval process is performed (step S15). If the password is incorrect, a warning message to that effect is output and the processing is interrupted.

  On the other hand, if the password has been approved, the control unit presents a member-specific sound source menu screen to the mobile phone 400 using the communication unit 40 (step S16). Through this sound source menu screen, the user can request the music distribution server 300 to download the desired music. The control unit determines whether or not there has been a request for distribution of the desired music from the mobile phone 400 (step S17), and if not, returns to the process of step S11.

  If there is a music distribution request, the customer information reference unit 39 grasps the carrier and model of the requesting mobile phone 400 by referring to the customer DB 37, and transmits it to the encapsulation unit 38 (step S18). The encapsulation unit 38 reads out the music reproduction program corresponding to the carrier and the model transmitted from the customer information reference unit 39 from the distribution program DB 36, and the carrier transmitted from the customer information reference unit 39 in the music requested to be distributed by the user. Then, the music file 15 corresponding to the model is read from the distribution music DB 35 and encapsulated to create a concatenation file (step S19).

  Finally, the communication unit 40 distributes the concatenation file created by the encapsulation unit 38 to the mobile phone 400 (step S20). The mobile phone 400 that has received the concatenation file executes the reproduction of the music file 15 by the music reproduction program included therein.

  As described above in detail, according to the present embodiment, a digital sound source such as a CD is separated into a singing voice portion and a BGM portion, and the singing voice portion is largely band-limited to have an ADPCM format to reduce the data amount. The amount of data was reduced by generating data in the MIDI format for the BGM portion. As a result, the data amount can be remarkably reduced as compared with the conventional method in which a CD sound source or the like is simply cut out and compressed in the MP3 format. Further, since the singing voice portion degraded by the band limitation is compensated for by the MIDI data, the quality of the singing voice to be reproduced can be maintained at a predetermined level or more.

  Therefore, while maintaining the file size limitation (for example, 10 Kbytes in the case of DoCoMo), which is a restriction on the ringtone of the current mobile phone type, ringtone voices whose quality is guaranteed to a certain level or higher are distributed to the mobile phone. It becomes possible to reproduce. That is, according to the present embodiment, the service of the ringing song can be used even with the current mobile phone type that does not include a large-capacity memory, an MP3 decoder, and the like.

  In the above-described embodiment, an example has been described in which the music file 15 is generated for a ringtone of a mobile phone, but the present invention is not necessarily limited to the case of generating a music file. The music file 15 of the present embodiment can be applied to a system that needs to reproduce music composed of singing voice and BGM with a small memory capacity. In this case, as a recording medium for storing the music file 15, a CD-ROM, a flexible disk, a hard disk, a magnetic tape, an optical disk, a magneto-optical disk, a DVD, a non-volatile memory card, and the like can be used. Construct a recording medium.

  Further, in the above-described embodiment, an example has been described in which the recording unit 1 records digital sound source data such as a CD or a DVD in a hard disk or the like of a computer in a WAV format, but is not limited thereto. For example, a singing voice sung by a user with a karaoke back at a recreation facility such as a karaoke box or a game center may be input from a microphone and recorded in a WAV format. In this case, not only the singing voice but also the surrounding noise is recorded at the same time, but the singing voice extracting unit 2, the BGM generating unit 3, the MIDI adjusting unit 4, and the file generating unit 5 perform the same processing as in the above embodiment, It is possible to generate a good ringing song file with no noise in the user's own singing voice.

  In this example, a recording device having the function of the recording unit 1 is installed independently in an entertainment facility such as a karaoke box or a game center, and a singing voice extraction unit 2, a BGM generation unit 3, a MIDI adjustment unit 4, a file generation unit 5 Can be provided in an editing computer separate from the recording device. In this case, data recorded by the recording unit 1 is input to an editing computer via a recording medium such as a CD, a flexible disk, a hard disk, a magnetic tape, an optical disk, a magneto-optical disk, a DVD, an MD, and a nonvolatile memory card. The recording may be transmitted from the recording device to the editing computer via a communication network such as the Internet. The generated ringing song file may also be transmitted from the editing computer to the user's mobile phone via the communication network.

  A device having all of the functions of the recording unit 1, the singing voice extracting unit 2, the BGM generating unit 3, the MIDI adjusting unit 4, and the file generating unit 5 may be installed in an entertainment facility such as a karaoke box or a game center. . In this case, the BGM generation unit 3 can be replaced with a function of holding MIDI-format BGM data to be reproduced as karaoke when recording a singing voice. That is, the BGM data in the MIDI format stored in advance is reproduced at the time of recording the singing voice, and a ringing song file is generated using the same BGM data and the singing voice data extracted from the recorded voice. At this time, the MIDI adjusting unit 4 analyzes the pitch, tempo, tone, volume, etc. of the singing voice recorded in accordance with the karaoke, generates MIDI-like pseudo singing voice data according to the analysis result, and adds the data to the BGM data.

  In addition, the above-described embodiment is merely an example of the embodiment for carrying out the present invention, and the technical scope of the present invention should not be interpreted in a limited manner. That is, the present invention can be embodied in various forms without departing from the spirit or main features thereof.

Further, other embodiments of the present invention will be described below.
1. A data distribution system that distributes a music file from a data distribution server to a requesting terminal,
Data storage means for storing in advance a music file generated by the music file generation device according to claim 1;
Playback program storage means for storing in advance playback programs corresponding to the respective specifications of the terminal,
When there is a request for distribution of desired data from the requesting terminal, the corresponding music file is read from the data storage means, and a reproduction program corresponding to the specification of the requesting terminal is read from the reproduction program storage means. A data distribution system, comprising: transmission means for reading and transmitting the music file and the reproduction program to the requesting terminal.
2. 2. The data distribution system according to claim 1, wherein the transmission unit includes an encapsulation unit that logically encapsulates the music file and the reproduction program into one file.
3. A data distribution server that distributes a music file to a requesting terminal,
Data storage means for storing a music file generated by the music file generation device according to claim 1;
Reproduction program storage means for storing a reproduction program corresponding to each specification of the terminal,
When there is a request for distribution of desired data from the requesting terminal, the corresponding music file is read from the data storage means, and a reproduction program corresponding to the specification of the requesting terminal is read from the reproduction program storage means. A data distribution server, comprising: transmission means for reading and transmitting the music file and the reproduction program to the requesting terminal.
4. 4. The data distribution server according to claim 3, wherein the transmission unit includes an encapsulation unit that logically encapsulates the music file and the reproduction program into one file.

  INDUSTRIAL APPLICABILITY The present invention is useful for making a tune composed of a singing voice and BGM available as a ring tone even in a current mobile phone not provided with a large-capacity memory or an MP3 decoder.

It is a figure showing the example of composition of the music file generation system concerning this embodiment. It is a conceptual diagram showing the data structure of the music file concerning this embodiment. It is a flowchart which shows the processing procedure of the music file generation method by this embodiment. It is a figure showing the example of composition of the music distribution system by this embodiment. It is a flowchart which shows the operation | movement of music distribution and customer registration in the music distribution server by this embodiment.

Explanation of reference numerals

Reference Signs List 1 recording unit 2 singing voice extracting unit 3 BGM generating unit 4 MIDI adjusting unit 5 file generating unit 11 digital sound source data in WAV format 12 singing voice data in ADPCM format 13 BGM data in MIDI format 14 BGM + simulated singing voice data in MIDI format 15 MLD format Music file 21 BGM
22 Simulated singing voice 23 Singing voice 31 Music file acquisition unit 32 Reproduction program acquisition unit 33 Customer information acquisition unit 34 DB registration unit 35 Distribution music DB
36 Distribution program DB
37 Customer DB
38 Encapsulation unit 39 Customer information reference unit 40 Communication unit 100 Music file generation system 200 Playback program generation system 300 Music distribution server 400 Mobile phone 500 Internet

Claims (13)

Singing voice extracting means for extracting the singing voice from digital voice data composed of a mixture of a singing voice and a voice other than the singing voice and obtaining singing voice data in PCM format;
In addition to generating MIDI-format BGM data, it generates MIDI-format simulated singing data in accordance with the singing voice extracted by the singing voice extracting means, and adds the simulated singing data to the BGM data to adjust the MIDI data. MIDI generating means for performing;
File generating means for processing the singing voice data in the PCM format generated by the singing voice extracting means and the BGM + simulated singing voice data in the MIDI format generated by the MIDI generating means into one music file. Music file generation device. The music file generation device according to claim 1, wherein the voice other than the singing voice is BGM. The music file generating apparatus according to claim 1, wherein the voice other than the singing voice is noise. The said singing voice extraction means performs the process which carries out band limitation to the predetermined frequency band corresponding to the said singing voice with respect to the digital voice data which mixed the said singing voice and the voice other than the said singing voice. 2. The music file generation device according to 1. The music file generated by the file generating means includes MIDI reproduction control information for reproducing the MIDI-format BGM + simulated singing voice data generated by the MIDI generating means, and the PCM-format singing voice generated by the singing voice extracting means. The music file generating apparatus according to claim 1, further comprising PCM reproduction control information for reproducing data in synchronization with the simulated singing voice data. A first step of extracting the singing voice from digital voice data composed of a mixture of a singing voice and a voice other than the singing voice to obtain singing voice data in PCM format;
A second step of generating MIDI-format BGM data;
MIDI simulated singing data is generated in accordance with the singing voice extracted in the first step, and the simulated singing data is added to the BGM data generated in the second step to adjust the MIDI data. 3 steps,
A fourth step of processing the PCM-format singing voice data generated in the first step and the MIDI-format BGM + simulated singing data adjusted in the third step into one music file; A music file generation method characterized by the following. 7. The music file generation method according to claim 6, wherein the voice other than the singing voice is BGM. The music file generating method according to claim 6, wherein the voice other than the singing voice is noise. In the first step, band limiting is performed on digital audio data obtained by mixing the singing voice and voices other than the singing voice to a predetermined frequency band corresponding to the singing voice. Item 7. A music file generation method according to Item 6. In the fourth step, an adjustment process for synchronizing the reproduction timing of the PCM format singing voice data generated in the second step and the MIDI format BGM + simulated singing voice data generated in the third step is performed. 7. The music file generation method according to claim 6, wherein: The music file generated in the fourth step includes MIDI playback control information for reproducing the MIDI format BGM + simulated singing voice data generated in the third step, and the PCM generated in the second step. 7. The music file generation method according to claim 6, further comprising PCM reproduction control information for reproducing the singing voice data in a format synchronized with the simulated singing voice data. PCM data comprising singing voice data in PCM format;
MIDI data including MIDI data to which BGM data in the MIDI format and simulated singing data in the MIDI format generated according to the singing voice of the PCM data are added;
A computer-readable recording medium on which a music file having a data structure in which the PCM data and the MIDI data are integrated into one file is recorded. 13. The music file according to claim 12, wherein the music file includes MIDI reproduction control information for reproducing the MIDI data, and PCM reproduction control information for reproducing the PCM data in synchronization with the MIDI data. The computer-readable recording medium according to the above.

Images