JP4229058B2 - Terminal device and recording medium - Google Patents

Description

  The present invention relates to a technique for reproducing music from music data in a terminal device.

In mobile terminals such as cellular phones, techniques for reproducing pronunciation data in various data formats (formats) such as pronunciation sequence data or pronunciation data such as ADPCM (Adaptive Differential Pulse Code Modulation) data have been developed (for example, , See Patent Document 1). Music data described in such a data format is stored in advance in a portable terminal such as a mobile phone, or music data is downloaded and stored in a music data distribution server or the like via a communication line. In addition, music such as a so-called ringing melody can be played on a portable terminal such as a cellular phone.
JP 2002-099541 A

By the way, when the pronunciation data in the above format is to be reproduced on the portable terminal, the pronunciation data to be reproduced on the portable terminal needs to be stored in advance. Here, when the data size of the sound generation data is large, it is stored or downloaded in the large size. Therefore, in a portable terminal with scarce resources such as a memory storage capacity and a data communication transfer speed, such sound generation data consumes a lot of resources, and in some cases, the resources are insufficient. Also, in such an environment where resources are limited, it is difficult to play high quality music because there is a limit on the size of data that can be transferred. There was also a problem that it was not possible to meet the demands of users who wanted to make it easier.
The present invention has been made in view of the above circumstances, and an object thereof is to provide a music reproduction system that reproduces music data that can store and distribute high-quality music with a small data size.

In order to solve the above-described problems, the present invention provides music data that instructs a terminal device having a function of playing music and a function of connecting to a network to play music, and the music is placed at a predetermined position in the data. Music data having a structure in which location information indicating the location in the network of music piece data corresponding to at least a part of the music piece data is provided.
In a preferred embodiment, the music data has a structure composed of a plurality of channels, and the predetermined position in the data is a position corresponding to a channel to be played back and a time to be played back.
In another preferred aspect, the location information includes a server name of a server that stores a musical piece to be reproduced and a file name of the musical piece.

Further, the present invention provides a first storage means for storing the music data, a communication means for acquiring at least a part of music piece data indicated by the location information via the network, and the communication means. The second storage means for storing the music piece data acquired by the above, the music data stored in the first storage means and the music piece according to the music piece data stored in the second storage means A terminal device having a music reproducing means for performing is provided.
In a preferred aspect, the terminal device includes a monitoring unit that monitors the free space of the second storage unit, and the music piece data when the free space monitored by the monitoring unit satisfies a predetermined condition. Download request generating means for generating a download request instructing acquisition of the download request.
In another preferred aspect, the communication means has a function of transmitting or receiving the music data.
In the above aspect, the terminal device may be a portable terminal device.

  According to the present invention, music piece data of a part of a music piece is acquired via a network, so that a high-quality music piece (voice) can be reproduced even on a terminal having a limited storage capacity.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
<1. Configuration>
FIG. 1 is a block diagram showing a configuration of a music distribution system 1 according to the present embodiment. The distribution server 10 has a database DB1 in which stream audio data such as mp3 data is recorded. The distribution server 10 can communicate with other devices via a network 70 such as the Internet. The distribution server 20 has a database DB2, and has the same function as the distribution server 10. A mobile terminal 50 such as a mobile phone or a PDA (Personal Digital Assistance) can communicate with other devices via the base station 30, the base station 40, and the network 70. That is, the mobile terminal 50 can communicate with the distribution server 10 or the distribution server 20 via the base station 30 (or the base station 40) and the network 70. The portable terminal 60 has the same function as the portable terminal 50.

  FIG. 2 is a block diagram illustrating a hardware configuration of the mobile terminal 50. A CPU (Central Processing Unit) 51 reads and executes a program stored in a ROM (Read Only Memory) 52 using a RAM (Random Access Memory) 55 as a work area. The CPU 51 also has a function of controlling each component of the mobile terminal 50. The mobile terminal 50 according to the present embodiment is a mobile phone, and the audio collected from the microphone is analog / digital converted by the audio processing unit 54, and the digitally converted audio data is wirelessly transmitted via the communication unit 53. It has a function. Further, the portable terminal 50 receives the voice data transmitted via the network 70 by the communication unit 53. The received audio data is digital / analog converted by the audio processing unit 54 and output from the speaker as audio. Furthermore, the portable terminal 50 is not only audio data, but also stream audio data such as mp3 data, performance control data such as SMF (Standard MIDI File) or SMAF (Synthetic music Mobile Application Format), e-mail message, application Data (contents) such as software can be communicated via the communication unit 53. These data are stored in the RAM 55.

  The display unit 56 includes a display device such as an LCD (Liquid Crystal Display), and displays characters and images under the control of the CPU 51. A user of the portable terminal 50 can input an instruction to the portable terminal 50 by operating the input unit 57 such as a numeric keypad or a cross key while viewing characters and images displayed on the display unit 56. The vibrator 58 has a function of vibrating under the control of the CPU 51 and notifying the user of an incoming call or the like. The sound source unit 100 will be described in detail below. The above components are connected to each other via a bus 99.

  FIG. 3 is a block diagram illustrating a configuration of the sound source unit 100. The tone generator 100 has a function of reproducing performance control data such as SMF or SMAF and waveform compression data such as mp3 data. When the reproduction of the performance control data is instructed, the CPU 51 supplies (part of) the performance control data stored in the RAM 55 to the sound source unit 100. A predetermined amount of performance control data is sequentially stored in a FIFO (First-In First-Out) 102 via the I / F 101 from the beginning of the data. The FIFO 102 is a storage means that can store a limited amount of performance control data, and is sequentially read out from the previously written performance control data. The sequencer 103 sequentially reads performance control data from the FIFO 102 and generates sound source control data as needed according to time information (duration) in the performance control data. The sequencer 103 outputs the generated sound source control data to the sound source 104. The sound source 104 outputs digital audio data according to the sound source control data. The audio data is converted into an analog audio signal by a DAC (Digital Analog Converter) 120 and output from the speaker 59 as audio. When the performance control data stored in the FIFO 102 is read and a predetermined amount of free space set in the FIFO 102 is generated, the FIFO 102 uses a dedicated signal line (not shown) for an interrupt request signal (Interrupt ReQuest, IRQ). To the CPU 51, and requests the CPU 51 to transfer the subsequent performance control data. The CPU 51 supplies subsequent performance control data to the FIFO 102 by a predetermined amount.

  On the other hand, when the reproduction of the waveform compressed data is instructed, the CPU 51 supplies (part of) the waveform compressed data stored in the RAM 55 to the sound source unit 100. A predetermined amount of waveform compressed data is taken in from the head of the data to the FIFO 112 via the I / F 111 and stored temporarily. The FIFO 112 is a storage means capable of storing a limited amount of waveform compressed data, and is sequentially read out from the previously written waveform compressed data. The decoder 113 decompresses waveform compressed data such as mp3 data and ADPCM data, and converts it into waveform data (digital audio data). The decoder 113 outputs the converted waveform data. The waveform data is converted into an analog audio signal by the DAC 120 and output from the speaker 59 as audio. When the waveform compression data stored in the FIFO 112 is read and a predetermined amount of free space set in the FIFO 112 is generated, the FIFO 112 sends an interrupt request signal (IRQ) to the CPU 51 via a dedicated signal line (not shown). The CPU 51 is requested to transfer the subsequent waveform compressed data. The CPU 51 supplies subsequent waveform compression data to the FIFO 112 by a predetermined amount. In the present embodiment, the decoder 113 has a function capable of decoding data of two types of formats, mp3 data and ADPCM data. In another aspect, the sound source unit 100 may separately include an mp3 decoder that decodes mp3 data and an ADPCM decoder that decodes ADPCM data. The data format is not limited to the mp3 format and the ADPCM format, and waveform compression data of other formats such as the wma format may be used. In this case, the sound source unit 100 needs to have a decoder suitable for the data format used.

  As described above, the sound source unit 100 includes a processing system (I / F 101, FIFO 102, sequencer 103, sound source 104) for reproducing performance control data, and a processing system (I / F 111, FIFO 112) for reproducing waveform compression data such as mp3 data. , Decoder 113) and two reproduction systems. The performance control data and the waveform compression data are processed by the corresponding reproduction systems, and digital audio data is generated. The audio data generated by the two playback systems is added by the adder 105 and is output as a sound from the speaker 59 in synchronization.

  FIG. 4 is a diagram showing a configuration of the music data D1 according to the present embodiment. The music data D1 has a format composed of five parts (channels) 1 to 5. The data of each part is sequence data having a pair of duration data and event data. The duration data corresponding to certain event data is data indicating the duration (time) from the start time of the previous event to the start time of the event. The event data is data indicating control contents for the output device such as the sound source unit 100. In FIG. 4, parts 1, 3, and 5 are MIDI (Musical Instruments Digital Interface) data having MIDI events as event data. Part 2 is embedded audio data having sound generation data in ADPCM format as event data. Part 4 starts reproduction of data (URL event) indicating a URL (Uniform Resource Locator) indicating a storage location of stream audio data such as mp3 format audio data as event data and the stream audio data as duration data. Data indicating the time to be used. The URL event includes information on a distribution server name and a distribution target file name such as “http://aaa.bbb.co.jp/sing-1.mp3”, for example. The portable terminal 50 downloads and reproduces data (stream audio data) designated from the distribution server designated by this URL.

  The portable terminal 50 stores the music data D1 in the RAM 55. The music data D1 may be stored in advance when the portable terminal 50 is shipped, or may be downloaded and stored from a server via a communication line after shipment. The portable terminal 50 reads the music data D <b> 1 from the RAM 55 and outputs it to the sound source unit 100. The sound source unit 100 reproduces music according to the music data D1 as described above. The music data D1 is music data in which MIDI data, embedded audio data, and stream audio data downloaded from the server are mixed. As described above, the portable terminal 50 according to the present embodiment can reproduce MIDI data (performance control data), embedded audio data, and stream audio data (waveform compressed data) in synchronization. In the present embodiment, by adopting the music data format of such a data format, it is possible to reproduce data of different formats in synchronization.

  FIG. 5 is a block diagram illustrating a hardware configuration of the distribution server 10. The distribution server 10 is a computer device having a CPU 11, a ROM 12, a RAM 13, an I / F 14, an input unit 15, a display unit 16, and a storage unit 17. The storage unit 17 includes a storage device such as an HDD, and stores a database DB1 in which stream audio data such as the above-described mp3 format audio data is recorded. The distribution server 10 is connected to a network 70 such as the Internet via the I / F 14, and has a function of transmitting stream audio data stored in the storage unit 17 in response to a download request received via the network 70. Have. The distribution server 20 also has the same hardware configuration as the distribution server 10. The stream audio data stored in the distribution server 10 is not limited to data in the mp3 format, and may be data described in other formats such as the ADPCM format and the wma format.

<2. Operation>
Next, the operation of the music distribution system 1 will be described.
FIG. 6 is a flowchart showing the operation of the music distribution system 1. When reproduction of music data D1 is instructed on portable terminal 50 (step S101: YES), CPU 51 searches whether or not music data D1 has URL event data prior to reproduction of music data D1 (step S102). ). When the music data D1 has URL event data (step S103: YES), the CPU 51 downloads the data indicated by the URL event data (if there are a plurality of URL event data, the data that appears first in the reproduction of the music data D1). A download request instructing to do so is generated. The CPU 51 transmits the generated download request via the communication unit 53 with the distribution server indicated by the URL event data as the destination (step S104). In this embodiment, the URL event data indicates mp3 format stream audio data D2 (hereinafter, mp3 data D2) stored in the distribution server 10. Therefore, the CPU 51 transmits a download request for the mp3 data D2 to the distribution server 10. Here, the download request includes data size information DS1 indicating the size of data that the portable terminal 50 can receive.
If the music data D1 does not have URL event data (step S103: NO), the CPU 51 proceeds to step S106 described later without performing steps S104 and S105 described later.

When receiving the download request, the CPU 11 of the distribution server 10 searches the database DB1 for the mp3 data D2. When the mp3 data D2 is found, the CPU 11 extracts the mp3 data D2 from the database DB1. The CPU 11 extracts a part of the mp3 data D2 from the head of the extracted mp3 data D2 so that the data has a size specified by the data size information DS1 included in the download request. Hereinafter, a part of the mp3 data D2 is referred to as music piece data D3.
The CPU 11 transmits the extracted music piece data D3 to the portable terminal 50 that is the transmission source of the download request via the I / F 14 and the network 70.

  When the music piece data D3 is received, the CPU 51 of the portable terminal 50 stores the received music piece data D3 in the RAM 55. In the RAM 55, a storage area M1 for music piece data is secured. The CPU 51 stores music piece data D3 in the storage area M1. Further, the CPU 51 causes the RAM 55 to store an address P3, which is information indicating the position of the downloaded data (that is, the start position of the data to be downloaded next) in the mp3 data D2. When the music piece data D3 is stored in the storage area M1 (step S105: YES), the CPU 51 sequentially outputs the music data D1 to the sound source unit 100. Thus, the reproduction of the music data D1 is started (step S106). As will be described below, the process proceeds to steps S107 to S109, but the music continues to be reproduced in these steps until the reproduction of the music is completed.

The sound source unit 100 sequentially reproduces the data of each part shown in FIG. 4 according to time information (duration) and outputs it as sound. For the parts 1, 3, and 5, MIDI data (performance control data) is sequentially supplied to the FIFO 102, and sound corresponding to the MIDI data of each part is reproduced. As for Part 2, ADPCM data (compressed waveform data) is sequentially supplied to the FIFO 112, and the corresponding sound is reproduced. When the URL event is reached in part 4, the sound source unit 100 requests the CPU 51 to transfer the musical piece data D3. The CPU 51 sequentially outputs the music piece data D3 from the storage area M1 to the sound source unit 100 in accordance with the request. Since the music piece data D3 is compressed waveform data in the mp3 format, it is reproduced in the sound source unit 100 by the reproduction system (I / F 111, FIFO 112, decoder 113) of the compressed waveform data. Thus, the stream audio corresponding to the music piece data D3 is reproduced. The music piece data D3 is sequentially supplied according to the storage capacity of the FIFO 112 of the sound source unit 100. Here, the CPU 51 monitors the remaining capacity of the storage area M1.
FIG. 7 is a diagram illustrating a method for monitoring the remaining capacity of the storage area M1. The CPU 51 starts the data that has not yet been output to the sound source unit 100 in the storage area M1 (hereinafter referred to as address P1) and the last address of the data that has not yet been output to the sound source unit 100 (hereinafter referred to as address P2). Is stored in the RAM 55 as a variable (FIG. 7A). Here, the address P1 is a data reading point, and the address P2 is a data writing point.

As the music piece data D3 is output to the sound source unit 100, the address P1 sequentially moves to the rear part. Here, the area from the beginning of the storage area M1 to the address P1 (the white part in FIG. 7B) is an empty area since the data has already been transferred. The CPU 51 calculates the capacity of this empty area, that is, the remaining capacity of the storage area M1, from the addresses P1 and P2 at regular time intervals.
Referring to FIG. 6 again, the CPU 51 monitors whether or not the calculated remaining capacity of the storage area M1 exceeds a predetermined value (for example, half the storage capacity of the storage area M1). (Step S107). When the remaining capacity does not exceed the predetermined value (step S107: NO), the CPU 51 performs the process of step S109 described later without performing the process of step S108 described below.

  When the remaining capacity exceeds a predetermined value (step S107: YES), the music piece data is transferred (step S108). Specifically, it is as follows. CPU51 produces | generates the download request | requirement of the data which follow music piece data D3 among mp3 data D2. This download request includes data size information DS2 indicating the remaining capacity of the storage area M1 (that is, a value half the storage capacity of the storage area M1). This download request also includes an address P3 which is information indicating the position where the download is started in the mp3 data D2. The CPU 51 transmits the generated download request to the distribution server 10 indicated by the URL event data.

  When the download request is received, the CPU 11 of the distribution server 10 extracts data of the size specified by the data size information DS2 from the position specified by the address P3 from the mp3 data D2 (hereinafter referred to as music piece data D4). Called). CPU11 transmits the extracted music piece data D4 to the portable terminal 50 which is a transmission origin of a download request.

  When the music piece data D4, which is music piece data subsequent to the music piece data D3, is received, the CPU 51 of the portable terminal 50 starts the music piece data D4 from the position next to the address P2 in the storage area M1. Store in free space. As shown in FIG. 7B, when the address P2 is located at the end of the storage area M1, the musical piece data D4 is stored from the beginning of the storage area M1 (FIG. 7C). At this time, the CPU 51 updates the value of the address P3 stored in the RAM 55. Note that the reproduction process of the music piece data D3 continues during this download process, and therefore the address P1 advances to the rear.

  When the reproduction processing of the music piece data D3 further proceeds and the free space in the storage area M1 reaches a predetermined value again (FIG. 7D), the CPU 51 downloads the music piece data D4. In the same manner as described above, a data download request subsequent to the music piece data D4 is generated, and the data (music piece data D5) is downloaded from the distribution server 10. The CPU 51 stores the downloaded music piece data D5 in the empty area of the storage area M1 (FIG. 7 (e)). When the music piece data D5 is stored in the storage area M1, the CPU 51 determines whether or not the reproduction of the music has ended (step S109). When the reproduction of the music ends (step S109: YES), the CPU 51 ends the operation of the music distribution system 1. When the reproduction of the music has not ended (step S109: NO), the CPU 51 repeatedly executes the processes of steps S107 and S108. As described above, in steps S107 to S109, not only the part 4 having the URL event but also other parts continue to be played until the music has been played.

  The CPU 51 repeatedly executes the above processing until the reproduction from the beginning to the end of the mp3 data D2 is completed. When the reproduction of the mp3 data D2 is completed, the CPU 51 waits until another URL event data in the music data D1 is reached. When another URL event data is reached, the CPU 51 performs download and playback processing in the same manner as in the case of the mp3 data D2.

As described above, the mp3 data D2 is divided into music piece data according to the storage capacity of the storage area M1, and downloaded part by part. Since the reproduction process is performed in parallel during the download process, the portable terminal 50 can reproduce the mp3 data D2 without interrupting the music. Also, MIDI data and ADPCM data of parts 1 to 3 and 5 are reproduced in parallel. Therefore, the portable terminal 50 according to the present embodiment can reproduce music data in which performance control data such as MIDI, embedded audio data such as ADPCM, and stream audio data downloaded from a server are mixed.
That is, in an environment where resources that can be used are limited, such as a mobile phone, for example, an accompaniment part is played back by performance control data such as MIDI, and a part that is difficult to play back by performance control data such as vocals is downloaded from a server Can be played back by data. Thereby, the portable terminal 50 can reproduce high-quality music with limited resources.

<3. Modification>
The present invention is not limited to the above-described embodiment, and various modifications can be made.
In the above-described embodiment, when downloading music piece data, information related to the remaining storage capacity of the storage area M1 is transmitted to the distribution server 10, and the distribution server 10 transmits data having a size corresponding to the remaining capacity to the portable terminal 50. However, the method of downloading music piece data is not limited to this. For example, the music piece data may be downloaded by the following method. The portable terminal 50 transmits only the information (address P3) indicating the download start position to the distribution server 10. Distribution server 10 transmits data from the position indicated by address P3. The CPU 51 of the portable terminal 50 monitors the capacity of the storage area M1, and transmits a download stop request to the distribution server 10 when the storage area M1 is filled with music piece data.

  In the embodiment described above, the download request for the subsequent music piece data is generated when the free capacity of the storage area M1 becomes half of the storage capacity of the storage area M1, but the download request is generated. The threshold values for timing and free space are not limited to these. It can be arbitrarily set according to the storage capacity and the communication line environment, such as 1/3 or 1/4 of the storage capacity of the storage area M1. Alternatively, the CPU 51 may be configured to determine the free capacity threshold based on communication environment information such as the speed of the communication line. Or it is good also as a structure which makes a user specify the threshold value of free capacity.

  The music data is not limited to the format shown in the above embodiment. For example, data in SMF format or SMAF format may be used as performance control data, and data in other formats such as wma format may be used as embedded audio data and stream audio data. Further, the music data may be composed of only the URL event part without the performance control data and the embedded audio data part, or the music data may have a plurality of URL event parts. Further, the URL event part may have only one URL event without having a duration (or a duration of 0).

It is a block diagram which shows the structure of the music distribution system 1 which concerns on one Embodiment of this invention. 3 is a block diagram showing a hardware configuration of a mobile terminal 50. FIG. 2 is a block diagram showing a configuration of a sound source unit 100. FIG. It is a figure which shows the structure of the music data D1 which concerns on the same embodiment. 2 is a block diagram showing a hardware configuration of a distribution server 10. FIG. 3 is a flowchart showing the operation of the music distribution system 1. It is a figure explaining the monitoring method of the remaining capacity of the storage area M1.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Music distribution system, 10 ... Distribution server, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... I / F, 15 ... Input part, 16 ... Display part, 17 ... Memory | storage part, 20 ... Distribution server, 30 ... base station, 50 ... mobile terminal, 51 ... CPU, 52 ... ROM, 53 ... communication unit, 54 ... audio processing unit, 55 ... RAM, 56 ... display unit, 57 ... input unit, 58 ... vibrator, 59 ... speaker, 60 ... portable terminal, 70 ... network, 99 ... bus, 100 ... sound source unit, 101 ... I / F, 102 ... FIFO, 103 ... sequencer, 104 ... sound source, 105 ... adder, 111 ... I / F, 112 ... FIFO 113 ... Decoder, 120 ... DAC

Claims (10)

A piece of music including timing information indicating a specific timing during the reproduction time of the music, and location information indicating the location in the network of music piece data corresponding to a part of the music described in correspondence with the timing information First storage means for storing data;
A communication means for acquiring a part of the music piece data indicated by the location information sequentially from the top via the network;
A second storage means for storing a part of the music piece data obtained by the communication means and a subsequent music piece data obtained while the part of the music piece data is being reproduced ;
Of the music data stored in the first storage means, a part other than the music piece data is reproduced, and the music element stored in the second storage means at a timing specified by the timing information. A terminal device comprising: music reproduction means for reproducing one piece of data. The music data includes an event,
The timing information is a duration indicating a start time of the event,
The terminal device according to claim 1, wherein the location information is described in the event. The music data has a structure consisting of a plurality of channels,
The terminal device according to claim 1, wherein the location information is described in a channel on which the musical piece is to be reproduced.   The terminal device according to claim 1, wherein the location information includes a server name of a server storing a musical piece to be reproduced and a file name of the musical piece. Monitoring means for monitoring the free capacity of the second storage means;
The terminal according to claim 1, further comprising: a download request generation unit that generates a download request instructing acquisition of the piece of music piece data when a free space monitored by the monitoring unit satisfies a predetermined condition. apparatus.   The terminal device according to claim 1, wherein the communication unit has a function of transmitting or receiving the music data. The communication means transmits a download request including data size information indicating the size of data that can be received by the terminal device to a device specified by the location information,
The terminal device according to claim 1, wherein the music piece data has a size specified by data size information included in the download request. The communication means transmits a download request including data size information indicating the remaining capacity of the second storage means to a device specified by the location information,
The terminal device according to claim 1, wherein the music piece data has a size specified by data size information included in the download request.   The terminal device according to claim 1, wherein the terminal device is portable. Data including timing information indicating a specific timing during the reproduction time of the music, and location information indicating the location in the network of the music piece data corresponding to a part of the music described in correspondence with the timing information A computer-readable recording medium on which music data having a structure is recorded,
The music data is stored in a terminal device having music playback means for playing back the music data, communication means for communicating via the network, and storage means.
The communication means acquires a part of the music piece data indicated by the location information sequentially from the top via the network;
A process in which the storage means stores a part of the music piece data acquired by the communication means and a subsequent music piece data acquired while the part of the music piece data is being reproduced ;
A process in which the music reproduction means reproduces a part other than the music piece data in the music data stored in the storage means, and reproduces the music piece data at a timing specified by the timing information; The computer-readable recording medium characterized by performing the above.

Images