KR100509126B1 - Audio melody tune generation device and portable terminal device using it - Google Patents

Abstract

In the apparatus for generating a voice melody music according to the present invention, music data including melody data and accompaniment sound data is generated based on predetermined playing conditions (rhythm selection information and tune selection information), and separately input text data is melody data. Are automatically assigned to. Melody data having this text is converted into a voice melody signal by the formant synthesis method, while an accompaniment signal is generated based on the accompaniment sound data. When the voice melody music creation apparatus is used in the portable terminal device, the voice melody music and the accompaniment sound can be reproduced. In this manner, the user of the portable terminal device can generate and play back a voice melody piece in which the text is automatically assigned to the melody of the desired piece of music by a simple operation of inputting text, thereby improving voice clarity at the time of listening. Can be.

Description

AUDIO MELODY TUNE GENERATION DEVICE AND PORTABLE TERMINAL DEVICE USING IT}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable terminal device equipped with a function of converting input text data into voice and pronunciation or playing back desired music.

Background Art Conventionally, a technique for generating speech by a formant synthesis method is well known (for example, Japanese Patent No. 2754965). Furthermore, predetermined character information or text data can be used for pitch (or pitch) information. Techniques for converting speech into speech by formant synthesis methods with reference to prior data are also known. On the other hand, a device for automatically creating (composing) music pieces suitable for lyrics data by rhythm selection and tune selection is also known (Japanese Patent Laid-Open No. 9-50278).

However, only the voice converted from the text data lacks monotone and interest, and when the clarity of the pronunciation of the voice is low, it is difficult for the listener to judge and understand it as a language. There is a problem. In addition, when the music is automatically created, there is a problem that the music is mechanical and monotonous music, and the listener is easily tired. In addition, although it is also possible for a user, such as a portable terminal device, to mix the automatically produced music and the sound produced by the formant synthesis method, mixing work by the user becomes complicated.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and an object thereof is to provide a voice melody music production apparatus capable of generating a voice melody music in which voice and melody music are combined by a simple operation, and a portable terminal device using the same. will be.

In addition, an audio melody tune includes not only the music to which a melody is given to a voice, but also the music which accompanies the accompaniment sound as needed.

In the apparatus for generating a voice melody music according to the present invention, music data including melody data and accompaniment sound data is generated based on predetermined playing conditions (rhythm selection information and tune selection information), and separately input text data is melody data. Are automatically assigned to. Melody data having this text is converted into a voice melody signal by the formant synthesis method, while an accompaniment signal is generated based on the accompaniment sound data.

When the above-mentioned voice melody music production apparatus is used for the portable terminal device, the voice melody music and the accompaniment sound can be reproduced.

In this manner, the user of the portable terminal device can generate and reproduce a voice melody piece of music which has been automatically assigned to the melody of the desired piece of music by a simple operation of inputting text. Even when the intelligibility of speech is relatively low, by providing a melody, not only the listening is easy but also the musical pieces with entertainment can be produced.

Further, the text data does not necessarily need to be input by the user by operating the portable terminal device, but may be downloaded from a predetermined server via the Internet. Moreover, about the piece of music used, a desired piece of music can be selected from the pieces of music previously memorized.

With reference to the accompanying drawings, the present invention will be described in detail.

1 is a block diagram illustrating a configuration of a portable terminal apparatus having a voice melody music generation function according to an embodiment of the present invention. The portable terminal device 1 in this embodiment corresponds to portable telephones (portable telephones, cellphones, etc.) or PHS (Personal Handyphone System). In addition, the application field of this invention is not limited to these, For example, it is applicable to a personal computer and a PDA (Personal Digital Assistant).

In addition, the portable terminal device 1 shown in FIG. 1 has a unique function that has not been seen in the past, that is, a function for automatically generating voice melody music on the basis of text data input or received by a user, and the voice melody music received. It has a function used as a melody, and the circuit block shown in Fig. 1 is configured to realize these functions. 2 is a functional block diagram for realizing these functions.

In FIG. 1, reference numeral 2 denotes a central processing unit (CPU), not only controls each block of the portable terminal device 1, but also has a sequencer (see FIG. 2) function described later. Reference numeral 3 denotes a ROM (Read-Only Memory) in which a program executed by the CPU 2 is stored, and reference numeral 4 denotes a nonvolatile random access memory (RAM) for storing various data. . Reference numeral 5 denotes a communication interface for wirelessly connecting the mobile terminal apparatus 1 and a predetermined base station, and reference numeral 6 denotes a personal computer or the like via the connection code (not shown). Represents a serial interface for connection.

Reference numeral 7 denotes a display portion composed of a liquid crystal display and a display driving circuit, and performs image display based on the display data supplied from the CPU 2. Reference numeral 8 denotes an operation portion consisting of numeric keypads, function keys and a key interface. Reference numeral 9 denotes a formant synthesis circuit, and is supplied with MIDI (Musical Instrument Digita1 Interface) data (including pitch data, volume data, and timing data) to which text data is added. This formant synthesis circuit converts text data into a speech signal by the formant synthesis method, and then mixes the corresponding speech signal and MIDI data to generate an audio melody signal (that is, a speech signal having a melody). To a speaker (not shown). In addition, the algorithm according to the formant synthesis method is arbitrarily set. The speech synthesis method is not limited to the formant synthesis method. For example, a speech signal may be generated by the waveform synthesis method. Reference numeral 10 denotes a sound source circuit, and forms an accompaniment signal in accordance with MIDI data representing the accompaniment sound supplied through bus line B, and outputs it to the speaker.

The sound source circuit 10 synthesizes a desired sound signal by any method, and for example, a known FM (Frequency Modulation) method or a PCM (Pulse Code Modulation) method can be used.

Next, with reference to FIGS. 2-4, the detailed structure and operation | movement of the principal part of the above-mentioned portable terminal apparatus 1 are demonstrated. In addition, since the communication / call function of this portable terminal apparatus 1 is the same as the communication / call function of the conventional mobile telephone, PHS, etc., the description is abbreviate | omitted.

Fig. 2 shows a configuration for generating the voice melody music, the main part of which is realized in software by the CPU 2. Here, reference numeral 13 denotes text data input by the user of the mobile terminal apparatus 1 by operating the operation unit 8, and is sent to the melody synthesis unit 14 having the text executed by the CPU 2; Is output. Further, the user can input the rhythm selection information and the tune selection information as the playing condition of the generated music by operating the operation unit 8, and these information are supplied to the music generation unit 15 executed by the CPU 2 do. The music generation section 15 is adapted from the desired pattern, i.e., the rhythm pattern, the base pattern and the chord progression pattern previously stored in the memory (ROM 3) based on the rhythm selection information and the tune selection information. Read the pattern to produce melody data (ie MIDI data). The generated melody data is output to the melody synthesis section 14 having the text, while the rhythm pattern and the bus pattern are output to the mixing circuit 17 as accompaniment sound data.

The melody synthesizing unit 14 having the text performs a process of automatically allocating the text data 13 to the melody data in order to realize an optimal song. As this allocation method, various methods can be applied. For example, the first voice is assigned to the first note of the melody, the last voice is assigned to the last note, and based on a predetermined rule for the notes in between. One method is adopted to properly allocate voice. This predetermined rule will be described. For example, a relatively large number of voices are allocated to long notes while a relatively small number of voices are allocated to short notes. In this case, one voice may be allocated to a plurality of notes, or a different number of voices may be allocated to a plurality of notes.

As described above, the automatic voice allocation process is executed by the melody synthesis circuit 14 having the text to generate the melody data having the text, and output to the mixing circuit 17. The mixing circuit 17 synthesizes the melody data having the above text and the accompaniment data output from the music generation unit 15 to generate voice melody music data, and the memory 18 (ie, RAM) as the incoming melody data. (4)).

Fig. 3 shows a flow chart for explaining the above-described generation process of voice melody music data, wherein step Sa1 indicates an input process of rhythm selection information and tune selection information by the user of the portable terminal apparatus 1, and step Sa2 The process of generating melody data and accompaniment sound data by the music generation unit 15 is shown. In addition, step Sa3 represents an input process for text data by the user, and step Sa4 represents a process of generating melody data having text by the melody synthesizing unit 14 having text. Step Sa5 represents the mixing process of the melody data having the text by the mixing circuit and the accompaniment sound data. The voice melody music data obtained by this mixing process is stored in the memory 18, and then appropriately reproduced according to the user's instruction. In addition, the detail of the reproduction | regeneration process of audio | voice melody music data is mentioned later. Further, it is determined by the user whether or not the reproduction result is "OK" (step Sa6), and when it is "OK", the voice melody music generation process shown in Fig. 3 is terminated. If the reproduction result is not "OK", the above-described steps Sa1 to Sa5 are repeated, whereby melody data having a desired text can be automatically generated. In this case, the above-described steps Sa1 to Sa5 may be repeated by changing the playing condition (that is, rhythm selection information and tune selection information) specified in step Sa1 or the text data input in step Sa3.

Next, the reproduction process of the voice melody music data stored in the memory 18 will be described. When receiving an incoming call from the base station and playing the incoming melody by the portable terminal device 1, the sequencer 20 executed by the CPU 2 receives the voice melody music data from the memory 18. It reads sequentially according to the timing data, outputs melody data having text to the formant synthesis circuit 9, and outputs accompaniment sound data to the sound source circuit 10. FIG. The formant synthesizing circuit 9 converts the text data into a speech signal by the formant synthesizing method, and converts the speech melody signal (i.e., melody) from the corresponding speech signal and melody data (i.e., data conforming to the MIDI standard). Voice signal) to be generated and output to the mixing circuit 21.

In addition, the sound source circuit 10 forms an accompaniment sound signal based on the accompaniment sound data supplied from the sequencer 20 and outputs it to the mixing circuit 21. The mixing circuit 21 mixes the voice melody signal and the accompaniment signal as described above and outputs them to the speaker 23.

4 is a flowchart for explaining the above-described voice melody music reproduction process. Here, step Sb1 indicates a process in which the sequencer 20 reads the voice melody music from the memory 18 and separates it into melody data having text and accompaniment data, and in step Sb2, the sequencer 20 performs the voice melody music. Shows the process of starting the reproduction of the form, step Sb3 shows the process in which the melody data having the text is supplied to the formant synthesis circuit 9, and step Sb4 shows the process in which the formant synthesis circuit 9 generates the voice melody signal. Where step Sb5 indicates a process in which the accompaniment sound data is supplied to the sound source circuit 10, step Sb6 indicates a process in which the sound source circuit 10 generates an accompaniment sound signal, and step Sb7 indicates a voice melody signal and an accompaniment sound The process of mixing signals is shown. In addition, it is determined whether or not the end of music reproduction by the user has been instructed in step Sb8. When the music reproduction is not finished, the above steps Sb3 to Sb7 are repeated, while when the music reproduction is terminated, the voice melody music reproduction processing shown in FIG. 4 ends.

According to the above embodiment, the portable terminal apparatus 1 can automatically generate and reproduce the voice melody piece with the originality (originarity), and the voice melody piece is suitable for use as an incoming melody. Since it is also possible to transmit and receive to another portable terminal device as an attached file such as an e-mail, it is also possible to share a common voice melody piece among predetermined acquaintances or friends. In addition, it is also possible to upload the created voice melody pieces to a predetermined site via the Internet or to download new voice melody pieces from the predetermined site.

In the above embodiment, a new melody is automatically composed by the music reproducing section 15 (refer to FIG. 2). Instead, music data (MIDI data) representing a plurality of music pieces is stored in the RAM 4 instead. The music reproducing section 15 stores the melody data corresponding to the music selected by the user of the portable terminal device 1 to the melody synthesizing section 14 having the text, and the accompaniment sound data is mixed with the circuit. You may output to (17). In this case, the melody of the desired piece of music is played in accordance with the text input by the user. Here, the music data stored in the RAM 4 may represent the melody of the famous music or may represent the melody of the other music. In addition, it is also possible to suitably change performance conditions such as rhythm and tune to the music data previously stored in the RAM 4 by an input operation by the user of the portable terminal device. Note that the text data does not necessarily need to be input by the user of the portable terminal device. For example, the text data stored in advance may be used, or the text data transmitted by electronic mail or the like may be used.

As described above, the present invention has various technical features and effects, and will be described below.

(1) In the voice melody music production apparatus according to the present invention, music data including melody data and accompaniment sound data is generated based on predetermined playing conditions, and separately input text data is automatically assigned to the melody data. Melody data having this text is converted into a voice melody signal by the formant synthesis method, while an accompaniment signal is generated based on the accompaniment sound data. When the voice melody music production apparatus is used for the portable terminal device, the voice melody music and the accompaniment sound can be reproduced.

(2) As described above, the user of the portable terminal device can generate and reproduce a voice melody piece of music which has been automatically assigned to the melody of a desired piece of music by a simple operation of inputting text. Even when the intelligibility of speech is relatively low, by providing a melody, not only the listening is easy but also the musical pieces with entertainment can be produced.

(3) Compared with the conventionally composed music automatically composed of voice melody, since the melody is provided to the voice, the enjoyment is increased for the listener and entertainment can be provided. In particular, it is suitable for use as an incoming melody of a cellular phone.

In addition, this invention is not necessarily limited to the above-mentioned embodiment, It is also possible to add various changes within the scope of the invention.

1 is a block diagram showing the configuration of a portable terminal apparatus having a voice melody music creation function according to an embodiment of the present invention.

Fig. 2 is a functional block diagram showing a configuration for realizing a voice melody music generation function.

3 is a flowchart for explaining a process of generating voice melody music data.

4 is a flowchart for explaining a reproduction process of voice melody music data.

<Explanation of reference numerals for the main parts of the drawings>

1: mobile terminal device

2: CPU

3: ROM

4: RAM

5: communication interface (communication I / F)

6: Serial Interface (Serial I / F)

7 display unit

8: control panel

9: formant synthesis circuit

10: sound source circuit

Claims (10)

An input unit for inputting performance condition data and text data indicative of a performance condition of a piece of music to be created, according to a user's instruction; A music generation unit for automatically composing a new melody on the basis of data representing the playing condition of the music to be generated, and generating and outputting music data including melody data representing the new melody; A melody data synthesizing unit having a text for automatically assigning the text data to a musical note constituting the melody data to generate melody data having a text; A storage unit for storing melody data having the text; A reproduction unit for reproducing melody data having the text read out from the storage unit Voice melody music generation apparatus comprising a. An input unit for inputting performance condition data and text data indicative of a performance condition of a piece of music to be created, according to a user's instruction; A music generation unit for automatically composing a new melody based on the playing condition data, and generating and outputting music data including melody data representing the new melody and accompaniment sound data; A melody data synthesizing unit having a text for automatically assigning the text data to a musical note constituting the melody data to generate melody data having a text; Means for generating music data by mixing the melody data having the text and the accompaniment sound data; A storage unit for storing the music data; A reproducing unit for reproducing the music data Voice melody music generation apparatus comprising a. The method of claim 2, The regeneration unit, A sequencer which reads out music data from the storage section and separates the melody data having the text into the accompaniment data; Means for generating a speech melody signal based on the melody data with the text; Means for generating an accompaniment signal based on the accompaniment sound data; Means for mixing the voice melody signal and the accompaniment signal; Speaker to which the output of the mixing means is supplied Voice melody music generation apparatus comprising a. The method according to any one of claims 1 to 3, An audio melody music generation apparatus configured to transmit data of the storage unit to an external data processing apparatus, and to receive transmission data from an external data processing apparatus and write the data to the storage unit. The method according to any one of claims 1 to 3, An audio melody music production apparatus, configured to transmit data of the storage unit to an external server via a communication line, and to receive transmission data from an external server through a communication line and write the data to the storage unit. The method according to any one of claims 1 to 3, And the playing condition data is data for designating a desired rhythm with respect to a piece of music. The method according to any one of claims 1 to 3, And the playing condition data is data for designating a desired tune with respect to a piece of music. The method according to any one of claims 1 to 3, And the reproducing unit converts melody data having the text into a voice signal by a formant synthesis method. The method according to any one of claims 1 to 3, And the reproducing unit converts melody data having the text into a voice signal by a waveform synthesizing method. A portable terminal device comprising the voice melody music generating device according to any one of claims 1 to 3, wherein a ring tone is generated based on melody data having a text in the storage unit.