JP2004226671A - Music data generation system, music data generation server system, and music data generation method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a system constituted so as to generate user's original music by expanding width of originality. <P>SOLUTION: An inputted message is transmitted from a portable information terminal 1 to a music data generation server system 2 and morpheme analysis of the received message is performed by the music data generation server system 2. Then, music data with length corresponding to the message and in a mode and a key corresponding to a meaning of the message is generated based on this analysis result. Then, the music data generated in such a way is transmitted to a third person's portable information terminal 3 with the message, the message and music are synchronized and outputted there. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

TECHNICAL FIELD OF THE INVENTION
The present invention relates to, for example, a system for generating music from text, and more specifically, to a system for easily generating self-made music using a terminal device.
[0001]
[Prior art]
Currently, a service is provided in which a message can be added to an animation image, music, or the like, such as a greeting card, so that the message can be transmitted. In this system, generally, a plurality of greeting cards are registered in the server device in advance, and a user can select a desired greeting card from among them and add a message.
[0002]
[Problems to be solved by the invention]
However, since such a system selects and uses images and music from a limited number of cards registered on the server device side, it is necessary to give the originality of the user to the card to be transmitted. Can not. It is also possible for the user to create his own music and send the created music with a message. However, in order to make music in this way, musical expertise is required. In addition to this, for example, a device for inputting the music information is such as a mobile phone or a personal computer. In such a case, the input takes a lot of time.
[0003]
On the other hand, as a service that allows a user to easily create original music, a service that allows text input from a mobile phone and generates music from the text is also currently provided.
[0004]
This system generates music from names and favorite words. For thousands of Japanese words with a clear image, how are the syllable beats and syllable connections (crossover sounds) included in them? The music is generated based on the close relationship between these syllables and the meaning of words by summing up whether they are used. For example, it has a hard image such as "go, ga, gi, gyu, ko, chi, ka, kyou, cha, ぱ, chi, ki, ba", and "fu, nu, ne, Words like "Ju, Chu, Nya, Nya, Nyo, Wa, Gu" have a soft image. Also, looking at each syllable, the syllable "ki" is suitable for conveying an image such as "clear, lively, bright, resistance, flashy, narrow", and the syllable "ho" is "pleasant, calm" , Safe, excellent, pale, happy, thin. " Then, the characteristics of the image that the sound has over each of the syllables are captured, and music that matches the image is generated.
[0005]
However, since such a system generates music from so-called short "words" such as names and favorite words, there is a high possibility that the user will select similar words, Since there is little information for giving a change, there is a high possibility that the music is common. Therefore, pursuing the originality of the user by such a method is not perfect.
[0006]
SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and has as its object to provide a system capable of generating original music by expanding the range of originality.
[0007]
[Means for Solving the Problems]
That is, in order to solve the above-mentioned problem, the present invention is configured to receive a text input such as a message from a user, generate music data based on the components of the received text, and output music based on the data. It was done.
[0008]
With this configuration, music data can be generated not only from short words but also from meaningful sentences, so even if the same words are partially used, by changing the length or arrangement of the sentences, etc. Original music data can be generated.
[0009]
Further, when generating the music data, the music data corresponding to the length of the input sentence is generated.
[0010]
With this configuration, the length of the music can be changed based on the length of the input sentence, and the length of the music can be easily changed.
[0011]
Further, when generating the music data, a keyword is extracted from the sentence, and a modality of major or minor and a key of which key is to be determined based on the keyword are determined. Generate music data.
[0012]
With such a configuration, music data suitable for the emotion of the user can be easily generated without prompting the user to input a melody and a key representing the atmosphere of the music.
[0013]
When outputting music, synchronized output such as changing the display form of a sentence in accordance with the reproduction state of the music is performed.
[0014]
With this configuration, the user can easily grasp the correspondence between the sentence and the music, and karaoke can be performed based on the synchronized output.
[0015]
When outputting the music data, the input text is displayed on a third-party terminal device by e-mail, and the music data is output.
[0016]
With this configuration, it is possible to transmit a mail pursuing the originality of the sender, and to transmit a message having a higher preference.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the present embodiment, portable information terminals 1 and 3 such as mobile phones are used as terminal devices, and a music data generation server device 2 is used as a server device. When generating music data, the portable information terminal 1 accepts an input of a text of a message to be transmitted to the other party, and transmits the text to the music data generation server device 2 via the network 4. Then, the music data generation server device 2 receiving the text and the e-mail address of the other party performs a morphological analysis of the message, generates music data composed of a melody and a code based on the morphological analysis, and generates the music data and the message. And data to the destination e-mail address. Then, the portable information terminal 3 that receives the message outputs the music and the message in synchronization. Hereinafter, the present embodiment will be described in detail.
[0018]
As shown in the block diagram of FIG. 2, the portable information terminals 1 and 3 are connected to an input receiving unit 10 for receiving a message input of a sentence composed of a plurality of phrases and a music data generation server device 2 via a network 4 such as the Internet. Transmitting means 11 and receiving means 13 for transmitting and receiving data between them, storage means 12 for storing a message with music generated by the music data generation server device 2, and output means 14 for outputting the stored message with music It comprises. In addition, the portable information terminals 1 and 2 have other means for performing functions unique to the portable information terminal, for example, means for functioning as a normal telephone.
[0019]
The input receiving means 10 for receiving an input of a message is configured by operation keys provided on the portable information terminals 1 and 3 and an application for permitting the input of the message. Normally, the operation keys are constituted by numeric keys provided in the portable information terminals 1 and 3, but text information may be created from voice using a voice recognition technique.
[0020]
The transmission unit 11 transmits a message to the music data generation server device 2 via the network 4 such as the Internet. The receiving means 13 receives the message with music transmitted from the music data generation server device 2.
[0021]
The storage unit 12 stores information necessary for operating the portable information terminals 1 and 3. The storage unit 12 includes an operation execution program for operating the mobile phone and music data received from the music data generation server device 2. And data related to messages.
[0022]
The output unit 14 includes a display output unit such as a display and an audio output unit such as a speaker. The output unit 14 outputs and outputs a message transmitted from the music data generation server device 2 and outputs music data as audio. The sound is output by the output means. The display output and the audio output incorporate a program for outputting the data while synchronizing with each other. For example, the display form is changed such that the color of the displayed message is sequentially changed in accordance with the progress of the music.
[0023]
On the other hand, the music data generation server device 2 automatically generates music data based on a received message, and includes a receiving unit 20, an analyzing unit 21, a meaning determining unit 22, a modal / tone determining unit 23, a note sequence generating unit. 24, music data generating means 25, media data generating means 26, and transmitting means 27.
[0024]
The receiving unit 20 receives data from the portable information terminal 1 via the network 4 and receives text data constituting a message from the portable information terminal 1 and an e-mail address as a destination to which the message is transmitted.
[0025]
The analysis means 21 is for performing morphological analysis on a message transmitted from the portable information terminal 1, and for example, as shown in FIG. If the information contains the word "", it is converted into hiragana and decomposed into "always", "show", "is", "." In this morphological analysis, not only the method of decomposing by Hiragana conversion, but also the method of decomposing into “always”, “care”, “became”, “.” , “Osewa”, “ninatteorimasu”, “.”, Etc. can also be adopted.
[0026]
The meaning determining unit 22 determines whether a predetermined character string is included in the sentence component analyzed by the analyzing unit 21 and determines whether the sentence as a whole has a bright meaning or a sad meaning. Determine if you have In this semantic judgment, a character string of a positive element, for example, "happy, happy, easy, fun, good, bright, good, light, south, white, top" and the like are registered in advance, In addition, as a character string of a negative element, for example, “sad, neglect, dislike, dark, evil, distress, thought, north, black, and lower” are registered. Then, it counts how many positive element character strings and negative element character strings are included in the constituent elements of the morphologically analyzed sentence.
[0027]
Then, the melody / tone determining unit 23 compares the number of character strings of the positive element with the number of character strings of the negative element, and first determines a major or minor key. More specifically, if the number of positive element character strings is large or equal, the music to be generated is determined to be a major key. Conversely, when the number of negative element character strings is larger, the music to be generated is determined to be in minor. In addition, as for the key to determine which sound is to be the main tone, in the simplified version, the C sound is used as the main tone, but in the normal version, a melody generated by C major or c minor is separately defined (for example, The main tone is determined by the S-JIS code of the character and taking mode 7).
[0028]
On the other hand, the note string generating means 24 counts the number of characters of the sentence constituent element subjected to the morphological analysis, and generates a note string by applying a melody template prepared in advance corresponding to the counted number. Specifically, first, a plurality of types of C major templates composed of one sound, two sounds, three sounds, four sounds, and five sounds are prepared. Then, for the character components analyzed by the morphological analysis, one-byte characters are counted as “1” in one byte, and two-byte characters are counted as “2” in two bytes, and any number of sounds corresponding to the counted number is counted. Apply the template. If the count of the character component subjected to the morphological analysis exceeds “5”, there is no template to be applied to this, and the count of the character component is decomposed into an arbitrary count. Apply a template corresponding to the count number. Thus, for example, when the count number such as “became” shown in FIG. 5 is “8”, for example, “4”, “2”, “2” ”Is applied to the template corresponding to each count number. As a result, a note sequence corresponding to the length of a sentence can be generated.
[0029]
The musical note sequence thus generated by the musical note sequence generating means is generated by the music data generating means 25 into music corresponding to the message. As shown in FIG. 3, the music data generating means 25 includes a melody (main melody) data generating means 250, an accompaniment data generating means 251, and an accompaniment data adding means 252.
[0030]
The melody data generating means 250 combines the note strings generated by the note string generating means 24 and converts the note strings into the melody and key determined by the melody / tone determining means 23. When the music is composed in a major key, it is usually configured as a C major, and when it is configured in a minor key, it is configured as a c minor obtained by lowering the B, E, and B sounds of the C major by a semitone. . Then, after these processes are performed, the length, repetition, end form, and the like are adjusted so that the melody becomes musical as a whole, and this data is passed to the accompaniment data generation means 251.
[0031]
The accompaniment data generation means 251 generates a chord suitable for the progress of the melody based on the generated melody. In this chord generation, first, for a given melody, all chord progressions allowed according to trichord progression are listed. This chord progression follows a set of rules called "prohibitions" in harmony, that is, rules such as "you should do this", "you must do this" or "do not do this". Takes into account both the first inversion type and the second inversion type, and generates a seventh chord and a ninth chord for the genera chords up to that inversion type. Then, for all the codes generated in this way, the code progress is evaluated in accordance with a preset evaluation table, and the code with the highest evaluation is extracted.
[0032]
The accompaniment data adding means 252 assigns the chord thus extracted to the melody. In this assignment work, processing such as assigning a chord to a melody note sequence in accordance with the melody tempo is performed.
[0033]
Then, the music data thus generated is integrated with the message by the media data generating means 26, and is converted into data that can be transmitted. The generated music data file is converted into, for example, a SMAF MA2 or CMIDI 2.0 format so that the file format can be output by the portable information terminal 3 on the message receiving side. If the output format on the receiving side is not known in the file conversion work, for example, an inquiry mail regarding the model is transmitted from the music data generation server device 2 to the portable information terminal 3 on the receiving side, and this reply is sent. Upon receipt, the data may be converted into a format corresponding to the model.
[0034]
The transmitting means 27 transmits the music data and the message generated in this way to the portable information terminal 3 of the receiving destination via the network 4.
[0035]
Next, the flow of the music data system 100 thus configured will be described with reference to FIG.
[0036]
First, when receiving the provision of a service for transmitting a message with a melody, the user starts up a predetermined application to display a screen as shown in FIG. 6, inputs a message according to this screen, and outputs the portable information as the transmission destination of the message. Enter the e-mail address of the terminal. When the portable information terminal 1 accepts the message (step S1), the transmission key of the message displayed on the screen is pressed (step S2), and the information on the message and the e-mail address of the other party is generated as music data. The data is transmitted to the server device 2 (step S3).
[0037]
Next, the music data generation server device 2 that has received this information (step S10) extracts text information of the message from the received information (step S11), and morphologically analyzes this information (step S12). . Then, based on the result of the morphological analysis, first, how many positive character strings and negative character strings are registered in advance in the sentence component is counted (step S13). If there are more or the same number of positive character strings based on the count number of this character string, an output is generated to the effect that a major music is generated. On the other hand, if there are more negative character strings, an output to generate minor music is output (step S14).
[0038]
After the determination of the trajectory is performed, the number of characters of the character component subjected to the morphological analysis is counted. The count of the number of characters is performed, for example, by counting the number of characters of the character component converted into hiragana (step S15), and if the counted number exceeds the number of sounds of the template prepared in advance, the number of characters is set to Break it down into any number of characters that fits the number of notes. Then, a template corresponding to the number of characters counted in this way is applied (step S16), and a conversion process of the melody is performed based on the melody determined in step S14 (step S17). If the melody determined in step S14 is major, no conversion processing is performed, and if the melody determined in that step is minor, the B sound of the note string composed of C major, Processing is performed so that the E and A sounds are reduced by a chromatic scale. As for other keys, C major or c minor is transposed by translation. Finally, in order to modify the melody thus generated into a musical melody as a whole, a modification operation such as its length, repetition and end form is performed (step S18).
[0039]
Next, coding is performed on the melody generated in this manner. Therefore, the melody is passed to the accompaniment data adding means 251, where a code corresponding to the melody is generated (step S19), and the code is added to the melody (step S20).
[0040]
Finally, a message is added to the generated music to generate media data, and a necessary format conversion process is performed (step S21). The generated media data is transmitted to the message creator based on the confirmation request from the message creator (steps S22 and S4), and output from the portable information terminal 1 for viewing. (Step S5). Then, as a result of the viewing, when an instruction is given that the generated music should be “good” or “recreate” (step S6), the result of the viewing is transmitted to the melody generation server device 2. (Step S7) If the result of viewing is a result that should be "recreated" (Step S23: NG), the process returns to Step S16 to regenerate the melody. On the other hand, if the viewing result is “good” (step S23: YES), the generated media data is transmitted to the e-mail address of the creator's destination (step S24), and received. The portable information terminal 3 (step S30) stores information on the music data and the message (step S31), and outputs the music and the message in synchronization based on the output instruction (step S32). (Step S33).
[0041]
As described above, in the above-described embodiment, the input of a sentence is received, the configuration of the sentence is morphologically analyzed, and music data is generated based on the result. Even if the message is attached and transmitted, originality can be given to the message.
[0042]
Also, when generating the music data, the input sentence is subjected to morphological analysis, and a template corresponding to the length of the sentence component is applied to generate music. Can be generated, and music of a desired length can be easily generated by the creator.
[0043]
Furthermore, in generating the music data, a character string of a positive element and a character string of a negative element are extracted in order to consider the meaning of the sentence, and a melody and a key are determined based on these numbers. Music suitable for a sentence having an emotional meaning can be easily generated.
[0044]
In addition, when this music is output, it is synchronized with the input sentence so that it can be output, so that the correspondence between the sentence and the music can be easily grasped, such as singing along with the music. It will be possible to give a karaoke-like taste.
[0045]
Further, since the message and the music data are transmitted to the portable information terminal 3 of the third party by e-mail, a greeting card rich in originality can be transmitted.
[0046]
The present invention is not limited to the above embodiment, but can be implemented in various modes.
[0047]
For example, in the above embodiment, the system 100 is configured by the portable information terminals 1 and 3 and the music data generation server device 2 and the like. However, all of these functions can be realized by one terminal device. In this case, music data may be generated by the terminal device. In this case, in relation to the present invention, this terminal device becomes a music data generation system.
[0048]
Further, in the above embodiment, the music data including the melody and the chord is generated, but the music including only the melody may be generated.
[0049]
Further, in the above-described embodiment, the message and the music data are transmitted to the portable information terminal 3 of the third party. However, the present invention is not limited to this, and the generated music data is transmitted to itself. Is also good. In this case, for example, if a sentence is input as the lyrics, the music data generation server device 2 can generate music data corresponding to the length of the lyrics, so that music with lyrics can be generated. Also, in this case, if the music and the sentence are similarly synchronized and output, the music can be used as karaoke.
[0050]
Further, in the above embodiment, when the result of viewing is NG, the template fitting operation is performed again. However, a message urging the user to re-enter a sentence is issued, and a message based on the new message is issued. Melody generation or the like may be performed again.
[0051]
【The invention's effect】
In the present invention, a text such as a message is received from the user, music data is generated based on the components of the received text, and the music data is output. To generate original music.
[Brief description of the drawings]
FIG. 1 is an overview of a music data generation system according to an embodiment of the present invention. FIG. 2 is a functional block diagram of the same embodiment. FIG. 3 is a detailed functional block diagram of a music data generating unit of the embodiment. FIG. FIG. 5 is a diagram showing a morphological analysis in the same form. FIG. 6 is a display example of a portable information terminal in the same form.
1, 3, mobile information terminal 2, music data generation server device 4, network 10, input receiving means 14, output means 21, analysis means 25, music data generation means 251 ... accompaniment data generating means 252 ... accompaniment data adding means

Claims (13)

In a music data generating system for generating music data based on information input as a sentence, an input receiving means for receiving an input of a sentence, an analyzing means for analyzing a configuration of the received sentence, and an analysis result by the analyzing means A music data generation system comprising: music data generation means for generating music data based on the music data; and output means for outputting music based on the generated music data. The music data generation system according to claim 1, wherein the music data generation means generates music data having a length corresponding to a length of the input text. 3. The music data generation system according to claim 1, wherein the music data generation means determines a tune and a key based on the analyzed keyword of the sentence and generates music data of the tune and the key. The music data generation system according to any one of claims 1 to 3, wherein the output means outputs the text and music input by the input means in synchronization with each other. The music data generation system according to any one of claims 1 to 4, wherein the output means displays a text received by an e-mail from a third party and outputs music. A music data generation server device that generates music data based on a sentence received by a terminal device, comprising: an analysis unit that analyzes a configuration of a sentence received by the terminal device; and music data based on an analysis result by the analysis unit. A music data generation server device comprising: music data generation means for generating; and transmission means for transmitting the generated music data so that the terminal device can output the music data. 7. The music data generation server device according to claim 6, wherein the music data generation means generates music data having a length corresponding to a length of the input sentence. 7. The music data generation server device according to claim 6, wherein the music data generation means determines a tune and a key based on a keyword of a sentence analyzed by the analysis means and generates music data of the tune and the key. . The music data generation server device according to any one of claims 6 to 8, wherein the transmission means displays the text on a third party terminal device and transmits the music so that the music can be output. A music data generation method for generating music data based on a sentence input as a sentence, comprising the steps of: analyzing a configuration of the input sentence; generating music data based on the analysis result; Transmitting the selected music data to a terminal device capable of outputting the music data. The music data generating method according to claim 10, wherein the step of generating the music data generates music data having a length corresponding to a length of an input sentence. The music data generation method according to claim 10 or 11, wherein the music data generation method determines a melody and a key based on the analyzed keyword of the sentence and generates music data of the melody and the key. The music data generation method according to claim 10, wherein the transmitting includes displaying the text on a third party terminal device and transmitting the music so that the music can be output.

Images