TW200303009A - Audio melody tune generation device and portable terminal device using it - Google Patents

Abstract

In an audio melody tune generation device of this invention, tune data including melody data and accompaniment data are created based on prescribed playing conditions (rhythm selection information, tonality selection information), so that the melody data are automatically allocated to text data independently input thereto. Then, text-added melody data are converted to audio melody signals in accordance with a formant synthesis method, while accompaniment signals are produced based on the accompaniment data. When the aforementioned audio melody tune generation device is used in a portable terminal device, it is possible to reproduce an audio melody tune and accompaniment. Upon simple operation for inputting-a text by the user of a portable terminal device, it is possible to generate and reproduce an audio melody tune in which the text is automatically allocated to the melody of a desired tune to improve audio clarity in audition.

Description

(-2) 200303009 玖 Brief description of the invention description) (The description of the invention should state: the technical field, prior art, content, embodiments and drawings of the invention belong to the technical field of the invention. The present invention relates to a method of transforming input text data into audio. Pronunciation, equipped with a portable terminal device that plays the desired music function. BACKGROUND ART It is known that the technology of generating audio by the formant synthesis method is widely known (for example, Japanese Patent No. 2 7 5 4 9 6 5), In addition, referring to the b-process (or Jinxiang) information and dictionary data, the technology of transforming specific text information and text (TEXT) data into audio by the resonance front synthesis method is also well known. On the other hand, by selecting rhythm and The selection of tunes is also well-known for the automatic creation (composition) of music suitable for lyrics data (Japanese Unexamined Patent Publication No. 9-5 027 8). However, 'the audio monotones that are only converted from rare materials are not interesting, and also' In the case where the clarity of the pronunciation of the audio is low, it is difficult for the listener to judge and understand the sentence. As a portable terminal device, there is a lack of practicality. Usability problems. In addition, in the case of automatic composition of music, the music finally forms mechanical monotonous and tasteless music, and there are problems that listeners are easily bored with meaning. Further, users of portable terminal devices, etc. Although it is possible to give this tone to the music created automatically and the sound generated by the formant synthesis method, in this case, the mixing operation becomes quite complicated for the user. The present invention is developed by the developer in view of the above-mentioned matters, and its purpose is Provided is an audio frequency melody music generating device capable of generating a combination of audio frequency and melody music by simple operation and a melody music melody and a portable terminal device using the same.

(-1) So ’audio melody tune, not only? The tunes for the audio melody include the accompaniment accompaniment to the audio tunes as needed. According to the audio frequency melody music generating device of the present invention, music data including melody data and accompaniment bone data is generated according to specific performance drill pieces (ie, selection information and tune selection information), and text data input by other methods is automatically assigned. To melody information. The episodic melody data is converted into an audio melody signal by a resonance induction method. On the other hand, an accompaniment sound signal is generated according to the accompaniment sound ㈣. 1. Use the above-mentioned audio melody music to make miso ¥ ^ The Tianzao device is used in a portable terminal and can play audio melody music and accompaniment stand. In this way, the user of the portable terminal device, h 褙 input and 早 early operations in the data, can generate and play the text ",,, to Bei Yi automatically allocated $ the desired melody of the audio frequency Melody music ^ „Even if the soundness and basicity of the audio frequency is relatively low, it can also be made by giving the melody, and becomes easier to listen to, and it can also produce entertaining music. Bu, the text data is not specific It must be entered by the user as a portable terminal. Even if a specific server is routed through the network, it can be set up. For the music used, it can be downloaded in advance, and other music can be downloaded. H A brief description of selecting a desired pattern in FIG. 1 shows a structure of a portable terminal device having an audio frequency melody λλ and a function that does not generate a function, according to an embodiment of the present invention. 疋 谭 术 曲 # 料 J 傅Absolutely <block diagram. 200303009

⑼ Figure 2 is a functional block diagram showing the function of generating audio melody music data. FIG. 3 is a flowchart showing the process of generating audio melody data. FIG. 4 is a flowchart showing the playback process of audio melody music data. Best Mode for Implementing the Invention The present invention will be described in detail below with reference to the embodiments and the accompanying drawings. FIG. 1 is a block diagram showing a configuration of a portable terminal device having an audio melody music data generating function according to an embodiment of the present invention. The portable terminal device i of this embodiment corresponds to portable telephones (cellphones, cellphones, etc.), and PHS (PersonalHandyphone

System). In addition, the field of application of the present invention is not limited to these, and for example, it can also be applied to a personal computer and a pDA (Persional Digital Assistant). In addition, the portable terminal device 1 shown in FIG. 1 has a unique function that is not known in the past, that is, a function that a user automatically generates an audio melody music according to input or received text data, and uses the audio melody music as For the functions used by the incoming call melody, the circuit block shown in Figure 1 is constituted to realize these functions. FIG. 2 is a functional block diagram for realizing these functions. The reference numeral 2 in FIG. 1 indicates a central processing unit (CPU) that controls each block of the portable terminal device 1 and also has a sequencer (refer to FIG. 2) described later. The number 3 indicates that R Ο M (R ead-0 η 1 y M em 〇ry, read-only memory) is stored in the program executed by CPU2, and the symbol 4 indicates that all kinds of data are non-volatile. RAM (Random-Access Memory). The symbol 5 is used to wirelessly connect the portable terminal device 1 200303009

The communication interface with a specific base station, symbol 6 indicates a serial interface for connecting the portable terminal device 1 to a personal computer or the like via a connection cable. The symbol 7 indicates a display portion formed by a liquid crystal display and a display driving circuit, and performs image display based on the display data provided by the aforementioned CPU2. The symbol 8 indicates an operation portion formed by a number key (n u m e r key pads), a function key, and a key interface. The symbol 9 indicates a formant synthesis circuit, and provides MIDI (Musical Instrument Digital Interface) data (including tone data, volume data, and timing data) with additional text data. The formant synthesizing circuit converts text data into an audio signal by the formant synthesis method, and simultaneously mixes the audio signal with the midi data to generate an audio melody signal (that is, a melody audio signal) toward a speaker (not shown) ) Output. The algorithm for the formant synthesis method is arbitrarily set. In addition, the audio synthesis method is not limited to the formant synthesis method, for example, even if an audio signal is generated by a waveform synthesis method. The symbol “丄” indicates that the sound source circuit ’forms a accompaniment sound signal through the bass line B according to the MIDI data of the supplied accompaniment sound and outputs it to the speaker. The sound source circuit 10 is a person who synthesizes a desired musical tone signal by an arbitrary method. As a method of the decay method, for example, the well-known FM (Frequency Modulation) method and pCM (Pulse cOde) can be used.

Modulation) method. Next, the detailed structure and operation of the main parts of the portable terminal device 1 described above will be described with reference to Figs. 2 to 4. In addition, since the communication / communicating function of the portable terminal device 1 and 2003303009 of the conventional portable telephone pad PΗ§ and the like are issued, the explanation is continued on the page "一二 赖 Ή", and the communication / call function It is the same, so its explanation is omitted. Fig. 2 shows a constructor for generating the above-mentioned audio melody, the main part of which is a software implementer using the above-mentioned C P U 2. Here, the symbol 1 3 indicates that the text data input by the user of the portable terminal device 1 by operating the operation unit 8 is output to the melodic-synthesizing unit 14 with text executed by the CPU 2 described above. In addition, the user can input rhythm selection information and tune selection information as performance conditions of the generated music by operating the operation unit 8, and the information is supplied to the music generation unit 15 executed by the CPU 2. According to the rhythm selection information and the tune selection information, the music generating section 15 reads out patterns from a desired pattern, that is, rhythm patterns, bass patterns, and chords that are stored in the memory (ROM3) in advance. Pattern to generate melody data (ie MIDI data). The generated melody data is output to the side-word melody synthesizing section 14; on the other hand, the rhythm pattern and bass pattern are output to the mixing circuit 17 as accompaniment sound data. Attached to the melody synthesizing section 14, the melody data will be automatically assigned to the most appropriate singable text data. Although various methods can be applied as the allocation processing method, for example, the first audio is assigned to the first note of the melody, the last audio is assigned to the last note of the melody, and the notes between them are moderate according to a specific rule. Method of audio distribution. After detailing this specific rule, for example, more audio is assigned to long notes, and less audio is assigned to short notes. In this case, one audio frequency may be allocated to the majority of notes, or a different number of audio frequencies may be allocated to the majority of notes. As described above, the text melody synthesizing unit 14 performs automatic audio allocation processing 200303009

Generate 17 output memory map process User Sa2, material data 14 for hybrid electricity mixing 18, Ryule judgment OK ”0 When the step is melody, that is, the word data and its process with text melody data, output to the aforementioned hybrid circuit 丨 7. The mixing circuit generates audio melodic music data from the above-mentioned accompanying melodic data and the accompaniment sound data of the aforementioned music generating section 15, and stores it in the body 18 (i.e., RAM 4) as the incoming melody data. 3 is a diagram showing the process of generating the above-mentioned audio frequency melody music data. Here, step 骡 Sal represents the input processing of rhythm selection information and tune selection information by using the portable terminal device i, and the step represents borrowing The aforementioned music generating section 5 performs melody data and accompaniment sound data generation processing. In addition, step S a 3 represents the input processing of borrowing text by the user. Step S a4 indicates the generation processing of the attached melodic data by the attached melodic synthesis unit. Step S a 5 indicates that the mixed path is used for mixing the melodic data with the accompanying sound data. The audio melody music data obtained through this processing are stored in the memory, and then played appropriately in accordance with the user's instructions. The details of the playback processing of the audio swirl data will be described later. In addition, depending on whether the result played by the user is "0 κ" (step sa 6,), when it is judged as "", the audio melody music generation processing shown in Fig. 3 is completed, and the playback result is not "0K". In this case, repeat the above Sal to step Sa5, so that the desired additional text can be automatically generated. Even if the performance conditions specified in step Sal are changed (also the rhythm selection information and tune selection information) With the input in step Sa3, the person can also repeat the above steps Sal to step Sa5. Ten pairs of melodies of the melody and tune memorized in Z Memory 18 are explained by you. Receive an incoming call from a base station (-10-200303009)

No .: Crying * When the device 1 plays the incoming call melody, it uses the aforementioned CPU2 to perform audio rotation ^ Γ &quot; Relies on the reading of the timing sequence in accordance with its timing data to perform the "4" and output the melodic data with text to the aforementioned formant synthesis Thunder private π i ^ 10 ^, and at the same time output accompaniment sound data to the aforementioned sound source circuit 1 0. According to the adult, material ㈣ ± synthesis circuit 9, the text data,-Austrian audio signal by resonance synthesizing method, at the same time An audio melody signal (ie, a melody audio signal) is generated from the audio signal and the melody data (that is, data with a standard as a standard), and is output to the hybrid circuit 21. In addition, the sound source circuit 10 ' The supplied accompaniment sound data forms a stand-up ρ%, k k, and outputs it to the hybrid circuit 2 1. The hybrid circuit 2 1 is based on the η &lt; audio melody signal and accompaniment sound signal, and is output to the speaker 23 Fig. 4 is a flowchart showing the playback process of the above-mentioned audio melody music. Here, the step ςΐ κ 1 pi / + 6 b ι indicates that the sequencer 20 reads out the audio melody music from the memory 丨 8, / v, 77 separate text Processing of character melody data and accompaniment sound data, step S b 2 &quot; 'denotes that the sequencer 20 starts processing of the audio melody music' step 骡 S b 3, means that the melodic data with text is supplied to the formant The processing of the synthesizing circuit 9, step Sb4, indicates the processing of the acoustic melody signal generated by the formant synthesizing circuit 9, and the step Sb5, indicates the processing of supplying the accompaniment sound data to the sound source circuit I0, and the step Sb6, indicates that The sound source circuit 1 〇 generates the accompaniment sound signal processing, step b S b 7, which indicates the processing of the mixed audio melody signal and the accompaniment sound signal. In addition, at step b S b 8, the user judges whether to instruct the completion of the playback of the music In the case where the music playback is not completed, the foregoing steps S b 3 to S b 7 are repeated, and on the other hand 200303009 (5), when the music playback is completed, the audio melody music playback processing shown in FIG. 4 is completed. If according to the above-mentioned embodiment, the portable terminal device 1 can automatically generate and play an original audio melody music, and the audio melody music is suitable even if it is used as an incoming call melody In addition, since attached files such as e-mail can also send and receive information to other portable terminal devices, a common melody can also be shared between specific acquaintances or friends. Further, the created audio can also be created The melody tune is uploaded to a specific network point via the network or the like, or a new audio melody tune is downloaded from the specific network point. In the above-mentioned embodiment, the new melody of the music player 15 (see FIG. 2) is automatically composed. However, instead of this, the music data (MIDI data) showing most of the music may be stored in the aforementioned RAM 4 in advance, and the music playback unit 15 outputs the melody data about the music selected by the user of the portable terminal device 1 and outputs To the episodic melody synthesizing section 14, the accompanying sound data can also be output to the mixing circuit 17. In this case, the melody of the desired music is played by the user along with the lyrics input by the text. Here, even if the melody of the famous tune is displayed on the tune data stored in the RAM 4, even the melody of other tunes may be displayed. In addition, for the music data stored in the RAM 4 in advance, the user of the portable terminal device can also be used to appropriately change the performance conditions such as rhythm and tune through input operations. Further, the text data is not specifically input by the user of the portable terminal device. For example, even if the text data stored in advance is used, it is also possible to use the text data transmitted by e-mail or the like. 200303009 说明 Description of the Invention Continued As mentioned above, the present invention has various technical features and effects, which will be described below. (1) The audio melody music generating device according to the present invention generates music data including melody data and accompaniment sound data according to specific performance conditions, and text data input by other methods is automatically assigned to the melody data. The episodic melody data is converted into an acoustic melody signal by the formant synthesis method. On the other hand, an accompaniment sound signal is generated based on the accompaniment sound data. When the audio melody music generating device is used in a portable terminal device, the audio melody music and accompaniment sound can be played. (2) As mentioned above, the user of the portable terminal device can generate and play a vocal melody tune that automatically assigns the text data to the melody of the desired tune by simple operation of inputting text data. Even if the audio clarity is relatively low, it can be easier to hear by giving a melody, and it can also produce entertaining music. (3) Compared with the music which only composes music automatically, the melody of the melody of the audio is provided with a melody to the audio, so it is more fun for the listener and can provide entertainment. In particular, it is more appropriate to use an incoming call melody as a portable telephone or the like. The present invention is not limited to the embodiments described above, and various changes can be added within the scope of the invention. Explanation of Symbols of the Drawings 1 Portable Terminal Device-13-200303009 ⑺ 2 Central Processing Unit 3 ROM 4 RAM 5 Communication Interface 6 Series Interface 7 Display 8 Operating Section 9 Formant Synthesis Circuit 10 Sound Source Circuit 13 Text Data 14 Attached Text melody synthesis section 15 Song generation section 17, 21 Mixing circuit 18 Memory 20 Sequencer 23 Speaker

-14-

Claims (1)

200303009 Scope of application and patent application 1. An audio melody music generating device, comprising: a music generating unit, which generates and outputs music data including melody data based on data showing performance conditions of the music that should be generated; Text data melody data synthesis unit, which automatically assigns specific text data to the aforementioned melody data to generate melodic data with text; a memory unit, which memorizes the aforementioned data with melody, and a playback unit, which plays the data from the aforementioned memory The aforementioned melodic data read by the Ministry. 2 · —An audio melody music generating device, characterized in that: It includes: a music generating unit, which generates and outputs music data including melody data and accompaniment data based on data showing the performance conditions of the music that should be generated; Melody data synthesizing section, which automatically assigns specific text data to the aforementioned melody data to generate textual melody data; a generating device that mixes the aforementioned textual melody data and the aforementioned accompaniment sound data to generate music data; a memory section , Which stores the aforementioned music data; and the playback section, which plays the aforementioned music data. 3. If the device for generating audio melody music in the second item of the patent application, the aforementioned playback unit includes: a sequencer, which reads out the song data from the aforementioned memory unit and divides it into 200303009 into the aforementioned text data and the accompanying sound Data to output; a generating device that generates an audio melody signal based on the aforementioned melodic data; a generating device that generates an accompaniment sound signal based on the aforementioned accompaniment sound data; a mixing device that mixes the aforementioned audio signal with the aforementioned Accompaniment sound signals; and speakers, which are outputs to the aforementioned mixing device. 4 · If the audio melody music generating device according to any one of the claims 1 to 3, the data of the aforementioned memory section is transmitted to an external data processing device, and the transmission data from the external data processing device is received, And write into the aforementioned memory section. 5. The audio melody music generating device according to any one of claims 1 to 3, wherein the data of the aforementioned memory section is transmitted to an external server via a communication cable, and the external server is received via a communication cable. The data is transmitted and written into the aforementioned memory section. 6. The audio melody music generating device according to any one of claims 1 to 3, in which the aforementioned performance condition data is data for specifying a desired rhythm for the music. 7. The audio melody music generating device according to any one of claims 1 to 3, in which the aforementioned performance condition data is information on designating a desired tune for the music. 8. For the audio melody music generating device according to any one of the claims 1 to 3, the aforementioned playback unit uses the formant synthesis method to convert the former 200303009 The melodic data described above is transformed into audio signals. 9. The audio melody music generating device according to any one of claims 1 to 3, wherein the aforementioned playback unit converts the aforementioned melodic data into an audio signal by means of a waveform synthesis method. 1 0. A portable terminal device, characterized in that it includes the aforementioned audio melody music generating device as in any of items 1 to 3 of the scope of patent application, and generates a receiving sound based on the melodic data with text in the aforementioned memory section. .