KR100664677B1 - Method for generating music contents using handheld terminal - Google Patents

Abstract

A method for generating music contents in a mobile terminal is provided to arouse a user interest and to increase a user's purchase intention by directly recording a live sound of the user without accompaniment to generate a musical score and music contents file. A wave file is generated by recording a live sound of a user. A musical interval and rhythm are analyzed from base information providing a musical score to automatically generate an editable musical score. One of several musical instruments is selected to generate a MIDI file played according to the musical score. The wave file and the MIDI file are combined to generate a new music contents file. The music contents file is reproduced or re-used.

Description

Method for generating music contents using handheld terminal

1 is a view showing an initial screen of a portable terminal for executing a method for generating music content in a portable terminal according to the present invention;

2 is a view showing a wave file generation screen of a music content generation method in a portable terminal according to the present invention;

3 is a view illustrating selecting an audio library from the wave file screen of FIG. 2;

4 is a view illustrating an initial screen for generating music content and a function thereof in a portable terminal according to the present invention;

5 is a view illustrating selecting an instrument on the initial screen of FIG. 4;

FIG. 6 is a diagram illustrating selecting background music from an initial screen of FIG. 4; FIG.

7 is a view showing a screen for creating and editing music scores in a method for generating music contents in a portable terminal according to the present invention;

8 is a flowchart illustrating a music content generation method in a portable terminal according to the present invention;

9 is a system diagram for executing a method of generating music content in a portable terminal according to the present invention;

10 is a flow chart illustrating a music score generation and editing process of the music content generation method in a portable terminal according to the present invention.

The present invention relates to a method for generating music contents in a portable terminal, and more particularly, to generate a score after generating a wave file by recording a sound of a user, and to edit the score and give various musical effect sounds. The present invention relates to a method for generating music contents in a portable terminal by generating a MIDI file, and finally generating a new playable music content file by combining a wave file recorded with a voice and a MIDI file.

With the popularization and technical development of portable terminals, terminals having various service and content functions continue to be released.

Currently, one of the content functions provided in the portable terminal includes a function of selecting a music file such as a pre-made ringtone or a melody, and a ring back tone service in which music is set instead of a dial sound during a call. If you want, you can download the music file from your music service provider to your portable device.

As the spread of portable terminals has become commonplace, the same ringing tone, that is, the same ringing tone is ringing simultaneously from different mobile phones in the same place is occurring frequently, and thus most mobile phone users feel sick. I also want to edit and compose my own personal music.

In view of this, Korean Patent Application Publication No. 2005-84720 discloses a "method for playing music on a mobile phone". This patent converts a musical score to a melody data for playing with a camera or plays a music file. Or to provide a way to convert ringtone files.

However, the method of photographing the sheet music with the camera is cumbersome to have the sheet music of the music which is composed by the user or the sheet music of the well-known music in advance, and it is not possible to use it when the sheet music is not provided. There is a problem that is insufficient to attract the interest and inefficient to apply to a portable terminal.

As another example, Korean Patent Application Publication No. 2004-38016 discloses "a mobile phone with a melody playing function", which has a built-in melody chip so that the user can play the melody by operating the keypad. One point is that you can record and save the melody you play as a ringtone.

However, if the operation of playing the melody by operating the keypad is incorrect, not only the performance of the melody cannot be executed correctly, but also the inconvenience of having to repeatedly operate the keypad because the composition or the sheet music generation that the actual user wants is not achieved.

As another example, Korean Patent Application Publication No. 2004-48470 discloses a method of composing music in a portable terminal, which is a user inputting a keypad of a terminal to personally compose music. It is characteristic of one point to make music which is present.

However, the steps of composing / editing / modifying music, etc., are disadvantageous in that the user has to repeatedly input the keypad directly, and the input time is too long.

The present invention is the result of the research and development in view of the above, the step of generating a wave file by directly recording the sound of the user (singing, humming, etc.) and the music score is automatically generated editable, and the sheet music To create a MIDI file by selecting an instrument or adding various musical effects while editing the file, and finally creating a new playable music content file by combining the recorded sound file and the MIDI file. Through the steps, to provide a method of creating music content in a portable terminal that can be used with everyone's interest and have a different dimension from the music composition or editing method of the music by the existing keypad input or the existing keypad input. It is.

The present invention for achieving the above object is:

Iii) generating a wave file by recording a voice generated by a user directly; Ii) automatically generating editable sheet music by analyzing pitch and beat from base information capable of providing sheet music; Iii) selecting one of several instruments to generate a MIDI file played according to the score; Iii) combining the wave file and the MIDI file with the same pitch and tempo to create a new music content file; Iii) a method of generating music contents in a portable terminal, comprising the step of playing or reusing the new music contents file.

In a preferred embodiment, the step of automatically generating the editable sheet music includes: i) photographing the sheet music on the actual paper as a base information capable of providing the sheet music, and analyzing the pitch and time signature from the photographed sheet music image file. Or done; Ii) using the key input means of the portable terminal as the base information for providing the sheet music, by directly selecting the notes and pitches of the pre-built sheet music program; Iii) importing a previously recorded music file as base information capable of providing sheet music, and then analyzing the pitch and beat of the music file; I) As the base information that can provide the score, it may be made by analyzing the pitch and the beat from the wave file in which the user has voiced the sound.

The wave file in which the user voice is recorded is separately stored to be used as voice lyrics data in step iii), and the wave file is analyzed using the copied file.

Preferably, various sound effects may be further mixed with the recorded wave file of the user voice.

Step ii) of automatically generating editable music scores by analyzing the pitch and time signature from the wave file comprises: dividing the voice data of the recorded user into syllable units and measuring the length and height of the sound for each syllable to generate a musical note. Steps; Determining a time interval between each syllable to generate a comma; By generating the notes and the rest is composed of a step consisting of a beat and a pitch suitable for the user's development.

In the step iii), it is possible to generate a MIDI file to which various musical effect sounds including rhythm, harmony, background music, and sound effects are added to the musical instrument in addition to the selected musical instrument.

Preferably, the pitch and tempo information obtained from the user sound can be used as a MIDI file, and the pitch and tempo of the user sound source can be changed when the pitch and tempo are changed while editing the score.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The present invention is to provide a music service content that can be applied to a portable terminal, a wave file recorded with the user's sound (song, humming, beat box, etc.) and a musical instrument or a variety of other musical effects The main point is to combine the created MIDI files to create a new playable music content file.

1 is a flowchart illustrating a music content generation method in a portable terminal according to the present invention.

As a first step to create a music content file according to the present invention, using a external microphone and a recording device provided in the portable terminal to record the user's sound, that is, songs, humming, beat box, etc. and stored as a wave file.

The waveform example of the user's sound recorded as a wave file is displayed as shown in the capture screen of FIG. 2, and when a library is added in this screen, the natural sound is displayed from the window of FIG. (Wind, rain, lightning, etc.), various animal sounds, human voices (whistles, laughter, etc.), noise (airplane sounds, horns, etc.), other sound effects (knock , Bomb sounds, etc.) may be overwritten or additionally mixed (mixed) with the recorded wave file.

In addition, the wave file in which the user voice is recorded is separately stored to be used as voice lyrics data when the music content file is generated, and the wave file for music score generation is analyzed using the copied file.

As a second step for creating a music content file according to the present invention, a step of automatically generating editable sheet music by analyzing pitch and beat from the wave file is performed.

Automatically generating the editable sheet music is to divide the recorded user's voice data into syllable units to generate a note by measuring the length and height of each syllable, and the time interval between each syllable. It is determined by the step of generating a comma, and as a result, a sheet music composed of beats and pitches suitable for the user's sound is generated.

In more detail, the syllable unit divisions are performed by analyzing continuous sound source waveforms, dividing regions having a constant pitch into basic regions, and re-dividing each basic region by syllable units of user-grown sounds. Based on this, a note is generated through a pitch recognition step.

In the pitch recognition step, a frequency is measured for each of the sound source waveforms divided into the same pitch, and the sound height (position on the scale-degree, level, me, wave, etc.) and the length of the sound for the waveform are determined and the corresponding note is obtained. Each scale has its own frequency and can be used to distinguish octaves.

The step of automatically generating the editable sheet music is most preferably performed by analyzing the pitch and time signature from the wave file as described above. Alternatively, the sheet music on the actual paper sheet is used as a base information for providing the sheet music. A method by analyzing the pitch and time signature from the photographed score image file, or as a base information for providing the score, using the key input unit of the portable terminal to directly It is a matter of course that the method made by selection or the method of analyzing the pitch and time signature of the music file after the music file previously recorded as the base information for providing the score can be selectively utilized.

7 is a screen of the generated sheet music, which is capable of editing the sheet music generated by selecting a note to be input (4), an editing tool (5), an octave display (7), a note input window (8), and the like. Do.

10 is a flowchart illustrating a music score generation and editing process in a method for generating a music content file in a portable terminal according to the present invention. A music score is generated by analyzing a wave file in which user voices are recorded, and a tempo in the score. The sheet music is edited by changing, changing the tone and note, changing the pan and volume, and generating the sheet music by user input.

As a third step for creating a music content file according to the present invention, a step for generating a MIDI file is performed.

FIG. 4 is an initial screen for generating a MIDI file, FIG. 5 is a screen showing selecting an instrument on the initial screen of FIG. 4, and FIG. 6 is a screen showing selecting background music on the initial screen of FIG. to be.

By selecting one or more of the various musical instruments, a MIDI file played according to the musical score generated as described above is generated. As an example, as shown in FIGS. 4 and 5, an organ on track 1, a piano on track 2, a celesta on track 3, Organ 4 is selected for track 4 and guitar is selected for track 5, so that a MIDI file of an ensemble played by each musical instrument as the musical score generated as described above is generated.

Of course, you can add tracks to select and select another instrument.

In addition to the musical instrument selected in this way, it is possible to generate a MIDI file to which various musical effect sounds including rhythmic feelings, chords, background music, and sound effects are assigned.

That is, as shown in the screen of Figure 6, by selecting the portion displayed in the rhythm can be given a variety of rhythms (dance, jazz, Latin, pop, reggae, rock, etc.), and the given rhythm once or more It can also be repeated many times.

On the other hand, the pitch and tempo information obtained from the user training sound can be used as a MIDI file, and the pitch and tempo of the user training sound source can be changed when the pitch and tempo are changed while editing the score.

In this way, you can open the created music file MIDI file, and specify or change each element for creating a MIDI file such as volume, tempo, and instrument, and assign an instrument or apply a chord or other sound effect. By providing various background music to add more musical elements and allowing the user to selectively synthesize them, the user's interest can be further increased.

As a fourth step for creating a music content file according to the present invention, the step of combining the wave file and the MIDI file with the same pitch and tempo to generate a new music content file.

That is, a step of generating a new music content file by combining a wave file in which the user voice is directly recorded and a MIDI file in the score format are performed.

As shown in the accompanying FIG. 1 screen, a wave file in which user voices (songs, hummings, beat boxes, etc.) are recorded, and musical instrument sounds (for example, organs on track 1 and pianos on track 2) are recorded. If you save (see Fig. 1) when a MIDI file with mixed background music (e.g., dance) on a track 3, a celesta, an organ on track 4, and a guitar on track 5 is mixed, , A new music content file (* .fmc) is created.

Finally, as a step of reproducing or reusing a music content file according to the present invention, a step of reproducing or reusing a music content file in which a recorded user voice and an automatically generated and edited score is combined is performed.

The new music content generated as described above may be reproduced through the generated device, transmitted by changing to various sound source formats, or played through heterogeneous devices, and used as a user sound for various sound source settings of the mobile phone.

On the other hand, Figure 9 is a system diagram for executing a music content file generation method in a portable terminal according to the present invention, showing a configuration mounted on a portable terminal or a PC capable of online communication.

That is, a microphone and recording apparatus capable of recording user voices, an AD converter and a device driver connected to the recording apparatus, software for generating music content files of the present invention, and memory for storing execution data of the software. And a controller for controlling the software, a CPU, and a speaker device for listening to music content files.

The music content file generated according to the present invention can be directly stored in the portable terminal and can be downloaded to the user's portable terminal from a PC capable of online communication (Internet).

As described above, the music content generation method in the portable terminal according to the present invention provides the following effects.

1) By combining a wave file recording the user's sound (song, humming, beatbox, etc.) with an editable score formed based on the wave file, and a MIDI file created by assigning musical instruments and musical effects to the score, Dimensional music content files can be provided.

2) Since music generation files and music content files are generated only by directly recording user voices without any accompaniment, the user's (consumer's) interest and fun can be greatly increased, thereby increasing purchase motivation.

3) By selecting the user-created music as the ringtone ringtone, etc., it provides the advantage that you can directly edit / compose your own personalized music.

Claims (10)

In the music file generation method using a portable terminal, Iii) generating a wave file by recording a voice generated by a user directly; Ii) automatically generating editable sheet music by analyzing pitch and beat from base information capable of providing sheet music; Iii) selecting one of several instruments to generate a MIDI file played according to the score; Iii) combining the wave file and the MIDI file with the same pitch and tempo to create a new music content file; Iii) playing or reusing the new music content file; Music content generation method in a portable terminal comprising a. The method of claim 1, wherein automatically generating the editable sheet music is performed by photographing a sheet music on a real paper as a base information capable of providing sheet music with a digital camera, and analyzing pitch and time signature from the photographed sheet music image file. A music content generating method in a portable terminal, characterized in that. The method of claim 1, wherein the step of automatically generating the editable sheet music is characterized in that the note and the pitch of the pre-built sheet music program using the key input means of the portable terminal as the base information that can provide the sheet music directly selected Music content generation method in a portable terminal. The method of claim 1, wherein the step of automatically generating the editable sheet music is characterized in that the music file that has been recorded in advance as the base information for providing the sheet music, and then analyzes the pitch and beat of the music file Music content generation method in a portable terminal. The portable apparatus of claim 1, wherein the generating of the editable sheet music is performed by analyzing the pitch and the beat from a wave file in which the user generates voices as the base information for providing the sheet music. A method of generating music content on a terminal. The portable terminal of claim 1, wherein the wave file in which the user voice is recorded is separately stored to be used as voice lyrics data in the step iii), and the wave file is analyzed using the copied file. To create music content for a player. The method according to claim 1 or 6, And a method of overwriting or additionally mixing various sound effects on the recorded wave file of the user voice. The method according to claim 1, Iii) Automatically generating editable sheet music by analyzing pitch and time signature from the wave file: Generating a note by dividing the recorded voice data of the user by syllable units and measuring the length and height of the note for each syllable; Determining a time interval between each syllable to generate a comma; And generating a musical score consisting of a beat and a pitch suitable for a user's sound by generating the notes and rests. The method according to claim 1, In the step iii), it is possible to generate a MIDI file to which the various musical effect sounds including rhythm, harmony, background music, and sound effects are added to the musical instrument in addition to the selected musical instrument. How to produce. The method according to claim 1, The portable terminal, characterized in that the pitch and tempo information obtained from the user training sound can be used as a MIDI file, and the pitch and tempo of the user training sound source can be changed when the pitch and tempo are changed while editing the score. How to create music content in.

Images