JP3530485B2 - Performance collecting apparatus, performance collecting method, and computer readable performance collecting program recording medium - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a search condition input device in a system for searching music information, and more particularly,
The present invention relates to a performance collecting device that allows a user to input search conditions by humming a part of a desired piece of music or playing with a musical instrument.

[0002]

2. Description of the Related Art As a conventional technique for allowing a user to hum a part of a melody to search for a desired song from a song database, Japanese Patent Application Laid-Open No. Hei 5 (1999) -57.
-61917, JP-A-6-274157,
JP-A-7-36478 and JP-A-11-27227.
As shown in Japanese Patent Publication No. 4 and the like, many inventions have been made.

The humming performance sampling device in these prior arts generally has a structure as shown in FIG. The user inputs humming through the microphone 901. The inputted Hamming performance signal is converted into a digital signal by the A / D conversion means 902. Note information acquisition means 90
3 analyzes the digital signal and obtains note information of the humming performance. This note information is used as a search condition for the music database.

[0004]

However, the above-described conventional humming performance collecting apparatus has no means for guiding the user about the humming tempo, and it is difficult for the user to hum at a stable tempo. There was a problem. The tempo is a part of the musical score information, and the variation in the humming tempo is also reflected in the note information of the humming performance output from the humming performance collection device. As a result, there is a problem in that the difference between the note information of the humming performance and the note information of the corresponding song in the song database becomes large, resulting in deterioration of search accuracy.

An object of the present invention is to solve the above-mentioned problem of the performance collecting device by humming or the like, and to allow the user to hum in accordance with the tempo of a guide sound or an animation motion. The purpose of the present invention is to provide a performance sampling device capable of inputting humming at a stable tempo and removing noise noise mixed in during performance input by a simple method.

[0006]

In order to achieve the above object, the present invention provides means for generating a guide sound at a constant cycle such as a metronome in order to assist a humming player to play at a constant speed. Also, it has a means for performing a humming of the player recorded from a microphone or the like and a noise processing for removing the noise such as the guide sound from the mixed voice of the guide sounds and acquiring only the desired humming performance. This is the most important feature.

[0007] Specifically, the performance collecting apparatus of the present invention enables a user to hum at a constant tempo, for example, in an apparatus for acquiring musical note information of a music by analyzing a performance signal input by the user by humming. A guide sound generating means for generating a guide sound for supporting, an animation control means for controlling an animation display for supporting the user so that the user can hum at a constant tempo, and a guide sound for the guide sound generated by the guide sound generating means. Tempo adjusting means for adjusting the generation cycle and the cycle of animation operation controlled by the animation control means, and note information selecting means for selecting only the notes satisfying a predetermined condition from the note information obtained by analyzing the humming performance signal. And selection condition setting means for setting the condition of the note selected by the note information selecting means. And butterflies.

In the above performance collecting device, the tempo adjusting means receives a tempo changing operation by the user,
Instructing the guide sound generation means and the animation control means to change the tempo. The guide sound generating means outputs the guide sound at a constant cycle so that the user can listen to the guide sound. When the tempo adjusting means instructs the tempo change, the guide sound generating cycle is set to the instructed tempo. Change to the corresponding cycle.

Further, the animation control means displays an animation in which the user repeats the operation at a constant cycle, and when the tempo adjustment means gives an instruction to change the tempo, the guide sound generation means is activated. Change the repeat cycle of the animation operation to the cycle corresponding to the specified tempo while synchronizing with the guide sound.

Thus, the user can adjust the guide sound and the tempo of the animation operation output from the performance collecting device so that they can be easily hummed, and then hum at a stable tempo according to the guide sound and the animation operation. become.

Further, in the above performance collecting device, the selection condition setting means receives a note selection condition setting operation by the user and instructs the note information selection means to set the selection condition. The note information selection means filters the note information obtained by analyzing the humming performance signal, and selects and outputs only those satisfying the note selection conditions set by the selection condition setting means. This makes it possible to delete the note information corresponding to the noise sound (guide sound, etc.) other than the user's humming input through the microphone after adjusting the noise sound intensity that changes depending on the sensitivity of the microphone. .

The program for realizing the above processing means by a computer can be stored in an appropriate recording medium such as a computer-readable portable medium memory, a semiconductor memory, a hard disk.

[0013]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing the configuration of the embodiment of the present invention. In FIG. 1, 10
1 is a microphone, 102 is an A / D conversion means, 103 is note information acquisition means, 104 is guide sound generation means, 105 is animation control means, 106 is tempo adjustment means, 107
Is note information selection means, 108 is selection condition setting means, 10
Reference numeral 9 is a speaker and 110 is a display.

While listening to the guide sound output from the speaker 109, the user also displays the display 110.
While watching the animation motion displayed on the screen, microphone 1
The phrase of the desired music is hummed toward 01.
This guide sound is obtained by converting the digital signal continuously generated by the guide sound generating means 104 at a constant cycle into the A / D converting means 1.
It is converted into an analog signal by 02 and output as a sound that can be heard by the speaker 109. The guide sound assists the user in humming at a constant tempo, and for example, a continuous sound with a fixed cycle, such as the metronome “clicks, clicks” is suitable.

In particular, it is desirable that the pitch of the guide tone is not included in the range of the humming pitch of the user. The reason is that, after the note information is acquired from the humming, the note information selecting unit 107 performs a process of removing the guide sound as a kind of noise based on the pitch of the note, for example. This process will be described later.

On the other hand, in the animation operation, a series of image information registered in advance by the animation control means 105 is repeatedly displayed on the display 110 at a constant cycle. For example, an animation expressing a pendulum operation of a metronome is suitable. Is.

The humming performance of the user is input from the microphone 101 to the A / D conversion means 102 as an analog signal and converted into a digital signal by the A / D conversion means 102. Here, the A / D conversion means 102 can be mounted by, for example, a sound board used in a personal computer.

The user uses the tempo adjusting means 106 to adjust the guide sound and the animation operation so that the tempo makes it easy to hum depending on the music to be hummed. FIG. 2 shows an example of an operation screen for tempo adjustment displayed by the tempo adjusting means 106. The user is
In the tempo adjustment screen shown in FIG. 2, by moving the slide bar with a pointing device such as a mouse, it is possible to change the interval at which the guide sound is generated. The tempo adjusting means 106 calculates the guide sound generation period from the detected position of the slide bar, based on the number of beats and the time previously associated with the position of the slide bar.

FIG. 3 shows an example of a control flow for generating the guide sound by the guide sound generating means 104 and the tempo adjusting means 106. The guide sound generation means 104 first sets the sound information used for the guide sound, the generation cycle of the sound information,
And, the timer for monitoring the generation period of the sound information is cleared as a pre-process (S301). Here, the sound information used for the guide sound corresponds to digital signal information corresponding to a single sound "click" when the metronome sound "click" is used as the guide sound. Further, the generation cycle can be calculated as 0.5 seconds, for example, if the number of beats per minute is 120. Since the timer has been cleared by this preprocessing, the guide sound generating means 104 immediately transmits the sound information to the A / D converting means 102 (S302, S30).
3), the first guide sound is output from the speaker 109.

After transmitting the guide sound information, the guide sound generating means 104 allows the user to change the tempo by the tempo adjusting means 10.
It is checked whether the request is made using 6 (S305),
For example, if a request to change the number of beats per minute from 120 to 60 is accepted, the generation cycle is changed from 0.5 seconds to 1
Change to seconds (S306).

Next, the guide sound generating means 104 sets the current generation period in the timer (S307), monitors the value of the timer while decrementing according to the elapsed time (S302, S304), When the value becomes zero, the next guide sound signal is transmitted (S303). By repeating the above, it is possible to output the guide sound according to the tempo set by the user.

Next, an example of the control flow of the animation operation by the animation control means 105 and the tempo adjustment means 106 will be described with reference to FIG.

The animation control means 105 first sets the image information used for the animation, sets the image information display interval, clears the timer for monitoring the image information display interval, and initializes the display image number. It is executed as a pre-process (S401, S402).

Here, the image information used for the animation corresponds to a series of image groups as shown in FIG. 5 when the pendulum motion of the metronome is animated. The series of image information shown in FIG. 5 is periodically displayed on the display 110 in the order of image 1 → image 2 → ... → image 5 → image 4 → ... → image 1, and the image 1 and image 5 are displayed. By synchronizing the display timing with the guide sound generation timing, the metronome is imitated visually.

The display interval of the image information is obtained from the guide sound generation period and the number of images forming the animation. For example, the guide sound generation period is 0.5 seconds and the number of images is 5. Then, 0.5 / (5-1) =
It can be calculated as 0.125 seconds. The initial value of the display image number N is, for example, if the image 1 in FIG. 5 is the initial display image,
Let N = 1.

After the above-described pre-processing, the animation control means 105 waits for the guide sound generation means 104 to generate the guide sound, and synchronizes the display timing of the initial display image with the guide sound generation timing (S403). ). After the guide sound is generated, the animation control means 105 enters the monitoring state of the timer (S404), but since the timer has been cleared by the preprocessing in the initial state, the image 1 is immediately displayed on the display 110 (S405). After this display, the animation control means 105 updates the display image number N to the number of the image to be displayed next. When using the image group of FIG. 5, for example, there are two types of updating operations, an operation of incrementing the value of N from 1 to 5 and an operation of decrementing from 5 to 1, but the animation control means 105 uses N. Each time the value of reaches the minimum value or the maximum value, the operation is switched to realize a periodic animation operation (S407 to S411).

Next, the animation control means 105
It is checked whether or not the user has requested the change of the tempo (change of the guide sound generation period) using the tempo adjusting means 106 (S412), and for example, the generation period of the guide sound is changed from 0.5 seconds to 1 second. If the image display interval is 0.12
While changing from 5 seconds to 0.25 seconds (S413),
Initialization for synchronizing the guide sound and the animation operation is performed (S402, S403).

If the tempo is not changed, the animation control means 105 sets the current image display interval in the timer (S414), monitors the timer value while decrementing according to the elapsed time (S404, S406), When the value of the timer reaches zero, the next image information is displayed on the display 110 (S405).

By repeating the above, an animation operation according to the tempo set by the user becomes possible. In the present embodiment, the case where the pendulum motion of the metronome is represented by animation has been described, but the animation usable in the present invention is not limited to this, and for example, the rotation motion of the hands of the clock or the motion of the character swinging the baton, etc. ， Any animation that works cyclically can be used.

The note information acquisition means 103 analyzes the digital signal of the humming performance output from the A / D conversion means 102, and obtains the note information corresponding to the humming performance. As a program for converting the digital signal of performance into note information, for example, Autoscore developed by Wildcat Canyon
There are products such as Professional, and note information acquisition means 1
03 can be implemented using such a product.

The note information selection means 107 selects only the note information output from the note information acquisition means 103 that satisfies a preset condition. Microphone 10
The sound input through 1 generally includes not only the humming performance of the user, but also a noise sound such as a guide sound output from the speaker 109 and ambient noise. These sounds are note information acquisition means 103 for selecting the type.
However, the note corresponding to the noise sound is unnecessary information for the music search, and if the search is performed including these unnecessary notes, the search accuracy deteriorates.

Therefore, the note information selection means 107 obtains the average value A of the pitches of all the note information output from the note information acquisition means 103, and the notes relating to the humming performance are fixed around the average value. By utilizing the characteristic that the pitch is generally within the pitch difference D of, only the notes whose pitch is in the range of A-D to A + D are selected. The value of the pitch difference D that determines the note selection range is
The optimum value changes depending on the sensitivity of 01, the voice quality of the user, the analysis accuracy of the humming performance in the note information acquisition means 103, and the like. The user can finely adjust the value of D through the selection condition setting means 108 and appropriately change the value of D set in the note information selection means 107.

FIG. 6 shows an example of the operation screen displayed by the selection condition setting means 108 for setting the selection condition of the note information. On the note information selection condition setting screen shown in FIG. 6, the user can change the size of the pitch difference D that determines the note selection range by moving the slide bar with a pointing device such as a mouse. The selection condition setting means 108 determines the pitch difference D from the detected position of the slide bar based on the value of the pitch difference D previously associated with the position of the slide bar, and the note information selecting means 1
Notify 07.

An example of the control flow of note information selection by the note information selection means 107 and the selection condition setting means 108 will be described with reference to FIG.

The note information selection means 107 first sets the initial value (default value) of the pitch difference D as preprocessing (S701). Next, the note information acquisition means 103 inputs the note information acquired from the user's humming performance (S702), and calculates the average value A of the pitches of all the notes of the note information (S703).

After that, the note information selection means 107 takes out the notes one by one from the beginning of the inputted note information (S704), and the pitch of the taken notes is from A-D to A +.
It is determined whether it is included in the range of D (S705).
If it is within the selected range from A-D to A + D, the data of the note is stored in the work area (S706). If it is outside the selected range, the data of the note is rejected, and the note length of the preceding note (the last note in the work area) is increased by the length of the rejected note (S707). Step S704 above
~ S707 is repeated for all the notes of the note information (S7
08).

When the process of selecting the note information for all the note information is completed, the note information stored in the work area is displayed on the display 110 in the musical score format as necessary, or the note information is converted into a sound and then the speaker. The performance is output from 109 (S709). Note that this step S709 can be omitted. During the above processing, the selection condition setting means 1
08 displays the note information selection condition setting screen shown in FIG. 6 to monitor whether or not the user has input selection condition change information. If the selection condition is changed, the note information selection means 107 changes the pitch difference D according to the instruction of the selection condition setting means 108 (S711), and step S704.
Then, the process of selecting the note information based on the new pitch difference D from the first note of the note information is re-executed.

When the user's OK is confirmed for the collected note information without changing the selection condition, the note information stored in the work area is used as the final collection result (S71).
2).

In the above, an example of the condition based on the average value A of the pitches and the set pitch difference D is shown as the note selection condition. However, the difference between the pitches of the preceding and following notes may be used as the selection condition. It may be possible to set a condition in which a pitch value or a pitch deviation value is taken into consideration.

FIG. 8 shows an example of a music information retrieval system to which the present invention is applied. The music information search server 800 and the user terminal 810 are connected via the network 820. Music database 8 of music information search server 800
In 02, a large number of music data are stored in advance. The music search unit 801 uses the note information sent from the user terminal 810 as a search key to search the music database 8
The music data stored in 02 is searched, and the search result is returned to the user terminal 810 which is the search request source. Various methods are known as methods for searching for music by the music search unit 801 and are not the gist of the present invention, so detailed description thereof will be omitted.

The present invention is used, for example, in the music search key input unit 811 in the user terminal 810. The music search key input unit 811 is composed of the means shown in FIG. 1, inputs a user's humming, converts it into musical note information, and uses the musical note information as a musical piece search key for a music information search server. Send to 800. The search result output unit 812 outputs the music and music information of the search result sent from the music information search server 800. It is possible to perform performance output of the music of the search result, display general music information such as the title of the music and the composer's name, and print out the score.

In the above description of the embodiment, an example of a user's humming performance was described as a performance that can be input to the device of the present invention, but the present invention is not limited to the user's humming performance, and for example, The user's singing and musical instrument performances can also be input.

[0043]

As described above, according to the present invention, when a user searches a music database for a desired music such as by humming a part of a melody, the user adjusts to a guide sound or an animation operation. Since the humming can be performed at a stable tempo, the difference between the note information of the humming performance or the like output from the performance collecting device and the note information of the corresponding song in the song database can be reduced. In particular, noise such as a guide sound that is mixed in at the time of performance input can be removed in accordance with preset note selection conditions, so that there is an effect that the accuracy of searching the music database can be improved.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an embodiment of the present invention.

FIG. 2 is a diagram showing an example of a tempo adjustment screen.

FIG. 3 is a control flowchart of guide sound generation according to the embodiment of the present invention.

FIG. 4 is a control flowchart of an animation operation in the embodiment of the present invention.

FIG. 5 is a diagram showing a configuration example of image information used for animation display in the embodiment of the present invention.

FIG. 6 is a diagram showing an example of a note information selection condition setting screen.

FIG. 7 is a control flowchart of note information selection according to the embodiment of the present invention.

FIG. 8 is a diagram showing an example of a music information search system to which the present invention is applied.

FIG. 9 is an explanatory diagram of a conventional technique.

[Explanation of symbols]

101 microphone 102 A / D conversion means 103 note information acquisition means 104 Guide sound generating means 105 Animation control means 106 Tempo adjustment means 107 Note information selection means 108 selection condition setting means 109 speakers 110 display 800 Music Information Search Server 801 Music Search Section 802 Music database 810 User terminal 811 Music search key input section 812 Search result output section 901 microphone 902 A / D conversion means 903 Note information acquisition means

─────────────────────────────────────────────────── ─── Continuation of the front page (56) References JP 2000-200083 (JP, A) JP 9-152865 (JP, A) JP 8-202537 (JP, A) (58) Fields investigated (Int.Cl. ⁷ , DB name) G10G 1/00-3/04 G10H 1/00

Claims (6)

(57) [Claims] 1. A performance sampling device for analyzing musical performance signals input by a user during humming, singing or playing a musical instrument to acquire musical note information of a musical composition or a part of the musical composition, so that the user can perform at a constant tempo. Guide sound generating means for generating a guide sound, a tempo adjusting means for adjusting the generation cycle of the guide sound generated by the guide sound generating means, and note information for acquiring note information by analyzing an input performance signal. Acquisition means, note information selection means for selecting only notes satisfying a predetermined condition from the note information acquired by the note information acquisition means, and selection condition setting means for setting conditions of notes selected by the note information selection means A performance sampling device comprising: 2. An animation control means for controlling an animation display for assisting a user to perform at a constant tempo, wherein the tempo adjusting means generates a guide sound generated by the guide sound generating means. 2. The performance collecting apparatus according to claim 1, wherein the animation control means adjusts the repetition cycle of the animation operation displayed by the animation control means. 3. The tempo adjusting means accepts a tempo change operation by a user, instructs the guide sound generating means and the animation control means to change the tempo, and the guide sound generating means can be heard by the user. As described above, the guide sound is output at a constant cycle, and when the tempo adjusting means instructs the tempo change, the guide sound generation cycle is changed to a cycle corresponding to the instructed tempo, and the animation control means ， While displaying an animation that repeats the action to the user at a fixed cycle,
When the tempo adjusting means gives an instruction to change the tempo,
The performance collecting apparatus according to claim 2, wherein the repetition cycle of the animation operation is changed to a cycle corresponding to the instructed tempo while synchronizing with the guide sound generated by the guide sound generating means. 4. The selection condition setting means receives a note selection condition setting operation by a user, sets a note selection condition to the note information selection means, and the note information selection means inputs the input performance. The note information obtained by analyzing the signal is filtered, and only the note information satisfying the note selection condition set by the selection condition setting means is selected and output. The performance collecting device according to any one of 1. 5. A performance sampling method in which a musical performance signal input by a user during humming, singing or playing a musical instrument is analyzed to acquire musical note information of a musical composition or a part of the musical composition, so that the user can perform at a constant tempo. A note sound is generated by analyzing the performance signal input by the user in accordance with the guide sound, and the note information is acquired from the acquired note information according to preset note selection conditions. A performance sampling method characterized by selecting only the notes that satisfy the conditions and using the selected notes as the note information of the sampling result. 6. A recording medium, which records a program for analyzing musical performance signals input by a user during humming, singing, or playing a musical instrument to acquire musical note information or musical note information of a part of the musical composition. Process for generating guide sound to support the performance at the tempo, process for adjusting the generation cycle of the generated guide sound based on setting information, and note information is acquired by analyzing the input performance signal A computer-readable program characterized by recording a program for causing a computer to execute a process, a process of selecting only notes satisfying a predetermined condition from the acquired note information, and a process of setting conditions of a selected note. Program recording medium for possible performance collection.