JP2017027087A - Code selection device, automatic accompaniment device, automatic accompaniment method and code selection method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable chords to be accurately and appropriately applied on the basis of history of melody sounds.SOLUTION: Musical piece database means that stores, as musical piece data, melody information and chords corresponding to the melody information for each of a plurality of musical pieces is provided. In addition, there are provided: musical piece retrieval means that retrieves musical piece data having corresponding melody information from the musical piece data base on the basis of performance information generated by operating a performance operator; chord determination means that determines chords on the basis of the performance information stored in performance storage means; chord selection means that selects whether to use the chord stored in association with the musical piece retrieved by the musical piece retrieval means, or the chords determined by the chords determination means; and automatic accompaniment means that indicates generation of accompaniment sounds based on the chords selected by the chord selection means.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a chord selection device, an automatic accompaniment device, an automatic accompaniment method, and an automatic accompaniment program.

  In a musical instrument having a keyboard, such as a piano, organ, electronic keyboard, or electronic piano, it is common to play an accompaniment with the left hand while playing a melody with the right hand.

  However, in order to perform the performance by moving the right hand and the left hand at the same time, appropriate practice is required. In particular, many beginners feel that it is difficult to move the right hand to play a melody, but at the same time it is difficult to play an accompaniment different from the melody with the left hand. For this reason, accompaniment equivalent to playing the left hand is automatically created as the performer plays the melody with the right hand so that even such a beginner can easily enjoy the performance. An electronic musical instrument to be played is realized.

  For example, Patent Literature 1 discloses a technique of an electronic musical instrument that can appropriately determine a chord name based on the weight of a melody sound and its transition.

JP 2011-158855 A

  In the electronic musical instrument described in Patent Document 1, the chord determination is performed using the position and weight of the beat of the melody sound, the melody sound and the chord name (chord name) at the beginning of the previous beat, etc. The melody progression and chording of a typical music can be performed in a very large number of different cases. In particular, in the field of music, the coding of melody progression is often judged by human sense, and the accuracy of coding by a machine There has been a demand for further improvement.

  The present invention has been made in view of the above points, and a chord selection device, an automatic accompaniment device, an automatic accompaniment method, and an automatic accompaniment that can quickly perform appropriate and accurate chording based on a history of melody sounds. The purpose is to provide a program.

  In order to achieve the above object, an automatic accompaniment apparatus according to one aspect of the present invention sequentially stores performance information for instructing the generation of musical sounds in response to an operation of the performance operator in each memory. And a performance storage means, and each time the performance information is stored in the memory, based on the performance information stored in the memory, melody information and a code corresponding to the melody information for each of a plurality of pieces of music. Music search means for searching music data having melody information corresponding to the performance information from music database means stored as music data; code determination means for determining a chord from performance information stored in the memory; Among the codes stored corresponding to the music searched by the music search means and the codes determined by the code determination means And code selection means for selecting use of either of the code, based on the selected encoded by said code selecting means, characterized by comprising an automatic accompaniment means for instructing generation of accompaniment sounds.

  Further, according to the present invention, the chord selection means compares the function of the chord stored in correspondence with the music data searched by the music searching means and the chord determined by the chord determination means, The code is selected based on the comparison result of the function of the code.

  Further, according to the present invention, when the chord selection means matches the function of each of the chord stored in correspondence with the music data searched by the music searching means and the chord determined by the chord determination means, A chord determined by the chord determining means is selected, and if the chord functions do not match, a chord stored in the music data is selected.

  According to the present invention, since both automatic coding and coding using a music database can be appropriately used based on the melody sound history, appropriate and accurate coding can be performed. This can be done quickly.

FIG. 1 is a diagram showing an external appearance of an electronic musical instrument according to the present embodiment. FIG. 2 is a block diagram showing the configuration of the electronic musical instrument according to the embodiment of the present invention. FIG. 3 is a flowchart showing an example of a main flow executed in the electronic musical instrument according to the present embodiment. FIG. 4 is a flowchart showing an example of keyboard processing according to the present embodiment. FIG. 5 is a flowchart showing an example of song candidate search processing according to the present embodiment. FIG. 6 is a flowchart illustrating an example of the F list-up process according to the present embodiment. FIG. 7 is a flowchart showing an example of the K list-up process according to the present embodiment. FIG. 8 is a flowchart showing an example of N list-up processing according to the present embodiment. FIG. 9 is a flowchart showing an example of the D list-up process according to the present embodiment. FIG. 10 is a flowchart showing an example of processing for creating a comprehensive list from the N list and the D list according to the present embodiment. FIG. 11 is a flowchart illustrating an example of the code selection process according to the present embodiment. FIG. 12 is a diagram showing an example of a music database according to the present embodiment. FIG. 13 is a diagram showing a score corresponding to the music database of FIG. FIG. 14 is a diagram showing an example of recorded data of the performance input melody history according to the present embodiment. FIG. 15 is a diagram illustrating an example of the F list according to the present embodiment. FIG. 16A shows an example of an input melody history according to the present embodiment, and FIG. 16B shows an example of a K list corresponding to the input melody of FIG. FIG. 17A shows an example of the input melody history according to the present embodiment, and FIG. 17B shows an example of an N list corresponding to the input melody of FIG. 17A. 18A is an example of the input melody history according to the present embodiment, FIG. 18B is an example of an N list corresponding to the input melody of FIG. 18A, and FIG. It is a figure which shows the example of D list corresponding to the input melody of 18 (A). FIG. 19 is a diagram showing an example of the comprehensive list according to the present embodiment. FIG. 20 is a diagram illustrating an example of the diatonic register according to the present embodiment. FIG. 21 is a diagram illustrating an example of the diatonic scale table according to the present embodiment. FIG. 22 is a diagram illustrating an example of a provisional code determination map according to the present embodiment. FIG. 23 is a diagram illustrating an example of a code database according to the present embodiment. FIG. 24 is a diagram illustrating an example of a code determination table according to the present embodiment. FIG. 25 is a flowchart showing an example of automatic accompaniment processing according to the present embodiment. FIG. 26 is a flowchart illustrating an example of code selection processing according to the second embodiment of the present invention.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. FIG. 1 is a diagram illustrating an external appearance of an electronic musical instrument to which the electronic musical instrument according to the present embodiment is applied. As shown in FIG. 1, an electronic musical instrument 10 according to the present embodiment has a keyboard 11 as a performance operator. In addition, on the upper part of the keyboard 11, switches (see reference numerals 12 and 13) for designating a tone color, starting and ending automatic accompaniment, designating a rhythm pattern, etc., and various information relating to the music to be played, for example, It has a display unit 15 for displaying timbre, rhythm pattern, chord name, and the like. The electronic musical instrument 10 according to the present embodiment has, for example, 61 keys (C2 to C7). In addition, the electronic musical instrument 10 can perform under one of two performance modes: an automatic accompaniment mode for turning on automatic accompaniment and a normal mode for turning off automatic accompaniment.

  FIG. 2 is a block diagram showing the configuration of the electronic musical instrument according to the embodiment of the present invention. As shown in FIG. 2, the electronic musical instrument 10 according to the present embodiment includes a CPU 21, a ROM 22, a RAM 23, a sound system 24, a switch group 25, a keyboard 11, and a display unit 15.

  The CPU 21 follows the control of the electronic musical instrument 10 as a whole, the detection of key depression of the keyboard 11 and the operation of the switches (for example, reference numerals 12 and 13 in FIG. 1), and the operation of the keys and switches. Various processes such as control of the sound system 24, determination of the chord name according to the pitch of the depressed musical tone, and performance of the automatic accompaniment according to the automatic accompaniment pattern and chord name are executed.

  The ROM 22 performs various processes to be executed by the CPU 21, for example, a process executed in response to a switch operation or a key depression of any key on the keyboard, a tone generated in response to the key depression, a tone of the tone to be depressed. Programs such as determination of chord names according to high, automatic accompaniment patterns and performance of automatic accompaniment according to chord names are stored. The ROM 22 is a waveform data area for storing waveform data for generating various musical sounds such as piano, guitar, bass drum, snare drum, and cymbal, and data indicating various automatic accompaniment patterns (automatic accompaniment data). Has an automatic accompaniment pattern area.

  The RAM 23 stores a program read from the ROM 22 and data generated in the course of processing. Further, the RAM 23 stores melody history data generated by the CPU 21 when the key of the keyboard 11 is pressed / released. In the present embodiment, the automatic accompaniment pattern has a melody automatic accompaniment pattern including a melody sound and obligato sound, a chord automatic accompaniment pattern including a constituent sound for each chord name, and a rhythm pattern including a drum sound. For example, the data record of the melody automatic accompaniment pattern includes the tone color, pitch, tone generation timing (pronunciation time), tone length, and the like of the musical tone. The record of the chord automatic accompaniment pattern data includes data indicating chord constituent sounds in addition to the above information. The rhythm pattern data includes the tone color of the musical tone and the sounding timing.

  The sound system 24 includes a sound source unit 26, an audio circuit 27, and a speaker 28. For example, when the sound source unit 26 receives information about the depressed key or information about the automatic accompaniment pattern from the CPU 21, the sound source unit 26 reads predetermined waveform data from the waveform data area of the ROM 22, and generates musical tone data of a predetermined pitch. Generate and output. The sound source unit 26 can also output waveform data, particularly waveform data of percussion instrument sounds such as a snare drum, bass drum, and cymbal, as musical sound data. The audio circuit 27 D / A converts and amplifies the musical sound data. Thereby, an acoustic signal is output from the speaker 28.

  Furthermore, the electronic musical instrument 10 according to the embodiment of the present invention includes a music database 30. As will be described later, the music database 30 is a database used as a dictionary for comparing an input melody history with each music in the database and referring to a chord (chord) of a suitable music. FIG. 12 is a diagram showing an example of an actual data structure of the music database 30.

  FIG. 12 exemplifies the beginning part of some of the songs starting with “C-D-E”, that is, “Dream”, among various music databases. Further, FIG. 13 shows the score of an actual song corresponding to the data of each song illustrated in FIG. Note that the music database that is actually read by the CPU 21 and used for various processes is recognized by the CPU 21 by configuring it with, for example, an XML (Extensible Markup Language) file format and adding tags and headers as necessary. It shall be possible.

  As shown in FIG. 12, in the music database, first, a music number and a music title are recorded for each music (a music number column and a title column in FIG. 12). In addition, as shown in the top line of the “Key / Beat” column of each song, how many times the song is recorded (Key) and how many beats (Beat) are recorded. Yes. For example, “C / 4” is recorded in the song number 1 “Kogatsune”, indicating that this song is recorded in C major -4 time signature. Similarly, “C / 3” is recorded in “Minato” of the music number 6, indicating that this music is recorded in C major-3 time signature.

  Note that FIG. 12 shows an example in which all the music pieces are recorded in C major, but even if they are unified in other than C major, each song has a database in a different key. Of course, there is no problem even if it is configured as described above. If all songs are stored in a database in the same key, the estimated tonality of the melody played by the user can be discriminated when the tonality can be discriminated by the coding algorithm and key judgment algorithm described later. Based on the tone (number of semitones) with the tonality used in the database (c key in FIG. 12), etc., all the songs registered in the song database are uniformly determined to the tonality. If transposition is performed, processing can be performed, and processing can be simplified. On the other hand, it is also possible to register the database in a different key for each song, for example, the key of each original song.

  Further, to the right of the Key / Beat column for each song in FIG. 12 (hereinafter referred to as “Note column”), the ST (Step Time) of the pitch of the melody of each song, the pitch with the previous sound, and the start tone is displayed. ) Ratio and chord (chord) for the melody are recorded.

  Again, exemplifying “Kogatsune” of song number 1, the melody of this song is “Doremifasososo”, so the top line of the Note column of song number 1 in FIG. In this order, data “CDEFFGGG” is recorded.

  Also, the pitch of the start sound / previous sound is recorded in the second row of the Note column of each piece of music in FIG. That is, for the first sound of the melody, the pitch of the start sound (all C in the example of FIG. 12) is recorded as it is, and after the second sound of the melody, the pitch (number of semitones) with the immediately preceding sound is recorded. ing. For example, in the case of song number 1 “Kototsune”, “C” is recorded as it is for the first sound of the melody, and “D”, which is the second sound of the melody that follows, is the previous melody sound (first "C", which is two semitones higher than "C", "2" is recorded. Similarly, for the third melody sound “E”, the pitch (number of semitones) “2” with the second sound “D” is recorded, and for the fourth melody sound “F”. A pitch (number of semitones) “1” with the third sound “E” is recorded.

  As shown in a part after the music number 2, when the melody sound falls from the immediately preceding sound, the pitch with the immediately preceding sound is recorded as a negative value (for example, a song number) 4th sound of “Suzume no Uta” (number 2), 5th sound, 6th sound of “hato” (music number 7)).

  Furthermore, the “ST ratio with the start sound” is recorded in the third row of the Note column of each piece of music in FIG. ST is an abbreviation for Step Time, and is a numerical value representing the length from the sound generation timing of a certain sound to the sound generation timing of the next sound. Therefore, in the “ST ratio with the start sound” of the music database, data representing the ratio between the ST of the melody start sound (first sound) and the ST of each note is recorded.

  Here, in FIG. 12, a note having the same length as the ST of the start sound is recorded so that the “ST ratio with the start sound” is 1. Therefore, for example, in “Kogatsune” of the music number 1, all notes from the second sound to the sixth sound are eighth notes (no rest) having the same length as the start sound. As for “ST ratio with start sound”, 1 is recorded. The seventh note (G of quarter note) of the song number 1 “Kototsune” is twice as long as the start note (eighth note), so the “ST ratio with the start note” is 2. It is recorded. Furthermore, in the song number 8 “Tonbi”, the start sound is a dotted quarter note, whereas the second to sixth notes are eighth notes that are one-third of the length. The “ST ratio with the start sound” is recorded as “0.33” for these notes.

  Further, in the fourth line of the Note column of each piece of music in FIG. 12, there is a chord column and a chord name (chord symbol) is recorded. In this chord column, for example, what is represented as “C” represents a chord of “Domiso” which is a so-called “C” chord. What is represented as “G7” represents a chord of “Soshirefer”, which is a so-called “G7” seventh chord. A chord column with “→” means the same chord as the previous chord, and means that the previous chord is continuously maintained without being changed. The correspondence between the chord name and the actual sound is associated with, for example, a chord name correspondence table (not shown) stored in the ROM or the like.

  This chord field is referred to when a chord to be added to a melody as an accompaniment is determined in chord selection processing described later. The chords that can be attached to a certain melody are not necessarily one way, but differ depending on the arrangement and the individuality / sensitivity of the performer. Here, the automatic accompaniment for automatic chord discrimination (chording) is complemented here. From the viewpoint of performing the chord, it is desirable that a chord table such as “at least if this chord is attached is not a mistake” is prepared.

  The data format of the music database is not necessarily limited to the format described here. For example, the ST ratio with the start sound is obtained from the length of each note of the melody based on the data in the MIDI format. Further, the pitches of the notes before and after the melody sound may be compared to obtain a pitch with the immediately preceding sound by calculation processing. Furthermore, the chord portion may have chord data, or the chord data may be executed in a form in which a chord data or a plurality of notes representing a chord are recorded on a separate track from the melody. .

  The electronic musical instrument 10 according to the present embodiment generates a musical tone based on the key depression of the keyboard 11 under the normal mode. On the other hand, the electronic musical instrument 10 enters an automatic accompaniment mode by operating an automatic accompaniment switch which is one of the various switches 12 and 13 shown in FIG. Under the automatic accompaniment mode, a musical tone having the pitch of the key is generated by pressing the key. In addition, a chord name is determined based on the information of the depressed key, and a musical tone is generated according to an automatic accompaniment pattern including chord constituent sounds of the chord name. Note that the automatic accompaniment pattern includes an automatic melody accompaniment pattern that accompanies a change in pitch such as piano, guitar, and bass, an automatic chord accompaniment pattern, and a rhythm pattern that does not accompany changes in pitch such as a bass drum, snare drum, and cymbal. be able to. Hereinafter, the case where the electronic musical instrument 10 operates in the automatic accompaniment mode will be described.

  Hereinafter, the process performed in the electronic musical instrument 10 according to the present embodiment will be described in detail. FIG. 3 is a flowchart showing an example of a main flow executed in the electronic musical instrument according to the present embodiment. Although not shown, timer increment processing for incrementing the counter value of the interrupt counter is also executed at predetermined time intervals during execution of the main flow.

  As shown in FIG. 3, when the electronic musical instrument 10 is powered on, the CPU 21 of the electronic musical instrument 10 executes an initial process (initialization process) including clearing the data in the RAM 23 and the image on the display unit 15. (Step S301). When the initial process ends, the CPU 21 detects each operation of the switches constituting the switch group 25, and executes a switch process that executes a process according to the detected operation (step S302).

  For example, in the switch process (step S302), various switch operations such as a tone color designation switch, an automatic accompaniment pattern type designation switch, and an automatic accompaniment pattern on / off designation switch are detected. When the automatic accompaniment pattern is turned on, the CPU 21 switches the performance mode to the automatic accompaniment mode. Data indicating the performance mode is specified in a predetermined area of the RAM 23. Similarly, data indicating the type of timbre and automatic accompaniment pattern is also stored in a predetermined area of the RAM 23.

  Next, the CPU 21 executes keyboard processing (step S303). FIG. 4 is a flowchart showing in more detail an example of keyboard processing according to the present embodiment. In the keyboard process, first, the CPU 21 scans the keys on the keyboard 11 (step S401). An event (key on or off), which is a key scanning result, is temporarily stored in the RAM 23 together with information on the time at which the event occurred. The CPU 21 refers to the key scanning result stored in the RAM 23 to determine whether there is an event for a certain key (step S402). If it is determined Yes in step S402, the CPU 11 determines whether the event is key-on (step S403).

  If YES in step S403, that is, if it is determined that the event is key-on, the CPU 21 executes a sound generation process for the key that has been key-on (step S404). In the sound generation process, the CPU 21 reads out the tone color data for the melody key that has been specified by the tone color specification switch and stored in the RAM 23 and the data indicating the pitch of the key, and temporarily stores them in the RAM 23. . Data indicating these timbres and pitches is given to the sound source unit 26 in a sound source sound generation process (step S306 in FIG. 3) described later. The sound source unit 26 stores the data in the ROM 22 according to the data indicating the timbres and pitches. The waveform data is read and musical tone data having a predetermined pitch is generated. Thereby, a predetermined musical sound is generated from the speaker 28.

  Thereafter, the CPU 21 stores the pitch information (for example, key number) and the key pressing timing (for example, key pressing time) for the key that has been turned on in the RAM 23 (step S405). The key pressing timing can be calculated based on the counter value of the interrupt counter.

  If it is determined No in step S403, the event is key-off. Therefore, the CPU 21 executes a mute process for the key that has been turned off (step S406). In the silencing process, the CPU 21 generates data indicating the pitch of the musical sound to be muted and temporarily stores it in the RAM 23. Also in this case, in the sound source sound generation process (step S306) described later, data indicating the tone color and pitch of the musical sound to be muted is given to the sound source unit 26. The sound source unit 26 mutes a predetermined musical sound based on the given data. Thereafter, the CPU 21 stores the time (key pressing time) during which the key was turned off in the RAM 23 (step S407). Further, when storing the melody history, the ratio of the length of the melody sound input first (ST: Step Time) and the length of the melody sound input this time (ST ratio with the start sound) is calculated. And added to the melody history information and stored.

  The CPU 21 determines whether the processing has been completed for all key events (step S408). If it is determined No in step S408, the process returns to step S402. When the process is completed for all the key events (step S408: Yes), the keyboard process in FIG. 4 is terminated.

  When the keyboard process (step 303 in FIG. 3) is completed, the CPU 21 executes a song candidate search process (step S304). FIG. 5 is a flowchart showing in more detail an example of song candidate search processing according to the present embodiment.

  In the song candidate search process, first, the CPU 21 determines whether or not a melody has been input by the key press / key release process detected by the keyboard process described above with reference to FIG. 4 (step S501). If there is no melody input (step S501: No), the music candidate search process in FIG. 5 is terminated.

  If there is a melody input (step S501: Yes), the input melody is recorded in the predetermined melody history storage area of the RAM 23 as a melody history in addition to the already recorded melody history (step S502). ). An example of the data structure of the melody history recorded in the RAM 23 is shown in FIG.

  In the example of FIG. 14, in accordance with the data structure of the above-described music database (FIG. 12), the input pitch, the pitch of the immediately preceding sound (starting sound), and the ST of the starting sound are input with respect to the melody input. Calculate and store the ratio. The specific significance and calculation method of each data are the same as those described in FIG. Of course, as described in the description of FIG. 12, for example, the data structure shown in FIG.

  When recording the melody history in step S502, for example, a very short input sound length can be excluded from the recorded sound of the melody history in order to remove a slight mistouch or the like. For example, for the input melody, for a sound whose key pressing time (duration) is equal to or less than a predetermined threshold, the melody history is not recorded, and the song candidate search is performed without performing the processing in step S503 and the subsequent steps. Processing such as returning from processing may be performed.

  When the recording of the melody history in step S502 ends, the CPU 21 determines whether or not the input melody sound is the first melody sound (step S503). If the input melody sound is the first melody sound (step S503: Yes), F list-up processing is performed (step S504). The details of the F list-up process are shown in FIG. 6, and will be described with reference to FIG.

  The F list listed in FIG. 6 is a list obtained by searching the music database (FIG. 12) for the melody sound that matches the first sound among the input melody sounds.

  Since only the first sound is compared with the music, it is not always possible to narrow down to a single music, and considering the case where the user is transposing and playing, it is not always possible to narrow down accurately. For example, if it is assumed that the user often plays the original music key when playing the melody, the music database recorded with the original music key is searched by the first sound of the input melody sound, so that a certain amount of music Can be narrowed down.

  In FIG. 6, the CPU 21 first acquires the start sound, that is, the information of the first sound of the input melody in the variable FN (step S601). Next, the CPU 21 searches for a music that matches the melody start sound FN and the sound registered as the start sound of the music database (the melody start sound of each music) (step S602).

  Then, the CPU 21 lists each music searched in step S602 as an F list (step S603). At this time, if there are a plurality of corresponding music pieces, all of them may be listed, or a predetermined number of randomly selected music pieces may be listed. If there is no corresponding music, a flag indicating that there is no corresponding music may be returned.

  An example of the F list created in this way is shown in FIG. Here, an example of an F list obtained by searching the music database shown in FIGS. 12 and 13 when the first melody input sound “C” shown in FIG. 14 is input is shown. In this case, since the first sound “C” of the melody input matches all the music pieces of the music numbers 1 to 9 in the music database, all the music pieces of the music numbers 1 to 9 are listed in the F list.

  Note that the ranks assigned to the songs indicate, as an example, a case where the music database is searched and the songs determined to be applicable are sequentially stored in the list. Here, a case is shown in which the music database is stored in the list in order from 1 and the ranking is given as it is. However, in addition to this, it is also possible to record the plurality of music pieces as the same rank (first place).

  When the F list is created by the process shown in FIG. 6 through step S504 in FIG. 5, the CPU 21 returns the process to the flowchart in FIG. 5, and sets the F list as a comprehensive list in step S511 ( Step S511), the song candidate search process is terminated.

  On the other hand, returning to step S503, if the input melody sound is not the first sound (step S503: No), it is determined whether or not the Key (tonality) for the input melody has been confirmed. (Step S505).

  Whether or not the key (tonality) has been determined can be determined by determining whether or not the key is determined as a “confirmation key” in the key (tonality) determination process in step S305 of FIG. 3 described later. Is possible. Details of the key (tonality) discrimination process will be described later.

  If it is determined in step S505 that Key (tonality) has been confirmed (step S505: Yes), the CPU 21 proceeds to step S506 to list the K list. The details of this K list-up process are shown in FIG. 7, and will be described with reference to FIG.

  The K list listed in FIG. 7 refers to each song recorded in the above-described song database (FIG. 12) based on the determination result that the key (tonality) of the input melody is confirmed. The key is shifted to the key (tonality) determined to be fixed, and then compared with the input melody history for listing.

  By performing such processing, even when the user is transposing and playing a melody in an arbitrary key, the music can be quickly played regardless of the key (tonality) of each music registered in the music database. You can search for and specify the correct code.

  In FIG. 7, the CPU 21 first acquires key information of the input melody determined to be confirmed in the variable Key (step S701). Next, the CPU 21 compares the music with the input melody based on the key (tonality) of each music registered in the music database (FIG. 12) and the final key of the melody acquired in the variable Key. (Step S702).

  This process will be described more specifically. For example, consider a case where the definite tone of the input melody acquired in the variable Key is F (F major). If the comparison is made with “Early Sleeping” of the song number 4, the registered key of this song is “C”, that is, in C major, so a semitone between the key “F” and the key “C”. Calculate the number. Since this can be calculated as “semitone number = 5” based on the well-known music theory, each tone of the melody registered with the song number 4 “Early Sleeping” (the top row of the Note column of the song number 4 in FIG. 12) is recorded. , Perform semitone +5 operation and transpose to F key. In the case of the above example, the original melody “CDECCE” becomes “FGAFFGA” by transposition of semitone +5.

  Then, each sound of the melody sound in the transposed music database is compared with each sound of the input melody history. As a result of the comparison, music that satisfies a predetermined condition is picked up as a search result in step S702.

  Here, various conditions can be considered for the pickup. For example, it is possible to pick up music in the music database in which all pitches from the first sound to the latest sound match the inputted melody history. Alternatively, a predetermined number of music pieces can be picked up in order from music pieces having a large number of consecutively matched sounds from the past sound to the current sound in the input melody history. Furthermore, a method of comparing sounds from the first sound to the current sound and picking up a predetermined number of music pieces in descending order of the number of matching sounds (probability) may be considered.

  Subsequently, the CPU 21 determines whether or not there is a song that has been picked up as a result of the search in step S702 (step S703). If there is no song that has been picked up, the list-up process of this K list is terminated (step S703: No).

  On the other hand, if there is a picked-up song (step S703: Yes), the ST ratio of each input melody history sound to the melody start sound (first sound) is calculated and picked up. Each song is compared with the data of “ST ratio with start sound” recorded on the song database, and the “correct answer rate” is calculated (step S704).

  Various methods are possible for the “calculation of correct answer rate” in step S704.

  For example, the ST ratio between each sound of the input melody history and the melody start sound is obtained, and the "" of each input melody and the ST ratio registered in the music database are determined based on the difference between the ST ratio of each sound. A method of determining the “accuracy rate” and adding (averaging) these may be considered. That is, for example, for the second sound “D” of the music number 4 “Early Sleeping”, the ST ratio = “1” is recorded on the music database as the length equal to the start sound, but contrary to this. In the melody actually played, if the length of the second sound is 90% or 110% of the melody start sound, the correct answer rate for the second sound is For example, “90 points”.

  As described above, in step S704, the “accuracy rate of each song”, which is an index corresponding to how close (similar) each song is to the input melody history, can be calculated. Then, with reference to the “accuracy rate of each piece of music”, a predetermined number of songs are listed as a K list in descending order of accuracy rate (step S705), and the K list-up process ends.

  An example of the K list created in this way is shown in FIG.

  Here, FIG. 16B shows an example of a K list obtained by searching the music database shown in FIGS. 12 and 13 when a melody as shown in FIG. 16A is input. .

  As shown in FIG. 16A, four sounds of “FGAB ♭” are inputted in order for the melody input. Also, it is assumed that F (F major) is obtained as a confirmation key based on this input melody. Here, assuming that the melody input shown in FIG. 16A is a melody input by a player playing the keyboard 11, human performance may include fluctuations and inaccuracies to some extent. As an example in consideration of this point, in the example of FIG. 16A, the second tone “G” is depressed slightly short, and the ST ratio with the start tone is 0.9, which is slightly smaller than 1. It shows the case. The third sound “A” indicates a case where the key is pushed a little longer and the ST ratio with the start sound is 1.1, which is slightly larger than 1.

  When the K list-up process of FIG. 7 is performed on such an input melody, first, the key (key) determined in the variable Key in step S701, that is, “F” is recorded, and then in step S702, the figure is displayed. For each song in the twelve song databases, the pitch connection is compared after transposing to “F” which is the confirmation key. That is, among the songs in each music database, those that are transposed in F major and have a pitch of “FGAB ♭”, that is, in C major, the pitch connection of “CDEF” is made from the first sound to the fourth sound. The music you have is searched. Therefore, in this case, the song number 1 “Kototsune” and the song number 3 “Kaeru no Uta” are extracted as the corresponding songs in which the pitches are connected.

  Since there is a corresponding song, step S703 is Yes, and the process proceeds to step S704, where the correct rate of the ST ratio: P is calculated for each corresponding song. Here, using the values of ST value: STdb (i) of the i-th note of the corresponding song in the music database and ST value: STin (i) of the i-th note of the input melody, The obtained example is shown.

  As shown in the equation (1), here, for the ST value of each sound, the ratio is obtained by dividing the absolute value of the difference between the value on the database and the input value by the ST value of the sound on the reference database. As a value, this is set as a 100-percentage value. Among the sounds input so far, values from the second sound to the latest sound are averaged, and a value obtained by subtracting from 100 is used as the “correct answer rate”.

  That is, when the input melody in FIG. 16A is compared with “Kogitsune” of the music number 1, the difference value of the ST value for the second sound is 0.1, so that the sound in the database By dividing by the ST value (= 1), it becomes 0.1 and becomes 100 by dividing into 100. Similarly, the third tone is 10 and the fourth tone is 0, and when these are added, 20 points are obtained.

  Therefore, these average values are (10 + 10 + 0) ÷ 3 = about 6.7 points, and this is subtracted from 100 points to obtain the correct answer rate = 93.3 points.

  In equation (1), the loop starts from i = 2, and the ST value ratio of the first note is not taken into account in the calculation. The ST ratio is determined based on the first note. Therefore, the ST ratio of the first sound is always 100% and is excluded.

  In this way, when the correct answer rate of each music piece whose pitch connection is the same is obtained, in step S705, the K list is listed in descending order. In the example of FIG. 16, since there is no difference in the score of the correct answer rate between “Kototsune” of the music number 1 and “Kaeru no Uta” of the music number 3, an example in which ranking is given for convenience is shown. With respect to the ranking of the tunes having the same score, the ranking can be determined by the same method as described in the F list.

  When the K list is created through the process shown in FIG. 7 through step S506 in FIG. 5, the CPU 21 returns the process to the flowchart in FIG. 5, and sets the K list as a comprehensive list in step S510 ( Step S510), the music candidate search process is terminated.

  On the other hand, if it is determined in step S505 that the key (tonality) is not fixed (step S505: No), the CPU 21 proceeds to step S507 to list the N list. The details of this N list-up process are shown in FIG. 8, and will be described with reference to FIG.

  The N list listed in FIG. 8 is a comparison between the pitch of the input melody history and the melody pitch data (note column top row data) of each song recorded in the above-described song database (FIG. 12). Go and list.

  In FIG. 8, the CPU 21 first acquires input pitch data as pitch-linked data from the input melody history data (FIG. 14) (step S801). Considering an example of input as shown in FIG. 14, assuming that the input of up to the third sound of the melody is assumed, in this step S801, data “CDE” is acquired as the pitch connection of the input melody. The

  Subsequently, the CPU 21 compares the acquired pitch connection data of the input melody with the melody pitch data (Note column top row data) of each song in the song database (FIG. 12), and the pitches match. The music is searched (step S802).

  For example, when the input melody is “CDE” as described above and the music database in the example of FIG. 12 is searched, all the 9 songs from song number 1 to song number 9 shown in FIG. In this case, in step S802, all nine songs in FIG. 12 are picked up as search results. Here, in addition to picking up the music whose pitches all match from the first sound to the latest sound, similar to the music pick-up method in step S702, search by various methods is possible. is there.

  Subsequently, the CPU 21 determines whether or not there is a tune that has been picked up as a result of the search in step S802 (step S803). If there is no song that has been picked up, the list-up process for the N list is terminated (step S803: No).

  On the other hand, if there is a tune that has been picked up (step S803: Yes), the ST ratio of the input melody history sound to the melody start sound (first sound) is calculated and picked up. Each song is compared with the data of “ST ratio with start sound” recorded on the song database, and the “correct answer rate” is calculated (step S804). The specific method for calculating the accuracy rate is the same as that described in step S704.

  Then, referring to the “accuracy rate of each song” calculated in step S804, a predetermined number of songs are listed in order from the one with the highest accuracy rate (step S805), and this N list processing is performed. Exit.

  An example of the N list created in this way is shown in FIG.

  Here, FIG. 17B shows an example of an N list obtained by searching the music database shown in FIGS. 12 and 13 when a melody as shown in FIG. 17A is input. .

  As shown in FIG. 17A, three sounds of “CDE” are input in order for melody input. In the example of melody input shown in FIG. 17A, it is assumed that all CDEs have the same length (ST value) and the ST ratio with the first sound is 1.

  When the N list-up process of FIG. 8 is performed on such an input melody, “CDE”, which is a pitch connection, is first extracted from the melody history data of FIG. 17A in step S801. Next, in step S802, the pitch connection is compared for each song in the song database of FIG. Here, in the list of the N list in this figure, unlike the list of the K list, since no key is determined, comparison is performed using the pitches of the music database as they are. Therefore, in this case, since all the songs from the song number 1 to the song number 9 have the pitch “CDE” from the start to the third sound, all nine songs are extracted as candidates in step S802.

  Since there is a corresponding song, the result of step S803 is Yes, and the process proceeds to step S804, where the correct rate of the ST ratio: P is calculated for each corresponding song. The calculation of the correct answer rate is performed using the equation (1) as in step S704 in the case of the K list.

  As an example, the case where the correct answer rate is obtained by comparing with “Tonbi” of the music number 8 will be described. In this case, for the second sound “D”, the difference value of the ST value is 0.67. Therefore, when dividing by the ST value (= 0.33) of the sound in the database, it becomes approximately 2. (For convenience, 0.33 = 1/3 and 0.67 = 2/3 are shown). Therefore, this value is converted into 100 fractions and becomes 200. Similarly, for the third sound “E”, the ratio of the difference values is calculated as 200.

  Therefore, these average values are (200 + 200) / 2 = 200 points, and this is subtracted from 100 points to obtain the correct answer rate = −100 points (in the figure, − is represented by ▲).

  In this way, when the correct answer rate of each song is obtained, in step S805, the N list is listed in descending order. An example of the N list created in this way is shown in FIG. The correct answer rate is the same for some songs, and for this ranking, as in the F list and K list, an example is shown in which the song numbers are ranked in ascending order. There is no problem even if ranking is done by the method.

  When the N list is created through the process shown in FIG. 8 through step S507 in FIG. 5, the CPU 21 returns the process to the flowchart in FIG. 5 and proceeds to step S508. List up. The details of the D listing process are shown in FIG. 9, and will be described with reference to FIG.

  The D list listed in FIG. 9 uses data of the pitch relationship of the input melody history and the pitch relationship of the melody of each song recorded in the above-described song database (FIG. 12) (Note column 2nd line). Comparison.

  In the N list of FIG. 8, the input melody and the pitch of the music database are compared, whereas in the D list of FIG. 9, the comparison is made using the pitch relation. As a result, even if the input melody is played in a different key from the melody registered in the music database, the comparison is performed using the relative pitch relationship registered in the music database. Thus, the music can be compared regardless of the tone of the input melody.

  In FIG. 9, first, the CPU 21 obtains the “pitch of the start sound / previous sound” data obtained by comparing the pitches of two adjacent sounds from the input melody history data (FIG. 14). Obtained as interval data (step S901).

  For example, if the input melody is now “FGA”, the pitch relationship is “2”, which is the pitch of the first sound “F” and the second sound “G”, and the second sound “G”. “2”, which is the pitch relationship of the third sound “A”, is acquired.

  Subsequently, the CPU 21 compares the acquired pitch interval data of the input melody with the “pitch of the start / previous tone” data (Note column second line data) of each song in the song database (FIG. 12). Then, the music having the same pitch interval is searched (step S902).

  Again, in the example in which “FGA” is input, the pitch relationship of the input melody is “2, 2” in order from the beginning, whereas it is registered in the music database in the example of FIG. Since all of the songs have a pitch relationship of “2, 2” in order from the beginning, all nine songs in FIG. 12 are picked up as search results in step S902.

  In this case, in view of the point that the above-mentioned D list is “a melody can be searched even when a melody is transposed in a different key from the music database”, the absolute of each start sound of the input melody and the music The pitches are not compared. In the example where “FGA” is input as described above, the pitch “F” of the start tone of the input melody is different from the pitch “C” of the start tone of each music piece. First, make sure that even different songs are picked up.

  Thus, when the above-mentioned “FGA” and melody are input, the N list search process in FIG. 8 is not picked up because the pitches are completely different from the pitches of each music, but the D list in FIG. In this search process, a musical piece starting from “CDE” is picked up even if the pitches themselves are different.

  Subsequently, the CPU 21 determines whether or not there is a tune that has been picked up as a result of the search in step S902 (step S903). If there is no song that has been picked up, the D list listing process is terminated (step S903: No).

  On the other hand, if there is a picked-up song (step S903: Yes), the ST ratio of each input melody history sound to the melody start sound (first sound) is calculated and picked up. Each song is compared with the data of “ST ratio with start sound” recorded on the song database to calculate the “correct answer rate” (step S904). The specific method for calculating the accuracy rate is the same as that described in step S704.

  Then, with reference to the “accuracy rate of each song” calculated in step S904, a predetermined number of songs are listed in order from the one with the highest accuracy rate as a D list (step S905). Exit.

  An example of the D list created in this way is shown in FIG.

  Here, when a melody as shown in FIG. 18A is input, an example of an N list obtained by searching the music database shown in FIGS. 12 and 13 is shown in FIG. An example of this is shown in FIG.

  As shown in FIG. 18A, three sounds of “FGA” are inputted in order for the melody input. In the example of melody input shown in FIG. 18A, it is assumed that all FGAs have the same length (ST value) and the ST ratio with the first sound is 1.

  As already described, when the pitch connection of each song in the song database in FIG. 12 is compared with the melody input in FIG. 18A, there is no song that begins with “FGA”. As shown in FIG. 12, in the N list, none of the songs 1 to 9 in FIG. 12 are listed. If another song is registered in the song database and there is a song beginning with “FGA”, it is picked up in the N list of FIG. 18B.

  When the D list-up process in FIG. 9 is performed on such an input melody, first, in step S901, the first sound (starting sound), which is pitch interval data from the melody history data in FIG. The pitch “2” of the second sound and the pitch “2” of the second to third sounds are extracted. Next, in step S902, the pitch interval is compared for each song in the song database of FIG. 12 with respect to the extracted pitch interval.

  Here, unlike the list of the N list, the list of the D list in this figure compares the pitch intervals rather than the pitch connection. Therefore, even if the input melody is played in a different key from the melody registered in the music database, the comparison can be performed using the relative pitch relationship registered in the music database. it can. As a result, there is a possibility that songs that are not listed in the N list in FIG. 18B are listed as the D list.

  Also for the input of FIG. 18A, the pitch interval of all nine songs from song number 1 to song number 9 in the song database of FIG. 12 is the pitch of the first sound (start sound) to the second sound. Since “2” and the pitch of the second to third sounds are “2”, in step S902, all these nine songs are extracted as candidates.

  Since there is a corresponding song, step S903 becomes Yes, and the process proceeds to step S904, where the correct rate P of the ST ratio is calculated for each corresponding song. The calculation of the correct answer rate is performed using equation (1) as in step S704 in the case of the K list and step S804 in the case of the N list.

  When the correct answer rate of each song is obtained in this way, the D list is listed in descending order of the score in step S905. An example of the D list created in this way is shown in FIG. The correct answer rate is the same for some songs, and this ranking is shown as an example of ranking in ascending order of song numbers, like the F list, K list, and N list. The ranking may be done by other methods.

  When the D list is created through the process shown in FIG. 9 through step S508 in FIG. 5, the CPU 21 returns the process to the flowchart in FIG. 5 and proceeds to step S509. A comprehensive list is created using the N list and D list created in S508 (step S509). The details of this comprehensive list creation process are shown in FIG. 10, and will be described with reference to FIG.

  In FIG. 10, the CPU 21 first integrates the N list and the D list and arranges them in order by a predetermined method to form a comprehensive list (step S1001).

  Here, as a method of integrating and arranging in order, for example, depending on the list type according to the accuracy rate of the ST ratio of each song of each list of N list and D list calculated in step S804 and step S904. There is a method of arranging songs in order from the one with the highest accuracy rate of the ST ratio.

  In addition, for example, when the pitch connection or pitch interval is compared in step S802 and step S902, the number of pitches whose pitch connection or pitch interval is the same between the input melody history and the music in the music database. A method of arranging music pieces from both the N list and the D list is possible, with the one having a large number as the top.

  Furthermore, a method of integrating the N list and the D list by comprehensively evaluating the comparison result of pitch connection or pitch interval and the accuracy rate of the ST ratio is possible. In this case, one of the evaluations, for example, a method in which the number of pitches with the same pitch connection or pitch interval is ranked high, and those with the same pitch number are ranked at the correct rate of the ST ratio, A method of preferentially ranking the correct rate of the ST ratio in the method, a method of adding a predetermined weight, adding the evaluation points of both items, and arranging the music in the order of the high evaluation point of the weighted addition, etc. Is possible.

  When a comprehensive list is created from the N list and the D list by such a method, the CPU 21 searches the overlapping list for duplicate music (step S1002). This is equivalent to searching for duplicate music that is listed in both the N and D lists.

  If there is a duplicate song in step S1002, if such a duplicate song exists in the general list, it is inconvenient for the subsequent processing, so the CPU 21 deletes this duplicate song from the general list (step S1002). S1003) so that there are no duplicate songs in the general list. Note that the overlapping songs are not limited to one song, and even if a plurality of songs are duplicated, they are all deleted.

  FIG. 19 shows an example of a comprehensive list created using the N list and the D list by the processing shown in FIG. In the general list of FIG. 19, the music pieces are arranged in the order of the correct answer rate, and the overlapping music pieces are deleted.

  As described above, in the song candidate search process shown in FIG. 5, a comprehensive list of song candidates corresponding to the status of the key (tonality) determination process described later is created based on the input melody.

  When the song candidate search process in FIG. 5 is completed through step S304 in FIG. 3, the CPU 21 returns to the flowchart in FIG. 3 and performs a key (tonality) determination process (step S305). The key (tonality) determination process is executed, for example, by having a diatonic register 2000 as shown in FIG.

  In the present embodiment, the CPU 21 stores values in a series of items in the diatonic register 2000 each time a melody sound is pressed. In the example of FIG. 20, a series of values are stored for each of the five melody sounds in time series (reference numerals 2001 to 2005). In FIG. 20, it is a value about a key depression new in time in the direction of arrow t. That is, as in the melody sound item, the keys are pressed in the order of “C”, “D”, “E”, “F”, “B”.

  In the present embodiment, the CPU 21 stores the values of items described below in the unit registers 2001 to 2005 of the diatonic register 2000 for a plurality of melody sounds. Each of the unit registers 2001 to 2005 has items such as a melody sound, a sound length, a temporary key, a temporary code, a temporary function, a melody sound history, a key candidate register, and a confirmation key, and the unit register includes a value for each item. Can be stored. In the melody sound, the note name of the pressed key is stored. The sound length stores the key pressing time of the key. In addition, about this sound length, it is good also as recording ST value in alignment with a music database.

  Finally, when the key (tonality) is confirmed, the CPU 21 stores the key name in the item of the confirmation key of the unit register (for example, stored in the unit register 2005). However, in order for the CPU 21 to determine that the key has been confirmed, a plurality of key depressions are required. Therefore, in the present embodiment, the temporary key is specified by the processing of the CPU 21 and the key name is stored in the temporary key item of the unit register until it is determined that the key can be determined. Further, under the temporary key, a temporary code name appropriate for the melody sound is stored in the temporary code item by the CPU 21. Also, in the provisional function item, the CPU 21 uses the provisional chord function (the chord name when the main sound is I, the tonic (T), the dominant (D), the subdominant (S ) Type) is stored.

  In the melody sound history, the note names of the pressed keys are accumulated at the start of performance or from a predetermined timing. For example, in the unit register 2001 for the first key press, only C that is the key pressed is stored, and in the unit register 2002 for the next key press, two keys CD are stored. The key candidate stores one or more key names that can be stored when the key is pressed.

  Narrowing down key (tonality) candidates from melody history data is executed by the CPU 21 referring to the diatonic scale table 2100 in FIG.

  The diatonic scale table 2100 stores key scale notes (sounds corresponding to scales) for each of the 12 keys C to B in an identifiable manner. For example, if the key is C, the pitch names of C, D, E, F, G, A, and B are stored (see reference numeral 2101), and if the key is G, G, A, B, C, D, E, The pitch name of F # is stored (see reference numeral 2102).

  Then, the CPU 21 compares the melody sound history of FIG. 20 with the diatonic scale table 2100, and whether there is a key whose pitch names included in the melody sound history are all included in the diatonic scale of a certain key. Is examined. Such a key may not exist or a plurality of keys may exist. For example, C, D, and E are stored in the melody sound history of the unit register 2003. Therefore, referring to the diatonic scale table 2100, there are three keys C, G, and F that include all of C, D, and E as diatonic scales. Therefore, in this case, the three keys C, D, and E can be key candidates. (Key candidate field of unit register 2003)

  And when this key (tonity) candidate becomes one, CPU21 makes the candidate key (tonity) the decision key (tonity). On the other hand, when there are two or more key candidates, the CPU 21 stores, for example, the candidate key with the least key signature as a temporary key and the value of the temporary key of the unit register. When the number of key signatures is the same (for example, F and G, D and B ♭), the # key is preferentially used as a temporary key.

  As described above, when the key (tonality) determination process is performed in step S305 of FIG. 3, the CPU 21 performs the automatic code determination process (step S306).

  The automatic chord determination process is a process of automatically determining a chord (chord) to be added to the current melody based on the melody sound input up to the present time, and can be realized by various methods.

  For example, based on the current melody sound, it is possible to determine a chord using a temporary chord determination map 2200 as shown in FIG. This technique can be used, for example, when a sufficient melody history is not yet obtained, for example, for the first note or about several notes after the start.

  In particular, when the key is unconfirmed, the code can be determined using the code database of FIG. As shown in FIG. 23, the chord database 2300 stores chord constituent sounds and scale notes related to the chord for each chord name. In FIG. 23, for example, a pitch name indicated by hatching is a chord constituent sound.

  For example, the CPU 21 selects a predetermined number of sounds in order from the longest in the melody history having a predetermined length. As the melody history having a predetermined length, for example, a melody history corresponding to a predetermined measure or a melody history having a predetermined number of sounds can be determined.

  The CPU 21 compares a predetermined number of sounds selected from those having a long sound length with the chord database 2300, and determines whether there is a chord having a chord constituting sound including the predetermined number of sounds. If a chord is found, the chord is determined as a code for automatic chord determination processing, and if not found, the chord can be determined by a method such as reducing the number of selected sounds and collating with the chord database again.

  It is also possible to determine a chord using a chord determination table as shown in FIG. 24 according to the function of the previous chord and the progress of the next melody.

  Here, the chord function means “tonic (TO)”, “subdominant (SU)”, “dominant (DO)” in music theory, and the classification by the previous chord function is shown at the left end of FIG. Has been.

  In the chord determination table shown in FIG. 24, depending on the function of the previous chord (tonic (TO), subdominant (SU) or dominant (DO)) and the combination of the previous melody sound PM and the current melody sound CM. The code name is acquired. Note that the code determination table 2400 in FIG. 24 is for the key (C). Therefore, in the case of other keys, the previous melody when the key is set to C, taking into account the offset from the actual previous melody sound PM and the current melody sound CM, with the pitch between the main sound of the key and C as an offset. The sound PM and the current melody sound CM may be calculated and used. Although not shown in the example of FIG. 24, the chord name may not be obtained depending on the combination of the previous melody sound PM and the current melody sound CM.

  Furthermore, it is also possible to execute the key (tonality) determination process in step S305 and the automatic code determination process in step S306 by using other known methods. For example, methods such as JP 2011-158855 A and JP 2012-68548 A can be used.

  In this way, when the automatic code determination process is performed in step S306 of FIG. 3, the CPU 21 executes the code selection process (step S307). Details of this code selection processing are shown in FIG. 11, and will be described with reference to FIG.

  The chord selection process executed in FIG. 11 is the chord progression of the songs listed in the song candidate search process executed in FIG. 5 and subsequent steps through step S304 and the automatic chord determination process executed in step S306. This is a process for determining which of the determined chords is used to perform automatic accompaniment.

  In FIG. 11, the CPU 21 first determines whether or not there is a song whose pitch / pitch connection matches a predetermined number, for example, 10 or more sounds, in the general list (step S1101). With regard to the number of sounds, the “Music Theme Encyclopedia” (Motonotosha) allows you to search for songs from a sequence of up to 6 sounds, but if you search for 6 sounds, songs with the same sound are rare. In some cases, about 10 songs are searched. From this, for example, if it is checked whether or not sounds of about 6 to 10 sounds are correct, it is possible to search for music with a certain degree of accuracy. If the melody input has not yet reached a predetermined number of sounds (for example, 10 sounds), this process may be skipped.

  If there is no predetermined number of pitch / pitch concatenations in the general list (step S1101: NO), the CPU 21 proceeds to step S1104 to output a code according to the real-time coding result and output this code. The selection process is terminated (step S1104). In the first place, if no song corresponding to each list of F list, K list, N list / D list is searched and no song is picked up in the general list, NO is determined in this step S1101, and step In 1104, a code according to the real-time coding result is output.

  On the other hand, if there is a predetermined number of pitch / pitch connections in the general list (step S1101: YES), the CPU 21 determines whether there is a song whose pronunciation timing matches 80% or more. Is determined (step S1102). Specifically, it is determined whether or not there are songs with a “correct answer rate” of 80 or more among the songs listed in the general list. As described above, the accuracy rate is an evaluation value related to the pronunciation timing obtained by comparing the value of the “ST ratio with the start sound” between the music database and the input melody history. By selecting a song with a predetermined value or more, it can be determined that the player is playing almost the same song as the database, and it is considered that chord progression is selected from the song database and can be used as an automatic accompaniment chord. It should be noted that the reference value of “80 points” can be changed as appropriate and implemented using different reference values. Further, for example, it is possible to accept a designation related to “skill level” with a button or the like (not shown) and change the reference value of the judgment according to this skill level.

  If there is no song whose pronunciation timing matches 80% or more (step S1102: NO), the CPU 21 advances the process to step S1104, outputs the code according to the real-time coding result, and ends the chord selection process. (Step S1104).

  On the other hand, if there is a song whose sounding timing matches 80% or more (step S1102: YES), the CPU 21 selects the song selected in step S1101 and step S1102, specifically, pitch / pitch connection. Is referred to a music database (FIG. 12) of songs that match a predetermined number of times and whose sound generation timing matches a predetermined rate or more (hereinafter referred to as “corresponding music”). Then, the chord of the portion estimated to be the current melody in the data of the corresponding song is read from the song database, and it is determined whether or not it matches the coding result of the automatic chord judgment process (real time coding) in step S306. (Step S1103).

  When the coding result of the automatic chord determination process (real time coding) matches the code read from the music database of the corresponding song (step S1103: YES), the CPU 21 advances the process to step S1104 to execute the real time code. The code according to the attachment result is output, and the code selection process is terminated (step S1104).

  On the other hand, if the coding result of the automatic chord determination process (real-time coding) and the code read from the music database of the corresponding song do not match (step S1103: NO), the CPU 21 proceeds to step S1105, The chord read from the music database of the corresponding music is output, and the chord selection process is terminated (step S1105).

  When the chord selection process shown in FIG. 11 is executed through step S307 in FIG. 3, the CPU 21 returns to the flowchart in FIG. 3 and executes the automatic accompaniment process in step S308 (step S308). S308). The details of this automatic accompaniment process are shown in FIG. 25 and will be described with reference to FIG.

  FIG. 25 is a flowchart showing an example of automatic accompaniment processing according to the present embodiment. First, the CPU 21 determines whether or not the electronic musical instrument 10 is operating under the automatic accompaniment mode (step 2501). If YES is determined in step 2501, it is determined whether the current time has reached the event execution timing for the melody sound data in the automatic accompaniment data with reference to a timer (not shown) of the CPU 21. (Step 2502).

  The automatic accompaniment data includes data of three types of musical sounds, that is, melody sounds (including obligato sounds), chord sounds, and rhythm sounds. The data of the melody sound and the data of the chord sound include the pitch, the sounding timing and the sounding time for each musical sound to be sounded. The rhythm sound data includes the sound generation timing for each musical sound (rhythm sound) to be generated.

  If it is determined Yes in step 2502, the CPU 21 executes a melody pronunciation / mute process (step 2503). In the melody pronunciation / mute process, it is determined whether the event related to the process is a note-on event. A note-on event can be determined by the fact that the current time substantially coincides with the tone generation timing of a predetermined musical sound in the melody sound data. On the other hand, a note-off event can be determined by the fact that the current time substantially coincides with the time obtained by adding the sound generation time to the sound generation timing.

  If the event related to the process is a note-off event, the CPU 21 executes a mute process. On the other hand, if the event related to the process is a note-on event, the sound generation process according to the melody sound data is executed.

  Next, the CPU 21 refers to a timer (not shown) of the CPU 21 to determine whether the current time has reached the event execution timing for the chord data in the automatic accompaniment data (step 2504). If it is determined Yes in step 2504, the CPU 21 executes chord sound generation / mute processing (step 2505). In the chord sound generation / mute process, the sound generation process is executed for the chord sound that has reached the sound generation timing, while the mute process is executed for the chord sound that has reached the mute timing.

  Thereafter, the CPU 21 determines whether or not the current time has reached the event execution timing for the rhythm data in the automatic accompaniment data (step 2506). If it is determined Yes in step 2506, the CPU 21 executes a rhythm sound generation process (step 2507). In the rhythm sound sound generation process, a note-on event is generated for the rhythm sound that has reached the sound generation timing.

  When the automatic accompaniment process (step S308 in FIG. 3) ends, the CPU 21 executes a sound source sound generation process (step S309). In the sound source sound generation process, the CPU 21 gives data indicating the tone color and pitch of the tone to be generated to the tone generator unit 26 based on the generated note-on event, or indicates the tone color and pitch of the tone to be muted. Data is supplied to the sound source unit 26. The sound source unit 26 reads the waveform data in the ROM 22 in accordance with data indicating tone color, pitch, tone length, etc., and generates predetermined musical tone data. Thereby, a predetermined musical sound is generated from the speaker 28. Further, the CPU 21 instructs the sound source 26 to mute the pitch indicated by the note-off event based on the note-off event.

  When the sound source sound generation process (step S309) is completed, the CPU 21 executes other processes (for example, image display on the display unit 15, lighting of LEDs (not shown), turning off, etc .: step S310), and step 302. Return to.

  As described above, in the present embodiment, an electronic musical instrument that automatically adds an accompaniment to a melody played by a performer, and includes a music database, and the player's performance melody and each song in the music database. Is compared. When a song that is determined to be matched under a predetermined condition is found, the chord registered in the song database is read and accompaniment is performed to the performer's performance melody.

  In this way, if a player's performance melody matches a song registered in the song database, regardless of automatic chord identification when accompaniment is automatically added in real time, Since the code suitable for the song can be read and output, the accuracy of automatic coding can be improved.

  Further, in the present embodiment, when the key (tonality) discrimination has not yet been determined in the collation process with the music database, the N list for comparing the pitches and the D list for comparing the pitch intervals It is possible to perform comparison and collation even when a melody is played in a key different from that registered in the music database. Therefore, even when the performer plays the melody in a key different from that of the database, the music database can be used effectively to perform coding.

  Furthermore, in the present embodiment, the ST ratio between the melody start sound and each melody sound is registered in the music database, the ST ratio between the start sound and each sound for the played melody is acquired, and the music The correct answer rate is calculated by comparing with the registered value in the database. Then, the music in the music database is preferentially searched from the one with a high accuracy rate. Therefore, even if the performance is performed slightly out of sync, it is possible to construct a flexible system that is searched for as a candidate song as long as the song features generally match.

  In parallel with the music database search, automatic chord discrimination processing is also performed, and if the corresponding song is not found by searching the music database, coding is performed based on the automatic chord discrimination result. ing. Therefore, by coding with the dual structure of automatic chord discrimination and music database search method, the music registered in the database is quickly coded accurately using the database, and the corresponding music is stored in the database. When there is no code or when it cannot be discriminated, a chord can be added by an automatic chord discriminating process, and it becomes possible to perform chording and automatic accompaniment with high accuracy without being unable to code.

  Next, a second embodiment of the present invention will be described. In the second embodiment, the CPU 21 executes a code selection process shown in FIG. 26 instead of the code selection process shown in FIG.

  In the code selection process of FIG. 26, the same step number as in FIG. 11 is assigned to the part that performs the same process as in FIG. 11, and the description thereof is omitted. In the code selection process of FIG. 26, step S2603 is executed instead of step 1103 of FIG.

  In step S2603, the CPU 21 is currently playing the chord added to the performance melody in the automatic chord determination process in step S306 and the songs in the song database determined to satisfy the conditions in S1101 and S1102. Compare the chord function with the chord attached to the melody part.

  Specifically, as a function of chords attached to the music database, information on the function of the chord is additionally recorded for each melody sound in the music database shown in FIG. Alternatively, in the music database of FIG. 12, the key (tonality) of each song is known, so the function is determined by comparing and comparing this tone with the code for each melody sound. It is also good.

  The function of the chord attached to the currently played melody portion may be the function recorded in the temporary function portion described in the key (tonality) determination portion in step S305. The chord function (temporary function) of the melody being played is compared and collated with the information of the temporary key or the confirmation key described in step S305 and the information of the chord (chord) attached to the current melody. Thus, the function can be determined.

Specifically, it is possible to obtain a chord function by preparing a table using a well-known music theory for various chords and chord functions and referring to this table. For example, “I _Maj ”, “I _M7 ”, “III _min ”, “III _m7 ”, “VI _min ”, “VI _m7 ” are code names corresponding to tonics. Code names corresponding to the subdominant include “II _min ”, “II _m7 ”, “II _m7 ⁽⁻⁵⁾ ”, “IV _Maj ”, “IV _M7 ”, “IV _min ”, and [IV _mM7 ]. As code names corresponding to the dominant, there are “III _Maj ”, “III ₇ ”, “III _{7 sus 4} ”, “V _Maj ”, “V ₇ ”, “V _{7 sus 4} ”, “VII _m7 ⁽⁻⁵⁾ ”. .

  In this way, in step S2603, the CPU 21 selects the chord added to the performance melody in the automatic chord determination process in step S306, and the songs in the music database determined to satisfy the conditions in S1101 and S1102. Compare the chord function with the chords attached to the melody part currently being played.

  If the code functions are common (step S2603: YES), the code of the real-time coding result is output (step S1104). On the other hand, if the chord functions are different (step S2603: NO), the chord read from the music database of the corresponding song is output (step S1105).

  In this way, in the second embodiment, when the “code function” of the code read from the music database matches the code of the result of real-time coding, the code having the same function is matched. As a variety in our company, we respect the result of real-time coding and output the code of the result of real-time coding. On the other hand, if the code function is different, the code of the result of real-time coding In order to avoid the risk of adding a misplaced chord, the music database code can be read and output. Therefore, by combining both the music database and real-time coding, the possibility of outputting a large misplaced code is reduced. It is possible to output code that respects

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

  In addition, the methods described in the above-described embodiments are, for example, magnetic disks (floppy disk, hard disk, etc.), optical disks (CD-ROM, DVD, etc.), recording media such as semiconductor memory, etc. as programs that can be executed by a computer. Can be applied to various devices, or transmitted by a communication medium and applied to various devices. A computer that implements this apparatus reads the program recorded on the recording medium, and executes the above-described processing by controlling the operation by this program.

In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.
Further, in the present specification, the term “system” means an overall device configured by a plurality of devices, a plurality of means, and the like.

  For example, a part of the processing described in FIG. 3 of the above embodiment may be changed in order of processing. For example, the order of the song candidate search process in S304, the key (tonality) determination process, and the automatic code determination process in S305 and S306 can be reversed. By doing so, the latest determination result can be used in determining whether or not “Key is determined?” In step S505.

  According to the present invention described above, since automatic coding and coding using a music database can be appropriately used based on the melody sound history, coding can be performed appropriately. Can be quickly coded.

  That is, according to the present invention, if a corresponding music is not found among the music registered in the music database means, a code is attached by automatic coding. Therefore, even when the corresponding music is not found in the music database, chords are not added, and a situation in which no automatic accompaniment is added to the performer's performance can be avoided.

  On the other hand, according to the present invention, when a corresponding music is searched among the music registered in the music database means, an automatic accompaniment is added using the code registered in the music database means. be able to. Therefore, it is possible to prevent a situation in which a chord is automatically discriminated by automatic coding and a chord that is clearly audibly strange to humans or has an incorrect chord is attached.

  Further, according to the present invention, when the corresponding music is searched among the music registered in the music database means, the code of the code by automatic coding and the code registered in the music database The function to be used is compared and the code to be used is selected. Therefore, there is a conspicuous error that the coding by automatic coding is different from the code registered in the music database in terms of the function of the code, and a large loss code is added. Can be prevented.

  Furthermore, if the chord registered in the music database has the same function as the chord, the automatic chording is selected to confirm that the chord function is not a big loss. Since it is possible to select a chord that respects the chording algorithm, the automatic accompaniment using a more appropriate chord can be performed.

Hereinafter, the invention described in the scope of claims of the present application will be appended.
[Appendix 1]
For each of a plurality of music pieces, a music database means in which melody information and a code corresponding to the melody information are stored as music data;
Performance storage means for storing performance information for sequentially instructing the generation of musical sounds corresponding to the operation of the performance operator;
Music search means for searching music data having melody information corresponding to the performance information from the music database means based on performance information stored in the performance storage means;
Chord determination means for determining chords from performance information stored in the performance storage means;
Code selection means for selecting which code to use among the code stored corresponding to the music searched by the music search means and the code determined by the code determination means;
Automatic accompaniment means for instructing the generation of an accompaniment sound based on the chord selected by the chord selection means;
An automatic accompaniment device characterized by comprising:

[Appendix 2]
The chord selection means compares the chord function stored in correspondence with the song data searched by the song searching means and the chord function determined by the chord determination means, and the comparison result of the chord function The automatic accompaniment apparatus according to appendix 1, wherein a chord is selected based on

[Appendix 3]
When the chord selection means matches the function of the chord stored in correspondence with the music data searched by the music searching means and the chord determined by the chord determination means, the chord determination means The automatic accompaniment apparatus according to appendix 2, wherein the determined chord is selected, and if the function of the chord does not match, the chord stored in the music data is selected.

[Appendix 4]
The chord selection means selects the chord determined by the chord determination means when the music search means does not search the music database means for a song having melody information corresponding to the performance information. The automatic accompaniment apparatus according to any one of appendices 1 to 3.

[Appendix 5]
The music search means is based on the ratio of the tone length of the first tone and the tone length of the input musical tone among the tone sounds that are sequentially instructed by the performance operator. 5. The automatic accompaniment apparatus according to any one of supplementary notes 1 to 4, wherein corresponding music is searched by ranking.

[Appendix 6]
The chord determination means comprises key determination means for determining the tonality of performance information of the musical performance operator,
The music search means transposes the music data stored in the music database means based on the key determined by the key determination means, and from the music database means based on the transposed music data and the performance information. The automatic accompaniment apparatus according to any one of appendices 1 to 5, wherein a corresponding music piece is searched.

[Appendix 7]
When the key determination by the key determination means is unconfirmed, the music search means searches for music based on pitch data included in melody information corresponding to music data stored in the music database means, The automatic accompaniment apparatus according to appendix 6, wherein music is searched by combining music search based on relative pitch interval data between high data.

[Appendix 8]
The automatic accompaniment apparatus according to any one of appendices 1 to 7, wherein each piece of music data stored in the music database means is stored in a single key.

[Appendix 9]
The automatic accompaniment apparatus according to any one of appendices 1 to 7, wherein each piece of music data stored in the music database means is recorded in the key of the original music.

[Appendix 10]
For each of a plurality of songs, music database means in which melody information and a code corresponding to the melody information are stored as music data, and performance information for sequentially instructing the generation of musical sounds corresponding to the operation of the performance operator An automatic accompaniment method used in an automatic accompaniment apparatus having a performance storage means for storing,
Based on the performance information stored in the performance storage means, search the music data having melody information corresponding to the performance information from the music database means,
From the performance information stored in the performance storage means, a chord is determined,
Select which code to use from the code stored corresponding to the music searched by the music search means and the code determined by the code determination means,
An automatic accompaniment method for instructing generation of an accompaniment sound based on a chord selected by the chord selection means.

[Appendix 11]
For each of a plurality of songs, music database means in which melody information and a code corresponding to the melody information are stored as music data, and performance information for sequentially instructing the generation of musical sounds corresponding to the operation of the performance operator A computer used as an automatic accompaniment device comprising a performance storage means for storing,
A music search step for searching music data having melody information corresponding to the performance information from the music database means based on the performance information stored in the performance storage means;
A chord determination step for determining chords from the performance information stored in the performance storage means;
A code selection step for selecting which code to use among the code stored corresponding to the searched music and the determined code;
An automatic accompaniment step for instructing the generation of an accompaniment sound based on the selected chord;
Automatic accompaniment program that executes

DESCRIPTION OF SYMBOLS 10 ... Electronic musical instrument, 11 ... Keyboard, 12, 13 ... Switch, 15 ... Display part, 21 ... CPU, 22 ... ROM, 23 ... RAM, 24 ... Sound system, 25 ... Switch group, 26 ... Sound source part, 27 ... Audio Circuit, 28 ... Speaker, 30 ... Music database, 2000 ... Diatonic register, 2001-2005 ... Unit register, 2100 ... Diatonic scale table, 2200 ... Temporary code determination map, 2300 ... Code database

The present invention relates to a chord selection device, an automatic accompaniment device, an automatic accompaniment method, and a chord selection method .

The present invention has been made in view of the above points. A chord selection device, an automatic accompaniment device, an automatic accompaniment method, and chord selection that can quickly perform appropriate and accurate chording based on a history of melody sounds. It aims to provide a method .

In order to achieve the above object, a chord selection method according to one aspect of the present invention is a chord selection method used in a chord selection device that selects a chord corresponding to a melody to be played, the chord corresponding to the melody being played. Is determined using a plurality of different determination methods including a first determination method and a second determination method, and the function of the first code determined by the first determination method and the second determination The function of the second code determined by the method is compared, and either the first code or the second code is selected based on the comparison result .

An automatic accompaniment method according to another aspect of the present invention is an automatic accompaniment method used in an automatic accompaniment device that generates an accompaniment sound corresponding to a melody to be played, and each of a plurality of musical pieces corresponds to a melody. Music data corresponding to the melody to be played is searched from the music database in which the chord is stored as music data, and the chord included in the searched music data is determined as the code corresponding to the melody and played. In response to the generation of a musical sound corresponding to the melody, an accompaniment sound is generated based on the determined chord, and in the search of the music data, the first musical sound among the plurality of musical sounds constituting the melody is searched. The corresponding music data is searched from the music database based on the ratio between the musical sound length and the second musical sound length after the second sound. The features.

An automatic accompaniment method according to another aspect of the present invention is an automatic accompaniment method used in an automatic accompaniment device that generates an accompaniment sound corresponding to a melody to be played, and is operated every time a performance operator is operated. Instructing the generation of a musical sound corresponding to the played operation element, searching for music data from the music database based on the operation history of the performance operator, and playing the accompaniment sound based on the code included in the searched music data Generation of music data from the music database based on the operation history of the performance operator at each timing at a plurality of timings at which generation of musical sounds is instructed repeatedly according to continuous operation of the performance operator. It is characterized by controlling to perform a search.

According to the present invention, when automatic coding is performed based on a history of melody sounds, it is possible to quickly perform appropriate and accurate coding.

Claims (12)

Performance storage means for sequentially storing performance information for instructing the generation of musical sounds corresponding to the operation of the performance operator in the memory for each operation of the performance operator;
Each time the performance information is stored in the memory, melody information and a code corresponding to the melody information are stored as music data for each of a plurality of music based on the performance information stored in the memory. Music search means for searching music data having melody information corresponding to the performance information from the music database means,
Chord determination means for determining chords from performance information stored in the memory;
Code selection means for selecting which code to use among the code stored corresponding to the music searched by the music search means and the code determined by the code determination means;
Automatic accompaniment means for instructing the generation of an accompaniment sound based on the chord selected by the chord selection means;
An automatic accompaniment device characterized by comprising:   The chord selection means compares the chord function stored in correspondence with the song data searched by the song searching means and the chord function determined by the chord determination means, and the comparison result of the chord function 2. The automatic accompaniment apparatus according to claim 1, wherein a chord is selected based on the chord.   When the chord selection means matches the function of the chord stored in correspondence with the music data searched by the music searching means and the chord determined by the chord determination means, the chord determination means 3. The automatic accompaniment apparatus according to claim 2, wherein a chord stored in the music data is selected when the determined chord is selected and the function of the chord does not match.   The chord selection means selects the chord determined by the chord determination means when the music search means does not search the music database means for a song having melody information corresponding to the performance information. An automatic accompaniment apparatus according to any one of claims 1 to 3.   The music search means is based on the ratio of the tone length of the first tone and the tone length of the input musical tone among the tone sounds that are sequentially instructed by the performance operator. 5. The automatic accompaniment apparatus according to any one of claims 1 to 4, wherein the corresponding music is searched by ranking. The chord determination means includes key determination means for determining the tonality of the performance information of the performance operator,
The music search means transposes the music data stored in the music database means based on the key determined by the key determination means, and from the music database means based on the transposed music data and the performance information. 6. The automatic accompaniment apparatus according to claim 1, wherein corresponding music is searched.   When the key determination by the key determination means is unconfirmed, the music search means searches for music based on pitch data included in melody information corresponding to music data stored in the music database means, The automatic accompaniment apparatus according to claim 6, wherein music is searched by combining music search based on relative pitch interval data between high data.   The automatic accompaniment apparatus according to any one of claims 1 to 7, wherein each piece of music data stored in the music database means is stored in a single key.   The automatic accompaniment apparatus according to any one of claims 1 to 7, wherein each piece of music data stored in the music database means is recorded in the key of the original music. An automatic accompaniment method used in an automatic accompaniment device,
Performance information for instructing the generation of musical sound corresponding to the operation of the performance operator is sequentially stored in the memory for each operation of the performance operator,
Each time the performance information is stored in the memory, melody information and a code corresponding to the melody information are stored as music data for each of a plurality of music based on the performance information stored in the memory. Search music data having melody information corresponding to the performance information from the music database means,
From the performance information stored in the memory, the chord is determined,
Select which code to use from the code stored corresponding to the searched music and the determined code,
An automatic accompaniment method for instructing generation of an accompaniment sound based on the selected chord. In a computer used as an automatic accompaniment device,
Storing performance information for instructing the generation of musical sounds corresponding to the operation of the performance operator in the memory sequentially for each operation of the performance operator;
Each time the performance information is stored in the memory, melody information and a code corresponding to the melody information are stored as music data for each of a plurality of music based on the performance information stored in the memory. A music search step for searching music data having melody information corresponding to the performance information from the music database means;
A chord determination step for determining chords from the performance information stored in the memory;
A code selection step for selecting which code to use among the code stored corresponding to the searched music and the determined code;
An automatic accompaniment step for instructing the generation of an accompaniment sound based on the selected chord;
Automatic accompaniment program that executes Performance storage means for sequentially storing performance information for instructing the generation of musical sounds corresponding to the operation of the performance operator in the memory for each operation of the performance operator;
Each time the performance information is stored in the memory, melody information and a code corresponding to the melody information are stored as music data for each of a plurality of music based on the performance information stored in the memory. Music search means for searching music data having melody information corresponding to the performance information from the music database means;
Chord determination means for determining chords from performance information stored in the memory;
Code selection means for selecting which code to use among the code stored corresponding to the music searched by the music search means and the code determined by the code determination means;
A code selection device comprising:

Images