JP2015102741A - Musical performance device and musical performance processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To detect a musical performance signal correctly and prevent deterioration of convenience and amusement felt by a user, even when a user performs mute musical performance.SOLUTION: A karaoke device 10 has a RAM including a musical performance part of an electric guitar 4, and storing karaoke music data to which code information formed of progress of plural codes is corresponded, and the karaoke device 10 reads stored karaoke music data and reproduce it, and according to reproduction of the karaoke music data, inputs a musical performance signal outputted from the electric guitar 4 by playing of the electric guitar 4 by a player of musical instrument, and based on the inputted musical performance signal, detects musical performance by mute musical performance of the player of musical instrument with discrimination from other musical performance methods, and outputs the detection result.

Description

  The present invention relates to a musical tone performance apparatus that performs various processes on performance signals based on a musical instrument performance of a user, and a musical tone performance processing program used therefor.

  A technique for performing various types of processing (for example, scoring and various types of display for performances) for improving the entertainment of the user in response to the detection result when the performance signal of the user playing the musical instrument is detected. Already known. For example, in the prior art described in Patent Document 1, target pitch data (song data) for music prepared in advance and actual pitch data (performance data) corresponding to a performance signal output from a musical instrument by the user's performance are described. ) Is compared. And based on those comparison results, the user's performance is scored.

JP 2012-83540 A

  By the way, in general, stringed instruments (particularly guitars) have various performance methods such as each string being pronounced substantially simultaneously (so-called stroke playing method), and each string being pronounced over time (so-called arpeggio playing method). . In particular, when a relatively fast-tempo (for example, rock-like) music is played by an electric guitar, each string is muted while being muted in order to emphasize the drive feeling (smooth atmosphere) of the music. Playing (so-called mute playing method). In this mute playing method, the sounding time of each string is extremely short, and after the pick hits the string, the vibration of the string is forcibly attenuated by the user's hand, so other normal playing methods (the above-mentioned stroke playing method and arpeggio playing method) Etc.) and a distinctive pronunciation. Therefore, when the mute performance is performed, if the same processing as the normal performance is performed uniformly, the performance signal cannot be accurately detected, and as a result, the various processes cannot be performed. In addition, there is a possibility that convenience and entertainment for the user may be reduced.

  An object of the present invention is to provide a musical tone performance apparatus and musical tone performance processing program capable of accurately detecting a performance signal even when the user performs a mute performance and preventing deterioration of user convenience and entertainment. is there.

  In order to achieve the above object, the first invention includes music data storage means for storing karaoke music data including chord information consisting of a plurality of chord progressions, including a performance part of a predetermined stringed instrument, Music data playback means for reading out and playing back the karaoke music data stored in the music data storage means, and according to the playback of the karaoke music data by the music data playback means, the instrument player performs the string instrument from the string instrument. A performance signal input means for inputting a performance signal to be output, and a mute for detecting the performance of the instrument performer by the mute performance method in distinction from other performance styles based on the performance signal input from the performance signal input means. Rendition style detection means, and mute performance style output means for outputting a detection result by the mute performance style detection means, Characterized in that it.

  In the musical tone performance apparatus according to the first aspect of the present invention, the karaoke music data stored in the music data storage means is read and reproduced by the music data reproducing means. At this time, in the first invention of the present application, the user (musical instrument player) can play the musical instrument along with the reproduction of the karaoke music data. That is, when the user plays a stringed instrument in accordance with the reproduction, the performance signal output from the stringed instrument is input and detected via the performance signal input means, and the user's entertainment is improved according to the detection result. The various processes (for example, scoring and various displays for performance) are executed.

  In the first invention of the present application, in consideration of the performance tendency of the actual user described above, the mute performance method detection means performs the performance by the musical instrument player based on the input performance signal. Separately detected, the mute performance output means outputs the detection result. As a result, the above-described adverse effects can be avoided and the performance signal can be accurately detected even when the user performs the mute performance, so that the various processes described above can be performed correctly, and user convenience and A decrease in entertainment can be prevented.

  The second invention corresponds to the chord in the stringed instrument for each chord included in the corresponding chord information in accordance with the reproduction of the karaoke song data in the song data reproducing means in the first invention. First target data generating means for generating first target pitch data corresponding to the mute playing method, and each code included in the code information corresponding to the reproduction of the karaoke music data by the music data reproducing means For each of the performance signals input from the performance signal input means, second target data generation means for generating second target pitch data corresponding to the other performance methods corresponding to the chord in the stringed instrument. Real data generation means for generating actual pitch data based on the mute performance method detection means, wherein the mute playing style detection means includes the first target pitch data and the second The degree of coincidence determination means capable of determining the degree of coincidence between at least one of the pitch data and the corresponding actual pitch data, and the musical instrument performance according to the degree of coincidence determined by the degree of coincidence determination means Scoring means capable of scoring at least one of the performance by the mute performance method and the performance by the other performance method by the person, and the mute performance output means is means for outputting the scoring result by the scoring means. It is characterized by being.

  In the second invention of this application, when a user plays a stringed instrument in accordance with the reproduction of karaoke music data, the performance is scored. That is, code information is associated with the reproduced karaoke music data. And according to the reproduction | regeneration of the said karaoke music data, the target pitch data of the said stringed instrument are produced | generated for every chord contained in the said chord information. At this time, in view of the performance tendency of the actual user as described above, in the second invention of the present application, the first target data generating means and the second target data generating means are provided. The first target data generating means generates first target pitch data corresponding to the mute performance method. The second target data generating means generates second target data corresponding to a normal performance method other than the mute performance method.

  On the other hand, after the performance signal output from the stringed instrument by the user's performance is input by the performance signal input means, the actual data generation means (for example, the frequency component of the performance signal is extracted and chroma vector processing is performed). ) Corresponding actual pitch data is generated.

  Then, the coincidence determination means determines the coincidence between the generated actual pitch data and the corresponding target pitch data, and the scoring means scores according to the coincidence. At this time, in the second invention of the present application, at least one of the first target pitch data and the second target pitch data is used as the target pitch data. This makes it possible to improve the scoring accuracy in the performance of the stringed instrument as compared with the case where the degree of coincidence is determined and scored without distinguishing between the mute performance method and other performance methods. As a result, convenience and entertainment for the user can be reliably improved.

  According to a third invention, in the second invention, the coincidence degree determining means is based on rendition style information added to the corresponding chord information in accordance with the reproduction of the karaoke music data by the music data reproducing means. One of the first target pitch data and the second target pitch data is selectively switched and used to determine the degree of coincidence with the corresponding actual pitch data.

  Generally, whether the user performs the mute performance or the other normal performance is generally uniquely determined for each music piece or for each performance section in each music piece. In the third invention of the present application, in response to this, performance method information is added in advance to code information associated with karaoke song data (or karaoke song data itself). This rendition style information represents, for example, whether the performer is a section (or music piece) to be played by the mute playing technique, or is a section (or music piece) to be played by other performance techniques. Then, the coincidence determination means determines the coincidence by selectively switching the first target pitch data or the second target pitch data based on the performance information.

  Thus, when the user performs a performance while mixing a song to be played by the mute playing method and a song to be played by another playing method, or a section to be played by the mute playing method in one song played by the user Even if there is a mixture of sections to be played by other playing methods, scoring can be performed with high accuracy. As a result, the convenience and entertainment for the user can be further improved.

  In order to achieve the above object, a musical tone performance processing program according to the fourth invention of the present application stores musical piece data that includes karaoke musical piece data that includes a performance part of a predetermined stringed instrument and that is associated with chord information consisting of a plurality of chord progressions. According to the reproduction of the karaoke music data by the music data reproduction means, the music data reproduction means for reading out and reproducing the karaoke music data stored in the music data storage means, The musical instrument based on the performance signal input from the performance signal input means to the arithmetic means provided in the musical sound performance device, which has a performance signal input means for inputting a performance signal output from the stringed instrument by performance A mute playing method detection procedure for detecting a player's performance using the mute playing method separately from other playing methods, And mute playing output procedure for outputting the result of detection by the serial mute playing detection procedure is executed.

  ADVANTAGE OF THE INVENTION According to this invention, even when a user performs a mute performance method, a performance signal can be detected correctly and the fall of a user's convenience and amusement can be prevented.

It is explanatory drawing which shows the main structures of the karaoke apparatus of one Embodiment of this invention. It is a functional block diagram which shows the main structures of the control system of the control apparatus with which the karaoke apparatus was equipped. It is explanatory drawing which shows an example of the data structure of the reception data from the server containing music data. It is explanatory drawing which shows an example of the display content displayed on a monitor at the time of reproduction | regeneration of music data. It is a functional block diagram showing the detailed function of CPU. It is a figure showing an example of the spectrum image which performed the FFT process of the performance signal when a single sound was played by the normal performance method. It is a figure showing an example of the spectrum image which performed the FFT process of the performance signal when a single sound was performed by the mute performance method. It is a figure showing an example of the spectrum image which performed the FFT process of the performance signal when a power chord is performed by the normal performance method. It is a figure showing an example of the spectrum image which performed the FFT process of the performance signal when playing a power code by the mute performance method. It is explanatory drawing for demonstrating the method of producing | generating target pitch data and comparing with real pitch data. It is explanatory drawing for demonstrating the example of a display of a scoring result. It is a flowchart which shows the processing content performed by CPU at the time of the music reproduction of a karaoke apparatus. It is a flowchart showing the detailed procedure of step S100. It is explanatory drawing for demonstrating the example of a display of the detection result of a mute performance.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the present embodiment, a case will be described in which a user mainly plays an electric guitar by himself along with the performance of karaoke music.

<Main configuration>
FIG. 1 is an explanatory diagram showing a main configuration of a karaoke apparatus which is a musical tone performance apparatus of the present embodiment. As shown in FIG. 1, the karaoke apparatus 10 has a monitor television (hereinafter, abbreviated as a monitor) that displays a lyrics telop indicating lyrics, a background video displayed on the background of the lyrics telop, a video showing a music selection number, etc. on the CRT. 13, a user monitor 14, a musical instrument connection board 8 for connecting an electronic musical instrument such as an electric guitar 4 (corresponding to a predetermined stringed musical instrument) or an electric bass, and a plurality of musical instrument performance parts By selecting a song (karaoke song; hereinafter abbreviated as “song” as appropriate) and selecting a song to be reserved for playback, sending a request signal indicating a request to send the selected song to the server, and by request signal Communication control such as reception of music data (corresponding to karaoke music data) corresponding to the displayed music, and musical tone type designation information included in the received music data And a control unit 20 that performs for designating the same type of instrument sound source and an instrument connected to the instrument connection board 8 of the IDI data, are provided.

  Further, in this example, the karaoke apparatus 10 mixes a musical instrument performance signal inputted from the musical instrument connection board 8, a voice signal inputted from the microphones 17 and 18, and a music reproduction signal (shown in FIG. 2 described later). Mixing circuit 9), volume balance adjustment between sound and music, echo adjustment, delay adjustment, amplification of mixing signal, pitch control (key control) of played music, high / low sound control ( An amplifier 16 that performs tone control), a set of floor type speakers 11 and 11 that reproduce the amplified signal output from the amplifier 16 as sound, a set of speakers 12 and 12 for hanging the ceiling, And a remote controller 30 for remotely operating the control device 20. The remote controller 30 is provided with various operation buttons 30a and 30b.

  Although not shown, the musical instrument connection board 8 is connected to the output terminals (phone plugs) of the electronic drum, keyboard, electric bass, and electric guitar 4 (phone jacks; corresponding to performance signal input means); And output terminals for outputting performance signals inputted to the respective input terminals. The musical instrument connection board 8 automatically detects that each musical instrument is connected and the type of the musical instrument by connecting the output terminal of each musical instrument to the input terminal, and selects one performance signal of the connected musical instrument. The selected performance signal is output to an input terminal 44 (see FIG. 2 described later) of the control device 20. For example, a performance signal output from the electric guitar 4 is input to the musical instrument connection board 8 via a phone jack 4 a (see FIG. 2 described later) for connecting a phone plug of the electric guitar 4, and is output from the output terminal of the musical instrument connection board 8. The output performance signal is input to the input terminal 44 of the control device 20. Note that instead of automatically detecting the connection and the type of the musical instrument as described above, the user may manually perform settings corresponding to the musical instrument already connected on the remote controller 30 or the like. In this case, acoustic guitar sounds such as gut guitars and folk guitars may be collected by a microphone and input to the phone jack 4a instead of an electronic stringed instrument such as the electric guitar 4.

<Control system>
The configuration of the control system of the control device 20 will be described with reference to FIG. FIG. 2 is a functional block diagram showing the main configuration of the control system of the control device 20. The control device 20 includes a communication terminal 40 connected to the LAN line 15, an input terminal 44 connected to the output terminal of the musical instrument connection board 8, and an audio output terminal 41 connected to the audio input terminal of the amplifier 16. And a video output terminal 42 connected to the video input terminal of the monitor 13 and a video output terminal 43 connected to the video input terminal of the monitor 14.

  Further, the control device 20 is provided with a CPU 45 (corresponding to a calculation means) that executes various controls according to a control program. The CPU 45 includes a RAM 46 for temporarily storing data transmitted from the remote controller 30, music selection number data indicating the music selection number of the selected music, music selection number data of the reserved music, and a program executed by the CPU 45 ( A ROM 47 that stores a musical tone performance processing program that executes a flow shown in FIGS. 12, 13, and 11 (to be described later) and a necessary data table is connected.

  Further, the CPU 45 has a video RAM 48 in which character video data for displaying lyrics telop and various message videos on the monitors 13 and 14 and music data and chord score information transmitted from the server 58 (details will be described later). The LAN board 50 for receiving the lyrics data and the video data via the communication terminal 40, and the RAM 49 for temporarily storing the music data and the lyrics data received by the LAN board 50 (in the music data storage means) Equivalent).

  Further, the CPU 45 is connected to a MIDI sound source board 51 that inputs MIDI data included in the song data read from the RAM 49 and outputs a sound source signal from a sound source specified by the input MIDI data. . Further, the CPU 45 inputs the output sound source signal and converts it into a signal that can be amplified by the amplifier 16, and a CD-ROM player 53 that reads background video data indicating a general background video. Is connected.

  The CPU 45 also receives general background video data read from the CD-ROM player 53, song-specific background data read from the RAM 49, lyrics telop data included in the song data, and the like. 13 is connected to a video control circuit 54 that performs video control for creating a video in which the lyrics telop is superimposed on the background video displayed on the display screen 13 and changing the color of the lyrics telop as the music progresses. ing.

  Further, the CPU 45 includes a conversion circuit 55 that converts an optical signal received from the light receiving unit 38 of the control device 20 into a digital signal, and various buttons and keys (tenkey, A display circuit 56 that outputs a display signal to an LED that lights when a music selection button or the like is pressed, and an input circuit 57 that inputs a switching signal generated when the various buttons and keys are pressed are connected.

<Basic operation of karaoke equipment>
In the karaoke apparatus 10 having the basic configuration described above, when the user selects a karaoke piece including, for example, a performance part of the electric guitar 4 by the remote controller 30, and receives the piece of music data transmitted from the server 58 in response to the selection, the piece of music data is obtained. Played. When a user (corresponding to a musical instrument player) plays the electric guitar 4 in accordance with the performance of the music data including the performance part of the electric guitar 4, the performance signal output from the electric guitar 4 is transmitted via the musical instrument connection board 8. Input to the input terminal 44 of the control device 20. Then, in the sound control circuit 52, the sound source signal is output to the sound output terminal 41. In the case of the so-called minus one playback state, the audio control circuit 52 outputs to the audio output terminal 41 in the minus one playback state in which a part of the music part of the electric guitar of the sound source signal is replaced with the performance signal of the electric guitar 4. Is done.

  At this time, in this embodiment, chord score information and performance method information (to be described in detail later) for performance support in advance for music data including the guitar performance part of the electric guitar 4 received from the server 58 together with the lyrics data and video data. The chord score information and the performance information are displayed together with the lyrics data and the video data by the monitors 13 and 14 when the music data is reproduced. Thereby, the user who is a performer uses the chord score information displayed on the monitors 13 and 14 to change the performance part of the electric guitar 4 according to the performance method corresponding to the performance method information according to the karaoke music to be reproduced. You can easily play and practice the electric guitar 4 or enjoy an ensemble of the entire karaoke song.

<Data structure>
FIG. 3 is an explanatory diagram showing a data structure of received data including music data received from the server 58 in the present embodiment. In the example shown in FIG. 3, four bars of karaoke music pieces of data received from the server are shown. The received data includes music data of a plurality of musical instrument performance parts (in this example, a guitar part, a bass part, and a drum part corresponding to the electric guitar 4) corresponding to the progress of the performance for four bars, the chord score information, The rendition style information, lyric data (lyric telop data), and video data are provided.

  The music data is reproduced from the first bar (hereinafter simply referred to as “first bar” or the like) in the data shown in FIG. 3 together with the lyrics data and the video data, and the second bar, the third bar, Playback proceeds to the fourth measure. Corresponding to the reproduction, display based on the lyrics data and the video data also proceeds. When there are a plurality of types of music data, each music data corresponds to a music name (for example, music ID used for music selection described above), MIDI data for music performance, lyrics data, and chord data for performance support. Any data structure may be used. Since the music data structure is well known, only the necessary parts are shown in FIG.

<Cord score information>
The chord score information is associated with music data. In this example, the first bar in the figure is chord C, chord G, chord Am, chord F. The second measure, the third measure, and the fourth measure have the same chord progression (may be chord progressions different from each other).

<Performance information>
The rendition style information is data for specifying the rendition style of the electric guitar 4 and is associated with the music data as with the chord score information. In this example, the first measure in the figure is a mute playing method, the second measure is a normal playing method that is not a mute playing method, the third measure is a mute playing method, and the fourth measure is the normal playing method. Details of the rendition style information will be described later.

In this example, the chord score information and rendition style information are composed of the same file as the music data. However, the present invention is not limited to this, and the chord score information and rendition style information are separate from the music data (hereinafter referred to as the chord score information file). ) And may be associated with the same music title.
For example, the chord score information and the performance information are the same as the music data even if the chord score information and the performance information are separate from the music data (code music information file) by the following configurations and processes (1) to (4). The same effect is obtained as with files.
(1) A chord score / playing style information file is a file of a table in which chord score information / playing style information that appears in accordance with the progress of music data reproduction is associated with the progress time of the music in advance. Specifically, information of (performance time t1: chord Em, t2: chord Bm,... Last performance time tX: last chord score information (or rendition style information) X) is recorded in the table.
(2) The chord score / performance method information file is stored in the RAM 49 together with the music data.
(3) When the reproduction of the music is designated from the input circuit 57, the CPU 45 reads out the corresponding chord score / performance method information file from the RAM 49 together with the music data.
(4) The CPU 45 reproduces the music data in accordance with the execution program stored in the ROM 47, and reads out the chord score information / performance style information from the chord score / performance style information file according to the playback progress time. Specifically, when the music data reproduction progress time reaches t1 (seconds), the chord Em corresponding to t1 is read from the chord score / performance method information file, and when t2 (seconds) arrives, t2 is reached. Read the corresponding code Bm. Similarly, the chord score corresponding to the progress time is continuously read from the chord score / performance method information file until the music data reproduction ends (tX).

  FIG. 4 is an explanatory diagram showing an example of display contents displayed on the monitors 13 and 14 in correspondence with the chord score information and the performance information when the music data is reproduced. In this example, a display example corresponding to the music data for four bars shown in FIG. 3 is shown. In other words, the contents displayed on the monitors 13 and 14 are the above four bars of lyrics “Let's love with your words instead of the body and tears” and the chord score attached to the upper side of the lyrics (first bar: C , G, Am, F, 2nd bar: C, G, Am, F, 3rd bar: C, G, Am, F, 4th bar: C, G, Am, F) Designation of the electric guitar 4 attached to the upper side (1st bar: mute performance, 2nd bar: normal performance, 3rd bar: mute performance, 4th bar: normal performance), 2 bars below the lyrics And a playback progress bar provided. The reproduction progress bar is indicated by a black portion extending in a strip shape to indicate the progress of reproduction of the music data. The user of the electric guitar 4 looks at the chord score displayed on the monitors 13 and 14 and the performance method designation at the time of reproducing the music data, and reads the chords of the electric guitar 4 in the order of the chord progression corresponding to the extension state of the reproduction progress bar. By pressing it, it is possible to easily play the electric guitar part of the karaoke music piece according to the above-mentioned playing method.

  FIG. 4 (a) shows that the reproduction of the music data starting from the beginning of the first bar (code C) proceeds to the middle of the first bar (immediately before the “na” portion of the lyrics “body”). The black portion of the first reproduction progress bar extends partway through the first bar. In FIG. 4 (b), playback further proceeds from the state of FIG. 4 (a), the first measure ends, and the middle part of the second measure (the “de” portion of the lyrics “not tears”). Is being reproduced, and the black portion extends partway through the second bar. In FIG. 4C, the reproduction further proceeds from the state of FIG. 4B, and the part of the chord F at the end of the second measure (the part after “ku” of the lyrics “not tears”) is reproduced. The black portion extends to the end of the second bar.

<Features of this embodiment>
By the way, the method of scoring a user's song in a karaoke apparatus has already been widely performed. Here, when the user plays a stringed instrument (in this example, the electric guitar 4) using the chord score information as described above, if the player scores the performance and displays the score result, the enjoyment for the user is achieved. Can be further increased.

  Therefore, in this embodiment, the chroma vector processing is performed after the frequency component of the performance signal output by the user playing the electric guitar 4 is extracted by a known FFT (Fast Fourier Transform) technique. Actual pitch data (details will be described later) corresponding to the performance is generated for each predetermined time segment. The scoring is performed based on the degree of coincidence between the actual pitch data and the target pitch data (details will be described later) generated based on the chord score information and the performance information. The details will be described below with reference to FIGS.

<Detailed functions of CPU>
FIG. 5 shows a functional configuration of the CPU 45 of the present embodiment in order to perform the above scoring. As illustrated, the CPU 45 includes an FFT processing unit 45a, a feature parameter acquisition unit 45b, an actual data buffer 45c, a target data generation unit 45g, a target data buffer 45e, a matching processing unit 45d, a scoring result generation unit 45f, and the like. It has a functional part.

  The performance signal output by the user's performance of the electric guitar 4 and input to the control device 20 as described above is converted into digital data, and then input to the FFT processing unit 45a and the characteristic parameter acquisition unit 45b. The FFT processing unit 45a divides the performance audio data, which is the input sampling data sequence, into predetermined time segments (for example, 186 msec) and performs fast Fourier transform. The frequency spectrum obtained by the FFT is input from the FFT processing unit 45a to the feature parameter acquisition unit 45b.

  The characteristic parameter acquisition unit 45b receives the performance sound data and also receives a frequency spectrum that is frequency domain information from the FFT processing unit 45a. The characteristic parameter acquisition unit 45b acquires a plurality of characteristic parameters indicating various characteristics of the performance sound data from the performance sound data and its frequency spectrum, and the actual pitch corresponding to the acquired result by a known chroma vectorization technique. Data (data representing each chord sound included in the performance signal) is generated and output. This feature parameter is acquired in the frame for each time segment. Specifically, the feature parameter acquisition unit 45b includes a time domain information acquisition unit 45ba that calculates a time domain feature parameter from the input performance audio data and a frequency domain feature from the frequency spectrum input from the FFT processing unit 45a. A frequency domain information acquisition unit 45bb for determining parameters is provided.

  The time domain information acquisition unit 45ba divides the input performance sound data into frames for each of the time segments synchronized with the FFT processing unit 45a, and acquires time domain feature parameters for each frame. Examples of characteristic parameters acquired by the region information acquisition unit 45ba include energy, energy change, duration, and the like. The frequency domain information acquisition unit 45bb acquires frequency domain feature parameters from the frequency spectrum of the waveform having the length of the time segment input from the FFT processing unit 45a. Examples of characteristic parameters acquired by the frequency domain information acquisition unit 45bb include, for example, pitch, harmonic frequency, harmonic level, harmonic phase, and the like. These pitch parameters (pitch indicating the scale of the guitar), overtone frequency, overtone level, and other parameters are used for the display in FIG.

  The actual pitch data generated and output based on the characteristic parameters acquired by the time domain information acquisition unit 45ba and the frequency domain information acquisition unit 45bb as described above are input to the actual data buffer 45c. The actual data buffer 45c stores the input actual pitch data with time information (time stamp).

  On the other hand, the chord score information and performance information synchronized with the karaoke song data are input to the target data generating unit 45g. The target data generation unit 45g has two types of target pitch data (in this embodiment, target pitch data for mute performance and target pitch data for normal performance) based on the chord score information and performance information. Is generated later. This target pitch data is, for example, data corresponding to a plurality of sounds constituting a chord of each chord included in the chord information (a sound having a pitch 5 degrees higher than the root sound of each chord and the root sound) It may be power code data consisting of The generated target pitch data is output to the target data buffer 45e and stored in the target data buffer 45e.

  The matching processor 45d compares the actual pitch data stored in the actual data buffer 45c as described above with the corresponding target pitch data stored in the target data buffer 45e by a known method. The degree of coincidence is calculated numerically, for example, by calculation. The calculated degree of coincidence is output to the scoring result generation unit 45f. In addition, instead of calculating the degree of coincidence by calculation, a table is prepared in advance, which is divided into a plurality of categories and the value of the degree of coincidence is associated with each category, and the comparison result is assigned to which category of the table. The degree of coincidence may be determined depending on whether it belongs.

  The scoring result generation unit 45f evaluates the performance by the user (in this example, the performance of the electric guitar 4) based on the degree of coincidence input from the matching processing unit 18, and gives a higher evaluation to the performance as the degree of coincidence increases. The scoring result generation unit 45f scores this evaluation as a score, for example, with 100 points being a perfect score, and inputs the scoring result to the monitors 13 and 14. The monitors 13 and 14 display the input scoring results.

<Performance of stringed instruments>
By the way, generally, in stringed instruments (especially the electric guitar 4), each string is pronounced substantially simultaneously (so-called stroke playing method), and each string is pronounced in order with time (so-called arpeggio playing method). There is a playing style. In particular, when a music with a relatively fast tempo (for example, a rock tone) is played by the electric guitar 4, each string is muted while being muted in order to emphasize the drive feeling of the music (good atmosphere). There is a case of playing (so-called mute playing method). In this mute playing method, the sounding time of each string is extremely short, and after the pick hits the string, the vibration of the string is forcibly attenuated by the user's hand, so other normal playing methods (the above-mentioned stroke playing method and arpeggio playing method) Etc.) and a distinctive pronunciation. Therefore, when the mute performance method is performed, the same processing as the normal performance method, for example, calculation or determination of the degree of coincidence using the uniform target pitch data regardless of the performance method (hereinafter, these are summarized as appropriate). If it is simply referred to as “determination”, accurate processing (scoring in this example) becomes difficult.

<Difference in performance signal between mute performance and normal performance>
Differences in performance signals between the mute performance method and the normal performance method will be described with reference to FIGS.

<Normal playing method Single tone performance signal>
For example, as an example of a performance signal in the normal playing method, FIG. 6 shows a spectrum image obtained by performing FFT processing on the performance signal when the “G” sound is played by pressing the 6th string 3 fret of the electric guitar 4. The horizontal axis represents the signal level. The band of “55 Hz to less than 110 Hz”, the band of “110 Hz to less than 220 Hz”, the band of “220 Hz to less than 440 Hz”, the band of “440 Hz to less than 880 Hz”, and “880 Hz to 1. Octave units so that the relationship between harmonic frequency and harmonic level for the input pitch can be found in the band below 76KHz, the band above 1.76KHz and below 3.52KHz, and the band above 3.52KHz. These are shown separately. The vertical axis indicates “A”, “A #”, “B”, “B #”, “C”, “C #”, “D”, “D #”, “E”, “F”, “F #”, “G”, and “G #”. , Each scale (pitch).

  As shown in the figure, the spectrum of the scale of “G” has a relatively large level in three bands of “55 Hz to less than 110 Hz”, “110 Hz to less than 220 Hz”, and “220 Hz to less than 440 Hz”. Has occurred. Even in a band of “440 Hz or more and less than 880 Hz”, the spectrum of the “G” scale occurs at a relatively small level.

  On the other hand, in the band of “220 Hz or more and less than 440 Hz”, the spectrum of the “D” scale is generated at a considerably large level (see the frame line a). This is the manifestation of the harmonic overtone specific to stringed instruments. Similarly, due to the influence of overtones, the spectrum of the scale of “D” occurs at a relatively small level even in a band of “440 Hz or more and less than 880 Hz”.

  As noise other than the above, the spectrum of the scale of “B” and the spectrum of the scale of “F” are generated at a certain level in a band of “440 Hz or more and less than 880 Hz”.

<Mute playing signal>
Similarly to the above, FIG. 7 shows a spectrum image obtained by performing FFT processing on the performance signal when the “G” sound is played with the mute playing method while pressing the 6th string 3rd fret.

  As shown in FIG. 7, this spectral image includes differences from the spectral image shown in FIG. 6 (although it has the same pitch). For example, in the mute performance method shown in FIG. 7, the spectrum of the scale of “G” in two bands of “55 Hz to less than 110 Hz” and “110 Hz to less than 220 Hz” is higher than that in the normal performance method. It has become. Further, the spectrum of the “G” scale in the “220 Hz or more and less than 440 Hz” band is smaller than that in the normal performance, and the spectrum of the “G” scale in the “440 Hz or more and less than 880 Hz” band is almost the same. It is gone.

  On the other hand, in the mute playing method shown in FIG. 7, the level of the spectrum of “D” scale in the band “220 Hz or more and less than 440 Hz” representing the influence of the above harmonics is smaller than that in the normal playing method (see frame a). ) In the band of “440 Hz or more and less than 880 Hz”, the spectrum of the scale of “D” almost disappears. In addition, the spectrum of the scale of “B” and the spectrum of the scale of “F” in the band of “440 Hz or more and less than 880 Hz” as the noise are considerably smaller than those in the normal performance method.

<Normal performance chord performance signal>
For example, as an example of a performance signal in the normal playing method, a spectrum obtained by performing FFT processing on a performance signal when “Cord G” is played with a power chord while pressing the 6th string 3rd fret and the 5th string 5th fret of the electric guitar 4 An image is shown in FIG.

  As shown in the figure, first, in a band of “55 Hz or more and less than 110 Hz”, a band of “110 Hz or more and less than 220 Hz”, and a band of “220 Hz or more and less than 440 Hz” (see frame C), the scale of “G” Of the spectrum occurs at a relatively large level. Even in a band of “440 Hz or more and less than 880 Hz”, the spectrum of the “G” scale occurs at a relatively small level.

  In addition, the spectrum of the scale of “D” is generated at a relatively large level in two bands of “110 Hz to less than 220 Hz” and “220 Hz to less than 440 Hz” (see frame line D). Even in the band of “440 Hz or more and less than 880 Hz”, the spectrum of “D” scale occurs at a relatively small level.

  As noise other than the above, in the band of “440 Hz or more and less than 880 Hz”, the spectrum of the scale of “F #”, the spectrum of the scale of “F”, the spectrum of the scale of “B”, the spectrum of the scale of “A” , Has occurred at a certain level. In the band of “880 Hz or more and less than 1.76 KHz”, the spectrum of the scale of “A” occurs at a certain level.

<Mute playing chord performance signal>
Similarly to the above, FIG. 9 shows a spectrum image obtained by performing FFT processing on the performance signal when the “chord G” is played with the power chord by mute playing while pressing the 6th string 3rd fret and the 5th string 5th fret.

  As shown in FIG. 9, this spectral image includes points different from the spectral image shown in FIG. 8 (although the power code is generated by the same fingering). For example, in the mute playing method shown in FIG. 9, the spectrum of the scale of “G” in the band “110 Hz or more and less than 220 Hz” is considerably larger than that in the normal playing method. On the other hand, the spectrum of the “G” scale in the “55 Hz to less than 110 Hz” band and the “220 Hz to less than 440 Hz” band is at a lower level than that in the above-described normal performance (see frame line o), 440 Hz or more. The spectrum of the scale of “G” in the band “less than 880 Hz” is almost gone.

  Further, in the mute playing method shown in FIG. 9, the spectrum level of the scale “D” in the band “220 Hz or more and less than 440 Hz” is considerably smaller than that in the normal playing method (see the frame line K). The level of the spectrum of the scale of “D” in the “less than” band is also smaller than that in the normal playing method. In the band of “440 Hz or more and less than 880 Hz”, the spectrum of the scale of “D” is almost lost. Further, the spectrum of the scale of “F #”, the spectrum of the scale of “F”, the spectrum of the scale of “B”, and the spectrum of the scale of “A” in the band of “440 Hz or more and less than 880 Hz” as the noise. Is smaller than that in the normal playing method.

<Generation of two types of target pitch data according to the playing style>
Based on the difference in performance signal depending on the performance method as described above, in the present embodiment, as the target pitch data, the spectrum characteristic (for example, the specified pitch data) corresponding to the normal performance method described above with reference to FIGS. Normal pitch target pitch data that takes into account the high harmonic component level in the band and the spectrum characteristics (for example, the level of the harmonic component in a specific band) described above with reference to FIGS. And mute performance target pitch data in consideration of small noise and low noise). That is, as shown in FIG. 5, the target data generating unit 45g of the CPU 45 generates mute performance target data for generating the mute performance target pitch data based on the chord score information input as described above. A generating unit 45g1 and a normal rendition style target data generating unit 45g2 that generates the normal rendition style target pitch data based on the input chord score information are provided. In the present embodiment, the mute performance target pitch data from the mute performance target data generator 45g or the normal performance target data generator 45g2 according to the performance information associated with the music data. The normal performance style target pitch data is selectively switched and input to the target data buffer 45e and stored therein. Therefore, the target pitch data for the mute performance method is incorporated in the target data buffer 45e, which is the target pitch data associated with one piece of music data and the performance method designation is the mute performance method. The target pitch data into which the above-mentioned target pitch data for normal performance is incorporated is stored in the musical piece portion designated as the normal performance. Then, the target pitch data is compared with the actual pitch data (performed by the user using a power code) by the matching processing unit 45d. This method will be described with reference to FIG.

<Comparison using two types of target pitch data>
10, in this example, in the music data shown in FIGS. 3 and 4, the above-described first measure of chord C → chord G → chord Am → chord F and mute playing method designation, chord C → chord G → Code Am-> Code F and 2nd bar with normal performance specification, Code C-> Code G-> Code Am-> Code F-> 3rd bar with mute performance specification, Code C-> Code G-> Code Am-> Code F-Normal performance method specification The music is played by the progression of chords in the order of the fourth measure,..., And the user has played the electric guitar 4 in accordance with the playback.

  As described above, the target pitch data corresponding to the chord progression as described above is the mute performance target pitch data in the mute performance-designated section, and the normal performance target sound in the normal performance-designated section. High data. Then, both the target pitch data for mute performance and the target pitch data for normal performance are, in this example, the root sound of each chord and the root sound (assuming that the user performs with the power chord). On the other hand, the power code data is composed of a sound having a pitch 5 degrees higher.

  In other words, in the first measure, for the chord C, a pitch that is pronounced in a fingering manner of pressing two places of the 4th string 5th fret and the 5th string 3rd fret is designated (that is, FIG. 10). For convenience, the TAB score is used for convenience, but the actual target pitch data is set as specific pitch data expressed by this TAB score (the same applies hereinafter). Similarly, for chord G, the 5th fret of the 5th string and the 3rd fret of the 6th string are designated, and for the chord Am, the 7th fret of the 5th string and the 5th fret of the 6th string are designated. On the other hand, 3rd fret of 5 strings and 1st fret of 6 strings are designated. In this example, as described above, the second bar to the fourth bar have the same chord progression as the first bar, so the same fingering mode is designated.

  Then, in the first bar to the fourth bar, as a result of performing frequency component extraction and chroma vector processing by FFT processing as described above on the basis of the performance signal by the user playing the electric guitar 4, the corresponding real sound is obtained. High data is being generated.

  In this example, when the user plays the electric guitar 4, in the first measure, for the chord C, the sound that is generated in a fingering manner that presses two places of the 6th fret of the 4th string and the 3rd fret of the 5th string High data is generated from the input performance signal (that is, the actual actual pitch data is generated as specific pitch data in the same manner as the target pitch data. In FIG. This is only expressed in TAB notation. After that, for chord G, 5th fret of 5 strings and 3rd fret of 6th string are pressed, for chord Am, 7th fret of 5th string and 5th fret of 6th string are pressed, and for chord F The 5th string 3rd fret and the 6th string 1st fret are held down.

  As a result, in the first bar, the target pitch data (specifically, the target pitch data for mute performance in this example) and the actual pitch data are compared with each other in the first chord C. It can be seen that the 6th fret of the 4th string is pressed in the actual pitch data while only the 5th fret of the 4th string is specified in the pitch data, and this is the only discrepancy data. In this example, the scoring result is “80 points” by scoring according to the degree of coincidence.

  Similarly, in the second measure, by playing the electric guitar 4 by the user, for the chord C, the four-string five-fret and the five-string three-fret are pressed, and for the chord G, the five-string fret. 5th fret and 6th string 3rd fret are pressed, 5th string 7th fret and 6th string 5th fret are pressed against chord Am, 5th string 3rd fret and 6th string are pressed against chord F One fret is held down. As a result, in the second measure, the target pitch data (specifically, the target pitch data for normal performance in this example) is compared with the actual pitch data, so that there is no mismatch data as described above. I understand that. By scoring corresponding to such a degree of coincidence (= 100%), in this example, the scoring result is “100 points”.

  In the third measure, the user plays the electric guitar 4 and the chord C is pressed with the 5th fret of the 4th string and the 3rd fret of the 5th string. The fret and the 6th string 3rd fret are pressed. For the chord Am, the 5th string 6th fret and the 6th string 4th fret are pressed. For the chord F, the 5th string 2nd fret and the 6th string 1st. The fret is held down. As a result, in the third measure, the target pitch data (specifically, the target pitch data for the mute playing method in this example) and the actual pitch data are compared with each other in the third chord Am. In comparison to the specification of the 5th string 7th fret in the pitch data, the 5th string 6th fret is pressed in the actual pitch data, and in the target pitch data the 6th string 4th fret is specified. It can be seen that the data is inconsistent. In addition, in the fourth chord F, it can be seen that the 2nd fret of the 5th string is pressed in the actual pitch data while the 5th string of the 3rd fret is specified in the target pitch data. In this example, a scoring result of “60 points” is obtained by scoring corresponding to the degree of coincidence.

  Further, in the fourth measure, the user plays the electric guitar 4 and the chord C is pressed with the 5th fret of the 4th string and the 3rd fret of the 5th string. Fret and 6th string 3rd fret are pressed, 5th string 7th fret and 6th string 5th fret are pressed against chord Am, 5th string 3rd fret and 6th string 1st for chord F The fret is held down. As a result, in the fourth measure, the target pitch data (specifically, the target pitch data for normal performance in this example) is compared with the actual pitch data, so that there is no mismatch data as described above. I understand that. By scoring according to such a degree of coincidence (= 100%), a scoring result of “100 points” is obtained as in the second measure.

  In the above example, the target data generating unit 45g selectively outputs the target pitch data for normal performance or the target pitch data for mute performance to the target buffer data 45e based on the performance information. . In other words, the target pitch data used for comparison is composed of the target pitch data for the normal performance style in the normal performance style designation section and the target pitch data for the mute performance style designation section in advance. In 45d, the above comparison was performed using the one target pitch data, and the degree of coincidence was calculated. However, it is not limited to this. That is, both the normal performance target pitch data and the mute performance target pitch data may be individually output and stored in, for example, another area of the target buffer data 45e from the target data generation unit 45g. In this case, the matching processing unit 45d performs the above comparison using the two target pitch data, calculates the degree of coincidence for each of them, and calculates the two degrees of coincidence (the target pitch data for normal performance method). It is good also as a final coincidence which becomes a higher value among the coincidence based on mute and target pitch data for mute performance method). In this case, it is sufficient if both the target performance pitch data for normal performance and the target pitch data for mute performance are prepared in advance, and the above performance information is not necessary.

  Also, in the above example, in the performance section using the mute performance (first and third measures in the above example) and the performance section using the normal performance (second and fourth measures in the above example), The degree of coincidence is calculated for the entire chord (power code with two sounds in the above example), and if there is a sound that does not match even in any section, it is subject to deduction, but this is not restrictive. That is, only the performance section by the mute playing method may be excluded from the deduction points due to the mismatch.

  11A to 11C show display examples displayed on the monitors 13 and 14 in accordance with the scoring result by the scoring result generation unit 45f as described above. FIG. 11A shows an example when the scoring result is 100 points (displayed together with the normal performance method), and FIG. 11A shows an example when the scoring result is 100 points (mute performance method). 11 (b), FIG. 11 (b) shows an example when the scoring result is 60 points (displayed together with mute performance), and FIG. 11 (c) shows a scoring result of 0 points. This is an example. In addition to this, in addition to displaying the result of scoring the guitar performance by the user for each time segment in which music data playback is in progress, various display modes such as lyrics and chord scores are also displayed. Are prepared in advance (not shown).

<Control procedure>
In order to realize the method of the present embodiment as described above, processing contents executed by the CPU 45 when the karaoke apparatus 10 plays back music will be described with reference to a flowchart of FIG.

  In FIG. 12, this flow is started when, for example, the user of the karaoke device 10 presses the power button of the control device 20 to turn on the power supply of the control device 20. In conjunction with the rising of the power supply of the control device 20, the power supply of the amplifier 16, the musical instrument connection board 8 and the monitors 13, 14 is started up. As described above, in this example, the case where the user of the karaoke apparatus 10 performs by connecting the electric guitar 4 to the musical instrument connection board 8 will be described. When the user connects the phone plug of the electric guitar 4 to the input terminal (phone jack) 4a of the musical instrument connection board 8, the musical instrument connection board 8 detects that the electric guitar 4 is connected.

  In FIG. 12, first, in step S10, the CPU 45 determines whether or not the music selection by the user has been completed. In the music selection, for example, when the user inputs the music selection number of the music that he / she wants to play the electric guitar 4 with the numeric keypad of the remote controller 30 and presses the music selection button, the music selection ends. Until the music selection is completed, the determination in step S10 is not satisfied (step S10: NO), and a loop standby is performed. When the music selection is completed, the determination in step S10 is satisfied (step S10: YES), and the process proceeds to step S15.

  In step S15, the CPU 45 temporarily stores the music selection number data indicating the music selection number in the RAM 46 corresponding to the music selection result in step S10, and transmits the music data corresponding to the music selection number via the LAN board 50. A request signal to be requested is transmitted to the server 58 via the LAN line 15. As a result, the server 58 retrieves the music data corresponding to the music selection number indicated in the request signal, the chord score information, the performance information, and the lyric data and video data corresponding to the music data from a storage device (not shown). The read music data and the like are transmitted to the control device 20 via the LAN line 15. When step S15 ends, the process proceeds to step S20.

  In step S20, the CPU 45 receives music data (including chord score information and performance information) transmitted from the server 58 via the LAN line 15 via the LAN board 50. Thereafter, the process proceeds to step S25.

In step S25, the CPU 45 temporarily stores the music data received in step S20 in the RAM 49. Thereafter, the process proceeds to step S30.
In addition, as a process of step S15, step S20, and step S25, the music data, chord score information, performance method information, etc. matched with the music selection number are acquired on demand from the server 58 for each music selection. . In addition, a large-capacity auxiliary storage means (not shown) is provided in the control device 20 of the karaoke apparatus 10, and music data and the like are stored in advance in the auxiliary storage means, and each song selection is associated with a song selection number. The information group may be read from the auxiliary storage unit to obtain target information.

  In step S30, the CPU 45 starts reading the MIDI data stored in the RAM 49 in step S25 and writes the read MIDI data to the MIDI tone generator board 51. When step S30 ends, the process proceeds to step S35.

  In step S35, the CPU 45 outputs a control signal to the MIDI sound source board 51 and causes the MIDI sound source board 51 to output a sound source signal corresponding to the MIDI data written in step S30. The sound source signal output from the MIDI sound source board 51 is output to the sound control circuit 52 and converted into a music signal that can be amplified by the amplifier 16, and the converted music signal is transmitted from the sound output terminal 41 to the amplifier 16. Is output. Also, the audio signal input from the microphones 17 and 18 is mixed with the music signal in the mixing circuit 9 built in the amplifier 16. At this time, the performance signal output from the output terminal of the electric guitar 4 is input to the mixing circuit 9 via the musical instrument connection board 8 and the control device 20, and is mixed with the audio signal and the music signal. The mixed signal thus mixed is amplified by an amplifier circuit (not shown) built in the amplifier 16 and then output to the speaker 11 and the speaker 12 and reproduced by both speakers. In addition, the procedure of this step S35 functions as music data reproducing means described in each claim. When step S35 ends, the process proceeds to step S40.

  In step S40, the CPU 45 outputs a control signal to the monitors 13 and 14, and displays the chord score information and the lyrics stored in step S25 on the monitors 13 and 14 (note that the scoring result in step S100 described later also applies to this). Sometimes displayed together). As a result, the user who is a player of the electric guitar 4 plays the electric guitar 4 in accordance with the specified playing style according to the chord score displayed on the monitors 13 and 14, so that the electric guitar 4 is played in accordance with the karaoke piece to be reproduced. The guitar performance part can be played easily. Thereafter, the process proceeds to step S50.

  In step S50, the CPU 45 stores the performance signal input from the input terminal 44 by the performance of the user's electric guitar 4 as performance data, for example, in the RAM 49. Thereafter, the process proceeds to step S55.

  In step S55, the CPU 45 determines whether or not one time segment corresponding to the FFT (Fast Fourier Transform) processing unit has been completed. If the time segment has not ended, the determination is not satisfied (S55: NO), and the process returns to step S30 and the same procedure is repeated. When the time segment ends, the determination is satisfied (S55: YES), and the routine goes to Step S100.

  In step S100, the CPU 45 performs scoring processing using the method described above. Details of the scoring process are shown in FIG.

  In FIG. 13, first, in step S110, the CPU 45 reads out the performance data accumulated in step S50 (corresponding to the one section), and the FFT processing unit 45a uses a known FFT (fast Fourier transform) technique. Each frequency component is extracted and analyzed. Thereafter, the process proceeds to step S120.

  In step S120, the CPU 45 generates the above-described actual pitch data by converting the analysis result in step S110 into a chroma vector by a known method by the feature parameter acquisition unit 45b. The CPU 45 that executes step S120 functions as actual data generating means. Thereafter, the process proceeds to step S130.

  In step S130, the CPU 45 obtains the chord score information and performance method acquired in step S20 and displayed in step S40 by the mute performance target data generation unit 45g1 and the normal performance target data generation unit 45g2 of the target data generation unit 45g. Based on the information, for each chord, as described above, the target pitch data (second pitch) using the target pitch data for mute performance (corresponding to the first target pitch data) or the target pitch data for normal performance is used. Corresponding to target pitch data) is generated and stored in the target data buffer 45e. In addition, CPU45 which performs this step S130 functions as a 1st target data production | generation means and a 2nd target production | generation means. Thereafter, the process proceeds to step S140.

  In step S140, the CPU 45 compares the target pitch data generated in step S130 with the corresponding actual pitch data generated in step S120 by the matching processing unit 45d, and calculates the degree of coincidence. Thereafter, the process proceeds to step S150. The CPU 45 that executes step S140 functions as a degree-of-match determination unit.

  In step S150, the CPU 45 performs scoring corresponding to the performance data by an appropriate method based on the degree of coincidence calculated in step S140, and outputs the scoring result to, for example, the RAM 49 for storage. The scoring results are displayed on the monitors 13 and 14 in step S40 executed after returning to the above-described step S30 (see FIGS. 11A to 11C). When step S150 is completed, this routine is terminated. In addition, CPU45 which performs this step S150 functions as a scoring means.

  In addition, the performance section for which the degree of coincidence is calculated in step S140 is a section in which the mute performance method is to be performed (in other words, the section in which the performance method information is “mute” in the above example), and subsequent step S150. When the scoring result based on the degree of matching becomes a certain value (for example, 60 points) or more (or the value of the degree of matching itself may be a certain value or more), the user can It can also be said that it has been detected that the guitar 4 is played by the mute playing method instead of the normal playing method. Therefore, in that sense, the CPU 45 that executes the steps S140 and S150 corresponds to the mute performance method detection procedure described in each claim and detects the performance by the mute performance method, and also functions as a mute performance method detection means. Further, the CPU 45 that executes step S150 and outputs the scoring result in this case corresponds to the mute performance method output procedure described in each claim and outputs the detection result of the mute performance method, and also functions as a mute performance method output means. Yes.

  In addition, as described above, the degree of coincidence between the target pitch data and the actual pitch data becomes a certain value or more, so that the electric guitar by the user (regardless of scoring or without scoring). In the case of detecting the performance of the 4 mute performance, instead of the display as shown in FIGS. 11 (a) to 11 (c) on the monitors 13 and 14, for example, as shown in FIGS. 14 (a) and 14 (b), Only whether the user's performance at that time is based on the mute performance (see FIG. 14A) or the normal performance (see FIG. 14B) may be displayed. .

  Returning to FIG. 12, when step S150 is completed, the CPU 45 determines whether reproduction of music data has been completed in step S65 (in other words, reading of MIDI data in step S30 has been completed up to the last MIDI data of music data). Determine whether or not. If the reproduction of the music data is finished, the determination is satisfied (step S65: YES), and this flow is finished. Until the reproduction of the music data is completed, the determination is not satisfied (step S65: NO), the process returns to step S30, and the procedure of steps S30 to S65 is repeated.

<Effect of embodiment>
As described above, in the present embodiment, when the user plays the electric guitar 4 in accordance with the reproduction of the music, the chroma vector processing is performed after the frequency component of the performance signal is extracted by the FFT technique. Thus, actual pitch data corresponding to the performance is generated for each predetermined time segment. The performance is scored based on the degree of coincidence between the actual pitch data and the target pitch data generated based on the chord score information associated with the music data.

  In this case, in the present embodiment, in consideration of the tendency when the user actually plays the stringed instrument such as the electric guitar 4 as described above, the mute playing method by the user is detected separately from the other normal playing methods. Specifically, target pitch data including target pitch data for mute performance and target pitch data for normal performance corresponding to the above mute performance is generated, and the match between the target pitch data and the corresponding actual pitch data The degree is calculated. As a result, it is possible to accurately execute a predetermined process (scoring in the above example) for improving the user's entertainment with respect to the performance of a stringed instrument such as the electric guitar 4. In the above scoring example, scoring accuracy can be improved as compared with the case where the degree of coincidence is determined and scoring is performed without distinguishing between the mute performance method and the normal performance method. As a result, convenience and entertainment for the user can be enhanced.

  In general, whether the user performs the mute performance or other normal performance is generally uniquely determined for each piece of music or for each performance section in each piece of music. In the present embodiment, in response to this, rendition style information is added in advance to the chord information (or karaoke song data itself) associated with the karaoke song data (see FIG. 3). Then, in the target data generating unit 45g, based on the above rendition style information, the mute rendition style target data from the mute rendition style target data generating unit 45g1, or the normal rendition style target data for the standard rendition style target data generating unit 45g2 Are selectively output to the target data buffer 45, and the target pitch data which is the synthesized data thereof is stored. Since the matching processing unit 45d determines the degree of coincidence using the target pitch data stored in the target data buffer 45, as a result, based on the rendition style information, the mute performance target data The degree of coincidence is determined by selectively switching the mute performance target data from the generation unit 45g1 or the normal performance method target pitch data from the normal performance target data generation unit 45g2.

  Thereby, in the matching processing unit 45d and the scoring result generation unit 45f, when the user performs a plurality of songs while mixing the songs to be played by the mute playing method and the songs to be played by the normal playing method, Even in a case where a section to be played by the mute playing method and a section to be played by the normal playing method are mixed in one piece of music, scoring can be performed with high accuracy. As a result, the convenience and entertainment for the user can be further improved.

  In addition, in the above, the arrow shown in each figure of FIG. 5 etc. shows an example of the flow of a signal, and does not limit the flow direction of a signal.

  In addition, the flowcharts shown in FIGS. 12 and 13 do not limit the present invention to the procedure shown in the above-described flow, and add / delete procedures or change the order within the scope of the gist and technical idea of the invention. You may do.

  In addition to those already described above, the methods according to the above-described embodiments and modifications may be used in appropriate combination.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

4 Electric guitar (stringed instrument)
10 Karaoke equipment (musical performance equipment)
45 CPU (calculation means)
49 RAM (music data storage means)

Claims (4)

Music data storage means for storing karaoke music data including chord information consisting of a plurality of chord progressions, including a performance part of a predetermined stringed instrument;
Music data reproducing means for reading out and reproducing the karaoke music data stored in the music data storage means;
A performance signal input means for inputting a performance signal output from the stringed instrument by a performance of the stringed instrument by a musical instrument player according to the reproduction of the karaoke music data by the music data reproducing means;
Based on the performance signal input from the performance signal input means, the mute performance method detection means for detecting the performance by the mute performance method of the musical instrument player separately from other performance methods;
Mute performance output means for outputting a detection result by the mute performance detection means;
A musical performance device characterized by comprising: In the musical sound performance device according to claim 1,
A first target pitch corresponding to the mute playing method corresponding to the chord in the stringed instrument for each chord included in the corresponding chord information in accordance with the reproduction of the karaoke song data by the music data reproducing means. First target data generating means for generating data;
A second target corresponding to the other performance method corresponding to the chord in the stringed instrument for each chord included in the corresponding chord information in accordance with the reproduction of the karaoke music data by the music data reproducing means. Second target data generating means for generating pitch data;
Actual data generating means for generating actual pitch data based on the performance signal input from the performance signal input means;
Have
The mute playing style detecting means includes
A degree of coincidence determination means capable of determining a degree of coincidence between at least one of the first target pitch data and the second target pitch data and the corresponding actual pitch data;
In accordance with the degree of coincidence determined by the coincidence degree determining means, scoring means capable of performing scoring on at least one of the performance by the mute performance method and the performance by the other performance method by the instrument player;
Including
The mute performance output means is
A musical tone performance apparatus, characterized in that it is means for outputting a scoring result by the scoring means. In the musical sound performance device according to claim 2,
The coincidence degree determining means includes
One of the first target pitch data and the second target pitch data based on the rendition style information added to the corresponding chord information according to the playback of the karaoke song data by the song data playback means. A musical performance device characterized by determining the degree of coincidence with the corresponding actual pitch data by selectively switching one of them. Music data storage means for storing karaoke music data including chord information consisting of a plurality of chord progressions including a performance part of a predetermined stringed instrument, and reading out the karaoke music data stored in the music data storage means Music data reproducing means for reproducing, and performance signal input means for inputting a performance signal output from the stringed instrument by the performance of the stringed instrument by a musical instrument player according to the reproduction of the karaoke music data by the music data reproducing means; For the arithmetic means provided in the musical sound performance device having
Based on the performance signal input from the performance signal input means, the mute performance method detection procedure for detecting the performance by the mute performance method of the musical instrument player separately from other performance methods;
A mute performance method output procedure for outputting a detection result in the mute performance method detection procedure;
A musical performance processing program for executing

Images