JP6065827B2 - Musical performance device and musical performance processing program - Google Patents

Description

  The present invention relates to a musical tone performance apparatus for scoring a user's musical instrument performance, and a musical tone performance processing program used therefor.

  A technique for inputting a performance signal when a user plays a musical instrument and scoring the performance is already known (for example, see Patent Document 1). In this prior art, an evaluation standard for music prepared in advance is compared with performance sounds output from musical instruments by the user's performance, and scoring is performed based on the comparison results.

JP 2011-69900 A

  By the way, generally, there are a variety of performance methods for playing stringed instruments depending on the genre of music and the preference of the performer. For example, when playing a single note of an electric guitar, a string is pressed on one fret with one finger, the sound is started by picking the other hand, and then the string is moved upward with the one finger touching the fret. There is a case where a playing technique (so-called choking technique) for smoothly shifting the tone pitch to a higher side by bending is performed.

  In the performance by this choking technique, the performer starts sounding at a pitch lower than the desired pitch (hereinafter referred to as the “starting pitch” where appropriate), and then performs the sound over time by the bending operation described above. The pitch is raised so as to reach the pitch that is finally desired to be pronounced (hereinafter referred to as the final pitch as appropriate). The above bending operation from the start of choking to the end of choking is an operation performed against the tension of the string, and the impression when the listener hears is considerably different depending on whether the player's skill is good or bad come. Therefore, if such a choking technique can be judged well and reflected in the above-mentioned scoring, it should be possible to perform an accurate scoring closer to the listener's impression.

  Under the above background, if scoring is performed uniformly in correspondence with only the normal playing method of making a sound by picking the other hand while holding the string on one fret with one finger, the above choking The skill of the performance technique cannot be reflected, and it is difficult to score accurately.

  An object of the present invention is to provide a musical tone performance apparatus and musical tone performance processing program that can improve the scoring accuracy of a stringed instrument played by a user.

  In order to achieve the above object, a musical tone performance apparatus according to a first aspect of the present invention is a music data storage means for storing karaoke music data, comprising a performance part of a predetermined stringed instrument including a choking performance part, and the music data Music data playback means for reading out and playing back the karaoke music data stored in the storage means, and according to the playback of the karaoke music data by the music data playback means, the musical instrument player outputs the string music instrument to play the string music instrument. Generating target pitch data including a choking start point and a choking end point in the choking performance method in response to the reproduction of the karaoke music data by the music data reproduction means. Target data generating means and the performance signal input from the performance signal input means And real data generating means for generating actual pitch data by the choking technique, and the waveform of the actual pitch data by the choking technique in which the pitch is plotted on the vertical axis and time is plotted on the horizontal axis, the choking of the target pitch data Choking scoring means for scoring the performance by the instrument player according to the choking performance depending on whether or not the straight line connecting the starting point and the choking end point is upward. It is characterized by.

  In the musical tone performance device according to the first aspect of the present application, a user (musical instrument player) can play a musical instrument along with the reproduction of karaoke music data. That is, the karaoke music data stored in the music data storage means is read and reproduced by the music data reproducing means.

  At this time, in the first invention of the present application, when the user plays the stringed instrument in accordance with the reproduction, the performance is scored. That is, the target pitch data of the stringed musical instrument is generated by the target data generating means in accordance with the reproduction of the karaoke song data. On the other hand, after the performance signal output from the stringed instrument by the user's performance is input by the performance signal input means, the actual data generation means (for example, the frequency component of the performance signal is extracted and chroma vector processing is performed). ) Corresponding actual pitch data is generated. Then, the scoring is performed based on the generated actual pitch data and the corresponding target pitch data.

  In the first invention of the present application, in view of the performance situation at the time of the actual performance described above, the choking scoring means is good at scoring based on the target pitch data and the corresponding actual pitch data. It is done so that it is reflected whether it is poor. Specifically, in the choking technique performed by an advanced player, the transition of the pitch from the start pitch to the end pitch is not performed linearly in terms of time. That is, a behavior that rises relatively sharply from the starting pitch at a relatively early time immediately after the start of choking and rises, then gradually increases gradually, and reaches the final pitch over time. It becomes. In the choking technique performed by beginners, the pitch is linearly performed from the start pitch to the end pitch as described above, or conversely, the pitch increase rate immediately after the start of choking is After time has passed until it has been relaxed, the choking is approaching and the sound rises sharply, the pitch rises, and the behavior reaches the final pitch.

  Therefore, in the choking scoring means, based on the above behavior difference, the waveform of the actual pitch data when the pitch is plotted on the vertical axis and the time is plotted on the horizontal axis connects the choking start point and the choking end point of the target pitch data. The above determination is made by discriminating whether or not the straight line is rising upward. That is, the straight line that rises to the right corresponds to a waveform (one aspect of poor choking) in the case where the pitch is linearly performed from the start pitch to the end pitch as described above. Further, the state of being convex downward with respect to the straight line rising to the right corresponds to a waveform (another aspect of poor choking) in which the pitch rises sharply near the end of the above choking and the pitch rises. Furthermore, the waveform that protrudes upward from the straight line that rises to the right is a waveform when the rate of increase in pitch gradually decreases after rising relatively sharply from the above-mentioned starting pitch (that is, it corresponds to good choking) Equivalent to In this way, the skill of the choking technique can be reliably reflected in the scoring result by the choking scoring means determining whether the choking is good or bad. As a result, accurate scoring close to the listener's impression can be performed with high accuracy, so that convenience and entertainment for the user can be enhanced.

  According to a second aspect of the present invention, in the first aspect, the choking scoring means is further configured such that the choking end point of the waveform of the actual pitch data by the choking technique is the same pitch as the right-up straight line or the right-up straight line. The scoring is performed according to whether or not the pitch is lower than a pitch threshold of a higher neighboring pitch.

  As an example when a player with low performance ability performs choking, there is a case where the bending operation becomes excessive and becomes higher than the final pitch at the end of choking. In the second invention of the present application, the choking scoring means scores corresponding to such a case. That is, a pitch threshold value is set in advance at a pitch higher than the final pitch at or near the same pitch as the straight line that rises to the right. Then, when the choking performance method is executed, whether or not the choking end point of the waveform of the actual pitch data is within the pitch threshold value is determined by the choking scoring means and added to the scoring result. Thereby, more accurate scoring can be performed with high accuracy.

  In order to achieve the above object, a musical tone performance processing program according to the third aspect of the present invention comprises a musical composition data storage means for storing karaoke musical composition data having a performance part of a predetermined stringed instrument including an execution part of a choking technique, and the musical composition Music data playback means for reading out and playing back the karaoke music data stored in the data storage means, and output from the stringed instrument by the performance of the stringed instrument by a musical instrument player in accordance with the playback of the karaoke music data by the music data playback means A choking performance in the choking performance method in response to the reproduction of the karaoke music data by the music data reproducing means, with respect to the arithmetic means provided in the musical sound performance device having the performance signal input means for inputting the performance signal to be played Target data for generating target pitch data including points and choking end points A real data generation procedure for generating actual pitch data by the choking performance based on the performance signal input from the performance signal input means, and the choking performance method in which the pitch is on the vertical axis and the time is on the horizontal axis Depending on whether the waveform of the actual pitch data according to the above is convex upward or not with respect to a straight line going up to the right connecting the choking start point and the choking end point of the target pitch data, And a choking scoring procedure for scoring the performance according to the choking technique.

  ADVANTAGE OF THE INVENTION According to this invention, the scoring precision with respect to the performance of the stringed instrument by a user can be improved.

It is explanatory drawing which shows the main structures of the karaoke apparatus of one Embodiment of this invention. It is a functional block diagram which shows the main structures of the control system of the control apparatus with which the karaoke apparatus was equipped. It is explanatory drawing which shows an example of the data structure of the reception data from the server containing music data. It is a functional block diagram showing the detailed function of CPU. It is a figure showing an example of the spectrum image which performed the FFT process of the performance signal when performing with the choking performance method. It is a figure showing an example of the spectrum image which performed the FFT process of the performance signal when performing with the choking performance method. It is explanatory drawing for demonstrating the method of comparing target pitch data and real pitch data in order to distinguish the skill of a choking technique. It is explanatory drawing for demonstrating the method of comparing target pitch data and real pitch data in order to distinguish the skill of a choking technique. It is explanatory drawing which expressed the target pitch data containing a choking site | part by the staff score. It is explanatory drawing which expressed the real pitch data including a choking site | part by the staff score. It is explanatory drawing for demonstrating the example of a display of a scoring result. It is a flowchart which shows the processing content performed by CPU at the time of the music reproduction of a karaoke apparatus. It is a flowchart showing the detailed procedure of step S100. It is a flowchart showing the detailed procedure of step S140.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the present embodiment, a case will be described in which a user mainly plays an electric guitar by himself along with the performance of karaoke music.

<Main configuration>
FIG. 1 is an explanatory diagram showing a main configuration of a karaoke apparatus which is a musical tone performance apparatus of the present embodiment. As shown in FIG. 1, the karaoke apparatus 10 has a monitor television (hereinafter, abbreviated as a monitor) that displays a lyrics telop indicating lyrics, a background video displayed on the background of the lyrics telop, a video showing a music selection number, etc. on the CRT. 13, a user monitor 14, a musical instrument connection board 8 for connecting an electronic musical instrument such as an electric guitar 4 (corresponding to a predetermined stringed musical instrument) or an electric bass, and a plurality of musical instrument performance parts By selecting a song (karaoke song; hereinafter abbreviated as “song” as appropriate) and selecting a song to be reserved for playback, sending a request signal indicating a request to send the selected song to the server, and by request signal Communication control such as reception of music data (corresponding to karaoke music data) corresponding to the displayed music, and musical tone type designation information included in the received music data And a control unit 20 that performs for designating the same type of instrument sound source and an instrument connected to the instrument connection board 8 of the IDI data, are provided.

  Further, in this example, the karaoke apparatus 10 mixes a musical instrument performance signal inputted from the musical instrument connection board 8, a voice signal inputted from the microphones 17 and 18, and a music reproduction signal (shown in FIG. 2 described later). Mixing circuit 9), volume balance adjustment between sound and music, echo adjustment, delay adjustment, amplification of mixing signal, pitch control (key control) of played music, high / low sound control ( An amplifier 16 that performs tone control), a set of floor type speakers 11 and 11 that reproduce the amplified signal output from the amplifier 16 as sound, a set of speakers 12 and 12 for hanging the ceiling, And a remote controller 30 for remotely operating the control device 20. The remote controller 30 is provided with various operation buttons 30a and 30b.

  Although not shown, the musical instrument connection board 8 is connected to the output terminals (phone plugs) of the electronic drum, keyboard, electric bass, and electric guitar 4 (phone jacks; corresponding to performance signal input means); And output terminals for outputting performance signals inputted to the respective input terminals. The musical instrument connection board 8 automatically detects that each musical instrument is connected and the type of the musical instrument by connecting the output terminal of each musical instrument to the input terminal, and selects one performance signal of the connected musical instrument. The selected performance signal is output to an input terminal 44 (see FIG. 2 described later) of the control device 20. For example, a performance signal output from the electric guitar 4 is input to the musical instrument connection board 8 via a phone jack 4 a (see FIG. 2 described later) for connecting a phone plug of the electric guitar 4, and is output from the output terminal of the musical instrument connection board 8. The output performance signal is input to the input terminal 44 of the control device 20. Note that instead of automatically detecting the connection and the type of the musical instrument as described above, the user may manually perform settings corresponding to the musical instrument already connected on the remote controller 30 or the like. In this case, acoustic guitar sounds such as gut guitars and folk guitars may be collected by a microphone and input to the phone jack 4a instead of an electronic stringed instrument such as the electric guitar 4.

<Control system>
The configuration of the control system of the control device 20 will be described with reference to FIG. FIG. 2 is a functional block diagram showing the main configuration of the control system of the control device 20. The control device 20 includes a communication terminal 40 connected to the LAN line 15, an input terminal 44 connected to the output terminal of the musical instrument connection board 8, and an audio output terminal 41 connected to the audio input terminal of the amplifier 16. And a video output terminal 42 connected to the video input terminal of the monitor 13 and a video output terminal 43 connected to the video input terminal of the monitor 14.

  Further, the control device 20 is provided with a CPU 45 (corresponding to a calculation means) that executes various controls according to a control program. The CPU 45 includes a RAM 46 for temporarily storing data transmitted from the remote controller 30, music selection number data indicating the music selection number of the selected music, music selection number data of the reserved music, and a program executed by the CPU 45 ( A musical tone performance processing program for executing the flow shown in FIGS. 12, 13, and 14 (to be described later) and a ROM 47 in which necessary data tables are stored are connected.

  In addition, the CPU 45 has a video RAM 48 in which character video data for displaying lyrics telop and various message videos on the monitors 13 and 14, music data transmitted from the server 58, and staff information (details will be described later), A LAN board 50 for receiving lyrics data and video data via the communication terminal 40, and a hard disk (hereinafter referred to as HDD) for temporarily storing music data and lyrics data received by the LAN board 50. An HDD 49 (corresponding to music data storage means) is connected.

  Further, the CPU 45 is connected to a MIDI sound source board 51 that inputs MIDI data included in the song data read from the HDD 49 and outputs a sound source signal from a sound source specified by the input MIDI data. . The CPU 45 is connected to an audio control circuit 52 that inputs the output sound source signal and converts it into a signal that can be amplified by the amplifier 16.

  Further, general background video data read from the HDD 49, song-specific background data read from the HDD 49, lyrics telop data included in the song data, and the like are input to the CPU 45, and the display screen of the monitor 13 is displayed. A video control circuit 54 is connected to perform video control for creating a video in which the lyrics telop is superimposed on the background video displayed on the screen or changing the color of the lyrics telop as the music progresses.

  Further, the CPU 45 includes a conversion circuit 55 that converts an optical signal from the remote controller 30 received by the light receiving unit 38 of the control device 20 into a digital signal, and various buttons and keys 60 (tenkeys) provided on the housing of the control device 20. A display circuit 56 that outputs a display signal to the LED 61 that is lit when the music selection button is pressed, and an input circuit 57 that inputs a switching signal generated when the various buttons and keys are pressed. .

<Basic operation of karaoke equipment>
In the karaoke apparatus 10 having the basic configuration described above, when the user selects a karaoke piece including, for example, a performance part of the electric guitar 4 by the remote controller 30, and receives the piece of music data transmitted from the server 58 in response to the selection, the piece of music data is obtained. Played. When a user (corresponding to a musical instrument player) plays the electric guitar 4 in accordance with the performance of the music data including the performance part of the electric guitar 4, the performance signal output from the electric guitar 4 is transmitted via the musical instrument connection board 8. Input to the input terminal 44 of the control device 20. Then, in the sound control circuit 52, the sound source signal is output to the sound output terminal 41. In the case of the so-called minus one playback state, the audio control circuit 52 outputs to the audio output terminal 41 in the minus one playback state in which a part of the music part of the electric guitar of the sound source signal is replaced with the performance signal of the electric guitar 4. Is done.

  At this time, in the present embodiment, the musical score data including the guitar performance part of the electric guitar 4 received together with the lyrics data and the video data from the server 58 is preliminarily associated with the staff information (details will be described later) for performance support. When reproducing the music data, the staff information is displayed on the monitors 13 and 14 together with the lyrics data and the video data. Thereby, the user who is a performer can easily perform the performance part of the electric guitar 4 by himself / herself in accordance with the karaoke music to be reproduced by utilizing the staff information displayed on the monitors 13 and 14. You can practice guitar 4 and enjoy an ensemble of the entire karaoke song.

<Data structure>
FIG. 3 is an explanatory diagram showing a data structure of received data including music data received from the server 58 in the present embodiment. In the example shown in FIG. 3, four bars of karaoke music pieces of data received from the server are shown. The received data includes music data of a plurality of musical instrument performance parts (in this example, a guitar part, a bass part, and a drum part corresponding to the electric guitar 4) corresponding to the progress of performance for four bars, and chord information ( However, it is not always necessary and may be omitted), the stave information, lyric data (lyric telop data), and video data.

  The music data is reproduced from the first bar (hereinafter simply referred to as “first bar” or the like) in the data shown in FIG. 3 together with the lyrics data and the video data, and the second bar, the third bar, Playback proceeds to the fourth measure. Corresponding to the reproduction, display based on the lyrics data and the video data also proceeds. When there are a plurality of types of music data, for each music data, a music title (for example, a music ID used for the music selection described above), MIDI data for music performance, lyrics data, the above-mentioned musical score information for performance support, etc. What is necessary is just to be the data structure matched. Since the music data structure is well known, only the necessary parts are shown in FIG.

<Code information>
The chord information is associated with the music data. In this example, the first bar in the figure is chord B ♭ maj7, the second bar is chord Am7, the third bar is chord Gm7 and Gm7 / C, and the fourth bar. Is the code Fmaj9.

<Stave information>
The staff notation information represents the contents of the guitar part in a staff notation, and is associated with music data as in the chord information. In addition, the choking part which should perform the choking performance method mentioned later becomes the staff score (refer FIG. 9, FIG. 10 mentioned later) of the content along the choking performance method. Details of the staff information will be described later. If the content is in accordance with the choking technique (that is, if the starting pitch and the final pitch, which will be described later, are specified), other information (for example, TAB score information) may be used instead of the staff information. Good.

In this example, the chord information and the staff information are composed of the same file as the music data. However, the present invention is not limited to this, and the chord information and the staff information are composed of the music data and a separate file and are associated with the same music name. It may be done. For example, by the following configurations and processes (1) to (4), even if the chord information and the staff information are separate files from the music data (hereinafter, chord / stave information information file), the chord information and the staff information are The same effect is obtained as in the case of the same file.
(1) The chord / staves information file is a table file in which chord information / staves information that appears in accordance with the progress of music data reproduction is associated with the progress of music in advance. Specifically, the table records information of (performance time t1: chord Em, t2: chord Bm,... Last performance time tX: last stave information (or chord information) X).
(2) The chord / stave information file is stored in the HDD 49 together with the music data.
(3) When the reproduction of the music is designated from the input circuit 57, the CPU 45 reads out the corresponding chord / stave information file from the HDD 49 together with the music data.
(4) The CPU 45 reproduces the music data according to the execution program of the ROM 47, and reads out the chord information / stave information from the chord / stave information file according to the reproduction progress time. Specifically, when the music data playback progress time reaches t1 (seconds), the code Em corresponding to t1 is read from the chord / stave information file, and when t2 (seconds) is reached, t2 is supported. The code Bm to be read is read. Similarly, the code corresponding to the progress time is continuously read from the chord / stave information file until the music data reproduction ends (tX).

<Features of this embodiment>
By the way, the method of scoring a user's song in a karaoke apparatus has already been widely performed. Here, when the user plays a stringed instrument (in this example, the electric guitar 4) as described above, if the player scores the performance and displays the score, the enjoyment for the user can be further increased. it can.

  Therefore, in this embodiment, the chroma vector processing is performed after the frequency component of the performance signal output by the user playing the electric guitar 4 is extracted by a known FFT (Fast Fourier Transform) technique. Actual pitch data (details will be described later) corresponding to the performance is generated for each predetermined time segment. The scoring is performed based on the degree of coincidence between the actual pitch data and the target pitch data (details will be described later) generated based on the staff information. The details will be described below with reference to FIGS.

<Detailed functions of CPU>
In order to perform the above scoring, the functional configuration of the CPU 45 of this embodiment is shown in FIG. As illustrated, the CPU 45 includes an FFT processing unit 45a, a feature parameter acquisition unit 45b, an actual data buffer 45c, a target data generation unit 45g, a target data buffer 45e, a matching processing unit 45d, a scoring result generation unit 45f, and the like. It has a functional part.

  The performance signal output by the user's performance of the electric guitar 4 and input to the control device 20 as described above is converted into digital data, and then input to the FFT processing unit 45a and the characteristic parameter acquisition unit 45b. The FFT processing unit 45a divides the performance audio data, which is the input sampling data sequence, into predetermined time segments (for example, 186 msec) and performs fast Fourier transform. The frequency spectrum obtained by the FFT is input from the FFT processing unit 45a to the feature parameter acquisition unit 45b.

  The characteristic parameter acquisition unit 45b receives the performance sound data and also receives a frequency spectrum that is frequency domain information from the FFT processing unit 45a. The characteristic parameter acquisition unit 45b acquires a plurality of characteristic parameters indicating various characteristics of the performance sound data from the performance sound data and its frequency spectrum, and the actual pitch corresponding to the acquired result by a known chroma vectorization technique. Data (data representing the sound included in the performance signal) is generated and output. This feature parameter is acquired in the frame for each time segment. Specifically, the feature parameter acquisition unit 45b includes a time domain information acquisition unit 45ba that calculates a time domain feature parameter from the input performance audio data and a frequency domain feature from the frequency spectrum input from the FFT processing unit 45a. A frequency domain information acquisition unit 45bb for determining parameters is provided.

  The time domain information acquisition unit 45ba divides the input performance sound data into frames for each of the time segments synchronized with the FFT processing unit 45a, and acquires time domain feature parameters for each frame. Examples of characteristic parameters acquired by the region information acquisition unit 45ba include energy, energy change, duration, and the like. The frequency domain information acquisition unit 45bb acquires frequency domain feature parameters from the frequency spectrum of the waveform having the length of the time segment input from the FFT processing unit 45a. Examples of characteristic parameters acquired by the frequency domain information acquisition unit 45bb include, for example, pitch, harmonic frequency, harmonic level, harmonic phase, and the like. Parameters such as pitch (pitch indicating the scale of the guitar), harmonic frequency, harmonic level and the like are used for generation and display of a spectral image, which will be described later with reference to FIGS.

  The actual pitch data generated and output based on the characteristic parameters acquired by the time domain information acquisition unit 45ba and the frequency domain information acquisition unit 45bb as described above are input to the actual data buffer 45c. The actual data buffer 45c stores the input actual pitch data with time information (time stamp).

  On the other hand, the stave information synchronized with the karaoke song data is input to the target data generating unit 45g. The target data generating unit 45g has two types of target pitch data (in this embodiment, target pitch data for choking performance and target pitch data for normal performance, which will be described in detail later) based on the staff information. Generate. This target pitch data is data corresponding to the sound represented by the staff information, for example. The generated target pitch data is output to the target data buffer 45e and stored in the target data buffer 45e.

  The matching processor 45d compares the actual pitch data stored in the actual data buffer 45c as described above with the corresponding target pitch data stored in the target data buffer 45e by a known method. The degree of coincidence is calculated numerically, for example, by calculation. The calculated degree of coincidence is output to the scoring result generation unit 45f. In addition, instead of calculating the degree of coincidence by calculation, a table is prepared in advance, which is divided into a plurality of categories and the value of the degree of coincidence is associated with each category, and the comparison result is assigned to which category of the table. The degree of coincidence may be determined depending on whether it belongs.

  The scoring result generation unit 45f evaluates the performance by the user (in this example, the performance of the electric guitar 4) based on the degree of coincidence input from the matching processing unit 18, and gives a higher evaluation to the performance as the degree of coincidence increases. The scoring result generation unit 45f scores this evaluation as a score, for example, with 100 points being a perfect score, and inputs the scoring result to the monitors 13 and 14. The monitors 13 and 14 display the input scoring results.

<Performance of stringed instruments>
By the way, generally, there are various performance methods for playing a stringed instrument (especially the electric guitar 4) depending on the genre of the music and the preference of the user who is the performer. For example, when playing a single note of the electric guitar 4, a string is pressed on one fret with one finger, and sounding is started by picking the other hand, and then the string is held in contact with the fret with the one finger. There is a case where a performance method (so-called choking performance method) that smoothly shifts the tone pitch to the higher side is sometimes performed.

  In the performance by the choking technique, the user starts sounding at a pitch lower than the final pitch to be pronounced (hereinafter referred to as the starting pitch as appropriate), and then the pitch is changed over time by the bending operation described above. Is raised so as to reach the pitch that is finally desired to be pronounced (hereinafter referred to as the final pitch as appropriate). The above bending operation from the start of choking to the end of choking is an operation performed against the tension of the string, and the impression when the listener hears is considerably different depending on whether the user's skill is good or bad . Therefore, if such a choking technique can be judged well and reflected in the above-mentioned scoring, it should be possible to perform an accurate scoring closer to the listener's impression. However, if the above scoring is performed uniformly in correspondence with only the normal playing technique of producing sound by picking the other hand while holding the string on one fret with one finger, the above choking technique skills are reflected. It is difficult to score accurately.

<Performance signal of choking technique>
The performance signal of the above choking technique will be described with reference to FIGS. 5 (a), 5 (b), 6 (a), and 6 (b).

  FIG. 5A, FIG. 5B, FIG. 6A, and FIG. 6B show, as an example, an example of a performance signal in the choking technique, which corresponds to the 13th fret of the 2nd string of the electric guitar 4. In order to finally sound the “C” sound, the 12th fret of the 2nd string is pressed to start the sound with the sound of “B” (the above-mentioned start pitch), and then the pitch is changed over time by the bending operation. Is a spectrum image obtained by performing FFT processing on the performance signal when the sound is raised to the above-mentioned “C” sound (the above-mentioned final pitch). The horizontal axis represents the signal level. The band of “55 Hz to less than 110 Hz”, the band of “110 Hz to less than 220 Hz”, the band of “220 Hz to less than 440 Hz”, the band of “440 Hz to less than 880 Hz”, and “880 Hz to 1. Octave units so that the relationship between harmonic frequency and harmonic level for the input pitch can be found in the band below 76KHz, the band above 1.76KHz and below 3.52KHz, and the band above 3.52KHz. These are shown separately. The vertical axis indicates “A”, “A #”, “B”, “B #”, “C”, “C #”, “D”, “D #”, “E”, “F”, “F #”, “G”, and “G #”. , Each scale (pitch).

  As shown in FIG. 5 (a), the band of “880 Hz or more and less than 1.76 KHz” corresponding to the start pitch, “1. In two bands of “76 KHz or more and less than 3.52 KHz”, the spectrum of the scale of “B” occurs at a relatively large level. Even in the band of “3.52 KHz or higher”, the spectrum of the scale of “B” occurs at a relatively small level.

  Thereafter, when 1.2 seconds have elapsed from the start of sound generation, as shown in FIG. 5B, the band of “880 Hz to less than 1.76 KHz”, “1.76 KHz to 3.76 KHz”, corresponding to the bending operation. In two bands of “less than 52 KHz”, the level of the spectrum of the scale “B” is slightly reduced, and a spectrum of a certain level starts to be generated in the scale of “C”.

  Furthermore, at 1.6 seconds after the start of sound generation, as shown in FIG. 6 (a), the band of “880 Hz or more and less than 1.76 KHz”, “1.76 KHz or more”, corresponding to the progress of the bending operation. In two bands of “less than 3.52 KHz”, the spectrum level of the scale “B” is further reduced, and the spectrum level of the scale “C” is further increased. As a result, the spectrum of the scale of “B” and the spectrum of the scale of “C” are approximately the same level.

  Then, at 2.0 seconds after the start of sound generation, as shown in FIG. 6B, in response to the progress of the bending operation, the band of “880 Hz to less than 1.76 KHz”, “1.76 KHz or more”. In the two bands of “less than 3.52 KHz”, the spectrum of the scale of “B” is almost lost, and only the spectrum of the scale of “C” is obtained.

<Generation of two types of target pitch data according to the playing style>
Based on the difference in performance signals as described above, in the present embodiment, the target pitch data includes the target pitch data for normal performance corresponding to a normal performance other than the choking, and the choking performance. Correspondingly, choke performance target pitch data taking into account the temporal change in pitch from the start pitch to the final pitch as described above with reference to FIGS. 5 and 6 is generated. That is, as shown in FIG. 4, the target data generation unit 45 g of the CPU 45 generates the choking performance method target pitch data for the choking performance method at the choking portion based on the notation information input as described above. And a normal performance style target data generation section 45g2 for generating the normal performance style target pitch data in a part other than the choking part based on the input stave information. In the present embodiment, the choking performance target pitch data from the choking performance target data generation unit 45g or the normal performance target data generation unit 45g2 according to the staff information associated with the music data. The normal performance style target pitch data is selectively switched and input to the target data buffer 45e and stored therein. Therefore, the target data buffer 45e is the target pitch data associated with one piece of music data, and the choke performance target pitch data is incorporated in the choking portion where the choking performance is to be performed. The target pitch data into which the above-mentioned target pitch data for normal performance is incorporated is stored in the part. Then, the target pitch data and the actual pitch data (performed by the user) are compared by the matching processing unit 45d. The method will be described with reference to FIGS. 7, 8, 9, and 10. FIG.

<Comparison of data for judging skill of choking>
In the present embodiment, as described above, the choking performance target pitch data is compared with the actual pitch data at the choking portion. At that time, from the viewpoint of discriminating whether the skill of the choking performance performed by the user is good or bad, the following comparison is performed.

(A) Is the waveform of the actual pitch data convex upward? The behavior of the choking technique will be described with reference to FIGS. 7A and 7B, in which the pitch is plotted on the vertical axis and the time is plotted on the horizontal axis. Normally, when an advanced player performs a choking technique, as shown by the broken-line block arrow in FIG. 7A, a comparison is made from the start pitch at a relatively early time immediately after the start of the choking start point giving the start pitch. After the sound rises sharply and the pitch rises, the pitch rise rate gradually decreases with the passage of time, and the behavior reaches the choking end point that gives the final pitch.

  On the other hand, in the choking technique performed by the beginner, as shown by the solid line arrow in FIG. 7A, the pitch is temporally from the choking start point to the choking end point through the choking midpoint. Move in a straight line. Or, as opposed to FIG. 7 (a), as shown by the broken line block arrow in FIG. 7 (b), after the pitch rise rate immediately after the choking start point has slowed, the choking end point is reached. The sound rises sharply soon and the pitch rises, and the behavior reaches the final pitch at the end of choking.

  Therefore, in the present embodiment, based on the difference in behavior, the waveform of the actual pitch data when the pitch is plotted on the vertical axis and the time is plotted on the horizontal axis as described above, the choke start point and the choking of the target pitch data are represented. Whether or not it is convex upward is identified with respect to a straight line rising to the right connecting the end points (equivalent to the behavior of the beginner in FIG. 7A). Specifically, the choking start point and the choking end point are acquired from the choking performance target pitch data, and correspond to a temporal intermediate position between the choking start point and the choking end point. The above-mentioned choking midpoint of the target pitch data for choking performance is calculated. The choking midpoint of the actual pitch data corresponding to the temporal intermediate position between the choking start point and the choking end point in the actual pitch data is calculated. Then, if the pitch at the choking midpoint of the actual pitch data is higher than the pitch at the choking midpoint of the choking performance target pitch data, as shown by the broken line block arrow in FIG. It is considered that the behavior is “convex”, and the degree of coincidence described later is high (that is, it is determined that the performance is advanced).

  If the pitch at the choking midpoint of the actual pitch data is lower than the pitch at the choking midpoint of the choking performance target pitch data, as indicated by the broken line block arrow in FIG. The degree of coincidence, which will be described later, has a low or intermediate value (determined not to correspond to a performance by an advanced player).

(B) Whether the choking end points coincide (within a predetermined range). For example, when the beginners who have low performance ability perform choking, the above-mentioned flexing operation becomes excessive and the final pitch is reached at the end of choking. (See FIG. 8A, which will be described later), or conversely, when the bending operation is insufficient and becomes lower than the final pitch at the end of choking (see FIG. 8 (described later)). b)).

  Therefore, in the present embodiment, first, the (upper limit) pitch threshold is set in advance to the same pitch (or higher pitch than the straight line in the vicinity) of the target pitch data. Value is set. Then, at the time of performing the choking technique, it is identified whether or not the waveform of the above-mentioned actual pitch data is within the above (upper limit side) pitch threshold value. Specifically, in this example, an allowable start point is set (upper limit side) at a pitch higher than the choking start point of the choke performance target pitch data by a predetermined value, and the choking performance target pitch is set. An allowable end point is set at a pitch (upper limit side) higher than the choking end point of the data by a predetermined value.

  In addition, in this example, a pitch threshold value (on the lower limit side) is also set in advance at the same pitch as the above-mentioned line that goes up to the right of the target pitch data (or a pitch that is lower than the line that goes up to the right in the vicinity). Is done. Then, at the time of performing the choking technique, it is identified whether or not the waveform of the above-described actual pitch data is equal to or higher than the above (lower limit) pitch threshold value. Specifically, in this example, an allowable start point is set at a pitch lower than the choking start point of the choking performance target pitch data by a predetermined value (lower limit side), and the choking performance target pitch is set. An allowable end point is set at a pitch lower than the choking end point of the data by a predetermined value (lower limit side).

  Then, the pitch at the choking start point of the actual pitch data is higher than the pitch at the (upper limit side) allowable start point, or the pitch at the choking end point of the actual pitch data is the above (upper limit) allowable end point. (See FIG. 8A), whether the pitch at the choking start point of the actual pitch data is lower than the pitch at the (lower limit) allowable start point, or the choking of the actual pitch data. If the pitch at the end point is lower than the pitch at the above (lower limit) allowable end point (see FIG. 8B), the coincidence level described later is a low value (beginners) Is determined to fall under the category of

<Specific example of comparison with target pitch data>
A specific example of the data comparison as described above will be described with reference to FIGS. FIG. 9 shows an example of target pitch data including the choking part, and FIG. 10 shows an example of actual pitch data corresponding to the target pitch data.

<Target pitch data in the choking area>
In FIG. 9, in this example, in order to generate the sound of “A” corresponding to the 5th fret of the 1st string of the first beat in the first measure of the chord B ♭ Maj7, “G” corresponding to the 3rd fret of the 1st string. After the start of the sound, the chording method for one note (see “cho.” Notation in the figure, the same applies hereinafter) is used to raise the pitch to the above “A” sound. .

  Also, in the second measure of the chord Am7, in order to sound the "A" sound equivalent to the 5th fret of the 1st string of the 3rd beat, the sound starts with the "G" sound equivalent to the 3rd fret of the 1st string as above. Then, a performance method is specified in which the pitch is raised to the above-mentioned “A” sound by a choking method for one sound.

  Also, in the third measure of chords Gm7 and Gm7 / C, in order to produce a sound of “B ♭” corresponding to the 3rd fret of the 3rd string of the 4th beat, the sound of “A” corresponding to the 2nd fret of the 3rd string After the start of sound generation, a performance method is specified in which the pitch is raised to the sound of “B ♭” by a choking method for semitones.

  In addition, in the fifth measure of the chord Dm, in order to sound the “F” sound corresponding to the 6th fret of the 2nd string of the first beat, the sound is started to sound with the sound “D” corresponding to the 3rd fret of the 2nd string. A performance method is specified in which the pitch is raised to the above-mentioned “F” sound by a choking performance of 1 sound + semitone.

  Also, in the 6th measure of chord Am7, in order to sound the “G” sound equivalent to the 3rd fret of the 1st string of the 3rd beat, after the start of sounding with the sound of “F” corresponding to the 1st fret of the 1st string A performance method is specified in which the pitch is raised to the above "G" sound by a choking performance for one sound.

  In addition, in the seventh measure of chord A7, in order to sound the “G” sound corresponding to the 5th fret of the 4th string of the 4th beat, after starting the sound with the sound “F” corresponding to the 3rd fret of the 4th string A performance method is specified in which the pitch is raised to the above "G" sound by a choking performance for one sound.

<Real pitch data at the choking area>
In FIG. 10, in this example, in the first measure of the chord B ♭ Maj7, the third measure of the chords Gm7 and Gm7 / C, the sixth measure of the chord Am7, and the seventh measure of the chord A7, The performance is performed as specified by the high data.

  On the other hand, in the second bar of the chord Am7, as a result of the excessive bending operation described above, the chord of 1 tone half choking is started after the start of sounding with the sound of “G” corresponding to the 3rd fret of the 1st string. As a result, the pitch rises to a sound “B ♭” higher than the designation “A” (for example, corresponding to the broken line block arrow in FIG. 8A). In the fifth measure of the chord Dm, the bending operation is insufficient, and as a result, the sound begins with the sound of “D” corresponding to the 3rd fret of the 2 strings, and the choking is performed for 1 sound. The pitch only rises to a sound “E” higher than the designation “F” (for example, corresponding to the broken line block arrow in FIG. 8B). Therefore, in these two choking parts, the degree of coincidence described later is a low value (determined to correspond to a beginner's performance).

  Examples of displays displayed on the monitors 13 and 14 in accordance with the scoring result in the scoring result generation unit 45f performed using the degree of coincidence determined as described above are shown in FIGS. Shown in FIG. 11A shows an example when the scoring result is 100 points, FIG. 11B shows an example when the scoring result is 60 points, and FIG. 11C shows a scoring result of 0 points. This is an example. In addition to this, in addition to displaying the result of scoring the guitar performance by the user for each time segment in which music data playback is in progress, various display modes are available depending on the value of each score, such as displaying lyrics and chords together. Prepared in advance (not shown).

<Control procedure>
In order to realize the method of the present embodiment as described above, the processing contents executed by the CPU 45 when the karaoke apparatus 10 reproduces music will be described with reference to the flowcharts of FIGS. 12, 13, and 14.

  In FIG. 12, this flow is started when, for example, the user of the karaoke device 10 presses the power button of the control device 20 to turn on the power supply of the control device 20. In conjunction with the rising of the power supply of the control device 20, the power supply of the amplifier 16, the musical instrument connection board 8 and the monitors 13, 14 is started up. As described above, in this example, the case where the user of the karaoke apparatus 10 performs by connecting the electric guitar 4 to the musical instrument connection board 8 will be described. When the user connects the phone plug of the electric guitar 4 to the input terminal (phone jack) 4a of the musical instrument connection board 8, the musical instrument connection board 8 detects that the electric guitar 4 is connected.

  In FIG. 12, first, in step S10, the CPU 45 determines whether or not the music selection by the user has been completed. In the music selection, for example, when the user inputs the music selection number of the music that he / she wants to play the electric guitar 4 with the numeric keypad of the remote controller 30 and presses the music selection button, the music selection ends. Until the music selection is completed, the determination in step S10 is not satisfied (step S10: NO), and a loop standby is performed. When the music selection is completed, the determination in step S10 is satisfied (step S10: YES), and the process proceeds to step S15.

  In step S15, the CPU 45 temporarily stores the music selection number data indicating the music selection number in the RAM 46 corresponding to the music selection result in step S10, and transmits the music data corresponding to the music selection number via the LAN board 50. A request signal to be requested is transmitted to the server 58 via the LAN line 15. Thereby, the server 58 searches and reads out the music data corresponding to the music selection number indicated in the request signal, the music notation information, etc., and the lyrics data and video data corresponding to the music data from a storage device (not shown), The read music data and the like are transmitted to the control device 20 via the LAN line 15. When step S15 ends, the process proceeds to step S20.

  In step S <b> 20, the CPU 45 receives the music data and the like (including the music score information) transmitted from the server 58 via the LAN line 15 via the LAN board 50. Thereafter, the process proceeds to step S25.

In step S25, the CPU 45 temporarily stores the music data received in step S20 in the HDD 49. Thereafter, the process proceeds to step S30.
In this example, as the processing of step S15, step S20, and step S25, the music data and the staff information associated with the music selection number are acquired from the server 58 on demand for each music selection. In addition, a large-capacity auxiliary storage means (not shown) is provided in the control device 20 of the karaoke apparatus 10, and music data and the like are stored in advance in the auxiliary storage means, and each song selection is associated with a song selection number. The information group may be read from the auxiliary storage unit to obtain target information.

  In step S30, the CPU 45 starts reading the MIDI data stored in the HDD 49 in step S25 and writes the read MIDI data to the MIDI tone generator board 51. When step S30 ends, the process proceeds to step S35.

  In step S35, the CPU 45 outputs a control signal to the MIDI sound source board 51 and causes the MIDI sound source board 51 to output a sound source signal corresponding to the MIDI data written in step S30. The sound source signal output from the MIDI sound source board 51 is output to the sound control circuit 52 and converted into a music signal that can be amplified by the amplifier 16, and the converted music signal is transmitted from the sound output terminal 41 to the amplifier 16. Is output. Also, the audio signal input from the microphones 17 and 18 is mixed with the music signal in the mixing circuit 9 built in the amplifier 16. At this time, the performance signal output from the output terminal of the electric guitar 4 is input to the mixing circuit 9 via the musical instrument connection board 8 and the control device 20, and is mixed with the audio signal and the music signal. The mixed signal thus mixed is amplified by an amplifier circuit (not shown) built in the amplifier 16 and then output to the speaker 11 and the speaker 12 and reproduced by both speakers. In addition, the procedure of this step S35 functions as music data reproducing means described in each claim. When step S35 ends, the process proceeds to step S40.

  In step S40, the CPU 45 outputs a control signal to the monitors 13 and 14 to display the staff information and lyrics stored in step S25 on the monitors 13 and 14 (note that the scoring result in step S100 described later is also displayed at this time). To be displayed). As a result, the user who is a player of the electric guitar 4 can easily perform the electric guitar performance part in accordance with the karaoke musical piece to be reproduced by playing the electric guitar 4 according to the staff notation displayed on the monitors 13 and 14. can do. Thereafter, the process proceeds to step S50.

  In step S50, the CPU 45 stores the performance signal input from the input terminal 44 by the performance of the user's electric guitar 4 as performance data, for example, in the HDD 49. Thereafter, the process proceeds to step S55.

  In step S55, the CPU 45 determines whether or not one time segment corresponding to the FFT (Fast Fourier Transform) processing unit has been completed. If the time segment has not ended, the determination is not satisfied (S55: NO), and the process returns to step S30 and the same procedure is repeated. When the time segment ends, the determination is satisfied (S55: YES), and the routine goes to Step S100.

  In step S100, the CPU 45 performs scoring processing using the method described above. Details of the scoring process are shown in FIG.

  In FIG. 13, first, in step S110, the CPU 45 reads out the performance data accumulated in step S50 (corresponding to the one section), and the FFT processing unit 45a uses a known FFT (fast Fourier transform) technique. Each frequency component is extracted and analyzed. Thereafter, the process proceeds to step S120.

  In step S120, the CPU 45 generates the above-described actual pitch data by converting the analysis result in step S110 into a chroma vector by a known method by the feature parameter acquisition unit 45b. This step S120 corresponds to the actual data generation procedure described in each claim, and the CPU 45 executing this step S120 functions as the actual data generation means described in each claim. Thereafter, the process proceeds to step S130.

  In step S130, the CPU 45 performs the choking performance target data generation unit 45g1 and the normal performance target data generation unit 45g2 of the target data generation unit 45g for each sound based on the musical score information acquired in step S20. As described above, the target pitch data composed of the choking performance target pitch data or the normal performance target pitch data is generated and stored in the target data buffer 45e. The target pitch data for choking performance at this time includes the above-described choking start point and choking end point. This step S130 corresponds to the target data generation procedure described in each claim, and the CPU 45 executing this step S130 functions as the target data generation means described in each claim. Thereafter, the process proceeds to step S140.

  In step S140, the CPU 45 compares the target pitch data generated in step S130 with the corresponding actual pitch data generated in step S120 by the matching processing unit 45d, and calculates a matching degree. A degree calculation process (refer to FIG. 14 described later for details) is executed.

  Details of the degree-of-match calculation processing in step S140 are shown in FIG. 14, first in step S210, the matching processing unit 45d of the CPU 45 determines whether the target pitch data generated in step S130 corresponds to the choking portion (in other words, target pitch data for choking performance method). It is determined whether or not. If it corresponds to the choking part (in other words, the choke performance target pitch data), the determination in step S210 is satisfied (S210: YES), and the process proceeds to step S215.

  In step S215, the matching processing unit 45d of the CPU 45 includes the above-described choking start point and choking end point included in the target pitch data (specifically, the choking performance target pitch data) stored in the target data buffer 45e. (Including each pitch).

  Thereafter, in step S220, the matching processing unit 45d of the CPU 45, based on the obtained choking start point and choke end point, includes the choking midpoint (including each pitch) of the target pitch data located between them. ) To get.

  Then, the process proceeds to step S225, where the matching processing unit 45d of the CPU 45 determines the pitch of the choking start point in the actual pitch data based on the actual pitch data generated in step S120 described above (corresponding to the performance by the choking technique by the user). Is determined to be within a predetermined range from the pitch at the choking start point of the target pitch data acquired in step S215. Specifically, as described above with reference to FIGS. 8A and 8B, the matching processing unit 45d of the CPU 45 determines that the choking start point in the actual pitch data is the above (lower limit side) allowable start. It is determined whether it is located between the point and the above (upper limit side) allowable start point. If it is not within the predetermined range, the determination in step S225 is not satisfied (S225: NO), and the matching processing unit 45d of the CPU 45 sets the degree of coincidence between the target pitch data and the actual pitch data to be “low” in step S250. . On the other hand, if it is within the predetermined range, the determination in step S225 is satisfied (S225: YES), and the process proceeds to step S230.

  In step S230, the matching processing unit 45d of the CPU 45 determines that the pitch of the choking end point in the actual pitch data is based on the actual pitch data generated in step S120 (corresponding to the performance by the user's choking performance). It is determined whether it is within a predetermined range from the pitch at the choking end point of the target pitch data acquired in step S215. Specifically, as described above with reference to FIGS. 8A and 8B, the matching processing unit 45d of the CPU 45 determines that the choking end point in the actual pitch data is the above (lower limit side) allowable end. It is determined whether it is located between the point and the above (upper limit side) allowable end point. If it is not within the predetermined range, the determination in step S230 is not satisfied (S230: NO), and the matching processing unit 45d of the CPU 45 has a “low match” between the target pitch data and the actual pitch data in step S250 as described above. "Is set. On the other hand, if it is within the predetermined range, the determination at Step S230 is satisfied (S230: YES), and the routine goes to Step S235.

  In step S235, the matching processing unit 45d of the CPU 45 acquires the waveform of the actual pitch data in step S215 based on the actual pitch data generated in step S120 (corresponding to the performance by the choking method by the user). It is determined whether or not the straight line that rises to the right connecting the choking start point and the choking end point of the target pitch data is convex upward. Specifically, as already described, the matching processing unit 45d of the CPU 45 calculates the pitch of the choking midpoint obtained from the choking start point and the choking end point in the actual pitch data in step S220. It is determined whether the pitch of the target pitch data is higher than the pitch of the choking midpoint. In this determination, a predetermined pitch range is provided for the choking midpoint of the target pitch data (for choking performance), and the pitch at the choking midpoint of the actual pitch data is higher than the upper limit of the pitch range. In this case, it may be regarded as convex above. If it is not convex above, the determination in step S235 is not satisfied (S235: NO), and the matching processing unit 45d of the CPU 45 sets the degree of coincidence between the target pitch data and the actual pitch data to “medium (intermediate value) in step S245. ) ”. On the other hand, if it is convex upward, the determination in step S235 is satisfied (S235: YES), and the degree of coincidence between the target pitch data and the actual pitch data is set to “high” in step S240.

  On the other hand, if the target pitch data generated in step S130 does not correspond to the choking part (in other words, the target pitch data for normal performance style), the determination in step S210 is not satisfied (S210: NO), The process moves to step S255.

  In step S255, the matching processing unit 45d of the CPU 45, based on the actual pitch data generated in the above-described step S120 (corresponding to the performance by the normal playing method by the user), the actual pitch data corresponds to the corresponding target pitch data ( It is determined whether or not it is substantially coincident with the normal performance style target pitch data (is within a predetermined range in the vicinity). If the actual pitch data is within the predetermined range, the determination in step S255 is satisfied (S255: YES), and the matching processing unit 45d of the CPU 45 determines that the matching degree between the target pitch data and the actual pitch data is “high” in step S260. "Is set. On the other hand, if the actual pitch data is not within the predetermined range, the determination in step S255 is not satisfied (S255: NO), and the matching processing unit 45d of the CPU 45 determines that the degree of coincidence between the target pitch data and the actual pitch data in step S265. Set to “Low”.

  When any of the above steps S240, S245, S250, S260, and S265 is completed, this routine is terminated, and the process proceeds to step S150 in FIG.

  In step S150, the CPU 45 calculates (sets) the coincidence calculated (set) in step S140 (specifically, any of steps S240, S245, S250, S260, and S265) by the scoring result generation unit 45f. Based on the degree, scoring corresponding to the performance data is performed by an appropriate method, and the scoring result is output to, for example, the HDD 49 and stored. The scoring results are displayed on the monitors 13 and 14 in step S40 executed after returning to the above-described step S30 (see FIGS. 11A to 11C).

  Thereafter, the CPU 45 determines in step S65 whether or not the reproduction of the music data has been completed (in other words, whether or not the reading of the MIDI data in step S30 has been completed up to the last MIDI data of the music data). If the reproduction of the music data is finished, the determination is satisfied (step S65: YES), and this flow is finished. Until the reproduction of the music data is completed, the determination is not satisfied (step S65: NO), the process returns to step S30, and the procedure of steps S30 to S65 is repeated.

  In addition, the said step S230, step S235, step S240, step S245, step S250, and above-mentioned step S150 are equivalent to the choking scoring procedure as described in each claim, The said step S230, step S235, step S240, step S245, CPU45 which performs step S250 and step S150 functions as the choking scoring means described in each claim.

<Effect of embodiment>
As described above, in the present embodiment, when the user plays the electric guitar 4 in accordance with the reproduction of the music, the chroma vector processing is performed after the frequency component of the performance signal is extracted by the FFT technique. Thus, actual pitch data corresponding to the performance is generated for each predetermined time segment (see step S120 in FIG. 13). Then, the performance is scored based on the degree of coincidence between the actual pitch data and the target pitch data generated based on the staff information associated with the music data (see step S150 in FIG. 13).

  At this time, in the present embodiment, in consideration of the tendency when the user actually plays the stringed instrument such as the electric guitar 4 as described above, the scoring based on the target pitch data and the corresponding actual pitch data is performed. The performance is made to reflect whether the performance is good or bad. Specifically, when the pitch is plotted on the vertical axis and time is plotted on the horizontal axis, the waveform of the actual pitch data is above the straight line that goes up to the right connecting the choking start point and choke end point of the target pitch data. Whether the choking is good or bad is determined based on whether or not it is convex (see step S235 in FIG. 14). As a result, the skill of the choking technique can be reliably reflected in the scoring result, so that accurate scoring close to the listener's impression can be performed with high accuracy. As a result, convenience and entertainment for the user can be enhanced.

  For example, when a player with low performance ability performs choking, the bending operation performed at the time of the choking performance becomes excessive, and may become higher than the final pitch at the end of choking. Therefore, in the present embodiment, in particular, such a case is also dealt with, and a pitch threshold value (see FIG. 8 (a) and (see (upper limit side) pitch threshold value in FIG. 8B) are set. When the choking technique is executed, the choking end point of the waveform of the above-described actual pitch data is the pitch threshold value (the upper limit pitch threshold value in FIGS. 8A and 8B). It is determined whether or not it falls within the following range (see step S225 and step S230 in FIG. 14), and is added to the scoring result. Thereby, more accurate scoring can be performed with high accuracy.

  In addition, in the above, the arrow shown in each figure of FIG. 4 etc. shows an example of the flow of a signal, and does not limit the flow direction of a signal.

  In addition, the flowcharts shown in FIGS. 12, 13, and 14 do not limit the present invention to the procedures shown in the above-described flow, and the addition / deletion of the procedures or the order of the procedures are within the scope not departing from the spirit and technical idea of the invention. Changes may be made.

  In addition to those already described above, the methods according to the above-described embodiments and modifications may be used in appropriate combination.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

4 Electric guitar (stringed instrument)
10 Karaoke equipment (musical performance equipment)
45 CPU (calculation means)
49 HDD (music data storage means)

Claims (3)

Music data storage means for storing karaoke music data, including a performance part of a predetermined stringed instrument including an execution part of the choking technique,
Music data reproducing means for reading out and reproducing the karaoke music data stored in the music data storage means;
A performance signal input means for inputting a performance signal output from the stringed instrument by a performance of the stringed instrument by a musical instrument player according to the reproduction of the karaoke music data by the music data reproducing means;
Target data generating means for generating target pitch data including a choking start point and a choking end point in the choking performance according to the reproduction of the karaoke music data by the music data reproducing means;
Actual data generating means for generating actual pitch data by the choking method based on the performance signal input from the performance signal input means;
The waveform of the actual pitch data by the choking method with the pitch on the vertical axis and the time on the horizontal axis is above the straight line connecting the choking start point and the choking end point of the target pitch data. Choking scoring means for scoring the performance according to the choking performance by the instrument player, depending on whether or not it is convex.
A musical performance device characterized by comprising: In the musical sound performance device according to claim 1,
The choking scoring means further includes a pitch threshold value of a pitch in the vicinity where the choking end point of the waveform of the actual pitch data by the choking performance is the same pitch as the right-up straight line or higher than the right-up straight line. The musical performance device characterized in that the scoring is performed according to whether or not: Music data storage means for storing karaoke music data, which has a performance part of a predetermined stringed instrument including a choking performance part, and music data playback for reading and playing back the karaoke music data stored in the music data storage means And a performance signal input means for inputting a performance signal output from the stringed instrument by the performance of the stringed instrument by a musical instrument player in accordance with the reproduction of the karaoke music data by the music data reproducing means. For the computing means provided,
A target data generation procedure for generating target pitch data including a choking start point and a choking end point in the choking performance according to the reproduction of the karaoke music data by the music data reproducing means;
An actual data generation procedure for generating actual pitch data by the choking method based on the performance signal input from the performance signal input means;
The waveform of the actual pitch data by the choking method with the pitch on the vertical axis and the time on the horizontal axis is above the straight line connecting the choking start point and the choking end point of the target pitch data. A choking scoring procedure for scoring the performance by the choking method by the instrument player, depending on whether or not it is convex.
A musical performance processing program for executing

Images