JP2015001586A - Stringed instrument performance evaluation device and stringed instrument performance evaluation program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve evaluation accuracy of a stringed instrument by accurately sampling performance sound thereof.SOLUTION: A stringed instrument performance evaluation device executes: a pitch notation level conversion processing which converts frequency conversion information into a pitch notation level per pitch notation; a weighting processing which weights the pitch notation level divided by octave with a coefficient set for each octave; a pitch notation level integration processing which integrates the weighted pitch notation level for each pitch notation and calculates an integrated level for each pitch notation; a performance pitch notation determination processing which determines the pitch notation having a prescribed integration level as a performance pitch notation; and an evaluation processing which performs evaluation by comparing the performance pitch notation determined by the performance pitch notation determination processing with reference performance information outputted by performance means according to musical performance.

Description

  The present invention relates to a stringed instrument performance scoring apparatus and a stringed instrument performance scoring program for evaluating a stringed instrument capable of playing a chord composed of a plurality of scales, such as a guitar, by performing comparison with reference information when performing the performance. .

  Conventionally, in a karaoke apparatus that performs singing in accordance with automatic performance, an evaluation function that performs evaluation (scoring) by comparing the main melody of the music to be automatically performed with the singing voice in order to determine the skill of the singing. What you have is known. Patent Document 1 discloses a singing voice evaluation device that adds points according to hearing comfort (content ratio of overtones).

  By the way, what is currently known as a karaoke apparatus has a function of connecting a stringed instrument such as a guitar or a bass and enjoying the performance of the stringed instrument together with the automatic performance of the music. According to such a function, even a stringed instrument played by one user can enjoy a stringed instrument played in accordance with the automatic performance.

  In such a karaoke apparatus capable of playing a stringed instrument, it is desired to perform skillful evaluation of the stringed instrument performance as in the conventional evaluation function for singing. Patent Document 2 discloses a musical sound performance device that enables scoring of an electric guitar.

JP 2005-107088 A JP 2013-44777 A

  However, unlike the singing of single pitches, the instrumental sound of stringed instruments such as guitars is usually composed of chords that sound multiple pitches at the same time. Cannot be used as

  Furthermore, when evaluating the performance of a stringed instrument, there is a problem of overtones included in the performance sound of the stringed instrument. Normally, one input sound includes a plurality of overtones. If there is only one input sound, the lowest peak value in the spectrum may be regarded as the fundamental sound. However, when a chord is created, the harmonics of each fundamental tone that make up the chord appear in the same spectrum. Therefore, it is not possible to distinguish between the fundamental tone and the harmonics. The situation is difficult to distinguish.

  Patent Document 2 discloses that the electric guitar as a stringed instrument is scored, but does not discuss the above-described problems of chords and overtones.

  The stringed instrument performance evaluation apparatus and the stringed instrument performance evaluation program according to the present invention are intended to improve evaluation accuracy by accurately extracting performance sounds by a stringed instrument in the performance evaluation by the stringed instrument described above.

Therefore, the stringed instrument performance evaluation apparatus according to the present invention is
A performance means for performing music based on music information including reference performance information;
Performance sound input means for inputting performance sound output from a stringed instrument;
A frequency conversion process for extracting frequency information by converting the frequency of the performance sound input by the performance sound input means;
Frequency conversion processing for extracting frequency information by frequency conversion;
Pitch name level conversion processing for converting frequency conversion information to a pitch name level for each pitch name;
A weighting process that weights the octave-divided pitch names with a coefficient set for each octave,
A pitch name level integration process for integrating weighted pitch name levels for each pitch name and calculating an integrated level for each pitch name;
A performance note name determination process for determining a note name having a predetermined integration level as a performance note name;
It is characterized by comprising control means for executing an evaluation process for performing an evaluation by comparing the performance sound name determined in the performance sound name determination process with the reference performance information output in accordance with the performance of the music.

Furthermore, in the stringed instrument performance evaluation apparatus according to the present invention,
The performance note name determination process is characterized in that the integration level for each note name is normalized with the maximum integration level, and a note name having a predetermined threshold value or more is determined as a performance note name.

Furthermore, in the stringed instrument performance evaluation apparatus according to the present invention,
The coefficient set for each octave used in the weighting process is set for each piece of music information or for each stringed instrument used in the piece of music information.

Furthermore, in the stringed instrument performance evaluation apparatus according to the present invention,
The octave range used in the weighting process is set for each piece of music information or for each stringed instrument used in the piece of music information.

Moreover, the stringed instrument performance evaluation program according to the present invention includes:
Frequency conversion processing for extracting frequency information by converting the performance sound output from the stringed instrument,
Pitch name level conversion processing for converting frequency conversion information to a pitch name level for each pitch name;
A weighting process that weights the octave-divided pitch names with a coefficient set for each octave,
A pitch name level integration process for integrating weighted pitch name levels for each pitch name and calculating an integrated level for each pitch name;
A performance note name determination process for determining a note name having a predetermined integration level as a performance note name;
The computer is caused to perform an evaluation process in which the performance sound name determined in the performance sound name determination process is compared with the reference performance information output from the performance means according to the performance of the music. .

  According to the stringed instrument performance evaluation apparatus and the stringed instrument performance evaluation program according to the present invention, it is possible to improve the evaluation accuracy by accurately extracting the performance sound of the stringed instrument. In particular, it is possible to accurately extract the performance sound in a guitar or the like that plays a chord in which a plurality of intervals sound simultaneously.

The figure which shows the structure of the karaoke system which concerns on embodiment of this invention. The flowchart which shows the music performance process which concerns on embodiment of this invention The flowchart which shows the performance sound acquisition process which concerns on embodiment of this invention The flowchart which shows the performance evaluation process which concerns on embodiment of this invention The figure which shows the weighting table which concerns on embodiment of this invention. The figure which shows an example of frequency conversion information (Example 1: Em7, no weight) The figure which shows an example of frequency conversion information (Example 1: Em7, weighted) The figure which shows an example of frequency conversion information (Example 2: Em7, no weight) The figure which shows an example of frequency conversion information (Example 2: Em7, weighted)

  Now, the stringed instrument performance scoring device according to the embodiment of the present invention will be described by taking as an example a case where it is applied to a karaoke system. FIG. 1 is a diagram showing a configuration of a karaoke system according to an embodiment of the present invention. The karaoke system in the present embodiment is composed of a karaoke device 2 and remote control devices 1a and 1b, which are connected to each other via a LAN 100 so that they can communicate wirelessly and wiredly.

  The karaoke device 2 installed in the store can accept various instructions from the user by the remote control device 1 (for example, 1a, 1b). In addition, the remote control device 1 includes a touch panel display screen in which the display unit 11 and the operation unit 17 are shared, and can provide various information to the user. The remote control device 1 is wirelessly connected to the karaoke device 2 via an access point 110 installed on the LAN 100. As shown in the figure, for example, the karaoke device 2 is associated with remote control devices 1 a and 1 b, and can transmit and receive information via the LAN 100. In addition, the remote control device 1 and the karaoke device 2 can perform short-range communication using infrared rays or the like.

  Furthermore, in the karaoke system of the present embodiment, a karaoke host 5 (server device) is provided via the Internet to provide various services to the user, and the storage unit 51 has various services such as music information and user information. The information necessary for is stored. And it is comprised so that various information can be transmitted / received with the karaoke apparatus 2 or the remote control apparatus 1 through the router 120. FIG.

  The karaoke apparatus 2 that employs the stringed instrument scoring device according to the embodiment of the present invention functions mainly with the control unit 30 that performs overall control, and performs music performance processing that performs music performance as a main function. A hard disk (HDD) 32 serving as a storage means stores music information used in music performance processing.

  In the present embodiment, the external musical instrument 44 c can be connected to the karaoke apparatus 2. As the external musical instrument 44c, various stringed instruments (guitar, bass, violin, etc.) that output electrical acoustic signals (performance sounds) can be used. The stringed instrument performance scoring device according to the present embodiment is particularly effective for a stringed instrument that plays a chord composed of a plurality of pitch names. The performance sound input from the external musical instrument 44 c is mixed with performance information performed by the acoustic control unit 70 and emitted from the speaker 42. In addition, an acoustic instrument having no electrical sound output may be adopted as the external instrument 44c. In that case, it is conceivable that the performance sound picked up by the microphone is input to the acoustic control unit 70 to be evaluated.

  The music information is prepared as music for practicing the performance of an external musical instrument (musical instrument practice music), performance information composed of MIDI information, background video designation information for designating a background video, performance Lyric information for displaying lyrics in synchronism with the sound, and reference performance information in which the name of the sound (performance sound name) to be played by the external musical instrument 44c is defined in synchronization with the performance. When the music is designated, the performance information included in the music information is played by the acoustic control unit 70, and the reference performance information is read in synchronization with the performance, and the performance is performed by the external instrument 44c based on the reference performance information. The note name (performance note name) to be determined is determined.

  The reference performance information is information that serves as an example of the external musical instrument 44c (stringed musical instrument) played by the user during music performance, and is information that defines the name of the note to be played. The external musical instrument 44c of the present embodiment is assumed to be a stringed musical instrument that can play chords such as a guitar. Therefore, the standard performance information can be composed of a plurality of pitch names constituting a chord, or can be composed of chord names such as C, G, and F. In the case of being composed of chord names, chord information as reference performance information is used after being converted into pitch names in the performance evaluation process.

  Then, the music performance process performed with the karaoke apparatus 2 of this embodiment is demonstrated. FIG. 2 is a flowchart showing music performance processing according to the embodiment of the present invention. When the performance processing is started after the karaoke device 2 is turned on, the karaoke device 2 checks the reservation table (S101), and determines whether there is a song to be played next (S102). If it is determined in the reservation table that there is a song to be played next (1202: Yes), the acoustic control unit 70 takes in the performance sound (PCM data) from the external musical instrument 44c. Setting is executed (S103), and acquisition of performance sound (PCM data) output from the external musical instrument 44c is started (S104).

  When the performance sound can be acquired from the external musical instrument 44c, the performance of the music specified on the reservation table is started by the acoustic control unit 70 as a performance means (S105). The performance sound acquisition process (S200) for performance evaluation of the stringed instrument is repeated during the performance information performance, and is continuously executed until the performance ends (S106: Yes).

  FIG. 3 is a flowchart showing performance sound acquisition processing according to the embodiment of the present invention. After the performance sound from the external musical instrument 44c is converted into PCM data, the sound control unit 70 acquires PCM data by a certain amount for each DMA setting size (S201). The acquired PCM data is accumulated in the FFT processing transfer buffer formed in the storage means such as the memory 27 (S202). The performance evaluation process (S300) is executed on the condition that the amount of data corresponding to the size of one FFT process as the frequency conversion process is accumulated in the FFT process transfer buffer (S203: Yes).

  FIG. 4 is a flowchart showing performance evaluation processing according to the embodiment of the present invention. When this process is started, a frequency conversion process is performed on the PCM data (accumulated data) accumulated in the FFT process required transfer buffer (S301). In the present embodiment, FFT processing is adopted as frequency conversion processing. However, as long as processing can analyze the level for each pitch name, not only FFT processing but also various frequency conversion processing can be adopted. is there. In S302, the level for each pitch name is detected based on the frequency conversion processing result (frequency conversion information). FIG. 6 shows an example of a result (frequency conversion information) obtained by performing the frequency conversion process on the performance sound.

  In FIG. 6, the level of conversion information for each frequency is shown in a bar graph for each preset octave (vertical axis). This frequency conversion information is a result of frequency conversion processing of the performance sound obtained when the chord Em7 is played by the external musical instrument 44c. The chord Em7 is a chord composed of pitch names (E, G, B, D) surrounded by circles in the figure. The horizontal axis indicating the frequency is divided for each pitch name from E to D #. Based on the pitch name of such frequency conversion information, the level for each sound and each octave is detected. In the present embodiment, the peak value is detected as the level of the pitch name among the levels belonging to each pitch name. As a method for detecting the level, various forms such as a total and an average of levels belonging to each pitch name can be adopted in addition to such forms.

In step S303, a weighting process for multiplying a coefficient for each octave is performed on the level for each pitch name detected in this manner with reference to a weighting table stored in a storage unit such as the memory 27. FIG. 5 shows a weighting table according to the embodiment of the present invention. FIG. 6 shows frequency conversion information (Example 1) corresponding to the performance sound obtained by playing the chord Em7 with the external musical instrument 44c as described above. OCT1 to OCT8 indicated on the vertical axis indicate octave intervals indicated by pitch names E to D #. In the weighting table, a coefficient is set for each octave section.

  FIG. 7 shows the frequency conversion information obtained by multiplying the weighting process by this weighting table, that is, the coefficient corresponding to each octave section. As described above, according to the present embodiment, the weighting process is performed on the level for each pitch name of the frequency conversion information obtained from the performance sound of the external instrument 44c, so that the harmonic sound unique to the performance sound of the stringed instrument is used. It is possible to suppress erroneous determination. In addition, it is possible to suppress erroneous determination due to noise or the like by considering the frequency range of the performance sound of the stringed instrument. In this embodiment, a guitar is used as the external musical instrument 44c, but in a general guitar, the boundary between OCT2 and OCT3 is the lower limit frequency of the external musical instrument 44c used. Therefore, in this embodiment, the noise component lower than the lower limit frequency of the guitar is suppressed by setting the coefficient of OCT1 to 0 and the coefficient of OCT2 to 0.25. Here, the reason why the OCT2 lower than the lower limit frequency is not set to 0 is that this weighting table can be used for music that is down-tuned by the external musical instrument 44c, and has versatility for a plurality of music. . When a weighting table is prepared for each song, it can be changed according to the song, such as down-tuning or corresponding to the lower limit frequency of the external instrument 44c to be used. By applying such a weighting table, it can be seen that the noise component included in OCT2 in Example 1 of FIG. 6 is suppressed as shown in FIG. .

  This weighting table may be prepared for each piece of music. Alternatively, when a plurality of types of external musical instruments 44c can be selected and played and evaluated with the same music, weighting used according to the type of the selected external musical instrument 44c (for example, lead guitar, rhythm guitar, bass, etc.) The table may be changed. In the weighting table, it is conceivable to change the octave interval in addition to changing the weighting coefficient. In the case of FIG. 6, the octave section is set to a section from E to D # with the pitch name E as an initial value, but it is conceivable to change the initial value to A to a section from A to G #. By changing the weighting table in this way, it becomes possible to perform highly accurate pitch name determination according to the type of music to be played or the type of external musical instrument 44c to be used.

  Using the weighting table for the level of each pitch name, after multiplying the coefficient for each octave (S303), the level is added for each pitch name between multiple octaves, and the added level for each pitch name is calculated (S304). Further, in the present embodiment, normalization (S305) is performed with the maximum value being 1 among the addition levels for each pitch name, and the normalized addition level for each pitch name is calculated. As described above, in the present embodiment, by executing the integration processing for calculating the addition level (integration level) for each pitch name among a plurality of octaves, it is used as a reference for determining the pitch name of the performance sound played by the external instrument 44c. I use it.

The addition level for each pitch name calculated in S305 is compared with a threshold value, and an addition level that does not satisfy the threshold value is converted to 0, that is, determined as a pitch name that is not played in the performance sound (S306). . On the other hand, the addition level for each pitch name remaining in the comparison with the threshold value is determined as the pitch name played by the external musical instrument 44c, and the performance is evaluated in comparison with the reference performance information. Therefore, reference performance information to be compared is acquired (S307), the degree of coincidence is digitized in comparison with the addition level for each note name remaining in the comparison with the threshold value, and the performance sound is evaluated (S308). ). As described above, the standard performance information can be composed of a pitch name or a chord name, and if it is composed of a chord name, the pitch performance name is included in the chord name. After conversion, a comparison is made. By repeatedly executing such a series of performance evaluation processes during the performance information performance, the performance evaluation of the external musical instrument 44c can be performed on the music being played.

  In particular, in the present embodiment, during the performance evaluation process (S300), the frequency conversion information is divided into octave sections, and weighting processing (S303) for multiplying a coefficient for each octave is executed, thereby obtaining harmonics peculiar to stringed instruments Alternatively, other noises can be suppressed, and the pitch name being played by the external musical instrument 44c can be accurately identified.

  FIGS. 6 and 7 show an example (Example 1) when the chord name Em7 is played. FIGS. 7 and 8 show chords whose constituent sounds are one octave higher than Example 1. FIG. An example (Example 2) of frequency conversion information when the name Em7 is played is shown. FIG. 7 shows frequency conversion information before weighting, and FIG. 8 shows frequency conversion information subjected to weighting. In Example 2, it can be seen that the level is higher at a higher octave position than in Example 1. As shown in FIG. 7, in Example 2, in the frequency conversion information before weighting, the pitch name F # is a harmonic component that is not included in Em7 (component sounds E, G, B, D), In particular, it appears remarkably in OCT6 and OCT7. By weighting the frequency conversion information, as shown in FIG. 8, the level of the harmonic component is suppressed, and erroneous detection suppression in the pitch name determination is achieved.

  By repeatedly executing the performance sound acquisition process (S200) and performance evaluation process (S300) described above during the music performance period, the value of S308 is calculated, and by summing up the values, the external musical instrument 44c ( Performance evaluation of (stringed instrument) is performed. The aggregated values are converted into evaluations such as scores and performance levels, and are displayed and output on the monitor device 41 and the like after the music performance is completed.

  Although the stringed instrument performance evaluation apparatus employed in the karaoke system has been described above, according to the stringed instrument performance evaluation apparatus of the present embodiment, it is possible to improve the evaluation accuracy by accurately extracting the performance sound of the stringed instrument. . In particular, it is possible to accurately extract the performance sound in a guitar or the like that plays a chord in which a plurality of pitches sound simultaneously.

  In the present embodiment, the stringed instrument performance evaluation apparatus employed in the karaoke system has been described. However, by installing it on a personal computer or a computer such as a portable information terminal, the stringed instrument performance scoring system can be used as a stringed instrument performance evaluation apparatus. The program is also an object of the present invention.

  Note that the present invention is not limited to these embodiments, and embodiments configured by appropriately combining the configurations of the respective embodiments also fall within the scope of the present invention.

DESCRIPTION OF SYMBOLS 1a, 1b ... Remote control device, 11 ... Display part, 12 ... Video RAM, 13 ... Image | video control part, 14 ... Memory, 15 ... Control part, 16 ... Wireless LAN communication part, 17 ... Operation part, 18 ... Operation processing part, DESCRIPTION OF SYMBOLS 19 ... Infrared communication part, 2 ... Karaoke apparatus, 21 ... Operation part, 22 ... Operation processing part, 23 ... Infrared communication part, 24 ... Interface part, 27 ... Memory, 28 ... Video RAM, 29 ... Video reproduction part, 30 ... Control unit 31 ... Video control unit 32 ... Hard disk 41 ... Monitor device 42 ... Speaker 44a, 44b ... Singing microphone 44c ... External musical instrument 100 ... LAN 110 ... Access point 120 ... Router 5 ... Karaoke host, 51 ... Memory

Claims (5)

A performance means for performing music based on music information including reference performance information;
Performance sound input means for inputting performance sound output from a stringed instrument;
A frequency conversion process for extracting frequency information by converting the frequency of the performance sound input by the performance sound input means;
Frequency conversion processing for extracting frequency information by frequency conversion;
Pitch name level conversion processing for converting frequency conversion information to a pitch name level for each pitch name;
A weighting process that weights the octave-divided pitch names with a coefficient set for each octave,
A pitch name level integration process for integrating weighted pitch name levels for each pitch name and calculating an integrated level for each pitch name;
A performance note name determination process for determining a note name having a predetermined integration level as a performance note name;
A stringed instrument comprising control means for executing an evaluation process for performing an evaluation by comparing the performance sound name determined in the performance sound name determination process with reference performance information output in accordance with the performance of the music Performance evaluation device. The performance note name determination process normalizes an integrated level for each note name with a maximum integration level, and determines a note name having a predetermined threshold or more as a performance note name. Stringed instrument performance evaluation device. The coefficient set for each octave used in the weighting process is set for each piece of musical piece information or for each stringed instrument used in the piece of musical piece information. Stringed instrument performance evaluation device. 4. The octave range used in the weighting process is set for each piece of music information or for each stringed instrument used in the piece of music information. 5. Stringed instrument performance evaluation device. Frequency conversion processing for extracting frequency information by converting the performance sound output from the stringed instrument,
Pitch name level conversion processing for converting frequency conversion information to a pitch name level for each pitch name;
A weighting process that weights the octave-divided pitch names with a coefficient set for each octave,
A pitch name level integration process for integrating weighted pitch name levels for each pitch name and calculating an integrated level for each pitch name;
A performance note name determination process for determining a note name having a predetermined integration level as a performance note name;
A stringed instrument performance evaluation program for causing a computer to execute an evaluation process in which a performance sound name determined in a performance sound name determination process is compared with reference performance information output from a performance means in accordance with the performance of a song.

Images