JP4934180B2 - Plucked string instrument performance evaluation device - Google Patents

Description

  The present invention relates to a plucked string instrument performance evaluation apparatus for evaluating the performance of a plucked string instrument such as a guitar, and more particularly to an improvement for realizing accurate performance evaluation with a simple configuration.

  In general, a great deal of time and effort is required to acquire the performance of a musical instrument, and when using an institution such as a music school for the acquisition, a considerable cost is required. On the other hand, with the recent progress in distribution and computerization due to the spread of the Internet, etc., it has become easy to obtain musical instrument textbooks and video teaching materials that you want to learn, but you can learn musical instrument performance by referring to textbooks etc. If you do, it is difficult to objectively evaluate your performance. Therefore, a technique for evaluating the performance of a musical instrument by an electronic control device has been proposed. For example, this is the music learning system described in Patent Document 1.

Japanese Patent Laid-Open No. 10-187022

  However, the conventional technology as described above is not limited to performance evaluation of an electronic musical instrument that can be connected to an electronic control device, and requires a dedicated device having an interface for connecting the electronic musical instrument. There was an adverse effect that became complicated. In addition, as a conventional method for evaluating the performance of a musical instrument or the like, there is a technique for evaluating the performance sound by comparing the performance sound input from the microphone with a predetermined evaluation standard. As described above, it has been difficult to achieve performance evaluation of a musical instrument that is played by mixing a plurality of performance sounds corresponding to a single performance operation. For this reason, there has been a demand for the development of a plucked instrument performance evaluation apparatus that realizes accurate performance evaluation with a simple configuration.

  The present invention has been made against the background of the above circumstances, and an object of the present invention is to provide a plucked string instrument performance evaluation apparatus that realizes accurate performance evaluation with a simple configuration.

  In order to achieve such an object, the gist of the present invention is a plucked string instrument performance evaluation device for evaluating the performance of a plucked string instrument that plays a performance sound by continuously scratching a plurality of strings, By comparing a microphone that converts an input sound into an electric signal, a performance sound of the plucked instrument converted into an electric signal by the microphone, and a predetermined evaluation standard, the plurality of strings are set to 1 Discrete evaluation means for performing a plurality of discrete evaluations at predetermined time intervals for each unit striking a stroke, and a performance for evaluating a unit performance corresponding to the discrete evaluation based on a plurality of discrete evaluations by the discrete evaluation means An evaluation means is provided.

  In this way, by comparing the microphone that converts the input sound into an electric signal, the performance sound of the plucked instrument converted into the electric signal by the microphone, and a predetermined evaluation criterion, Corresponding to the discrete evaluation based on the discrete evaluation means for performing a plurality of discrete evaluations at a predetermined time interval for each unit percussion for stroking a plurality of strings, and based on the plurality of discrete evaluations by the discrete evaluation means Since it is equipped with performance evaluation means for evaluating unit performances, a simple configuration such as collecting the performance sound of a musical instrument with a general microphone, a plurality of points corresponding to performance performance for one stroke. By performing the discrete evaluation, it is possible to suitably evaluate the performance of a plucked string instrument that is played by mixing a plurality of performance sounds in the performance of one stroke.That is, it is possible to provide a plucked string instrument performance evaluation apparatus that realizes accurate performance evaluation with a simple configuration.

  Here, preferably, unit time determination means for determining a time corresponding to a unit performance based on a performance sound corresponding to the unit performance for stroking the plurality of strings for one stroke from a predetermined relationship. The discrete evaluation means determines a time interval and / or the number of evaluations related to the discrete evaluation corresponding to the unit performance based on the time corresponding to the unit performance determined by the unit time determination means. is there. In this way, the performance for one stroke can be more accurately evaluated by performing a discrete evaluation of a plurality of points in consideration of the stroke time corresponding to the performance operation for one stroke.

  Further, preferably, based on a performance sound corresponding to a unit performance for stroking the plurality of strings for one stroke, a playing direction of the plurality of strings related to the unit performance is determined from a predetermined relationship. It comprises a playing direction determination means, and the discrete evaluation means and the performance evaluation means perform the discrete evaluation and performance evaluation based on the playing directions of the plurality of strings determined by the playing direction determination means. In this way, the performance of the subject plucked string instrument can be more accurately evaluated by performing discrete evaluation and performance evaluation in consideration of the stroke direction corresponding to the performance operation for one stroke.

  Preferably, a stable time point detecting means for detecting a time point at which the performance sound is stabilized based on a performance sound corresponding to a unit performance for stroking the plurality of strings for one stroke from a predetermined relationship is provided. The performance evaluation means adopts a discrete evaluation around the time when the performance sound detected by the stable time detection means is stable among the plurality of discrete evaluations by the discrete evaluation means as the evaluation related to the unit performance. It is. In this way, the performance of the target plucked string instrument can be more accurately evaluated by adopting discrete evaluation when the performance sound corresponding to the performance operation for one stroke is stabilized to some extent.

  Also preferably, the performance of a guitar having six strings as the plucked string instrument is evaluated. In this way, it is possible to provide a plucked string instrument performance evaluation apparatus that accurately evaluates the performance of a guitar, which is a popular plucked string instrument, with a simple configuration.

  Preferably, the performance of a bass guitar provided with four strings as the plucked string instrument is evaluated. In this way, it is possible to provide a plucked instrument performance evaluation apparatus that accurately evaluates the performance of a bass guitar, which is a popular plucked string instrument, with a simple configuration.

  Preferably, the plucked string instrument performance evaluation device outputs a predetermined performance tune selected from a large number of performance tunes and outputs a lyric character image of the performance tune along with the output of the performance tune. This is provided in a karaoke apparatus that displays a performance video including the performance video. If it does in this way, the performance of a plucked string instrument can be practiced in a simple and practical aspect using the karaoke apparatus generally installed in the karaoke box etc. with which the soundproofing equipment was adjusted.

BRIEF DESCRIPTION OF THE DRAWINGS It is the schematic explaining the karaoke system provided with the karaoke apparatus with which the plucked string musical instrument performance evaluation apparatus of this invention is applied suitably. It is a block diagram which illustrates the structure of the karaoke apparatus with which the karaoke system of FIG. 1 was equipped. It is a functional block diagram explaining the principal part of the control function with which CPU of the karaoke apparatus of FIG. 2 as a plucked instrument performance evaluation apparatus which is one Example of this invention was equipped. It is a figure explaining the determination of the stroke timing by the plucked string musical instrument performance evaluation apparatus of FIG. It is a figure explaining the determination of the stroke time by the plucked string musical instrument performance evaluation apparatus of FIG. 3, and has shown the state in which the sound generate | occur | produced at three time points, when the window length is 0.15 second. It is a figure explaining the judgment at the time of the performance sound stabilized by the plucked string instrument performance evaluation apparatus of FIG. 3, and is a figure which shows a mode that the spectrum corresponding to a performance sound disappears. It is a figure which illustrates the performance evaluation result commentary image | video displayed on a video display apparatus corresponding to the evaluation result by the plucked string musical instrument performance evaluation apparatus of FIG. It is a figure which illustrates the performance music recommendation image | video displayed on an image | video display apparatus corresponding to the evaluation result by the plucked string musical instrument performance evaluation apparatus of FIG. It is a flowchart explaining the principal part of the guitar performance evaluation control by CPU of the karaoke apparatus of FIG. 2 as a plucked instrument performance evaluation apparatus which is one Example of this invention.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a schematic diagram illustrating a karaoke system 10 including a karaoke apparatus 16 to which the plucked string instrument performance evaluation apparatus of the present invention is preferably applied. As shown in FIG. 1, in the karaoke system 10, a plurality of private rooms 14 a, 14 b, 14 c,... In a store 12 such as a karaoke box, a snack, an inn, etc. Karaoke devices 16a, 16b, 16c,... (Hereinafter simply referred to as karaoke device 16 unless otherwise specified). ing. The plurality of karaoke devices 16 are connected to a communication line 18 such as a public telephone line via a router 28, and are connected to a server device (center device) 20 of a karaoke service providing company connected to the communication line 18. Information can be communicated between each other via the communication line 18. The server device 20 is a server that performs basic control of storage and input / output management of digital contents (Digital Contents) such as karaoke information (music data), background video information, and information between songs. The content is regularly distributed to the karaoke device 16 via the karaoke device 16 and a predetermined function control program is transmitted in response to a request from the karaoke device 16. The karaoke system 10 includes a plurality of electronic quick sample devices 22a, 22b, 22c,... (Hereinafter simply referred to as the electronic quick sample device 22 unless otherwise distinguished). 1 to several electronic quick sample devices 22 are lent for each user (group) and are used as remote control devices for the karaoke device 16 in each private room 14 as will be described later. ing. A LAN 24 for connecting the plurality of karaoke apparatuses 16 to each other is laid in the store 12, and an input to the karaoke apparatus 16 from the electronic quick sample apparatus 22 is made via a predetermined access point 26 and the LAN 24. This is performed by LAN communication or the like.

  FIG. 2 is a block diagram illustrating the configuration of the karaoke apparatus 16. As shown in FIG. 2, the karaoke device 16 includes a video display device 30 such as a CRT (Cathode-ray Tube) or a TFT (Thin Film Transistor Liquid Crystal), a video output control unit 32 such as a CRT controller, and a video. An information decoder 34, a video mixer 36, a synthesizer 38 as a sound source, a microphone 40 as an audio input device, an A / D converter 41 for converting audio input from the microphone 40 into a digital signal, and an amplifier mixer 42, a speaker 44, an operation panel 46, an input / output interface 48 that processes input signals from the operation panel 46, a CPU 50 that is a central processing unit, a ROM 52 that is a read-only memory, and an occasional write A RAM 54 as a read memory, a hard disk 56 as a storage device, a modem 58, The AN port 60 is configured and remote control receiver 62 for receiving a remote control signal from the input device such as the electronic Hayami the device 22 or the remote control device 64, provided with. Further, the karaoke apparatus 16 is provided with various control functions described later with reference to FIG. 3 in the CPU 50, so that the performance of the plucked string instrument such as the guitar 66 is evaluated. It serves as an example.

  The video output control unit 32 functions as a character video output device that outputs a character video (telop) such as a lyric character video generated by the CPU 50, and also displays for controlling various video displays by the video display device 30. It is a control device. The video information decoder 34 is a background video playback device that plays back (decodes) a predetermined background video based on background video information stored in the hard disk 56 when a user sings a song while referring to lyrics. is there. The background video information is, for example, MPEG (Moving Picture Experts Group) format data, and the background video reproduced by the video information decoder 34 based on the MPEG data is sent to the video mixer. The video mixer 36 combines the character video generated by the CPU 50 and output from the video output control unit 32 with the background video reproduced by the video information decoder 34 to the video display device 30. This is a video composition device to be displayed.

  The synthesizer 38 is a sound source that generates a music signal such as a musical instrument performance signal based on performance information of a karaoke performance song read from the hard disk 56 and sent. The performance information is, for example, data in MIDI (Musical Instrument Digital Interface) format, and the music signal generated by the synthesizer 38 based on the MIDI data is converted into an analog signal and sent to the amplifier mixer 42. The microphone 40 is an electroacoustic converter that converts input sound into an electric signal. In the amplifier mixer 42, a music signal that is sent and a user's singing voice that is input via the microphone 40 are provided. Are mixed, and these signals are electrically amplified and output from the speaker 44. Also, the sound (sound information) input through the microphone 40 and converted into an electric signal is converted into a digital signal through the A / D converter 41 and is used for performance evaluation control described later. The data is supplied to the CPU 50, the RAM 54, and the like. During performance evaluation control of the guitar 66, the performance sound of the guitar 66 that is input from the microphone 40 and converted into a digital signal via the A / D converter 41 is stored in the RAM 54 and the like, which will be described later. It is appropriately read and used for various controls related to performance evaluation control.

  The operation panel 46 allows the user of the karaoke apparatus 16 to select a karaoke performance song that the user wants to sing, adjust the pitch of the performance song, adjust the volume balance between the performance and the song, and perform echo and volume. , An input device provided with operation buttons (switches) or knobs for performing various adjustments such as tone. Further, the karaoke device 16 is provided with a remote control device 64 that functions as an input device for remotely executing a part of the function of the operation panel 46, and the remote control receiving unit 62 is connected to the remote control device 64 from the remote control device 64. A remote control signal to be transmitted is received and supplied to the CPU 50. In addition, the association (sticking) processing between the karaoke device 16 and the electronic quick sample device 22 is also performed via the remote control receiving unit 62, and thus the electronic quick sample device associated with the karaoke device 16. 22 also functions as an input device.

  The CPU 50 is a so-called microcomputer that processes and controls electronic information based on a predetermined program stored in advance in the ROM 52 using the temporary storage function of the RAM 54, and the electronic quick sample device 22 and the remote control device 64. When a predetermined karaoke performance song is selected by the above or the like, the selected karaoke performance song is registered in the reserved song table provided in the RAM 54, or from the hard disk 56 to the RAM 54 according to the performance order of the reserved song table. The performance information and lyrics information etc. of the selected karaoke performance song are read out, the performance information is transmitted from the RAM 54 to the synthesizer 38 as the performance of the karaoke performance song progresses, and the lyric characters are based on the lyrics information. Generate a video and send it to the video output control unit 32. A new character information is generated while a name character image is generated and sent to the image output control unit 32, a predetermined background image is reproduced by controlling the image information decoder 34, that is, during a karaoke performance, that is, between songs. In addition to basic control such as information selection control, information communication control with the server device 20 via the communication line 18, such as music selection ranking, store advertisement, etc., performance evaluation control to be described later Various controls related to the control are executed.

  The modem 58 is a device for connecting the karaoke device 16 to a communication line 18 such as a public telephone line, converts a digital signal output from the CPU 50 into an analog signal and sends it to the communication line 18. The analog signal transmitted via the communication line 18 is converted into a digital signal and supplied to the CPU 50. In addition, the aspect by which any karaoke apparatus 16 is equipped with the function of the said router 28 among the several karaoke apparatuses 16 with which the said store 12 was equipped, and is connected to the said communication line 18 as a master commander is also considered, In that case, The modem 58 is required for the karaoke device 16 that functions as the master commander, but is not necessarily provided for other karaoke devices 16 that communicate information with the server device 20 via the master commander. Not necessary.

  The LAN port 60 is a connector for connecting the karaoke device 16 to other devices such as the other karaoke device 16 and the electronic quick sample device 22 via the LAN 24, and the karaoke device 16 is used as such. By being connected via the LAN 24, information can be transmitted / received to / from other devices such as the other karaoke apparatus 16 and the electronic quick sample apparatus 22. For example, the music selection input from the electronic quick sample device 22 received through the access point 26 is received and stored in a reserved music table provided in the RAM 54, or the karaoke device 16 through the access point 26. Thus, mutual exchange of information between the karaoke device 16 and the electronic quick sample device 22 is performed via radio waves, such as transmitting predetermined information to the electronic quick sample device 22.

  As shown in FIG. 3, the hard disk 56 has a karaoke database 68 for storing a large number of karaoke data (music data) for outputting karaoke performance music and a code database 70 for storing various information relating to chords of plucked instruments. Various databases such as the beginning are provided. Among a plurality of karaoke devices 16 provided in a store such as a karaoke box, a predetermined karaoke device 16 such as the karaoke device 16a is connected to the communication line 18 via the modem 58, and the plurality of karaoke devices. 16, new music data, information on chords, etc. are distributed from the server device 20 via the communication line 18 at any time so that new music can always be played by the karaoke 16 and the karaoke database 68 to chord database of the hard disk 56. 70 and so on. In addition, communication is performed via the LAN 24 between the karaoke device 16 a that has acquired information from the server device 20 and the other karaoke devices 16, and is stored in the hard disk 56 of each karaoke device 16. Information is shared, and the contents of the karaoke database 68 to the code database 70 are equivalent.

  In the karaoke database 68, karaoke information identified by a music selection number unique to each musical piece that is a content ID is stored for each musical piece. This karaoke information includes header information such as a song name, singer name, announcement time, and genre, performance information for generating a performance sound, and lyrics information for generating a lyric character image (lyric telop). The performance information is, for example, MIDI data for outputting a predetermined performance sound by the synthesizer 38, and includes the type of performance sound (instrument) related to the output and score information corresponding to each performance sound. . That is, with respect to a performance song (karaoke data) including the performance sound of the guitar 66 that is a plucked string instrument, the guitar chord corresponding to the performance sound of the guitar 66 and its output timing (each chord at which timing as the performance performance of the performance music progresses). Should be output). The lyric information is data for outputting a lyric character video of a performance tune through the video output control unit 32 and the like, and is combined with the text information of the lyric corresponding to the lyric character video and the performance output. Switch timing information for switching the display of the lyrics character image and color change timing information for sequentially changing the color of the lyrics character image in parallel with the performance output.

  In the chord database 70, for example, various kinds of information relating to chords (guitar chords) of the guitar 66 are stored. The chord is, for example, a performance sound (chord) in which the six strings included in the guitar 66 are played when the guitar 66 is played and the sounds played are overlapped. Is determined by how to hold the string (how to hold the string with the finger on the opposite side of the hand against the string). That is, in the guitar 66, the performer presses the six strings (not necessarily pressing all six) with the fingers of one hand, and holds the six strings in a predetermined direction with the other hand. By choking continuously (at once), a chord corresponding to a predetermined chord is played as a performance sound for one stroke. In other words, the same performance sound (chord) can be played by performing the same performance on the guitar 66. In the chord database 70, the audio information corresponding to the performance sound that is played when the performance corresponding to each chord (guitar chord) is performed on the guitar 66 is preferably general as described in detail below. A frequency analysis result (obtained experimentally in advance) obtained by performing a fast Fourier transform or a calculation of a chroma vector is stored for each code.

FIG. 3 is a functional block diagram for explaining a main part of the control function provided in the CPU 50 of the karaoke apparatus 16 as the plucked instrument performance evaluation apparatus of the present embodiment. The performance sound analyzing means 72 shown in FIG. 3 analyzes the performance sound (audio information) of the guitar 66 which is converted into an electric signal by the microphone 40 and converted into a digital signal by the A / D converter 41. For example, (a) audio information supplied from the A / D converter 41 is expanded into frequency components by fast Fourier transformation (FFT), and (b) the expanded frequency components are converted into the following (1). (C) A predetermined comb filter as shown in the equation (a filter that allows the center frequency of each scale to pass through) is separated to some degree, and (c) each scale is added over several octaves to satisfy the following (2) Obtain a chroma vector as a frequency analysis result as shown in the equation. Note that P _{c, o} related to the comb filter indicates the power when the scale is c and the octave is o, and the comb filter is applied to each sound. The technology related to the frequency analysis and chord estimation of such guitar playing sound is described in “Konogi Yasutoshi, Emura Hakuo, Miura Masafumi,” Chord estimation system using chroma information and chord progression database (Chord estimation system using chromatic profiles and chord progression databese) "Information Processing Society of Japan Research Report. [Music Information Science] IPSJ SIG Notes 2008 (89) pp.53-58 20080915 Information Processing Society of Japan.

  The stroke analysis means 74 analyzes a performance sound corresponding to a unit performance for stroking the six strings provided on the guitar 66 for one stroke. In order to perform such an analysis, a timing determination unit 76, a unit time determination unit 78, and a playing direction determination unit 80 are included. In the case of a plucked musical instrument that performs by continuously scratching a plurality of strings, such as the guitar 66, when the unit performance is performed by stroking one stroke, each of the plurality of strings is played. In addition to being strictly different, a previously played string sound remains, so it is difficult to determine the stroke timing, stroke time, stroke direction, and the like depending on the presence or absence of voice input. For this reason, the stroke analysis means 74 corresponds to a unit performance in which the six strings provided in the guitar 66 are stroked by one stroke by the timing determination means 76, the unit time determination means 78, and the performance direction determination means 80. The stroke timing, stroke time, and stroke direction corresponding to the performance sound are determined. Hereinafter, control by each control means will be described.

  Based on a performance sound corresponding to a unit performance for stroking the six strings provided on the guitar 66 for one stroke, the timing determination means 76 outputs an output timing (stroke) corresponding to the unit performance based on a predetermined relationship. Timing), ie, what time is played. FIG. 4 is a diagram for explaining the determination of the stroke timing by the timing determination means 76, and the vertical axis represents the sound pressure as a 16-bit integer. As shown in FIG. 4, in the waveform obtained as a result of the unit performance of stroking the six strings provided on the guitar 66 for one stroke, the time point t1 at which the sound begins is momentarily strengthened, and thereafter quickly. (For example, a curve approximating exp (−ct) is drawn as shown in FIG. 4). Utilizing this relationship, the timing determination means 76 preferably has a waveform corresponding to the input sound for a performance sound corresponding to a unit performance for stroking the six strings provided in the guitar 66 for one stroke. As shown in FIG. 4, the instant t <b> 1 that increases instantaneously is determined as the output timing (stroke timing) of the unit bullet.

  The unit time determination means 78 has a predetermined relationship, and thus a unit performance for stroking the six strings provided in the guitar 66 for one stroke (even if there is a string that does not necessarily stir all strings and does not play). The time (stroke time) corresponding to the unit performance is determined based on the performance sound corresponding to “good”. FIG. 5 is a diagram for explaining the determination of the stroke time by the unit time determination means 78, and shows a state in which sound is generated at three time points when the window length is 0.15 seconds. When speech information is expanded into frequency components by fast Fourier transform, it is not always possible to accurately obtain information such as time change and scale due to the problem of the uncertainty principle. Although it is difficult to obtain the output timing of the sound corresponding to each string, if the occurrence of two or more musical scales can be detected by obtaining the above-described chroma vector corresponding to the unit performance, the two or more The stroke time corresponding to the unit performance, that is, the time required for one stroke of the six strings provided in the guitar 66 can be roughly determined from the interval at which the scale occurs. In the present embodiment, preferably, the correspondence relationship between the interval between the occurrence times of two or more musical scales included in a unit performance and the stroke time related to the unit performance is stored in the hard disk 56 or the like. Utilizing the unit time determination means 78, with respect to a performance sound corresponding to a unit performance for stroking six strings provided in the guitar 66, two or more scales included in the performance sound are generated. The stroke time is determined based on the time interval (time interval). That is, the value as a value proportional to the interval between the occurrence times of two or more scales, such as a relatively fast stroke when the interval between occurrences of the scale is small and a relatively slow stroke when the interval is large. Calculate the stroke time.

  Based on a predetermined relationship, the playing direction determination means 80, based on the performance sound corresponding to the unit performance that stirs the six strings provided on the guitar 66 for one stroke, the six performances related to the unit performance. Determine the direction of the string. As described above with reference to FIG. 5, when the occurrence of two or more scales corresponding to the unit performance can be detected, the performance corresponding to the unit performance is the down stroke from the scale and the order of generation of each scale. Determine whether it is due to (a performance in which the performer scratches the string in the direction of swinging his hand) or an upstroke (a performance in which the performer scratches the string in the direction of swinging his hand) Can do. In the present embodiment, preferably, a correspondence relationship between two or more scales included in a unit play or the order of occurrence thereof and the stroke direction related to the unit play is stored in the hard disk 56 or the like. Then, the playing direction determination means 80 has two or more scales included in the performance sound and the generation of the performance sound corresponding to the unit performance for stroking the six strings provided in the guitar 66 for one stroke. Based on the order, the direction of playing the unit bullet is determined.

  Returning to FIG. 3, the stable time point detection means 82 has the performance sound based on the performance sound corresponding to the unit performance of stroking the six strings provided in the guitar 66 for one stroke from a predetermined relationship. Detects when is stable. FIG. 6 is a diagram for explaining determination of the time point when the performance sound is stabilized by the stable time point detection means 82, and shows how the spectrum corresponding to the performance sound disappears. As shown in FIG. 6, it can be seen that even when the performance sound is almost stable, the sound disappears quietly, and it is generally known that a relatively sharp spectrum can be obtained when the sound is stable. ing. In the present embodiment, preferably, information for determining whether or not the spectrum related to the performance sound corresponding to the unit performance has reached a predetermined stable state is stored. The stable time point detection means 82 is in a state where the frequency analysis result of the performance sound corresponding to the unit performance for stroking the six strings provided in the guitar 66 is predetermined sharp (each component is clearly separated) Is detected as the time when the performance sound is stabilized.

  Returning to FIG. 3, the discrete evaluation means 84 converts the performance sound of the guitar 66 converted into an electric signal by the microphone 40 and converted into a digital signal by the A / D converter 41, and a predetermined evaluation criterion. And a plurality of discrete evaluations are performed at a predetermined time interval for each unit performance in which the six strings in the guitar 66 are stroked for one stroke. Here, the discrete evaluation means 84 of the present embodiment performs such discrete evaluation using the information stored in the code database 70 as the evaluation criterion. That is, with respect to the performance sound corresponding to the unit performance for stroking six strings on the guitar 66 for one stroke, the performance sound analyzing means 72 performs a plurality of times (for example, 10 times) at a predetermined time interval (for example, every 0.1 second). ), And the frequency analysis result at each point is compared with the correspondence relationship between each code stored in the code database 70 and the frequency analysis result, thereby corresponding to the frequency analysis result at each point. Determine the code to be used. In other words, the output time of the performance sound corresponding to the unit performance of stroking the six strings in the guitar 66 determined by the timing determination means 76 is used as a starting point, and the duration of the performance sound is equally divided. At a plurality of times, the frequency analysis and the code corresponding to the frequency analysis result are determined.

  As described above, in the performance by the plucked string instrument such as the guitar 66, since the performance sound is produced by continuously scratching a plurality of strings, the first string for the unit performance corresponding to one stroke is used. A certain time interval inevitably occurs between the time of playing and the time of playing the last string. For this reason, at the moment you play the first string, the sound corresponding to the last string is not output, and at the moment you play the last string, the sound corresponding to the first string begins to decay It is conceivable that an accurate chord cannot be determined by determining only one point for the unit performance. Therefore, in the plucked string instrument performance evaluation apparatus of the present embodiment, the discrete evaluation means 84 performs a discrete evaluation a plurality of times at a predetermined time interval for each unit percussion of stroking six strings in the guitar 66 for one stroke. The determination of the chord corresponding to the unit bullet can be made as accurate as possible.

  The performance evaluation unit 86 evaluates a unit performance corresponding to the discrete evaluation based on a plurality of discrete evaluations by the discrete evaluation unit 84. For example, when outputting a karaoke performance related to predetermined karaoke data stored in the karaoke database 68, the code having the highest number of determinations among the codes obtained as a result of a plurality of discrete evaluations by the discrete evaluation means 84 is The chord corresponding to the unit performance related to the discrete evaluation is determined, the code corresponding to the unit performance determined as described above, the output timing of the unit performance determined by the timing determination means 76, and the karaoke related to the output By comparing the guitar chord defined in the performance karaoke data (MIDI data) and its output timing, the unit performance related to the performance of the guitar 66 accompanying the karaoke performance is evaluated. That is, the performance of the guitar 66 is determined based on whether or not the unit performance by the guitar 66 matches the guitar chord defined in the MIDI data of the karaoke performance song related to the output, and the deviation of the output timing. evaluate.

  Here, preferably, the discrete evaluation means 84 is based on the time (stroke time) corresponding to the unit performance determined by the unit time determination means 78, and the time related to the discrete evaluation corresponding to the unit performance. Determine the interval and / or the number of evaluations. For example, when the time corresponding to the unit performance determined by the unit time determination unit 78 is relatively long, the time interval related to the discrete evaluation corresponding to the unit performance is increased and / or the number of evaluations is increased. On the other hand, when the time corresponding to the unit performance is relatively short, the unit time determination means 78 is such that the time interval related to the discrete evaluation corresponding to the unit performance is shortened and / or the number of evaluations is reduced. The time interval and / or the number of evaluations related to the discrete evaluation are changed according to the time corresponding to the unit performance determined by the above. In the present embodiment, preferably, the correspondence relationship between the time corresponding to the unit performance and the time interval and / or the number of evaluations related to the discrete evaluation is stored in the hard disk 56 or the like, and the discrete evaluation means 84 Such control is performed based on the time corresponding to the unit performance determined by the unit time determination means 78 from the relationship.

  Preferably, the discrete evaluation means 84 and the performance evaluation means 86 perform the discrete evaluation and performance evaluation based on the playing directions of the six strings determined by the playing direction determination means 80. For example, the discrete evaluation means 84 is determined by the percussion direction determination means 80 for the unit performance in the discrete evaluation related to the performance sound corresponding to the unit performance for stroking six strings in the guitar 66 for one stroke. Based on the playing directions of the six strings, the chord determination for each discrete evaluation is performed. The performance evaluation unit 86 compares the discrete evaluation results obtained by the discrete evaluation unit 84 related to the unit performance with the playing directions of the six strings determined by the playing direction determination unit 80. Then, it is determined whether or not the code corresponding to the discrete evaluation result is appropriate as the evaluation result.

  Preferably, the performance evaluation means 86 performs a discrete evaluation around the time when the performance sound detected by the stable time detection means 82 among the plurality of discrete evaluations by the discrete evaluation means 84 is stable. Adopted as an evaluation for playing the bullet. That is, when the discrete evaluation means 84 performs a plurality of discrete evaluations corresponding to the unit performance and a plurality of chords are determined as the discrete evaluation results, the stable time point detection means corresponds to the unit performance. A discrete evaluation around the time point when the performance sound detected by 82 is stable (for example, within a predetermined time before and after the stable time point) is adopted as the evaluation (code) related to the unit performance, and the performance evaluation related to the unit performance I do.

  Returning to FIG. 3, the evaluation result display means 88 causes the video display device 30 to display the video related to the evaluation result by the performance evaluation means 86 via the video output control unit 32 or the like. FIG. 7 is a diagram illustrating a performance evaluation result commentary video 90 displayed on the video display device 30 corresponding to the evaluation result by the performance evaluation means 86. As shown in FIG. 7, the evaluation result display means 88, for example, as a video related to the evaluation result by the performance evaluation means 86, for example, a correct chord related to the unit performance and a player who plays the unit performance in the unit performance. Compare the displayed code. Furthermore, the scale component of the chord that is the correct answer is compared with the scale component of the chord that is actually played (input via the microphone 40) to indicate which component is not being played well by showing the missing component. Teach (explain) the performer. For example, in the example shown in the performance evaluation result explanation video 90 in FIG. 7, the correct code is C, but the actually played code is Cm. In this case, the correct answer is CEG, but the performance is CD # G. Therefore, it is possible that the intention to play E was playing D #. In this way, by visually indicating such information obtained as an evaluation result by the performance evaluation means 86 by the evaluation result display means 88, it is possible to accurately teach the part that the player is not good at. . Note that the performance evaluation result commentary video 90 as shown in FIG. 7 may be displayed in synchronization with the karaoke performance to be evaluated, or the evaluation result at the time when the karaoke performance is completed. It may be displayed in association with timing or lyrics.

  FIG. 8 is a diagram illustrating a performance song recommendation video 92 displayed on the video display device 30 corresponding to the evaluation result by the performance evaluation means 86. As shown in FIG. 8, the evaluation result display means 88 uses, for example, a karaoke performance song containing a relatively large number of chords that are easily mistaken by the performer as a recommended performance song as an image related to the evaluation result by the performance evaluation means 86 Display. Further, as shown in FIG. 8, a direct music selection input button 94 for selecting and inputting the recommended performance music is displayed. The direct music selection input button 94 enables the music selection input of the recommended performance music by performing a predetermined operation with the cursor positioned on the remote control device 64 or the like, for example. For example, in the example shown in the performance song recommendation video 92 of FIG. 8, C, D, and A # are listed as codes that are determined to be easy to be mistaken by the performer as evaluation results, and more of these codes are included. As a recommended performance song including "Huangyan Curtain Call" is recommended. In this way, by showing the recommended performance music based on the information obtained as an evaluation result by the performance evaluation means 86 by the evaluation result display means 88, a performance music suitable for special training of the parts that the player is not good at is shown. It can be taught accurately.

  FIG. 9 is a flowchart for explaining a main part of the guitar performance evaluation control by the CPU 50 of the karaoke apparatus 16 as the plucked string instrument performance evaluation apparatus of this embodiment, which is repeatedly executed at a predetermined cycle.

  First, in step (hereinafter, step is omitted) S1, it is determined whether or not performance evaluation control of the guitar 66 for a predetermined karaoke performance piece is started. If the determination in S1 is negative, the routine is terminated accordingly. If the determination in S1 is affirmative, in S2, karaoke data corresponding to the target karaoke performance song is the karaoke data. The output of the karaoke performance read out from the database 68 and corresponding to the karaoke data is started. Next, in S3, it is determined whether or not audio information corresponding to the performance sound of the guitar 66 has been input from the microphone 40. If the determination in S3 is negative, the processing from S10 is executed, but if the determination in S3 is affirmative, in S4 corresponding to the operation of the timing determination unit 76, the microphone 40 Based on the performance sound corresponding to the input unit bullet, the stroke timing corresponding to the unit bullet is determined. Next, in S5 corresponding to the operation of the playing direction determination means 80, the stroke direction related to the unit performance is determined based on the performance sound corresponding to the unit performance input from the microphone 40. Next, in S6 corresponding to the operation of the unit time determination means 78, the stroke time related to the unit performance is determined based on the performance sound corresponding to the unit performance input from the microphone 40. Next, in S7 corresponding to the operation of the stable time point detection means 82, the time point at which the performance sound is stabilized is detected (determined) based on the performance sound corresponding to the unit performance input from the microphone 40. Next, in S8 corresponding to the operation of the discrete evaluation means 84, the microphone 40 is based on the stroke timing determined in S4, the stroke direction determined in S5, the stroke time determined in S6, and the like. Discrete evaluation is performed a plurality of times at predetermined time intervals with respect to the performance sound corresponding to the unit bullet input from. Next, in S9 corresponding to the operation of the performance evaluation means 86, based on the stroke timing determined in S4, the stroke direction determined in S5, and the time when the performance sound detected in S7 is stabilized. , A chord related to a unit performance corresponding to a plurality of discrete evaluations in S8 is determined, and the unit performance is evaluated in comparison with a karaoke performance piece (MIDI data) related to output. Next, in S10, it is determined whether or not the performance of the target karaoke performance song has been completed. If the determination in S10 is negative, the processes in and after S3 are executed again. However, if the determination in S10 is affirmative, comprehensive evaluation is performed throughout the target karaoke performance piece in S11. Is called. Next, in S12 corresponding to the operation of the evaluation result display means 88, the performance evaluation result commentary video 90 shown in FIG. 7, the performance song recommendation video 92 shown in FIG. After being displayed on the video display device 30, this routine is terminated.

  Thus, according to the present embodiment, the microphone 40 that converts the input sound into an electric signal, the performance sound of the plucked instrument converted into the electric signal by the microphone 40, and a predetermined evaluation criterion are used. By comparing, the discrete evaluation means 84 (S8) that performs a plurality of discrete evaluations at a predetermined time interval for each unit percussion for stroking the plurality of strings for one stroke, and the discrete evaluation means 84 performs a plurality of discrete times. Since the performance evaluation means 86 (S9) for evaluating the unit performance corresponding to the discrete evaluation based on the evaluation is provided, it is easy to collect the performance sound of the musical instrument with the general microphone 40. By performing a discrete evaluation of a plurality of points corresponding to a performance operation for one stroke, a plurality of performance sounds are mixed and played in that one stroke performance. The playing of plucked string instrument that is can be suitably evaluated. That is, it is possible to provide a plucked string instrument performance evaluation apparatus that realizes accurate performance evaluation with a simple configuration.

  Further, based on a predetermined relationship, unit time determination means 78 (S6) is provided for determining a time corresponding to a unit performance based on a performance sound corresponding to the unit performance that stirs the plurality of strings for one stroke. The discrete evaluation means 84 determines the time interval and / or the number of evaluations related to the discrete evaluation corresponding to the unit performance based on the time corresponding to the unit performance determined by the unit time determination means 78. Therefore, the performance for one stroke can be more accurately evaluated by performing a discrete evaluation of a plurality of points in consideration of the stroke time corresponding to the performance operation for one stroke.

  Further, based on a predetermined relationship, based on a performance sound corresponding to a unit performance for stroking the plurality of strings for one stroke, a playing direction determination means for determining a playing direction of the plurality of strings related to the unit performance. 80 (S5), and the discrete evaluation means 84 and performance evaluation means 86 perform the discrete evaluation and performance evaluation based on the playing directions of the plurality of strings determined by the playing direction determination means 80. Therefore, by performing discrete evaluation and performance evaluation in consideration of the stroke direction corresponding to the performance operation for one stroke, it is possible to more accurately evaluate the performance of the target plucked instrument.

  Further, based on a predetermined relationship, stable time point detection means 82 (S7) is provided for detecting a time point when the performance sound is stabilized based on the performance sound corresponding to the unit performance for stroking the plurality of strings for one stroke. The performance evaluation means 86 determines a discrete evaluation around the time when the performance sound detected by the stable time detection means 82 among the plurality of discrete evaluations by the discrete evaluation means 84 is stabilized as the evaluation related to the unit performance. Therefore, the performance of the target plucked string instrument can be more accurately evaluated by adopting the discrete evaluation when the performance sound corresponding to the performance operation for one stroke is stabilized to some extent.

  Moreover, since the performance of the guitar 66 having six strings as the plucked string instrument is evaluated, the plucked string instrument performance evaluation apparatus accurately evaluates the performance of the guitar 66, which is a popular plucked string instrument, with a simple configuration. Can be provided.

  The plucked string instrument performance evaluation apparatus outputs a predetermined performance song selected from a large number of performance songs, and outputs a performance image including a lyric character image of the performance song along with the output of the performance song. Since the karaoke device 16 to be displayed is functionally provided, the karaoke device 16 generally installed in a karaoke box or the like with soundproofing equipment is used to play a plucked string instrument in a simple and practical manner. I can practice.

  The preferred embodiments of the present invention have been described in detail with reference to the drawings. However, the present invention is not limited to these embodiments, and may be implemented in other modes.

  For example, in the above-described embodiment, the karaoke apparatus 16 as a plucked string instrument performance evaluation apparatus evaluates the performance of the guitar 66 having six strings as the plucked string instrument. For example, the performance of a bass guitar having four strings as the plucked string instrument can be suitably evaluated. In this case, the chord database 70 stores various information related to the bass guitar chords. In addition, the present invention can be widely applied to performance evaluation of plucked musical instruments that play performance sounds by continuously scratching a plurality of strings such as ukulele, mandolin, balalaika, shamisen, cocoon, and sanshin.

  Further, in the above-described embodiment, the example in which the plucked string instrument performance evaluation apparatus according to the embodiment of the present invention is functionally provided in the karaoke apparatus 16 has been described. However, the present invention is not necessarily applied to the karaoke apparatus 16. Needless to say, it can naturally be established as a single plucked string instrument performance evaluation device. In this case, as the data corresponding to the karaoke data (MIDI data) in the above-described embodiment, information for determining at which timing each chord should be output with the progress of the performance of the performance music is evaluated by the performance evaluation means 86. As a reference, it is stored in a predetermined storage device provided in the plucked instrument performance evaluation apparatus.

  Further, in the above-described embodiment, the evaluation result display means 88 displays the video as shown in FIGS. 7 to 8 related to the evaluation result by the performance evaluation means 86 via the video output control unit 32 or the like. Although displayed on the device 30, a similar image may be displayed on the touch panel display of the electronic quick sample device 22.

  Further, although not particularly mentioned in the above-described embodiment, for example, when evaluating the performance of an electric guitar, various measures are taken regarding the embodiment, such as playing the electric guitar connected to the amplifier mixer 42 of the karaoke device 16. It goes without saying that it should be done.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

16: Karaoke device (plucked string instrument performance evaluation device)
40: Microphone 66: Guitar (plucked string instrument)
78: Unit time determination means 80: Playing direction determination means 82: Stable time detection means 84: Discrete evaluation means 86: Performance evaluation means

Claims (7)

A plucked string instrument performance evaluation device for evaluating the performance of a plucked string instrument that plays a performance sound by continuously stroking multiple strings,
A microphone that converts the input sound into an electrical signal;
By comparing the performance sound of the plucked string instrument converted into an electric signal by the microphone with a predetermined evaluation standard, a plurality of unit sounds for stroking the plurality of strings at a predetermined time interval are compared with each other. Discrete evaluation means for performing discrete evaluation of times,
A plucked string instrument performance evaluation apparatus comprising: performance evaluation means for evaluating a unit performance corresponding to the discrete evaluation based on a plurality of discrete evaluations by the discrete evaluation means. A unit time determination means for determining a time corresponding to the unit performance based on a performance sound corresponding to the unit performance for stroking the plurality of strings for one stroke from a predetermined relationship;
The discrete evaluation means determines a time interval and / or the number of evaluations related to discrete evaluation corresponding to the unit performance based on a time corresponding to the unit performance determined by the unit time determination means. Item 2. The plucked string instrument performance evaluation apparatus according to Item 1. Based on a predetermined relationship, a playing direction determining means for determining the playing direction of the plurality of strings related to the unit playing based on a performance sound corresponding to the unit playing that strokes the plurality of strings for one stroke is provided. ,
The repellent evaluation according to claim 1 or 2, wherein the discrete evaluation means and the performance evaluation means perform the discrete evaluation and performance evaluation based on the playing directions of the plurality of strings determined by the playing direction determination means. Stringed instrument performance evaluation device. Based on a predetermined relationship, a stable time point detecting means for detecting a time point at which the performance sound is stabilized based on a performance sound corresponding to a unit performance for stroking the plurality of strings for one stroke,
The performance evaluation means employs a discrete evaluation near the time when the performance sound detected by the stable time detection means is stable among the multiple evaluations performed by the discrete evaluation means as the evaluation related to the unit performance. 4. A plucked string instrument performance evaluation apparatus according to claim 1, wherein:   5. The plucked instrument performance evaluation apparatus according to claim 1, wherein the performance of a guitar having six strings as the plucked string instrument is evaluated.   5. The plucked string musical instrument performance evaluation apparatus according to claim 1, wherein the performance of a bass guitar having four strings as the plucked string musical instrument is evaluated.   A karaoke apparatus for outputting a predetermined performance song selected from a large number of performance songs and displaying a performance image including a lyric character image of the performance song in parallel with the output of the performance song. The plucked string instrument performance evaluation apparatus according to any one of claims 1 to 6.

Images