JP2009047861A - Device and method for assisting performance, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device and a method for assisting a performance capable of effectively assisting the performance by providing accurate evaluation of a performance note during the performance, and a program. <P>SOLUTION: The device for assisting a performance includes a memory part 103 for recording code information of the codes included in a musical piece in relation to progress of the musical piece, a reproduction part 108 for reproducing the musical piece, a performance sound obtaining part 201 for obtaining a performance note of a predetermined musical instrument to be performed according to the musical piece reproduced by the reproduction part 108, a performance analysis part 202 for analyzing the performance sound obtained by the performance sound obtaining part 201 for calculating code information of the codes included in the performance sound, and an evaluation part 204 for evaluating the performance sound based on the approximation degree of the code information recorded in the memory part 103 and the code information calculated by the performance analysis part 202. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a performance support apparatus, a performance support method, and a program.

  Playing musical instruments from the past is one of the entertainment of people, and with the development of information processing technology in recent years, various performance support devices that support the performance of musical instruments have been developed. Such a performance support device is devised to display the musical instrument itself, display music data, and support musical instrument lessons (also called “practice”).

  Conventionally, for example, a music playback device using a timing counter described in Patent Document 1, a performance support device that displays lyrics and chords in accordance with the progress of a performance music described in Patent Document 2, and a microphone described in Patent Document 3 A device for extracting a musical sound by input and generating a musical sound extracted, a device for reproducing / displaying fingering data by motion capture described in Patent Document 4, and an actual performance data and model performance data described in Patent Document 5 Devices that perform comparison and calculate the match rate and difference are known.

JP 2002-169551 A JP 2001-154665 A JP 2000-200084 A JP 2000-3171 Japanese Patent Laid-Open No. 11-3028 JP-A-2005-274708

  These conventionally known performance support apparatuses can teach the performance of a musical instrument in accordance with the performance by displaying a score on the display device in accordance with the performance. However, a user who wants to practice playing a musical instrument (also referred to as a “performer”) cannot know whether or not the performance sound he / she has played is correct. There is a possibility of playing the instrument in the dark clouds even though there is not.

  Further, even if the performance sound is evaluated, an evaluation result with a poor evaluation accuracy and an incorrect evaluation may hinder the player's mastery of musical instruments and music performance. In addition, since beginners are included in the performers, even if a performance evaluation is generally made at the end of the performance, such beginners should improve the overall music from the overall evaluation. It is difficult to grasp.

  Accordingly, the present invention has been made in view of the above problems, and an object of the present invention is to provide a player with an accurate evaluation of performance sound during performance and effectively support performance. There is to do.

  In order to solve the above-described problem, according to one aspect of the present invention, a storage unit that records code information of a code included in a song in association with the progress of the song, a playback unit that plays back the song, and a playback unit A performance sound acquisition unit that acquires a performance sound of a predetermined musical instrument that is played in accordance with the music to be played back, and a performance sound acquired by the performance sound acquisition unit are analyzed, and chord information of a chord included in the performance sound is obtained. A performance analysis unit for calculating, and an evaluation unit for evaluating performance sound based on the degree of approximation between the chord information recorded in the storage unit and the chord information calculated by the performance analysis unit, A performance support apparatus is provided.

  According to this configuration, the performance sound acquired by the performance sound acquisition unit is analyzed by the performance analysis unit to calculate chord information. The evaluation unit can evaluate the performance sound based on the degree of approximation between the chord information of the performance sound and the chord information of the music recorded in the storage unit. Therefore, the performance sound can be evaluated by the chord information represented by the sound. And since it evaluates based on the degree of approximation of code information, the difference of different code information can also be evaluated.

  The performance analysis unit may calculate chord information of a chord included in the performance sound for a performance sound corresponding to a section in which the chord information recorded in the storage unit does not change. In the section where the chord information stored in the storage section does not change, it is highly possible that the chord information of the performance sound does not change. Therefore, according to such a configuration, by performing analysis in this section, it is possible to reduce the possibility of performing erroneous analysis due to changes in chord information of the performance sound.

  In addition, the performance analysis unit calculates a plurality of candidate codes to which the performance sound can correspond and a reliability representing the certainty with respect to the performance sound of each of the plurality of candidate codes, and the calculated plurality of candidate codes and reliability May be the chord information of the performance sound.

  Further, a predetermined music is analyzed using an analysis method used in the performance analysis unit, and a plurality of candidate codes to which the music can correspond and a reliability representing the certainty for each of the plurality of candidate codes. The music analysis unit may further include a music analysis unit that calculates and uses the calculated plurality of candidate codes and reliability as code information of the music, and the music analysis unit may record the calculated code information in the storage unit. According to this structure, a performance analysis part and a music analysis part analyze a performance sound or a music with the same analysis method. Therefore, the analysis accuracy of the performance sound chord information by the performance analysis section and the music analysis section chord information by the music analysis section can be made substantially equal.

  The evaluation unit may evaluate the performance sound based on the difference between the reliability of each candidate chord analyzed by the performance analysis unit and the reliability of each candidate chord analyzed by the music analysis unit.

  Moreover, you may further have an evaluation result display control part which performs the display control which displays the evaluation result by an evaluation part on a display part, while the music reproduction by a reproducing part is in progress.

  In order to solve the above-described problem, according to another aspect of the present invention, a playback start step for starting playback of a song, and a performance of a predetermined instrument played in accordance with the song played in the playback start step A performance sound acquisition step for acquiring sound, a performance analysis step for analyzing the performance sound acquired in the performance sound acquisition step, and calculating chord information of chords included in the performance sound, and the progress of the music A performance support comprising: an evaluation step for evaluating a performance sound based on a degree of approximation between chord information of a chord included in a song recorded in advance and the chord information calculated in the performance analysis step A method is provided.

  In order to solve the above-described problem, according to another aspect of the present invention, a storage function in which code information of a code included in a song is recorded in association with the progress of the song and playback for playing the song Function, a performance sound acquisition function for acquiring a performance sound of a predetermined instrument played in accordance with the reproduced music, and a performance sound acquired by the performance sound acquisition function are analyzed, and a chord included in the performance sound is analyzed. A performance analysis function for calculating chord information, and an evaluation function for evaluating performance sound based on the degree of approximation between the chord information recorded in the storage function and the chord information calculated by the performance analysis function. A program is provided.

  As described above, according to the present invention, it is possible to provide a player with an accurate evaluation of a performance sound during performance and effectively support the performance.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

<First Embodiment>
First, the configuration of the performance support apparatus 1 according to the first embodiment of the present invention will be described with reference to FIG. FIG. 1 is an explanatory diagram for explaining a configuration of a performance support apparatus according to the first embodiment of the present invention.

(1. Configuration of the performance support apparatus 1)
As shown in FIG. 1, the performance support apparatus 1 is connected to a microphone 2, a speaker 3, and a monitor 4.

  The microphone 2 is an example of a sound acquisition device, and collects a sound (hereinafter also referred to as “performance sound”) produced by a performer playing a musical instrument, and an analog signal of the performance sound obtained by collecting the sound. Is output to the performance support apparatus 1.

  The speaker 3 is an example of an audio output device, and receives an analog audio signal output from the performance support device 1 and outputs the audio signal.

  The monitor 4 is an example of a display unit, and displays a still image or a moving image (hereinafter also referred to as “display image”) output from the performance support apparatus 1. Any device that can display a display image can be used as the display unit.

  That is, the performance support apparatus 1 reproduces a predetermined music and outputs the music from the speaker 3 by voice. Furthermore, the performance support apparatus 1 displays a predetermined display image on the monitor 4 to support the performance by the performer simultaneously with the reproduction of the music. Then, the player plays a predetermined musical instrument while viewing this display image. In addition, when the performer plays a musical instrument and a performance sound is output from the musical instrument, the performance support apparatus 1 acquires the performance sound via the microphone 2, and information for supporting the performance based on the performance sound. Is generated and displayed on the monitor 4. The performance support apparatus 1 supports the performance of the performer by performing such display. The performance support apparatus 1 will be described in detail.

  In the following description, it is assumed that the musical instrument supported by the performance support device 1 is “guitar”. However, the present invention is not limited to this example, and the present invention is not limited to, for example, stringed instruments such as guitars, ukuleles, and violins, percussion instruments such as drums and drums, It can be applied to various musical instruments such as brass instruments such as trombone and woodwind instruments such as recorder / flute.

  The performance support apparatus 1 includes a music data acquisition unit 101, a music data DB 102, a practice data generation unit 11, a selection unit 105, a decoder 106, a playback unit 108, a timer 109, a sound output control unit 110, Beat display control unit 111, chord display control unit 112, tablature display control unit 113, performance sound acquisition unit 201, performance analysis unit 202, chord information acquisition unit 203, evaluation unit 204, and evaluation result display A control unit 205, an evaluation result DB 206, and an evaluation result output unit 207 are included. The practice data generation unit 11 includes a practice data acquisition unit 103, a practice data DB 104, and a music analysis unit 107.

  The performance support apparatus 1 includes a drawing unit that displays a display image in accordance with the music on the monitor 4 to support the performance of the music, and displays the evaluation result on the monitor 4 by evaluating the performance of the performer. And an evaluation unit that supports the performance of the music.

  More specifically, the drawing unit includes a practice data generation unit 11, a music data acquisition unit 101, a music data DB 102, a selection unit 105, a decoder 106, a playback unit 108, a timer 109, and a sound output. A control unit 110, a beat display control unit 111, a chord display control unit 112, and a tab score display control unit 113 are included. The evaluation unit includes a performance sound acquisition unit 201, a performance analysis unit 202, a chord information acquisition unit 203, an evaluation unit 204, an evaluation result display control unit 205, an evaluation result DB 206, and an evaluation result output unit 207. And are included. However, the rough method of the drawing unit and the evaluation unit is merely an outline, and for example, the practice data generation unit 11, the reproduction unit 108, the timer 109, and the like are included in the evaluation unit as well as the drawing unit. May be.

Each configuration of the performance support apparatus 1 will be described as follows.
First, the configuration of the drawing unit will be described.

(1-1. Drawing unit)
The music data acquisition unit 101 acquires music data (hereinafter also referred to as “music data”) and records the music data in the music data DB 102. More specifically, the music data acquisition unit 101 is, for example, a separate storage device (not shown) such as a hard disk drive (HDD), a read only memory (ROM), a random access memory (RAM), or a flexible disk. Various optical discs such as CDs (Compact Discs), MOs (Magneto Optical) discs, DVDs (Digital Versatile Discs), drives such as magnetic discs (not shown), or removable recording media such as semiconductor memories (not shown) )) Is obtained from any storage device. Furthermore, the music data acquisition unit 101 may acquire music collected by the microphone 2 or the like (connection lines are not shown). At this time, when the acquired music data is an analog signal, the music data acquisition unit 101 converts the analog signal into a digital signal and records the digital signal in the music data DB 102.

  The music data DB 102 stores the music data acquired by the music data acquisition unit 101. The music data DB 102 may store a plurality of music.

  The practice data acquisition unit 103 acquires data (hereinafter also referred to as “practice data”) that is displayed on the monitor 4 when the performer plays the guitar and supports the performance of the performer. It is recorded in the practice data DB in association with the music data. Note that the practice data acquisition unit 103 acquires the practice data from various storage devices in the same manner as the music data acquisition unit 101 described above.

  The practice data DB 104 is an example of a storage unit, and stores practice data acquired by the practice data acquisition unit 103 and practice data analyzed by the music analysis unit 107 described below. The practice data stored in the practice data DB 104 is stored in association with the music data stored in the music data DB 102 described above. That is, for example, one piece of practice data is associated with one piece of music data. The ratio of the number of corresponding data does not have to be 1: 1.

  The practice data includes, for example, “beat information”, “chord information”, “tablature information”, etc. for one song. This information can be explained as follows.

  (1) The beat information is information representing the timing (time point) of playing the guitar (performing the performance operation) in the progression of the music in association with the music. In other words, the beat information represents, for example, how many milliseconds after the start of performance, the time signature and beat (for example, the third night of four bars) in the music are displayed. This time signature or beat (timing) is also referred to as “beat” below. In other words, the beat information determines the beat with respect to the elapsed time since the music started to be played. That is, the beat information determines how many seconds after the music starts to be played (whether the instrument should be played). This beat information includes a “beat symbol” for each beat. This beat symbol is an example of a timing symbol, and is a symbol displayed on the monitor 4 in order to make the player recognize that the beat has been reached, that is, the timing of playing the guitar has been reached. Further, the beat information includes information indicating whether or not the beat is a measure break. Then, it is desirable that the beat symbol of the beat in the bar break has a different shape from the beat symbols of other beats (ie, time signatures). Thus, by making the beat symbol of the bar break different from the other beat symbols, the player can recognize the bar break.

  (2) The chord information is information indicating the chord progression in the music, that is, the guitar chord (chord) in the music progression in association with the music and the beat information. That is, the chord information stores the chord in each beat described above in association with the beat. That is, the chord information includes information such as “the chord of the nth beat is“ C ””.

  (3) The tablature information is an example of rendition style information that represents how to play a musical instrument that should be output at each timing during the progression of the music, and is information that represents the tablature of the guitar. That is, the tablature information stores the tablature of the chord in each beat described above in association with the beat information and chord information. And this tablature information is matched with the progress of a music by being linked | related with a beat. That is, the tablature information is associated with the passage of time since the music started to be played. For example, “1 second after the music starts playing, the first tablature information, 2 seconds later , “Second tablature information”. In other words, for example, for one piece of music, generally, a plurality of tablature information related in time series to the progress of the music is included as the practice data. Become.

  An example of each of these symbols or information displayed on the monitor 4 is shown in FIG. FIG. 2 is an explanatory diagram for explaining an example of the display screen 41 displayed on the monitor 4. In FIG. 2, each of the beat symbols B1 to B4 is displayed as a beat symbol representing a beat. The beat symbol B1 is displayed with a thick line at a bar break, and the beat symbols B2 to B4 are displayed with a thin line at a beat bar. In addition, chord information C1 to C4 such as chord names “G” and “C” are displayed on the beat symbol side of the associated beat. Further, tablature information T1, T2 is displayed on the display screen 41.

  The selection unit 105 selects one piece of music data and practice data associated therewith. More specifically, the selection unit 105 selects one piece of music data from the music data DB 102 in accordance with an input from the performer or a predetermined order. Then, the selection unit 105 selects practice data associated with the selected music data from the practice data DB 104. Further, the selection unit 105 acquires the selected music data and practice data from the music data DB 102 or the practice data DB 104, and outputs them to the reproduction unit 108. At this time, if the music data is encoded, the selection unit 105 outputs the music data to the playback unit 108 via the decoder 106. Further, when there is no practice data associated with the music data, the selection unit 105 outputs the music data to the music analysis unit 107 to calculate practice data, and then calculates the practice data and the music data. Are output to the playback unit 108.

  The decoder 106 decodes the encoded music data received from the selection unit 105 (for example, encoded into a file format such as Wave, MP3, ATRAC, etc.), and outputs the decoded music data to the playback unit 108. At this time, if there is no practice data associated with the music data, the decoder 106 outputs the music data to the music analysis unit 107. By providing the decoder 106, it is possible to use music data of any file format.

  The music analysis unit 107 analyzes the music data received from the selection unit 105 or the decoder 106, and calculates practice data. Then, the music analysis unit 107 records this practice data in the practice data DB 104 in association with the music data. The analysis of the music analysis unit 107 will be described more specifically as follows.

  In this analysis, the music analysis unit 107 acquires and analyzes music data. As this analysis, any analysis method capable of extracting beat timing and chord from music data can be used. Moreover, as this analysis method, a generally used method can be used.

  More specifically, as this analysis method, the music feature amount analysis technique described in Patent Document 6 can be used. According to this music feature amount analysis technique, it is possible to extract various feature amounts of music. However, the performance support apparatus 1 according to the present embodiment uses the beat information and the chord information among the feature amounts, and generates tablature information from the chord information.

  That is, according to this analysis method, for example, the waveform data of music data is broken down into time-series scales. Then, by analyzing this scale, a plurality of chord candidates (hereinafter also referred to as “candidate chords”) corresponding to the scale are extracted, and the degree of certainty of the chord for that scale is certain. Is calculated (hereinafter also referred to as “reliability”). Then, the music analysis unit 107 outputs the candidate code and its reliability as code information. In other words, in other words, the reliability is an approximation indicating how close the candidate code is to the actual code of the music data, and the candidate code that is an analysis result by the music analysis unit 107 indicates the actual code. This shows the accuracy of the analysis result indicating how accurately the analysis was performed.

  An example of candidate codes and reliability analyzed by the music analysis unit 107 is shown in FIG. FIG. 3 is an explanatory diagram for explaining the operation of the performance support apparatus according to the present embodiment. As shown in FIG. 3, “E”, “Dm”... “C”, etc. are extracted as candidate codes, and the reliability corresponding to each candidate code is “90%”, “85%”. % "Etc. are calculated. The code information displayed on the monitor 4 is one code having high reliability among a plurality of candidate codes (hereinafter simply referred to as “code”). That is, “E” among the candidate codes is displayed on the monitor 4.

  Then, beat information is calculated from the timing at which the chord exists. At this time, the music analysis unit 107 determines whether the timing is a measure change point and generates a beat symbol. Further, tablature information is generated from the code information code (one of the candidate codes with high reliability). In order to generate this tablature information, the music analysis unit 107 may store dictionary data of chord information and tablature information, a look-up table, and the like.

  The music analysis unit 107 has a learning function. This learning function, for example, calculates time-series energy for each candidate code from the scale in the above analysis processing, and compares and analyzes the increase / decrease of this energy for each analysis, thereby improving the accuracy of the analysis. It is a function to learn.

  However, the analysis by the music analysis unit 107 is not limited to such an example. For example, if the chord and its timing can be extracted, beat information, chord information, and tablature information can be calculated. Therefore, any method can be used as long as the chord and its timing can be extracted from the music data as described above. Can also be used.

  The playback unit 108 plays back the music data received from the selection unit 105. Then, the timer 109 is activated simultaneously with the start of reproduction. This timer 109 measures the elapsed time indicating the degree of progress of the music and outputs the elapsed time to the sound output control unit 110, beat display control unit 111, chord display control unit 112, and tablature display control unit 113.

  Further, the reproduction unit 108 outputs an audio signal based on the reproduced music data to the sound output control unit 110. The playback unit 108 outputs beat information to the beat display control unit 111, chord information to the chord display control unit 112, and tab score information to the tab score display control unit 113 as the music progresses.

The playback unit 108 can also play back music by changing the playback speed of the music.
In that case, the playback unit 108 may change the speed of the timer 109. Further, the playback unit 108 can perform so-called “AB repeat” in which a predetermined section of music is repeatedly played back. Then, the playback unit 108 can seek and generate a portion in the music piece desired by the performer by the operation of the performer. Note that the reproducing unit 108 may not output an audio signal to the sound output control unit 110. In this case, the performer plays the guitar with reference to only the display on the monitor 4.

  The sound output control unit 110 converts the audio signal received from the reproduction unit 108 into an analog audio signal and outputs the analog audio signal to the speaker 3. Therefore, the sound of music is emitted from the speaker 3.

  The beat display control unit 111 is an example of a timing symbol display control unit, and displays beat symbols on the monitor 4 based on beat information from the reproduction unit 108 and elapsed time from the timer 109. More specifically, as shown in FIG. 2, the beat symbols B1 to B3 are displayed so as to be aligned left and right. At this time, the beat symbols B1, B2, B3, and B4 represent beats that are continuous in time series. In addition, the beat display control unit 111 displays a beat symbol B <b> 1 for a beat that has actually come in the progress of the music at the reference position 31 in the display screen 41. The beat symbols B2 to B4 of the subsequent beats are displayed in order in the left-right direction. Here, the reference position 31 represents a position in the display screen 41 for indicating that the beat timing has been reached in the music piece by displaying the beat symbol of the beat.

  Furthermore, the beat display control unit 111 moves the beat display according to the progress of the music based on the beat information and the elapsed time. At this time, the beat display control unit 111 moves the beat symbol so that the beat symbol of the beat at the one timing reaches the reference position 31 when the progress of the music reaches the one timing. . More specifically, the beat display control unit 111 moves the beat symbols B1 to B4 in the movement direction 32 immediately before the timing of the beat symbol B2 shown in FIG. Then, when this timing arrives, the beat symbol B2 is made to reach the reference position 31. At this time, after the beat symbol reaches the reference position 31, it is desirable that the beat symbol is temporarily moved to that position. By temporarily stopping in this way, it is possible to make the player more clearly recognize that the beat timing has been reached.

  The code display control unit 112 is an example of a code information display control unit, and displays code information on the monitor 4 based on the code information from the reproduction unit 108 and the elapsed time from the timer 109. More specifically, as shown in FIG. 2, chord information C1 to C4 is displayed side by side on the beat symbols B1 to B4 side. At this time, the code information C1, C2, C3, and C4 also represent codes that are continuous in time series. The chord display control unit 112 moves the chord information C1 to C4 together with the beat symbol of the beat associated with the chord information C1 to C4. That is, the chord information C1 to C4 is moved together with the beat information B1 to B4. For this purpose, the chord display control unit 112 may receive a signal representing movement of the beat symbols B1 to B4 from the beat display control unit 111 and use it for movement of the chord information C1 to C4.

  The tab score display control unit 113 is an example of a rendition style information display control unit, and displays tab score information on the monitor 4 based on the tab score information from the playback unit 108 and the elapsed time from the timer 109. More specifically, as shown in FIG. 2, the tablature information T1 and T2 are displayed side by side aligned. At this time, the tablature information T1 and T2 also indicate tablatures that are continuous in time series. The tablature information T1 is a tablature corresponding to the code “G” of the code information C1 and C2. The tab score information T2 is a tab score corresponding to the chord “C” of the next chord information C3 and C4 in the beat following the beat of the tab score information T1 (corresponding to the beat symbols B1 and B2). . In other words, the tablature display control unit 113 performs the tablature of the chord in the current beat (the beat at which the timing of the music has progressed, that is, the beat symbol B1 displayed at the reference position 31), Is different, and the next tab in the beat following this beat is displayed. In other words, the tablature display control unit 113 displays two tablatures that are different in time series, and the tablature to be played now and the tablature to be played next are displayed on the monitor 4. Then, the tablature information T1 corresponding to the current beat (the beat represented by the beat symbol B1 displayed at the reference position 31) is displayed at the reference position 31.

  Note that the number of tablature information displayed at one time by the tablature display control unit 113 does not have to be two as described above, and the tablature display control unit 113 displays two or more tablature information on the monitor 4. Can also be displayed. However, for convenience of explanation, it is assumed that two tablature information (for example, tablature information T1, T2) is displayed.

  Further, the tab score display control unit 113 displays both tab score information T1 and T2 in a stationary state (fixed) on the monitor 4. A tablature display control unit immediately before the timing (chord information switching timing) when the chord information changes from the current chord (for example, “G”) to the next chord (next performance information, for example, “C”). 113 blinks the display of the next tablature information T2, and then moves the display position of both the tablature information T1 and T2. At this time, when the tab score display control unit 113 reaches this change timing, the tab score information of the next chord (for example, tab score information T2 corresponding to the chord “C”) reaches the reference position 31. As shown, the tablature information is moved in the moving direction 32.

  In other words, in the case of FIG. 2, when the next beat is reached in the progression of the music, the beat symbols B1 to B4 and the chord information C1 to C4 move, and when the next beat is reached, the beat symbol B2 is To the reference position 31. However, in this beat, the chord information C2 is the same “G” as the chord information C1 in the previous beat, so the chord represented by the chord information does not change. Therefore, the tablature information T1, T2 moves. Further, when the next beat is reached, the beat symbols B2 to B4 and the chord information C2 to C4 move, and when the next beat is reached, the beat symbol B3 moves to the reference position 31. At this time, since the code information C3 is “C” different from the code information C2, the code represented by the code information changes. Therefore, the tablature information T1 and T2 also move, and the tablature information T2 moves to the reference position 31.

  Here, the timing of changing from the current chord to the next chord is, in other words, the timing of switching from the current tab score information (one performance information) to the next tab score information (next performance information). Needless to say. Therefore, in the following, this timing is also referred to as a timing at which a chord is switched (changed) or a timing at which a tablature is switched (changed).

  In this way, the tablature information T1 and T2 are displayed in a stationary state, and the display of the next tablature information T2 is blinked immediately before the timing at which the chord changes, so that the timing at which the chord changes approaches the performer. Can be recognized. Further, while displaying the tablature information T1 and T2 in a stationary manner, both tablature information T1 and T2 are displayed so that the next tablature information T2 reaches the reference position 31 when the chord change timing is reached. By moving T2, the performer can recognize the next tablature information T2 without following the tablature information, and the visual burden on the performer can be reduced. Further, in order to move the tablature information T1 and T2 as described above, the tablature display control unit 113 receives a signal indicating that the chord information changes from the chord display control unit 112, and performs this movement. May be used.

In the above, each structure which a drawing part has was demonstrated.
Next, each structure which an evaluation part has is demonstrated. However, as described above, a part of the configuration of the drawing unit is also used by the evaluation unit. In particular, for example, the practice data generation unit 11 and the reproduction unit 108 may be included in this evaluation unit.

(1-2. Evaluation section)
The performance sound acquisition unit 201 acquires the performance sound of the player who played the music on the guitar through the microphone 2 while viewing the image displayed on the monitor 4 by the drawing unit. More specifically, the performance sound acquisition unit 201 acquires an analog audio signal collected by the microphone 2 and converts it into a digital audio signal (hereinafter also referred to as “performance sound data”), and a performance analysis unit. To 202.

  The performance analysis unit 202 analyzes the performance sound data received from the performance sound acquisition unit 201 and extracts chord information of the performance sound. Then, the music analysis unit 107 outputs the chord information of the performance sound to the evaluation unit 204. At this time, the performance analysis unit 202 analyzes performance sound data by the same analysis method as the music analysis method by the music analysis unit 107 described above. Therefore, the explanation about this analysis method is omitted. In the analysis by the music analysis unit 107, not only the chord information of the music but also practice data including beat information and tablature information is calculated. In this performance analysis unit 202, at least the chord information of the performance sound is calculated. do it. However, it goes without saying that beat information and tablature information may also be calculated.

  At this time, the performance analysis unit 202 acquires the chord information of the selected music piece from the selection unit 105. The performance analysis unit 202 does not perform the above analysis at the time when the chord information of the music changes, and performs the above analysis on the performance sound data corresponding to the section in which the chord information of the music does not change. An example of a section in which the performance analysis unit 202 performs analysis is shown in FIG. FIG. 4 is an explanatory diagram for explaining the timing at which the performance analysis unit performs analysis.

  In FIG. 4, the time points at which the codes of the respective code information are started are displayed in time series. That is, the code information from the time “0′00” 00 ”when the music reproduction is started represents the code“ C ”, and the code information is“ 0′00 ”60” from the music reproduction start. The representing code changes from “C” to “G”. Similarly, “G” is changed to “Am” at the time “0′01” 20 ”, and“ Am ”is changed to“ F ”at the time“ 0′01 ”80”. That is, in the section 1 from “0′00” 00 ”to“ 0′00 ”60”, the code information represents the code of “C”, and “0′00” 60 ”to“ 0′01 ”. In the section 2 before “20”, the code information represents a code of “G”. Hereinafter, similarly, the section 3 represents the “Am” code, and the section 4 represents the “F” code.

  In the case shown in FIG. 4, the performance analysis unit 202 analyzes performance sounds in the sections 1, 2, 3, and 4 except for the time when the chord changes.

  According to the above analysis method, the accuracy of the analysis by the performance analysis unit 202 at the time when the chord changes can be lowered. That is, when performing the chord analysis in real time, the performance analysis unit 202 usually analyzes the performance sound data by dividing the performance sound data into sections (also referred to as frames) having a constant length at regular intervals (for example, 1 frame = 10). Ms length). However, it is difficult to determine the length of this frame. If this time is too long, the code changes within one frame, and the probability that accurate code information cannot be analyzed increases. Conversely, if the time is too short, the probability that the code changes will decrease, The accuracy of itself cannot be secured.

  Therefore, in order to solve this problem, the performance analysis unit 202 according to the present embodiment uses the chord information of the music. That is, as shown in FIG. 4, the performance analysis unit 202 determines the sections 1 to 4 in which the chord information of the music does not change except the time when the chord information of the music changes, based on the chord information of the music. Then, the performance analysis unit 202 analyzes performance sound data in the sections 1 to 4. Thus, by not performing the analysis at the time when the chord is expected to change, it is possible to perform stable chord analysis and to improve the analysis accuracy of the chord information of the performance sound. .

  The chord information acquisition unit 203 acquires chord information of practice data. More specifically, the code information acquisition unit 203 acquires code information output from the reproduction unit 108 to the code display control unit 112. Then, the chord information acquisition unit 203 outputs the acquired chord information of the music to the evaluation unit 204.

  The evaluation unit 204 performs chord information on performance sound from the performance analysis unit 202 (hereinafter also referred to as “performance sound chord information”) and chord information on music from the chord information acquisition unit 203 (hereinafter also referred to as “music chord information”). .) Is evaluated based on the degree of approximation to. That is, the evaluation unit 204 calculates an approximation degree representing how close the performance sound code information and the music code information are. And the evaluation part 204 evaluates a performance sound from this approximation degree. In other words, the evaluation unit 204 evaluates whether the chord to be played matches the played chord for every one or two or more beats in the progression of the music. Then, the evaluation unit 204 outputs the evaluation result to the evaluation result display control unit 205 and records it in the evaluation result DB 206.

  More specifically, for example, when the above candidate code and its reliability are included in the chord information, the evaluation unit 204 determines the reliability of each candidate code in the performance sound code information and the same music code as the candidate code. The degree of approximation with the reliability of the candidate code is calculated. The calculation of the degree of approximation will be described later. And the evaluation part 204 evaluates the approximation degree of a performance sound with the calculated value of this approximation degree. As this evaluation, for example, the calculation value is standardized to give a score, and the evaluation result is, for example, “What is the maximum score out of 100 (may be 10)?” Is possible. In addition, a plurality of ranges are defined for the calculated value of the approximation degree, and evaluation results (for example, “Good!”, “OK”, “Bad!”, Etc.) according to the range including the calculated value are used. It may be displayed.

  The evaluation result display control unit 205 displays the evaluation result from the evaluation unit 204 on the monitor 4 while the music is in progress. A display example of this evaluation result is shown in FIG. As shown in FIG. 2, an evaluation result 51 “Good!” Is displayed. This evaluation result indicates whether or not the chord of the performance sound at the beat (beat symbol B1) displayed at the reference position 31 or the beat before that coincides with the chord of the practice data at that beat. ing. That is, the beat symbol B1 is temporarily stopped at the reference position 31 until just before the next beat symbol B2 beat timing comes. This stop time depends on the tempo of the music and can be arbitrarily set. That is, while the operation is temporarily stopped, the evaluation result for the chord in this beat may be displayed on the monitor 4, or the evaluation result for the chord of one or more previous beats may be displayed. In this way, by displaying the degree of chord approximation as an evaluation result during a performance, it is possible to provide information about whether the player's performance is correct or wrong during the performance. By playing with reference to the evaluation results, it is possible to correct the wrong chord playing while playing.

  Evaluation result DB206 memorize | stores the evaluation result of the performance sound in each beat by the evaluation part 204. FIG. At this time, the evaluation result DB 206 is recorded by the evaluation unit 204 in association with the progress of the music. That is, the evaluation result is stored in association with the elapsed time of the progression of music, such as “evaluation result in beats after several seconds”.

  The evaluation result output unit 207 displays the evaluation result stored in the evaluation result DB 206 on the monitor 4 when the reproduction of the music is finished and the player has finished playing the guitar. At this time, the evaluation result output unit 207 may analyze the evaluation result with respect to the progress of the music and display the analysis result. Since the evaluation result DB 206 stores the evaluation result of each beat in the music, the analysis by the evaluation result output unit 207 includes, for example, “which code is bad in evaluation”, “in which section of the music, It is possible to perform various analyzes such as “Is the chord evaluation bad?” Or “Which section of the music is out of timing”. By performing such an analysis, the player finds chords and weak chords that he is good at and presents advice, and provides advice on chord transitions. Information can be provided to the performer.

The configuration of the performance support device 1 according to the present embodiment has been described above.
Next, the operation of the performance support apparatus 1 according to this embodiment will be described with reference to FIG.

(2. Operation of the performance support apparatus 1)
FIG. 5 is an explanatory diagram for explaining the operation of the performance support apparatus 1 according to the present embodiment.
FIG. 5 shows an operation when the music data acquisition unit 101 has already acquired music data and the music data is stored in the music data DB 102 in advance.

  First, in step S01, the selection unit 105 selects one piece of music data from the music data stored in the music data DB 102. Then, the process proceeds to the next step S02.

  In step S02, the selection part 105 reads the selected music data from music data DB102. Then, the process proceeds to the next step S03.

  In step S03, the selection unit 105 determines whether or not the music data is encoded data. If the music data is not encoded, the process proceeds to step S05. If the music data is encoded, the selection unit 105 outputs the music data to the decoder 106, and the step before step S05 is performed. Proceed to S04.

  In step S04, the decoder 106 decodes the music data. Then, the process proceeds to the next step S05.

  In step S05, the selection unit 105 determines whether or not there is practice data associated with the music data, that is, whether or not the music data has been analyzed. If the music data has been analyzed, the selection unit 105 outputs the music data to the playback unit 108 or causes the decoder 106 to output the decoded music data to the playback unit 108. Then, the process proceeds to step S08.

  On the other hand, if the music data has not been analyzed, the selection unit 105 outputs the music data to the reproduction unit 108 and the music analysis unit 107, or the decoded music data from the decoder 106 to the reproduction unit 108 and the music analysis unit 107. To output. Then, the process proceeds to step S07 before proceeding to step S08.

  That is, in step S07, the music analysis unit 107 analyzes the music data and calculates practice data. Then, the music analysis unit 107 records the calculated practice data in the practice data DB 104. Then, the process proceeds to step S08.

  In step S08, the selection unit 105 reads the practice data associated with the selected music data from the practice data DB 104 and outputs it to the reproduction unit 108. At this time, the selection unit 105 also outputs the practice data to the performance analysis unit 202 for evaluation. Then, the process proceeds to step S09.

  In step S09, the playback unit 108 starts playback. In step S10, the reproduction unit 108 starts the timer 109. In step S09, the playback unit 108 changes and sets the playback speed, and plays the music at the set playback speed. Then, the playback unit 108 sequentially plays the music data to the sound output control unit 110, the beat information to the beat display control unit 111, the chord information to the chord display control unit 112, and the tablature information to the tab display information in accordance with the playback of the music. The data is output to the score display control unit 113. Then, the process proceeds to step S11.

  In step S11, the beat display control unit 111, the chord display control unit 112, and the tab score display control unit 113 perform drawing processing. And after the process of step S11, it progresses to step S12 and the evaluation process by an evaluation part is performed. The processing in step S11 and step S12 will be described later. In step S13, it is determined whether or not the reproduction of the music has ended. Steps S11 and S12 are repeatedly processed until the reproduction of the music is completed. Whether or not the reproduction of the music has ended may be determined by the reproduction unit 108, and a signal indicating that the music has ended may be output to each component.

  If it is determined in step S13 that the music has been reproduced, the process proceeds to step S14, where the evaluation result output unit 207 acquires and analyzes the evaluation result from the evaluation result DB 206, and monitors the evaluation result and / or the analysis result. 4 to display.

The outline of the operation of the performance support apparatus 1 has been described above.
Next, the drawing process performed in step S11 will be described with reference to FIG.

(2-1. Drawing process by performance support apparatus 1)
In the drawing process shown in FIG. 6, the process of step S111 is first performed.
In step S111, the beat display control unit 111, the chord display control unit 112, and the tab score display control unit 113 obtain the music playback time (that is, the elapsed time from the start of playback) from the timer 109. Then, the process proceeds to next Step S112.

  In step S112, the beat display control unit 111 determines whether or not the reproduction time reaches the timing of the next beat. In other words, the beat display control unit 111 sets “beat movement start timing” immediately before the next beat timing, and determines that the next beat timing is reached when this beat movement start timing is reached. . The beat movement start timing is set immediately before the next beat timing. The time interval between the next beat timing and the beat movement start timing is a rhythm interval (time interval between beats and beats). Any shorter value can be set. In addition, the speed of movement of the following beat symbols and the like is determined by this time interval.

  If it is determined in step S112 that the next beat timing is reached, the process proceeds to step S113. If it is not determined that the next beat timing is reached, the process proceeds to step S114.

  In step S113, the beat display control unit 111 sets the movement of the beat symbol display position. Then, the chord display control unit 112 sets the movement of the chord information display position in accordance with the movement of the beat symbol. At this time, the beat display control unit 111 sets the movement of the beat symbol so that the next beat symbol reaches the reference position 31 when the next beat timing is reached. At this time, it is preferable that the movement of the next beat symbol is set so as to reach the reference position 31 at the time when the next beat timing is reached. After step S113, the process proceeds to step S114.

  In step S114, the tablature display control unit 113 determines whether or not the playback time has reached the timing when the chord information is switched (that is, the timing when the tablature information is switched), that is, the timing of the next beat (beat movement start timing). ), It is determined whether or not the chord information (that is, the tablature information) is changed. More specifically, for example, the chord display control unit 112 outputs information on whether or not the chord information is changed to the tab score display control unit 113, and the tab score display control unit 113 changes the chord information. It may be determined that the code information is switched on the basis of the information on whether or not it is performed. Further, for example, the tab score display control unit 113 may determine that the chord information is switched when the tab score information output from the reproduction unit 108 is changed.

  If it is determined in step S114 that the timing at which the code information is switched is reached, the process proceeds to step S115. If it is determined that the timing at which the code information is switched is not reached, the process proceeds to step S117.

  In step S115, the tab score display control unit 113 blinks the display of the next tab score information. And after blinking, it progresses to the following step S116.

  In step S116, the tablature display control unit 113 sets movement of tablature information. At this time, the tablature display control unit 113 displays the tablature so that the next tablature information has reached the reference position 31 when the next tablature timing (next beat timing) is reached. Set up information movement. At this time, it is preferable that the movement of the next tablature information is set so as to reach the reference position 31 at the time when the timing of the next tablature is reached. After step S116, the process proceeds to step S117.

  In step S117, the beat display control unit 111, the chord display control unit 112, and the tab score display control unit 113 redraw the image displayed on the display screen 41 of the monitor 4. That is, the display positions of beat symbols, chord information, and tablature information are moved based on the set movement.

  The manner in which the display positions of beat symbols, chord information, and tablature information are moved in this redrawing process will be described with reference to FIG. FIG. 7 is an explanatory diagram for explaining an example of a change in the display screen in the drawing process. In FIG. 7, (A) to (B) show images displayed on the display screen 41 of the monitor 4 at each time point. In other words, the arrow 33 represents the passage of time.

First, the movement between beat symbols and chord information will be described as follows.
At the time of FIG. 7A, the beat timing represented by the beat symbol B1 is shown. The beat symbols B2 to B4 of the subsequent beats are displayed to the right of the beat symbol B1. This beat symbol B2 represents the next beat.

  Then, immediately before the reproduction of the music reaches the timing of the next beat (beat symbol B2) (beat movement start timing), all the beat symbols B1 to B4 move in the left direction. The display screen 41 at the time when the next beat timing is reached is as shown in FIG.

  That is, as shown in (B) of FIG. 7, the beat symbol B <b> 2 representing the next beat has moved to the reference position 31 in (A). The beat symbols B3 to B5 following the beat symbol B2 are also moved.

  Similarly, as shown in FIG. 7C, when the timing of the next beat in (B) is reached, the beat symbol B3 representing the next beat in (B) moves to the reference position 31. Then, subsequent beat symbols B4 to B6 also move.

  At this time, the chord information C1 to C4 also move together with the corresponding beat symbols.

Next, the movement of tablature information will be described as follows.
In (A) and (B) of FIG. 7, the beat chord information B1 and B2 displayed at the reference position 31, that is, the chord information C1 and C2 of the beat at the timing when the reproduction of the music arrives is the same with the chord “G”. Therefore, the tablature information T1 and T2 does not move and remains stationary. However, in FIG. 7C, the chord information C3 of the beat symbol B3 displayed at the reference position 31 is the chord “C”, which is different from the chords before that. Therefore, immediately before the time elapses from (B) to (C) in FIG. 7, the display of the next tab score information T2 blinks. Then, as shown in (C) of FIG. 7, the next tab score information T <b> 2 of (B) moves to the reference position 31.

  For example, after each beat symbol B2 to B5, chord information C2 to C5, and tablature information T1 and T2 have moved from time (B) to time (C), it is shown in (C). In this way, beat symbol B5, chord information C5, and tablature information T3 are displayed following beat symbol B4, chord information C4, and tablature information T2, respectively. At this time, the beat symbol B5, chord information C5, and tablature information T3 also follow the movement of the beat symbols B2 to B5, chord information C2 to C5, and tablature information T1 and T2 to the right of the display screen 41. It is preferable to display while moving from.

(2-2. Effects of drawing process)
The drawing process by the performance support apparatus 1 according to the present embodiment has been described above.
According to the performance support apparatus 1 according to the present embodiment, the following effects can be achieved.

  In other words, according to the performance support apparatus 1, beat symbols representing measures, beats, and the like are scrolled and displayed in one direction on the display screen 41 at a constant rhythm, whereas a beat is engraved. However, as long as the chord does not change, the tablature information is displayed in a stationary state. Therefore, a player who plays an instrument while looking at the display screen 41 can recognize the rhythm of the music by the beat symbol and can perform without losing the sense of rhythm. Furthermore, since the performer can play the musical instrument by looking at the tablature information displayed in a stationary state, the performer can play the music while checking how to play the musical instrument. Therefore, according to this performance support apparatus 1, it is possible to effectively support the performance of the performer's musical instrument.

  In addition to the current chord (for example, tablature information T1 in FIG. 7A), the tablature information for the next chord (for example, tablature information T2 in FIG. 7A) is also displayed on the display screen. 41 is displayed in a stationary state. Therefore, the performer can prepare for playing the next chord while viewing the next tablature information displayed in a stationary state. For this preparation, for example, it is recognized that “Next is this chord, how to play this chord is like this tablature ...” and the body position such as fingers and arms is adjusted accordingly It can be moved and muscles can be tensioned.

  Furthermore, since the current tab score information and the next tab score information are displayed in a stationary state at this time, it is not necessary for the performer to follow the moving tab score information. Can be reduced. For example, if the tablature moves constantly or everywhere, the player's ability to recognize other beat symbols, etc., is reduced, and the player's visibility of the tablature is also reduced. Therefore, the player who is proficient in playing the musical instrument is forced to become proficient in recognizing the display screen. However, according to the performance support device 1 according to the present embodiment, the tablature is displayed in a stationary state as long as the chord does not change as described above, thus preventing such a decline in recognition and visibility. And performers can concentrate on learning how to play musical instruments. Therefore, more effective performance support can be performed.

  Then, by moving the tablature only at the moment when the chord is switched, it is possible to emphasize the fact that the chord is changed and to make the player recognize it.

  Also, according to the performance support apparatus 1, immediately before moving to the next chord, the display of the tablature information of the next chord blinks. Therefore, the performer can recognize that the timing for playing the next chord is approaching, and can more easily play the instrument.

  In addition, since the beat symbol has a different shape when it represents a time signature (for example, beat symbol B2) and when it represents a bar break (for example, beat symbol B1), the performer can play the current beat or You can recognize whether each subsequent beat is a bar break or a beat break. Recognizing the bar breaks in this way can improve the efficiency when learning a musical instrument or music.

  Moreover, according to this performance support apparatus 1, the music data acquisition part 101 can acquire a new music, and the music analysis part 107 can analyze this new music and can create practice data. Therefore, the performer can perform not only the music prepared in advance but also a new music according to his / her preference.

  Further, according to the performance support apparatus 1, since the playback speed of the music by the playback unit 108 can be changed, for example, when the normal performance speed is too fast to be accompanied by the performer, the playback speed is slowed down. can do. Conversely, the playback speed can be increased. That is, it is possible to provide performance support that matches the skill and preference of the performer.

  By providing such an effect, the performance support apparatus 1 according to the present embodiment can cause the performer to perform with a sense of rhythm, and more effectively enhance the player's proficiency in playing the instrument. It is possible to support. In addition, as described above, each beat symbol and chord information are scrolled sequentially, and when the chord information is switched, the tablature information is scrolled, so that it is easy to understand predetermined information such as the time and method of playing the instrument next time, and Since it can be provided to the performer as if it were a game, it is possible to increase motivation for the performer.

The drawing process performed in step S11 has been described above.
Next, the evaluation process performed in step S12 will be described with reference to FIG.

(2-3. Evaluation process by the performance support apparatus 1)
In the drawing process shown in FIG. 8, the process of step S121 is first performed.
In step S121 (an example of a performance sound acquisition step), the performance sound acquisition unit 201 acquires performance sound data via the microphone 2. The performance sound acquisition unit 201 converts the acquired performance sound into performance sound data that is an analog audio signal and outputs the performance sound data to the performance analysis unit 202. After step S121, the process proceeds to step S122.

  In step S122 (an example of a performance analysis step), the performance analysis unit 202 analyzes the performance sound data from the performance sound acquisition unit 201 and calculates chord information. At this time, as described above, the performance analysis unit 202 acquires music code information from the selection unit 105, and analyzes the audio signal in a section where the chord represented by the music code information does not change. Further, as described above, the performance analysis unit 202 analyzes the performance sound data by the analysis method by the music analysis unit 107. The code information includes a plurality of candidate codes and the reliability of each candidate code. Then, the performance analysis unit 202 outputs performance sound chord information that is the analysis result to the evaluation unit 204, and proceeds to the next step S123.

  In step S123, the chord information acquisition unit 203 acquires the song code information reproduced by the reproduction unit 108, and outputs the song code information to the evaluation unit 204. Then, the process proceeds to step S124.

  In step S124 (an example of an evaluation step), the evaluation unit 204 evaluates the performance sound based on the music code information and the performance sound code information, and calculates the evaluation result. An example of calculating the evaluation result will be described with reference to FIG. FIG. 9 is an explanatory diagram for explaining an evaluation process performed by the performance support apparatus according to the present embodiment.

  As illustrated in FIG. 9, the evaluation unit 204 acquires, for example, music code information and performance sound code information corresponding to the sections 1 to 4. At this time, the evaluation unit 204 performs evaluation in a section where the code does not change, such as the sections 1 to 4. Further, as described above, each of the music code information and the circular noise code information includes a plurality of candidate codes and the reliability of each candidate code.

  In this evaluation process, the evaluation unit 204 regards these pieces of code information as vectors, and calculates the distance between these vectors (the magnitude of the difference vector between both vectors), that is, the degree of approximation. Then, the evaluation unit 204 compares this distance with a predetermined range, and outputs an evaluation result associated with the predetermined range to which this distance belongs.

Taking the section 1 in FIG. 9 as an example, the above-described evaluation result calculation process will be described more specifically as follows. That is, the evaluation unit 204 regards each piece of code information as the following two vectors.
1) Music vector C _T1 = {0.90, 0.30, 0.10, 0.10, ...}
2) Performance sound vector C _R1 = {0.75, 0.40, 0.15, 0.15, ...}

In each vector element, the first element is the reliability with respect to the code “C”, the second element is the reliability with respect to the code “Cm”, and the third and subsequent elements are the same. . The distance D ₁ of the between the vector, for example, is calculated by the following equation 1

Then, the evaluation unit 204 calculates an evaluation result based on the distance D ₁ , that is, the degree of approximation. For example, although the distance D ₁ is calculated as “0.191” in the above formula 1, 0.191 is a range of “Good!” That is one of the evaluation results (for example, 0.000 or more). If it is within less than 0.200), this “Good!” Is output as an evaluation result. Also, if you want to express the evaluation results in percent, for example, by subtracting the distance D ₁ from a predetermined value, dividing the result by the predetermined value, and performing the predetermined calculation, such as multiplying by 100 Thus, the evaluation result can be calculated.

  The evaluation result calculation process in step S124 has been described above. After the process of step S124, the process proceeds to step S125.

  In step S125, the evaluation unit 204 stores the calculated evaluation result in the evaluation result DB 206. Then, the process proceeds to next Step S126.

  In step S126, the evaluation result display control unit 205 causes the monitor 4 to display the evaluation result calculated by the evaluation unit 204. At this time, the evaluation result display control unit 205 sequentially displays the evaluation results during the reproduction of the music. A display example of this evaluation result is shown in FIG.

  As shown in FIG. 5A, the evaluation result display control unit 205 displays “Good!” As the evaluation result 51 in the upper left of the display screen 41, for example. Further, for example, “Bad!” As the evaluation result 52 as shown in (B), “Ok” as the evaluation result 53 as shown in (C), etc., based on the evaluation result by the evaluation unit 204 Are displayed sequentially during playback.

(2-4. Effects of evaluation process)
The drawing process by the performance support apparatus 1 according to the present embodiment has been described above.
According to the performance support apparatus 1 according to the present embodiment, the following effects can be achieved.

  That is, according to the performance support apparatus 1, the performance sound generated by the performer playing the musical instrument is analyzed in real time by the performance analysis unit 202, and the performance sound code information as a result of the analysis is analyzed by the evaluation unit 204. It can be evaluated in real time by comparing with code information. Accordingly, the performer can play the music while observing the evaluation result and grasping whether the timing and timing of playing the instrument are correct. Therefore, the performer can sequentially correct how to play and the timing to play. Therefore, according to this performance support apparatus 1, it is possible to more effectively support the performance of musical instruments and music by the performer.

  Further, the analysis by the music analysis unit 107 can analyze the sound in the actual music and extract chord change points and feature quantities by using all the music data. On the other hand, if the performer is not proficient with a musical instrument or music, the performance sound played by the performer is often different from the sound in the actual music, so the analysis accuracy of the performance analysis unit 202 is limited. . Therefore, the performance analysis unit 202 may be less accurate than the music analysis unit 107. This decrease in performance sound analysis accuracy may reduce the accuracy of evaluation by the evaluation unit 204. However, according to the performance support device 1 according to the present embodiment, the analysis accuracy can be improved and the evaluation accuracy can be improved as follows.

  That is, according to the performance support apparatus 1, the performance analysis unit 202 uses the chord information of the music and analyzes the performance sound data in a section where the chord information of the music does not change. Therefore, it is possible to predict a section in which the chord information will not change even in the performance sound, and by performing analysis in this section, it is possible to improve the analysis accuracy of the performance sound chord information.

  Moreover, according to the performance support apparatus 1, not only the coincidence / mismatch of the chords represented by the performance sound code information is evaluated, but also based on the plurality of candidate codes included in the performance sound code information and the reliability of each candidate code. Can be evaluated. Therefore, the accuracy of evaluation by the evaluation unit 204 can be improved.

  At this time, since the music chord information and the performance sound chord information are calculated by the same analysis method, the limit due to the analysis accuracy can be compensated, and the evaluation accuracy by the evaluation unit 204 can be further improved. That is, the accuracy of the analysis and chord information calculation by the music analysis unit 107 and the performance analysis unit 202 is limited, and an error or an error occurs depending on a predetermined probability or case. However, by using the same analysis method in the music analysis unit 107 and the performance analysis unit 202, the music code information and the performance sound code information can include the same error or error in the same probability or case. Therefore, the limit of analysis accuracy can be compensated by comparing and evaluating the music chord information and the performance sound chord information.

  Further, the evaluation unit 204 regards the music chord information and the performance sound chord information as vectors, and calculates the distance between the vectors, for example, compared with a case where only candidate codes with high reliability are compared, for example, More flexible evaluation can be performed. Therefore, the accuracy of evaluation by the evaluation unit 204 can be further improved.

  Furthermore, according to the performance support apparatus 1 according to the present embodiment, the evaluation result is accumulated in the evaluation result DB 206, and the evaluation result output unit 207 analyzes the evaluation result and various information useful for learning the performance of the musical instrument. Can be provided. At this time, the evaluation result output unit 207 can output the above-described useful information by using the evaluation result for each section or one or more beats included in the section, so that it is more accurate and useful. Information can be provided to the performer.

The performance support device 1 according to the first embodiment of the present invention has been described above.
Next, a performance support apparatus 5 according to the second embodiment of the present invention will be described.

Second Embodiment
First, the configuration of the performance support apparatus 5 according to the second embodiment of the present invention will be described with reference to FIG. The basic configuration and operation of the performance support apparatus 5 according to the present embodiment are the same as those of the performance support apparatus 1 according to the first embodiment described above, and thus detailed description thereof will be omitted. The description will focus on the differences from the form.

(1. Configuration of the performance support device 5)
FIG. 10 is an explanatory diagram for explaining a configuration of a performance support apparatus according to the second embodiment of the present invention. As shown in FIG. 10, the performance support apparatus 5 according to the present embodiment includes the playback unit 501 that is a configuration that replaces the playback unit 108 and the conversion unit 502 that is a newly added configuration. This is different from the performance support device 5 according to the embodiment. Therefore, description will be made centering on the reproduction unit 501 and the conversion unit 502.

  The playback unit 501 plays back the music data received from the selection unit 105. Then, the timer 109 is activated simultaneously with the start of reproduction. This timer 109 measures the elapsed time indicating the degree of progress of the music and outputs the elapsed time to the sound output control unit 110, beat display control unit 111, chord display control unit 112, and tablature display control unit 113.

  Further, the reproduction unit 108 outputs an audio signal based on the reproduced music data to the sound output control unit 110. The playback unit 108 outputs beat information to the beat display control unit 111 and chord information and tab score information to the conversion unit 502 tab score display control unit 113 in accordance with the progress of the music.

The playback unit 501 can also play back music by changing the playback speed.
In that case, the playback unit 501 also changes the speed of the timer 109. Further, the playback unit 501 can perform so-called “AB repeat” in which a predetermined section of music is repeatedly played back. Then, the playback unit 501 can seek and generate a portion in the music piece desired by the performer by the operation of the performer. Note that the reproducing unit 501 may not output an audio signal to the sound output control unit 110. In this case, the performer plays the guitar with reference to only the display on the monitor 4.

  At this time, unlike the reproducing unit 108, the reproducing unit 501 can reproduce the music data by changing the tonality of the music data. That is, the reproduction unit 501 can change the tonality previously determined for the music data by the player's input, and output the music data with the changed tonality to the sound output control unit 110. At this time, the reproduction unit 501 outputs tonality change information indicating how much the tonality has been changed to the conversion unit 502.

  Based on the tone change information from the playback unit 501, the conversion unit 502 converts the chord information and tablature information from the playback unit 501 into code information and tablature information in the changed tone. At this time, the conversion unit 502 stores data (for example, a look-up table) that represents the correspondence between tonality, chord information, and tablature information, and this data may be used for the conversion.

  In the present embodiment, the chord information acquisition unit 203 acquires the chord information and tablature information converted by the conversion unit 502.

The configuration of the performance support apparatus 5 according to this embodiment has been described above.
Next, the operation of the performance support apparatus 5 according to this embodiment will be described.

(2. Drawing process by performance support device 5)
The performance support apparatus 5 according to the present embodiment performs an additional operation in the drawing process in addition to the same operation as that of the performance support apparatus 1 according to the first embodiment. The operation of the performance support apparatus 5 is shown in FIG.

  As shown in FIG. 11, the performance support device 5 according to the present embodiment performs step S301 before the processing of step S111 (reproduction time acquisition processing) during the operation of the performance support device 1 according to the first embodiment. Process step S303. The processing in steps S301 to S303 will be described as follows.

  That is, in step S301, the reproducing unit 108 changes the tonality of the music data. That is, when the performer inputs predetermined information for changing the tonality of the music data, the playback unit 108 changes the tonality of the music data based on this information, and the changed music data is sounded. Output to the output control unit 110. Further, the reproduction unit 108 outputs tonality change information to the conversion unit 502 in accordance with the tonality change. Then, the process proceeds to step S302.

  In step S302, the conversion unit 502 determines whether or not the tonality conversion has been performed by the reproduction unit 501 based on whether or not the tonality conversion signal has been received. More specifically, when the tonality conversion signal has not been received, the conversion unit 502 determines that the tonality has not been converted, and converts the chord information and tablature information from the reproduction unit 501 into the chord display control unit. 112 and the tablature display control unit 113 respectively. Then, the process proceeds to step S111.

  On the other hand, when the tonality change signal is received, the conversion unit 502 determines that the tonality has been converted, and proceeds to step S301.

  In step S301, the conversion unit 502 converts chord information and tablature information based on the tonal change signal. Then, the conversion unit 502 outputs the converted chord information and tab score information to the chord display control unit 112 and the tab score display control unit 113, respectively. Then, the process proceeds to step S111.

  Note that the drawing process after step S111 and the other processes are the same as those in the performance support apparatus 1 according to the first embodiment, and a description thereof will be omitted.

(3. Effects of the second embodiment)
The configuration and operation of the performance support apparatus 5 according to this embodiment have been described above.
According to the performance support device 5 according to the second embodiment, the tonality can be changed and reproduced according to the player's request, and the chord information and tablature information with the tonality changed can be played. Can be provided. Therefore, more flexible performance support can be performed. In addition, when playing an instrument such as a guitar, for example, it is conceivable to sing lyrics at the same time. In this case, it is very important to change the tonality. It becomes possible to meet the demands of performers who want to practice music.

  As mentioned above, although preferred embodiment of this invention was described referring an accompanying drawing, it cannot be overemphasized that this invention is not limited to this example. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are naturally within the technical scope of the present invention. Understood.

  For example, in the above-described embodiment, the chord information and tablature information store the chord or tablature in each beat in association with the beat, but the present invention is not limited to such an example. The chord information and / or tablature information may represent, for example, the time when the chord or tablature changes as the music progresses. In other words, for example, the chord information may indicate how many milliseconds after the start of music playback when the chord “C” changes to “Em”, and the tablature information includes the tab “C”. It may represent how many milliseconds after the start of playback the time at which the score changes to the tab score “Em”.

  In the above embodiment, the sound output control unit 110 outputs the sound signal of the music reproduced by the reproduction unit 108 via the speaker 3. However, the sound output control unit 110 has a plurality of modes such as an automatic performance mode, for example. In this automatic performance mode, the chord information is also obtained from the reproduction unit 108, and the performer can obtain the chord information based on the chord information. It is also possible to synthesize the sound of the musical instrument to be played and output it through the speaker 3. Therefore, the performance support apparatuses 1 and 5 can automatically reproduce the performance sound of the musical instrument.

  Further, in the above embodiment, the evaluation unit 204 regards the music chord information and the performance sound chord information as a vector having the reliability of each candidate chord as the size of each element, and calculates the distance of this vector by the above Equation 1. Thus, the performance sound was evaluated based on the calculation result. However, the present invention is not limited to such an example. For example, the evaluation unit 204 may calculate a distance by another method instead of the Euclidean distance between both vectors as in Expression 1. Further, for example, the evaluation unit 204 may extract only one or two or more candidate codes with high reliability in each code information, and calculate the distance by using only these candidate codes.

  Furthermore, the evaluation unit 204 extracts one or more candidate codes with high reliability in the music code information, and the candidate codes are included in one or more candidate codes with high reliability in the performance sound code information. Depending on whether or not, the performance sound may be evaluated.

  As described above, various methods can be considered as a performance sound evaluation method by the evaluation unit 204. For example, as this evaluation method, the degree of coincidence between the chord waveform represented by the music chord information and the chord waveform represented by the performance sound chord information is calculated as an approximate degree, and the performance sound is evaluated according to the approximate degree. Also good. In addition, the present invention can use all methods as described above, or can combine these methods.

  Moreover, although the said embodiment demonstrated the case where the beat symbol, chord information, and tablature information scroll in the left-right direction as the moving direction 32, this invention is not limited to this example.

  That is, for example, as shown in FIG. 12, beat symbols, chord information, and tablature information can be moved in the moving direction 35 in the front-rear direction of the screen. For example, as shown in FIG. 13, it is also possible to move beat symbols, chord information, and tablature information in the vertical movement direction 34. In the case shown in FIG. 12, the front-rear direction means that the beat symbols, chord information, and tablature information displayed on the screen are moved and changed in size, and the beat symbols, chords are adjusted by adjusting the overlapping degree. This means a display method in which the player can recognize the information and the tablature information as if they moved in the front-rear direction in the display screen 41.

  Moreover, although the said embodiment demonstrated the case where a musical instrument was a guitar, this invention is not limited to this example. In other words, as described above, any musical instrument can be used. In this case, the rendition style information is not limited to tablature information, and may be various information according to the musical instrument. For example, when the musical instrument is a piano, as shown in FIG. 13, this rendition style information is displayed as rendition style information T1 and T2 as a predetermined video showing the piano keyboard and the location where the chord is to be played. It is also possible to do.

  In addition, the series of processes described in the above embodiments may be executed by dedicated hardware, but may be executed by software. When a series of processing is performed by software, the above-described series of processing can be realized by causing a general-purpose or dedicated computer as shown in FIG. 14 to execute the program.

  FIG. 14 is an explanatory diagram for explaining a configuration example of a computer that realizes a series of processes by executing a program. The execution of a program for performing a series of processes by a computer will be described as follows.

  As illustrated in FIG. 14, for example, the computer includes a bus 601, a CPU (Central Processing Unit) 603, a recording device, an input / output interface 606, a communication device 607, an input device, a drive 611, and an output device. And so on. These components are connected to each other via a bus 601 and an input / output interface 606 so as to be able to transmit information to each other.

  The program can be recorded in, for example, an HDD (Hard Disk Drive) 603, a ROM (Read Only Memory) 604, a RAM (Random Access Memory) 605, which is an example of a recording device.

  The program is temporarily stored in a removable recording medium 612 such as a flexible disk, various optical discs such as CD (Compact Disc), MO (Magneto Optical) disc, and DVD (Digital Versatile Disc), a magnetic disc, and a semiconductor memory. Or it can be recorded permanently. Such a removable recording medium 612 can also be provided as so-called package software. In this case, the program recorded in these removable recording media 612 may be read by the drive 611 and recorded in the recording device via the input / output interface 606, the bus 601 and the like.

  Furthermore, the program can be recorded in, for example, a download site, another computer, another recording device, etc. (not shown). In this case, the program is transferred via a network 608 such as a LAN (Local Area Network) or the Internet, and the communication device 607 receives the program. The program received by the communication device 607 may be recorded in the recording device via the input / output interface 606, the bus 601 and the like.

  Then, the CPU 602 executes various processes according to the program recorded in the recording device, thereby realizing the series of processes. At this time, for example, the CPU 602 may directly read and execute the program directly from the above-described recording apparatus, or may be executed after being once loaded into the RAM 605. Further, for example, when receiving the program via the communication device 607 or the drive 611, the CPU 602 may directly execute the received program without recording it in the recording device.

  Furthermore, the CPU 602 may perform various processes based on signals and information input from input devices such as a mouse 609, a keyboard 610, and a microphone 615, as necessary.

  Then, the CPU 602 may output a result of executing the above-described series of processing from an output device such as a monitor 613 and a speaker 614, and the CPU 602 transmits the processing result from the communication device 607 as necessary. Alternatively, the information may be recorded on the recording device or the removable recording medium 612 described above.

It is explanatory drawing for demonstrating the structure of the performance assistance apparatus which concerns on 1st Embodiment of this invention. It is explanatory drawing for demonstrating an example of the display screen displayed on a monitor. It is explanatory drawing for demonstrating operation | movement of the performance assistance apparatus which concerns on the same embodiment. It is explanatory drawing for demonstrating the timing which a performance analysis part analyzes. It is explanatory drawing for demonstrating operation | movement of the performance assistance apparatus which concerns on the same embodiment. It is explanatory drawing for demonstrating the drawing process by the performance assistance apparatus which concerns on the same embodiment. It is explanatory drawing for demonstrating an example of the change of the display screen in a drawing process. It is explanatory drawing for demonstrating the evaluation process by the performance assistance apparatus which concerns on the same embodiment. It is explanatory drawing for demonstrating the evaluation process by the performance assistance apparatus which concerns on the same embodiment. It is explanatory drawing for demonstrating the structure of the performance assistance apparatus which concerns on 2nd Embodiment of this invention. It is explanatory drawing for demonstrating operation | movement of the performance assistance apparatus which concerns on the same embodiment. In drawing processing, it is explanatory drawing for demonstrating the case where a display position moves to an up-down direction. In drawing processing, it is explanatory drawing for demonstrating the case where a display position moves to the front-back direction. And FIG. 14 is an explanatory diagram for explaining a configuration example of a computer that realizes a series of processes by executing a program.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,5 Performance support apparatus 2 Microphone 3 Speaker 4 Monitor 11 Practice data generation part 31 Reference position 32, 34, 35 Movement direction 41 Display screen 51, 52, 53 Evaluation result 101 Music data acquisition part 102 Music data DB
103 Practice data acquisition part 104 Practice data DB
DESCRIPTION OF SYMBOLS 105 Selection part 106 Decoder 107 Music analysis part 108,501 Playback part 109 Timer 110 Sound output control part 111 Beat display control part 112 Code display control part 113 Tab score display control part 201 Performance sound acquisition part 202 Performance analysis part 203 Code information acquisition Unit 204 Evaluation unit 205 Evaluation result display control unit 206 Evaluation result DB
207 Evaluation result output unit 502 Conversion unit 601 Bus 602 CPU
603 HDD
604 ROM
605 RAM
606 Input / output interface 607 Communication device 608 Network 609 Mouse 610 Keyboard 611 Drive 612 Removable recording medium 613 Monitor 614 Speaker 615 Microphone B1-B6 Beat information C1-C6 Code information T1-T3 Tablature information

Claims (8)

A storage unit that records chord information of a chord included in the song in association with the progress of the song;
A playback unit for playing back the music;
A performance sound acquisition unit that acquires a performance sound of a predetermined musical instrument that is played along with the music played by the playback unit;
A performance analysis unit that analyzes the performance sound acquired by the performance sound acquisition unit and calculates chord information of a chord included in the performance sound;
An evaluation unit that evaluates the performance sound based on the degree of approximation between the chord information recorded in the storage unit and the chord information calculated by the performance analysis unit;
A performance support apparatus characterized by comprising:   2. The performance analysis unit calculates chord information of a chord included in the performance sound for the performance sound corresponding to a section in which the chord information recorded in the storage unit does not change. The performance support apparatus described in 1. The performance analysis unit
Calculating a plurality of candidate chords to which the performance sound can be applied and a reliability representing the certainty of the plurality of candidate chords with respect to the performance sound;
2. The performance support apparatus according to claim 1, wherein the calculated candidate codes and the reliability are used as chord information of the performance sound. Analyzing the predetermined music using an analysis method used in the performance analysis unit, a plurality of candidate codes to which the music can correspond, and a reliability representing the likelihood of each of the plurality of candidate codes with respect to the music And a music analysis unit that uses the calculated candidate codes and the reliability as code information of the music,
The performance support apparatus according to claim 3, wherein the music analysis unit records the calculated chord information in the storage unit.   The evaluation unit evaluates the performance sound based on a difference between the reliability of each candidate chord analyzed by the performance analysis unit and the reliability of each candidate chord analyzed by the music analysis unit. The performance support apparatus according to claim 4, wherein the performance support apparatus is characterized.   The performance support apparatus according to claim 1, further comprising an evaluation result display control unit that performs display control to display an evaluation result by the evaluation unit on a display unit while music reproduction by the reproduction unit is in progress. . A playback start step for starting playback of the music;
A performance sound acquisition step of acquiring a performance sound of a predetermined musical instrument played along with the music played in the playback start step;
A performance analysis step of analyzing the performance sound acquired in the performance sound acquisition step and calculating chord information of a chord included in the performance sound;
An evaluation step for evaluating the performance sound based on the degree of approximation between the chord information of the chord included in the musical piece and the chord information calculated in the performance analysis step, which is recorded in advance in association with the progress of the musical piece; ,
A performance support method characterized by comprising: On the computer,
A storage function for recording chord information of a chord included in a song in association with the progress of the song;
A playback function for playing the music;
A performance sound acquisition function for acquiring a performance sound of a predetermined musical instrument played in accordance with the reproduced music;
A performance analysis function for analyzing the performance sound acquired by the performance sound acquisition function and calculating chord information of a chord included in the performance sound;
An evaluation function for evaluating the performance sound based on the degree of approximation between the chord information recorded in the storage function and the chord information calculated by the performance analysis function;
A program to realize

Images