JP2013083845A - Device, method, and program for processing information - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it possible for a trainee to continue to practice an instrument without interrupting the practice.SOLUTION: A device for processing information includes: a music score database 22 for registering music score information of music; an operation section 12 operated by a trainee, for, when physical restrictions relating to performance of an instrument by the trainee is inputted, obtaining the information to supply it to a controller 11; and a performance level calculation section 20 for calculating a performance difficulty degree for the player playing music by the instrument as a performance skill level on the basis of the music score information of the music registered in the music score database 22 and the physical restrictions of the trainee supplied from the controller 11. The present technique can be applied to an instrument practice device.

Description

  The present technology relates to an information processing device and method, and a program, and more particularly, to an information processing device and method, and a program that can be continued while enjoying practice for improving musical instrument performance.

  Techniques for assisting practice for improving musical instrument performance techniques have been proposed (see Patent Documents 1 to 3).

JP-A-11-167341 JP 2007-183660 A JP 2007-244102 A

  By the way, the devices and software for assisting the practice of musical instruments to enhance the performance technique of these conventional musical instruments are devised to lower the threshold for the practitioner or to enhance the entertainment property. It was functional or single purpose.

  In addition, although practice devices aimed at improving performance skills are known, since musical scores prepared only for technical improvement are presented, there is a high probability that the music is unknown to the practitioner. I never felt motivated to master it. In other words, there were many practice elements that the practitioner did not feel comfortable with the performance itself, such as repeated practice at specific locations, and it was difficult to continue the practice. Moreover, even if the practice elements are mastered by repeated practice, it is not the kind of song that is required to be played in public, so the published song needs to be practiced separately, and there is a risk that practice will be boring.

  Further, although the concept of automatically simplifying an arbitrary score is known, there has been no prior art that describes a specific method of simplification.

  This technology has been developed in view of such circumstances, and in particular, the trainer is bored with the practice itself in improving the musical instrument performance and assisting the practice of the musical instrument to increase the number of repertoires. It is intended to be able to present a musical score as a practice song so as not to frustrate or frustrate practice.

  An information processing apparatus according to an aspect of the present technology includes a musical score information acquisition unit that acquires musical score information, a restriction acquisition unit that acquires physical restrictions related to the performance of the musical instrument by a player of the musical instrument, A performance difficulty calculating unit that calculates a performance difficulty for the performer when the music is played on the musical instrument based on the musical score information and the physical constraints.

  The musical instrument may be a keyboard musical instrument, and the performance difficulty calculation unit calculates a static finger vector indicating a static arrangement of the performer's fingers for a predetermined period arranged based on the musical score of the music A static finger vector calculation unit that calculates a static finger difficulty level that indicates a static difficulty level of a player's finger for a predetermined period of time arranged based on the musical score of the music, based on the static finger vector. A finger difficulty calculation unit; a moving finger vector calculating unit that calculates a dynamic finger vector indicating a dynamic change of the performer's finger between the static finger vectors; and a musical score of the music based on the moving finger vector A moving finger difficulty calculating unit that calculates a moving finger difficulty indicating a dynamic difficulty of a player's finger in a predetermined period arranged based on a combination of the static finger vector and the moving finger vector Fingering vector calculation means for calculating a fingering vector that is In addition, for each performance technology element composed of a combination of the fingering vectors for a predetermined performance technology in the music, the static finger vector constituting the fingering vector and the static finger difficulty for the dynamic finger vector and the difficult finger motion A performance technique level is calculated from the degree, and an average value of performance technique levels of all performance technique elements included in the music is calculated as a performance difficulty level of the music.

  When the music piece is played by the musical instrument by the performer, a listening unit that listens to the played music piece, a score conversion unit that converts the music listened to by the listening unit into a score, and the score conversion unit By comparing the score converted by the score with the score obtained from the score information of the music, a music level different from the music is recommended based on the performance level calculation unit for obtaining the performance level of the performer and the performance level. A recommendation section can be included.

  Including a score simplification processing unit that simplifies the score of the original music of the music so as to reduce the difficulty of playing, and the recommendation unit, when the performance level is lower than a first predetermined threshold, A musical composition different from the musical composition having a lower performance difficulty level simplified by the musical score simplification processing section is recommended.

  When the performance level is higher than a second predetermined threshold value that is higher than the first predetermined threshold value, the recommendation unit includes the music piece having a higher performance difficulty level converted by the score conversion unit, and Can recommend different songs.

  When the performance level is higher than a second predetermined threshold higher than the first predetermined threshold in the mode for improving the performance level of the performer, the recommendation unit has the performance difficulty level. It is possible to recommend a music that is higher and has the same original music as the music but is different from the music.

  In the mode of increasing the repertoire of music that can be performed by the performer, the recommendation unit includes the performance unit when the performance level is higher than a second predetermined threshold value that is higher than the first predetermined threshold value. It is possible to recommend a song having the same difficulty level and a different original song from the song.

  In the recommendation unit, in the mode in which the performance level of the performer is improved and the repertoire of music that can be performed is increased, the performance level is higher than the first predetermined threshold. Is higher than the threshold value, and the performance difficulty level is substantially the same according to the number of repertoires that can be performed by the performer and the performance level of the performer, and the original music is different from the music Alternatively, it is possible to recommend one of the music pieces having a higher performance difficulty level and the same music and the original music but different from the music.

  An information processing method according to an aspect of the present technology is a constraint in which the information processing apparatus performs score information acquisition processing for acquiring music score information of a musical piece, and acquires physical restrictions related to the performance of the instrument by a musical instrument player. A matter acquisition process is performed, and a performance difficulty calculation process is performed to calculate a performance difficulty for the performer when the music is played on the musical instrument based on the musical score information and the physical restrictions. .

  A program according to one aspect of the present technology includes a computer, a score information acquisition unit that acquires musical score information, a restriction acquisition unit that acquires physical restrictions related to the performance of the musical instrument by a musician, A program for functioning as a performance difficulty calculation unit for calculating a performance difficulty for the performer when playing the music on the musical instrument based on the musical score information of the music and the physical restrictions .

  The information processing apparatus of the present technology may be an independent apparatus or a block that performs information processing.

  According to the present technology, it is possible to improve music performance technology or to continue practice while enjoying practice for increasing the number of repertoires.

It is a figure showing an example of composition of an embodiment of an information processor to which this art is applied. It is a figure explaining the kind of practice mode. It is a figure explaining the kind of practice mode. It is a flowchart explaining practice support processing. It is a flowchart explaining a YG level simple confirmation process. It is a flowchart explaining a score simplification process. It is a figure explaining a score simplification process. It is a figure explaining a static finger vector. It is a figure explaining a static finger difficulty. It is a figure explaining the physical restriction | limiting which concerns on the performance of a musical instrument. It is a figure explaining the change of a static finger vector. It is a figure explaining the state transition diagram which paid its attention to the motion of one finger | toe. It is a figure explaining a moving finger vector. It is a figure explaining a moving finger difficulty. It is a figure explaining a fingering vector. It is a figure explaining a performance technical element. It is a figure explaining the YG level for every performance technical element of a music. It is a figure explaining simplification of a static finger difficulty. It is a figure explaining simplification of a static finger difficulty. It is a figure explaining the simplification using turning. It is a figure explaining simplification of a moving finger difficulty. It is a figure explaining simplification of a moving finger difficulty. It is a figure explaining the example of the score with which the moving finger difficulty was simplified. It is a figure explaining the example of the score simplified by increasing (DELTA) t. It is a figure explaining the example of the simplified musical score. It is a figure explaining the example of the simplified musical score. It is a flowchart explaining a YG level determination process. It is a flowchart explaining an evaluation value calculation process. It is a flowchart explaining an evaluation value calculation process. It is a figure explaining repertoire number distribution. It is a flowchart explaining the same YG level music recommendation process. It is a flowchart explaining the other same YG level music recommendation process. It is a figure explaining the calculation method of similarity. It is a figure explaining the example of the calculation method of similarity. And FIG. 11 is a diagram illustrating a configuration example of a general-purpose personal computer.

[Configuration example of information processing device to which this technology is applied]
A configuration example of an information processing apparatus to which the present technology is applied will be described with reference to FIG.

  The information processing apparatus of FIG. 1 is a musical score to be practiced so as to improve the performance technique of the practitioner and improve the repertoire of music that can be performed by the practitioner when the practitioner practices the performance of the musical instrument. By presenting the musical score) as practice music according to the performance technique of the practitioner, performance practice is assisted. As for the information processing apparatus 1 in FIG. 1, an example for performance practice of a keyboard instrument such as a piano or an electric tone will be described. By applying this technology, performance practice for other instruments is assisted. It is also possible to do.

  The information processing apparatus 1 includes a control unit 11, an operation unit 12, a performance information recording unit 13, an evaluation unit 14, a learning selection unit 15, a practitioner information record holding unit 16, a score recommendation unit 17, and a score simplification processing unit 18. I have. The information processing apparatus 1 also includes a presentation unit 19, a performance level calculation unit 20, a score selection unit 21, a score database (DB) 22, and a new score registration unit 23.

  The control unit 11 is composed of a microcomputer or the like, and controls the entire operation of the information processing apparatus 1. The operation unit 12 includes a keyboard and operation buttons operated by a practitioner. The operation unit 12 is operated when inputting a practice mode, music to be played, and physical restriction (constraint) information of the practitioner. A corresponding operation signal is generated. When the instrument is played by the practitioner, the performance information recording unit 13 records the performance of the practitioner and supplies it to the evaluation unit 14. More specifically, the performance information recording unit 13 includes a microphone 13a, a camera 13b, and a sensor 13c. The microphone 13a acquires and records the sound emitted from the keyboard instrument when the practitioner performs. The camera 13b captures an image that shows a practitioner's finger usage (which finger is pressing which keyboard) related to the performance of the keyboard, pedals, and the like. The sensor 13c measures the pressure or the like related to the pressing operation on the keyboard or pedal of the musical instrument, and measures the strength of the practitioner during performance. The performance information recording unit 13 records sound, images, and pressure measurement results measured by the microphone 13a, the camera 13b, and the sensor 13c as performance information and supplies the performance information to the evaluation unit 14.

  Based on the performance information supplied from the performance information recording unit 13, the evaluation unit 14 obtains an evaluation value based on the performance by the practitioner as the performance level of the practitioner, and records the practitioner information including a hard disk or the like as the practitioner information. The holding unit 16 is held in association with the practitioner. More specifically, the evaluation unit 14 includes a simple evaluation unit 51 and a score conversion unit 52. When registering a practitioner, the simple evaluation unit 51 simply obtains the performance technique level (hereinafter also referred to as YG level) of the first practitioner. More specifically, when the YG level of the practitioner made by the evaluation unit 14 is obtained, the sound obtained by the microphone 13a, the image of the practitioner's finger using the camera 13b, and the sensor 13c are used. The simple evaluation unit 51 obtains the YG level of the practitioner with only the sound acquired by the microphone 13a, whereas the YG level of the practitioner is obtained based on the information of the pressure to press the measured keyboard. “Simple” is attached. The score conversion unit 52 converts the performance sound into a score (performance score) based on the sound acquired when the practitioner acquired by the microphone 13a plays the musical instrument. The simple evaluation unit 51 simply obtains the YG level by comparing the performance score that is the score converted in this way with the target score that is the score presented to the practitioner.

  When the operation unit 12 is operated and an operation signal for selecting a practice mode for selecting a song recommended as a practice song is issued to the learner, the learning selection unit 15 displays information on the corresponding practice mode. This is supplied to the control unit 11. Here, there are three types of practice modes: first to third modes. The first mode is a practice mode in which practice songs are sequentially recommended and presented so as to improve the performance technique of the music that the trainer wants to be able to perform. The second mode is a practice mode in which practice songs are sequentially recommended and presented so as to increase the repertoire of songs that can be played at the performance level of the practitioner. Furthermore, the third mode is a practice mode in which practice music is sequentially recommended and presented so as to increase the repertoire of music that can be played while improving performance techniques.

  The score recommendation unit 17 selects a music corresponding to the YG level of the practitioner included in the practitioner information recorded in the practitioner information record holding unit 16 from the scores registered in the score DB 22. The information of the selected score is supplied to the score selection unit 21. The score selection unit 21 reads the recommended score data from the score DB 22 and presents it as a target score, which is a practice song, to the presentation unit 19 composed of an LCD (Liquid Crystal Display), an organic EL (Electronic Luminescent), or the like. The practitioner repeats the practice by playing the instrument while viewing the score presented as practice music in the presentation unit 19.

  The score simplification processing unit 18 simplifies the score step by step while maintaining the musicality of the original song in order with the score of the original song as the highest difficulty, and presents the score corresponding to the trainee's YG level as a practice song It is presented at 19. Therefore, in the first process, the score simplification processing unit 18 repeats the simplification process until the score corresponding to the YG level of the practitioner supplied from the control unit 11 is obtained, and the score corresponding to the YG level of the practitioner is repeated. Is presented to the presentation unit 19 as a practice song. At this time, the performance level calculation unit 20 uses the music score and the practitioner based on the simplified score that is sequentially generated and the physical restriction information such as the size of the hand of the practitioner or the length of the finger. Each YG level is calculated and supplied to the score simplification processing unit 18.

  More specifically, the performance level calculation unit 20 includes a performance technology element list 31, a static finger vector calculation unit 32, a static finger difficulty calculation unit 33, a moving finger vector calculation unit 34, a moving finger difficulty calculation unit 35, and a luck. A finger vector calculation unit 36 is provided. The static finger vector calculation unit 32 obtains a static finger vector obtained by vectorizing the finger arrangement when the keys are sequentially pressed in predetermined time units based on the score. The static finger difficulty calculator 33 calculates the difficulty set based on the physical restriction for each static finger vector. The moving finger vector calculation unit 34 calculates a moving finger vector defined by the difference of the static finger vectors obtained sequentially. The moving finger difficulty calculator 35 calculates the difficulty set based on the physical restriction for each obtained moving finger vector.

  The fingering vector calculation unit 36 calculates a fingering vector from the adjacent finger vector and a moving finger vector obtained from the difference between the adjacent finger vectors. The performance level calculation unit 20 searches for a predetermined performance technology element from a combination of fingering vectors registered in the performance technology element list 31, and for each searched performance technology element, the static level that is the element is searched. The difficulty level for each performance technology element is set based on the finger difficulty level and the moving finger difficulty level. Then, the performance level calculation unit 20 calculates the average value of the difficulty levels set for all performance technology elements included in the music as the performance technology level of the musical score, that is, the YG level. Details of the calculation of the YG level will be described later. During this time, the new score registering unit 23 registers the simplified score generated repeatedly and sequentially in the score DB 22 together with the YG level as a new score.

[Practice mode]
Next, the details of the practice mode in the information processing apparatus 1 will be described with reference to FIGS.

  As described above, the information processing apparatus 1 can set three types of practice modes of the first to third modes.

  That is, as shown in FIG. 2, if the horizontal axis is the number of songs that the practitioner can play, that is, the number of repertoires, and the vertical axis is the YG level of the practitioner, Appropriate music is presented as practice music in the order indicated by arrows A to C. That is, the arrow A in FIG. 2 indicates the order in which the music pieces are presented in the first mode, and the practice mode in which the musical score of the practice music is presented so as to increase the YG level for the same music in the first mode. It is shown that. Accordingly, when the practice mode is the first mode, the repertoire number of the same music is not increased because the music score of the practice music is changed so that the YG level of the music is gradually increased. However, it is possible to obtain a high YG level for specific music. That is, in the first mode, it can be said that this is a practice mode suitable for practicing with the motive that the trainer wants to be able to play this music.

  In addition, an arrow C in FIG. 2 indicates the order of presenting the music pieces in the second mode, and the music score of the practice music is increased so that the second mode increases the number of music pieces that can be played although they are the same YG level music pieces. This is a practice mode that presents. Therefore, when the practice mode is the second mode, the score of the practice song is presented so that the repertoire gradually increases, so the YG level cannot be raised, but a song that can be played for a particular YG level song The number, that is, the number of repertoires can be increased. In other words, the second mode is suitable for practicing with the motivation to increase the repertoire and continue practicing because the practitioner has a boring personality and cannot continue practicing. It can be said that it is a practice mode.

  Furthermore, the arrow B in FIG. 2 shows the order of presenting the music in the third mode, and the third mode presents the score of the practice music so as to increase the YG level and increase the number of repertoires. Indicates practice mode. Therefore, when the practice mode is the third mode, the score of various original songs is presented as practice songs so that the YG level is increased and the number of repertoires is increased. It becomes possible to increase the number comprehensively.

  More specifically, when the music composed of the original music score is music a to c and the YG level is 1 to 3, the YG level of the original music score is 3 which is the most difficult, The score of the original music is scored a3, b3, and c3. In addition, it is assumed that the scores a3, b3, and c3 are simplified, and the two scores with the YG level lowered by one are scored a'2, b'2, and c'2. Further, it is assumed that the scores a'2, b'2, and c'2 are further simplified, and the score of one score obtained by lowering the YG level by one step is the scores a'1, b'1, and c'1. When the horizontal axis is the repertoire music and the vertical axis is the YG level, these musical scores are arranged as shown in FIG.

  For example, when the information processing apparatus 1 increases the number of repertoires of music pieces that are practice songs to be presented to the practitioner, the practice songs are recommended in the order of songs a, b, and c. In this case, when the practice mode is the first mode, the information processing apparatus 1 recommends the score a′1 as a practice song first, and considers that the practitioner can sufficiently play the score a′1. And recommends a score a′2 having the same original music. Furthermore, when the practitioner considers that the score a'2 can be sufficiently performed, the information processing apparatus 1 recommends the score a3 that is the original music. The practitioner starts practicing the music he / she wants to play in this practice mode using the most simplified score, gradually increasing the YG level, and finally the original music score. It becomes possible to perform.

  Further, when the practice mode is the second mode, the information processing apparatus 1 recommends the score a′1 as the music to be practiced first, and the practitioner regards the score a′1 as being sufficiently playable. However, although the original music is different, the music score b'2 of the same YG level is recommended. Further, the information processing apparatus 1 recommends the score c′1 when the practitioner considers that the score b′1 can be sufficiently performed. The practitioner can only increase the number of repertoires of musical pieces that can be played, although only the score simplified most by such practice mode.

  Further, when the practice mode is the third mode, the information processing apparatus 1 recommends the score a′1 as the music to be practiced first, and the practitioner considers that the score a′1 can be sufficiently played. And recommends a score a′2 having the same original music. Further, when the practitioner considers that the score a'2 can be sufficiently performed, the information processing apparatus 1 recommends the score b'2 having the same YG level but different original music. If the practitioner considers that the score b'2 can be sufficiently performed, the information processing apparatus 1 recommends the score c'2 having the same YG level although the original music is different. Further, when the practitioner considers that the score c'2 can be sufficiently played, the information processing apparatus 1 recommends a score c3 having the same original music but a higher YG level. The practitioner starts practicing the music he / she wants to play in this practice mode using the most simplified score, and while gradually practicing the music with different original music, gradually raising the YG level Eventually, it is possible to play the same score as the YG level of the music that he / she wants to play, although it is different from the music he / she wants to play. At this point, it is considered that the YG level is actually increased, so that the practitioner can easily perform the music a3 or the music a2 that he / she wanted to play. Can be considered. That is, in the third mode, the practitioner can increase the repertoire while increasing the YG level. However, in the case of the third mode, as shown in FIG. 3, it is expected that it will take some time to improve.

[Practice support processing]
Next, with reference to the flowchart of FIG. 4, a description will be given of practice support processing for a practitioner of musical instrument performance by the information processing apparatus 1 of FIG. 1.

  In step S <b> 1, the control unit 11 controls the presentation unit 19 to obtain information necessary for the practitioner, that is, an image requesting input of the music, the practitioner information, and the practice mode that the practitioner wants to be able to play. Present. Here, the practitioner information is a practitioner's face image, name (handle name, etc.), performance technique level (YG level), and physical restriction information. For example, when the practitioner's YG level is 10 levels, his / her YG level may be reported, or a musical score of some music is presented and played, and the played music is evaluated and obtained. You may do it. As will be described later, here, an example will be described in which a musical score of some kind of music is presented and played, and evaluation is performed based on the played music. The physical restriction information indicates information that is physically restricted when the practitioner plays the musical instrument, and is information such as the size of the practitioner's hand and the length of the finger, for example. These pieces of information may be captured by a camera 13b or the like provided in the performance information recording unit 13, or the length may be input by a numeric keypad.

  In step S <b> 2, the control unit 11 determines whether or not the music unit, the learner information, and the practice mode are input by operating the operation unit 12, and the same processing is repeated until it is determined that the input is performed. . If the operation unit 12 is operated in step S2 and it is considered that the music, the practicer information, and the practice mode are input, the process proceeds to step S3.

  In step S <b> 3, the control unit 11 searches for the practitioner information held in the practitioner information record holding unit 16 based on the practitioner information input by operating the operation unit 12. It is determined whether it is registered. That is, it is determined whether or not the trainee has already received practice support. In step S3, for example, when the trainee information does not exist, that is, when it is considered that the trainer is the first to receive practice support, the process proceeds to step S4.

  In step S4, the control unit 11 controls the evaluation unit 14 to execute the YG level simple confirmation process, and simply confirms the YG level of the practitioner.

[YG level simple confirmation process]
Here, the YG level simple confirmation process will be described with reference to the flowchart of FIG.

  In step S <b> 31, the simple evaluation unit 51 of the evaluation unit 14 accesses the score DB 22 to select and read the score of the music that is the subject song. The simple evaluation unit 51 may select a musical score of a music piece having an average YG level, or may select a musical score of a predetermined musical piece for simply measuring the YG level. May be. In addition, since it is sufficient if the YG level can be easily measured, a relatively short musical score may be selected.

  In step S32, the simple evaluation unit 51 presents (presents) the musical score read from the musical score DB 22 to the presentation unit 19 so that it can be played by the practitioner and displays information prompting the practitioner to perform. To do. This allows the practitioner to perform while watching the score.

  In step S33, the simple evaluation unit 51 sequentially acquires performance information recorded by controlling the microphone 13a of the performance information recording unit 13. That is, the microphone 13a acquires the sound of the musical instrument played by the practitioner.

  In step S34, the simple evaluation unit 51 compares the performance information and the presented score to calculate the similarity. More specifically, the simple evaluation unit 51 controls the score conversion unit 52 to convert it into a score composed of speech information acquired by the microphone 13a, that is, a performance score, and reproducibility by comparison with the presented score. The similarity is calculated based on whether or not there is. That is, the simple evaluation unit 51 compares, for example, whether or not it matches the performance score based on all the sounds of the presented score, and calculates the matching rate as the similarity.

  In step S35, the simple evaluation unit 51 determines whether or not the similarity is higher than a threshold that is the upper limit of the standard level of the YG level. For example, the similarity is the upper limit of the standard level of the YG level. If the level is not higher than the threshold, the process proceeds to step S36.

  In step S36, the simple evaluation unit 51 determines whether or not the similarity is lower than a threshold that is a lower limit of the standard level of the YG level. For example, the similarity is a lower limit of the standard level of the YG level. When the level is not lower than the threshold value, that is, when the level is the standard level, the process proceeds to step S37.

  In step S37, the simple evaluation unit 51 regards the YG level of the practitioner as the standard level, and uses the YG level obtained simply as the practitioner information as the YG level of the practitioner. To hold.

  In step S36, if the similarity is a level lower than the threshold that is the lower limit of the standard level of the YG level, in step S38, the simple evaluation unit 51 considers that the trainee's YG level is a lower level. The YG level simply obtained as the practitioner information is held in the practitioner information record holding unit 16 as the YG level of the practitioner.

  Furthermore, in step S35, when the similarity is higher than the threshold value that is the upper limit of the standard level of the YG level, in step S39, the simple evaluation unit 51 considers that the trainee's YG level is the advanced level. The YG level simply obtained as the practitioner information is held in the practitioner information record holding unit 16 as the YG level of the practitioner.

  As a result of the above processing, if the YG level has three levels, it is possible to classify the upper level, the standard level, and the lower level. When the number of levels is greater than this, when the upper limit of the standard level is exceeded, the score of the YG level music higher than the presented music is repeatedly presented and played, and the standard level is repeated. When the value falls below the lower limit, it is possible to confirm even if the YG level of the practitioner is at a higher level by repeating the presentation of the music score of the music at a lower YG level than the presented music. it can. In addition, when the YG level is set to about 100 levels, for example, 30, 50, and 80 temporary values as representative values with respect to the advanced level, the standard level, and the lower level obtained in the above-described method. The YG level may be set simply.

  Now, the description returns to the flowchart of FIG.

  When the YG level simple confirmation process is executed by the process of step S4 and the YG level of the practitioner is simply obtained, in step S5, the control unit 11 accesses the practitioner information record holding unit 16 to practice. The YG level of the trainee is read out and supplied to the score simplification processing unit 18 to instruct the trainee to simplify the score to be played to the trainee's YG level or a YG level in the vicinity thereof. The score simplification processing unit 18 executes score simplification processing based on this command, and the score that the practitioner wants to perform is left at the YG level of the practitioner or the vicinity thereof while leaving the musicality of the music. Simplify to YG level. At this time, the score selection unit 21 acquires the score information of the music that the practitioner wants to perform, which is input by the operation unit 12, is read from the score DB 22, and is supplied to the presentation unit 19. .

[Music score simplification processing]
Here, the music score simplification process will be described with reference to the flowchart of FIG.

  In step S51, the performance level calculation unit 20 reads the musical score information read by the presenting unit 19 and controls the static finger vector calculation unit 32 to calculate the YG level of the entire song, thereby controlling the musical composition. A static finger vector is calculated.

[YG level required for music performance]
Here, a method of calculating the YG level based on the musical score, that is, the performance technique level required for performance will be described.

  In obtaining the YG level based on the musical score of the music, the finger vector, the moving finger vector, and the fingering vector that is a combination thereof are defined. Degree and difficulty of moving finger are defined. Eventually, the YG level necessary for performance based on the musical score is calculated from the static finger difficulty level and the moving finger difficulty level.

  First, the static finger vector calculation unit 32 decomposes the performance information described in the score into fine time units. For example, as shown in FIG. 7, the musical score is discretely sampled in a minimum unit, such as times t1 to t5, with the change points of the notes described in the musical score as a delimiter. Since the time of each performance sample point is a change point of a note, the sampling period is not equal. For example, in the case of the score shown in FIG. 7, since the performance tempo is 120 BPM (Beat per min), the performance time per quarter note is about 500 ms, and the eighth note is 250 ms per unit. Therefore, the time between times t2 and t1 is 500 milliseconds, and the time between times t3 and t2 is 250 milliseconds.

  Further, as shown in the upper right part of FIG. 8, a number unique to each keyboard (keyboard number) is assigned to the keyboard of the keyboard instrument in order from the left. For example, suppose that the lowest note number in 88 keys is 1, and each time the sound goes up, the number is incremented by 1, such as 2, 3,. Here, for example, when a black key exists between the white key 1 and the white key 2, the keyboard number of the black key is 1.5. Of course, you may give the serial number which mixed white key and black key.

  In addition, as shown in the left part of FIG. 8, a finger-specific number (finger number) is assigned to the fingers of the left and right hands to be played. For example, as shown in the left part of FIG. 8, the order of the thumb, index finger, middle finger, ring finger, and little finger of the left hand is set to finger numbers 0 to 4, and the thumb, index finger, middle finger, ring finger, little finger of the right hand Are the finger numbers 5 to 9.

  If the above notation method is used, the state of the finger of the hand performing at each performance sample point can be expressed in a matrix. For example, as shown in the lower right part of FIG. 8, when playing a domiso with the thumb, middle finger, and little finger of the left hand, and a thumb with the thumb of the right hand, the fingers of both hands press the keyboard numbers 1, 3, 5 and 8 in order from the left. doing. When no key is pressed by the finger, the keyboard number is 0. The information of the performance time of 0.1 seconds is added to this, and the static finger vector SV is expressed in a matrix as shown in the lower right part of FIG. The static finger vector SV represents the state of the finger pressing the keyboard of each performance sample point.

  That is, in step S51, the static finger vector calculation unit 32 calculates the static finger vector defined as described above. Although the static finger vector is defined with reference to FIG. 8, there are many static finger vectors that are performance sample points because there are various musical compositions.

  In step S52, the static finger difficulty calculation unit 33 calculates the static finger difficulty based on the static finger vector.

  Now consider the difficulty of playing keyboard instruments. When considering the difficulty of playing a keyboard instrument, 1 may be the difficulty of a finger pressing pattern. For example, it is physically difficult to press a chord with an opening of nearly one octave with one hand.

  The static finger difficulty level calculation unit 33 calculates the difficulty level of the finger press pattern for each static finger vector. That is, the difficulty level of finger pressing depends on physical restriction information such as the skeleton of the hand (hand size, finger length, etc.) and muscles, and the physical shape of the keyboard instrument keyboard. You can think of it. The finger difficulty calculation unit 33 defines the finger pressing difficulty based on the physical restriction information input as the practitioner information as a finger difficulty, and the finger difficulty is calculated for each finger vector. Set. Therefore, even if it is the same music, the practicing finger difficulty differs for each practitioner.

  The static finger difficulty calculation unit 33 gives the static finger difficulty as a continuous value, for example, from 0.0 (easiest) to 100.0 (most difficult). Further, as shown in FIG. 9, the finger difficulty calculation unit 33 may define the left hand difficulty SDL and the right hand difficulty SDR separately for the left hand and right hand patterns excluding the performance time. . In this case, the difficulty level of the left and right hands is defined in one static finger vector.

  More specifically, for example, if the total number of keys of a keyboard instrument is 88 keys, the total number of pressed patterns using five or less fingers of the left hand is obtained as in the following equation (1). There will be about 5 billion types. Therefore, there are about 10 billion ways left and right, which is a finite number. Since this total number is obtained purely by mathematical calculation, it can be seen that most patterns are practically impossible to press down, and the fingering difficulty is almost 100.0.

  Here, each term of the first term to the fifth term is the number of arrangement patterns for each of the thumb, index finger, middle finger, ring finger, and little finger.

  Therefore, the difficulty level of the finger may be converted into a coefficient table by obtaining all the difficulty levels for each practitioner in advance for a pressing pattern smaller than 100.0. Note that the method of obtaining the finger vector and the corresponding finger difficulty level may be subjectively defined by the teacher player, or statistically obtained from performance error information of a large number of players. In addition, as to how to obtain the static finger vector and the corresponding difficulty level, the finger shape, keyboard distance, and physical restriction information may be modeled and automatically generated by calculation.

  The physical restriction information is information indicating that the reachable range of the finger is restricted by the physical distance of each finger or the angle of the palm with respect to the keyboard as shown in FIG. For example, the static finger difficulty calculation unit 33 uses information on the hand size and finger length in the practicer information based on the physical restriction information indicating the size of the hand for the distance constraint in FIG. However, the tendency that the difficulty level increases as the distance between the keys increases is the same. Therefore, when calculating the relative finger difficulty level by calculation, the static finger difficulty level calculation unit 33 determines the standard hand size. It may be obtained as a model, and may be enlarged or reduced using the hand size of the practitioner information. In addition, as shown in FIG. 10, a prior restriction condition is prepared such that the keyboard number of the keyboard pressed by the finger of finger number 9 is not less than the keyboard number of the keyboard pressed by the finger of finger number 7. By doing so, the number of patterns for which the degree of difficulty should be obtained can be greatly reduced, and the table calculation can be performed efficiently.

  In the lower part of FIG. 10, the distance between the right thumb and the index finger from the top is a maximum of five keys, the distance between the right thumb and the middle finger is a maximum of 7.5 keys, and the right index finger and the middle finger Is a maximum of three keyboards, and the constraint condition is that the distance between the right-hand ring finger and the little finger is the maximum of 1.5 keyboards. Accordingly, since the distance between the thumb and index finger of the right hand shown in the upper part of FIG. 10 is 2.5 (2.5 keys), it is about half of the distance constraint 5 and the difficulty level is moderate. Can be considered. On the other hand, since the distance between the index finger and the middle finger is 3 (for 3 keys), it is the same as 3 that is the distance constraint, so it can be considered that the degree of difficulty is high. As described above, the difficulty level of the finger is set based on, for example, the average value of the distance constraint between the fingers.

  In addition, since the coefficient table only needs to be created once and is not recreated for each performance, the coefficient table creation cost can be set only at the time of the first creation. Therefore, in this case, the process of step S52 is a process of reading out the finger difficulty level corresponding to the finger vector from the table.

  When the static finger vector is obtained by the processing of steps S51 and S52 and the difficulty level of the static finger is obtained, in step S53, the moving finger vector calculation unit 34 determines the moving finger that is the difference between the obtained static finger vectors. Calculate the vector.

  Here, the moving finger vector will be described. An actual performance of a keyboard instrument can be regarded as a change in the static finger vector. That is, as shown in FIG. For example, when playing a dormitory at time t1 and playing a dormitory at time t2, the finger vector SV1 changes to the finger vector SV2. In the example of FIG. 11, the state of changing to the silent finger vectors SV1 to SV4 is shown. That is, at time t1, the vector SV1 is [0.1, 1, 0, 3, 0, 5, 8, 0, 0, 0, 0] from above, and at time t2, the vector SV2 is from above. [0.3, 1, 0, 3, 0, 5, 8, 0, 10, 0, 0]. At time t3, the vector SV3 is [0.6, 5, 0, 7, 0, 9, 0, 0, 0, 0, 0] from above. At time t4, the vector SV4 is from above. [0.9, 5, 0, 7, 0, 9, 11, 0, 0, 0, 0].

  Here, attention is focused on the movement of one finger when the static finger vector changes. FIG. 12 shows a state transition diagram of the movement of one finger. Usually, the finger is free when nothing is played. Further, it is assumed that the keyboard is in a fixed state when any key is pressed. Here, four transition patterns of transitions A, B, C, and D can be defined as patterns that transition between the two states. That is, the transition A is a transition in which the finger is changed from the free state to the fixed state. That is, a state transition corresponding to an operation in which a certain finger presses some keyboard from a free state is shown. Transition B is a transition in which the finger changes from a fixed state to a free state. That is, state transition corresponding to an operation of releasing a finger from pressing the keyboard is shown. Transition C is a state in which a finger is pressing and holding the same keyboard. That is, for example, at a certain time, the thumb is pressing the keyboard. When the little finger presses another key while keeping the thumb as it is at the next time, the movement of the thumb indicates a state transition corresponding to the transition C. Transition D is an operation of pressing another keyboard at the next time from a state where a finger is pressing a certain keyboard. That is, for example, when the thumb presses the keyboard of the keyboard at a certain time and the thumb presses the keyboard of the keyboard at the next time, this thumb motion indicates a state transition corresponding to the transition D. A state transition corresponding to transition D is also shown when the same key is pressed again with the same finger. Transition E is an operation in which a finger repeatedly strikes the same keyboard, and shows a kind of state transition of transition D.

  Furthermore, as shown in FIG. 13, when the transition is made from the static finger vector SV1 to SV2, many fingers move in a short time. A thing representing this movement is defined as a moving finger vector MV.

  For example, when the finger vector SV1 changes to the finger vector SV2, the moving finger vector MV1 is obtained as the finger vector SV2-the finger vector SV1. The moving finger vector MV1 is obtained by subtracting the static finger vector SV1 at time t1 from the static finger vector SV2 at time t2, and is a difference vector between the two static finger vectors. The top element of the matrix represents the difference time.

  For example, in the case of the moving finger vector MV2 in FIG. 13, the values of finger numbers 0, 2, and 4 are 4, respectively. This means that the change time from the static finger vector SV2 to the static finger vector SV3 is 0.25 seconds, and each finger has moved by four white keys. For example, if the width of the white key is about 2.2 cm, it will move 8.8 cm in 0.25 seconds.

  In FIG. 13, values A, B, and C in the moving finger vector indicate the state transition described in the state transition diagram of FIG.

  Although the moving finger vector is defined as described above, there are a large number of moving finger vectors that are performance forms because various musical compositions exist.

  When the moving finger vector is obtained by the process of step S53, the moving finger difficulty calculating unit 35 calculates the moving finger difficulty based on the moving finger vector in step S54.

  Here, the moving finger difficulty will be described. The moving finger difficulty level is defined in the same manner as the static finger difficulty level described with reference to FIG. That is, when considering the difficulty of playing a keyboard instrument, there is not only the difficulty of moving the finger, but also the difficulty of moving the finger in a short time. For example, it is difficult to accurately jump a finger to a pitch that is close to one octave in 250 milliseconds.

  The moving finger difficulty calculation unit 35 defines the difficulty level of the finger movement pattern for each moving finger vector. In other words, the difficulty of finger movement depends on physical limitations such as the skeleton of the hand (the size of the hand, the length of the finger, etc.), the muscles, and the keyboard of the keyboard instrument. Can be considered. Therefore, the moving finger difficulty level calculation unit 35 calculates the difficulty level of finger movement based on the physical restriction information of the practitioner as the moving finger difficulty level. Therefore, as for the moving finger difficulty level, as with the static finger difficulty level, different values are required for each practitioner even for the same music piece.

  That is, the moving finger difficulty level calculation unit 35 calculates a continuous value, for example, from 0.0 (easiest) to 100.0 (most difficult). Further, as shown in FIG. 14, the moving finger difficulty level calculation unit 35 may divide into left hand and right hand patterns and define and calculate a left hand difficulty level MDL and a right hand difficulty level MDR, respectively. . In this case, two difficulty levels are defined for one moving finger vector.

  More specifically, for example, if the total number of keys of a keyboard instrument is 88 keys, the total number of moving finger vectors is obtained as shown in the following equation (2), so there are about 245 billion. The total number of left and right is about 490 billion, which is a finite number. Since this total number is obtained purely by mathematical calculation, it can be seen that most patterns are practically impossible to press, and the moving finger difficulty is almost 100.0.

  Therefore, a coefficient table may be created by obtaining all the difficulty levels for the pressing pattern having a moving finger difficulty level smaller than 100.0. It should be noted that the method of obtaining the moving finger vector and the corresponding moving finger difficulty level may be subjectively defined by the teacher player, or statistically obtained from performance error information of a large number of performers. In addition, this coefficient table only needs to be created once and not re-created for each performance, so by creating a coefficient table, the cost for creating the coefficient table should be limited to the initial creation. Can do.

  Note that the difference time information is not included in the calculation of the total number. That is, the difficulty of finger movement is considered to increase as the finger movement time, that is, the difference time is shorter. Therefore, the difficulty level of fingering is expressed by the standard difference time, for example, the difficulty level of a standard player at 500 ms, and the ratio of the actual difference time and the standard difference time of 500 ms is used. The degree of difficulty shall be calculated. For example, the reciprocal of the difference time / 500 ms may be multiplied by the coefficient of the fingering difficulty.

  In step S55, the fingering vector calculation unit 36 calculates a fingering vector composed of a combination of a static finger vector and a moving finger vector.

  Here, the fingering vector will be described. When focusing on the difficulty level of performance, the difficulty level is considered to be a combination of a static finger vector and a moving finger vector. Therefore, as shown in FIG. 15, a combination of a static finger vector and a moving finger vector is defined as a fingering vector FV. For example, it is assumed that the fingering vector FV1 is composed of three vectors of the static finger vectors SV1 and SV2 and the moving finger vector MV1. In FIG. 15, the state of moving from the fingering vector FV1 to the fingering vector FV2 and from the fingering vector FV2 to the fingering vector FV3 is shown.

  Therefore, the difficulty level of the fingering vector can be considered as a combination of the static finger difficulty level of the included static finger vector and the dynamic finger difficulty level of the moving finger vector.

  In step S56, the performance level calculation unit 20 searches and extracts performance technology elements registered in advance in the performance technology element list 31 with reference to the obtained fingering vector arrangement pattern.

  Here, performance technical elements will be described. For example, there is a performance technique called trill with a keyboard instrument, and when this is considered as a performance technique element, the performance technique element can be expressed as a combination of fingering vectors. For example, as shown in FIG. 16, when the performance technique of trill is composed of a series of fingering vectors FV4 to FV7, this group of fingering vectors is defined as a performance technique element TE.

  In the example of FIG. 16, the flow of a series of performances is composed of three groups of performance technology elements TE1 to TE3, and the series of performances is composed of three performance technology elements.

  The group of performance technology elements may be disassembled for each measure, or may be disassembled by separating the places where there are rests. These performance technology elements are recorded and stored in the performance technology element list 31 in a database in advance.

  In step S57, the performance level calculation unit 20 calculates a difficulty level as a performance technology level for each calculated performance technology element based on the static finger difficulty level and the moving finger difficulty level. More specifically, since the performance technique element is a combination of fingering vectors, first, the performance level calculation unit 20 calculates the difficulty level of each fingering vector. Each fingering vector is composed of two static finger vectors and one moving finger vector. For this reason, the performance level calculation unit 20 calculates the difficulty level of each fingering vector as an average value of the static finger difficulty level of the static finger vector and the moving finger vector level of the moving finger vector. Further, the performance level calculation unit 20 calculates, for each performance technology element, an average value of the difficulty levels of the fingering vectors constituting each performance technology level, that is, a YG level for the performance technology element. For example, as shown in FIG. 17, when the average of the fingering difficulty and the fingering difficulty of the performance technique element TE1 including the fingering vectors FV1 to FV3 included in the music piece A is 18, The YG level is 18. Similarly, when the average of the fingering difficulty and the fingering difficulty of the performance technology element TE2 including the fingering vectors FV4 to FV7 included in the music piece A is 15, the YG level of the performance technology element TE2 is set to 15. . Furthermore, when the average of the difficulty level of the fingering technique and the difficulty level of the moving finger of the performance technique element TE3 including the fingering vectors FV8 and FV9 included in the music A is 15, the YG level of the performance technique element TE3 is set to 15. In calculating the YG level, an average value obtained by weighting the difficulty level for each configuration of the moving finger vector or the static finger vector may be used as the performance technique level.

  In step S58, the performance level calculation unit 20 calculates an average value of YG levels obtained individually for each performance technology element included in the score of the music that is the original music as the YG level of the music of the original music. That is, for example, as shown in FIG. 17, when performance technical elements TE1 to TE3 are included in the music piece A, when the respective YG levels are 18, 15, and 15, the performance level calculation unit 20 The YG level of the music piece A is calculated as 16 (= (18 + 15 + 15) / 3).

  In step S <b> 59, the performance level calculation unit 20 registers the YG level of the calculated musical score of the original music in association with the score in the score DB 22 and supplies the score simplification processing unit 18 with the YG level. That is, the YG level in the musical score of the original music is obtained by the processing from steps S51 to S59. Since the calculation of the YG level of the score is not necessary after that once it is obtained for each practitioner, steps S51 to S59 are performed for the same practitioner in the score simplification processing after the first time. This processing may be omitted. Alternatively, the processes of steps S51 to S59 may be executed at different timings by batch processing and registered in the score DB 22 in a state where the YG level is obtained for any score.

  In step S60, the score simplification processing unit 18 compares the YG level of the current score with the YG level of the practitioner, and determines whether the YG level of the practitioner is higher than the YG level of the score. . That is, if the practitioner's YG level is higher than the YG level of the score, the practitioner is considered to be able to play the score, and conversely, the practitioner's YG level is equal to the YG level of the score. If not, the performance is considered difficult. In step S60, for example, if the trainee's YG level has not reached the score YG level and is considered to be a score that is difficult for the trainee to perform, the process proceeds to step S61.

  In step S61, the score simplification processing unit 18 simplifies the score by reducing the difficulty of fingering by simplifying the constituent sounds in a predetermined range of the score, and the simplified score information is recorded on the performance level. It supplies to the calculation part 20.

  That is, as shown in the left part of FIG. 18, the score before simplification is a domiso dormitory, and a static finger when performing a performance by playing the dormitory with the thumb, middle finger, and little finger of the left hand and the dormitory with the thumb and middle finger of the right hand Consider a case where the difficulty corresponding to the vector SV is SD. In this case, as shown in the right part of FIG. 18, the score simplification processing unit 18 simplifies the constituent sounds and can perform more easily than the target finger difficulty level SD. The score is simplified by obtaining a new static finger vector SV ′ having a degree SD ′.

  More specifically, for example, when a general chord called Fm7 consisting of the four notes at the upper left of FIG. 19 is the original chord, as shown in the lower left of FIG. As shown by the static finger vector, the left thumb plays the fa, the right thumb, forefinger, and ring finger play the four sounds: shih, do, and mi.

  The musical score simplification processing unit 18 performs processing by paying attention to the properties of chords when simplifying the constituent sounds. That is, taking Fm7 in the upper left part of FIG. 19 as an example, the part F of the chord component is the most important sound of the chord in the part called the root note (root note). Therefore, the chord called Fm is composed of the root tone fa, the third tone that is 3 degrees short when viewed from the root tone fa, and the 3 tones that are 5 degrees above the basic tone. There are 3 sounds. 7 is a short 7 degree sound as seen from the root note, which in this example is a mist. This (short) 7th-degree sound is a decorative sound that gives variation to the sound, and even if omitted, the song itself will not break. Other sounds that can be used for decoration include 9,11,13, sus4. Therefore, the score simplification processing unit 18, as shown in the upper center part of FIG. 19, shows the score of the root note, the third on the short side when viewed from the root note, Simplify to 3 sounds. As a result, as shown in the lower center part of FIG. 19, the static finger vector shows the root sound of the thumb with the thumb, the third degree higher than the root sound with the index finger, and 5 degrees higher with the ring finger. By playing the three sounds of, it is simplified from playing with both hands to playing with one hand.

  Further, when simplification is necessary, that is, when the score of the original music is at the upper center of FIG. 19, the score simplification processing unit 18 uses the root note as shown in the upper right part of FIG. Leave only one face and omit others. As a result, the silent finger vector is only simplified by playing the root sound with the index finger as shown in the lower right part of FIG.

  In step S62, the performance level calculation unit 20 calculates the YG level for the performance technical element including the simplified range for the simplified score supplied from the score simplification processing unit 18, and further simplified. The YG level of the totalized music is calculated.

  In step S63, the performance level calculation unit 20 registers the YG level in the calculated simplified score in the score DB 22 in association with the simplified score, and supplies the score simplification processing unit 18 with the YG level.

  In step S64, the score simplification processing unit 18 compares the current score YG level with the trainee YG level, and determines whether the trainee YG level is higher than the score YG level. In step S64, for example, if the trainee's YG level has not reached the score YG level and it is considered that the trainee is difficult to play, the process proceeds to step S65.

  In step S65, the score simplification processing unit 18 simplifies the score by reducing the difficulty level of the finger by turning the constituent sounds in a predetermined range of the score, and the performance level calculation unit 20 uses the simplified score information. To supply.

  That is, as shown in the upper part of FIG. 20, for example, when the constituent sounds are Do, Mi, and Shi, the maximum distance and the average distance between the fingers are calculated from the static finger vector SV of the original score, respectively, 4.0. And 3.0. Qualitatively speaking, the greater the distance between fingers, the less the range of movement of each finger and the lower the degree of freedom.

  Therefore, as shown in the lower part of FIG. 20, the score simplification processing unit 18 pays attention to the sound having the greatest distance from each finger (in this example), and moves to a lower octave. According to the musical nature, if the pitch name is the same even if the octave is different, the overall harmony sound is the same. Moving up and down the octave of the same note name in this way is called turning in musical terms.

  Using this turning, the maximum distance and the average distance are similarly obtained for the static finger vectors SV ′ rearranged in the order of 、, 、, and か ら from the bottom as shown in the lower part of FIG. 5 The score simplification processing unit 18 reduces the difficulty level of the finger by turning in this way.

  In step S66, the performance level calculation unit 20 calculates the YG level for the performance technical element including the simplified range for the simplified score supplied from the score simplification processing unit 18, and further the music The overall YG level is calculated.

  In step S67, the performance level calculation unit 20 registers the YG level in the calculated simplified score in the score DB 22 in association with the simplified score, and supplies the score simplification processing unit 18 with the YG level.

  In step S68, the score simplification processing unit 18 compares the current score YG level with the YG level of the practitioner, and determines whether or not the practitioner YG level is higher than the YG level of the score. . In step S68, for example, when the YG level of the practitioner has not reached the YG level of the score and it is considered that the score is difficult for the practitioner to perform, the process proceeds to step S69.

  In step S69, the score simplification processing unit 18 simplifies the score by reducing the difficulty of moving fingers by reducing the movement distance of the finger between the static finger vectors for a predetermined range of the score, thereby simplifying the score. Is supplied to the performance level calculation unit 20.

  That is, the moving finger difficulty is a value obtained from the moving finger vector, and the moving finger vector is obtained from the difference between the static finger vectors of two adjacent times. Simplifying the moving finger vector can be realized by reducing the difference between the static finger vectors and increasing the time between the static finger vectors. Further, in order to reduce the difference between the static finger vectors, by increasing the number of moving finger vector elements by reducing the number of times of change of the note that repeats sounding or muting, Δt is also lengthened as a result. That is, as shown in FIG. 21, in the case of the static finger vectors SV1 to SV4 and the moving finger vectors MV1 to MV3, the difference between the static finger vectors SV1 to SV4 is reduced, and the moving finger vectors MV1 to MV3 If the score is changed so that the number of elements increases to 0, the difficulty of moving fingers decreases.

  More specifically, for example, as shown in the upper left part of FIG. 22, when the original score is composed of a large number of eighth notes, 16 movements are shown as shown in the upper right part of FIG. It is expressed by a finger vector. The time interval of each moving finger vector is 0.25 seconds at 120 BPM.

  Therefore, the score simplification processing unit 18 pays attention to the sequence of notes for each measure, and lists the note names used in the measure. At this time, the same pitch name is not counted twice, and the octave difference is also treated as the same pitch name. Then, for example, it can be seen that the first bar in the upper left part of FIG. 22 is made only of the constituent sounds of “Do, Mi, So, and Shi” from “Domisoshi Moshidoshi”.

  Next, the score simplification processing unit 18 compares the combination of the constituent sound and the chord, and if it is the same as the constituent sound of the widely known chord, replaces all the notes of the measure with all the notes of the chord. . By such processing, the score in the upper left part of FIG. 22 is simplified to “Domishi” (CM7), “Resociation” = “Sosile” (G) as shown in the lower left part of FIG. Further, since the change points of the notes are reduced, the 16 moving finger vectors are set to one as shown in the lower right part of FIG. 22, and Δt is also reduced at the same time. In comparison, a very effective simplification is achieved.

  Although FIG. 22 shows a basic example, there are many cases where an actual score does not become a constituent sound of an existing chord even if the constituent sounds in one measure are listed. Therefore, as shown in FIG. 23, the score simplification processing unit 18 sets the target section from a measure when it does not apply to an existing chord, for example, from one measure to a half measure and further to a half measure. The score is simplified by performing the same processing while dividing it into fine units. In FIG. 23, the length is smaller than the length of one quarter note (two eighth notes).

  That is, in FIG. 23, the scores in the first bar shown at the top are all “quarter notes” and “dosolera”, and the scores in the second bar are all eighth notes and “soroso sososhi”. "Fami".

  By dividing the first measure in half, it is divided into “Doso” and “Rera”, but since both are not dissonant chords, they are made into chords and half notes. On the other hand, in the second measure, when it is halved, it is divided into “Leso” and “Mifasoshi”, and “Leso” is not a dissonant chord, so it is a chord and a half note, but “Mifasosi” Since is a dissonant, it is further divided into “Soshi” and “Fami”, and “Soshi” is not a dissonant, so it is a half note, and “Fami” is a dissonant and is left as it is. As a result, the score is simplified as shown in the upper right part of FIG.

  In step S70, the performance level calculation unit 20 calculates the YG level for the performance technical element including the simplified range for the simplified score supplied from the score simplification processing unit 18, and further the music The overall YG level is calculated.

  In step S71, the performance level calculation unit 20 registers the YG level of the calculated simplified score in the score DB 22 in association with the simplified score and supplies the YG level to the score simplification processing unit 18.

  In step S72, the score simplification processing unit 18 compares the YG level of the current score with the YG level of the practitioner, and determines whether or not the practitioner's YG level is higher than the YG level of the score. . In step S72, for example, when the YG level of the practitioner has not reached the YG level of the score and it is considered that the score is difficult for the practitioner to perform, the process proceeds to step S73.

  In step S73, the score simplification processing unit 18 simplifies the score by reducing the difficulty of moving finger by increasing Δt for a predetermined range of the score, and the performance level calculation unit calculates simplified score information. 20 is supplied.

  More specifically, in order to increase Δt purely, the score simplification processing unit 18 combines them into 1 when notes having the same pitch are consecutive. That is, as shown in the upper part of FIG. 24, if the eighth note of the Soviet is continuous from time t2 to t4, the score simplification processing unit 18 These are simplified so as to increase Δt by combining them into quarter notes 1 as indicated by times t2 to t3.

  By combining the processes of steps S69 and S73, the score simplification processing unit 18 simplifies the score shown in the upper part of FIG. 25 into the score shown in the lower part of FIG. That is, in the first measure, “Faso”, which is the last note, is set to “So” only. In the second measure, the first two notes are half-note “seo” and the second half “sid” is only “shi”. In the third measure, “Dre”, which is the first note, is set to “D”, and “Soshiso”, which is the final note, is set only to “So” on the high pitch side. Further, in the fourth measure, the same two sounds in the first half are combined into one sound, and the two sounds in the latter half are grouped into the high-pitched “So”. In addition, you may enable it to set what ratio the ratio of the note thinned out by the process of step S69, S73.

  In step S74, the performance level calculation unit 20 calculates the YG level for the performance technical element including the simplified range for the simplified score supplied from the score simplification processing unit 18, and further the music The overall YG level is calculated.

  In step S75, the performance level calculation unit 20 registers the YG level of the calculated simplified score in the score DB 22 in association with the simplified score and supplies the YG level to the score simplification processing unit 18.

  In step S76, the score simplification processing unit 18 compares the YG level of the current score with the YG level of the practitioner and determines whether the YG level of the practitioner is higher than the YG level of the score. . In step S76, for example, if the YG level of the practitioner has not reached the YG level of the score and it is considered that the score is difficult for the practitioner to perform, the process proceeds to step S77.

  In step S77, the score simplification processing unit 18 simplifies the score by omitting the performance technology element itself for a predetermined range of the score, and supplies the score information that has been simplified to the performance level calculation unit 20.

That is, a specific technical element may be described in the musical score separately from the notation of the note. For example, there is a trill playing technique as a playing technique in which two or more fingers are alternately moved at high speed and two or more sounds are played at high speed. In addition, there are symbols that indicate the strength of keystrokes, such as pp (pianissimo) and f (forte), which are low in difficulty but are played with short cuts called staccato.
Although these performance techniques are additional, following the notes only becomes a factor that increases the difficulty level for a novice beginner. Therefore, the score simplification processing unit 18 reduces the difficulty level by omitting these individual performance techniques.

  That is, for example, as shown in the lower left part of FIG. 26, the musical score simplification processing unit 18, when the performance technology elements TE <b> 1 to TE <b> 3 play trills, as shown in the lower right part of FIG. 26, By omitting them, the score is simplified. That is, in the musical score in the lower left part of FIG. 26, as described below, “Rashidside” and “Sidashishi” are each indicated by a five-tuplet. However, the musical score simplification processing unit 18 simply deletes such advanced performance technology elements as “si”. As a result, the musical score is simplified while leaving the reverberation of music while eliminating the need for advanced performance techniques.

  In step S78, the performance level calculation unit 20 calculates the YG level for the performance technical element including the simplified range for the simplified score supplied from the score simplification processing unit 18, and further the music The overall YG level is calculated.

  In step S79, the performance level calculation unit 20 registers the YG level of the calculated simplified score in the score DB 22 in association with the simplified score, and supplies the score simplification processing unit 18 with the YG level.

  In step S80, the score simplification processing unit 18 compares the YG level of the current score with the YG level of the practitioner, and determines whether the YG level of the practitioner is higher than the YG level of the score. . In step S80, for example, if the YG level of the practitioner has not reached the YG level of the score and it is considered that the score is difficult for the practitioner to perform, the process proceeds to step S81.

  In step S81, the score simplification processing unit 18 determines whether or not elements that can be simplified remain in the score. That is, for example, the score simplification processing unit 18 searches for a measure that has not been simplified or a measure that can be simplified, and determines whether there is an element that can be simplified depending on the presence or absence thereof. If it is determined in step S81 that there are still elements that can be simplified, the process returns to step S61. That is, the score simplification process in steps S61 to S81 is repeated until the practitioner's YG level is higher than the YG level of the musical score and the player can sufficiently perform.

  Then, in any of steps S60, S64, S68, S72, S76, and S80, it is considered that the YG level of the practitioner is higher than the YG level of the musical score of the music, or there are elements that can be simplified in step S81. When it is determined that there is no score, the music score simplification process ends.

  Through the above processing, the score simplification process is repeated until the score of the YG level appropriate for the trainee's YG level is obtained. Note that the musical score simplification process itself may be processed off-line, or all the musical scores up to the lowest YG level may be created. In this way, it is possible to store score data having different YG levels for the same music piece in the score DB 22 and improve the processing speed. Further, by storing the score data having different YG levels in the score DB 22 as described above, if the trainee's YG level can be recognized, it is only necessary to read out the corresponding score of the YG level, and the score simplification process itself. It is possible to do it only once. Further, in the above example, an example of generating a score simplified to a YG level lower than the trainee's YG level has been described, but a score of a slightly higher YG level than the trainee's YG level is generated. You may be allowed to do this, and by doing this, it is possible to put a little load on practice.

  Now, the description returns to the flowchart of FIG.

  When the score simplification process is performed by the process of step S5, in step S6, the score simplification processing unit 18 supplies the score corresponding to the YG level of the practitioner to the presentation unit 19, and as a practice song to the practitioner. Present the score and urge you to start playing the instrument. That is, based on this presentation, the practitioner starts playing the musical instrument while viewing the score presented on the presentation unit 19.

  In step S7, the performance information recording unit 13 controls the microphone 13a to acquire the sound of the musical instrument played by the practitioner, and controls the camera 13b to move the finger relative to the keyboard of the musical instrument played by the practitioner. To image. Furthermore, the performance information recording unit 13 controls the sensor 13c to measure the pressing pressure on the keyboard of the practitioner's instrument. Then, the performance information recording unit 13 supplies the evaluation unit 14 with performance information including information on these sounds, images, and pressing pressures. The evaluation unit 14 records and holds the supplied performance information in the practitioner information record holding unit 16 in association with information for identifying the practitioner.

  In step S <b> 8, the evaluation unit 14 determines whether or not the performance is completed from the acquisition state of the performance information supplied from the performance information recording unit 13. If it is determined in step S8 that the performance has not been completed, the process returns to step S6. That is, performance information continues to be recorded until it is deemed that the performance has been completed. If it is determined in step S8 that the performance has been completed, the process proceeds to step S9.

  In step S9, the evaluation unit 14 notifies the control unit 11 that the performance has been completed. The control unit 11 executes the YG level determination process, and whether the content played by the practitioner has reached the YG level of the score, that is, whether the current YG level of the practitioner is higher than the YG level of the score Determine whether or not.

[YG level determination processing]
Here, the YG level determination process will be described with reference to the flowchart of FIG.

  In step S91, the evaluation unit 14 determines whether the practitioner has completed the performance based on the performance information. More specifically, the evaluation unit 14 controls the score conversion unit 52 to convert the sound generated when the practitioner plays the instrument into a performance score based on the performance information, and presents it to the presentation unit 19. Make sure that it is played to the end compared to the score. If it is determined in step S91 that the performance has been performed to the end, the process proceeds to step S92.

  In step S92, the evaluation unit 14 executes an evaluation value calculation process to calculate the YG level of the practitioner, which is an evaluation value for evaluating the performance of the instrument by the practitioner.

[Evaluation value calculation processing]
Here, the evaluation value calculation processing will be described with reference to the flowchart of FIG.

  In step S111, the evaluation unit 14 controls the score conversion unit 52 to perform a performance score, that is, when the practitioner plays the instrument based on the performance information recorded in the practitioner information record holding unit 16. Information is generated by converting the voice obtained by the microphone 13a into a musical score. Here, not only the voice in step S91 described above, but also the evaluation unit 14 analyzes the image picked up by the camera 13b, thereby playing the keyboard of the key number of each sound with which finger number. In addition, based on the strength based on the pressing pressure measured by the sensor 13c, information on the strength and expression of the sound when playing is also reproduced in the performance score. Therefore, a performance score including information related to more detailed performance is generated than the performance score converted in the YG level simple confirmation process in step S4. That is, here, the performance score is a score that includes the performance of the practitioner including the finger movement.

  In step S <b> 112, the evaluation unit 14 reads and acquires the target score, that is, the score data of the music presented in the presenting unit 19 from the score DB 22. This score data includes not only the score information, but also the information about which note should be played with which finger number and which finger number should be played, and information indicating the strength and expression of the sound. Yes.

  In step S113, the evaluation unit 14 calculates the similarity between the target score and the performance score. More specifically, the evaluation unit 14 includes, for example, all the notes provided in the score, information on finger numbers indicating the finger to be played for each key of the key number of each sound, and information such as sound strength Of these, the percentage of coincidence is calculated as the similarity.

  In step S114, the evaluation unit 14 generates an evaluation value from the obtained similarity. That is, the similarity is 0.0 when the correlation is the lowest, and 1.0 when the correlation is the highest. Therefore, the similarity is such that the manner in which the practitioner's finger is pressed and the timing matches the score. It approaches 1 and approaches 0 as it does not match. The evaluation value means that the higher the value, the more the music can be played, so this similarity may be applied to the evaluation value as it is, or a value through some conversion formula is defined as the evaluation value May be. However, for example, a conversion equation as shown by the following equation (3) may be defined so that the evaluation value after conversion also takes a value from 0.0 to 1.0.

V = f (C) (0 ≦ C ≦ 1)
... (3)

  Here, V represents an evaluation value, C represents a similarity, and f represents a function expressing the evaluation value using the similarity as a parameter.

  In step S115, the evaluation unit 14 calculates the player's YG level from the obtained evaluation value V. That is, for example, the evaluation unit 14 calculates the YG level by the calculation represented by the following expression (4) based on the evaluation value V obtained by the expression (3).

X = V × T (0 <V <1)
... (4)

  Here, X is the player's YG level, and T is the score's YG level. When this song can be played completely, the evaluation value V is 1. However, since the song with the highest technical level is played, there is no case that the song can be played completely. Similarly, even in the case where this song could not be played at all, that is, the evaluation value is 0 or the evaluation value V is close to 0, if the song is far from the music level, a simpler song is played. There should be no such case.

  With the above processing, it is possible to obtain the evaluation value of the practitioner from the result of the practitioner playing while viewing the score, and further to calculate the YG level of the practitioner based on the evaluation value.

  Now, the description returns to the flowchart of FIG.

  In step S92, when the YG level that is the evaluation value for the result performed by the practitioner is calculated, in step S93, the evaluation unit 14 determines that the YG level calculated as the evaluation value for the result performed by the practitioner is the current value. It is determined whether or not it is lower than the lower threshold of the YG level set for the score. In step S93, for example, when it is determined that the YG level calculated as the evaluation value for the result performed by the practitioner is lower than the lower threshold of the YG level set in the current score, the process proceeds to step S95. .

  In step S95, the evaluation unit 14 considers that the YG level of the practitioner has not reached the YG level of the score, and reaches the YG level of the score in association with the practitioner information in the practitioner information record holding unit 16. Record and retain information indicating that the

  On the other hand, if it is determined in step S93 that the YG level calculated as the evaluation value for the result of the performance by the practitioner is not lower than the lower threshold of the YG level set in the current score, the process proceeds to step S94. move on.

  In step S94, the evaluation unit 14 determines whether or not the YG level calculated as the evaluation value for the result performed by the practitioner is higher than the upper threshold of the YG level set in the current score. In step S94, for example, when the evaluation unit 14 determines that the YG level calculated as the evaluation value for the result performed by the practitioner is higher than the upper threshold value of the YG level set in the current score, the process is as follows. The process proceeds to step S96.

  In step S96, the evaluation unit 14 considers that the YG level of the practitioner has reached the YG level of the musical score, and associates it with the information of the practitioner in the practitioner information record holding unit 16 to set the YG level of the musical score. Record and hold information indicating that it has been reached.

  That is, when the trainee's YG level as an evaluation value obtained by the evaluation unit 14 is high, this indicates that the music can be played as described in the score. Conversely, when the player's YG level as an evaluation value is low, it is indicated that the music cannot be played as described in the score. Therefore, as shown in FIG. 29, when the trainee's YG level, which is the evaluation value, is high and exceeds the YG upper limit threshold, the score is a simple score that is not necessary for the trainee to improve the technique. Indicates that there is. In other words, it can be said that the practitioner's performance level cannot be accurately determined depending on the performance result of this musical piece, and that the practitioner should be presented again by presenting a new higher YG level score. Similarly, if the practitioner's YG level as an evaluation value is too low and lower than the lower threshold, the score indicates that it is too difficult for the practitioner. In other words, it can be said that it is necessary to practice from a lower level by presenting a new lower YG level score, assuming that the performance level of the practitioner cannot be accurately determined depending on the performance result of the score.

  With the above processing, it is possible to calculate the YG level of the trainee as an evaluation value based on the performance result of the trainee.

  Now, the description returns to the flowchart of FIG.

  When the YG level determination process is executed by the process of step S9, in step S10, the control unit 11 accesses the practitioner information record holding unit 16, and in the determination result of the YG level determination process based on the practitioner information. Then, it is determined whether or not the trainee's YG level is considered to have reached the YG level of the score. In step S10, for example, when it is considered that the YG level of the practitioner has reached the YG level of the score, the process proceeds to step S11.

  In step S11, the control unit 11 accesses the practitioner information record holding unit 16, and the practice mode selected by the practitioner is the first mode, that is, the music that the player desires to play rather than increasing the number of repertoires. It is determined whether or not this is a mode for improving the performance technique. In step S11, for example, when it is determined that the mode is not the first mode, the process proceeds to step S12.

  In step S12, the score recommendation unit 17 accesses the practitioner information record holding unit 16 so that the practice mode selected by the practitioner is the second mode, that is, the repertoire number is increased more than the improvement of the performance technique. It is determined whether or not it is a mode to perform. In step S12, for example, when it is considered that the mode is not the second mode, the process proceeds to step S13.

  In step S13, the score recommendation unit 17 accesses the practitioner information record holding unit 16, reads the practitioner information, and generates a repertoire distribution. That is, in steps S11 and S12, since the mode is neither the first mode nor the second mode, the practitioner is determined to be the third mode, that is, the mode in which the repertoire number is increased while improving the performance technique. In the third mode, the target score which is a practice song is selected so as to increase the number of repertoires at a certain time while changing the score so as to improve the performance technique. Therefore, the control unit 11 generates a repertoire distribution for the practitioner in order to determine whether the performance technique should be improved or the number of repertoires should be increased at this stage.

  As shown in FIG. 30, the repertoire distribution is a distribution in which the horizontal axis represents the average repertoire number and the vertical axis represents the YG level of each practitioner, and indicates the position of the practitioner in the distribution. Is. In the repertoire distribution of FIG. 30, the curve G indicates the average number of repertoires for each YG level of all the practitioners. Therefore, in the repertoire distribution, for example, as indicated by a point P1 in FIG. 30, the number of practitioners belonging to the region above the curve G is smaller than the average number of repertoires at the same YG level. . For this reason, at present, it can be said that the mode in which the number of repertoires is increased, that is, the second mode is better than the improvement of the performance technique as indicated by the arrow G1. On the other hand, in the repertoire distribution, for example, as indicated by a point P2 in FIG. 30, the number of practitioners belonging to the region below the curve G is sufficient for the average number of repertoires at the same YG level. It is. For this reason, at present, it can be said that the mode in which the performance technique is improved, that is, the first mode is better than the increase in the number of repertoires, as indicated by the arrow G2.

  Therefore, in step S14, the score recommendation unit 17 determines whether or not the state of the practitioner is a state in which priority is given to increasing the number of repertoires based on the generated repertoire distribution. In step S14, for example, in the state indicated by the point P2 in FIG. 30 described above, since the number of repertoires is sufficient, it is not a state in which the number of repertoires is increased. The process proceeds to step S15.

  In step S15, the score recommendation unit 17 is the same YG level as the next practice song (YG level, which is one level higher than the current trainer's YG level), as in the first mode. The musical score selection unit 21 is controlled so as to recommend it as a target musical score, and the target musical score is presented to the presentation unit 19. Note that a large number of simplified scores having the same or similar YG level are registered in the score DB 22, but among them, the score corresponding to the YG level of the practitioner is the target score. Recommended to be recommended. Therefore, the score recommendation unit 17 refers to the performance score that is the performance result of the trainee so far, and matches the target score and the performance score among the YG level scores that are one step higher than the current YG level. The performance technology elements that are (mastered) are more difficult than the current target score, and the performance technology elements that do not match the target score and the performance score (not mastered) The score of the YG level is recommended as the target score. With this process, a score that is relatively close to the YG level can be selected as the practice song for the same song, so that the practicer can gradually improve the current YG level little by little. It becomes possible. In addition, since an extremely high YG level score is not selected as a practice song, the practitioner is less likely to feel unable to practice, so that practice can be continued happily.

  On the other hand, in step S14, for example, in the state indicated by the point P1 in FIG. 30 described above, since the number of repertoires is small, the state of the practitioner is a state in which priority is given to increasing the number of repertoires. The processing proceeds to step S21.

  In step S21, the score recommendation unit 17 executes the same YG level music recommendation process, recommends music having the same YG level, and causes the practitioner to select one of them.

[Same YG level music recommendation process]
Here, the same YG level music recommendation process will be described with reference to the flowchart of FIG. In this process, it is assumed that the music score DB 22 has been subjected to simplification processing for all YG levels for music pieces for all original songs, and that simplified music scores are registered. Therefore, when a new musical piece is registered in the score DB 22, the above-described score simplification process is processed offline, and the lowest score set as the YG level is generated and registered by the simplification process. To do.

  In step S131, the score recommendation unit 17 initializes a counter N for counting the number of songs to 1.

  In step S132, the score recommendation unit 17 accesses the score DB 22, and acquires the YG level of the score of the currently presented music.

  In step S133, the score recommendation unit 17 obtains the YG level of the score of a song that is registered in the score DB 22 other than the currently presented song, that is, a song whose original song is different from the currently presented song.

  In step S134, the score recommendation unit 17 sets one of the unprocessed scores read from the score DB 22 as the score N to be processed, the YG level of the score of the currently presented music, and the YG of the score N to be processed. Compare the level.

  In step S135, the score recommendation unit 17 determines whether or not the YG level of the score N to be processed is substantially equal to the YG level of the score N of the currently presented music. In step S135, for example, when it is determined that the YG level of the musical score N to be processed is substantially equal to the YG level of the musical score N of the currently presented music, the process proceeds to step S136.

  In step S136, the score recommendation unit 17 controls the score selection unit 21 to control the score selection unit 21 with the same music score as the currently presented score, and using the names of the other songs as the practice song candidates. To present.

  In step S137, the score recommendation unit 17 determines whether or not the read score of the music that is different from the currently presented music and the original music is compared with the YG level of the music of the music that is currently presented. To do. In step S137, if all the scores have not been compared for the YG level, the process proceeds to step S138.

  In step S138, the score recommendation unit 17 increments the counter N by 1, and the process returns to step S133.

  On the other hand, in step S135, for example, when it is determined that the YG level of the musical score N to be processed is not substantially equal to the YG level of the musical score N of the currently presented music, the process of step S136 is skipped. .

  In other words, the processes in steps S133 to S138 are repeated until it is determined in step S137 that there is no unprocessed score read from all the score DBs 22. If it is determined in step S137 that there is no unprocessed score read from the score DB 22, the process proceeds to step S139.

  In step S139, the score recommendation unit 17 determines whether any of the music presented as a candidate for the practice music on the presentation unit 19 is selected via the control unit 11, and the same applies until the music is selected. Repeat the process. In step S139, when the practitioner operates the operation unit 12 to select one of the practice songs, the score recommendation unit 17 sends the score of the selected practice song to the presentation unit 19 in step S140. The musical score selection unit 21 is controlled so as to be presented.

  That is, with the above processing, the current musical score is considered to be in a state where it can be played and it is better to increase the number of repertoires. Can be recommended as a candidate for the next practice song, and one of them can be selected by the practice person. As a result, the practice that tends to be monotonous can be changed, so that the practitioner can increase the consciousness of continuing the practice. Furthermore, since the score given as a candidate is a score that is almost the same as the YG level that is already playable, it is highly likely that the practitioner will be able to perform without much effort. The practitioner is likely to be able to perform in a relatively short period of time, so the number of repertoires can be increased while enjoying the practice.

  Now, the description returns to the flowchart of FIG.

  When the next music piece is recommended by the process of step S15 or S21, in step S16, the control unit 11 determines whether or not the operation unit 12 has been operated to instruct the end of the process. If the end is instructed in step S16, the process proceeds to step S17.

  In step S <b> 17, the control unit 11 associates the information of the music and the musical score currently presented in the presenting unit 19 with the practitioner, and causes the practitioner information record holding unit 16 to record and hold the practitioner information. The process is terminated. Thereby, the practitioner who has started practicing the musical instrument using the information processing apparatus 1 can continuously receive the practice music corresponding to his / her YG level simply by inputting his / her practitioner information. Can do.

  On the other hand, if it is determined in step S12 that the practice mode is the second mode, the process proceeds to step S21. That is, since it is a practice mode in which the number of repertoires is increased, in step S21, the same YG level music recommendation process is performed, and the score of the music of substantially the same YG level is presented as a practice music candidate. A practice song is determined.

  In Step S11, when it is determined that the practice mode is the first mode, the process proceeds to Step S15. In other words, since this is a practice mode in which the YG level is improved, in step S15, the score that is currently presented and the original song are the same, and a score that is higher in the YG level by about one level is presented as a practice song. Is done.

  Furthermore, if it is not determined in step S10 that the practitioner's YG level obtained based on the performance information has reached the YG level of the score, the process proceeds to step S19.

  In step S19, the control unit 11 determines whether the difference between the YG level of the practitioner obtained based on the performance information and the YG level of the score is equal to or greater than a predetermined value. In step S19, the difference between the YG level of the practitioner obtained based on the performance information and the YG level of the score is greater than or equal to a predetermined value, that is, the YG level of the score is considered too high for the practitioner. If so, the process proceeds to step S20.

  In step S20, the control unit 11 controls the score simplification processing unit 18 to execute the score simplification process, so that the current score of the musical composition is determined based on the performance information. A score having a lower YG level is generated and presented as the next practice song.

  In addition, when the practitioner information is searched in step S3, it is considered that the practitioner is not a new practitioner, so registration is performed at the end of the previous practice in the process of step S17 based on the practitioner information. The information to be input including the YG level can be used as it is.

  That is, when the first mode is selected as the practice mode by repeating the processes of steps S6 to S16 and steps S18 to S21, when the practice person's YG level rises and the performance technique improves, Close musical scores are gradually presented. For this reason, the practice music is set so that the score of the original song is approached from the simplified score of the lowest YG level, so that the practitioner can not play. It is possible to reduce the possibility of being lost.

  In addition, when the second mode is selected as the practice mode, when the practitioner can play the musical score of the musical score presented as the practice music, the substantially same YG level musical score is presented as the next practice music. The trainer can increase the number of repertoires in a short period of time because the possibility of completing practice songs one after another is increased in a relatively short period of time. For this reason, since the number of repertoires can be increased, it is possible to reduce the possibility of stopping the practice in the middle.

  Furthermore, when the third mode is selected as the practice mode, when the practitioner can play the music of the musical score presented as the practice music, from the relationship between the current practitioner's YG level and the number of repertoires, A practice song will be presented based on whether the performance skill level should be improved or the repertoire number should be increased, so improve the performance technique level and the repertoire number in a balanced manner. It becomes possible.

  In addition, when it is determined that the current score is too difficult for the practitioner because the difference between the YG level of the practitioner obtained based on the performance information and the YG level of the score is large regardless of the practice mode. Furthermore, the score is simplified. As described above, the objective musical score that is optimal for the practitioner is always presented as the practice tune, so that it is possible to prevent the practitioner from having a feeling that it cannot be practiced. For this reason, it becomes possible to reduce the possibility that the musical instrument performance practice cannot be continued and stopped.

<Modification>
[Same YG level music recommendation process using similarity]
In the above, in the same YG level music recommendation process, by comparing the YG level in each score and the YG level of the practitioner obtained based on the performance information, the music that the practitioner will be able to play relatively quickly is selected. An example of recommending it as the next practice song has been explained. However, instead of the YG level, a score including a performance technology element having a high degree of similarity of performance technology elements included in a score considered that the practitioner has been able to perform may be presented as the next practice music. Furthermore, it may be possible to select whether to select a mode for selecting the next practice song candidate by comparison with the YG level described above or a mode for selecting a score having a high similarity as a candidate for the practice song. .

  Here, the score recommendation unit 17 sets a mode for selecting the next practice song candidate by comparison with the YG level described above, or selects a score having a high similarity in performance technology element as a practice song candidate. In the following, the same YG level music recommendation process in a mode in which a score having a high similarity is selected as a candidate for a practice music will be described.

  In step S151, the score recommendation unit 17 initializes a counter N for counting the number of songs to 1.

  In step S152, the score recommendation unit 17 selects an unprocessed score among the scores of the music that is registered in the score DB 22 other than the currently presented music, that is, the music different from the currently presented music. Either one is set as the musical score N to be processed, and the similarity to the musical score of the currently presented music is calculated.

  For example, the performance technology element TE1 composed of fingering vectors FV1 to FV3 and the performance technology element TE2 composed of fingering vectors FV4 to FV6 shown in FIG. The similarity between the performance technology elements TE1 and TE2 can be calculated by the calculation shown.

  Here, TE1 and TE2 are vectors of performance technology elements TE1 composed of fingering vectors FV1 to FV3, respectively, vectors of performance technology elements TE2 composed of fingering vectors FV4 to FV6, and cosθ is a performance technology element TE1. , TE2 similarity. Therefore, the score recommendation unit 17 applies the similarity defined by cos θ to calculate the similarity of music as shown in FIG.

  That is, when the music (score) 1 is composed of the performance technology elements TE1 to TE3 and the music (score) 2 is composed of the performance technology elements TE4 to TE6, the score recommendation unit 17 uses the following formula (6 ) To calculate the similarity between music pieces (musical scores).

Similarity = [max (C14, C15, C16)
+ Max (C24, C25, C26)
+ Max (C34, C35, C36)] / 3
... (6)

  Here, max (a, b, c) indicates that the maximum value of a to c is selected. C14 to C16 indicate the similarity between the performance technology element TE1 and the performance technology elements TE4 to TE6, respectively. C24 to C26 indicate the similarity between the performance technology element TE2 and the performance technology elements TE4 to TE6, respectively. Further, C34 to C36 indicate the degrees of similarity between the performance technology element TE3 and the performance technology elements TE4 to TE6, respectively.

  In step S153, the score recommendation unit 17 determines whether or not the similarity between the score N to be processed and the score of the currently presented music is higher than a predetermined reference value. In step S153, for example, if it is determined that the score N of the musical score to be processed and the score of the musical score currently being presented are higher than a predetermined reference value, the process proceeds to step S154.

  In step S154, the score recommendation unit 17 controls the score selection unit 21 by using the name of the other song N as a candidate for a practice song that is a score including performance technology elements similar to the score currently presented. The presentation part 19 is made to present.

  In step S155, the score recommendation unit 17 obtains the degree of similarity between all the scores of the songs that are registered in the score DB 22 and the songs that are different from the original songs and the scores that are currently presented. Determine whether or not. If it is determined in step S155 that the similarity between all the musical scores registered in the musical score DB 22 and the musical composition of which the original musical composition is different from the musical score that is currently presented has not been obtained, The process proceeds to step S156.

  In step S156, the score recommendation unit 17 increments the counter N by 1, and the process returns to step S152.

  On the other hand, if it is determined in step S153 that all of the scores of the songs that are registered in the score DB 22 and have different original songs from the currently presented songs are similar to the score currently being presented, step S154 is performed. This process is skipped.

  That is, in step S155, until it is determined that similarities between all the musical scores of the musical compositions that are registered in the musical score DB 22 and that are different from the original musical composition are currently presented. The processes in steps S152 to S156 are repeated. In step S155, when it is determined that the scores of all the music pieces that are registered in the music score DB 22 and that have different original music pieces from the original music piece are similar to the currently presented music score. The process proceeds to step S157.

  In step S157, the score recommendation unit 17 determines whether any of the music presented as a candidate for the practice music on the presentation unit 19 is selected via the control unit 11, and the same applies until the music is selected. Repeat the process. In step S157, when the practitioner operates the operation unit 12 to select one of the practice songs, the score recommendation unit 17 presents the score of the selected practice song to the presentation unit 19 in step S158. The score selection unit 21 is controlled as described above.

  In other words, the above-described processing can present a score that is considered to have been performed and a score that is similar in performance technology elements as candidates for the next practice song. Since it becomes possible to practice the next practice song, it becomes possible to play a new practice song in a relatively short period of time.

  For this reason, it is possible to recommend a score including substantially the same performance technology element as a candidate for the next practice music, and to let the practice person select one of them. As a result, the practice that tends to be monotonous can be changed, so that the practitioner can increase the consciousness of continuing the practice. Further, the score given as a candidate is a score that is almost the same as a performance technology element that has already been made playable. From this, it is highly likely that the practitioner will be able to perform without much effort, so the practitioner is likely to be able to perform in a relatively short period of time, and the repertoire can be enjoyed while enjoying the practice. It becomes possible to increase the number.

  In the above, an example has been described in which the candidate for the next practice song is presented by the similarity using the performance technology element between the scores. However, the practice is searched by the similarity using the performance technology element between the scores. A musical score candidate that is a song and a musical score of a practice song that has substantially the same YG level may both be presented as candidates for the next practice song.

  As described above, according to the present technology, the practitioner can play the target music that he / she wanted to be able to play relatively easily in a step-by-step manner. , You can improve the possibility that you can continue to practice until you can play the score of the original song. In addition, since the repertoire can be increased according to the YG level acquired by itself, the number of repertoires can be increased relatively easily. Furthermore, the YG level for the score can be set including the physical restrictions of the practitioner, so the target score is presented appropriately to practitioners of various hand sizes, from children to adults. It becomes possible to do.

  The series of processes described above can be executed by hardware or software. When a series of processing is executed by software, a program constituting the software is installed in the computer. Here, the computer includes, for example, a general-purpose personal computer capable of executing various functions by installing various programs by installing a computer incorporated in dedicated hardware.

  FIG. 35 is a block diagram illustrating a hardware configuration example of a computer that executes the above-described series of processing by a program.

  In a computer, a central processing unit (CPU) 1001, a read only memory (ROM) 1002, and a random access memory (RAM) 1003 are connected to each other by a bus 1004.

  An input / output interface 1005 is further connected to the bus 1004. An input unit 1006, an output unit 1007, a storage unit 1008, a communication unit 1009, and a drive 1010 are connected to the input / output interface 1005.

  The input unit 1006 includes a keyboard, a mouse, a microphone, and the like. The output unit 1007 includes a display, a speaker, and the like. The storage unit 1008 includes a hard disk, a nonvolatile memory, and the like. The communication unit 1009 includes a network interface. The drive 1010 drives a removable medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

  In the computer configured as described above, the CPU 1001 loads the program stored in the storage unit 1008 to the RAM 1003 via the input / output interface 1005 and the bus 1004 and executes the program, for example. Is performed.

  The program executed by the computer (CPU 1001) can be provided by being recorded on the removable medium 1011 as a package medium, for example. The program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

  In the computer, the program can be installed in the storage unit 1008 via the input / output interface 1005 by attaching the removable medium 1011 to the drive 1010. Further, the program can be received by the communication unit 1009 via a wired or wireless transmission medium and installed in the storage unit 1008. In addition, the program can be installed in advance in the ROM 1002 or the storage unit 1008.

  In this specification, the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Accordingly, a plurality of devices housed in separate housings and connected via a network and a single device housing a plurality of modules in one housing are all systems. .

  The embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present technology.

  For example, the present technology can take a configuration of cloud computing in which one function is shared by a plurality of devices via a network and is jointly processed.

  In addition, each step described in the above flowchart can be executed by being shared by a plurality of apparatuses in addition to being executed by one apparatus.

  Further, when a plurality of processes are included in one step, the plurality of processes included in the one step can be executed by being shared by a plurality of apparatuses in addition to being executed by one apparatus.

In addition, this technique can take the following structures.
(1) a musical score information acquisition unit that acquires musical score information;
A restriction acquisition unit for acquiring physical restrictions related to the performance of the musical instrument by a player of the musical instrument;
An information processing apparatus comprising: a performance difficulty calculating unit that calculates a performance difficulty for the performer when playing the music on the musical instrument based on the musical score information of the music and the physical restrictions .
(2) The instrument is a keyboard instrument,
The performance difficulty calculation unit
A static finger vector calculation unit for calculating a static finger vector indicating a static arrangement of the fingers of the performer for a predetermined period arranged based on the musical score of the music;
Based on the static finger vector, a static finger difficulty calculating unit that calculates a static finger difficulty indicating a static difficulty of a player's finger for a predetermined period arranged based on the musical score of the music;
A moving finger vector calculation unit for calculating a moving finger vector indicating a dynamic change of the performer's finger between the static finger vectors;
Based on the moving finger vector, a moving finger difficulty calculating unit that calculates a moving finger difficulty indicating a dynamic difficulty of a player's finger in a predetermined period arranged based on the musical score of the music;
A fingering vector calculating means for calculating a fingering vector that is a combination of the static finger vector and the moving finger vector;
For each performance technique element comprising a combination of the fingering vectors for a predetermined performance technique in the music, from the static finger vector constituting the fingering vector and the static finger difficulty and the dynamic finger difficulty for the moving finger vector The information processing apparatus according to (1), wherein a performance technology level is calculated, and an average value of performance technology levels of all performance technology elements included in the music is calculated as a performance difficulty level of the music.
(3) When the music piece is played by the musical instrument by the performer, a listening unit that listens to the played music piece;
A score conversion unit that converts the music listened to by the listening unit into a score;
The musical score is different from the musical composition based on the performance level calculating section that obtains the performance level of the performer by comparing the musical score converted by the musical score conversion section with the musical score obtained from the musical score information of the musical composition. The information processing apparatus according to (1) or (2), including a recommendation unit that recommends music.
(4) A score simplification processing unit that simplifies the score of the original music of the music so as to reduce the difficulty of playing, and the recommendation unit has a performance level lower than a first predetermined threshold value In this case, the information processing apparatus according to (2) or (3), wherein the musical piece simplification processing unit recommends a music piece having a lower performance difficulty and different from the music piece.
(5) When the performance level is higher than a second predetermined threshold value higher than the first predetermined threshold value, the recommendation unit has a higher performance difficulty level converted by the score conversion unit, The information processing apparatus according to (3) or (4), wherein a music different from the music is recommended.
(6) When the recommendation unit is a mode for improving the performance level of the performer, the performance is difficult when the performance level is higher than a second predetermined threshold value that is higher than the first predetermined threshold value. The information processing apparatus according to (3) or (4), wherein the music is higher in degree and recommends a music different from the music in which the music is the same as the original music.
(7) In the mode in which the recommendation unit is a mode for increasing the repertoire of music that can be performed by the performer, when the performance level is higher than a second predetermined threshold value that is higher than the first predetermined threshold value, The information processing apparatus according to (3) or (4), wherein the musical performance difficulty level is substantially the same, and a musical piece that is different from the original musical piece is recommended.
(8) When the recommendation unit is a mode in which the performance level of the performer is improved and the repertoire of musical pieces that can be played is increased, the performance level is higher than the first predetermined threshold value. Is higher than the predetermined threshold value, the performance difficulty level is substantially the same according to the number of repertoires that the performer can perform and the performance level of the performer, and the music is the original music The information processing apparatus according to (3) or (4), wherein a different music piece or a music piece having a higher performance difficulty level and having the same original music piece as the music piece but different from the music piece is recommended.
(9) In the information processing method of the information processing apparatus,
The information processing apparatus is
Music score information acquisition processing to acquire music score information,
Restriction acquisition processing for acquiring physical restrictions related to the performance of the musical instrument by a player of the musical instrument,
An information processing method for performing performance difficulty calculation processing for calculating a performance difficulty level for the performer when the music is played on the musical instrument based on the musical score information of the music and the physical restrictions.
(10) Connect the computer
A musical score information acquisition unit for acquiring musical score information;
A restriction acquisition unit for acquiring physical restrictions related to the performance of the musical instrument by a player of the musical instrument;
Based on the musical score information of the music and the physical restrictions, the music is caused to function as a performance difficulty calculation unit that calculates the performance difficulty for the performer when playing with the instrument. Program.

  DESCRIPTION OF SYMBOLS 1 Information processing apparatus, 11 Control part, 12 Operation part, 13 Performance information recording part, 13a Microphone, 13b Camera part, 13c Sensor part, 14 Evaluation part, 15 Learning selection part, 16 Trainer information record holding part, 17 Score recommendation , 18 score simplification processing section, 19 presentation section, 20 performance level calculation section, 21 score selection section, 22 score DB, 23 new score registration section

Claims (10)

A musical score information acquisition unit for acquiring musical score information;
A restriction acquisition unit for acquiring physical restrictions related to the performance of the musical instrument by a player of the musical instrument;
An information processing apparatus comprising: a performance difficulty calculating unit that calculates a performance difficulty for the performer when playing the music on the musical instrument based on the musical score information of the music and the physical restrictions . The instrument is a keyboard instrument;
The performance difficulty calculation unit
A static finger vector calculation unit for calculating a static finger vector indicating a static arrangement of the fingers of the performer for a predetermined period arranged based on the musical score of the music;
Based on the static finger vector, a static finger difficulty calculating unit that calculates a static finger difficulty indicating a static difficulty of a player's finger for a predetermined period arranged based on the musical score of the music;
A moving finger vector calculation unit for calculating a moving finger vector indicating a dynamic change of the performer's finger between the static finger vectors;
Based on the moving finger vector, a moving finger difficulty calculating unit that calculates a moving finger difficulty indicating a dynamic difficulty of a player's finger in a predetermined period arranged based on the musical score of the music;
A fingering vector calculating means for calculating a fingering vector that is a combination of the static finger vector and the moving finger vector;
For each performance technique element comprising a combination of the fingering vectors for a predetermined performance technique in the music, from the static finger vector constituting the fingering vector and the static finger difficulty and the dynamic finger difficulty for the moving finger vector The information processing apparatus according to claim 1, wherein a performance technique level is calculated, and an average value of performance technique levels of all performance technique elements included in the music is calculated as a performance difficulty level of the music. A listening section for listening to the played music piece when the music piece is played by the instrument;
A score conversion unit that converts the music listened to by the listening unit into a score;
The musical score is different from the musical composition based on the performance level calculating section that obtains the performance level of the performer by comparing the musical score converted by the musical score conversion section with the musical score obtained from the musical score information of the musical composition. The information processing apparatus according to claim 1, further comprising a recommendation unit that recommends music. Including a score simplification processing unit that simplifies the score of the original song of the music so as to reduce the difficulty of playing,
The recommendation unit recommends a song different from the song having a lower performance difficulty level simplified by the score simplification processing unit when the performance level is lower than a first predetermined threshold. 3. The information processing apparatus according to 3. When the performance level is higher than a second predetermined threshold value that is higher than the first predetermined threshold value, the recommendation unit has a higher performance difficulty level converted by the score conversion unit. The information processing apparatus according to claim 4, wherein different music pieces are recommended. In the mode in which the recommendation unit is a mode for improving the performance level of the performer, when the performance level is higher than a second predetermined threshold value that is higher than the first predetermined threshold value, the performance difficulty level is higher. The information processing apparatus according to claim 4, wherein a music piece that is expensive and has the same original music as the music but is different from the music is recommended. In the mode in which the recommendation unit is a mode for increasing the repertoire of music that can be performed by the performer, the performance is difficult when the performance level is higher than a second predetermined threshold value that is higher than the first predetermined threshold value. The information processing apparatus according to claim 4, wherein music pieces having substantially the same degree and having different original music pieces from the music pieces are recommended. In the mode in which the recommendation unit is a mode for improving the performance level of the performer and increasing the repertoire of musical pieces that can be performed, the performance level is higher than the first predetermined threshold. When the value is higher than the threshold value, the number of repertoires that can be played by the performer and the performance level of the performer are substantially the same, and the original music is different from the music. The information processing apparatus according to claim 4, wherein the information processing apparatus according to claim 4, wherein the music difficulty is higher and the music and the original music are the same and the music different from the music is recommended. In the information processing method of the information processing apparatus,
The information processing apparatus is
Music score information acquisition processing to acquire music score information,
Restriction acquisition processing for acquiring physical restrictions related to the performance of the musical instrument by a player of the musical instrument,
An information processing method for performing performance difficulty calculation processing for calculating a performance difficulty level for the performer when the music is played on the musical instrument based on the musical score information of the music and the physical restrictions. Computer
A musical score information acquisition unit for acquiring musical score information;
A restriction acquisition unit for acquiring physical restrictions related to the performance of the musical instrument by a player of the musical instrument;
Based on the musical score information of the music and the physical restrictions, the music is caused to function as a performance difficulty calculation unit that calculates the performance difficulty for the performer when playing with the instrument. Program.

Images