JP2015069170A - Performance operation guide device, method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To automatically extract operation information related to a technique on a performance operation from fingering information added to the performance information, and to execute the performance guide of even the technique on the performance operation as well as fingering in a technology for performing the guide of the performance operation such as fingering guide in a keyboard instrument.SOLUTION: Operation state estimation means 102 is configured to, on the basis of each performance information 105 read from a storage part 104 by performance information reading means 101, estimate the performance operation state of a player in the performance information 105. Performance operation guide means 103 is configured to perform guide related to the performance operation of the player on the basis of a first performance operation state 106 estimated by the operation state estimation means 102 and a second performance operation state 107 estimated after the first performance operation state 106.

Description

  The present invention relates to a technique for guiding performance operations such as a fingering guide in a keyboard instrument.

  For example, in order to visually guide a performance operation in a keyboard instrument, a technique for guiding finger fingering in a performance on a keyboard instrument image is conventionally known (for example, Patent Document 1).

Japanese Patent No. 3521838

  Here, for example, when playing a keyboard instrument, there are various performance techniques (such as crossing and passing fingers, moving hands, spreading and narrowing hands). Therefore, it is desired not only to learn fingering but also to learn these techniques on performance. In addition, when playing a keyboard instrument or the like, not only the present, but also the preparation operation such as how to prepare the position of the finger or hand depending on the next and subsequent sound forms was one of the important techniques.

  However, the conventional fingering guide technique simply indicates the position of the key to be pressed at a certain timing and the finger that presses the key, and it is difficult to master the technique of performance performance. Had problems.

  It is an object of the present invention to automatically extract motion information related to a technique on performance behavior from fingering information added to performance information, thereby enabling performance guidance to be performed on the performance motion technique together with fingering. And

  In one example, performance information reading means for reading out performance information from the storage unit, including information related to the sound generation timing for sound generation, information related to the pitch, and information related to the performance operation of the performer of each musical sound constituting the music And an operation state estimating means for estimating the performance operation state of the performer in the performance information based on the performance information read by the performance information reading means, and a first performance operation estimated by the operation state estimating means. And a performance operation guide means for performing a guide on the performance operation of the performer based on the state and the second performance operation state estimated after the first performance operation state.

  According to the present invention, it becomes possible to automatically extract operation information related to a technique on performance performance from fingering information added to performance information, thereby performing performance guidance on performance techniques together with fingering. It becomes possible.

It is a block diagram which shows embodiment of the performance operation guide apparatus by this invention. It is a figure which shows an example of the hardware constitutions of the performance guide apparatus incorporating embodiment of the performance operation guide apparatus. It is a figure which shows the data structural example of performance information. It is a figure which shows the data structural example of operation | movement data. It is a figure which shows the example of a data structure of preparation instruction data. It is a flowchart which shows the example of the whole operation | movement process of this embodiment. It is a flowchart (the 1) which shows the example of a process of operation | movement information generation. It is a flowchart which shows the example of the process of a search of a next key. It is a flowchart which shows the example of a process of Next buffer update. It is a flowchart which shows the example of a key release confirmation process. It is a flowchart which shows the example of a key press search process. It is a flowchart (the 1) which shows the example of a process of a preparation confirmation. It is a flowchart (the 2) which shows the example of a process of a preparation confirmation. It is a flowchart (the 3) which shows the example of a process of a preparation confirmation. It is a flowchart (the 4) which shows the example of a process of a preparation confirmation. It is a flowchart which shows the example of a process of acquisition of a keyboard distance. It is a flowchart (the 1) which shows the example of a process of operation data output. It is a flowchart (the 2) which shows the example of a process of operation data output. It is a flowchart which shows the example of a process of depth position calculation. It is a flowchart which shows the example of a process of calculation of the next start time. It is a figure which shows the example of a memory | storage of performance information. It is a figure which shows the example of an output of operation | movement data when not considering preparation operation | movement. It is a figure which shows the example of an output of operation | movement data when a preparatory operation is considered. It is FIG. (1) which shows the example of a display of a performance guide. It is a flowchart (the 2) which shows the example of a process of operation | movement information generation. It is a flowchart which shows the example of a process of a preparation instruction data output. It is a figure which shows the example of an output of preparation instruction data. It is FIG. (2) which shows the example of a display of a performance guide.

Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings.
FIG. 1 is a block diagram showing an embodiment of a performance operation guide device 100 according to the present invention. The performance operation guide device 100 includes performance information reading means 101, operation state estimation means 102, and performance action guide means 103. A storage unit 104 is provided inside or outside.

  The performance information reading means 101 reads from the storage unit 104 performance information 105 that includes information related to the sound generation timing at which each musical sound constituting the music is generated, information related to the pitch, and information related to the performance operation of the performer. .

  The operation state estimation means 102 estimates the performance operation state of the performer in the performance information 105 based on the performance information 105 read by the performance information reading means 101.

  The performance operation guide means 103 performs the performance based on the first performance operation state 106 estimated by the operation state estimation means 102 and the second performance operation state 107 estimated after the first performance operation state 106. Guidance on the performance of the performers.

  In the above-described configuration, the performance operation guide device 100 may perform guidance related to the performance operation of the keyboard instrument. At this time, the operation state estimating means 102 estimates the position of the player's hand in the depth direction of the keyboard as the first and second performance operation states 106 and 107 of the player. Further, the performance operation guide means 103 performs a guide regarding the performance operation of the performer according to the estimated position of the performer's hand.

  In the configuration so far, the performance operation guide device 100 may perform guidance related to the performance operation of the keyboard instrument.

  At this time, the operation state estimation means 102, as the first and second performance operation states 106 and 107 of the performer, is in a state where the keyboard is being pressed with the thumb and from this state over the thumb with a finger other than the thumb. It is possible to estimate the state where the key is pressed at the next and subsequent timings. In this case, the performance operation guide means 103 may guide the thumb as a finger to perform, and guide a finger other than the thumb as a finger to prepare for performance.

  In addition, the operation state estimation means 102 uses the thumb as the first and second performance operation states 106 and 107 of the performer while pressing the keyboard with the thumb and pressing the key with a finger other than the thumb from this state. It may be estimated that a key is pressed at a subsequent timing after passing under a finger other than the thumb and moving. In this case, the 103 performance operation guide means may guide a finger other than the thumb as a finger to perform and guide the thumb as a finger to prepare for performance.

  In the configuration so far, the performance operation guide device 100 may perform guidance related to the performance operation of the keyboard instrument.

  In this case, the operation state estimation means 102 determines the predetermined first key operation state 106 and 107 as the player's first and second performance operation states 106 and 107 based on the predetermined key on the keyboard and the pressed key. You may estimate the state where the key of the position away from the reference value is pressed next. In this case, the performance operation guide means 103 may guide the preparation for movement from the current key pressing state to the next key pressing state.

  With the configuration of the above embodiment, the operation state estimation unit 102 determines the performance operation state of the performer in the performance information 105 based on the performance information 105 read out by the performance information reading unit 101. The performance operation states 106 and 107 can be estimated. The performance operation guide means 103 performs the performance guide using these first and second performance operation states 106 and 107, so that not only the fingering guide of the finger to perform at each operation timing, but also You can also guide your fingers to prepare for subsequent performances. Performance preparation actions can include actions such as exceeding the thumb with another finger, passing a thumb with the thumb, and moving the finger over a wide range. Become.

  FIG. 2 is a diagram illustrating an example of a hardware configuration of the embodiment of the performance operation guide apparatus 100 having the functional configuration of FIG. The apparatus 100 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an input unit 204, a display unit 205, and a MIDI interface unit (hereinafter referred to as “MIDI I / F”). 206) are connected to each other by a bus 207. The MIDI I / F 206 is connected to an external (may be built-in) electronic musical instrument 208 (corresponding to the musical instrument 104 in FIG. 1).

  The CPU 201 performs overall control of the performance operation guide device 100 according to a control program stored in the ROM 202.

  The ROM 202 stores a control program for executing a control operation shown in each flowchart described later. The ROM 202 also stores performance information 105 shown in FIG.

  The RAM 203 temporarily stores various information necessary for execution of the control program, such as performance information, operation data, and preparation instruction data shown in FIGS. 3, 4, and 5 described later.

  The input unit 204 detects an input operation by a user using a keyboard, a mouse, various switches, and the like, and notifies the CPU 201 of the detection result.

  The display unit 205 outputs data sent under the control of the CPU 201 to a liquid crystal display or the like. For example, the display unit 205 displays a performance action guide in a display format as shown in FIG.

  The MIDI I / F 206 causes the CPU 201 to automatically play the music for performing the performance operation by sequentially transferring the performance information on the ROM 202 or the RAM 203 to the electronic musical instrument 208 in the MIDI (Musical Instrument Digital Interface) data format. be able to.

  The operation of the performance operation guide device 100 according to the present embodiment is realized by the CPU 201 reading out from the ROM 202 and sequentially executing a control program loaded with the function processing of each unit in FIG. . The program may be provided via a portable recording medium (not shown) or may be acquired from the network by a network connection device (not shown).

  Hereinafter, the operation of the performance operation guide apparatus 100 according to this embodiment having the functional configuration of FIG. 1 and the hardware configuration of FIG. 2 will be described in detail.

  FIG. 3 is a diagram showing a data configuration example of performance information Note [0], Note [1],..., Note [N-1] of the music for performing the performance operation guide. Correspond. In FIG. 2, the performance information is index numbers (0, 1,..., N-1) (N is the number of pieces of performance information for one song) that is necessary for the CPU 201 to automatically play the electronic musical instrument 208. ), The sound generation start time Time to start sound generation and the sound generation duration Gate (corresponding to “information related to sound generation timing” in FIG. 1), pitch Pitch (corresponding to “information related to sound pitch” in FIG. 1), right hand or left hand Each information of a track number Hand shown (corresponding to “information about a part” in FIG. 1) and a finger number Finger (corresponding to “information about a finger to perform” in FIG. 1) is stored. The performance information Note [0], Note [1],..., Note [N-1] are sequentially read out and processed after being transferred from the ROM 202 to the RAM 203 by the CPU 201 in FIG. Index numbers (0, 1,..., N−1) are assigned so as to be arranged in the order of the start time Time.

  FIG. 4 is a diagram illustrating a data configuration example of operation data frame [0], frame [1],..., Frame [FrameCount-1] generated on the RAM 203 by a control process described later by the CPU 201 in FIG. Yes, corresponding to the operation information 105 of FIG. FrameCount indicates the total number of operation data generated on the RAM 203. In FIG. 2, the operation data includes the track number “Hand” indicating the right hand (value “1”) or the left hand (value “0”) and five tracks necessary for the CPU 201 to display the performance operation guide on the display unit 205. Performance position of each finger “position [0] to position [4]” (key number on which the finger should be placed) (corresponding to “information on performance position of each finger” in FIG. 1), start movement to move there. The operation start time “start” and the operation end time “term” (corresponding to “information about operation timing” in FIG. 1), and the states “status [0] to status [4]” of each finger (respectively, The value “−1” is a preparation operation, the value “1” is a key press, and the value “0” is not specified.) (Corresponding to “information for instructing performance guide / performance preparation guide of each finger” in FIG. 1) ,depth Storage of information such as the position of the direction "Zpos" (corresponding to "information on the depth direction position" in FIG. 1).

  FIG. 5 is a diagram showing a data configuration example of preparation instruction data PreMotion [0], PreMotion [1],..., PreMotion [PreMotionCount-1] generated on the RAM 203 by a control process described later by the CPU 201 of FIG. And corresponds to the preparation instruction information 107 of FIG. PreMotionCount indicates the total number of preparation instruction data generated on the RAM 203. In FIG. 2, when the CPU 201 displays the performance operation guide on the display unit 205 in FIG. 2, the preparation instruction data is data that is displayed to alert the user about the performance operation (fingering). . The preparation instruction data includes the track number (right hand / left hand), the preparation start time and preparation end time which are the start and end times of preparation (consciousness), and the preparation type (1 is Passing, 2 is the preparation (consciousness) type) Moving), information (corresponding to “preparation instruction information 107” in FIG. 1) such as an index number (see FIG. 3) of performance information corresponding to each finger is stored.

  Hereinafter, the performance preparation operation information generation processing in the present embodiment will be described using a flowchart. In the following description, the function parts in FIG. 1 and the hardware parts in FIG. 2 are referred to as needed. Also, the performance information Note [0] to Note [N-1] described in FIG. 3, the operation data frame [0] to frame [FrameCount] described in FIG. 4, and the preparation instruction data PrepMotion [0] described in FIG. ] To PrepMotion [PrepMotionCount] are stored in the RAM 203. Further, each variable used in the following description is also stored in the RAM 203. In the following description, the name of a variable may indicate a value stored in the variable.

  FIG. 6 is a main flowchart showing performance preparation operation information generation processing in the present embodiment. This processing is realized as an operation in which the CPU 201 executes the performance preparation operation information generation processing program stored in the ROM 202 in FIG.

  In the present embodiment, when the user selects a song from the input unit 204, the CPU 201 sends performance information Note [i] (0 ≦ i ≦ N−1) (see FIG. 3) for the one song from the ROM 202. The information is read out to the RAM 203, and the action information generation process is sequentially generated for each piece of performance information Note [i] thus read.

  When the process starts, the CPU 201 initializes performance information and various variables on the RAM 203 (step S601), reads performance information having the configuration illustrated in FIG. 3 from the RAM 203 (step S602), and illustrates the RAM 203 in FIG. The operation data and the preparation instruction data are generated in the data format (step S603), and the program is terminated.

  FIG. 7 is a flowchart illustrating an example of the operation information generation process in step S603 of FIG.

  First, the CPU 201 sets a value 1 to the part search variable iH (step S701). The part search variable iH is information indicating which one of the right hand and the left hand is to be processed. If the value is 1, the right hand indicates the right hand and if the value is 2, the left hand indicates the left hand. Thereafter, the CPU 201 increments the value of the part search variable iH by +1 in step S712, and determines for each part of the right hand and left hand indicated by the variable iH until it determines that the value of the variable iH exceeds 2 in step S702. Steps S703 to S711 are executed to generate operation data (see FIG. 4) and preparation instruction data (see FIG. 5) collectively.

  First, the CPU 201 initializes each variable (step S703). First, 0 is set in the performance information search variable iN. The values of the performance information search variable iN are index numbers 0 to N (0 ≦ i ≦ N−1, where N is the maximum of the performance information) of the performance information Note [0] to Note [N−1] illustrated in FIG. Number). Time 0 is set in the operation start time variable start. This variable is used in the operation data output process in step S710. Pointer variables Hand [0] to Hand [4] (corresponding to thumb to little finger) to the performance information to be pressed by each finger with respect to the current value of part search variable iH are undefined values. NULL is set. Hereinafter, this variable is referred to as “key depression target performance information pointer variable Hand [0] to Hand [4]”. Further, the guide object of each finger for generating performance data (see FIG. 4) by outputting performance information that is a guide object (key depression or preparatory action) for the current value of the part search variable iH. The undefined value NULL is also set in the pointer variables prep [0] to prep [4] (corresponding to the thumb to the little finger) to the performance information. Hereinafter, this variable is referred to as “output buffer performance information pointer variable prep [0] to prep [4]”. Further, the value of the variable FrameCount indicating the total number of operation data in FIG. 4 is initialized to “0”. This variable is manipulated in the operation data output process in step S710 of FIG.

  Next, the CPU 201 executes a next key search process (step S704). This process is a process of calculating each value of pointer variables Next [0] to Next [4] (corresponding to thumb to little finger) to the performance information to be pressed next to each finger. Hereinafter, this variable is referred to as “next timing performance information pointer variable Next [0] to Next [4]”. Step S704 is the first execution, and the performance information search variable iN = 0 is set in step S703. For this reason, the search for the next key in step S704 belongs to the current part iH to be pressed at the next timing for each finger with respect to the sounding timing at the beginning of the song in the current part iH. Pointer variables Next [0] to Next [4] to each piece of performance information are acquired in advance. The next timing performance information pointer variables Next [0] to Next [4] are referred to in the preparation confirmation process in step S709.

  Next, the CPU 201 increments the value of the performance information search variable iN by +1 in step S711, and in step S705, the value of the variable iN is the maximum number of performance information (in the example of FIG. 3, the maximum number of performance information = N ), The following series of processing from step S706 to S710 is executed for each piece of performance information Note [iN] (0 ≦ iN ≦ N−1). By this iterative process, the CPU 201 executes the process for all performance information Note [0], Note [1],..., Note [N-1] of the specified song for the current part iH. The operation data for the performance guide for the entire song is calculated at once.

  The CPU 201 uses the track number Hand (see FIG. 3) of the performance information Note [iN] currently being processed indicated by the performance information search variable iN (referred to as “Note [iN] .Hand”) for the current part search. Whether the variable iH is equal to the currently processed part iH, that is, whether the hand playing the note Note [iN] (separate right hand or left hand) is equal to the hand specified by iH currently being investigated. Is determined (step S706).

  If the determination in step S706 is NO, that is, if the note Note [iN] is not a sound played with the hand currently being investigated, the CPU 201 describes the performance information search variable iN as +1 (in step S711, “iN ++”). ), And the process proceeds to the next performance information processing.

  If the determination in step S706 is YES, the CPU 201 first executes a key release confirmation process (step S707). In the key release confirmation processing, when the key of the performance information Note [iN] belonging to the current part iH is pressed, the performance information of the five fingers corresponding to the key pressing of the current part iH is shown. Among the key-pressed performance information pointer variables Hand [0] to Hand [4], there is a finger whose sounding period (sounding start time + sounding duration) ends before the sounding start time of the performance information Note [iN]. If so, the pronunciation of that finger is terminated.

  Next, the CPU 201 executes a key depression search process (step S708). In the key depression search process, performance information belonging to the current part iH to be sounded is searched simultaneously with the performance information Note [iN] to be processed belonging to the current part iH. Then, the retrieved performance information is set together with the performance information Note [iN] in the key depression target performance information pointer variables Hand [0] to Hand [4] corresponding to the fingers registered in each performance information. Further, among the next timing performance information pointer variables Next [0] to Next [4], the content of the pointer corresponding to the finger on which the set has been made is pressed at the next timing on the finger on which the set has been made. The pointer value to the performance information belonging to the current part iH to be played is updated. Note that performance information belonging to the same part and starting to sound at the same time is continuously stored in the RAM 203. For this reason, after the performance information whose sound generation is started at the same time is retrieved by the key depression retrieval process, the value of the next performance information retrieval variable iN is set by jumping by the number of retrieved performance information. .

  Subsequently, the CPU 201 executes a preparation confirmation process (step S709). In the preparation confirmation process, the performance information corresponding to the performance information at the reproduction time is compared with the performance information corresponding to the performance information after the reproduction time at each reproduction time of the music while the performance information is sequentially read. As a result, for example, a first state is detected in which the key is pushed over the thumb with a finger other than the thumb while the key is depressed with the thumb and the key is depressed at the subsequent timing. Alternatively, a second state is detected in which a key other than the thumb is pressed and moved under the finger other than the thumb while the key is pressed at a subsequent timing. In addition, in any state other than the first and second states, a key whose position is different from the key being pressed by an arbitrary finger compared to a predetermined reference value is set to a timing other than that arbitrary finger at the following timing. A third state in which the key is pressed with a finger is detected. Alternatively, a fourth state in which the same key as the key being pressed with an arbitrary finger is pressed with a finger other than the arbitrary finger at the next timing is detected. Furthermore, a state is detected in which a key at a position away from a currently pressed key at a position away from a predetermined reference value is pressed next.

  The key release confirmation process in step S707, the key depression search process in step S708, and the preparation confirmation process in step S709 realize the function of the operation state estimation unit 102 in FIG.

  Next, the CPU 201 executes operation data output processing. In the operation data output process, the operation data described in FIG. 4 (corresponding to “performance operation information 105” in FIG. 1) is output.

  As described above, in the preparation confirmation process in step S709, the first state in which the key is pressed with the thumb while the key is moved over the thumb with a finger other than the thumb and the key is pressed at the subsequent timing is detected. In such a case, in the operation data output process in step S710, the following data is output as the operation data. First, information on the performance position (keyboard number) of the thumb and fingers other than the thumb is obtained as any one of positions [0] and positions [1] to [4] corresponding to the thumb. . Further, the operation start time and operation end time of the key pressing operation including the thumb and fingers other than the thumb are obtained as start and term. Further, for the thumb, a value “1” indicating a key depression (guided as a finger to perform) is obtained as status [0]. For the fingers other than the thumb, a value “−1” indicating a preparatory action (guided as a finger to be prepared for performance) is a value corresponding to each finger of status [1] to status [4]. It is obtained as something.

  In addition, as described above, in the preparation confirmation process in step S709, the key is pressed at the next and subsequent timings while the key other than the thumb is moved under the finger other than the thumb while the key is pressed with the finger other than the thumb. When the state 2 is detected, the following data is output as the operation data in the operation data output process of step S710. First, information on the finger other than the thumb and the performance position (keyboard number) of the thumb is obtained as position [0] corresponding to each thumb of position [1] to position [4]. Also, the operation start time and operation end time of the key pressing operation including the fingers other than the thumb and the thumb are obtained as start and term. Further, for fingers other than the thumb, a value “1” indicating a key press (guided as a finger to perform) is obtained as one corresponding to each finger of status [1] to status [4]. It is done. For the thumb, a value “−1” indicating a preparatory operation (guided as a finger to be prepared for performance) is obtained as status [0].

  Further, as described above, in the preparation confirmation process in step S709, the position closer to the predetermined reference value is different from the key being pressed with any finger than in the first and second states. When the third state in which the key is pressed with a finger other than the arbitrary finger is detected at the subsequent timing, in the operation data output process of step S710, the operation data is as follows: Data is output. First, the information on the performance position (keyboard number) of the arbitrary finger and the fingers other than the arbitrary finger is obtained as any one of the positions [0] to position [4] corresponding to each finger. Also, the operation start time and operation end time of the key pressing operation including the above-mentioned arbitrary finger and fingers other than the arbitrary finger are obtained as start and term. Further, the value “1” indicating the key depression (guided as a finger to be played) is given for the arbitrary finger, and the preparatory operation (preparation for performance should be performed) for the fingers other than the arbitrary finger. A value “−1” indicating “guided as a finger” is obtained as any one of status [0] to status [4] corresponding to each finger.

  The operation data output process in step S710 described above realizes the functions of the operation state estimation unit 102 and the performance operation guide unit 103 in FIG.

  The series of processes from step S706 to step S710 described above is performed for each performance described in FIG. 3 for each part of the right hand and left hand by the repetition control controlled by steps S702 and S712, and by the repetition control controlled by steps S705 and S711. It is executed for each information Note [iN] (0 ≦ iN ≦ N−1). As a result, the operation data frame [0] to frame [FrameCount-1] described with reference to FIG. This motion data includes not only information on which finger is pressed for each motion timing but also information on which finger is prepared for the next key press, statuses [0] to status of each finger. It is characterized by possessing as [4]. By using such operation data, the CPU 201 can realize the following performance operation guide on the display of the display unit 205.

  For example, a value “1” indicating a key press is set in status [0] indicating the state of the thumb, and a preparation operation is performed on any of status [1] to status [4] indicating the state of a finger other than the thumb. When the value “−1” is set, the CPU 201 presses the key represented by the thumb position position [0] with the thumb and the statuses [1] to status indicating the states of the fingers other than the thumb. Among the fingers of [4], for which the value “−1” indicating the preparatory action is set, the finger at the position of the key represented by any of position [1] to position [4] corresponding to the finger. Operate to prepare (place). In this case, depending on the relationship between the thumb position position [0] and the key positions of the other finger positions position [1] to position [4] to be prepared, the right / left positional relationship of the normal finger is reversed. May be in a positional relationship. In such a case, the CPU 201 can perform a guide display of a preparatory operation of “move fingers other than the thumb over the thumb to the next key pressing position”.

  In addition, for example, a value “1” indicating a key press is set in any of status [1] to status [4] indicating the state of a finger other than the thumb, and a preparatory operation is performed on status [0] indicating the state of the thumb. Similarly, when the value “−1” indicating the key is set, depending on the positional relationship between the position of the finger key indicating the key press and the position of the key on which the thumb should perform the preparation operation, the CPU 201 It is possible to guide display the preparatory action of “Move the bottom of the finger other than the thumb and move it to the next key pressing position”.

  It can be said that these performance guide displays are operation information related to techniques on performance operations. In this way, the performance action is performed from the fingering information ("finger number" in FIG. 3) added to the performance information by the action information generation process in step S603 of FIG. 6 shown in the flowchart of FIG. 7 in the present embodiment. It is possible to automatically extract motion information relating to the above technique, and thereby it is possible to guide performance techniques as well as fingering.

  FIG. 8 is a flowchart showing an example of the next key search process in step S704 of FIG.

  First, the CPU 201 stores the value “0” in the finger number designation variable ifig (step S801).

  Next, in step 803, the CPU 201 determines that the value of the variable ifig has reached the maximum number of fingers of one hand “5” in step S 802 while incrementing the value of the finger number designation variable ifig by +1 in step S 804. The next timing performance information pointer variable Next [ifig] corresponding to the finger indicated by the variable ifig is updated. Here, ifif = 0, the thumb is designated, ifig = 1, the index finger, ifig = 2, the middle finger, ifig = 3, the ring finger, and ifig = 4, the little finger is designated.

  FIG. 9 is a flowchart showing an example of Next [ifig] update processing in step S803 of FIG.

  First, the CPU 201 stores an undefined value NULL in the next timing performance information pointer variable Next [ifig] corresponding to the finger indicated by the current finger number ifig (step S901).

  Next, the CPU 201 stores a value obtained by adding 1 to the counter value of the current performance information (in the case of FIG. 7 to FIG. 8, the value indicated by the performance information search variable iN) in the performance information search variable i (step S902). ). This means that the search is performed from the performance information next to the current performance information.

  Next, the CPU 201 increments the value of the performance information search variable i by +1 in step S906, while the value of the variable i is the maximum number of performance information in step S903 (in the example of FIG. 3, the maximum number of performance information = N). ), The following determination processing of steps S904 and S905 is executed for each performance information Note [i] (current performance information index number + 1 ≦ i ≦ N−1).

  That is, the CPU 201 first describes the track number Hand (see FIG. 3) indicating the right hand or the left hand in the performance information Note [i] indicated by the performance information search variable i (referred to as “Note [i] .Hand” in FIG. 9). ) Is equal to the part number currently being processed indicated by the value of the part search variable iH (see steps S701, S702, and S712 in FIG. 7) (step S904). Note that “==” in FIG. 9 is an operator that checks that the values on both sides are “equal”.

  If the determination in step S904 is NO, the performance information Note [i] indicated by the performance information search variable i is not the part currently being processed (separate right hand / left hand), so the CPU 201 proceeds to the process in step S906. Then, it proceeds to search for the next performance information.

  If the determination in step S904 is YES, the CPU 201 further designates a finger number Finger (see FIG. 3) in the performance information Note [i] indicated by the performance information search variable i (see “Note [i]. Finger” in FIG. 9). It is determined whether or not the finger number ifig currently being processed (see steps S801, S802, and S804 in FIG. 8) is equal (step S905).

  If the determination in step S905 is NO, the performance information Note [i] indicated by the performance information search variable i is a musical note played with a finger other than the finger currently being processed, and therefore the CPU 201 proceeds to the process of step S906. To the next search for performance information.

  If the determination in step S905 is YES, the CPU 201 finds that the track number (part number) and the finger number match the next timing performance information pointer variable Next [ifig] corresponding to the finger indicated by the current finger number ifig. The pointer value (storage address, etc.) to the performance information Note [i] is stored, and the update process of the next timing performance information pointer variable Next [ifig] is terminated.

  When the determination in step S904 or S905 continues to be NO, and when the search for all performance information is finished and the determination in step S903 is NO, the CPU 201 is represented by ifig shown in the flowchart of FIG. The update process is terminated while the content of the next timing performance information pointer variable Next [ifig] regarding the finger is set to NULL in step S901. The process of FIG. 9 is repeatedly executed in FIG. 8 while sequentially changing the instructions of the fingers by ifig, and the process is sequentially performed for all fingers of the part (right hand / left hand) currently being processed.

  As described above, the processing for searching for the next key in step S704 in FIG. 7 is realized by the example of the processing shown in the flowcharts in FIGS.

  FIG. 10 is a flowchart showing an example of the key release confirmation process in step S707 of FIG.

  First, the CPU 201 stores the value “0” in the finger number designation variable ifig (step S1001).

  Next, from step 1003 until the CPU 201 determines that the value of the variable ifig has reached the maximum number of fingers of one hand “5” in step S1002 while incrementing the value of the finger number designation variable ifig by +1 in step S1006. A series of processing of S1005 is executed. The meaning of each value of the variable ifig is the same as in the case of FIG.

  The CPU 201 determines whether or not the value of the key-pressing target performance information pointer variable Hand [ifig] indicated by the current finger number ifig is not an undefined value (step S1003). Note that “! =” In FIG. 10 is an operator that checks that the values on both sides are not equal. As described above, the key-pressing target performance information pointer variable Hand [ifig] is a pointer variable to performance information when the finger represented by ifig is pressing, so the value of Hand [ifig] is If it is not Null, it means that the finger is being pressed.

  If the determination in step S1003 is NO, since the finger is not being pressed, the CPU 201 proceeds to the process in step S1006 and proceeds to the next finger process.

  If the value of the key-pressing target performance information pointer variable Hand [ifig] is not an undefined value and the determination in step S1003 is YES, the CPU 201 generates the sound generation start time Time of the performance information indicated by the pointer variable Hand [ifig] (see FIG. 3). ) Is added to the sound generation duration time Gate of the performance information to calculate the sound generation end time of the performance information. Then, the CPU 201 determines that the sound generation end time of the performance information pointed to by the pointer variable Hand [ifig] is the performance information that is currently processed by the performance information search variable iN (see steps S705, S711, etc. in FIG. 7). It is determined whether or not the sounding start time Time of Note [iN] is earlier (smaller) (step S1004).

  If the sounding end time of the performance information pointed to by the pointer variable Hand [ifig] is before the sounding start time Time of the performance information Note [iN] to be processed and the determination in step S1004 is YES, the CPU 201 determines that the pointer variable Hand [ifig] ] Stores the undefined value NULL, and puts the finger indicated by the current finger number ifig into a key-released state (step S1005).

  After that, the CPU 201 proceeds to the process of step S1006 and proceeds to the next finger process.

  When the confirmation for all five fingers is completed and the determination in step S1002 is NO, the CPU 201 ends the key release confirmation process in step S707 of FIG. 7 shown in the flowchart of FIG.

  As described above, each finger indicated by the key-pressing target performance information pointer variables Hand [0] to Hand [4] by the key release confirmation processing in step S707 of FIG. 7 shown in the processing example of the flowchart of FIG. Among the pieces of performance information that are currently being pressed, the finger whose sounding end time is earlier than the sounding start time of the currently processed performance information Note [iN] is set to the key release state.

  FIG. 11 is a flowchart illustrating an example of the key depression search process in step S708 of FIG.

  First, the CPU 201 sets the value of the performance information search variable iN to be processed to the performance information search variable i. That is, the start position for searching for performance information for simultaneous pronunciation is the performance information Note [iN] itself that is currently processed. The CPU 201 also sets the value of the performance information search variable iN to be processed at present in the variable set indicating the index number of the performance information searched last for simultaneous sounding. In other words, the performance information searched last for simultaneous pronunciation is the performance information Note [iN] itself that is currently processed (step S1101).

  Next, the CPU 201 increments the value of the performance information search variable i by +1 in step S1109, while the value of the variable i is the maximum number of performance information in step S1102 (in the example of FIG. 3, the maximum number of performance information = N. Steps S1103 to S1108 are executed until it is determined that the above has been reached.

  First, the CPU 201 stores the track number Hand (see FIG. 3) indicating the right hand or the left hand in the performance information Note [i] indicated by the performance information search variable i (described as “Note [i] .Hand” in FIG. 9). Then, it is determined whether or not the value of the part search variable iH is equal to the currently processed part number (see steps S701, S702, and S712 in FIG. 7) (step S1103).

  If the determination in step S1103 is NO, the performance information Note [i] indicated by the performance information search variable i is not the part currently being processed (separate right hand / left hand), so the CPU 201 proceeds to the process in step S1109. Then, it proceeds to search for the next performance information.

  If the determination in step S1103 is YES, the CPU 201 determines the sound generation start time Time (see FIG. 3) in the performance information Note [i] indicated by the performance information search variable i (“Note [i] .Time” in FIG. 11). Is described as “Note [iN] .Time” in FIG. 11) as to the sound generation start time Time (see FIG. 3) of the performance information Note [iN] that is currently processed. Determination is made (step S1104).

  If the performance information at the same time is found and the determination in step S1104 is YES, the CPU 201 stores the finger number Finger in the currently searched performance information Note [i] (“Note [in FIG. 11) in the finger number designation variable ifig. i] .Filter ”(step S1105).

  In the first process, since i = iN (see step S1101), the determination in step S1104 is “Note [i] .Time = Note [iN] .Time == Note [iN] .Time?”. The decision is to compare yourself with yourself. For this reason, the determination in step S1104 is always YES.

Next, the CPU 201 stores the finger number Finger (see FIG. 3) of the searched performance information Note [i] in the current finger number ifig (step S1105).
Thereafter, the CPU 201 stores a pointer to the searched performance information Note [i] in the key-pressing target performance information pointer variable Hand [ifig] indicated by the current finger number ifig (step S1106). That is, for the performance information that is the same time as the pronunciation start time Time (see FIG. 3) of the performance information Note [iN] to be processed (referred to as “Note [iN] .Time” in FIG. 11), Each note is set in the pointer variable Hand [ifig] for the finger to be played. As described above, in the first process, since the determination in step S1105 is always YES, the pointer to the searched performance information Note [i] that is currently processed is always the key-pressed performance information pointer variable Hand [ifig. ] Will be registered.

  Further, the CPU 201 stores the value of the performance information search variable i indicating the searched performance information Note [i] in the variable set indicating the index number of the performance information searched last for simultaneous sounding (step S1107). ). Since the variable set is updated every time a sound that performs simultaneous sound generation is found in step S1104, the largest performance information search variable i among those that perform simultaneous sound generation is finally set. .

  Finally, the CPU 201 executes a process of updating the next timing performance information pointer variable Next [ifig] corresponding to the finger indicated by the finger number ifig (see step S1105) corresponding to the searched performance information Note [i] (see step S1105). Step S1108). An example of this processing is shown in the flowchart of FIG. However, in step S902 in FIG. 9, the CPU 201 stores a value obtained by adding 1 to the counter value i of the searched current performance information in the performance information search variable i. This means that the performance information to be pressed next is searched from the performance information next to the current performance information Note [i] for performing the simultaneous sounding searched.

  After the process of step S1108, the CPU 201 proceeds to the process of step S1109 and proceeds to search for the next performance information.

  Here, as described with reference to FIG. 3, the performance information Note [0], Note [1],..., Note [N] are index numbers (0, 1,. ..., N). Accordingly, in the determination in step S1104, the sounding start time Time in the performance information Note [i] indicated by the current performance information search variable i is the same as the sounding start time Time of the performance information Note [iN] currently processed. Instead, if the determination result is NO, there is no performance information at the same time after the performance information Note [i] indicated by the current performance information search variable i. Therefore, in this case, the CPU 201 ends the key pressing search process. In this case, for the performance information searched for performing simultaneous pronunciation, in steps S709 and S710 of FIG. 7, along with the performance information Note [iN] to be processed, the key depression target performance information pointer variable Hand [0] ˜ Since it is set to Hand [4] and processed in a lump, it is not necessary to execute the processing loop from step S706 to S710 in FIG. For this reason, the CPU 201 sets the value of the variable set indicating the index number of the performance information searched last to perform simultaneous sounding as the value of the performance information search variable iN to be processed at the next processing. In this case, the already searched notes are skipped as simultaneous pronunciation, and the processing is continued. (Step S1110).

  After the process of step S1110, the CPU 201 ends the key depression search process of step S708 of FIG. 7 shown in the flowchart of FIG.

  Also, when the search for all performance information is completed and the determination in step S1102 is NO, the CPU 201 ends the key depression search process in step S708 of FIG. 7 shown in the flowchart of FIG.

  12 to 15 are flowcharts illustrating an example of the preparation confirmation process in step S709 of FIG.

  Through the preparation confirmation processes of FIGS. 12 to 15, prep [0] to prep [4] are targets for outputting the operation data of FIG. 4 in the operation data output process of step S710 of FIG. The performance information for each finger is stored. The performance information in this case includes performance information to be depressed at the output timing of the corresponding operation data and performance information to be prepared for key depression at the next operation timing. First, the CPU 201 performs a series of processing from steps S1201 to S1208 in FIG. 12 to temporarily change the contents of the key-pressing target performance information pointer variables Hand [0] to Hand [4] into the output buffer performance information pointer variable prep [0]. ] To prep [4]. In this copy process, first, the contents of pointer variables Hand [0] to Hand [4] storing performance information to be pressed are copied to prep [0] to prep [4]. Thereafter, in the flowcharts of FIGS. 13 to 15, performance information to be subjected to a preparation operation is determined from the next timing performance information pointers Next [0] to Next [4] of each finger. The determined performance information is additionally registered in prep [0] to prep [4] in step S1243 of FIG.

  First, the CPU 201 stores the value “0” in the preparation operation determination variables Prepare, Moving, and Passing (step S1201).

  Next, the CPU 201 stores the value “0” in both the finger number designation variable ifig and the key depression index counter variable figure (step S1202).

  After that, the CPU 201 increments the finger number designation variable ifig by +1 in step S1208, and until it determines in step S1203 that the value of the variable ifig has reached the maximum number of fingers of one hand “5”, from step S1204 to S1207. A series of processes up to are executed.

  First, the CPU 201 stores the undefined value NULL in both the output buffer performance information pointer variable prep [ifig] and the temporary buffer performance information pointer variable pList [ifig] corresponding to the current finger number ifig. Further, the CPU 201 stores the value “−1” in the step data step [ifig] corresponding to the current finger number ifig (step S1204). Here, the performance information pointer variables for the temporary buffer pList [0] to pList [4] are used to indicate that the performance information pointer variables prep [0] to prep [4] for the output buffer exceed the finger or the finger. A pointer to performance information to be subjected to a special preparation operation such as passing or hand movement is stored. These pList [0] to pList [4] are not used in the process of the flowchart of FIG. 7, but are used in the process of outputting the preparation instruction data in the flowcharts shown in FIGS. Further, the step data step [ifig] indicates which key pressing stage the finger corresponding to the current finger number ifig is in. If step [ifig] = 0, it indicates that the finger should be pressed this time, and if step [ifig] = 1, 2,..., the key is pressed next time, next,. Indicates that it should be. Step [ifig] = − 1 set in step S1204 indicates that the key pressing stage has not yet been determined for the finger.

  Next, the CPU 201 copies the contents of the key-pressing performance information pointer variable Hand [ifig] corresponding to the current finger number ifig to the output buffer performance information pointer variable prep [ifig] (step S1205).

  Next, the CPU 201 determines whether or not the content of the output buffer performance information pointer variable prep [ifig] corresponding to the current finger number ifig is not the undefined value NULL (step S1206).

  If the content of prep [ifig] is not the undefined value NULL and the determination in step S1206 is YES, it means that the content of the key depression target performance information pointer variable Hand [ifig] corresponding to the finger number ifig is not NULL. The CPU 201 stores a value “0” indicating the current key depression in the step data step [ifig] corresponding to the current finger number ifig. Further, the CPU 201 increments the value of the key depression index counter variable “figure” by +1 (described by an operator “++” in FIG. 12) (step S1207).

  When the content of prep [ifig] is the undefined value NULL and the determination in step S1206 is NO, or after the process in step S1207, the CPU 201 proceeds to the process in step S1208 and executes the process for the next finger. To do.

  After the above-described series of processing from step S1203 to S1208, when the copy processing for five fingers is completed and the determination in step S1208 is NO, the key-pressed performance information pointer variables Hand [0] to Hand Of [4], a pointer to performance information indicating key depression is copied to output buffer performance information pointer variables prep [0] to prep [4]. In this case, the value “0” is stored in the data corresponding to the finger in the key pressing state among the step data step [0] to step [4], and the undefined state is stored in the data corresponding to the other fingers. The indicated value “−1” is stored.

  After the determination in step S1203 in FIG. 12 is NO, the CPU 201 executes a series of processes in steps S1209 to S1219 in FIG. Here, among the next timing performance information pointer variables Next [0] to Next [4], a finger for which a pointer to performance information is not defined in the output buffer performance information pointer variables prep [0] to prep [4]. A pointer to performance information with the earliest sounding start time and a finger number corresponding thereto are acquired in variables NotePre and fig, respectively.

  That is, the CPU 201 first determines whether or not the value of the key depression index counter variable figure is smaller than 5 (step S1209).

  If the value of the key depression index counter variable figure is 5, all five fingers indicate that the key is being depressed (see steps S1206 and S1207 in FIG. 12), and output buffer performance information. There is no finger in which pointers to performance information are not defined in the pointer variables prep [0] to prep [4]. In this case, the determination in step S1209 in FIG. 13 is NO, and the CPU 201 ends the preparation confirmation process in step S709 in FIG. In this case, the values of the preparation operation determination variables Prepare, Moving, and Passing remain set to the value “0” in step S1201 of FIG. The five pieces of performance information set in the output buffer performance information pointer variables prep [0] to prep [4] are all set in the key depression target performance information pointer variables Hand [0] to Hand [4]. In addition, five pieces of performance information that start sounding at the same time are stored as they are. As a result, in the operation data output process in step S710 of FIG. 7 described later (refer to steps S1712 → S1713 of FIG. 18 described later), both finger states “status [0] to status [4]” (see FIG. 4). A value “1” indicating a key press is set. That is, the processing of steps S1714 → S1715 in FIG. 18 to be described later is never executed, and the value “−” indicating the preparatory operation is displayed in any of the finger statuses [0] to [4] (see FIG. 4). “1” is not set.

  If the value of the key depression index counter variable is less than 5 and the determination in step S1209 is YES, the CPU 201 stores the initial value “1” in the current key depression comparison stage variable step (step S1210). The value of the key pressing comparison stage variable step indicates the timing at which performance information to be pressed is compared with the performance information currently being pressed. If step = 1, it indicates that the performance information being pressed at the next timing is compared with the performance information being currently pressed. If step = 2, it indicates that the performance information that is pressed at the next timing is compared with the performance information that is currently being pressed. The value of the key pressing comparison stage variable step is initialized to “1” in step S1209 and then incremented by +1 in step S1244 of FIG. 15 described later, and the search from steps S1211 to S1219 is repeatedly executed.

  Next, the CPU 201 sets an undefined value in the variable NotePre that stores a pointer to performance information having the earliest sounding start time among fingers whose key pressing and preparation actions are not yet determined in the current key pressing comparison step. A value “−1” indicating that no finger is present is stored in a variable fig that stores NULL and stores a finger number corresponding to the NULL (step S1211).

  Next, after setting an initial value “0” (thumb) to the finger number designation variable ifig in step S1212, the CPU 201 increments the value of igf by +1 in step S1219, and in step S1213 the maximum number of fingers in one hand Until it is determined that “5” has been reached, the following series of processing from steps S1214 to S1218 is executed.

  First, the CPU 201 sets the value of step data step [ifig] corresponding to the current finger number ifig to a value “−1” indicating that the key pressing stage has not yet been determined for the finger of the finger number ifig (FIG. 12). It is determined whether or not (see step S1204) (step S1214).

  If the value of the step data step [ifig] corresponding to the current finger number ifig is other than “−1” and the determination in step S1214 is NO, it is determined that the finger of the finger number ifig performs a key press or a preparation operation. Since it has been completed, the CPU 201 proceeds to the process of step S1219 and proceeds to the process of the next finger number.

  If the value of the step data step [ifig] corresponding to the current finger number ifig is “−1” and the determination in step S1214 is YES, the CPU 201 determines the next timing performance information pointer variable Next corresponding to the current finger number ifig. It is determined whether the value of [ifig] is not the undefined value NULL (step S1215).

  If the value of Next [ifig] is the undefined value NULL and the determination in step S1215 is NO, the finger corresponding to the finger number ifig is not pressed at the next or subsequent timing. Therefore, the CPU 201 proceeds to the process of step S1219 and proceeds to the process of the next finger number.

  If the value of Next [ifig] is not the undefined value NULL and the determination in step S1215 is YES, the CPU 201 changes the performance information to the earliest sounding start time among the fingers whose key presses and preparation operations are not yet determined. The content of the variable NotePre for storing the pointer is not the undefined value NULL, and the sounding start time Time (denoted as “NotePre.Time” in FIG. 13) indicated by the variable NotePre corresponds to the current finger number ifig. It is determined whether or not it is earlier (smaller) than the sounding start time Time of the performance information indicated by the next timing performance information pointer variable Next [ifig] (described as “Next [ifig] .Time” in FIG. 13) (step S1216). ).

  If the determination in step S1216 is YES, the sounding start time of the performance information indicated by the current variable NotePre is the sounding start time of the performance information indicated by the next timing performance information pointer variable Next [ifig] corresponding to the current finger number ifig. Faster than. In this case, the CPU 201 maintains the content of the variable NotePre as it is, and proceeds to the process of step S1219 to proceed to the process of the next finger number.

  If the determination in step S1216 is NO, the current variable NotePre has not been defined yet (NULL), or the performance information indicated by the next timing performance information pointer variable Next [ifig] corresponding to the current finger number ifig The sound generation start time is earlier than the sound generation start time of the performance information indicated by the current variable NotePre. Therefore, in this case, the CPU 201 copies the pointer value stored in Next [ifig] to the variable NotePre (step S1217).

  Further, the CPU 201 copies the value of the current finger number designation variable ifig to the variable fig that holds the finger number corresponding to the variable NotePre (step S1218).

  Thereafter, the CPU 201 proceeds to the process of step S1219 and proceeds to a process for the next finger number ifig.

  The series of processes from step S1214 to step S1218 are repeatedly executed for each finger number ifig, and when the value of the finger number ifig eventually becomes 5 and the determination in step S1213 is NO, the variable NotePre is still set. Among the fingers for which no key press or preparatory action has been determined, the next key press by the finger is compared with other fingers, and the pointer to the performance information with the earliest pronunciation start time in the current key press comparison step is can get. In addition, a finger number corresponding to the performance information indicated by NotePre is obtained in the variable fig. Initially, the key-press comparison stage step = 1 (see step S1210). Therefore, the variables NotePre and fig are obtained with a pointer to performance information with the earliest sounding start time to be pressed next to the current key press and the corresponding finger number.

  When the determination in step S1213 is NO, the CPU 201 executes a series of processes from steps S1220 to S1239 in the flowchart of FIG. Here, the performance state corresponding to the performance information obtained in the above-mentioned variable NotePre is compared with the performance state of the performance information indicating the key depression among the output buffer performance information pointer variables prep [0] to prep [4]. The

  First, the CPU 201 determines whether or not the content of the variable NotePre is not the undefined value NULL (step S1220). Depending on the execution state of steps S1213 to S1219 in FIG. 13, after the content of the variable NotePre is set to the undefined value NULL in step S1211 in FIG. 13, the determination in step S1216 in FIG. 13 is YES for all finger numbers ifig. Otherwise, the determination in step S1213 may be NO. In this case, the variable NotePre is in a state where a pointer to the performance information with the earliest sounding start time cannot be obtained, and the value of NotePre becomes the undefined value NULL. As a result, if the determination in step S1220 is NO, the CPU 201 ends the preparation confirmation process in step S709 of FIG.

  If the content of the variable NotePre is not the undefined value NULL and the determination in step S1220 is YES, the CPU 201 registers the content of the variable NotePre in any of the output buffer performance information pointer variables prep [0] to prep [4]. A value “1” indicating registration is temporarily stored in a set variable set indicating whether or not (step S1221). The value of the set variable set can be set to a value “0” indicating non-registration in determination of various performance states described later (steps S1231, S1233, and S1238 in FIG. 14).

  Next, the CPU 201 sets the current key pressing comparison stage variable to step data step [ifig] corresponding to the finger number fig of the performance information having the earliest sounding start time to be pressed next to the current key pressing. The value of step (the value “1” for the first time) is stored (step S1222). This is control for preventing the finger number that has already been processed from being selected again as YES in the determination in step S1214 of FIG. 13 executed after the second time. Further, by looking at each value of the step data step [0] to step [4], it is possible to know the number of performance information to be pressed after the current key pressing timing. It also has the merit that it can be used to control the guide.

  Next, the CPU 201 sets an initial value “0” (thumb) to the finger number designation variable ifig in step S1223, and then increments the value of igf by +1 in step S1239, while the value of the finger number ifig is set in step S1224. Until it is determined that the maximum number of fingers of one hand “5” has been reached, the following series of processing from step S1225 to S1238 is executed. In this process, for the next key pressing information obtained by the series of processes in steps S1214 to S1218 in FIG. Sound) is checked.

  First, the CPU 201 sets the value of the finger number ifig not equal to the finger number fig of the performance information with the earliest sounding start time to be pressed next to the current key press, and for the output buffer corresponding to the finger number ifig. Whether or not the value of the performance information pointer variable prep [ifig] is not the undefined value NULL and the step data step [ifig] corresponding to the finger number ifig is equal to a value “0” indicating key depression (step in FIG. 12). S1207) is determined (step S1225). The first condition checks that ifig and fig are different because it is not necessary to examine the relationship between the same fingers. The second condition is that if the performance information of the finger number ifig to be investigated has not yet been determined and prep [ifig] is NULL, there is no need to examine the relationship with such finger ifig. . The third condition is to check whether the finger number ifig to be investigated is a finger that has been pressed. This determination is a determination as to whether or not the performance information indicated by the output buffer performance information pointer variable prep [ifig] corresponding to the finger number ifig is performance information indicating key depression.

  If the determination in step S1225 is NO, since prep [ifig] does not indicate performance information indicating key depression, the process proceeds to step S1239 and proceeds to the next finger number process.

  If the performance information indicated by prep [ifig] is performance information indicating key depression, and if the determination in step S1225 is YES, the CPU 201 indicates that the key depression performance information indicated by prep [ifig] and the variable NotePre still indicate The keyboard distance between the performance information with the earliest sounding start time to be pressed next to the current key pressing among the fingers for which the key pressing or the preparation operation has not been determined is acquired (step S1226). The keyboard distance is a value obtained by converting the pitch Pitch (see FIG. 3) of the performance information with the larger finger number into the keyboard number, and converting the pitch Pitch of the performance information with the smaller finger number into the keyboard number. Calculated as the result of subtraction. Details of this processing will be described later using the flowchart of FIG.

  Next, the CPU 201 determines whether or not the keyboard distance acquired in step S1226 is smaller than 0 (step S1227).

  If the keyboard distance is less than 0 and the determination in step S1227 is YES, it indicates that the positional relationship between the two fingers whose current relationship is being investigated is reversed from the position of the finger in the normal hand orientation. . Therefore, in this case, the CPU 201 determines that either the finger number fig of the performance information to be pressed next next to the current key press or the finger number ifig of the current key press is the thumb finger number. It is determined whether it is “0” (step S1228). That is, it is checked whether one of the two fingers whose relationship is currently being investigated is a thumb.

  If the determination in step S1228 is YES, the CPU 201 is in the first state in which the key is moved with the thumb other than the thumb while the key is pressed with the thumb and pressed at the next and subsequent timings. Alternatively, it is determined that the key is in the second state in which the key is pressed at the next and subsequent timings while the key other than the thumb is pressed while the key is pressed with the finger other than the thumb.

  In this case, the CPU 201 stores a value “1” in the finger crossing variable Passing indicating the crossing of fingers, which is one of the preparatory movement determination variables (step S1229).

  Further, the CPU 201 performs a temporary buffer performance information pointer variable pList [NotePre.] Corresponding to a finger number Finger (see FIG. 3) in the performance information indicated by the variable NotePre (referred to as “NotePre.Finger” in FIG. 14). The value of the variable NotePre is stored in [Finger] (step S1230). That is, with respect to the finger represented by “NotePre.Finger”, the performance information indicated by NotePre is used as a sound that needs to be subjected to special preparatory actions such as finger crossing, finger penetration, and hand movement. Store in the area.

  Thereafter, the CPU 201 proceeds to the process of step S1239 and proceeds to a comparison process with the performance information of the key depression having the next finger number.

  If the determination in step S1228 is NO, the CPU 201 determines that there is no intersection between fingers other than the thumbs, and sets the content of the variable NotePre as one of the output buffer performance information pointer variables prep [0] to prep [4]. A value “0” indicating non-registration is stored in a set variable set indicating whether or not to register (step S1231). That is, the performance information indicated by the variable NotePre is determined to be a sound that cannot be prepared unless the fingers are crossed because of the relationship with the finger that is currently pressed. Will not be registered.

  Thereafter, the CPU 201 proceeds to the process of step S1239 and proceeds to a comparison process with the performance information of the key depression having the next finger number.

  If the keyboard distance is not smaller than 0 and the determination in step S1227 is NO, the CPU 201 determines whether or not the keyboard distance acquired in step S1226 is greater than a reference value (step S1232). The reference value is, for example, a value of about 2 to 4 keys in the interval between fingers × semitone. For example, the distance between the thumb and the little finger can be about 8 to 16 semitones with a finger interval (4-0) × 2 to 4 semitones. Become.

  If the keyboard distance is greater than the reference value and the determination in step S1232 is YES, the CPU 201 determines that the movement range of the hand playing the keyboard is large, and stores a value “0” indicating non-registration in the set variable set. . That is, the performance information indicated by the variable NotePre is not registered as performance information for performing the preparation operation.

  Next, the CPU 201 determines whether or not the value of the key pressing comparison stage variable step is “1” (step S1234).

  If the determination in step S1234 is YES, that is, if it is determined that the keyboard movement is performed at the next operation timing of the current key press, a sound whose keyboard distance is larger than the reference value is immediately after the current key press. Since it is executed at the next operation timing, the finger jump is necessary. Therefore, the CPU 201 stores the value “1” in the movement variable Moving indicating the movement of the finger hand, which is one of the preparation action determination variables (step S1235).

  Further, similarly to step S1230, the CPU 201 performs performance information pointer variable pList [NotePre. For temporary buffer corresponding to the finger number Finger in the performance information indicated by the variable NotePre. The value of the variable NotePre is stored in [Finger] (step S1236).

  As described above, the performance information indicated by the variable NotePre is not registered as performance information for the preparation operation, but the movement variable Moving and the temporary buffer performance information pointer variable pList [NotePre. [Finger] is set. As described above, pList [0] to pList [4] are not used in the process of the flowchart of FIG. 7, but are used in the process of outputting the preparation instruction data in the flowcharts shown in FIGS. .

  If the keyboard distance is not greater than the reference value and the determination in step S1232 is NO, the CPU 201 determines whether the keyboard distance acquired in step S1226 is 0 and the value of the key pressing comparison stage variable step is not “1”. Is determined (step S1237). If this determination is YES, it means that the same key as the key being pressed with an arbitrary finger is pressed with a finger different from the currently pressed key at a later timing than the next. ing.

  If the determination in step S1237 is NO, the CPU 201 maintains a state where the value “1” indicating registration is stored in the set variable set. That is, the performance information indicated by the variable NotePre can be registered as performance information for performing the preparation operation. Thereafter, the CPU 201 proceeds to the process of step S1239 and proceeds to a comparison process with the performance information of the key depression having the next finger number.

  If the same key as the key being pressed with an arbitrary finger is pressed with a finger other than the arbitrary finger at the next and subsequent timings, and the determination in step S1237 is YES, the CPU 201 A value “0” indicating non-registration is stored in the set variable set (step S1238). That is, the performance information indicated by the variable NotePre is not registered as performance information for performing the preparation operation.

  Thereafter, the CPU 201 proceeds to the process of step S1239 and proceeds to a comparison process with the performance information of the key depression having the next finger number.

  The CPU 201 executes the above-described series of processing from steps S1225 to S1238 for the finger numbers ifig from 0 to 4. Thus, the CPU 201 compares the performance state corresponding to the performance information obtained in the variable NotePre with the performance state of the performance information indicating the key depression among the output buffer performance information pointer variables prep [0] to prep [4]. To do. Then, the CPU 201 determines whether or not the pointer to the performance information indicated by NotePre can be registered in prep [0] to prep [4] as the pointer to the performance information for performing the preparation operation, and the value of the set variable set is set. Do the set.

  When the above-described control operation corresponding to all finger numbers ifig from 0 to 4 is completed for the performance information of the current variable NotePre, when the determination in step S1224 is NO, the CPU 201 performs the control process of the flowchart of FIG. Run.

  In FIG. 15, the CPU 201 determines whether or not the value “1” is stored in the movement variable Moving, or whether the value “1” is stored in the finger crossing variable Passing (step S1240).

  If the determination in step S1240 is YES, the CPU 201 stores the value “1” in the preparation execution instruction variable Prepare, which is one of the preparation operation determination variables (step S1241). The preparation operation determination variables Prepare, Moving, and Passing are not used in the process of the flowchart of FIG. 7, but are used in the process of outputting the preparation instruction data in the flowcharts of FIGS. 25 and 26 described later.

  When the determination in step S1240 is NO or after the processing in step S1241, the CPU 201 determines whether or not the value “1” is set in the set variable set, that is, whether or not registration is possible. (Step S1242).

  If the determination in step S1242 is YES, the CPU 201 performs an output buffer performance information pointer variable corresponding to the finger number Finger (see FIG. 3) in the performance information indicated by the variable NotePre (referred to as “NotePre.Finger” in FIG. 15). prep [Note Pre. The value of the variable NotePre is stored in [Finger] (step S1243). In this way, the pointer to the performance information indicated by the variable NotePre is set to prep [NotePre. [Finger].

  If the value of the set variable “set” is “0” and the determination in step S1242 is NO, the execution of step S1243 is skipped, and the performance information indicated by the variable NotePre is output buffer performance information pointer variable as performance information for performing the preparatory operation. prep [Note Pre. [Finger] is not registered.

  After the process in step S1243 or if the determination in step S1242 is NO, the CPU 201 increments the value of the key pressing comparison stage variable step by +1 (step S1244). Up to now, if step = 1, that is, processing related to the preparatory operation corresponding to the next operation timing of the current key pressing operation timing, then step = 2 is set, so that the current key pressing operation timing is obtained. The process related to the preparatory operation corresponding to the next operation timing of the next is executed.

  The CPU 201 returns to the process of step S1211 of FIG. 13 after the process of step S1244 of FIG. Then, the CPU 201 performs the output buffer performance information pointer variable prep [0] to the next timing performance information pointer variable Next [0] to Next [4] through a series of processing from steps S1211 to S1219 in FIG. To the performance information that corresponds to the finger for which the pointer to the performance information is not defined in prep [4] and that has the earliest start time of the sound after the performance information first obtained in the variable NotePre as described above. And the corresponding finger numbers are acquired in the variables NotePre and fig, respectively. Then, the CPU 201 executes again the processes of the flowcharts of FIGS. 14 and 15 for these variables NotePre and fig. As a result, the CPU 201 indicates that the pointer to the performance information with the earliest sounding start time to be pressed at the next timing with respect to the current key press indicated by the variable NotePre is the pointer to the performance information for performing the preparation operation. Prep [Note Pre. [Finger].

  As a result of repeatedly executing the above control processing, the CPU 201 can no longer obtain a pointer to performance information in the variable NotePre in the execution of the flowchart of FIG. 13, and if the determination in step S1220 of FIG. The preparation confirmation process in step S709 corresponding to the value of the performance information search variable iN is terminated.

  FIG. 16 is a flowchart showing an example of the keyboard distance acquisition process in step S1226 of FIG.

  First, the CPU 201 sets the performance information with the larger finger number Finger (see FIG. 3) among the performance information indicated by the output buffer performance information pointer variable prep [ifig] and the performance information indicated by the variable NotePre in FIG. The performance information with the smaller finger number Finger is set in the variable notet (step S1601).

Next, the CPU 201 stores the pitch Pitch (refer to FIG. 3) of the performance information notef (referred to as “notef.Pitch” in FIG. 16) in the pitch variable pf. Then, the CPU 201 calculates a keyboard position by the following equation and stores it in the keyboard position variable keyf (step S1602).

keyf ← OctDist × (pf / 12) + KeyDist [pf% 12]
... (1)

Here, OctDist is a constant and has a value “14”. KeyDist [] = {0, 1, 2, 3, 4, 6, 7, 8, 9, 10, 11, 12}, KeyDist [0] = 0, KeyDist [1] = 1, KeyDist [2] = 2, KeyDist [3] = 3, KeyDist [4] = 4, KeyDist [5] = 6, KeyDist [6] = 7, KeyDist [7] = 8, KeyDist [8] = 9, KeyDist [9] = 10. KeyDist [10] = 11, and KeyDist [11] = 12. In the above equation (1), KeyDist [pf% 12] is Key Dist [pf% 12] with the remainder “pf% 12” obtained by dividing the value of the pitch variable pf by 12 (“%” indicates the remainder operation). ] Value. The constant OctDist is a constant that represents a keyboard distance of one octave. There are 12 semitones in one octave, and OctDist can be set to 12. Here, for convenience, the keyboard distance between all white keys and white keys is regarded as 2, that is, between the mifers, A value of 14 is used as OctDist, assuming that there are two semitones between the seeds.

Subsequently, as in step S1602, the CPU 201 also stores the pitch Pitch (described as “notet.Pitch” in FIG. 16) of the performance information notet in the pitch variable pt. Then, the CPU 201 calculates a keyboard position by the following equation and stores it in the keyboard position variable keyt (step S1603).

key ← OctDist × (pt / 12) + KeyDist [pt% 12]
... (2)

  Thereafter, the CPU 201 subtracts the value of the keyboard position variable keyt calculated in step S1603 from the value of the keyboard position variable keyf calculated in step S1602, and stores the subtraction result in the keyboard distance variable dist (step S1604).

  Next, the CPU 201 determines whether or not the value of the current part search variable iH (see steps S702 and S712 in FIG. 7) is 2, that is, whether or not the current part is the left hand (step). S1605).

  If the current part is the left hand and the determination in step S1605 is YES, the CPU 201 multiplies the value of the keyboard distance variable dist by −1, that is, reverses the sign (step S1606).

  After the process of step S1606 or when the determination of step S1605 is NO, the CPU 201 ends the keyboard distance acquisition process of step S1226 in FIG. 14 shown in the flowchart of FIG.

  In obtaining the keyboard distance, the keyboard distance dist is calculated by subtracting the keyboard position of the finger with the smaller finger number from the keyboard position of the finger with the larger finger number. Therefore, in the case of the right hand, for example, if the keyboard position of the index finger is at a position where the pitch is larger than the keyboard position of the thumb, the keyboard distance dist is a positive value. Also, if you are trying to press the left finger position of the thumb with your index finger over the thumb while pressing with your thumb with the right hand, subtract the keyboard position of the thumb from the index position of the index finger with the highest finger number. The obtained keyboard distance dist is a value smaller than 0. Similarly, when pushing the thumb with the index finger under the forefinger and pressing the keyboard position on the right side of the index finger, it is obtained by subtracting the thumb keyboard position from the index finger keyboard position with a large finger number. The keyboard distance dist is also less than 0.

  For the left hand, by multiplying the value of the obtained keyboard distance dist by −1, the same relationship as that for the right hand can be obtained. That is, in the case of the left hand, if the left hand is normally placed on the keyboard, the keyboard position of the index finger will be at a pitch lower than the keyboard position of the thumb, so in that case, from the keyboard position of the index finger with a large finger number, Subtracting the keyboard position will result in a negative value. In order to make this the same relationship as the right hand, a positive value is obtained by multiplying by -1. In this state, with the left hand, when pressing the thumb with the index finger over the thumb and pressing the right keyboard position, subtract the thumb keyboard position from the index finger with the higher index number. The keyboard distance dist thus obtained is a value greater than 0, and by multiplying this by −1, the final keyboard distance dist becomes a negative value. Similarly, when pushing the thumb with the index finger under the index finger and pressing the keyboard position on the left side of the index finger, it is obtained by subtracting the keyboard position of the thumb from the index position of the index finger with the large finger number. The keyboard distance “dist” is also a value larger than 0, and by multiplying this by −1, the final keyboard distance “dist” becomes a negative value.

  As described above, the value of the keyboard distance variable “dist” calculated by the flowchart of FIG. 16 can be set to a value smaller than 0 only when the finger is entangled or penetrated by the thumb. . This state is determined in step S1227 in FIG.

  17 and 18 are flowcharts showing an example of the operation data output process in step S710 of FIG.

  First, the CPU 201 executes a series of processes from steps S1701 to S1707 in FIG. Here, initial setting of variables, calculation and setting of the current operation start time start, operation end time term, and track number Hand for operation data are performed.

  First, the CPU 201 stores the value of the total frame count at the current time in the frame count variable i for designating each frame frame [i] of the operation data (FIG. 4) (step S1701). The total number of frames FrameCount is initialized to “0” in step S703 in FIG. 7, and incremented by +1 in step S1721 in FIG. As a result, the number of operation data is sequentially increased.

  Next, in steps S1702 to S1707, the CPU 201 determines a track number Hand, an operation start time start, and an operation end time term (see FIG. 4) when generating operation data at the current operation timing. The performance information Note [iN] corresponding to the value of the performance information search variable iN (see steps S705 and S711 in FIG. 7), and the performance information pointer variable prep [0] for the output buffer that is simultaneously depressed or prepared. ] To perform performance guidance for each piece of performance information indicated by prep [4], the following control is required. That is, the performance guide includes the sound generation start time Note [iN]. The guide display is started before Time, and the sound generation start time Note [iN]. It is necessary to end the guide (actual key depression) at Time.

  Therefore, the CPU 201 first calculates the operation start time start (stored in the variable of the same name) as the sound generation start time Note [iN]. It is determined whether it is larger than Time. The operation start time start is initially set to a value “0” in step S703 of FIG. In the middle of the operation, the operation start time for the value of the next performance information search variable iN in step S1722 of FIG. 18 at the end of the process of outputting the operation data at the value of the previous performance information search variable iN. start is calculated.

  The current operation start time start calculated as described above is the sound generation start time Note [iN]. When it is later (larger value) than Time, the performance guide generates the pronunciation start time Note [iN]. Since it must be before Time, the operation start time start needs to be corrected.

  If the determination in step S1702 is YES, the CPU 201 further determines that the sounding start time laston of the previous performance information (stored in the variable of the same name) is the sounding start time Note [iN]. It is determined whether it is smaller than Time (step S1703).

If the determination in step S1703 is YES, the CPU 201 starts from the previous sounding start time laston, and from the previous sounding start time laston, the sounding start time Note [iN]. The time when the time obtained by multiplying the elapsed time until Time by a predetermined ratio RATIO (for example, 80% = 0.8) has elapsed is set as the operation start time start. That is,

start ← laston + (Note [iN] .Time-laston)
× RATIO (3)

As a result, for example, 80% (ratio represented by RATIO) of the time from the sound start time of the previous sound to the sound start time of the current sound has elapsed is set as the operation start time start. Become.

  On the other hand, the last pronunciation start time laston is Note [iN]. If it is not smaller than Time and the determination in step S1703 is NO, there is no choice but the previous sounding start time laston is set to the current operation start time start (step S1704).

  The calculated operation start time start is the pronunciation start time Note [iN]. If it is not greater than Time and the determination in step S1702 is NO, the CPU 201 uses the calculated operation start time start as it is.

  After the current operation start time start is determined as described above, the CPU 201 determines the sound generation start time Note [iN] .. N of the current performance information for the next processing using the next value of the performance information search variable iN. Time is set as last sounding start time laston (step S1706).

  Thereafter, the CPU 201 sets the current part search variable iH to the track number Hand (described as “frame [i] .Hand” in FIG. 17) of the operation data frame [i] corresponding to the value of the frame count variable i. The value (see steps S702 and S712 in FIG. 7) is stored. Further, the CPU 201 stores the current operation start time start calculated as described above in the operation start time start (described as “frame [i] .start” in FIG. 17) of the operation data frame [i]. Further, the CPU 201 adds the sound generation start time Note [iN] .. of the performance information of this time to the operation end time term (described as “frame [i] .term” in FIG. 17) of the operation data frame [i]. Time is stored (step S1707).

  After step S1707, the CPU 201 executes a series of processing from step S1708 to S1722 in FIG. Here, the performance position “position [0] to position [4]” (key number where the finger should be placed) of each of the five fingers for the current motion data, and the status “status [0] to status [ 4] ”(the value“ −1 ”is a preparation operation, the value“ 1 ”is a key press), and the position“ Zpos ”in the depth direction is generated and set.

  The CPU 201 sets an initial value “0” (thumb) to the finger number designation variable ifig at step S1708, and then increments the value of igf by +1 at step S1718, and at step S1709 the maximum number of fingers “5” at one hand. Until it is determined that the value has been reached, a series of processes of steps S1710 to S1717 below are executed.

  First, the CPU 201 determines whether or not the value of the performance information pointer variable for output buffer prep [ifig] corresponding to the finger number ifig is not the undefined value NULL (step S1710).

  If the determination in step S1710 is YES, since the performance information prep [ifig] for output has been determined for the finger ifig currently being processed, the CPU 201 determines the pitch pitch of prep [ifig] (see FIG. 3) ( 18 is described as “prep [ifig] .Pitch”), and the performance position position [ifig] (“frame [i] .position” in FIG. 18) corresponding to the finger number ifig of the current motion data frame [i]. ("Ifig" ") (step S1711). That is, the pitch of the performance information determined by prep [ifig] is stored as finger position data regarding the finger ifig currently being processed.

  Next, the CPU 201 determines that the sound generation start time Time (described as “prep [ifig] .Time” in FIG. 18) of the performance information indicated by the output buffer performance information pointer variable prep [ifig] corresponding to the finger number ifig is The pronunciation start time Note [iN]. It is determined whether it is equal to Time, that is, whether the sound generation start times Time of prep [ifig] and Note [iN] are equal (step S1712). This is because the key press of the finger number ifig is Note [iN]. It is determined whether or not the key is pressed at the same time.

  If the determination in step S1712 is YES, the CPU 201 describes the state status [ifig] corresponding to the finger number ifig of the current motion data frame [i] (described as “frame [i] .status [ifig]” in FIG. 18). ) Stores a value “1” indicating the key depression (step S1713).

  Thereafter, the CPU 201 proceeds to the process of step S <b> 1718 and proceeds to the process of the next finger number.

  In step S1712, the sounding start time Time of the performance information pointer variable prep [ifig] for the output buffer corresponding to the current finger number ifig is not equal to the sounding start time Time of the current performance information Note [iN]. If the determination is NO, the CPU 201 determines that prep [ifig]> Note [iN]. It is determined whether it is Time (step S1714).

  If the determination in step S1714 is YES, the performance information indicated by prep [ifig] corresponding to the current finger number ifig should perform a preparation operation. For this reason, the CPU 201 sets the state frame [i]... Corresponding to the finger number ifig of the current operation data. A value “−1” indicating the preparatory operation is stored in status [ifig] (step S1715).

  Thereafter, the CPU 201 proceeds to the process of step S <b> 1718 and proceeds to the process of the next finger number.

  If the determination in step S1714 is NO, it means that no pointer to performance information is stored in the output buffer performance information pointer variable prep [ifig] corresponding to the current finger number ifig. In this case, the CPU 201 determines that the state frame [i]... Corresponds to the finger number ifig of the current operation data. A value “0” indicating no data is stored in status [ifig] (step S1716).

  Thereafter, the CPU 201 proceeds to the process of step S <b> 1718 and proceeds to the process of the next finger number.

  Returning to step S1710, if the value of the performance information pointer variable for output buffer prep [ifig] corresponding to the current finger number ifig is the undefined value NULL and the determination in step S1710 is NO, the CPU 201 Performance position frame [i]... Corresponding to the finger number ifig of the motion data. A value “−1” indicating no data is stored in position [ifig], and the state frame [i]. A value “0” indicating no data is stored in status [ifig] (step S1717).

  Thereafter, the CPU 201 proceeds to the process of step S <b> 1718 and proceeds to the process of the next finger number.

  When the above-described series of processing from step S1710 to S1717 is executed for all five finger numbers ifig, the determination in step S1709 is NO.

  As a result, the CPU 201 executes depth position calculation processing, and obtains the position in the depth direction obtained as a result in the variable Zpos (step S1719).

  The CPU 201 adds the position in the depth direction obtained in the variable Zpos to frame [i]. It is stored as Zpos (see FIG. 4) (step S1720).

  The CPU 201 increments the total frame count of the operation data frame [i] by +1 (step S1721).

  Finally, the CPU 201 executes processing for calculating the next start time, and calculates an operation start time start for the value of the next performance information search variable iN (step S1722).

  Thereafter, the CPU 201 ends the operation data output process in step S710 of FIG. 7 shown in the flowcharts of FIGS.

  FIG. 19 is a flowchart showing an example of the depth position calculation processing in step S1719 of FIG. In this process, it is determined which position is appropriate for placing the hand in the depth direction of the keyboard based on the current key pressing state of each finger and the state of the preparation operation. Here, as the position of the hand in the keyboard depth direction, the position of the hand is defined in four stages of zpos = 1 to 4, and it is determined which depth position is appropriate.

  First, the CPU 201 provisionally stores a value “1” in the depth position variable zpos (step S1901). This value indicates that the hand is placed on the front side of the keyboard and all the white keys are pressed.

  Next, the CPU 201 determines whether or not the value of the output buffer performance information pointer variable prep [0] corresponding to the thumb is not the undefined value NULL (step S1902).

  If the determination in step S1902 is YES, there is performance information corresponding to the thumb, so the CPU 201 performs pitch data prep [0]. Pitch is stored in the pitch variable p (step S1903).

  Further, the CPU 201 determines whether or not the value of the black key determination constant BlackKey [p] corresponding to the value of the pitch variable p is “1”, that is, the pitch Pitch indicated by the performance information corresponding to the thumb is a black key. It is determined whether or not (step S1904). Now, the black key determination constant BlackKey [] = {0, 1, 0, 1, 0, 0, 1, 0, 1, 0, 1, 0}. The value “0” indicates a white key, and the value “1” indicates a black key. This arrangement of arrays corresponds to a general arrangement of white keys and black keys in an actual keyboard instrument. By examining this array value using the pitch variable p as a key value, it is possible to determine whether or not the pitch Pitch indicated by the performance information is a black key. Actually, the pitch data prep [0]. Judgment is made by calculating the pitch within the octave by using the remainder of the Pitch value divided by 12, for example.

  If the determination in step S1904 is YES, since the performance information corresponding to the thumb is a black key, the CPU 201 stores a value “4” in the depth position variable zpos (step S1905). This value indicates that all five fingers of one hand are placed on the black key on the back side of the keyboard. That is, that the thumb is placed on the black key means that all five fingers are naturally placed on the black key.

  After the process of step S1905, the CPU 201 ends the depth position calculation process of step S1719 of FIG. 18 shown in the flowchart of FIG.

  On the other hand, returning to step S1902, if the value of the output buffer performance information pointer variable prep [0] corresponding to the thumb is the undefined value NULL and the determination in step S1902 is NO, the CPU 201 corresponds to the little finger. It is determined whether or not the value of the performance information pointer variable prep [4] for output buffer is not the undefined value NULL (step S1906).

  If the determination in step S1906 is YES, there is performance information corresponding to the little finger, so the CPU 201 performs pitch data prep [4]. Pitch is stored in the pitch variable p (step S1907).

  Further, the CPU 201 determines whether or not the value of the black key determination constant BlackKey [p] corresponding to the value of the pitch variable p is “1”, that is, the pitch Pitch indicated by the performance information corresponding to the little finger is a black key. It is determined whether or not (step S1908).

  If the determination in step S1908 is YES, the performance information corresponding to the little finger is a black key, and therefore the CPU 201 stores the value “3” in the depth position variable zpos (step S1909). This value indicates that the four fingers of the index finger, middle finger, ring finger, and little finger are placed on the black key on the back side of the keyboard. That is, the fact that the little finger is placed on the black key means that the four fingers are naturally placed on the black key.

  After the process of step S1909, the CPU 201 ends the depth position calculation process of step S1719 of FIG. 18 shown in the flowchart of FIG.

  In addition to the thumb, if the value of the output buffer performance information pointer variable prep [4] corresponding to the little finger is the undefined value NULL and the determination in step S1906 is NO, the CPU 201 sets the value of the variable i in step S1910. After setting “1”, a series of processing from step S1912 to S1915 is performed until it is determined in step S1911 that the value of variable i has reached 4 while incrementing the value of variable i by +1 in step S1916. Execute.

  First, the CPU 201 sets the value of the performance information pointer variable prep [i] for the output buffer corresponding to the finger indicated by the value of the variable i (the index finger for “1”, the middle finger for “2”, the ring finger for “3”) as an undefined value. It is determined whether or not it is NULL (step S1912).

  If the determination in step S1912 is YES, the CPU 201 determines the pitch data prep [i]. Pitch is stored in the pitch variable p (step S1913).

  Further, the CPU 201 determines whether or not the value of the black key determination constant BlackKey [p] corresponding to the value of the pitch variable p is “1”, that is, the pitch Pitch indicated by the performance information of the finger corresponding to the value of the variable i. Is determined to be a black key (step S1914).

  If the determination in step S1914 is YES, the CPU 201 stores the value “2” in the depth position variable zpos (step S1915). This value indicates that the three fingers of the index finger, the middle finger, and the ring finger are placed on the black key on the back side of the keyboard. That is, any one of the three fingers placed on the black key means that the three fingers are naturally placed on the black key.

  After the process of step S1915, the CPU 201 ends the depth position calculation process of step S1719 of FIG. 18 shown in the flowchart of FIG.

  Even when the value of the variable i becomes 4 and the determination in step S1911 becomes NO, the CPU 201 ends the depth position calculation processing in step S1719 in FIG. 18 shown in the flowchart in FIG. Since this corresponds to a case where none of the fingers is a black key, the value of the depth position variable zpos is the value “1” initially set in step S1901.

  In the depth position calculation process described above, the position where the hand is placed is calculated regardless of whether each finger presses the key or performs a preparation operation.

  FIG. 20 is a flowchart illustrating an example of the next start time calculation process in step S <b> 1722 of FIG. 18.

  First, the CPU 201 saves the value of the second previous operation start time startLast [1], which is a variable value for storing the past operation start time, in the third previous operation start time startLast [2]. The value of startLast [0] is saved to the previous operation start time startLast [1] twice, and the current operation start time start is saved to the previous operation start time startLast [0] (Step S2001). The operation start time startLast [2] three times before is not used in the process of the flowchart of FIG. 7, but is used in the process of outputting the preparation instruction data in the flowcharts of FIGS. 25 and 26 described later.

  Next, the CPU 201 performs the next operation data output process of FIG. 17 and FIG. 18 corresponding to the next value of the performance information search variable iN by a series of processes of steps S2002 to S2013 below. The operation start time start is calculated. Here, the next operation start time start is set based on the performance information of the sound that is released earliest among the performance information that is currently sounded.

  First, the CPU 201 starts the sound generation start time Note [iN]. Time is provisionally set to the next operation start time start (step S2002).

  Next, the sound generation start time Note [iN]. Time [Note] [iN]. A value obtained by adding Gate (see FIG. 3) is set as a note-off time NoteOff (stored in a variable of the same name) of the performance information.

  Next, after setting an initial value “0” (thumb) to the finger number designation variable ifig in step S2004, the CPU 201 increments the value of igf by +1 in step S2011, and in step S2005, the maximum number of fingers in one hand. Until it is determined that “5” has been reached, a series of processes from the following steps S2006 to S2010 are executed.

  First, the CPU 201 determines whether or not the value of the output buffer performance information pointer variable prep [ifig] corresponding to the finger number ifig is not the undefined value NULL (step S2006).

  If the determination in step S2006 is YES, the CPU 201 determines the sound generation start time prep [ifig] .. of the performance information indicated by the output buffer performance information pointer variable corresponding to the finger number ifig. Time is the sound generation start time Note [iN]. Whether or not it is equal to or less than Time, that is, the key press of the finger number ifig is Note [iN]. Whether the sound at the same time as the key depression of Time or the sound contained in prep [ifig] is depressed before the current performance information Note [iN] and is still being depressed. It is determined whether or not (step S2007).

  If the determination in step S2007 is YES, the CPU 201 causes the performance information pronunciation start time prep [ifig]. In Time, the pronunciation duration time prep [ifig]. A value obtained by multiplying Gate by a ratio RATIO (for example, 80% = 0.8) is added, and the addition result is set to term as the operation end time of the performance information prep [ifig] currently being investigated ( Step S2008).

  Thereafter, the CPU 201 determines that the next operation start time start is smaller than the operation end time term of the performance information prep [ifig] currently being investigated, and the operation end time term of the performance information prep [ifig] currently being investigated is It is determined whether or not it is smaller than the note-off time NoteOff (step S2009).

  If the determination in step S2009 is YES, the operation end time term calculated in step S2008 is tentatively earliest among the sounds that have been examined so far, among the performance information that is currently sounded. . In this case, the CPU 201 sets the operation end time term as a new note-off time NoteOff (step S2010).

  If the determination in step S2009 is NO, the CPU 201 maintains the current note-off time NoteOff.

  After the process of step S2010, or when the determination of the process of step S2009 is NO, or the performance information indicated by the output buffer performance information pointer variable prep [ifig] corresponding to the finger number ifig is simultaneously or before If the key is not depressed and the determination in step S2007 is NO, or if prep [ifig] is the undefined value NULL and the determination in step S2006 is NO, the CPU 201 proceeds to the process in step S2011 and proceeds to the next instruction. Proceed to number processing.

  When the processing for all the finger numbers ifig ends and the determination in step S2005 is NO, the CPU 201 determines whether or not the next operation start time start is before (smaller) than the note-off time NoteOff (step S2012).

  If the determination in step S2012 is YES, the CPU 201 sets the note-off time NoteOff to the next operation start time start. If NO, the CPU 201 maintains the value of the current operation start time start and is shown in the flowchart of FIG. The next start time calculation process in step S 1722 of FIG.

  FIG. 21 is a diagram showing an example of storing performance information, FIG. 22 is a diagram showing an example of output of operation data corresponding to the performance information of FIG. 21, and when operation preparation is not considered, and FIG. 23 is a diagram of FIG. FIG. 24 shows an example of output of operation data when the preparation operation is taken into account by the control processing shown in the flowcharts of FIGS. 7 to 20 corresponding to the performance information, and FIG. FIG.

  The performance information shown in FIG. 21 has one set of performance information per line, that is, data of one sound per line, according to the data configuration example described with reference to FIG.

  When preparation performance is not considered for this performance data, a pitch is set for each performance position position [0] to position [4] of each finger as illustrated in FIG. The value “−1” indicates that there is no pitch setting), and the corresponding status “status [0] to status [4]” is set to the value “1” when the key is pressed, and the value “0” otherwise. It is only done. Therefore, when the performance guide is displayed based on such operation data, at the position of * in FIG. 22, for example, after the key of the pitch 67 is pressed with the thumb of position [0], the sound is played. The key of the pitch “66” adjacent to the left of the high “67” key is pressed with the index finger of position [1]. This is an example in which a performance technique is required in which the next key pressing is performed by moving the finger over the thumb pressing with the index finger. However, in the operation data that does not consider the preparation operation illustrated in FIG. 22, it is impossible to know what key is to be pressed next with respect to the current key pressing, so only a simple performance guide display is performed. I can't.

  On the other hand, when the preparation operation is taken into consideration for the performance data illustrated in FIG. 21 by the control processing of this embodiment, the performance position position [0] of each finger is illustrated as illustrated in FIG. ] To the position [4], the pitch of the finger that performs the key press and the pitch of the finger that performs the preparation operation are set (value “−1” indicates no pitch setting), and the corresponding status “status”. In [0] to status [4], the value “1” is set when the key is pressed, the value “−1” is set when the preparation operation is performed, and the value “0” is set when neither is performed. It becomes possible. Therefore, when the performance guide is displayed based on such motion data, the key of the pitch “67” is indicated by the thumb of position [0], as shown in the position of * in FIG. When the key is pressed, status [1] is set to enter a preparatory operation of pressing the key of pitch "66" on the left side of the key of pitch "67" with the index finger of position [1]. The value “−1” to be set and the pitch “66” set in position [1] can be specified. By recognizing that the thumb is involved, the display of the performance guide indicates that the index finger has moved beyond the current thumb key press and is ready for the next key press. It can be displayed. Thereby, the user can learn the performance technique at the time of key depression. In this case, as the performance information, as shown in FIG. 21, it is not necessary to have special information for the performance technique, and the information of the preparation operation is automatically generated from the information of the finger number Finger. Is possible.

  FIG. 24 is a diagram (part 1) illustrating a display example of a performance guide, and illustrates a performance guide display of the right hand. The five round marks on the keyboard indicate the position of each finger on the right hand. The slightly larger circle on the left indicates the thumb, and small circles corresponding to the index, middle, ring, and little fingers, respectively, toward the right. It is shown. For the left hand, the direction is reversed. When the key is pressed, the keyboard is dark.

  In the example of FIG. 24A, it is shown that the thumb is in the key-pressed state and the other fingers are in the ready state. At this time, in the example of the performance guide shown in FIG. 24A by the depth position calculation process shown in the flowchart of FIG. 19, the value “1” is stored in zpos, so that all fingers are placed on the white key. Is displayed.

  The example in FIG. 24B also shows that the thumb is in the key-pressed state and the other fingers are in the ready state. However, the depth position calculation processing shown in the flowchart in FIG. In the performance guide example, the value “2” is stored in zpos, so that an instruction to place the index finger, middle finger, and ring finger on the black key and to place the thumb and little finger on the white key is displayed. Then, since the instruction to prepare by placing the index finger on the black key that is half a tone lower than the thumb is displayed, the performer naturally goes over the thumb and puts the index finger on the black key of F # to prepare it. Can take.

  It should be noted that a display may be made so as to explicitly indicate when a finger exceeds or a finger is dropped.

  FIG. 25 is a flowchart (part 2) illustrating an example of the operation information generation process. In FIG. 25, the same step numbers are assigned to the portions that execute the same processing as in the flowchart of FIG. The detailed flowchart of each step is the same as that described with reference to FIGS. The process of FIG. 25 differs from the process shown in the flowchart of FIG. 7 in that the process of outputting the preparation instruction data in step S2501 is added. Further, in step S703 in FIG. 25, a process for initializing the value of the variable PreMotionCount indicating the total number of preparation instruction data to “0” is added.

  FIG. 26 is a flowchart showing an example of the preparation instruction data output process in step S2501 of FIG.

  First, the CPU 201 determines whether or not the value of the preparation execution instruction variable Prepare, which is one of the preparation operation determination variables, is “1” (step S2601). This preparation execution instruction variable Prepare is set in step S1241 of FIG. 15 in the preparation confirmation process of step S709 of FIG.

  If the determination in step S2601 is NO, the CPU 201 ends without substantially performing the process of outputting the preparation instruction data in step S2501 of FIG. 25 shown in the flowchart of FIG.

  If the determination in step S2601 is YES, the CPU 201 stores the value of the total number of preparation instruction data PrepMotionCount at the current time in the data count variable i for instructing each data PrepMotion [i] of the preparation instruction data (FIG. 5). To do. Thereafter, the CPU 201 increments the value of PrepMotionCount by +1 (step S2602). That is, in the array PrepMotion, the array number in which the current data is to be recorded is set to i, and the value of PrepMotionCount is incremented by 1 as the array number used in the next recording. The total number of preparation instruction data PrepMotionCount is initialized to the value “0” in step S703 in FIG. As a result, the number of preparation instruction data is sequentially increased.

  Next, the CPU 201 sets the current part search variable in the track number Hand (described as “PrepMotion [i] .Hand” in FIG. 26) of the preparation instruction data PrepMotion [i] corresponding to the value of the data count variable i. The iH value (separate right hand / left hand) (see steps S702 and S712 in FIG. 25) is stored.

  Next, the CPU 201 stores the operation start time startLast [2] three times before in the preparation start time start (described as “PrepMotion [i] .start” in FIG. 26) of the preparation instruction data PrepMotion [i]. The operation start time startLast [2] three times before is the data set in step S2001 of FIG. 20 in the processing of calculating the next start time of step S1522 of FIG. 18 during the operation data output processing of step S710 of FIG. Value. With this setting, the preparation instruction data PrepMotion [i] is displayed as a preparation instruction from an earlier time.

  Next, the CPU 201 initializes a value “0” to the type variable type.

  Thereafter, the CPU 201 determines whether or not the value of the finger crossing variable Passing is “1” (step S2606). The finger crossing variable Passing is set in step S1229 of FIG. 14 during the preparation confirmation process in step S709 of FIG. 25 when a state of over fingering or passing through the thumb with respect to the thumb occurs.

  If the determination in step S2606 is YES, the CPU 201 sets the value “1” in the type variable type (step S2609).

  If the determination in step S2606 is NO, the CPU 201 determines whether or not the value of the movement variable Moving is “1” (step S2608). The movement variable Moving is set in step S1235 in FIG. 14 during the preparation confirmation process in step S709 in FIG. 25 when a movement of the keyboard distance exceeding the reference value (a musical performance with a jump) occurs.

  If the determination in step S2608 is YES, the CPU 201 sets the value “2” in the type variable type (step S2609).

  After the processing of step S2607 or S2609, or when the determination in step S2608 is NO, the CPU 201 prepares the preparation type type of the preparation instruction data PrepMotion [i] (“PrepMotion [i] .type” in FIG. 26). And the value of the type variable type is stored.

  Thereafter, the CPU 201 calculates and sets the preparation end time term in a series of processes from step S2611 to S2619.

  First, the CPU 201 provisionally sets the preparation start time start to the preparation end time term (step S2611).

  Next, the CPU 201 sets an initial value “0” (thumb) to the finger number designation variable ifig in step S2612, and then increments the value of igf by +1 in step S2618, and in step S2613, the maximum number of fingers in one hand. Until it is determined that “5” has been reached, the following series of processing from step S2614 to S2617 is executed.

  First, the CPU 201 determines whether or not the value of the temporary buffer performance information pointer variable pList [ifig] corresponding to the finger number ifig is not the undefined value NULL (step S2614).

  If the determination in step S2614 is YES, the CPU 201 indicates the index number index of the performance information indicated by the temporary buffer performance information pointer variable pList [ifig] indicated by the current finger number ifig (“pList [ifig] .index in FIG. 26). Is stored in the index number index [ifig] (denoted as “PrepMotion [i] .index [ifig]” in FIG. 26) indicated by the finger number ifig of the current preparation instruction data PrepMotion [i] ( Step S2616). The temporary buffer performance information pointer variables pList [0] to pList [4] are set in step S1230 of FIG. 14 in the next start time calculation process of step S1522 of FIG. 18 during the operation data output process of step S710 of FIG. Alternatively, it is set in step S1236.

  Further, the CPU 201 calculates the sound generation start time Time (described as “pList [ifig] .Time” in FIG. 26) of the performance information indicated by the temporary buffer performance information pointer variable pList [ifig] indicated by the current finger number ifig. It stores in the preparation end time term (step S2617). That is, the performance guide based on the preparation instruction data ends when the performance information indicated by pList [ifig] starts sounding.

  When the processing for all the finger numbers ifig is completed and the determination in step S2613 is NO, the CPU 201 stores the value of the preparation end time variable term in the preparation end time term of the current preparation instruction data PrepMotion [i] ( Step S2619).

  Thereafter, the CPU 201 ends the preparation instruction data output process of step S2501 of FIG. 25 shown in the flowchart of FIG.

  FIG. 27 is a diagram illustrating an output example of preparation instruction data, and FIG. 28 is a diagram (part 2) illustrating a display example of a performance guide.

  The performance information corresponding to these examples is the same as that illustrated in FIG. Further, the output operation data is the same as that illustrated in FIG.

  The processing of the flowcharts of FIGS. 25 and 26 makes it possible to output preparation instruction data as shown in FIG. Here, the preparation type data indicating preparation of large movement of the key-pressing position type = 2, that is, “Moving” preparation instruction data, and the preparation type data indicating preparation of finger crossing preparation = 1, ie, “Passing” are provided. ing. By using such preparation instruction data, as illustrated in FIG. 28, it is possible to display a triangular black arrow that instructs the movement direction of the hand for a necessary time.

As described above, according to the present embodiment, it is possible to generate information corresponding to a technique for performing a performance operation that is not limited to information for key pressing from only performance information and fingering information. As a result, it is possible to guide performance techniques as well as fingering. In addition, it is possible to provide useful information about the practice of musical instrument performance, such as automatically generating information that alerts the user about the points necessary for preparation. In addition, there is a merit that it becomes unnecessary to add additional information to the performance information by the expert.
Regarding the above embodiments, the following additional notes are disclosed.

(Appendix 1)
Performance information reading means for reading out performance information from the storage unit, including information related to the sound generation timing for sound generation of each musical sound constituting the song, information related to the pitch, and information related to the performance operation of the performer,
Operation state estimating means for estimating the performance operation state of the performer in the performance information based on the performance information read by the performance information reading means;
Based on the first performance operation state estimated by the operation state estimation means and the second performance operation state estimated after the first performance operation state, a guide regarding the performance operation of the performer is performed. Performance operation guide means;
A performance operation guide device comprising:
(Appendix 2)
The performance information is divided into a plurality of parts,
The operation state estimation means estimates the performance operation state for each part,
The performance operation guide device according to appendix 1, wherein the performance operation guide means performs a guide regarding the performance operation of the performer for each part.
(Appendix 3)
The performance guide device guides the performance operation of the keyboard instrument,
The operation state estimating means estimates the position of the player's hand in the depth direction of the keyboard as the first and second performance operation states of the player,
The performance operation guide device according to any one of appendices 1 and 2, wherein the performance operation guide means performs a guide regarding the performance operation of the performer according to the estimated position of the performer's hand.
(Appendix 4)
The performance operation guide device guides performance operation of a keyboard instrument,
The operation state estimating means moves the keyboard over the thumb with a finger other than the thumb from the state where the keyboard is being pressed with the thumb as the first and second performance operation states of the performer. The performance operation guide means guides the thumb as a finger to be played, and fingers other than the thumb to prepare for performance. As a guide and
The key is pressed with the thumb and the key is pressed with a finger other than the thumb from this state and moved under the finger other than the thumb with the thumb to press the key at the next and subsequent timings. When the state is estimated, the performance operation guide means guides a finger other than the thumb as a finger to perform, and guides the thumb as a finger to prepare for performance.
The performance operation guide device according to any one of appendices 1 to 3, characterized in that:
(Appendix 5)
The performance operation guide device guides performance operation of a keyboard instrument,
The operation state estimating means is a state in which a predetermined key of the keyboard is pressed and a distance from the pressed key is less than a predetermined reference value as the first and second performance operation states of the performer. The performance operation guide means guides the preparation for movement from the current key pressing state to the next key pressing state, when it is estimated that the key at the next position is pressed next.
The performance operation guide device for musical instrument performance according to any one of appendices 1 to 4, characterized in that:
(Appendix 6)
A performance operation guide method used in a performance operation guide device,
Performance information including information related to the sound generation timing for sound generation, information related to pitch, and information related to the performance operation of the performer is read from the storage unit for each musical sound constituting the song,
Based on each of the read performance information, the performance operation state of the performer in the performance information is estimated,
Based on the estimated first performance operation state and the second performance operation state estimated after the first performance operation state, a guide regarding the performance operation of the performer is performed.
A performance operation guide method characterized by the above.
(Appendix 7)
In a computer used as a performance operation guide device,
A performance information reading step of reading performance information from the storage unit, including information related to the sound generation timing for sound generation of each musical sound constituting the song, information related to the pitch, and information related to the performance operation of the performer,
An operation state estimating step for estimating a performance operation state of a performer in each piece of performance information based on each of the read performance information,
A performance operation guide step for performing a guide on the performance operation of the performer based on the estimated first performance operation state and a second performance operation state estimated after the first performance operation state; ,
A performance operation guide program that executes

DESCRIPTION OF SYMBOLS 100 Performance operation guide apparatus 101 Performance information reading means 102 Operation state estimation means 103 Performance operation guide means 104 Storage part 105 Performance information 106 1st performance operation state 107 2nd performance operation state 201 CPU
202 ROM
203 RAM
204 Input unit 205 Display unit 206 MIDI I / F (MIDI interface unit)
207 Bus 208 Electronic musical instrument

Claims (7)

Performance information reading means for reading out performance information from the storage unit, including information related to the sound generation timing for sound generation of each musical sound constituting the song, information related to the pitch, and information related to the performance operation of the performer,
Operation state estimating means for estimating the performance operation state of the performer in the performance information based on the performance information read by the performance information reading means;
Based on the first performance operation state estimated by the operation state estimation means and the second performance operation state estimated after the first performance operation state, a guide regarding the performance operation of the performer is performed. Performance operation guide means;
A performance operation guide device comprising: The performance information is divided into a plurality of parts,
The operation state estimation means estimates the performance operation state for each part,
The performance operation guide device according to claim 1, wherein the performance operation guide unit performs a guide regarding a performance operation of the performer for each part. The performance guide device guides the performance operation of the keyboard instrument,
The operation state estimating means estimates the position of the player's hand in the depth direction of the keyboard as the first and second performance operation states of the player,
The performance operation guide device according to claim 1, wherein the performance operation guide means performs a guide related to the performance operation of the performer according to the estimated position of the performer's hand. . The performance operation guide device guides performance operation of a keyboard instrument,
The operation state estimating means moves the keyboard over the thumb with a finger other than the thumb from the state where the keyboard is being pressed with the thumb as the first and second performance operation states of the performer. The performance operation guide means guides the thumb as a finger to be played, and fingers other than the thumb to prepare for performance. As a guide and
The key is pressed with the thumb and the key is pressed with a finger other than the thumb from this state and moved under the finger other than the thumb with the thumb to press the key at the next and subsequent timings. When the state is estimated, the performance operation guide means guides a finger other than the thumb as a finger to perform, and guides the thumb as a finger to prepare for performance.
The performance operation guide device according to claim 1, wherein the performance operation guide device is provided. The performance operation guide device guides performance operation of a keyboard instrument,
The operation state estimating means is a state in which a predetermined key of the keyboard is pressed and a distance from the pressed key is less than a predetermined reference value as the first and second performance operation states of the performer. The performance operation guide means guides the preparation for movement from the current key pressing state to the next key pressing state, when it is estimated that the key at the next position is pressed next.
The performance operation guide device for musical instrument performance according to any one of claims 1 to 4. A performance operation guide method used in a performance operation guide device,
Performance information including information related to the sound generation timing for sound generation, information related to pitch, and information related to the performance operation of the performer is read from the storage unit for each musical sound constituting the song,
Based on each of the read performance information, the performance operation state of the performer in the performance information is estimated,
Based on the estimated first performance operation state and the second performance operation state estimated after the first performance operation state, a guide regarding the performance operation of the performer is performed.
A performance operation guide method characterized by the above. In a computer used as a performance operation guide device,
A performance information reading step of reading performance information from the storage unit, including information related to the sound generation timing for sound generation of each musical sound constituting the song, information related to the pitch, and information related to the performance operation of the performer,
An operation state estimating step for estimating a performance operation state of a performer in each piece of performance information based on each of the read performance information,
A performance operation guide step for performing a guide on the performance operation of the performer based on the estimated first performance operation state and a second performance operation state estimated after the first performance operation state; ,
A performance operation guide program that executes