JP7107720B2 - fingering display program - Google Patents

Description

The present invention relates to a fingering display for practicing a keyboard instrument, and based on performance information composed of a plurality of musical tones and fingering number information corresponding to each musical tone, a fingering animation of playing a musical instrument is drawn during musical tone reproduction. It relates to a fingering display program for displaying on a screen.

When practicing playing a keyboard instrument such as an electronic piano, a fingering image consisting of the back of the hand and each finger is displayed superimposed on the keyboard display to be operated, so that the learner can learn how to press and release the keyboard. There has been proposed a performance operation display device for instructing
For example, Patent Literature 1 discloses a fingering animation generation technique in which hand movements are continuously transitioned in order to make it easier to understand how to move fingers. I try to determine the shape of each finger and the position of the back of the hand.

That is, in Patent Document 1, a plurality of types of operation fingering image data and a plurality of types of progress fingering image data are stored in a ROM, and operation fingering corresponding to the fingering indicating the start of key operation for note-on processing is performed. Image data is selected from the ROM, read out, given to the display device and displayed, and progress fingering image data corresponding to the fingering indicating the progress from the note-off process to the start of operation of the key to be pressed next. is read out from the ROM and given to a display device for display, thereby providing a detailed performance guide according to the progress of the music.

In addition, the applicant has proposed a fingering display method disclosed in Patent Document 2 as a fingering display method capable of drawing a hand shape that matches the size of the keyboard and the size of the keyboard displayed on the screen.

Japanese Patent No. 3521838 Japanese Patent No. 4070100

According to the fingering display device disclosed in Patent Literature 1 described above, it is possible to intuitively instruct a practicer as to which key should be played with which finger and at what timing. However, when the left and right hands approach each other or cross each other and both hands overlap, a phenomenon often occurs in which one hand hides the vicinity of the tips of the fingers, which is necessary information for the other hand. In such cases, no consideration was given to how each hand should be prioritized and how it should be drawn.

The present invention has been proposed in view of the above-mentioned actual situation. It is an object of the present invention to provide a fingering display program capable of reliably giving instructions to (a player).

In order to achieve the above object, the present invention (claim 1) is a program for drawing a fingering animation of playing a musical instrument during music playback based on key depression information of the music and displaying the fingering on a screen,
When generating fingering images for the left hand and right hand based on the fingering position information corresponding to the playback time when the music is played back,
When the fingering images of the left hand and the right hand overlap, the hand including the finger that presses the musical tone that was pressed immediately before the current playback position is drawn in front,
When there is no musical tone to be pressed at the current playback position and neither hand is pressing a key, the computer is caused to execute a function of drawing the hand including the finger to be pressed next on the front.

Claim 2 is the fingering display program according to claim 1,
When fingering images of the left hand and the right hand are overlapped, when the left and right hands are pressed at the same time, at least the hand whose finger movement speed is higher than a predetermined standard is drawn on the front. run on the computer.

Claim 3 is the fingering display program according to claim 1 or claim 2,
The computer is caused to execute a function of drawing with the transmittance of the hand to be drawn on the front side smaller than the transmittance of the other hand.

According to the present invention, when the fingering images of the left hand and the right hand overlap, the hand including the finger that presses the tone that was pressed immediately before the current playback position is drawn in front, and the key pressing at the current playback position is drawn. When there is no target tone and neither hand is pressing a key, by drawing the hand that includes the finger to be pressed next, the information to be pressed last (the shape of the hand, the position of the back of the hand, the position of the back of the hand, The finger to press the key, the position of the key to press) can be reliably displayed on the front.

When the fingering images of the left hand and the right hand are overlapped and the left hand and the right hand are pressed at the same time, at least the finger movement speed of the key pressing finger is drawn in front of the hand whose degree of difficulty is higher than a predetermined standard. , it is possible to preferentially display the information of the fingers of the hand having the higher difficulty level, which is more important for the practitioner.

When the fingering images of the left hand and the right hand overlap, the fingering image of the front hand is made easier to see by rendering the hand displayed in the front with a lower transparency than the other hand. At the same time, the fingering image of the hand on the back side can be confirmed at the same time.

1 is a functional block diagram showing the configuration of a fingering display device of the present invention; FIG. It is an example of a musical score having a part where the left hand and the right hand are played alternately. (a) to (h) are image diagrams showing examples of fingering images displayed corresponding to the musical score of FIG. 2 in chronological order. It is an example of a musical score having a portion where the left hand and right hand press keys simultaneously. (a) to (e) are image diagrams showing examples of fingering images displayed corresponding to the musical score of FIG. 4 in chronological order. FIG. 4 is a flow chart for generating fingering images of the left hand and right hand (both hands) in the fingering display program of the present invention; FIG.

Hereinafter, the fingering display device of the present invention will be described with reference to the drawings.
The fingering display device is a well-known tablet terminal having a CPU, a ROM, a RAM, a hard disk, etc., in order to display musical score data and display fingerings corresponding thereto. be built. A tablet terminal includes a display unit capable of displaying musical scores and a keyboard, a touch panel having an input unit for inputting touch operations, and a sound output device such as a speaker for reproducing sound. On the display unit, fingering images of hand patterns are displayed together with the keyboard, and the user can practice fingering on a keyboard instrument or the like, relying on the displayed fingering images.
The CPU of the fingering display device executes various processes according to an installed predetermined control program (fingering display program) to control the entire fingering display device.
Also, a MIDI device can be connected to the tablet terminal via a MIDI interface. Performance data and fingering drawing data can be stored in the ROM within the tablet terminal, or provided from the outside via a MIDI interface or from a recording medium.

As an example of use of the fingering display device, for example, it is connected to a digital piano, and the musical score data recorded in the device is displayed. A user plays a digital piano while looking at the musical score displayed on the fingering display device, inputs the performance result to the device side, and corresponds to the musical score data displayed on the device side. By comparing it with the model performance data, the user can check (evaluate) the performance state.

A fingering display device constructed by installing, for example, a fingering display program stored in a recording medium in order to execute processing according to the present invention on a tablet terminal will be described with reference to the functional block diagram of FIG. do.
The fingering display device includes a musical tone/finger number information storage section 11 storing musical tone information for performing a performance and fingering number information for displaying fingerings corresponding to each musical tone, and a key depression information based on the fingering information. A key depression information generation unit 12 that generates information, a key depression information storage unit 13 that stores key depression information, a fingering position information generation unit 14 that generates fingering position information from the key depression information, and a fingering position information. and a fingering image generation unit 15 for generating a fingering image from.
A musical score image generating unit 16 is provided for generating a musical score image from the musical score information included in the fingering information. and displayed on a display device 18 such as a display.

The fingering display device also includes a reproduction information generation unit 21 for reproducing reproduction information for reproducing a piece of music from the musical tone information stored in the musical tone/finger number information storage unit 11, and a reproduction information storage unit for storing the reproduction information. 22, a sound generation unit 23 for generating sound from reproduction information, a sound reproduction unit 24 for converting into analog signals, and a sound output device 25 such as an amplifier and a speaker.

The musical tone/finger number information storage unit 11 stores the musical tones constituting the musical score and the minimum information necessary for music reproduction and fingering drawing, such as finger numbers corresponding to the musical tones.

The key depression information generator 12 generates key depression information at an arbitrary time from the beginning to the end of a piece of music based on the information stored in the musical tone/finger number information storage section 11 . As the key depression information, the target time, the playing hand and finger number for each tone being depressed at that time, the sound volume, the note number, and the presence/absence of a special fingering flag are generated. Special fingerings include fingering, fingering, and fingering in performance techniques.
The key depression information generated by the key depression information generation section 12 is stored in the key depression information storage section 13 .

If the key-press information stored in the key-press information storage unit 13 contains a special fingering, the fingering display generated by the key-press information generating unit 12 is assumed to require a special fingering. The special fingering information generation section 31 generates special fingering information from the key depression information and stores it in the special fingering information storage section 32 . Whether or not the fingering display includes a special fingering is determined from the key depression information generated by the key depression information generating section 12 .

The fingering position information generation unit 14 generates fingering position information Pm at the reproduction time (time of the current reproduction position from the beginning of the music) T based on the information stored in the key depression information storage unit 13 .

The fingering position information Pm is information for depicting the handprint and finger shape in the fingering image. The fingering position information includes the position data of the center of the back of the left and right hands, the position data of the base of each of the five fingers, the position data of the two bases of the wrist (thumb side, little finger side), and the position of the tip of each finger. Contains data. By giving these pieces of information, it becomes possible to draw a fingering image. Also, in order to determine the position of each part of the bill with respect to the key, data representing the positional relationship between the position data and the key should be provided.
As a method of obtaining a fingering image from fingering position information, for example, the known methods disclosed in the above-mentioned Patent Document 1 (Patent No. 3521838) and Patent Document 2 (Patent No. 4070100) are used.

The fingering image generator 15 generates fingering images of both hands at the reproduction time T based on the information generated by the fingering position information generator 14 .
Each fingering image is generated based on information about the hand shape and the coordinates of the finger positions according to the fingering position information.
A specific image example and generation procedure of each fingering image corresponding to the left hand and right hand will be described later.

Also, the musical score image generation unit 16 generates a musical score image based on the information stored in the musical tone/finger number information storage unit 11 .

The fingering images created by the fingering image generator 15 and the musical score images created by the musical score image generator 16 are stored in the image information storage unit 17 as image information.

The image information stored in the image information storage unit 17 is displayed on the display device 17 .
That is, based on the key depression information corresponding to the musical tones of the musical score, a fingering animation of playing the musical instrument is displayed on the screen when the music is reproduced. As a specific image display, the musical score is displayed in the upper row, and fingering images for playing each tone of the keyboard and the musical score with both hands are displayed in the lower row. Performance information such as a piano roll may be displayed instead of the musical score.

The reproduction information generation section 21 generates reproduction information of musical tones based on the information stored in the musical tone/finger number information storage section 11 . As the reproduction information, MIDI information of the time, volume and note number at which each tone is generated is created.
The reproduction information created by the reproduction information generation section 21 is stored in the reproduction information storage section 22 .
The sound generator 23 generates sound information composed of analog signals in accordance with the reproduction information.

The sound reproduction unit 24 reproduces an analog signal corresponding to the sound information. Further, in generating the key-press information by the key-press information generating unit 12, time information is input from the sound reproducing unit 24 so that key-press information corresponding to the reproduction time of the music is generated.
The sound output device 25 reproduces sound by outputting an analog signal as sound information through an amplifier and a speaker.

Fingering images for the left hand and right hand displayed by the fingering display device described above will be described with reference to FIGS. 2 and 3. FIG.
FIG. 2 shows a part of the musical score of "For Elise", which is a piece of music in which there are parts played alternately by the left hand and the right hand. The fingering images of the left and right hands will be explained using the musical tones displayed in the part. The numbers displayed on the notes are finger numbers indicating which finger is used to press the key. "1" is the thumb, "2" is the index finger, "3" is the middle finger, and "4" is The ring finger and "5" correspond to the little finger, respectively.

In the musical score of the X part in FIG. 2, the middle finger (3) of the left hand presses the "re (sharp)" key (reproduction time T1), and the index finger (2) of the left hand presses the "mi" key (reproduction time T2). ), then the index finger (2) of the right hand presses "re (sharp)" (playback time T4), the middle finger (3) of the right hand presses "mi" (playback time T5), and then presses the key "mi" (playback time T5). The key "re (sharp)" is pressed with the middle finger (3) (reproduction time T7), and the key "mi" is pressed with the index finger (2) of the left hand (reproduction time T8).
In other words, when one hand is pressing a key, the other hand is in a rest (pause state), so the left and right hands alternately press the same keys ``re (sharp)'' and ``mi''. will come to

In such a musical score, when generating fingering images for the left hand and right hand based on fingering position information corresponding to the playback time at the time of music playback, if the fingering images for the left hand and right hand overlap, the current playback position The hand corresponding to the tone whose sounding start time is the latest among the tones to be pressed (that is, the hand including the finger that presses the tone that was pressed immediately before the current playback position) is drawn in front.
Also, when there is no musical tone to be pressed at the current playback position and neither hand is pressing a key, the hand including the finger to be pressed next is drawn in front.

Therefore, the fingering images of the left and right hands at the playback time T are sequentially shown in FIGS. 3(a) to 3(h). will be drawn.
Also, when a key is depressed, a key-depression mark P is displayed at the corresponding fingertip, and the depressed key portion also changes color (hatched portion). During key depression preparation, a key depression preparation mark Q indicating the next key depression is displayed on the corresponding fingertip.

In the fingering image at the reproduction time T1 in FIG. 3A, the left hand is depicted in front because the left hand key is pressed. In the fingering image of the left hand, the middle finger (3) presses "re (sharp)" and the color of the key changes. Since the right hand is in a rest at the reproduction time T1, the forefinger (2) to be depressed next time (reproduction time T4) is indicated by the key depression preparation mark Q. As shown in FIG.

In the fingering image at reproduction time T2 in FIG. 3B, the left hand is depicted in front because the key is depressed with the left hand, as at reproduction time T1. In the fingering image of the left hand, the index finger (2) presses "mi" and the color of the key changes. Since the right hand is still at rest at playback time T2, the index finger (2) to be pressed next time (playback time T4) is indicated by the key press preparation mark Q (preparing for key press). .

In the fingering image at the playback time T3 in FIG. 3C, the key is released with the left hand, and there is no musical tone to be pressed at the current playback position, and neither hand is pressing the key. At this time, since the hand including the finger that will be pressed next time (reproduction time T4) is drawn in front, the right hand, which is the next key to be pressed, is drawn in front.
That is, in the fingering image of the left hand, the middle finger (3) is preparing to press a key toward playback time T7, and in the fingering image of the right hand, the index finger (2) is preparing to press a key toward playback time T4. The right hand including the fingers at key time (reproduction time T4) is the front.

In the fingering image at the reproduction time T4 in FIG. 3D, the right hand is drawn in front because the right hand key is pressed. In the fingering image of the right hand, the forefinger (2) presses "re (sharp)" and the color of the key changes. Since the left hand is in a rest at the reproduction time T4, the key depression preparation mark Q indicates the middle finger (3) to be depressed next time (reproduction time T7).

In the fingering image at the reproduction time T5 in FIG. 3E, the right hand is drawn in front because the right hand key is pressed. In the fingering image of the right hand, the middle finger (3) presses "mi" and the color of the key changes. The left hand is in a rest state even at playback time T5, so the middle finger (3) to be pressed next time (playback time T7) is indicated by the key-press preparation mark Q. FIG.

In the fingering image at playback time T6 in FIG. 3(f), the right hand key is released, and there is no musical tone to be pressed at the current playback position, and neither hand is pressing a key. At this time, the hand including the finger to be pressed next time (reproduction time T7) is drawn in front, so the left hand, which is the next key to be pressed, is drawn in front. That is, in the fingering image of the left hand, the middle finger (3) is preparing to press a key toward reproduction time T7.

In the fingering image at the reproduction time T7 in FIG. 3G, the left hand is drawn in front because the left hand key is pressed. In the fingering image of the left hand, the middle finger (3) presses "re (sharp)" and the color of the key changes.

In the fingering image at playback time T8 in FIG. 3(h), the left hand is depicted in front because the key is being pressed with the left hand. In the fingering image of the left hand, the index finger (2) presses "mi" and the color of the key changes.

Next, the case where the left hand and the right hand are in the depressed state at the same time will be described. In such a case, when the fingering images of the left hand and the right hand are overlapped and the left hand and the right hand are pressed at the same time, processing is performed to draw the hand that is more difficult to perform on the front.

For example, in the case of the musical score shown in FIG. 4, the little finger (5) of the left hand presses "Do", the ring finger (4) of the right hand presses "So" (reproduction time T11), and the ring finger (4) of the left hand presses "So". is pressed (playback time T12), the middle finger (3) of the left hand presses "do" and the thumb (1) presses "mi" (playback time T13), and the ring finger (4) of the left hand presses "sol". , the index finger (2) of the right hand simultaneously presses "mi" (reproduction time T14), and the thumb (1) of the right hand presses "do" (reproduction time T15).

In such a musical score, when the fingering images for the left and right hands are generated based on the fingering position information corresponding to the playback time when the music is played back, if the fingering images for the left and right hands overlap, the above-mentioned current playback A process of drawing the hand corresponding to the tone with the latest sounding start time among the tones to be pressed at the position (i.e., the hand including the finger pressing the tone pressed immediately before the current playback position) to the front. , when there is no tone to be pressed at the current playback position and neither hand is pressing a key, in addition to drawing the hand that includes the finger to be pressed next, the left and right hands simultaneously press the key. When it is played, the hand that is difficult to play is drawn in front.

Therefore, the fingering images of the left and right hands at the playback time T are sequentially shown in FIGS. 5(a) to 5(e). will be drawn.
Also, when a key is depressed, a key-depression mark P is displayed at the corresponding fingertip, and the depressed key portion also changes color (hatched portion).

In the fingering image at playback time T11 in FIG. 5A, the left hand and right hand are at the time of key depression and the hands are separated, so the left hand and right hand are drawn without overlapping. In the fingering image of the left hand, the little finger (5) presses "do" and the color of the key changes. In the fingering image of the right hand, the ring finger (4) presses "G" and the color of the key changes.

In the fingering image at the reproduction time T12 in FIG. 5B, the left hand is depicted in front during key depression (to be depressed later) after both hands have been depressed at the reproduction time T11. In the fingering image of the left hand, the ring finger (4) presses "G" and the color of the key changes. In the fingering image of the right hand, the key-pressing mark P is attached to the ring finger (4) pressed at the reproduction time T11.

In the fingering image at reproduction time T13 in FIG. 5C, the left hand is depicted in front during chord key depression (to be depressed later) after both hands have been depressed at reproduction time T11. In the fingering image of the left hand, the chords "do" and "mi" are pressed with the index finger (3) and thumb (1), and the colors of the keys change. In the fingering image of the right hand, the key-pressing mark P is attached to the ring finger (4) pressed at the reproduction time T11.

In the fingering image at playback time T14 in FIG. 5D, both hands are simultaneously depressed. In this case, the difficult hand is drawn in front, but in this example the left hand is drawn in front. In the fingering image of the left hand, the ring finger (4) presses "G" and the color of the key changes. In the fingering image of the right hand, the index finger (2) presses "mi" and the color of the key changes.

In the fingering image at reproduction time T15 in FIG. 5E, the right hand during key depression (to be depressed later) after both hands have been depressed at reproduction time T14 is drawn in front. In the fingering image of the right hand, the key "do" is pressed with the thumb (1) and the color of the key changes. In the fingering image of the left hand, the key-pressing mark P is attached to the ring finger (4) pressed at the reproduction time T14.

When the fingering images of the left hand and the right hand overlap, the fingering images drawn in the front are made easier to see by rendering the hand drawn in the front with a smaller transmittance than the other hand. , the fingering image of the hand on the back can also be confirmed at the same time.

According to the above example, when the fingering images for the left hand and the right hand overlap, the fingering image to be drawn in the foreground will be the fingering image whose pronunciation start time is This is the fingering image of the hand corresponding to the slowest musical tone, and if there is no musical tone to be pressed at the current playback position and neither hand is pressing the key, the hand that includes the finger to be pressed next. It is a fingering image of.
In addition, when the fingering images of the left hand and the right hand are overlapped, the fingering image is drawn in front of the difficult hand when the left hand and the right hand are pressed at the same time.

Next, in the fingering position information generation unit 14 and the fingering image generation unit 15 of FIG. 1, refer to the flowchart of FIG. 6 for the processing procedure for generating the fingering images of both the left hand and the right hand from the fingering position information. to explain.
In the fingering display device, a stored fingering display program generates fingering position information based on key depression information at playback time, and generates left and right fingering images based on the fingering position information. and drawn on the display device 18 . The key depression information also includes information about volume.

First, keyboard information and both hands drawn on the keyboard (left hand and right hand ) is read (step 41).
Next, keyboard description is performed from the keyboard information of step 41 (step 42).

It is determined whether or not the playback time is during key depression (step 43). If the key is being pressed, it is determined whether the key is being pressed with both hands at the same time (step 44).
If the keys are not simultaneously depressed by both hands, it is determined whether the previous key depression was by the left hand (step 45).
If the last key pressed is the left hand, the right hand fingering image is drawn (step 46), the left hand fingering image is drawn thereon (step 47), and the left hand fingering image is displayed on the screen. (step 50).
If the last key pressed is the right hand, the left hand fingering image is drawn (step 48), the right hand fingering image is drawn thereon (step 49), and the right hand fingering image is displayed on the screen. (step 50).

If the playback time is not during key depression in step 43, it is determined whether the next key depression is the left hand (step 51).
If the next key to be pressed is the left hand, the fingering image for the right hand is drawn (step 52), the fingering image for the left hand is drawn thereon (step 53), and the fingering image with the left hand in front is displayed on the screen. (step 50).
If the next key to be pressed is the right hand, the left hand fingering image is drawn (step 54), the right hand fingering image is drawn thereon (step 55), and the right hand fingering image is displayed on the screen. (step 50).

If both hands are simultaneously depressed in step 44, the difficulty levels of the left hand operation and the right hand operation are compared to determine whether the left hand operation is more difficult (step 61).
Whether or not the level of difficulty is high is determined each time by considering the left and right of the hand, key position, finger movement speed and distance, front and rear movement, note value and sound frequency, etc., and satisfying the criteria. determine whether or not Alternatively, the entire piece of music may be scanned at the start of the performance, and locations of high difficulty set by the piece of music may be detected.

If the difficulty level of the left hand is high, the fingering image of the right hand is drawn (step 62), the fingering image of the left hand is drawn on it (step 63), and the fingering image with the left hand placed in front is displayed on the screen. Display (step 50).
If the difficulty level of the right hand is high, the fingering image of the left hand is drawn (step 64), the fingering image of the right hand is drawn on it (step 65), and the fingering image with the right hand placed in front is displayed on the screen. Display (step 50).

According to the fingering display program described above, when drawing the fingering images of the left and right hands, even if the left and right hands approach or cross each other, the musical tone to be pressed at the current playback position is displayed. Among them, the hand corresponding to the tone with the latest pronunciation start time is displayed in front, and when there is no tone to be pressed at the current playback position and neither hand is pressing a key, the next finger to be pressed is included. It is possible to display the hands in front.

As a result, by displaying the last key-pressing information (hand shape, position of the back of the hand, fingers to be pressed, and the position of the key to be pressed), which is the information that the trainee most wants to know, It is possible to display without being hidden or obstructed by the hand or finger that pressed the key earlier.

In addition, when the fingering images of the left hand and the right hand are overlapped and the left and right hands are pressed at the same time, the more difficult hand is displayed in the front, so that the more difficult hand that is more important for the practicer can be displayed. Information on fingers can be given priority.

In addition, when the fingering images of the left hand and the right hand overlap, the hand displayed in the front is drawn with a lower transparency than the other hand, so that the fingering images in the front are easier to see. At the same time, the fingering image of the hand on the back side can be confirmed at the same time.

REFERENCE SIGNS LIST 11: musical tone/finger number information storage unit 12: key depression information generation unit 13: key depression information storage unit 14: fingering position information generation unit 15: fingering image generation unit 16: musical score image generation unit 17: image information storage unit REFERENCE SIGNS LIST 18: display device 21: reproduction information generation unit 22: reproduction information storage unit 23: sound generation unit 24: sound reproduction unit 25: sound output device P: key pressing mark Q: key pressing ready mark

Claims (3)

A program for drawing a fingering animation of playing a musical instrument during music reproduction based on key depression information of the music and displaying the fingering on a screen,
When generating fingering images for the left hand and right hand based on the fingering position information corresponding to the playback time when the music is played back,
When the fingering images of the left hand and the right hand overlap, the hand including the finger that presses the musical tone that was pressed immediately before the current playback position is drawn in front,
A fingering characterized in that when there is no musical tone to be pressed at the current playback position and neither hand is pressing a key, the computer is caused to execute a function of drawing a hand including the finger to be pressed next on the front. display program. When fingering images of the left hand and the right hand are overlapped, when the left and right hands are pressed at the same time, at least the hand whose finger movement speed is higher than a predetermined standard is drawn on the front. 2. The fingering display program according to claim 1, which causes a computer to execute: 3. A fingering display program according to claim 1 or 2, wherein the hand drawn on the front side is drawn with a smaller transmittance than the other hand.

Images