JP4262717B2 - Performance guide device - Google Patents

Description

  The present invention relates to a performance guide device for guiding performance by showing a player a guide display based on music data in a keyboard instrument such as a piano, an electronic piano, an electronic keyboard, and an organ.

  With respect to such a keyboard instrument performance guide device, a guide display is provided by a light emitting diode such as a note or a single lamp display at a position corresponding to each key of the keyboard instrument, and the performer guides the display board regardless of the score. There are known ones that can play music by guiding the display. Such a performance guide device is suitable for beginners who cannot read a score, but lacks a function for those who are going to be able to read a score and want to go further. Therefore, a performance guide device for guiding a performer by displaying a part of a musical score to be played on a guide display board using a liquid crystal device and sequentially displaying positions corresponding to the musical score and a key to be depressed by a light emitting diode. Is known (see, for example, Patent Document 1). According to this performance guide device, since the relationship between the notes of the score and the keys on the keyboard is clearly displayed, the performer can read the score without knowing it and can expect improved reading ability. .

  In addition, as a musical instrument performance guide device, a device for guiding fingering is also known. The performance of the keyboard instrument is ideally performed using 10 fingers on the left and right, and improvement in skill cannot be expected if the performance is performed with only one finger according to the performance guide device. The fingering method is used to indicate which note is to be pressed with which finger. In a normal score, numbers from 1 to 5 on the little finger are assigned. Therefore, in addition to guiding the fingering by displaying the number for fingering on the notes and sheet music displayed on the guide display board, there is also known a guide device for displaying the finger and instructing which finger to press. (For example, refer to Patent Document 2).

In addition to the performance guide device, general light display means include incandescent bulbs, fluorescent tubes, cold cathode ray tubes, light emitting diodes (LEDs), semiconductor lasers (LDs), liquid crystal displays (LCDs), and electroluminescence. In addition to a device using a light source such as (EL), a stereoscopic image reproducing device (for example, see Patent Literature 3) and a hologram device (see, for example, Patent Literature 4) for stereoscopically displaying an image, an electronic developed by NHK Broadcasting Technology Laboratory Holographic technology is known.
Japanese Patent Laid-Open No. 05-181406 JP 2000-338972 A JP 2001-235708 A JP 2005-283683 A

  However, in the conventional performance guide device for displaying a score, the LCD display board for displaying the score has a size that can display a score for one measure, and the musical notes of the score displayed there are displayed. There is a problem that it is difficult to obtain a physical correspondence between the keys and the keys on the actual keyboard. Further, even in a performance guide device that displays finger of a person on a display board and instructs fingering, there is a problem that it is difficult to obtain a physical correspondence between the finger displayed on the display board and a key on an actual keyboard. It was.

  The present invention has been made to solve such a conventional problem, and provides a performance guide device that facilitates the physical correspondence between a musical score or a finger displayed on a display board and a key on an actual keyboard. The purpose is to do.

  In order to achieve the above object, the performance guide apparatus of the present invention includes a display means capable of independently displaying a high score and a low score of a grand staff by a predetermined length, and a press for detecting a pressed key. Based on the signal from the key depression detecting means, the treble part music is recorded at the position of the key to be depressed corresponding to the notes in the high note and the low note displayed on the display means. And a control means for displaying the bass part movably independently.

  With this configuration, the control means sequentially displays the treble and bass parts of the grand staff on the display means on the basis of the music data of the musical composition to be played, and sequentially displays, for example, about one bar. Based on the signal from the keypress detection means, the treble and bass parts are selected as necessary so that they match the actual positions of the keys to be pressed corresponding to the notes in the high and low parts. Since each of them is moved and displayed independently, it becomes easier for the performer to take a physical correspondence between the position of the musical note displayed on the display means and the position of the key on the keyboard to be depressed. The positional relationship between the key and the key to be pressed can be clearly understood. For this reason, it is possible to easily learn the technique for performing while watching the score without relying on the performance guide device.

  The present invention is also characterized in that the display means discriminates and displays a note corresponding to the key to be depressed in the treble part and / or the bass part from other notes. With this configuration, the performer can reliably identify the note of the key to be depressed and the other note.

  The present invention is also characterized in that the display means has a plurality of display areas partitioned in the vertical direction along the keyboard. With this configuration, not only a grand staff or the like can be displayed in a plurality of display areas, but also various different displays can be provided, and a lot of information can be given to the player.

  In the present invention, it is also preferable that the display means displays a high part and / or a low part of the grand staff in one of the plurality of display areas and presses the key in another one of the display areas. A fingering mark is displayed at a position corresponding to the key position. With this configuration, the positional relationship between the score and the key to be pressed becomes clear, and the reading ability can be improved.

  In the present invention, it is also preferable that the display means displays a high part and / or a low part of the grand staff in one of the plurality of display areas and presses the key in another one of the display areas. A finger image is displayed at a position corresponding to the key position. With this configuration, the positional relationship between the score and the finger to be pressed becomes clear, and the reading ability and fingering technique can be improved.

  In the present invention, it is also preferable that the display means includes at least one of a fingering mark and a finger image at a position corresponding to a position of a key to be depressed, a treble part and / or a bass part of the grand staff. Is projected in the direction of the keyboard (including projection or light projection). With this configuration, fingering marks and finger images are displayed above the keyboard, not in front of the keyboard, so the positional relationship between the score and the key to be pressed becomes clear, and it is easy to perform while gazing at the keyboard. Can guide the beginners reliably.

  The present invention is also characterized in that the display means is a two-dimensional display, a three-dimensional display, a hologram display, or a combination thereof. With this configuration, note display and the like can be performed in a three-dimensional manner, so that dynamic effects of notes and the like can be enhanced, and it can be understood as a bodily sensation that notes and the like change over time, and a deeper understanding of music can be deepened.

  In the present invention, the control means displays a note corresponding to the pitch at the key depression position obtained by the key depression detection means at a corresponding pitch position in the score displayed on the display means. At the same time, the pitch position of the note is stored. With this configuration, when the performer presses the wrong key, the note corresponding to the wrong key is displayed at the corresponding pitch position on the score displayed on the display means. It is possible to clearly recognize that the key pressing position is wrong, and to understand the relationship between the wrong key pressing position and the position on the score, thereby improving the reading ability. Further, since the wrong key pressing position is stored, the wrong key pressing position can be reconfirmed after the performance.

  The present invention is also characterized in that the display means, the key press detection means, and the control means are integrally formed and can be attached to and detached from a keyboard instrument. With this configuration, since it can be attached to an existing keyboard instrument, it is not necessary to purchase a new keyboard instrument, which can greatly contribute to user convenience and economy.

  The present invention provides a display means capable of independently displaying a treble part and a bass part of a grand staff by a predetermined length independently, a key depression detecting means for detecting a depressed key, and displayed on the display means. Based on the signal from the key-press detection means, the treble part and the low part are displayed so as to be independently movable at the position of the key to be depressed corresponding to the note in the high part and the low part. Control means, and the control means displays the treble and bass parts of the grand staff on the display means based on the music data of the musical composition to be played, for an arbitrary measure, for example, about one measure. As necessary, the treble part is displayed based on the signal from the key depression detection means so that it is displayed in sequence and matches the actual position of the key to be depressed corresponding to the note in the treble and bass parts. The staff and bass are moved independently Therefore, it is easy for the performer to take a physical correspondence between the position of the musical note displayed on the display means and the position of the key on the keyboard to be depressed. You can clearly understand the positional relationship with the key. For this reason, it is possible to easily learn the technique for performing while watching the score without relying on the performance guide device.

(Embodiment 1)
Hereinafter, the performance guide apparatus according to the first embodiment of the present invention will be described. In FIG. 1, the performance guide device 3 is a long and thin plate-like member arranged in parallel as a rear position instead of or near a keyboard presser provided on the back side of the keyboard 2 of the piano body 1. As described above, the performance guide device 3 is detachable from the piano body 1 by integrating the guide display plate 4 as display means and the key press detection means and control means described later, so that the piano body 1 and the keyboard 2 are processed. There are advantages to not. In addition, if the performance guide device 3 uses an organic EL incorporating an LSI and a touch sensor, the performance guide device 3 itself can be formed in a film shape. Moreover, the performance guide apparatus 3 can also be incorporated in main bodies, such as a piano. In the case where the keyboard 2 is an 88-key piano, the performance guide device 3 does not have to be provided for all 88 keys, such as the number of frequently used keys, for example, 76 keys, 64 keys, 49 keys, etc. It may be partially provided.

  As shown in FIG. 2, the guide display board 4 projects a dot matrix display unit 41 for displaying a score and the like, and an image such as musical notes arranged in front of the dot matrix display unit 41 on the keyboard. And a lens plate 42 serving as projection means. The dot matrix display unit 41 is divided into three areas 41a, 41b, and 41c in the vertical direction. A musical score, music signs, various messages, and the like are displayed in the first area 41a, and a fingering is displayed in the second area 41b. A mark m is displayed, and a finger image is displayed in the third area 41c. The lens plate 42 is partitioned into a compound eye lens 42a corresponding to the first area 41a of the dot matrix display unit 41, a monocular lens array 42b corresponding to the second area 41b, and a space 42c corresponding to the third area 41c. ing. As another configuration example, the lowermost third area 41 c of the dot matrix display unit 41 and the lowermost space portion 42 c of the lens plate 42 may be omitted. Furthermore, the projection means 42a may not be provided for the first area 41a, and the projection means may be provided only for the second area 41b.

  In the first area 41a, the treble and bass parts of the grand staff are displayed independently. The high and low notes of the grand staff are displayed in the middle of the keyboard 2 in one mode, but in another mode, the note to be played corresponds to the position of the key to be pressed separately. Is displayed. The compound eye lens 42a of the lens plate 42 corresponds to the first area 41a, and a virtual stereoscopic image 43 such as a note image displayed in the first area 41a is displayed on the keyboard by the first area 41a and the compound eye lens 42a. A three-dimensional display that forms an image above 2 is constructed.

  FIG. 3 shows the basic principle of integral photography (IP), which is an example of a three-dimensional display. As shown in FIG. 3A, a large amount of small image data is obtained by a CCD camera 103 through a compound eye lens (fly eye lens) 102 in which a large number of minute convex lenses are arranged on a target object 101, and this is recorded in a memory 104. At the time of reproduction, as shown in FIG. 3B, image data from the memory 104 is sent to the liquid crystal display 105, small image data is displayed on the liquid crystal display 105, and through the compound eye lens 106 similar to the compound eye lens 102 from the front. When viewed, a stereoscopic reproduction image 107 of the target object is obtained. As a three-dimensional display, in addition to the integral photography method, a known technique such as a parallax barrier method or a lenticular lens method using an image obtained by alternately synthesizing left and right parallax images into vertical stripes should be used. Can do. Therefore, a part of the lens plate 42 can be appropriately changed to a parallax barrier system.

  In this way, the image data of the treble and bass parts of the grand staff are created in advance and stored in the memory, and are selected as appropriate by the liquid crystal driver. As shown in FIG. By displaying in the first area 41 a of the matrix display unit 41, the virtual stereoscopic image 43 can be displayed above the keyboard 2.

  The fingering mark m displayed in the second area 41b of the dot matrix display section 41 is displayed corresponding to the key to be pressed as shown in FIG. The monocular lens array 42b of the lens plate 42 corresponding to the second area 41b images the fingering mark m displayed on the second area 41b as a beam spot 44 on the keyboard 2. In addition, the fingering mark m may display a number from 1 to 5 assigned to each finger instead of the beam spot 44 as shown. Further, the second area 41b is not as a part of the dot matrix display section 41, that is, not the dot matrix display section, but the LEDs 46a are arranged in a line so as to correspond to each key of the keyboard 2, as shown in FIG. The irradiation light may be configured as an LED array 46 that forms an image as a beam spot 44 on each key of the keyboard 2. In this case, the LED array 46 is provided at the position of the second area 41b and the portion of the monocular lens array 42b is a space, or the position of the second area 41b is a space or dead space, and the LED array 46 is a monocular lens array. 42b can be arranged. Further, a semiconductor laser array may be configured using a semiconductor laser instead of the LED 46a.

  In FIG. 2, the portion of the lens plate 42 corresponding to the third area 41c is a space portion 42c. The third area 41c displays the reproduced stereoscopic image 45 of the finger image displayed in the third area 41c on the keyboard 2. The hologram display that forms an image above is formed. In the reproduced stereoscopic image 45 of the finger image, when viewed from above, five fingers on both the left and right sides are displayed with the same width as the key.

  FIG. 7 shows the principle of the rainbow hologram technique used as a hologram display in the present embodiment. In FIG. 7A, in order to record the object 111 on the master hologram plate 112, the laser beam from the He-Ne laser 113 is reflected by the beam splitter 114 and the mirrors 115 and 116, and is reflected by the objective lens 117 and the pinhole 118. The laser beam is spread to illuminate the object 111, and object light 119 that is reflected light of the object 111 irradiates the master hologram 112 plate. On the other hand, the laser beam that has passed through the beam splitter 114 is reflected by the mirror 120 and then spread by the objective lens 121 and the pinhole 122 to irradiate the master hologram 112 plate as the reference beam 123. In this way, interference fringes are formed on the master hologram plate 112 by the object light 119 and the reference light 123, and a master hologram is produced. Next, as shown in FIG. 7B, the laser beam from the same He-Ne laser 113 is reflected by the mirror 124, the beam splitter 125, and the mirrors 126 and 127, and the laser beam is spread by the objective lens 128 and the pinhole 129. After that, parallel reproduction illumination light 131 is obtained by the collimator lens 130, and this is irradiated onto the master hologram plate 112 from the direction opposite to the reference light 123. As a result, a real image reproduction image 132 is formed on the opposite side of the master hologram plate 112 from the object 111. At this time, a slit plate 133 is disposed on the surface of the master hologram plate 112 on the collimator lens 130 side, and the light that has passed through the slit plate 133 becomes object light 134 and the real image reproduction image 132 is irradiated onto the transfer hologram plate 135. Is done. On the other hand, the laser beam reflected by the beam splitter 125 is reflected by the mirror 136, spread by the objective lens 137 and the pinhole 138, and then irradiates the transfer hologram plate 135 as the reference beam 139. In this way, interference fringes are formed on the transfer hologram plate 135 by the object beam 134 and the reference beam 139, and a transfer hologram is produced. At the time of reproduction, as shown in FIG. 7C, the reproduction illumination light 141 is reproduced by the white light source 140 from the back side of the observer in the opposite direction to the reference light 139 with respect to the transfer hologram plate 135 on which the interference fringes are formed. , A real image reproduction image 142 is formed on the side opposite to the white light source 140, and this can be observed by an observer.

  A hologram display in the present embodiment using this rainbow hologram technology will be described. First, regarding the creation of the master hologram, a CCD camera is used as the master hologram plate 112 in FIG. 7A, a finger model is imaged as the object 111, and the interference pattern of the obtained finger model is connected to the CCD camera. Stored in the computer's memory. Next, a transmissive LCD connected to a computer is used as the master hologram plate 112 in FIG. 7B, and interference fringes stored in the memory of the computer are output to form a real image reproduction image 132. A CCD camera connected to a computer as a transfer hologram plate 135 is arranged in front of the master hologram plate 112, and a real image reproduction image 132 is picked up by this CCD camera and stored in the memory of the computer. As the third area 41c of the guide display board 4 mounted on an actual piano, a transmissive LCD is used instead of the transfer hologram plate 135 in FIG. 7C, and this transmissive LCD is stored in the memory of the computer. By outputting the stored interference fringes and irradiating white light as reproduction illumination light 141 from an LED or the like as the white light source 140 disposed behind the interference fringe, a real image reproduction image 142 can be obtained on the viewer side. As shown in FIG. 8, a reproduced three-dimensional image 45 of fingers can be obtained on the keyboard 2. In addition to such a rainbow hologram, other known hologram techniques for reproducing a three-dimensional reproduction image in the direction of the keyboard 2 can be used. Further, if the refractive efficiency and diffraction efficiency are corrected using a hologram optical element (HOE), a better hologram image can be obtained.

  FIG. 9 shows the internal configuration of the performance guide apparatus 3 in the present embodiment. In FIG. 9, the first area 41a of the dot matrix display unit 41 is driven by the first drive unit 11a of the liquid crystal drive unit (LCD driver) 11, the second area 41b is driven by the second drive unit 11b, and the third The area 41c is driven by the third drive unit 11c. Each drive part 11a, 11b, 11c of the LCD driver 11 is controlled by the control part 12 which consists of CPU. The control unit 12 includes an OS for controlling the entire apparatus by the control unit 12 and an ROM 13 for storing application programs for controlling the performance guide apparatus, and music data and work data used when the control unit 12 controls each unit. A RAM 14 for temporary storage; an external memory 15 such as an IC card, an optical card, an optical disk, a magnetic card, or a magnetic disk for storing the flow of encoded digital notes for each song and various music markers as music data; The key press detection unit 16 that detects the key press or key release operation by the performer, the music performance data detected by the key press detection unit 16 and the music data transferred from the external memory 15 to the RAM 14 are compared and played. A performance state determination unit 17 that determines the state is connected to an operation input unit 18 through which a performer inputs a performance mode and a command. The control unit 12 may have an interface function for exchanging data from a DVD, a hard disk, a personal computer, MIDI, or another terminal as a storage device. A flash memory may be used instead of the ROM 13 and the RAM 14.

  In the external memory 15, as a fingering guide function for the performer, a key pressing part specification for pressing keys according to the display of each note written on the score, and a key pressing down after the key pressing part are performed. Specifying the non-key-pressing part that allows fingers to be placed at suitable positions, whether or not the key-pressing part and the non-key-pressing part are changed, that is, whether to move, and whether to move left or right The direction of movement, the amount of movement (designated by how much) it moves, and the key press that should be pressed next from the key press position or the vicinity of the key press part and the non-key press part. The position and the moving speed for moving to the next key pressing position to be pressed at the performance speed of the music are stored as binarized music data for each bar unit.

  The key press detection unit 16 uses a transmission type or reflection type photocoupler, and detects key press and / or key release by detecting the displacement of the pressed key. FIG. 10 shows an example using a reflection type photocoupler. As shown in FIG. 10 (a), a light emitting diode PD1 and a light receiving diode PD2 are provided, and the light emitted from the light emitting diode PD1 passes through the lenses L1 and L2 and is received by the light receiving diode PD2 before the key 2 is pressed with a finger. The light is received and the current from the + B power source is grounded through the light receiving diode PD2, and no key pressing signal is output to the control unit 12. When the key 2 is pressed, as shown in FIG. 10B, the light beam from the light emitting diode PD1 is not received by the light receiving diode PD2, and the current from the + B power source is detected by the key press as a voltage signal to the control unit 12. Is done. When the key 2 is released from the state shown in FIG. 10B, the state again enters the state shown in FIG. 10A, a current flows through the light receiving diode PD2, and the controller 12 detects the key release.

  The performance state determination unit 17 acquires the data of the player's key press intensity, tone length, and key release speed from the detection data sent from the key press detection unit 16, and uses this data and the music data sent from the RAM 14. By comparing, the performance state of the performer is determined at any time as the music progresses. The determination result is sent to the control unit 12 and displayed on the first area 41a of the dot matrix display unit 41, for example, “Please play more slowly” to notify the player. The operation input unit 18 designates a performance mode from the mouse, trackball, pad, and keyboard, and instructs what to display. The operation input unit 18 may be provided with a touch panel on the front surface of the dot matrix display unit 41 so that writing can be performed on the touch panel with a light pen and / or fingers.

  Next, a schematic operation as a guide function of the performance guide device 3 in the present embodiment will be described. When the start switch provided in the performance guide device 3 is pressed by the performer, the control unit 12 is activated, and a predetermined measure (in this case, one measure) of the musical score from the external memory 15 or the internal ROM 13 is made one block. The music data for the right hand (for the treble part) and the left hand (for the bass part) are read out and stored in the RAM 14, respectively. The music data includes a key-pressing portion designation data to be pressed in accordance with the display of each note written in the score, and a non-printing position that allows a finger to be placed at a position where the key is to be pressed next to the key-pressing portion. Key press part specification data, movement presence / absence data specifying whether or not the key press part and non-key press part are changed, that is, movement, movement direction data specifying whether to move left and right, and how much (Length) Movement amount data for specifying whether to move, and the display of the key-pressed part and the non-key-pressed part, and the key-pressed position to be pressed next from the pressed key-pressed position or its vicinity It is a set with moving speed data that moves to the position of the key to be pressed at the performance speed of the music. When the right-hand first block data is read from the external memory 15 and stored in the RAM 14, the left-hand second block music data having the same configuration is subsequently read from the external memory 15 and the RAM 14. Stored in The control unit 12 reads each data from the RAM 14 and controls the display of each area 41a, 41b, 41c through each driving unit 11a, 11b, 11c of the liquid crystal driving unit 11. When the performer performs key depression, the key depression and / or key release is detected by the key depression detection unit 16. When the key depression detecting unit 16 detects the key depression, the control unit 12 reads out the music data of the next third block for the right hand and the music data of the next fourth block for the left hand from the external memory 15 and reads the RAM 14. Similarly, the display of each area 41a, 41b, 41c is controlled through each drive part 11a, 11b, 11c of the liquid crystal drive part 11.

  In accordance with the guide display displayed on the dot matrix display unit 41, the performer presses the corresponding key. The control unit 12 detects this key pressing operation with the key pressing detection unit 16, and the corresponding note and finger number from the position where the key is pressed or the vicinity thereof to the key to be pressed next by each performer's finger. And the corresponding music signs are also displayed. Further, when a finger image is displayed on the third area 41c by the hologram display, the finger image is moved to the position where the key should be pressed next, and the finger to be pressed is moved to the position of the note image and the fingering mark m. Match. The music performance data detected by the key press detection unit 16 is sent to the performance state determination unit 17, where it is compared with the music data read from the RAM 14, and the determination result is a message such as “Please play more slowly”. Is displayed at any time on the dot matrix display unit 41 as the performance of the music progresses. By repeating the above guide display, the player is guided to the end of the music. Finally, the performance state determination unit 17 performs a comprehensive evaluation until the end of the performance, sends the result to the control unit 12, and displays “practice more 50 points” and the result in the first area 41a. . In this embodiment, the key pressed display and the non-key pressed display are distinguished by blinking the light. However, other display methods can be used as long as they can be distinguished, such as light intensity and color coding. is not. Further, as a method of expressing the note value which is the length of the note, the note head size after the key depression may be gradually reduced in proportion to the note value. Further, in the first area 41a, various musical signs and messages 47 necessary for performance such as dynamic symbols, velocity symbols, idea symbols, pedal symbols, etc. in the music data stored in the RAM 14 are also displayed. Regarding the pedal symbol, in order to make the half pedal easier to understand, rectangles and triangles are used as display marks, and if the foot is pushed from the top, it is colored downward, and if it is a release foot, it is colored upward. You may make it disappear.

  Next, a specific example of display as a function for learning reading music in the present embodiment will be described. In the present embodiment, the player can arbitrarily select the following guide modes from level 1 to level 5 through the operation input unit 18 according to the skill of the player.

  Level 1: This level 1 is for advanced users. As shown in FIG. 11, the high and low parts of the grand staff are placed in an arbitrary measure in the first area 41a at a position substantially corresponding to the center of the keyboard 2. For example, the virtual solid score (only the eighth note 43 which is a part of the score is shown in FIG. 2) is displayed above the keyboard 2 by sequentially displaying one bar. In the illustrated example, after the quarter note n1 of the high note and the half note n4 of the low note are pressed, the eighth note n2 of the high note is flashed as a note to be pressed. . As a method for identifying the note to be pressed, in addition to the blinking display, an enlarged display, a rotation display, a reverse display, a vibration display, a radiated light display around the note, a background color change display, or the like can be used. it can. When the quarter note n1 and the half note n4 having different lengths are pressed simultaneously, the longer note is identified and displayed until the note value of the longer note elapses. Further, at level 1, even if the performer presses the correct key according to the score or presses the wrong key, the next note is sequentially identified and displayed by pressing the key. However, in the case of mistouch, the note corresponding to the pitch at the key pressing position obtained by the key pressing detector 16 is displayed at the corresponding pitch position in the score displayed in the first area 41a. A message 47 such as “Miss touched” is displayed. For example, when the key k44 corresponding to the note n1 is to be pressed, when the key k42 is pressed, the note is displayed in red at the pitch position of the score corresponding to the key k42, that is, the position of “Le”. As a result, the performer can clearly recognize that the key pressing position is wrong, and can understand the relationship between the wrong key pressing position and the position on the score, thereby improving the reading ability. Note that this note display may display an X mark at the pitch position or only the note head. Alternatively, a note length corresponding to the length of the key pressed may be displayed based on the length of time the key is pressed, that is, the time between the key pressing and the key release. Furthermore, the pitch position of the key that was pressed by mistake may be stored in the RAM 14, and the wrong key pressed position may be displayed after the performance to reconfirm the player. This mistouch display function is also applied to the following levels 2 to 5.

  Level 2: This level 2 is for intermediate players, and is applied when the player does not press the key even after the time specified for the note or a certain period of time has elapsed or presses the wrong key. . At this level 2, initially, the grand staff is displayed in the first area 41a at the substantially central portion of the keyboard 2 as in level 1, but if the player does not press the key even after a certain period of time, it is incorrect. When a key is pressed, the treble part is moved to the position where the right hand should press the key, and the bass part is moved to the position where the left hand should press the key. In other words, the player is made to display the position of the key to be pressed and to allow the player to determine the key to be pressed by himself. At this time, if the interval between the notes displayed on the treble and / or bass notes is made narrower than the key to be pressed, a plurality of notes can be entered. Can give a chance to think about which key corresponds to, and improve reading ability.

  Level 3: This level 3 is for intermediate players lower than level 2, and applies when the performer does not press the key for a specified time or after a certain period of time, or presses the wrong key It is what is done. At this level 3, at first, the grand staff is displayed in the first area 41a at the center of the keyboard 2 as in level 1, but if the player does not press the key even after a certain period of time, it is incorrect. When a key is pressed, the treble part is moved to the key position corresponding to the note to be pressed by the right hand, and the bass part is corresponded to the note to be pressed by the left hand, as shown in FIG. Move to the key position. That is, when the note n4 to be pressed with the left hand is not correctly pressed, the entire bass part is moved in the left direction so as to correspond to the position of the key k35 to be pressed. If the note n2 to be pressed with the right hand is not correctly pressed, the entire treble part is moved in the right direction so as to correspond to the position of the key k47 to be pressed. At this time, as shown in FIG. 12A, the interval between the note to be pressed displayed on the high note and / or the low note and the left and right adjacent notes is the width of the key to be actually pressed. The interval between the keys and the notes to be pressed is made to correspond to the keys to be actually pressed in a one-to-one correspondence so that the keys can be visually recognized easily. This does not apply to the interval between notes that are not pressed. As a result, notes that should actually be pressed are appealed, and notes that are not pressed are displayed close to the actual score, so that reading training is performed. Alternatively, as another display method, as shown in FIG. 12B, for example, the musical score is centered on the note n45 and the key k45 to be pressed so that each note corresponds to every key to be pressed one bar at a time. By extending the whole in the left-right direction, note n40 can correspond to key k40, note n42 to key k42, note n44 to key k44, and the like. As a result, the display is easy to understand for beginners. However, when the user gets used to a certain extent, the display should be switched to the display shown in FIG. 12A. When the performer correctly presses the key, the treble and / or bass notes are returned to the original center position and displayed. Thus, the performer can easily visually recognize and understand the correspondence between the note to be played and the key to be pressed.

  Level 4: This level 4 is for beginners who are lower than level 3 and applies when the performer does not press the key for a specified time or after a certain period of time, or when the wrong key is pressed It is what is done. At level 4, initially, the grand staff is displayed in the first area 41a at the center of the keyboard 2 as in level 1. However, if the player does not press the key even after a certain period of time, it is incorrect. When a key is pressed, as shown in FIG. 13, the treble part is moved to the key position corresponding to the note to be pressed by the right hand, and the low part is corresponded to the note to be pressed by the left hand. Move to the key position. That is, when the note n4 to be pressed with the left hand is not correctly pressed, the entire bass part is moved in the left direction so as to correspond to the position of the key k35 to be pressed. If the note n2 to be pressed with the right hand is not correctly pressed, the entire treble part is moved in the right direction so as to correspond to the position of the key k47 to be pressed. At this time, as described above, the interval between the left and right notes adjacent to the note to be pressed displayed on the high note and / or the low note is set to be approximately equal to the width of the key to be pressed. The power notes and the keys are made to correspond one-on-one so that they can be visually recognized. In this case, the interval between not-pressed notes is not limited to this. Further, the fingering mark m is displayed at a position corresponding to the keys k35 and k47 to be pressed in the second area 41b, and the beam spot 44 is projected on the surfaces of the keys k35 and k47. Further, a finger image is displayed as a hologram in the third area 41c, and a reproduced stereoscopic image 45 of the finger image is displayed at a corresponding position on the keyboard 2 so that the finger to be used corresponds to the key to be pressed. In addition, the fingers not pressed are also displayed at the same time, and the change in the width of each finger can be recognized at a glance according to the fingering situation. Thus, the performer can easily visually confirm and understand the correspondence between the note to be played, the key to be pressed, and the finger to be used. Note that the left and right finger images may be displayed in different colors in order to distinguish them from each other. Furthermore, in the finger image, if the finger to be pressed is made different in color from the other fingers and is vibrated up and down on the key to be pressed, it can be recognized very realistically by the player. Furthermore, it can be recognized that the entire finger moves to the left and right as the music progresses. When the performer correctly presses the key, the treble and / or bass notes are returned to the original center position and displayed. Thus, the performer can easily visually recognize and understand the correspondence between the note to be played and the key to be pressed. In this case, in order to correspond to the key to be pressed one by one, for example, the musical note n1 corresponds to the key k44, the musical note n2 corresponds to the key k47, and the musical note n3 corresponds to the key k51. It can also be displayed stretched in the direction.

  Level 5: This level 5 is for beginners who are even lower than level 4, and from the beginning of the performance, the treble part is moved to the key position corresponding to the note to be pressed by the right hand as shown in FIG. The bass part is moved to the position corresponding to the note to be pressed by the left hand, and the fingering mark m is displayed at the position corresponding to the key k35, k47 to be pressed in the second area 41b, and the key k35 , A beam spot 44 is projected on the surface of k47. Further, a finger image is displayed as a hologram in the third area 41c, and a reproduced stereoscopic image 45 of the finger image is displayed at a corresponding position on the keyboard 2 so that the finger to be used corresponds to the key to be pressed. Thus, the performer can easily visually confirm and understand the correspondence between the note to be played, the key to be pressed, and the finger to be used. Note that the left and right finger images may be displayed in different colors in order to distinguish them from each other. Furthermore, in the finger image, if the finger to be pressed is made different in color from the other fingers and is vibrated up and down on the key to be pressed, it can be recognized very realistically by the player.

  The selection of the guide modes from level 1 to level 5 is selected at the beginning of the performance by the performer, but can be switched even during the performance. Further, it may be configured as a selectable matter that the score display returns to the basic center position when the key is correctly pressed. In addition, when displaying the score in the first area 41a, one bar is displayed in color, the background color changes one after another in parallel with the progress of the notes, and the changed color is the speed of the metronome symbol. By flashing in time, the speed of music can be experienced. In addition, there are multiple notes that are identified and displayed to be pressed, and in the case of chords and polyphony, the correspondence between the displayed identification note and the actual key is the key that corresponds to the identification note most suitable for fingering. You may comprise so that it may stop just above. Furthermore, if you should press the right hand and left hand at the same time, if you press the key corresponding to the note of only the high note, or if you press the key corresponding to the note of the low note only, In such a case, it can be regarded as a mistake, and a note to be pressed next and / or a fingering mark m may not be displayed. Therefore, when the notes of the high notes and the notes of the low notes are to be depressed at the same time, the next progression cannot be made unless the keys are depressed at the same time. Furthermore, when a note with a long note value and a note with a short note are to be pressed simultaneously, the note to be pressed and / or the fingering mark m corresponding to the note is flashed, and a note with a long note value and a short note are displayed. When the keys are pressed at the same time, the fingering mark m corresponding to the note with a long note value and / or the note with a short note value stops flashing and remains lit, and the fingering mark corresponding to the note to be pressed The m may be blinked one after another by pressing the key, and the lighting state of the note may be continued until the length of the note having a long note value is reached. Furthermore, as shown in FIG. 14, the waveform is displayed above (or below) the score display in the first area 41a, the strength of the note is expressed by the amplitude, the height of the note is expressed by the frequency, You may make it represent the length of a note by duration. Then, by displaying the waveform of the note to be pressed now and the waveform of the previous and next note separately according to the line type, color, etc., the strength, height, and length of the note are displayed. Can be understood visually. Although the grand staff is displayed at the center position of the first area 41a, if the grand staff can be displayed at a position independent of the guide display board 4, the display becomes easier to see. For example, it may be displayed independently on an LCD or the like on a piano score stand or displayed on a notebook computer placed on the piano.

  As described above, according to the present embodiment, the dot matrix display unit 41 and the control unit 12 independently display the treble and bass parts of the grand staff at positions corresponding to the keys to be pressed. At the same time, after the player's key depression operation is detected by the key depression detection unit 16, the fingering mark m and the image of the finger can be sequentially displayed for the position of the key to be depressed next by the player. Since these guide displays are projected onto the corresponding keys by the lens plate 42 arranged on the front surface thereof, the performer can perform with the correct fingering method while looking at the keyboard. Furthermore, since the performance state determination unit 17 compares the music performance data detected by the key press detection unit 16 with the corresponding music data stored in the RAM 14, the performance state of the performer can be determined. Without stopping the performance, it is possible to determine at any time whether the musical performance is correct, such as the pitch, sound length, slur, staccato, tenuto, etc. Automatic guidance is possible.

  In the present embodiment, notes and musical scores are displayed in the first area 41a at the top of the dot matrix display unit 41, fingering marks are displayed in the second area 41b, and hand images are displayed in the third area 41c as necessary. Although displayed, the order can be arbitrarily changed, and a note or a score may be displayed in the third area at the bottom. Furthermore, a finger image may be displayed on the integral photography portion of the first area 41a, and a note or a score may be displayed on the hologram display portion of the third area 41c.

  In the present embodiment, a virtual stereoscopic image is displayed in the first area 41a using the three-dimensional display technology. However, as shown in FIG. 15, the first area 41a of the dot matrix display unit 41 is displayed as a normal LCD dot. A score is displayed as a matrix display unit 48, and a lens array 49 having lenses corresponding to the keys of the keyboard 2 is arranged on the front surface of the LCD dot matrix display unit 48 in correspondence with the LCD dot matrix display unit 48. A musical note corresponding to a key to be pressed in the musical score displayed in 48 may be projected as a musical note image 50 on the surface of the key to be pressed. The LCD dot matrix 48 displays the high and low scores of the grand staff, so that the entire lens array 49 is arranged in a two-tier configuration or the center so that both scores can be projected onto the keyboard 2. It has a two-stage structure that is partly divided from left to right. Even in this case, the guide display is not hidden by the fingers of the performer, and even if the guide display is displayed at a position where the guide display is hidden by the performers' fingers, the guide display is not displayed. Therefore, the performer can perform while watching the guide display projected on the fingers. Further, since the corresponding lens element itself of the lens array 49 also shines, the guide display can be confirmed also on the lens element. The lens array 49 is an erecting equal-magnification imaging lens array or the like. Therefore, in any case, the guide display is not hidden by fingers, and by playing while watching the guide display, it is possible to easily perform the performance even for the first music.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. The second embodiment differs from the first embodiment described above in that the dot matrix display section 41 of the guide display board 4 is partitioned into two areas 41a and 41b in the vertical direction as shown in FIG. In the first area 41a, a musical score, a music sign, various messages, and the like are displayed, a fingering mark m is displayed in the second area 41b, and the lens plate 42 arranged in front of the second area 41b It is only provided. Therefore, 41a becomes an LCD dot matrix display unit, and a three-dimensional display is not performed and a two-dimensional display is obtained. Other configurations are the same as those in the first embodiment, including the guide mode for the grand staff displayed in the first area 41a and the fingering mark m displayed in the second area 41b. Therefore, according to the second embodiment, the configuration of the guide display plate 4 is greatly simplified, so that the cost of the apparatus can be greatly reduced.

  In the description of the first embodiment and the second embodiment described above, the fingering mark m displayed in the second area 41b is projected by the monocular lens array 42b on the surface of the corresponding key. Is determined by the position of the first area 41b and the monocular lens array 42b, and the inclination and focal length of each lens element of the monocular lens array 42b. For this reason, the projection position can be adjusted by constructing the monocular lens array 42 independently from the other parts and attaching it so that it can tilt in the front-rear direction with the rotation shafts provided at the center part or both sides of the lower part as fulcrums. You may do it. Further, a fingering mark may be projected on the entire surface of the corresponding key according to the focal length and the inclination angle of the monocular lens array 42b. Further, as an initial setting, the fingering mark may indicate a high-pitched sound key at the center of the keyboard 2 when the performance guide device is turned on.

  In each of the above embodiments, the liquid crystal device is used as the display unit. However, the dot matrix display unit 41 may be configured by a light emitting diode, an organic EL, a semiconductor laser, plasma, or the like. Furthermore, a pinhole can be used as the projection means. As for the LCD, a transmissive LCD, a reflective LCD, a backlight LCD, or a combination thereof is appropriately used depending on the usage situation of each area.

The schematic perspective view which shows the state which attached the performance guide apparatus in embodiment of this invention to the piano. FIG. 3 is a schematic side view showing the structure of the guide display plate in the first embodiment. FIG. 3 is a schematic diagram illustrating the principle of a three-dimensional display in the first embodiment. FIG. 3 is a schematic perspective view showing display by a three-dimensional display in the first embodiment. FIG. 3 is a schematic perspective view showing a display example of fingering marks in the first embodiment. FIG. 6 is a schematic perspective view showing another display example of fingering marks in the first embodiment. FIG. 3 is a schematic diagram showing the principle of a hologram display in the first embodiment. FIG. 3 is a schematic perspective view showing a display example by the hologram display in the first embodiment. FIG. 2 is a schematic block diagram showing an internal configuration of a performance guide device according to Embodiment 1. FIG. 3 is a schematic perspective view showing a configuration of a key press detection unit in the first embodiment. FIG. 3 is a schematic diagram illustrating a display example in a level 1 guide mode according to the first embodiment. FIG. 6 is a schematic diagram illustrating a display example in a level 3 guide mode according to the first embodiment. Explanatory drawing which shows another display example in the guide mode of the level 3 in Embodiment 1. FIG. Explanatory drawing which shows another example of a display in the level 3 guide mode in Embodiment 1. FIG. FIG. 6 is a schematic diagram showing a display example in the guide modes of levels 4 and 5 in the first embodiment. FIG. 6 is a schematic diagram illustrating another display example of a score in the first embodiment. FIG. 6 is a schematic perspective view showing another display example of a score in the first embodiment. The schematic side view which shows the guide display board in Embodiment 2 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Piano main body 2 Keyboard 3 Performance guide apparatus 4 Guide display board 11 Liquid crystal drive part 12 Control part 13 ROM
14 RAM
15 External Memory 16 Key Press Detection Unit 17 Performance State Determination Unit 18 Operation Input Unit 41 Dot Matrix Display Unit 41a First Area (Musical Note Display)
41b 2nd area (fingering mark display)
41c 3rd area (finger graphic display)

Claims (9)

  Display means that can display the high and low parts of the grand staff of the musical composition that is arranged side by side along the keyboard of the keyboard instrument independently for a predetermined length, and detects the key pressed Based on a signal from the key depression detecting means, the treble part is located at the position of the key to be depressed corresponding to the notes in the treble part music and the bass part music displayed on the display means. A performance guide device comprising control means for displaying a score and a bass part so as to be independently movable.   2. The performance guide device according to claim 1, wherein the display means distinguishes and displays a note corresponding to the key to be depressed in the treble part and / or the bass part from other notes.   2. A performance guide apparatus according to claim 1, wherein the display means has a plurality of display areas partitioned in the vertical direction along the keyboard.   The display means displays the high part and / or low part of the grand staff in one of the plurality of display areas, and corresponds to the position of the key to be pressed in another one of the display areas. 4. A performance guide apparatus according to claim 3, wherein a fingering mark is displayed at a position to be played.   The display means displays the high part and / or low part of the grand staff in one of the plurality of display areas, and corresponds to the position of the key to be pressed in another one of the display areas. 4. The performance guide apparatus according to claim 3, wherein an image of a finger is displayed at a position to be played.   The display means places at least one of a fingering mark and a finger image in the direction of the keyboard at a position corresponding to the position of the key to be depressed, the treble and / or bass part of the grand staff. 6. The performance guide device according to claim 4 or 5, wherein the performance guide device projects toward the screen.   7. The performance guide apparatus according to claim 6, wherein the display means is a two-dimensional display, a three-dimensional display, a hologram display, or a combination thereof.   The control means displays a note corresponding to the pitch at the key depression position obtained by the key depression detection means at a corresponding pitch position in the score displayed on the display means, and 2. The performance guide apparatus according to claim 1, wherein a pitch position is stored.   The performance guide apparatus according to claim 1, wherein the display means, the key press detection means, and the control means are integrally configured and detachable from a keyboard instrument.

Images