JP2006078863A - Musical instrument system and musical instrument used for the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a musical instrument system and a musical instrument used for the system with which timing of a start of a partner's playing and the conditions of the fingers of the partner can be recognized by overcoming the problems that a student cannot recognize when a four-handed performance with a teacher is started on the conventional musical instrument system even though the partner is displayed on a display, cannot recognize accurate timing when a next play is started at a fermata portion that appears in the middle of the performance, and the student cannot accurately recognize and imitate the state of the teacher's fingers when the piano teacher tries to teach him/her one of the techniques of "crossing hands". <P>SOLUTION: In the musical instrument which is used for a musical instrument system that is used for a four-handed performance between two musical instruments having keyboards located at remote places, a display is arranged in front of the keyboard to display the hands that are placed on the partner's keyboard and are transmitted from the partner's musical instrument. The musical instruments are used to constitute the musical instrument system. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a musical instrument system that can be used with a piano in different places such as a remote place and a musical instrument used therefor.

In recent years, a system that allows one-on-one piano lessons of talented piano teachers in remote locations has been developed, and remote lessons are being implemented. For example, as disclosed in Japanese Patent Application Laid-Open No. 2002-91291, two automatic performance piano systems are provided at a distance from each other, each of which includes a camera, a microphone, a display, and a speaker. It is known that the sound taken by the microphone can be sent to the other party via the communication line so that the state of the other party playing the piano can be visually observed on the display and the other party's performance can be heard. It has been. This instrument system allows teachers at remote locations to take lessons at home.
JP 2002-91291 A

  However, in the above-mentioned conventional musical instrument system, when you try to shoot with a teacher, even though the opponent is shown on the display, when do you start playing or at the timing of the Fermata part that appears in the middle of the performance? I can't figure out exactly what will happen next. In addition, when a piano teacher teaches a student to “pick a finger”, which is one technique of performance, it is difficult for the student to accurately recognize and imitate the state of the teacher's finger.

  An object of the present invention is to solve the above problems and to provide a musical instrument system capable of recognizing the start timing of the opponent's performance and the state of the opponent's finger and a musical instrument used therefor.

  The musical instrument system according to the present invention is a musical instrument system for performing repetitive bullets and the like by exchanging signals via a communication line between a first musical instrument having a keyboard and a second musical instrument having a keyboard. In this example, a transmitter for transmitting the performance signal of the first musical instrument to the second musical instrument, the performance signal transmitted from the second musical instrument, and the player's hand placed on the keyboard of the second musical instrument are imaged. A second instrument, comprising: a receiver that receives a video signal; a speaker that emits a performance signal received by the receiver; and a display that displays a video of the player's hand received by the receiver. Includes a camera that produces the video signal, a transmitter that transmits the performance signal of the second instrument and the video signal to the first instrument, and the display is located near the keyboard of the first instrument. It is characterized by being placed in front of the player.

The second musical instrument further includes a receiver that receives the performance signal transmitted from the first musical instrument, and a speaker that emits the performance signal received by the receiver. To do.
The first musical instrument is further provided with a camera that captures the player's hand placed on the keyboard of the first musical instrument, and means for transmitting the video signal captured by the camera is transmitted by the first musical instrument. The second musical instrument is provided with receiving means for receiving the video signal sent from the first musical instrument in the receiver of the second musical instrument, and the video signal received by the receiver is received by the second musical instrument. It is characterized by providing a display for projection.

Further, the musical instrument of the present invention is a musical instrument having a keyboard used in a musical instrument system for performing a bullet or the like with a musical instrument having a keyboard at a remote location, and is a partner player sent from the counterpart's instrument A display for displaying the hand placed on the keyboard is arranged in front of the player in the vicinity of the keyboard.
Further, the player's hand placed on the keyboard of his / her musical instrument is projected on the display together with the opponent's player's hand.

  Further, the second instrument player's hand projected on the display is a mirror image reversal image similar to a mirror image reversal of the first instrument player's hand.

  According to the musical instrument system of the present invention and the musical instrument used therefor, by visually confirming the slight movement start of the hand placed on the keyboard of the opponent player displayed on the display provided on the instrument, simultaneously with the opponent player You can start playing by touching the keyboard, which is effective when you want to play a series. In addition, when the opponent player is a piano teacher, the state of the keyboard operation of the teacher can be confirmed in front of the eyes, so that a more reliable lesson can be taken while being in a remote place. Also, if you show your hand on the display with the teacher's hand, you can compare the two and make a more effective lesson. Further, if a display is provided for both musical instruments to be played, it is possible to perform while confirming the state of the opponent's hand with each other, and it is possible to perform a more favorable bullet.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a perspective view of a grand piano used in a musical instrument system according to an embodiment of the present invention. The piano 1 has been sent with two cameras 3 and 3a for imaging a finger on the keyboard 2, a microphone 4 for capturing the voice of the player, and a recording microphone 4a for recording the performance sound of the piano. A speaker 5 that emits the performance sound (musical tone) of the opponent and the voice of the opponent player, a display 6 that reflects the hand being played and the hand of the opponent that has been sent, a transmitter 8 and a receiver 9 are provided. It has been. These are added to the piano body and are called piano 1. The musical tone signal of the piano and the player's voice signal are collectively referred to as a sound signal.

  The cameras 3 and 3a, the microphones 4 and 4a, and the speaker 5 are commercially available. The display 6 is embedded with a recess provided on the back side of a freely openable lid 7 that covers the keyboard 2 of the piano 1. Accordingly, since a thin display 6 is required, a liquid crystal display is optimal. The display 6 is an elongated display that covers almost the entire keyboard. It is not always necessary to cover the entire keyboard. This display needs to be specially made, but it can be implemented sufficiently according to the current state of the art. Moreover, you may use the thing currently used for a small-sized liquid crystal television side by side. In this case, the image may be divided and projected on several liquid crystals so that the entire image becomes one image.

Further, the display 6 is provided on the lid 7 of the keyboard 2 of the piano 1. However, in the case of a grand piano, the lid 7 stands perpendicular to the surface of the keyboard 2 and is convenient for the player to view. What is necessary is just to arrange | position in front of 2. That is, what is necessary is just to arrange | position ahead seeing from a player in the vicinity of the keyboard 2 of the piano 1. FIG.
The transmitter 8 and the receiver 9 may be those generally used. The transmitter is a means for processing the sound signal, and processes the video signals of the cameras 3 and 3a and transmits them together with the sound signal. A transmission means is provided. The receiver 9 is provided with means for receiving and processing the sent audio signals and video signals.

FIG. 2 shows that the players A and B try to use the two pianos 1 and 1B at different locations (the piano 1B number is described by adding B to the piano 1 number). It shows the state to do. The piano 1B has the same structure as the piano 1. The operation will be described later.
FIG. 3 is a block diagram showing signal exchange in the case of FIG. The video signals picked up by the cameras 3 and 3a are sent out from the transmitter 8 together with the sound signals captured by the microphones 4 and 4a, and received by the player B via the communication line (video phone line or broadband network) 10. It is received by the machine 9B, projected as an image on the display 6B of the piano 1B, and emitted from the speaker 5B.

  As shown in FIG. 2, since the video of the hand sent from the player B side is a mirror-inverted video similar to the video in which the player A's hand is mirror-inverted, the video imaged by the two cameras 3B and 3aB Image processing is performed to obtain a mirror image inversion image. That is, a three-dimensional image of a hand is created from video signals projected by two cameras, the three-dimensional image is cut out from a desired angle, and a mirror image inverted image shown in FIG. The cameras 3B and 3aB are preferably wide-angle cameras. If a precise hand image is not required, it can be implemented with a single camera.

Signals are exchanged in the same manner from the player B side to the player A side, so that signals can be transmitted and received simultaneously. In addition, the video signal of the transmitter 8 is added to the receiver 9 of his / her own and displayed on the display 6 of his / her piano 1.
Audio delay is a problem when using two pianos at remote locations to play a series. In addition, when audio is transmitted together with video, it is necessary that the video be transmitted without delay as with audio. NTT has started a service for high-definition videophones using optical fibers. The communication speed is 6 megabits per second, and there is no video / audio delay unlike conventional videophones. That is, if the communication speed is 6 megabits per second, humans cannot perceive the video and audio delay caused by this. NTT East has also released a remote piano lesson experiment using IP videophone. According to this, “Interactively confirming the movement of the teacher on the screen by interactively exchanging the video of the camera connected to the computer, the sound from the microphone, and the piano sound source, take a lesson while talking with the teacher. Emphasized that the voice can be transmitted without delay, so it is possible to shoot with a distant teacher ... "and according to current technology, it is possible to use two pianos at remote locations. It is.

  Referring to FIG. 2, the case of a continuous shot will be described. When player B puts his hand on keyboard 2B of piano 1B to start playing, the state is imaged by camera 3B, and the state is piano of player A. 1 is displayed on the display 6. The finger at this time is set so that the fingertip is down. If the player A reads on the display 6 this finger movement, particularly the slight movement of the hand when he wants to play the piano 1B, the player can press the keyboard 2 at the same time as the player B to start a continuous shot. Also, the player A can enter the performance without delay by reading the slight movement of the player B's hand at the timing of the player B entering the next performance at the place of Fermata in the middle of the performance.

  Further, even when the keyboard 2 is not pressed, the information that the hand is placed on the keyboard 2 is transmitted to the opponent, so that the conversation with the opponent during the round is smooth. Putting your hand on the keyboard 2 indicates the initiative of conversation and instrumental performance. For example, perform “instrumental performance (a little playing)” before, after, or at the same time as “This is smoother (♪♪♪)”. Note that the instrumental performance is a piano teacher that lets students listen to a sample of one or two phrases, for example, the beginning of Beethoven's 9th chorus “Mi, Mi, Fa , Seo, Seo, Fa, Mi, Les, De, De, Les, Mi, Mi, Les, Les ”

In the case of memorization, players often play the piano while looking at their own hands and keyboards, but some players perform while looking at their hands on the keyboard lid. the hand of player B on the display 6 to accommodate the needs and monitor, keep as Utsushidaseru also hand player a.
In a remote piano lesson, when a piano teacher teaches a student a so-called “finger-finger” technique, the teacher's finger is shown on the display 6 on the student side, which can be easily confirmed. Since his / her finger is also reflected on the display 6, it can be visually checked whether the movement is the same.

Next, another embodiment will be described.
FIG. 4 is a perspective view of a piano 1a used in a musical instrument system according to another embodiment, and FIG. The difference from the piano 1 in FIG. 1 is that the horizontal length of the display 6a is about half. If this length is larger than half, the player B's hand does not have to be hidden. Your hand will be reflected on the mirror surface behind the lid 7 of the piano 1a.

  As shown in FIGS. 6 and 7, a recess 11 of the lid 7 is provided, and rails 12 a and 12 b are formed at the top and bottom of the recess 11 so that the display 6 a can slide in the left-right direction. When the player A plays the first part on the left side of the piano 1 and plays the second part on the right side of the piano 1B in the case of performing a continuous shot, the display shown in FIG. The position is acceptable, but in the opposite case, the display position needs to be moved. In order to cope with such a case, the display 6a can be moved left and right.

  Further, in the case of a grand piano, the lid 7 of the keyboard 2 can be opened at a substantially right angle with the keyboard, so that the display 6 is in an easily viewable position. On the other hand, in the case of an applied piano, the lid 7 is often inclined and stopped with respect to the surface of the keyboard 2 as shown in FIG. In such a case, the display 6 is taken out of the recess so as to be substantially perpendicular to the surface of the keyboard 2. In addition, even if it is not necessarily perpendicular | vertical, as long as the movement of a hand and a finger can be confirmed, you may incline.

Note that the musical instrument can be applied to a musical instrument that is played with a keyboard arranged horizontally such as a grand piano, an applied piano, an electronic piano, an electronic organ, and a keyboard.
In addition, the display 6 may be attached to the entire surface of the lid 7 when the lid 7 is opened, instead of being embedded in the back surface of the lid 7 of the keyboard 2. It is desirable that the position of the player B's keyboard pressed by the finger shown on the display 6 and the player A side are in the same position.

Further, the piano 1 on the player A side and the piano 1B on the player B side do not need to have the same configuration. The piano 1 on the player A side has at least the microphones 4 and 4a, the speaker 5, the transmitter 9 for transmitting sound signals, and the video. It suffices if there is a receiver 8 and a display 6 for receiving signals and sound signals , and the cameras 3 and 3a are not necessary. The player B side piano 1B corresponding to this is only required to have the cameras 3B, 3aB, microphones 4B, 4aB, speaker 5B, transmitter 9B, receiver 8B, and the display 6B is not necessary. This is because when the piano teacher is the player B and the player A is a student, the display 6 should be at the lowest student side. Of course, it is desirable that both are provided.

Of course, the microphones 3 and 3a and the speaker 5 may be used if they are originally provided in the piano body.
In FIG. 1, the two cameras 3 and 3a are installed on the piano body. However, two wide-angle cameras may be embedded at a certain distance on the display 6 of the lid 7 of the piano 1. good. Moreover, as shown in FIG. 9, you may make it attach the cameras 3 and 3a to the inner surface upper part of the lid | cover 7 of the piano 1. As shown in FIG. In FIG. 9, the camera 3a is attached to the upper part inside the lid 7 at a fixed distance from the camera 3, and is not shown.

  Furthermore, when the teacher of the piano unilaterally gives an example to the student, the teacher's piano includes a camera that produces a video signal of the teacher's hand, a performance signal of the teacher's piano, and the video signal. And a transmitter for transmitting to the first musical instrument.

  The musical instrument system of the present invention is particularly useful when a grand piano is used to play a bullet with a remote piano.

It is a perspective view of the piano used for the musical instrument system in one Example of this invention. It is a figure which shows the use condition of the musical instrument system. It is a block diagram which shows the communication state of the musical instrument system. It is a perspective view of the piano used for the musical instrument system in the other embodiment. It is a figure which shows the use condition of the musical instrument system. It is a partial front view which shows the other Example of the same system. It is a longitudinal cross-sectional view of a part of FIG. It is sectional drawing of a part of piano in the other Example. It is sectional drawing of a part of piano in the other Example.

Explanation of symbols

1, 1B: Piano 2: Keyboard 3, 3a, 3B, 3aB: Camera 4, 4a, 4B, 4ab: Microphone 5, 5B: Speaker 6, 6B, 6a: Display 7: Lid 8, 8B: Receiver 9, 9B : Transmitter 10: Video phone line 11: Recess 12a, 12b: Rail

Claims (8)

A musical instrument system that performs repetitive bullets by exchanging signals between a first musical instrument having a keyboard and a second musical instrument having a keyboard via a communication line,
The first musical instrument includes a transmitter that transmits a performance signal of the first musical instrument to the second musical instrument, a performance signal transmitted from the second musical instrument, and a player placed on the keyboard of the second musical instrument. A receiver for receiving a video signal obtained by imaging a hand; a speaker for emitting a performance signal received by the receiver; and a display for displaying a video of the player's hand received by the receiver;
The second musical instrument includes a camera that creates the video signal, and a transmitter that transmits the performance signal of the second musical instrument and the video signal to the first musical instrument,
A musical instrument system, wherein the display is arranged in front of the keyboard of the first musical instrument as viewed from the player.   The second musical instrument further includes a receiver that receives a performance signal transmitted from the first musical instrument, and a speaker that emits the performance signal received by the receiver. Item 1. The musical instrument system according to Item 1.   The first musical instrument is further provided with a camera for imaging a player's hand placed on the keyboard of the first musical instrument, and means for transmitting a video signal captured by the camera is provided to the transmitter of the first musical instrument. The second musical instrument is further provided with a receiving means for receiving the video signal sent from the first musical instrument in the receiver of the second musical instrument, and the video signal received by the receiver is displayed. The musical instrument system according to claim 1, further comprising a display that performs the operation.   2. The musical instrument system according to claim 1, wherein the player's hand placed on the keyboard of his / her musical instrument is displayed on the display together with the opponent's player's hand.   5. The musical instrument system according to claim 4, wherein the player's hand of the second musical instrument displayed on the display is a mirror image reversal image similar to a mirror image of the player's hand of the first musical instrument. A musical instrument having a keyboard used in a musical instrument system for performing repetitive bullets and the like with a musical instrument having a keyboard at a remote location,
A musical instrument characterized in that a display for displaying a hand placed on the keyboard of the opponent player sent from the opponent's instrument is arranged in front of the player near the keyboard.   7. The musical instrument according to claim 6, wherein the player's hand placed on the keyboard of his / her instrument is displayed on the display together with the opponent's player's hand.   8. The musical instrument system according to claim 7, wherein the opponent player's hand projected on the display is a mirror image reversal image similar to a mirror image reversal of his / her hand.

Images