KR102532810B1 - Remote support apparatus for piano lesson - Google Patents

Abstract

The present invention relates to a remote piano lesson support device, and the remote piano lesson support device 100 according to an embodiment of the present invention includes a plurality of keys arranged between the keyboard auxiliary trees (3, see FIG. 3) on both sides of a piano 1. It includes a photographing unit 10 for photographing the keyboard 5 and the fingers of a player who is fingering, and a display unit 20 for outputting image information photographed by the photographing unit 10.

Description

Remote piano lesson support device {REMOTE SUPPORT APPARATUS FOR PIANO LESSON}

The present invention relates to a remote piano lesson support device, and more particularly, to a device for assisting a teacher and a learner in a remote location to conduct a piano lesson online.

In general, piano lessons are conducted face-to-face. Face-to-face piano lessons have the advantage of being able to form a bond through direct interaction and immediate correction because the teacher and the learner are together in time and space, but there are limitations in space and time, so learning is inevitably limited.

Recently, with the development of information and communication technology (ICT) and digital media, there has been a big change in the education method, and distance education has become possible, breaking away from traditional face-to-face education. Distance education is a non-face-to-face teaching and learning method in which teachers and learners are geographically separated, but exchange learning materials and results while interacting through teaching media. The foundation of this distance education is the instructional medium that learners can use individually. In the field of piano lessons, as disclosed in the following prior art documents, online piano lesson devices through the Internet have been developed to support distance education.

However, conventional online piano lesson devices support only one-way learning, such as providing a score of piano music selected by the user, the position of the keyboard to be played, and the music to be played in real time to a user terminal connected through the Internet. Therefore, there is a problem in that it is not possible to immediately point out and correct the correct fingering and playing posture by checking the shape and posture of the piano player's fingers or wrist.

In addition, an image-based piano lesson that supports video and audio may be considered, but even in this case, only the keyboard video is provided due to the limited angle of view of the camera, so the teacher cannot check the fingering and playing posture of the learner. Unless it is properly constructed, it is difficult to effectively teach and learn because it is impossible to know whether the keys have been accurately struck with only the sound of the piano due to ambient noise or noise.

Accordingly, there is an urgent need for a solution to the problems of the conventional remote piano lesson aids.

KR 10-2002-0016976 A

The present invention is to solve the above-mentioned problems of the prior art, and one aspect of the present invention is to use a camera equipped with a fisheye lens to play piano keys when a teacher and a learner in a remote place conduct a piano lesson online. And to provide a remote piano lesson support device that can check the player's fingers and posture.

Another aspect of the present invention is to provide a remote piano lesson support device capable of assisting correct fingering and pedaling lessons by detecting movements of piano keys or pedals.

A remote piano lesson supporting device according to an embodiment of the present invention includes a photographing unit for photographing a plurality of keys arranged between the keyboard auxiliary trees on both sides of the piano and fingers of a player who is fingering; and a display unit outputting image information captured by the photographing unit.

In addition, in the remote piano lesson support device according to an embodiment of the present invention, the photographing unit includes: a main camera equipped with a fish-eye lens; and a camera cradle for detachably mounting the main camera on the display unit.

In addition, in the remote piano lesson support device according to an embodiment of the present invention, the photographing unit may further include a sub-camera that photographs the shape of the player's fingers and wrist from the side.

In addition, in the remote piano lesson support device according to an embodiment of the present invention, the key detection unit for detecting the movement of the plurality of keys; and a key information output unit that generates key information based on the information sensed by the key sensor, transmits the key information to the display, and outputs the key information.

In addition, in the remote piano lesson support device according to an embodiment of the present invention, the key sensing unit includes a main body disposed upward and spaced apart from the plurality of keys, and having insertion holes at positions facing each of the plurality of keys; supports extending downward from both sides of the main body and mounted on both side keyboard auxiliary necks of the piano; an insertion table having one end contacting the outer surface of the keyboard and the other end being inserted into the insertion hole, and sliding downward when the keyboard is keyed; A contact portion including a first contact point attached to an inner surface of the insertion hole and a second contact point attached to an outer surface of the insertion table, wherein the first contact point and the second contact point contact each other when the insertion table slides downward. ; and a current sensor for sensing a current that is energized when the first contact point and the second contact point are contacted.

In addition, in the remote piano lesson support device according to an embodiment of the present invention, the key information may include a key that has been keyed among the plurality of keys and a key duration of the key that has been keyed.

In addition, in the remote piano lesson support device according to an embodiment of the present invention, the pedaling detection unit for detecting the movement of the plurality of pedals of the piano; and a pedaling information output unit configured to generate pedaling information based on the information detected by the pedaling detection unit, transmit the pedaling information to the display, and output the pedaling information.

In addition, in the remote piano lesson support device according to an embodiment of the present invention, the pedaling detection unit may include a mat disposed downward and spaced apart from the plurality of pedals; and pressure sensors disposed at positions on the mat facing each of the plurality of pedals to measure the pressure applied by the moving pedals.

In addition, in the remote piano lesson support device according to an embodiment of the present invention, the pedaling information may include operated pedals among the plurality of pedals and operation time of the operated pedals.

In addition, in the remote piano lesson support device according to an embodiment of the present invention, a communication module capable of communicating with an external communication device; may further include.

Features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings.

Prior to this, the terms or words used in this specification and claims should not be interpreted in a conventional and dictionary sense, and the inventor may appropriately define the concept of the term in order to explain his or her invention in the best way. It should be interpreted as a meaning and concept consistent with the technical idea of the present invention based on the principle that there is.

According to the present invention, when a teacher and a learner in a remote place conduct a piano lesson online, the piano keyboard and the player's fingers and posture can be checked using a camera equipped with a fish-eye lens, so that the learner's You can correct your playing posture.

In addition, since the movement of the piano keys or pedals is sensed in real time and the teacher and the learner share the performance situation, correct fingering and pedaling lessons can be supported more effectively.

1 is a diagram showing the configuration of a remote piano lesson support device according to a first embodiment of the present invention.
2 is a diagram showing a photographing unit of a remote piano lesson support device according to a second embodiment of the present invention.
3 is a diagram showing the configuration of a remote piano lesson support device according to a third embodiment of the present invention.
FIG. 4 is a front view of the keystroke sensor shown in FIG. 3 .
FIG. 5 is a cross-sectional view taken along line AA' of FIG. 4, and is a diagram illustrating an operating state of the key sensor.
6 is a diagram showing the configuration of a remote piano lesson support device according to a fourth embodiment of the present invention.
FIG. 7 is a side view illustrating an operating state of the pedaling detection unit shown in FIG. 6 .

Objects, specific advantages and novel features of the present invention will become more apparent from the following detailed description and preferred embodiments taken in conjunction with the accompanying drawings. In adding reference numerals to components of each drawing in this specification, it should be noted that the same components have the same numbers as much as possible, even if they are displayed on different drawings. In addition, terms such as “first” and “second” are used to distinguish one component from another component, and the components are not limited by the terms. Hereinafter, in describing the present invention, detailed descriptions of related known technologies that may unnecessarily obscure the subject matter of the present invention will be omitted.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram showing the configuration of a remote piano lesson support device according to a first embodiment of the present invention.

As shown in FIG. 1, the remote piano lesson support device 100 according to the first embodiment of the present invention has a plurality of keys ( 5), and a photographing unit 10 for photographing the fingers of a player who is fingering, and a display unit 20 for outputting image information photographed by the photographing unit 10.

The present invention relates to an apparatus for assisting a teacher and a learner in a remote location to conduct a piano lesson online. Recently, technology to support online piano lessons has been developed, but there is a problem in that it is not possible to immediately point out and correct the correct fingering and playing posture by checking the shape of the piano player's fingers, wrist, posture, etc. As a solution to the problem, the present invention has been devised.

Specifically, the remote piano lesson supporting device 100 according to the first embodiment of the present invention includes a photographing unit 10 and a display unit 20 .

The photographing unit 10 is a video device that photographs the piano 1 and the player in real time. The piano 1 is composed of a piano body, a plurality of keys 5 composed of white and black keys, pedals 6, etc., and the plurality of keys 5 are arranged on both sides of the keyboard auxiliary woods 3, See Figure 3) is arranged between. Here, the photographing unit 10 can photograph the plurality of keys 5 and the player's fingers fingering on the keys 5 . In addition, the performer's upper body can also be photographed at the same time. The photographing unit 10 may include at least one or more cameras. Therefore, one camera can take pictures of the keyboard 5, the player's fingers, the player's upper body, etc., or a plurality of cameras can separately take pictures of the keyboard 5, the player's fingers, the player's upper body, etc. A specific configuration of the photographing unit 10 will be described later.

The display unit 20 is an image output device and visually outputs image information photographed by the photographing unit 10 . Here, the display unit 20 may output not only video information but also audio information. A computing device is built into the display unit 20 to receive image information from the photographing unit 10, process the information, and output the image information.

In addition, the remote piano lesson support device 100 according to the first embodiment of the present invention may further include a communication module 70. The communication module 70 provides an interface enabling communication with an external communication device through wired or wireless communication. Accordingly, the remote piano lesson support device 100 according to the present invention can exchange data with an external communication device.

Here, the external communication device communicating with the remote piano lesson supporting device 100 according to the present invention may be another remote piano lesson supporting device 100 . In this case, the learner and the teacher each possess the remote piano lesson support devices 100a and 100b according to the present invention, and the learner is able to play the piano 1 through the first remote piano lesson support device 100a owned by the learner. ) is recorded (keyboard, fingers, posture, etc.), and the instructor plays (keyboard, fingers, posture, etc.) through the second remote piano lesson support device 100b owned by the teacher. , By transmitting and receiving each image information through the communication module 70 and sharing the image information through the display unit 20, the piano lesson can be conducted. At this time, the instructor can check the performance of the learner, point out the playing posture such as fingering that has a problem immediately, and shoot the correct playing posture and present it in real time, through interactive teaching and learning. can be corrected in real time.

Here, the display unit 20 and the communication module 70 may be implemented as separate devices and combined, or may be integrated in the form of a communication terminal such as a tablet PC or a smart device.

Meanwhile, in one embodiment, the photographing unit 10 may include a main camera 11 and a camera cradle 13 . Here, a fish-eye lens 11a may be mounted on the main camera 11 . The fish-eye lens 11a is a lens having an angle of view of 180° or more, and can simultaneously photograph the keyboard 5 as well as the body of the piano player. Accordingly, image information such as the player's fingers, posture, and keyboard 5 can be generated through the main camera 11 equipped with the fish-eye lens 11a. The main camera 11 may be detachably mounted on the display unit 20 by the camera cradle 13 . The camera cradle 13 may be implemented with a bracket formed in a “c” shape by connecting one side of the upper and lower plates facing each other, and a fixing means that penetrates the lower plate and is inserted into the inside. Here, the main camera 11 is attached to the upper plate of the bracket, one end of the display unit 20 is inserted into the other open side of the bracket, and the fixing means is locked and adhered to the rear surface of the display unit 20, The main camera 11 may be mounted on the display unit 20 . However, the camera holder 13 does not necessarily have to be implemented as the bracket and fixing means, and there is no particular limitation as long as the main camera 11 can be detachably mounted on the display unit 20.

2 is a diagram showing a photographing unit of a remote piano lesson support device according to a second embodiment of the present invention.

Referring to FIG. 2 , the photographing unit 10 of the remote piano lesson support device according to the second embodiment of the present invention may further include a sub camera 15 . In the case of playing the piano 1, the player's fingers should be bent so as to be able to hit the keys 5 with their tips, and the wrist should not move too much. Therefore, in piano lessons, the shape of the learner's fingers and wrists are subject to correction. Here, the sub camera 15 is a camera provided to take pictures of the player's finger and wrist shape from the side. Since image information photographed by the sub-camera 15 is also output through the display unit 20, the player's finger and wrist posture information provided in real time can be used for piano lessons.

Meanwhile, image information captured by the photographing unit 10, that is, images of the keyboard 5, the player's fingers, posture, and the like, may be divided into each other and simultaneously output on the display unit 20.

FIG. 3 is a diagram showing the configuration of a remote piano lesson support device according to a third embodiment of the present invention, FIG. 4 is a front view of the key sensor shown in FIG. 3, and FIG. 5 is a cross-sectional view taken along line A-A' in FIG. , which describes the operating state of the keystroke sensing unit.

As shown in FIGS. 3 to 5 , the remote piano lesson supporting device according to the third embodiment of the present invention may further include a key detection unit 30 and a key information output unit 40 .

The key detection unit 30 senses the movement of the plurality of keys 5 . When a player plays the piano 1, a specific key 5 is keyed according to sheet music, and at this time, the key detecting unit 30 detects the key 5 keyed.

The keystroke sensor 30 may include a body 31 , a support 35 , an insertion stand 32 , a contact unit 33 , and a current sensor 34 . Here, the main body 31 is a member that is spaced apart from the plurality of keys 5 and disposed upward, and has insertion holes 31a formed at positions facing each of the plurality of keys 5 . Insertion holes 31a are holes formed on one surface facing the keyboard 5, and are provided as many as the number of the keyboard 5 to correspond to the keyboard 5 on a one-to-one basis.

The support 35 is a member for fixing the main body 31, and extends downward from both sides of the main body 31, respectively. Each of the extended supports 35 is mounted on the keyboard auxiliary timbers 3 on both sides of the piano 1, and the main body 31 can be fixed to be spaced apart from the upper side of the keyboard 5.

The insertion table 32 is a member that is inserted one by one into each insertion hole 31a. Accordingly, the keyboard 5, the insertion hole 31a, and the insertion table 32 correspond to each other on a one-to-one basis. Here, one end of the insertion stand 32 is exposed to the outside and contacts the outer surface of the corresponding key 5, and the other end of the opposite side is inserted into the insertion hole 31a, and the corresponding key 5 is keyed downward. When inclined to , the insertion table 32 slides downward by gravity. In addition, when a finger falls off a key 5 that has been keyed and the key 5 is finished, the key 5 returns to its original position and the insertion table 32 slides upward.

The contact portion 33 includes a first contact point 33a and a second contact point 33b. The first contact point 33a is attached to the inner surface of the insertion hole 31a, and the second contact point 33b is the insertion stand. It is attached to the outer surface of (32). The first contact point 33a and the second contact point 33b are spaced apart from each other when the key 5 corresponding to the insertion stand 32 is not keyed (see the left side of FIG. 5), and the key 5 ) are keyed to contact each other when the insertion table 32 slides downward (see the right side of FIG. 5). Here, the first contact point 33a and the second contact point 33b constitute an electric circuit connected to the power source PS. Therefore, current does not flow as an open circuit while the first contact point 33a and the second contact point 33b are spaced apart, and current as a short circuit when the first contact point 33a and the second contact point 33b are in contact with each other. will flow

The current detector 34 senses current flowing through a circuit formed by the first contact point 33a and the second contact point 33b. Electric circuits including the first contact point 33a, the second contact point 33b, and the current sensor 34 may be provided as many as the number of keys 5 to correspond to the keyboard 5 one-to-one. Accordingly, it is possible to determine which key 5 among the plurality of keys 5 has been struck by sensing the current flowing through the individual electric circuits.

Meanwhile, the key information output unit 40, as a computing device, generates key information based on the information sensed by the key sensor 30. Here, the key information may include the key 5 that has been keyed among the plurality of keys 5 and the key timing of the key 5 that has been keyed. Since the key sensing unit 30 senses the movement of the key 5, based on the information, the key information output unit 40 can discriminate which key 5 has been pressed from among the plurality of keys 5. can That is, it is determined which key 5 has been pressed through the current sensed by the electric circuit that senses the movement of each key 5 . In addition, information on the time when the electric circuit corresponding to the key 5 is energized is received from the key sensing unit 30, and the energization time is converted into a key time to generate key information. The key information output unit 40 that has generated the key information in this way can transmit the key information to the display unit 20 to output it. Therefore, the teacher can visually check whether the learner has played the keyboard 5 for the required time.

6 is a diagram showing the configuration of a remote piano lesson support device according to a fourth embodiment of the present invention, and FIG. 7 is a side view illustrating an operating state of the pedaling detection unit shown in FIG. 6 .

Referring to FIGS. 6 and 7 , the remote piano lesson support device according to the fourth embodiment of the present invention may further include a pedaling detection unit 50 and a pedaling information output unit 60 .

In piano playing, since pedaling is as important as fingering, the pedaling detection unit 50 and the pedaling information output unit 60 detect the player's pedaling and implement it as visual information.

Here, the pedaling detection unit 50 senses the movement of the plurality of pedals 6 provided in the piano 1. For example, the pedaling detection unit 50 may include a mat 51 and a pressure sensor 53 .

The mat 51 is a plate-shaped member that is spaced apart from the plurality of pedals 6 and disposed downward.

The pressure sensor 53 is a sensor that measures pressure, converts the result into an electrical signal, and outputs the result. A plurality of pressure sensors 53 are disposed on the mat 51 so as to face one to one with each of the plurality of pedals 6 . Therefore, when the player steps on one of the pedals 6, the pedal 6 moves and presses one of the pressure sensors 53, and the corresponding pressure sensor 53 measures the pressure.

Meanwhile, the pedaling information output unit 60 may generate pedaling information based on the information detected by the pedaling detection unit 50 . Here, the pedaling information may include an actuated pedal 6 of the plurality of pedals 6 and an operating time of the actuated pedal 6 . In addition, the pedaling information may further include an applied force to the pedal 6 actuated. Since the pedaling detection unit 50 detects the movement of the pedal 6, based on the information, the pedaling information output unit 60 can distinguish which of the plurality of pedals 6 is operated. can That is, it is possible to determine which pedal 6 has been operated by sensing the pressure of each pressure sensor 53 that measures the pressure of each pedal 6 . In addition, the operation time of the corresponding pedal 6 may be calculated by receiving information about the time when pressure was applied from the pedaling detection unit 50 . Furthermore, from the pressure signal applied to the pedal 6, it is possible to discriminate how much force the player has stepped on the pedal 6. Here, the intensity applied to the pedal 6 does not necessarily have to be converted into an absolute value, and it is irrelevant even if it is distinguished by its relative value, such as high, medium, or low. The pedaling information output unit 60 that has generated the pedaling information in this way may transmit the pedaling information to the display unit 20 to output the pedaling information. Therefore, the teacher can visually confirm whether the learner has operated the corresponding pedal 6 with the required intensity and time to match the sheet music.

Overall, according to the present invention, when a teacher and a learner in a remote place conduct a piano lesson online, the piano keys and the player's fingers and posture can be checked using a camera equipped with a fish-eye lens, so that they can immediately It is possible to correct the performance posture of the learner. In addition, since the movement of the piano keys or pedals is sensed in real time and the teacher and the learner share the performance situation, correct fingering and pedaling lessons can be supported more effectively.

Although the present invention has been described in detail through specific examples, this is for explaining the present invention in detail, the present invention is not limited thereto, and within the technical spirit of the present invention, by those skilled in the art It is clear that modifications and improvements are possible.

All simple modifications or changes of the present invention belong to the scope of the present invention, and the specific protection scope of the present invention will be clarified by the appended claims.

1: piano 3: keyboard auxiliary tree
5: keyboard 6: pedal
10: shooting unit 11: main camera
11a: fisheye lens 13: camera holder
15: sub camera 20: display unit
30: keystroke sensor 31: main body
31a: insertion hole 32: insertion stand
33: contact part 33a: first contact
33b: second contact 34: current sensor
35: support 40: key information output unit
50: pedaling detection unit 51: mat
53: pressure sensor 60: pedaling information output unit
70: communication module 100: remote piano lesson support device

Claims (10)

a photographing unit for photographing a plurality of keys arranged between the keyboard auxiliary necks on both sides of the piano and fingers of a player who finger them; and
Including; a display unit for outputting image information captured by the photographing unit;
a key sensing unit that senses movement of the plurality of keys; and
and a key information output unit generating key information based on the information sensed by the key sensing unit and transmitting and outputting the key information to the display.
The keystroke sensor,
a body spaced apart from the plurality of keyboards and disposed upward, and having insertion holes formed at positions facing each of the plurality of keyboards;
supports extending downward from both sides of the main body and mounted on both side keyboard auxiliary necks of the piano;
an insertion table having one end contacting the outer surface of the keyboard and the other end being inserted into the insertion hole, and sliding downward when the keyboard is keyed;
A contact portion including a first contact point attached to an inner surface of the insertion hole and a second contact point attached to an outer surface of the insertion table, wherein the first contact point and the second contact point contact each other when the insertion table slides downward. ; and
A remote piano lesson support device comprising: a current sensor for sensing a current energized by contacting the first contact point and the second contact point.
The method of claim 1,
the filming unit,
Main camera with fisheye lens; and
A remote piano lesson support device including a camera cradle for detachably mounting the main camera on the display unit.
The method of claim 2,
the filming unit,
The remote piano lesson support device further comprising a sub-camera that photographs the shape of the player's fingers and wrists from the side.
delete delete The method of claim 1,
The key information,
A remote piano lesson support device comprising a key that has been struck among the plurality of keys and a key duration of the key that has been struck.
The method of claim 1,
a pedaling detection unit for detecting movements of a plurality of pedals of the piano; and
The remote piano lesson support device further comprising: a pedaling information output unit generating pedaling information based on the information detected by the pedaling detection unit, and transmitting and outputting the pedaling information to the display.
The method of claim 7,
The pedaling detection unit,
A mat spaced apart from the plurality of pedals and disposed downward; and
A remote piano lesson support device including a pressure sensor disposed at a position on the mat facing each of the plurality of pedals to measure the pressure applied by the moving pedal.
The method of claim 7,
The pedaling information,
A remote piano lesson support device including an actuated pedal among the plurality of pedals and an operating time of the actuated pedal.
The method of claim 1,
A remote piano lesson support device further comprising a communication module capable of communicating with an external communication device.

Images