CN215495466U

CN215495466U - Gesture recognition device and piano teaching integrated system

Info

Publication number: CN215495466U
Application number: CN202122019827.5U
Authority: CN
Inventors: 唐昌辉; 苏晓
Original assignee: Guilin Zhishen Information Technology Co Ltd
Current assignee: Guilin Zhishen Information Technology Co Ltd
Priority date: 2021-08-25
Filing date: 2021-08-25
Publication date: 2022-01-11
Anticipated expiration: 2031-08-25

Abstract

The utility model belongs to the technical field of piano teaching, and provides a gesture recognition device and a piano teaching integrated system, wherein the gesture recognition device comprises a display, a lens and a processing device, the display is provided with a display area, the lens is arranged on the side part of the display area, and the processing device is communicated with the display and the lens; the piano teaching integrated system comprises the gesture recognition device. According to the gesture recognition device and the piano teaching integrated system provided by the utility model, the video information containing the gesture is acquired through the lens, the image is processed by matching with the processing device, the processed gesture information is displayed on the display in a partition mode, namely the processed gesture information is fed back to the user through the display, and the compared gesture information is displayed in a partition mode, so that the user can be taught, the technical problem that the user cannot improve the training level of the user without knowing the error point of the user in the independent exercise process is solved, and the structure is simple.

Description

Gesture recognition device and piano teaching integrated system

Technical Field

The utility model belongs to the technical field of piano teaching, and particularly relates to a gesture recognition device and a piano teaching integrated system.

Background

The correct piano hand shape is an important part of piano practice, and in piano learning, novice trainees often face many problems, such as: the problems of wrong hand posture, wrong rhythm playing, wrong key playing and the like during playing the piano are solved.

At present, in the piano training education process, the finger shape of a beginner is difficult to keep a correct posture, especially, the finger tail joint of a student with a small age is difficult to stand up, a bad piano playing habit is developed in the past for a long time, therefore, the teacher is required to constantly remind, and the teacher supervises to correct the error. Therefore, when the user exercises alone, a teaching device capable of recognizing and correcting the gestures is needed to improve the training level of the user.

SUMMERY OF THE UTILITY MODEL

The embodiment of the utility model aims to provide a gesture recognition device and a piano teaching integrated system, and aims to solve the technical problems that an existing user does not know own error point and cannot improve own training level in a separate exercise process.

In order to achieve the purpose, the utility model adopts the technical scheme that: provided is a gesture recognition apparatus including:

a display connected to the piano, the display having a display area;

a lens disposed at a side of the display area; and

and the processing device is in communication connection with the display and the lens.

Optionally, the lens is disposed on the display, the display has a mounting area, the mounting area is located at a side of the display area, and the lens is disposed in the mounting area; or,

the lens is arranged to avoid the display and is positioned at the side part of the display.

Optionally, the lens comprises at least two first lens portions and a second lens portion;

when the lens is mounted on the display, the mounting area comprises at least two first area parts and a second area part, the second area part is positioned between two adjacent first area parts, the first lens part is arranged in the first area parts, and the second lens part is arranged in the second area parts;

when the lens avoids the display, at least two first lens parts are arranged on two sides of the display, and the second lens part is arranged on one side of the display, which is adjacent to the first lens part.

Optionally, the first lens portion is a normal lens, and the second lens portion is a wide-angle lens.

Optionally, when the lens is mounted on the display, the gesture recognition apparatus further includes:

the first angle adjusting mechanism is connected with the first lens part and the display and is used for adjusting the angle of the first lens part; and

the second angle adjusting mechanism is connected with the second lens part and the display and is used for adjusting the angle of the second lens part;

when the lens is set to avoid the display, the gesture recognition apparatus further includes:

the mounting plate is connected with the piano, and the display and the lens are arranged on the mounting plate;

the first angle adjusting mechanism is connected with the first lens part and the mounting plate and is used for adjusting the angle of the first lens part; and

and the second angle adjusting mechanism is connected with the second lens part and the mounting plate and used for adjusting the angle of the second lens part.

Optionally, the first lens part has a pitch angle of 30 ° to 60 °, and the second lens part has a pitch angle of 30 ° to 60 °.

Optionally, when the lens is disposed on a display, the first angle adjustment mechanism includes:

the first rotary driving part is arranged on one side of the display, which is far away from the first lens part, and is fixedly connected with the display, and a rotating shaft of the first rotary driving part is in driving connection with the first lens part;

the second angle adjusting mechanism includes:

the second rotary driving piece is arranged on one side of the display, which is far away from the second lens part, and is fixedly connected with the display, and a rotating shaft of the second rotary driving piece is in driving connection with the second lens part;

when the camera lens set up in when on the mounting panel, first angle adjustment mechanism includes:

the first rotary driving part is arranged on one side of the mounting plate, which is far away from the first lens part, and is fixedly connected with the mounting plate, and a rotating shaft of the first rotary driving part is in driving connection with the first lens part;

the second angle adjusting mechanism includes:

second rotary driving piece, set up in deviating from of mounting panel one side of second camera lens portion, and with mounting panel fixed connection, second rotary driving piece's rotation axis with second camera lens portion drive connection.

Optionally, the distance between the first lens portion and a key of a piano is 15-25 cm.

Optionally, when the lens is mounted on the display, a sliding groove is formed in the display, the sliding groove is arranged corresponding to the mounting area and extends along a first direction, and the first lens portion is slidably connected in the sliding groove;

when the camera lens set up in when on the mounting panel, the spout has been seted up on the mounting panel, the spout extends along first direction, sliding connection has first camera lens portion in the spout.

the linear transmission mechanism is arranged on one side of the display, which is far away from the first lens part, and is connected with the first lens part and used for driving the first lens part to reciprocate along the sliding groove;

when the lens set up in on the mounting panel, gesture recognition device still includes:

the linear transmission mechanism is arranged on one side of the first lens part, deviating from the mounting plate, and is connected with the first lens part and used for driving the first lens part to move along the sliding groove in a reciprocating manner.

Optionally, when the lens is disposed on the display, the linear transmission mechanism includes:

the guide rail is arranged on one side of the display, which is far away from the first lens part, is connected with the display and is arranged in parallel with the sliding groove at intervals; and

the sliding block is connected with the guide rail in a sliding mode and is connected with the first lens part;

when the camera lens set up in when on the mounting panel, linear drive mechanism includes:

the guide rail is arranged on one side of the mounting plate, which is far away from the first lens part, is connected with the mounting plate and is arranged in parallel with the sliding groove at intervals; and

the sliding block is connected with the guide rail in a sliding mode and connected with the first lens portion.

The utility model also provides a piano teaching integrated system which comprises a piano and the gesture recognition device, wherein the display is detachably connected with the piano.

The gesture recognition device and the piano teaching integrated system provided by the utility model have the beneficial effects that: obtain the video information who contains the gesture through the camera lens, cooperation and cooperation processing apparatus handle the image and show the gesture information subregion after handling on the display, feed back to the user through the display promptly, show the gesture information subregion of contrast to can impart knowledge to students to the user, solve the user and do not know the technical problem that the error point of oneself can't improve the training level of oneself alone in the exercise process, simple structure.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1 is a first schematic view of a gesture recognition apparatus according to an embodiment of the present invention;

fig. 2 is an exploded view of a gesture recognition apparatus according to an embodiment of the present invention;

fig. 3 is a schematic rear view of a gesture recognition apparatus according to an embodiment of the present invention;

FIG. 4 is a schematic cross-sectional view taken along line A-A of FIG. 3;

FIG. 5 is a schematic diagram of a second schematic view of a gesture recognition apparatus according to an embodiment of the present invention;

fig. 6 is a schematic cross-sectional view taken along line B-B in fig. 5.

Wherein, in the figures, the respective reference numerals:

1-a display; 11-a display area; 12-a mounting area; 121-a first area portion; 122-a second area portion; 13-mounting grooves; 14-a chute;

2-a lens; 21-a first lens portion; 211-a mounting portion; 212-a first body portion; 22-a second lens portion; 221-a plate body portion; 222-a second body portion;

3-a linear transmission mechanism; 31-a guide rail; 32-a slide block;

4-a first angle adjustment mechanism;

5-a second angle adjustment mechanism;

6-mounting the column.

Detailed Description

In order to make the technical problems, technical solutions and advantageous effects to be solved by the present invention more clearly apparent, the present invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the utility model and are not intended to limit the utility model.

It will be understood that when an element is referred to as being "secured to" or "disposed on" another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element.

It will be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like, as used herein, refer to an orientation or positional relationship indicated in the drawings, which is solely for the purpose of facilitating the description and simplifying the description, and do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and is therefore not to be construed as limiting the utility model.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.

Referring to fig. 1 and fig. 2 together, a description will now be given of a gesture recognition apparatus according to an embodiment of the present invention. The gesture recognition device is mainly used for piano teaching,

specifically, the gesture recognition apparatus includes a display 1 connected to a piano, a lens 2, and a processing device. Wherein, display 1 passes through locking mechanism to be fixed on the piano, and this locking mechanism can be the cooperation of nut and screw rod, also can be spring clip to make the plane at display 1 place and the plane at the last door plant place of piano parallel, and do not have and control the slope, guaranteed that the yaw angle and the roll angle of camera lens are 0 degree. The display 1 has a display area 11, and the lens 2 is installed at the side of the display area 11, that is, the lens 2 can be installed on the display 1, and of course, the lens 2 can be installed to avoid the display 1, and the lens 2 is used for shooting the hand and the keys of the user at the same time. The processing device is in communication connection with the display 1 and the lens 2, and is used for acquiring and processing images of the lens 2, transmitting the processed gesture information to the display 1, and displaying the compared gesture information in a partition mode in a display area 11 of the display 1.

In this embodiment, the processing device includes an image processing module, a central processing module, and a data memory. The image processing module is used for acquiring and processing the image of the lens 2, namely the image processing module is used for intercepting and processing the image containing the hand information of the user. The central processing module is in communication connection with the image processing module and the display 1, and is used for receiving processing information of the image processing module, comparing the processed image information with corresponding gesture data in the data memory through an algorithm, transmitting the compared gesture information to the display 1, and displaying the compared gesture information in a display area 11 of the display 1 in a partition mode. The specific working principle is as follows:

the image processing module is used for intercepting an image containing user hand information from video information shot by the lens 2 and transmitting a signal to the central processing module, the central processing module identifies gesture data in the image through a neural network algorithm and compares the gesture data with corresponding gesture data in the data storage, so that whether the gesture of the user is matched with prestored gesture data or not is judged, the gesture data is fed back to the user through the user interaction system, namely the display 1, the compared gesture information is displayed in a partition mode, and therefore the user can be taught.

Compared with the prior art, the gesture recognition device provided by the utility model has the advantages that the video information containing gestures is obtained through the lens 2, the image is processed through the processing device in a matching way, the processed gesture information is displayed on the display 1 in a partition way, namely the processed gesture information is fed back to a user through the display 1, and the compared gesture information is displayed in a partition way, so that the user can be taught, the technical problem that the user cannot improve the training level of the user without knowing the error point of the user in the independent exercise process is solved, and the structure is simple.

In one embodiment of the utility model, the lens 2 is disposed on the display 1, the display 1 having a mounting area 12, the mounting area 12 being located at a side of the display area 11, the lens 2 being disposed within the mounting area 12.

Of course, in other embodiments, the lens 2 may be disposed away from the display 1 and located at the side of the display 1.

In an embodiment of the present application, referring in particular to fig. 1, the lens 2 comprises at least two first lens portions 21 and a second lens portion 22. When the lens 2 is mounted on the display 1, the mounting area 12 includes at least two first area portions 121 and a second area portion 122, the second area portion 122 is located between two adjacent first area portions 121, the first lens portions 21 are respectively and correspondingly disposed in the first area portions 121, and the second lens portion 22 is disposed in the second area portion 122. When the lens 2 is set to avoid the display 1, at least two first lens parts 21 are arranged on two sides of the display 1, and the second lens part 22 is arranged on one side of the display 1 adjacent to the first lens part 21 and used for collecting a complete image of the whole piano.

Specifically, in the present embodiment, the number of the first lens portions 21 is two, and one of the first lens portions 21 is located on the left side, so that gesture data located in the left half portion of the piano can be collected, and the gesture data is mainly used for shooting an image of the key from the center of the 26 th white key from the left side to the left side; the other first lens portion 21 is located on the right side and is used for collecting gesture data of the right half portion of the piano and mainly shooting an image of the key from the left to the right of the center F of the 27 th white key. It should be noted that, because the pictures collected by each lens 2 need to be sent to a computing Unit for computation, the consumption of computing resources will be increased when adding one lens, so that the cost of adding a lens is increased, and the cost increase caused by a higher-effort NPU (network-Processing Unit) and a CPU (central Processing Unit) is a more considerable factor, that is, the hardware cost is greatly increased when adding a lens, and meanwhile, the problems of wiring between lenses and frame synchronization become more complicated. The plane where the gesture recognition device is located is parallel to the upper door plate of the piano, and left and right inclination does not exist, so that the yaw angle and the rolling angle of the lens are guaranteed to be 0 degree.

The display 1 is composed of a 21-inch 1080P touch screen display and is used for displaying interactive information, such as music scores, gesture error information, correct gesture information and the like. The display 1 is divided into three sections, which may divide the display 1 into three sections in the vertical direction. The left part is used for displaying left gestures, wherein the left gestures comprise wrong gestures, wrong places are marked by colors, and correct gestures are displayed, so that a user can know the wrong places and correct the wrong places; similarly, the right part is used for displaying right gestures, the right gestures comprise wrong gestures and are marked with different colors to form wrong places, and correct gestures are displayed, so that a user can know the wrong places and correct the wrong places. The music score is displayed in the middle part, so that a user can learn according to the music score conveniently.

In an embodiment of the present invention, referring to fig. 1 and fig. 2, the number of the second lens portions 22 is one, and the second lens portions 22 are connected to the image processing module in a communication manner for shooting the key, i.e. shooting the entire piano key. Through setting up second lens portion 22, can supply the region that at least two first lens portion 21 can not shoot, first lens portion 21 is used for assisting second lens portion 22, solves the problem that second lens portion 22 edge formation of image has the distortion, reduces the performance requirement to CPU, and processing apparatus can handle the image of second lens portion 22, can intercept the image that contains user's hand information that second lens portion 22 shot, and integrate with the image that each first lens portion 21 shot to form complete image.

The second lens part in the middle of the present invention can capture the whole piano picture, and a wide-angle lens is adopted as an auxiliary device for the left and right first lens parts 21. Firstly, when a user sets up the gesture recognition device, the user can only place the device at an approximate position, the position is different from the optimal position, a complete key picture is collected through the second lens part 22 at the middle position, the distance between the current position and the optimal position is calculated, and the gesture recognition device is moved to the optimal position, so that the first lens part 21 at the side part can also obtain the optimal visual angle, and the gesture recognition device can obtain the optimal performance; secondly, the second lens part 22 at the middle position has a visual angle difference with the first lens part 21 at the side part, so that when the problems of shielding and the like can be alleviated, the picture of the second lens part 22 at the middle position can be sent to the calculation unit for calculation, and the overall performance of the gesture recognition device is improved; and thirdly, a complete playing interface is provided for the user, so that the user can select and watch the music playing from one more visual angle.

Further, the first lens portion 21 is a normal lens, and the second lens portion 22 is a wide-angle lens. The common lens is a camera lens which generally specifies a focal length and a fixed aperture (or a manual aperture) and focuses in a middle range, and the common lens can be focused and adjusted through a focusing ring, so that the function is simple. The wide-angle lens is a photographic lens with a focal length shorter than that of a standard lens, a visual angle larger than that of the standard lens, a focal length longer than that of a fisheye lens and a visual angle smaller than that of the fisheye lens. It should be noted that, since the wide-angle lens itself may generate serious distortion, the middle key is closer to the second lens portion 22, the object looks bigger, and the two keys are farther from the first lens portion 21, the object looks smaller, even if the distortion is corrected by using the orthodontic algorithm, the better effect cannot be achieved, and the effect of such a picture is not good for the user or the algorithm. On the other hand, because the second lens part 22 is disposed at a too high position, objects such as hands are relatively far away from the lens, and features such as hand details, hand type error features and key gaps cannot be well presented, so that the algorithm precision is affected. The left and right first lens parts 21 can cover all keys by adopting a common lens, taking the left first lens part 21 as an example, the coverage range of the left first lens part 21 is all complete keys in the area from the leftmost key to the right key of the center C, and the difference of the coverage range of the keys can be caused by the different deployment positions and deployment angles of the common lens, but the area is the minimum coverage range of the single-side lens in the utility model. Because only need gather the image of key left half, the deployment position of left first lens portion 21 need be than single camera lens a lot of lower, and image details are more clear, and the influence that hand self sheltered from the problem also obviously reduces a lot, has promoted misidentification's precision greatly. Meanwhile, the distortion of the common lens is far smaller than that of the ultra-wide-angle lens, the common lens with a proper angle is selected, and the image is corrected through an orthodontic algorithm, so that the image basically has no distortion sense, and the method is very friendly to users and algorithms.

In an embodiment of the present invention, referring to fig. 1 and fig. 2, a mounting groove 13 is formed on the display 1, the mounting groove 13 is disposed corresponding to the second area portion 122 and extends along a first direction, wherein the first direction is a vertical direction in fig. 1, and the second lens portion 22 is connected in the mounting groove 13.

Specifically, with reference to fig. 3 and 4, the first lens portion 21 includes a mounting portion 211 and a first body portion 212, wherein the mounting portion 211 is disposed on the back surface of the display 1 and connected to the display 1, and the first body portion 212 is connected to the mounting portion 211, so that the gesture can be photographed.

The second lens portion 22 includes a plate body portion 221 and a second body portion 222. Wherein, the plate body part 221 is disposed on the back of the display 1 and connected with the display 1, and the second body part 222 is connected with the plate body part 221 and passes through the mounting groove 13, so that the whole key can be photographed.

Further, referring to fig. 3 and 4, the gesture recognition device further includes a first angle adjusting mechanism 4 and a second angle adjusting mechanism 5, the first angle adjusting mechanism 4 is disposed on one side of the display 1 departing from the first lens portion 21, is connected to the first lens portion 21 and the display 1, and is used for adjusting an angle of the first lens portion 21, and the first angle adjusting mechanism 4 includes a first rotation driving member. The first rotary driving member is disposed on a side of the display 1 away from the first lens portion 21 and connected to the display 1, and a rotation axis of the first rotary driving member is in driving connection with the first lens portion 21. The second angle adjusting mechanism 5 is disposed on a side of the display 1 away from the second lens portion 22, and is connected to the second lens portion 22 and the display 1, and is configured to adjust an angle of the second lens portion 22. The second angle adjusting mechanism 5 includes a second rotation driving member, the second rotation driving member is disposed on one side of the display 1 departing from the second lens portion 22 and is connected to the display 1, and a rotation axis of the second rotation driving member is in driving connection with the second lens portion 22.

Specifically, the first rotary driving member and the second rotary driving member are both servo motors, the first lens portion 21 and the second lens portion 22 are correspondingly rotated through the servo motors, and the first lens portion and the second lens portion can stop after reaching a required angle, that is, the rotation angles of the first lens portion 21 and the second lens portion 22 can be accurately adjusted by the servo motors. Adopt first rotary driving spare and second rotary driving spare rotatory to it is rotatory to correspond to drive first lens portion 21 and second lens portion 22, and easy operation is convenient, thereby can the different positions of placing and the different piano size of adaptation display 1.

In an embodiment of the present invention, referring to fig. 2 and fig. 3, the gesture recognition apparatus further includes a mounting post 6, the mounting post 6 is disposed on a side of the display 1 away from the second lens portion 22, the mounting post 6 is parallel to the mounting groove 13 and spaced apart from the mounting groove, and the mounting post 6 is connected to the second rotary driving member. The second rotary driving member is disposed on the mounting post 6, so that interference between the rotary shaft of the second rotary driving member and the display 1 during rotation can be avoided.

In an embodiment of the present invention, referring to fig. 1 to 3, a sliding slot 14 is formed on the display 1, the sliding slot 14 is disposed corresponding to the mounting area 12 and extends along a first direction, wherein the first direction refers to a vertical direction shown in fig. 3, the sliding slot 14 is slidably connected with a first lens portion 21, and by slidably connecting the first lens portion 21 in the sliding slot 14, a height of the first lens portion 21 can be manually or electrically adjusted, i.e., a distance between the first lens portion 21 and the key can be adjusted, so as to adapt to different mounting positions of the display 1 or different sizes of pianos.

In one embodiment of the present invention, by adjusting the height and the pitch angle of the first lens part 21, all the keys between the 1 st white key from the left and the 26 th white key from the left of the piano can be completely displayed in the image of the first lens part 21 from the left, and occupy the maximum ratio in the image; and all the areas between the 27 th white key from the left and the 52 th white key from the left can be completely displayed in the first lens part 21 at the right side, and the ratio of the areas in the image is the largest; the key inner edges in the left and right images are both coincident with the lower boundary of the image.

Specifically, in the present embodiment, the distance between the first lens section 21 and the key of the piano is 15 to 25cm, the pitch angle of the first lens section 21 is 30 to 60 °, and the optimum position can be obtained. In a particular application, the distance between the first lens portion 21 and the key of the piano is 15cm, 16cm, 17cm, 18cm, 19cm, 20cm, 21cm, 22cm, 23cm, 24cm or 25 cm; the first lens portion 21 has a pitch angle of 30 °, 45 °, or 60 °. Preferably, the distance between the first lens portion 21 and the key is 20cm, and the pitch angle of the first lens portion 21 is 45 °.

It should be noted that these parameters are not set in advance, but are determined by algorithm fine tuning according to the image characteristics of the optimal position, the above position can obtain the best hand characteristics and key characteristics, if the height of the first lens portion 21 is too high, the pitch angle must be increased to obtain the keyboard image, when playing the piano, the fingers are approximately arc-shaped, the joints at the ends of the fingers are approximately right-angled to stand on the keys, the too large pitch angle may cause the shielding of some finger characteristics (such as folded fingers) to be serious, and the too high height may cause the key target to become small in the image; the height of first lens portion 21 is low excessively, needs to reduce the angle of pitch and can catch complete key image, because first lens portion 21 is nearer apart from the key, can lead to the key to show imperfectly, and some key have surpassed the display range of image, also can lead to the characteristic of the back of the palm of the hand and wrist to shelter from seriously.

In one embodiment of the present invention, the center line of the projection of the middle second lens portion 22 on the piano key coincides with the center line of the key, which means the line of separation of the 26 th white key center E from the 27 th white key center F from the left side. The pitch angle of the second lens part 22 can be adjusted by the above-described mechanism so that an image of the entire piano can be displayed in the second lens part 22. The pitch angle of the second lens part 22 is 30-60 degrees, and an optimal position can be obtained.

In particular applications, the second lens portion 22 has a pitch angle of 30 °, 45 °, or 60 °. Preferably, the second lens portion 22 has a pitch angle of 45 °. Too large pitch angle may cause serious occlusion of some finger features (such as folded fingers), too small pitch angle may cause incomplete key display, and some keys exceed the display range of images, and may also cause serious occlusion of features on the palm back and wrist.

In an embodiment of the present invention, referring to fig. 2 and fig. 3, the gesture recognition apparatus further includes a linear actuator 3 disposed on a side of the display 1 away from the first lens portion 21, wherein the linear actuator 3 is connected to the first lens portion 21 and is configured to drive the first lens portion 21 to reciprocate along the sliding slot 14, so as to adjust a distance between the first lens portion 21 and the key. The following embodiments are provided for the linear gear 3 based on different configurations:

the first embodiment is as follows:

referring specifically to fig. 3 and 4, the linear actuator 3 includes a guide rail 31 and a slider 32. The guide rail 31 is disposed on a side of the display 1 away from the first lens portion 21, connected to the display 1, and parallel to the sliding groove 14, and a side portion of the slider 32 is slidably connected to the guide rail 31, and a side portion of the slider 32 close to the first lens portion 21 is connected to the first lens portion 21.

It should be noted that the sliding block 32 can be manually slid, so as to drive the first lens portion 21 to slide along the guide rail 31. Of course, the first lens portion 21 may also be driven to slide along the guide rail 31 by an electric mode, for example, a driving end of a driving cylinder may be connected to the sliding block 32, and the driving cylinder drives the sliding block 32 to slide along the guide rail 31.

Example two:

the linear transmission mechanism is a lead screw nut mechanism which comprises a lead screw and a lead screw nut. Wherein, the lead screw sets up in the back of display 1 along first direction, and the both ends of this lead screw are connected with display 1 respectively, and on the lead screw was located to the lead screw nut cover, this lead screw nut was connected with first camera lens portion 21, when rotatory this lead screw, drove lead screw nut and remove along the lead screw to can drive the first camera lens portion 21 of being connected with lead screw nut and remove along the lead screw.

Further, the screw nut mechanism further comprises a first knob, the first knob is connected with the end portion of the screw, and the first knob can be conveniently rotated by hands, so that the screw is driven to rotate.

Of course, in other embodiments, a rotary motor may be used in place of the first knob, the rotary motor rotating to rotate the lead screw and thereby move the lead screw nut along the lead screw.

Example three:

the linear transmission mechanism is a synchronous belt transmission mechanism which comprises a plurality of belt wheels, a rotary driving source and a conveying belt. The plurality of belt wheels are arranged at intervals along a first direction, each belt wheel is connected with the display 1 in a rotating mode, the rotary driving source is connected with one of the belt wheels in a driving mode and used for driving the belt wheels to rotate, the conveying belt is sleeved on the plurality of belt wheels and is in transmission connection with the plurality of belt wheels, and the conveying belt is connected with the first lens portion 21. When the rotary driving source rotates, the belt wheel is driven to rotate, and the conveying belt is driven to rotate through the friction force between the conveying belt and the belt wheel. Of course, in other embodiments, the conveyor belt is provided with teeth, the belt wheel is provided with teeth engaged with the conveyor belt, and the conveyor belt is driven to rotate by the engagement transmission between the conveyor belt and the teeth on the belt wheel, so as to drive the first lens portion 21 to ascend or descend.

Example four:

this linear transmission is rack and pinion mechanism, and this rack and pinion mechanism includes rack and gear, and wherein, the rack sets up in the back of display 1 along first direction to be connected with display 1, gear and rack meshing rotates on this gear and is connected with first lens portion 21, makes the gear remove along the rack through rotating gear, thereby drives first lens portion 21 and removes along the rack.

Specifically, this rack and pinion mechanism still includes the second knob, and the gear includes interconnect's axial region and gear portion, and wherein the axial region is connected with the second knob, and gear portion and rack toothing carry out the transmission of motion, through rotatory second knob to can drive the gear and remove along the rack, gear movement drives first lens portion 21 and reciprocates.

Of course, in other embodiments, the second knob may be replaced with a rotary drive source that rotates to drive the gear to rotate.

Example five:

the linear transmission mechanism is a worm and gear mechanism, the worm is arranged on the back of the display 1 along a first direction and is connected with the display 1, the worm is meshed with the worm, the worm is rotatably connected with a first lens part 21, and the worm is enabled to move along the worm by rotating the worm, so that the first lens part 21 is driven to move along the worm.

In another embodiment of the present invention, the difference from the above embodiment is that when the lens 2 is disposed away from the display 1, the gesture recognition apparatus further includes a mounting plate (not shown in the figure) connected to the piano, on which the display 1, the first angle adjustment mechanism, and the second angle adjustment mechanism are disposed, the first angle adjustment mechanism 4 is used to adjust the angle of the first lens portion 21, and the second angle adjustment mechanism 5 is used to adjust the angle of the second lens portion 22.

Further, in this embodiment, a sliding groove is formed in the mounting plate, the sliding groove extends along the first direction, and the first lens portion 21 is slidably connected in the sliding groove. The gesture recognition device further comprises a linear transmission mechanism, the linear transmission mechanism is arranged on one side, away from the first lens portion 21, of the mounting plate, and the linear transmission mechanism is connected with the first lens portion 21 and used for driving the first lens portion 21 to move back and forth along the sliding groove.

The utility model also provides a piano teaching integrated system which comprises a piano and the gesture recognition device in any embodiment, and the display 1 is detachably connected with the piano.

The piano teaching integrated system provided by the utility model adopts the gesture recognition device, when the gesture recognition device is installed on a piano, video information containing gestures is obtained through the lens 2, the image is processed in a matching way and matched with the processing device, the processed gesture information is displayed on the display 1 in a partition way, namely the processed gesture information is fed back to a user through the display 1, and the compared gesture information is displayed in a partition way, so that the user can be taught, the technical problem that the user cannot improve the training level of the user without knowing the error point of the user in the independent exercise process is solved, and the structure is simple.

In one embodiment of the present invention, referring to fig. 1 and 2, the display 1 is mounted to the piano by a locking mechanism, such as a nut or spring clip.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the utility model, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.

Claims

1. The utility model provides a gesture recognition device for install on the piano which characterized in that: the method comprises the following steps:

a display connected to the piano, the display having a display area;

a lens disposed at a side of the display area; and

2. The gesture recognition apparatus of claim 1, wherein: the lens is arranged on the display, the display is provided with a mounting area, the mounting area is positioned at the side part of the display area, and the lens is arranged in the mounting area; or,

3. The gesture recognition apparatus of claim 2, wherein: the lens comprises at least two first lens parts and a second lens part;

4. The gesture recognition apparatus of claim 3, wherein: the first lens part is a common lens, and the second lens part is a wide-angle lens.

5. The gesture recognition apparatus according to claim 3 or 4, characterized in that: when the lens is mounted on the display, the gesture recognition apparatus further includes:

6. The gesture recognition apparatus of claim 5, wherein: the pitch angle of the first lens part is 30-60 degrees, and the pitch angle of the second lens part is 30-60 degrees.

7. The gesture recognition apparatus of claim 5, wherein: when the lens is disposed on the display, the first angle adjustment mechanism includes:

the second angle adjusting mechanism includes:

8. The gesture recognition apparatus of claim 5, wherein: when the lens is mounted on the display, a sliding groove is formed in the display, the sliding groove is arranged corresponding to the mounting area and extends along a first direction, and the first lens part is connected in the sliding groove in a sliding mode;

9. The gesture recognition apparatus of claim 8, wherein: the distance between the first lens part and keys of the piano is 15-25 cm.

10. The gesture recognition apparatus of claim 8, wherein: when the lens is mounted on the display, the gesture recognition apparatus further includes:

11. The gesture recognition apparatus of claim 10, wherein: when the lens is disposed on the display, the linear transmission mechanism includes:

12. The utility model provides a piano teaching integrated system which characterized in that: comprising a piano with which the display is detachably connected, and a gesture recognition apparatus according to any one of claims 1 to 11.