CN210295507U - Internet of things system for piano - Google Patents
Internet of things system for piano Download PDFInfo
- Publication number
- CN210295507U CN210295507U CN201920646285.4U CN201920646285U CN210295507U CN 210295507 U CN210295507 U CN 210295507U CN 201920646285 U CN201920646285 U CN 201920646285U CN 210295507 U CN210295507 U CN 210295507U
- Authority
- CN
- China
- Prior art keywords
- communicator
- microprocessor
- piano
- internet
- terminal equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The utility model relates to a piano thing networking systems, be applied to internet of things, including the piano main part, gloves, first terminal equipment, AR glasses equipment and second terminal equipment, gloves are provided with action capture equipment respectively with the key, action capture equipment includes action capture unit and development board unit, the action capture unit includes sensor and first microprocessor, development board unit includes concentrator and first communicator, the sensor gathers finger action information, send and handle for first microprocessor, send for the concentrator after obtaining the space movement data, send for first terminal equipment after gathering and enlargeing the processing, the second microprocessor establishes the 3D gesture, and send for second terminal equipment after generating real-time image according to the 3D gesture, show through transparent display screen at last. Therefore, the scheme collects the finger action information and cannot be influenced by external environment light interference, so that the video pictures played for the students can be more clear and visual, and the learning effect is improved.
Description
Technical Field
The application relates to the technical field of Internet of things, in particular to a piano Internet of things system.
Background
With the continuous development of society, the way that students learn pianos has changed thereupon, has appeared to learn playing the piano through distance teaching.
In the related art, the finger actions of the pianist are recorded by arranging a plurality of cameras with different angles around the piano, video data about the finger actions of the pianist are manufactured and then played to the trainee, and therefore the purpose of learning is achieved. However, the camera is easily interfered by light of external environment during the recording process, so that the recorded video picture is not clear, thereby affecting the learning effect of students.
SUMMERY OF THE UTILITY MODEL
To overcome, at least to some extent, the problems in the related art, the present application provides a piano internet of things system.
The purpose of the application is realized by the following technical scheme:
a piano internet of things system, comprising:
the device comprises a piano main body, gloves, first terminal equipment, AR (augmented reality) glasses equipment and second terminal equipment; wherein:
keys are arranged on the piano main body;
the gloves and the keys are respectively provided with motion capture equipment; the motion capture device includes a motion capture unit and a development board unit; the motion capture unit comprises a sensor and a first microprocessor which are connected with each other; the development board unit comprises a hub and a first communicator which are connected with each other; the hub is connected with the first microprocessor;
the first terminal equipment comprises a second communicator, a second microprocessor and a third communicator which are connected in sequence; the second communicator is in wireless communication connection with the first communicator; the third communicator is used for connecting the Internet;
the second terminal equipment comprises a fourth communicator, a third microprocessor and a fifth communicator which are connected in sequence; the fourth communicator is used for connecting the Internet;
the AR glasses equipment comprises a glasses frame, lenses, a transparent display screen superposed on the lenses, a sixth communicator and a fourth microprocessor, wherein the sixth communicator and the fourth microprocessor are respectively arranged on the glasses frame; the fourth microprocessor is respectively connected with the transparent display screen and the sixth communicator; the sixth communicator is in wireless communication connection with the fifth communicator;
the sensor collects finger action information of a pianist and sends the finger action information to the first microprocessor, the first microprocessor processes the finger action information and obtains corresponding spatial movement data, the first microprocessor sends the spatial movement data to the concentrator, the concentrator summarizes and amplifies the spatial movement data, the concentrator sends the spatial movement data to the first terminal equipment through the first communicator, the first terminal equipment receives the spatial movement data through the second communicator, the second microprocessor in the terminal equipment establishes a 3D gesture according to the spatial movement data, a preset hand action model and a piano model and generates a real-time image according to the 3D gesture, and the third communicator sends the real-time image to the second terminal equipment through the internet, the second terminal device receives the real-time image through the fourth communicator, the third microprocessor in the second terminal device sends the real-time image to the AR glasses device through the fifth communicator, the AR glasses device receives the real-time image through the sixth communicator, and the fourth microprocessor in the AR glasses device sends the real-time image to the transparent display screen for displaying.
Optionally, the sensor is an attitude sensor.
Optionally, the attitude sensor includes a three-axis gyroscope, a three-axis accelerometer and a three-axis magnetometer; the three-axis gyroscope is used for acquiring angular velocity information of finger actions in real time; the three-axis accelerometer is used for acquiring acceleration information of finger actions in real time; the three-axis magnetometer is used for acquiring the magnetic force information of finger actions in real time.
Optionally, the first microprocessor, the second microprocessor, the third microprocessor and the fourth microprocessor are all single-chip microcomputers.
Optionally, the development board unit further comprises a battery for powering the motion capture device.
Optionally, the development board unit is an Arduino series development board.
Optionally, the third communicator and the fourth communicator are both network interfaces or wireless network cards;
the first communicator, the second communicator, the fifth communicator and the sixth communicator are all Bluetooth modules; or the first communicator, the second communicator, the fifth communicator and the sixth communicator are all WiFi modules; or, the first communicator, the second communicator, the fifth communicator and the sixth communicator are all wireless RF modules.
Optionally, the transparent display screen includes a micro projector and an optical lens.
Optionally, the transparent display screen comprises a micro projector and an optical lens.
Optionally, the first terminal device and the second terminal device are both a computer, a tablet computer, or a mobile phone.
The technical scheme provided by the embodiment of the application can have the following beneficial effects: the piano internet of things system provided by the embodiment comprises a piano main body, gloves, first terminal equipment, AR glasses equipment and second terminal equipment; wherein: keys are arranged on the piano main body; the gloves and the keys are respectively provided with motion capture equipment; the motion capture device includes a motion capture unit and a development board unit; the motion capture unit comprises a sensor and a first microprocessor which are connected with each other; the development board unit comprises a hub and a first communicator which are connected with each other; the concentrator is connected with the first microprocessor; the sensor collects finger action information of a pianist, the finger action information is sent to the first microprocessor for further processing, corresponding space movement data are obtained, the concentrator receives the space movement data, summarizes and amplifies the space movement data, and the space movement data are sent to the first terminal equipment through the first communicator. The first terminal equipment comprises a second communicator, a second microprocessor and a third communicator which are connected in sequence; the first terminal device receives the spatial movement data through the second communicator, the second microprocessor establishes a 3D posture according to the spatial movement data, the preset hand action model and the piano model and generates a real-time image according to the 3D posture, the third communicator sends the real-time image to the second terminal device through the internet, the second terminal device receives the real-time image through the fourth communicator, and the third microprocessor in the second terminal device sends the real-time image to the AR glasses device through the fifth communicator. The AR glasses device comprises a sixth communicator, a third microprocessor and a transparent display screen which are sequentially connected; the AR glasses equipment receives the real-time images through the sixth communicator, and then the fourth microprocessor sends the real-time images to the transparent display screen for displaying. So, compare with above-mentioned correlation technique, thereby the piano thing networking systems that this scheme provided realizes the collection of finger action information through the concrete action that the direct perception of sensor indicates, can not receive external environment light interference's influence in the collection process to compare in gathering through the sensor and can be more accurate through the camera, consequently, the video picture that finally plays for the student can be more clear directly perceived, more is favorable to the student to study, improves the learning effect.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
Fig. 1 is a schematic structural diagram of a piano and gloves in a piano internet of things system provided in an embodiment of the present application.
Fig. 2 is a schematic circuit structure diagram in a piano internet of things system according to an embodiment of the present application.
Fig. 3 is a schematic structural diagram of an AR glasses device in a piano internet of things system according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples consistent with the piano internet of things system of the present application, as detailed in the appended claims.
Examples
Referring to fig. 1, fig. 1 is a schematic structural diagram of a piano and gloves in a piano internet of things system provided in an embodiment of the present application.
Referring to fig. 2, fig. 2 is a schematic circuit structure diagram in a piano internet of things system according to an embodiment of the present application.
Referring to fig. 3, fig. 3 is a schematic structural diagram of an AR glasses device in a piano internet of things system according to an embodiment of the present application.
As shown in fig. 1, fig. 2 and fig. 3, the system of internet of things for piano provided by the present embodiment includes:
a piano body 001, a glove 002, a first terminal device 003, an AR glasses device 004, and a second terminal device 005; wherein:
the piano body 001 is provided with keys 011;
the glove 002 and the key 011 are respectively provided with a motion capture device 006; the motion capture device 006 includes a motion capture unit 061 and a development board unit 062; the motion capture unit 061 includes a sensor 611 and a first microprocessor 612 connected to each other; the development board unit 062 includes a hub 621 and a first communicator 622 connected to each other; the hub 621 is connected to the first microprocessor 612;
the first terminal device 003 includes a second communicator 031, a second microprocessor 032 and a third communicator 033 connected in sequence; the second communicator 031 is in wireless communication connection with the first communicator 622; the third communicator 033 is for connecting to the internet;
the second terminal device 005 comprises a fourth communicator 051, a third microprocessor 052 and a fifth communicator 053 which are connected in sequence; the fourth communicator 051 is used for connecting the Internet;
the Augmented Reality (AR) glasses device 004 includes a frame 041, lenses 042, a transparent display screen 043 stacked on the lenses 042, a sixth communicator 044 and a fourth microprocessor 045 respectively disposed on the frame 041; the fourth microprocessor 045 is respectively connected with the transparent display screen 043 and the sixth communicator 044; the sixth communicator 044 is in wireless communication connection with the fifth communicator 053;
the sensor 611 collects finger action information of a pianist, the finger action information is sent to the first microprocessor 612, the first microprocessor 612 processes the finger action information and obtains corresponding spatial movement data, the first microprocessor 612 sends the spatial movement data to the hub 621, the hub 621 collects and amplifies the spatial movement data, the hub 621 sends the spatial movement data to the first terminal device 003 through the first communicator 622, the first terminal device 003 receives the spatial movement data through the second communicator 031, the second microprocessor 032 establishes a three-dimensional (3Dimensions, 3D) posture according to the spatial movement data, a preset hand action model and a piano model and generates a real-time image according to the 3D posture, the third communicator 033 sends the real-time image to the second terminal device 005 through the internet, and the second terminal device 005 receives the real-time image through the fourth communicator 051, the third microprocessor 052 in the second terminal device 005 transmits the real-time image to the AR glasses device 004 through the fifth communicator 053, the AR glasses device 004 receives the real-time image through the sixth communicator 044, and the fourth microprocessor 045 in the AR glasses device 004 transmits the real-time image to the transparent display screen 043 for display.
The piano internet of things system provided by the embodiment comprises a piano main body 001, gloves 002, a first terminal device 003, an AR glasses device 004 and a second terminal device 005; wherein: the piano body 001 is provided with keys 011; the glove 002 and the key 011 are respectively provided with a motion capture device 006; the motion capture device 006 includes a motion capture unit 061 and a development board unit 062; the motion capture unit 061 includes a sensor 611 and a first microprocessor 612 connected to each other; the development board unit 062 includes a hub 621 and a first communicator 622 connected to each other; the hub 621 is connected to the first microprocessor 612; the sensor 611 collects finger movement information of the pianist, sends the finger movement information to the first microprocessor 612 for further processing, so as to obtain corresponding spatial movement data, and the hub 621 receives the spatial movement data, summarizes and amplifies the spatial movement data, and sends the spatial movement data to the first terminal device 003 through the first communicator 622. The first terminal device 003 includes a second communicator 031, a second microprocessor 032 and a third communicator 033 connected in sequence; first terminal equipment 003 receives the space movement data through second communicator 031, second microprocessor 032 establishes the 3D gesture according to space movement data, preset hand action model and piano model to generate real-time image according to the 3D gesture, third communicator 033 sends real-time image to second terminal equipment 005, second terminal equipment 005 receives real-time image through fourth communicator 051, third microprocessor 052 in second terminal equipment 005 sends real-time image to AR glasses equipment 004 through fifth communicator 053. The AR glasses device 004 includes a sixth communicator 044, a third microprocessor 045 and a transparent display screen 043 connected in sequence; the AR glasses device 004 receives the live image through the sixth communicator 044, and then the fourth microprocessor 045 transmits the live image to the transparent display screen 043 for display. So, compare with above-mentioned correlation technique, thereby the piano thing networking systems that this scheme provided realizes the collection of finger action information through the concrete action of the direct perception finger of sensor 611, can not receive external environment light interference's influence in the collection process to compare in gathering through sensor 611 and can be more accurate through the camera collection, consequently, the video picture that finally plays for the student can be more clear directly perceived, more is favorable to the student to study, improves the learning effect.
The first terminal device 003 and the second terminal device 005 may be provided with a storage module, and the storage module is connected to the corresponding microprocessor to store the image for subsequent viewing.
The specific implementation mode of establishing the 3D gesture according to the spatial movement data, the preset hand action model and the piano model and generating the real-time image according to the 3D gesture can be implemented by referring to the related technology, and is not described herein again.
In one embodiment, the hub 621 and the first microprocessor 612 may be connected via a hardware interface. Alternatively, the hub 621 and the first microprocessor 612 may be connected through a data line. The hub 621 may be an active hub or an intelligent hub. The data line may be a Universal Serial Bus (USB) 3.0 data line or a Universal Serial Bus (USB) 2.0 data line. The transmission speed of the USB3.0 data line is better than that of the USB2.0 data line.
There are various types of sensors, and in some embodiments, the sensor 611 may be, but is not limited to, an attitude sensor.
In some embodiments, the attitude sensor may specifically include a three-axis gyroscope, a three-axis accelerometer, and a three-axis magnetometer; the three-axis gyroscope is used for acquiring angular velocity information of finger actions in real time; the three-axis accelerometer is used for acquiring acceleration information of finger actions in real time; the three-axis magnetometer is used for acquiring the magnetic force information of the finger action in real time.
In specific implementation, the attitude sensor can BE BMI055, BMI060, TLI5012, BE1000, TM1000Q, MPU6050, MPU6500 and the like.
There are various types of microprocessors, and in some embodiments, the first microprocessor 612, the second microprocessor 032, the third microprocessor 052, and the fourth microprocessor 045 are all single-chip microprocessors.
In specific implementation, the single chip microcomputer can be an MCS-51 series single chip microcomputer, and specifically comprises models of 8051, 8751, 8031 and 8951.
The development board unit 062 provided by the present embodiment further includes a battery for powering the motion capture device 006.
In practice, the battery may be a zinc series battery, a nickel series battery or a lead series battery.
In some embodiments, development board unit 062 is an Arduino series development board.
In specific implementation, the development board unit 062 may be an Arduino MEGA model development board.
In some embodiments, optionally, the third communicator 033 and the fourth communicator 051 are both network interfaces or wireless network cards. If adopt network interface, then can be through the internet of net twine connection, transmission speed is faster, if adopt wireless network card can the lug connection internet, compares with the connection net twine, and it is more nimble convenient to use.
Optionally, the first communicator 622, the second communicator 031, the fifth communicator 053, and the sixth communicator 044 are all bluetooth modules; or, the first communicator 622, the second communicator 031, the fifth communicator 053, and the sixth communicator 044 are all Wireless Fidelity (WiFi) modules; alternatively, the first communicator 622, the second communicator 031, the fifth communicator 053, and the sixth communicator 044 are all Radio Frequency (RF) modules. Bluetooth technology, WiFi technology and RF technology are mature wireless communication technologies and are easy to implement.
In a specific implementation, the bluetooth module may be model CC 2541.
The transparent display screen 043 has various specific structures.
In some embodiments, transparent display screen 043 includes a pico projector and optics. In specific implementation, the micro-projector projects an image on the optical lens by direct projection to realize imaging.
In some embodiments, transparent display 043 includes a micro-projector and optical lenses. In specific implementation, the micro projector projects an image on the optical lens through light refraction to realize imaging.
In some embodiments, the first terminal device 003 and the second terminal device 005 can be, but are not limited to, a computer, a tablet computer, or a mobile phone.
It is understood that the same or similar parts in the above embodiments may be mutually referred to, and the same or similar parts in other embodiments may be referred to for the content which is not described in detail in some embodiments.
It should be noted that, in the description of the present invention, the terms "first", "second", etc. are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In addition, in the description of the present invention, "a plurality" means at least two unless otherwise specified.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Although embodiments of the present invention have been shown and described, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art without departing from the scope of the present invention.
Claims (10)
1. A piano Internet of things system is characterized by comprising:
the device comprises a piano main body, gloves, first terminal equipment, AR (augmented reality) glasses equipment and second terminal equipment; wherein:
keys are arranged on the piano main body;
the gloves and the keys are respectively provided with motion capture equipment; the motion capture device includes a motion capture unit and a development board unit; the motion capture unit comprises a sensor and a first microprocessor which are connected with each other; the development board unit comprises a hub and a first communicator which are connected with each other; the hub is connected with the first microprocessor;
the first terminal equipment comprises a second communicator, a second microprocessor and a third communicator which are connected in sequence; the second communicator is in wireless communication connection with the first communicator; the third communicator is used for connecting the Internet;
the second terminal equipment comprises a fourth communicator, a third microprocessor and a fifth communicator which are connected in sequence; the fourth communicator is used for connecting the Internet;
the AR glasses equipment comprises a glasses frame, lenses, a transparent display screen superposed on the lenses, a sixth communicator and a fourth microprocessor, wherein the sixth communicator and the fourth microprocessor are respectively arranged on the glasses frame; the fourth microprocessor is respectively connected with the transparent display screen and the sixth communicator; the sixth communicator is in wireless communication connection with the fifth communicator;
the sensor collects finger action information of a pianist and sends the finger action information to the first microprocessor, the first microprocessor processes the finger action information and obtains corresponding spatial movement data, the first microprocessor sends the spatial movement data to the concentrator, the concentrator summarizes and amplifies the spatial movement data, the concentrator sends the spatial movement data to the first terminal equipment through the first communicator, the first terminal equipment receives the spatial movement data through the second communicator, the second microprocessor in the terminal equipment establishes a 3D gesture according to the spatial movement data, a preset hand action model and a piano model and generates a real-time image according to the 3D gesture, and the third communicator sends the real-time image to the second terminal equipment through the internet, the second terminal device receives the real-time image through the fourth communicator, the third microprocessor in the second terminal device sends the real-time image to the AR glasses device through the fifth communicator, the AR glasses device receives the real-time image through the sixth communicator, and the fourth microprocessor in the AR glasses device sends the real-time image to the transparent display screen for displaying.
2. The piano internet of things system of claim 1, wherein the sensor is an attitude sensor.
3. The piano internet of things system of claim 2, wherein the attitude sensors comprise a three-axis gyroscope, a three-axis accelerometer, and a three-axis magnetometer; the three-axis gyroscope is used for acquiring angular velocity information of finger actions in real time; the three-axis accelerometer is used for acquiring acceleration information of finger actions in real time; the three-axis magnetometer is used for acquiring the magnetic force information of finger actions in real time.
4. The piano internet of things system of claim 1, wherein the first microprocessor, the second microprocessor, the third microprocessor and the fourth microprocessor are all single-chip microcomputers.
5. The piano internet of things system of claim 1, wherein the development board unit further comprises a battery for powering the motion capture device.
6. The piano internet of things system of claim 1 or 5, wherein the development board unit is an Arduino series development board.
7. The piano internet of things system of claim 1, wherein the third communicator and the fourth communicator are both network interfaces or wireless network cards;
the first communicator, the second communicator, the fifth communicator and the sixth communicator are all Bluetooth modules; or the first communicator, the second communicator, the fifth communicator and the sixth communicator are all WiFi modules; or, the first communicator, the second communicator, the fifth communicator and the sixth communicator are all wireless RF modules.
8. The piano internet of things system of claim 1, wherein the transparent display screen comprises a pico projector and optics.
9. The piano internet of things system of claim 1, wherein the transparent display screen comprises a miniature projector and optics.
10. The piano internet of things system of claim 1, wherein the first terminal device and the second terminal device are each a computer, a tablet computer, or a mobile phone.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201920646285.4U CN210295507U (en) | 2019-05-07 | 2019-05-07 | Internet of things system for piano |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201920646285.4U CN210295507U (en) | 2019-05-07 | 2019-05-07 | Internet of things system for piano |
Publications (1)
Publication Number | Publication Date |
---|---|
CN210295507U true CN210295507U (en) | 2020-04-10 |
Family
ID=70069128
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201920646285.4U Expired - Fee Related CN210295507U (en) | 2019-05-07 | 2019-05-07 | Internet of things system for piano |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN210295507U (en) |
-
2019
- 2019-05-07 CN CN201920646285.4U patent/CN210295507U/en not_active Expired - Fee Related
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105453011B (en) | Virtual objects direction and visualization | |
US11769306B2 (en) | User-exhibit distance based collaborative interaction method and system for augmented reality museum | |
KR20210130773A (en) | Image processing method and head mounted display device | |
CN107408314A (en) | Mixed reality system | |
CN106066701B (en) | A kind of AR and VR data processing equipment and method | |
CN109313812A (en) | Sharing experience with context enhancing | |
CN104536579A (en) | Interactive three-dimensional scenery and digital image high-speed fusing processing system and method | |
CN105639818A (en) | Intelligent safety helmet based on augmented reality, space scanning and gesture recognition technologies | |
CN109219955A (en) | Video is pressed into | |
CN105393158A (en) | Shared and private holographic objects | |
CN107798932A (en) | A kind of early education training system based on AR technologies | |
CN106652590A (en) | Teaching method, teaching recognizer and teaching system | |
WO2020264149A1 (en) | Fast hand meshing for dynamic occlusion | |
CN108830944B (en) | Optical perspective three-dimensional near-to-eye display system and display method | |
CN112272311A (en) | Method, device, terminal, server and medium for repairing splash screen | |
CN112711335A (en) | Virtual environment picture display method, device, equipment and storage medium | |
CN106780680A (en) | Three-dimensional animation generation method, terminal and system based on augmented reality | |
CN106354205A (en) | Wearable virtual reality implementing system | |
CN112071130A (en) | Knowledge education system and education method based on VR technology | |
KR20180080012A (en) | The apparatus and method of musical contents creation and sharing system using social network service | |
CN112037090B (en) | Knowledge education system based on VR technology and 6DOF gesture tracking | |
KR102176805B1 (en) | System and method for providing virtual reality contents indicated view direction | |
CN210295507U (en) | Internet of things system for piano | |
CN117095096A (en) | Personalized human body digital twin model creation method, online driving method and device | |
CN203078415U (en) | Intelligent vehicle-mounted panoramic imaging system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200410 |