CN215458018U

CN215458018U - Wearable equipment and musical instrument partner training system with same

Info

Publication number: CN215458018U
Application number: CN202121602369.1U
Authority: CN
Inventors: 散华杰
Original assignee: Goertek Inc
Current assignee: Goertek Inc
Priority date: 2021-07-14
Filing date: 2021-07-14
Publication date: 2022-01-11
Anticipated expiration: 2031-07-14

Abstract

The utility model relates to the technical field of electronic products, in particular to wearable equipment and a musical instrument partner training system with the same. Wearable equipment is dressed in the arm includes: the voice acquisition module is arranged on the wearable equipment and acquires an audio signal caused by playing the musical instrument with the fingers; the action acquisition module is arranged at a position, close to the skin of the wearing part, on the wearable equipment and acquires action signals of the skin of the wearing part caused by playing the musical instrument with the fingers; the processing module is electrically connected with the voice acquisition module and the action acquisition module and is used for identifying the audio signals and the action signals; and the communication module is electrically connected with the processing module and sends the audio signal and the action signal identified by the processing module to the terminal. The wearable device can collect audio signals caused by the finger playing musical instrument and action signals on the arm, so that data support is provided for the subsequent analysis of the finger playing musical instrument whether the standard is met.

Description

Wearable equipment and musical instrument partner training system with same

Technical Field

The utility model relates to the technical field of electronic products, in particular to wearable equipment and a musical instrument partner training system with the same.

Background

This section provides background information related to the present disclosure only and is not necessarily prior art.

In the current society, musical instruments are more and more commonly learned, but most parents do not know the musical instruments, the accompanying time is limited, and the accompanying cost of professional accompanying teachers is higher.

Except real person online guidance, most of the existing musical instrument accompanying schemes adopt a camera and recording mode to carry out accompanying guidance on children, the accompanying mode adopts a camera to shoot actions of the children, and a microphone collects sound. The partner training mode can basically achieve the purpose of partner training and guidance in theory, but in the practical application process, the camera is greatly influenced by the difference of shooting angles, ambient light and terminal equipment, the recognition effect error is large, and the partner training guidance effect is poor.

SUMMERY OF THE UTILITY MODEL

The object of the present invention is to solve at least one of the problems of the prior art mentioned above, and the object is achieved by the following technical solutions:

a first aspect of the present invention provides a wearable device worn on an arm, the wearable device including: the voice acquisition module is arranged on the wearable equipment and acquires an audio signal caused by playing the musical instrument with the fingers; the action acquisition module is arranged at a position, close to the skin of the wearing part, on the wearable equipment and acquires action signals of the skin of the wearing part caused by playing the musical instrument with the fingers; the processing module is electrically connected with the voice acquisition module and the action acquisition module and is used for identifying the audio signals and the action signals; and the communication module is electrically connected with the processing module and sends the audio signal and the action signal identified by the processing module to the terminal.

Preferably, the action acquisition module comprises an electromyography sensor or an electromyography sensor array, and the electromyography sensor or the electromyography sensor array acquires an electromyography signal of skin at a wearing position caused by the finger playing instrument.

Preferably, the action acquisition module comprises a plurality of groups of electromyography sensors which are distributed at intervals along the circumferential direction of the arm and correspond to the plurality of fingers, and the distance between two adjacent electromyography sensors in each group of electromyography sensors corresponds to the distribution density of muscle cells on the skin of the wearing position.

Preferably, the distance between two adjacent electromyographic sensors in each group of electromyographic sensors is 12 mm.

Preferably, the motion collection module further comprises a vibration sensor for collecting a vibration signal on the skin of the wearing place caused by the fingering of the musical instrument.

Preferably, the action acquisition module includes a plurality of vibrations sensors, and a plurality of vibrations sensors distribute on wearable equipment along circumference and correspond with multiunit flesh electric sensor and be located the position of a plurality of hand muscle, and a plurality of vibrations sensors and multiunit flesh electric sensor form a plurality of sensor arrays on wearable equipment.

Preferably, wearable equipment still includes signal amplifier and the right leg electrode of being connected with the flesh electricity sensor, and the flesh electricity signal that flesh electricity sensor gathered transmits to signal amplifier after through right leg electrode steady voltage.

Preferably, the wearable device comprises a main body and a wearing part which is arranged on the main body and is wound around the arm, wherein the main body is provided with a first rectangular array formed by the electromyographic sensors, one electromyographic sensor arranged in the center of the first rectangular array and two vibration sensors positioned on two sides of the first rectangular array, and at least one of the two wearing parts on two sides of the main body is provided with a second rectangular array formed by the electromyographic sensors and one vibration sensor positioned on one side, far away from the main body, of the second rectangular array.

Preferably, the side, close to the arm, of the motion acquisition module is provided with an arc-shaped structure matched with the arm, and/or the voice acquisition module is arranged on the side, located on the finger, of the main body.

A second aspect of the present invention provides a musical instrument training system including: two wearable devices respectively worn on two arms, the two wearable devices collecting audio signals caused by a finger playing instrument and motion signals on the arms, the wearable devices being the wearable devices according to the first aspect of the present invention; the terminal is connected with the two wearable devices in a communication mode, receives the action signals and the audio signals collected by the two wearable devices, and analyzes the corresponding degree of the action signals and the audio signals and the music score of the musical instrument.

The person skilled in the art can understand that the wearable device of the present invention performs the audio signal associated with the musical instrument played by fingers and the action signal of the muscle on the arm by means of voice collection and action collection, the action signal collects the myoelectric signal and the vibration signal generated by the muscle change of the arm driven by the movement of the fingers through the action collection module attached to the skin of the arm, then the processing module performs a series of signal processing to identify which finger or which fingers are specifically acted by combining the myoelectric signal and the vibration signal, then the collected and identified audio signal and action signal are transmitted to the terminal through the communication module, the terminal receives the action signal and audio signal collected by the wearable device, analyzes the corresponding degree of the action signal and audio signal with the music score of the musical instrument, and displays the corresponding degree of the action signal and audio signal with the music score of the musical instrument on the terminal, thereby achieving the purpose of partner training and guidance.

Furthermore, the utility model discloses a method for carrying out voice acquisition and action acquisition on the audio signals associated with the finger playing musical instrument and the action signals of muscles on the arms without being influenced by the surrounding environment, and the method has the advantages of wide application range and high recognition success rate.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the utility model. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

fig. 1 is a top view of a wearable device of one embodiment of the utility model.

Fig. 2 is a side view of the wearable device shown in fig. 1.

Fig. 3 is a schematic structural diagram of an internal circuit of the wearable device shown in fig. 1.

Fig. 4 is a schematic structural diagram of a voice capture module of the wearable device shown in fig. 1.

FIG. 5 is a distribution diagram of two adjacent electromyographic sensors according to one embodiment of the utility model.

Fig. 6 is a schematic structural diagram of an instrument partner training system according to an embodiment of the present invention.

Wherein the reference numbers are as follows:

100. a wearable device; 101. a main body; 102. a left strap; 103. a right strap; 10. a voice acquisition module; 20. an electromyographic sensor; 21. a second electromyographic sensor array; 30. a shock sensor; 40. a right leg electrode; 50. a processing module; 60. a communication module; 70. a signal amplifier; 80. a processing circuit; 200. and (4) a terminal.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art. It should be noted that the combination of the smart bracelet and the wearable device of the present invention is only a preferred embodiment, and is not intended to limit the protection scope of the wearable device of the present invention, for example, the wearable device of the present invention may be a stand-alone partner training device, or be combined with other electronic products with similar structures, such as a smart watch, and the like, and such adjustment does not depart from the protection scope of the wearable device of the present invention.

It is to be understood that the terminology used herein is for the purpose of describing particular example embodiments only, and is not intended to be limiting. As used herein, the singular forms "a", "an" and "the" may be intended to include the plural forms as well, unless the context clearly indicates otherwise. The terms "comprising," "including," and "having" are inclusive and therefore specify the presence of stated features, elements, and/or components, but do not preclude the presence or addition of one or more other features, elements, components, and/or groups thereof.

Although the terms first, second, etc. may be used herein to describe various elements, components, regions, layers and/or sections, these elements, components, regions, layers and/or sections should not be limited by these terms. These terms may be only used to distinguish one element, component, region, layer or section from another region, layer or section. Terms such as "first," "second," and other numerical terms when used herein do not imply a sequence or order unless clearly indicated by the context. In addition, in the description of the present invention, unless otherwise explicitly specified or limited, the terms "disposed" and "connected" are to be construed broadly, e.g., as a fixed connection, a removable connection, or an integral connection; may be directly connected or indirectly connected through an intermediate. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.

For convenience of description, spatially relative terms, such as "upper", "left", "circumferential", "right", "side", and the like, may be used herein to describe one element or feature's relationship to another element or feature as illustrated in the figures. This spatially relative relationship is intended to encompass different orientations of the mechanism in use or operation in addition to the orientation depicted in the figures. For example, if the mechanism in the figures is turned over, elements described as "below" or "beneath" other elements or features would then be oriented "above" or "over" the other elements or features. Thus, the example term "below … …" can include both an orientation of above and below. The mechanism may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly.

Fig. 1 is a top view of a wearable device according to an embodiment of the present invention, fig. 2 is a side view of the wearable device shown in fig. 1, fig. 3 is a schematic structural diagram of an internal circuit of the wearable device shown in fig. 1, fig. 4 is a schematic structural diagram of a voice acquisition module of the wearable device shown in fig. 1, and fig. 5 is a distribution diagram of two adjacent electromyographic sensors according to an embodiment of the present invention.

As shown in fig. 1 to 5, a first aspect of the present invention provides a wearable device 100, the wearable device 100 is worn on the arm, the wearable device 100 includes a voice capture module 10, a motion capture module (described in detail below), a processing module 50, and a communication module 60 (shown in fig. 6), the voice capture module 10 is disposed on the wearable device 100, and collects the audio signal caused by the finger playing instrument, the motion collection module is arranged on the wearable device 100 at the position close to the skin of the wearing position, and collects the action signal of the skin of the wearing part caused by the finger playing instrument, the processing module 50 is electrically connected with the voice collecting module 10 and the action collecting module, and identifies the audio signal and the action signal, the communication module 60 is electrically connected with the processing module 50, and transmits the audio signal and the motion signal recognized by the processing module 50 to the terminal 200.

In this embodiment, the wearable device 100 of the present invention performs a voice capture and motion capture mode to perform an audio signal and a motion signal of an arm muscle associated with a musical instrument played by a finger, the motion signal captures an electromyographic signal and a vibration signal generated by a change of the arm muscle driven by a motion of the finger through a motion capture module attached to a skin of the arm, the processing module 50 performs a series of signal processing in combination with the electromyographic signal and the vibration signal to identify which finger or fingers are in motion, and then transmits the captured and identified audio signal and motion signal to the terminal 200 through a ble (bluetooth Low energy) antenna through the communication module 60, the terminal 200 receives the motion signal and audio signal captured and identified by the wearable device 100, analyzes a degree of correspondence between the motion signal and audio signal and a music score of the musical instrument, and displays the degree of correspondence between the motion signal and audio signal and the music score of the musical instrument on the terminal 200, thereby achieving the purpose of partner training and guidance.

It should be noted that the wearable device 100 of the present invention can be a stand-alone partner training device, and can also be configured to be combined with a smart bracelet or other electronic product, such as a smart watch, for example, according to an embodiment of the present invention, in order to facilitate understanding of the specific structure of the wearable device 100 of the present invention, the present specification explains technical features and technical effects of the wearable device 100 of the present invention by combining the wearable device 100 with a smart band as a preferred embodiment, the smart band includes a main body 101, straps connected to both sides of the main body 101, the straps include a left strap 102 and a right strap 103 located on both sides of the main body 101, the main body 101 is closely attached to the skin of an arm in an approximately parallel manner by the straps, a motion capture module is provided inside the main body 101 and/or the left and right straps, therefore, the action acquisition module can be tightly attached to the skin of an arm to acquire the electromyographic signals and the vibration signals generated by skin vibration.

Specifically, according to the embodiment of the present invention, the motion collection module includes an electromyography sensor 20 or an electromyography sensor array, and the electromyography sensor 20 or the electromyography sensor array collects an electromyography signal at the skin of the wearing place caused by the fingering of the musical instrument. Specifically, when the fingers play the musical instrument, the arm muscle changes caused by each playing action of the fingers are different, and the myoelectric signals generated by the arm muscle changes are also different, so that after the processing module 50 of the wearable device 100 analyzes a large number of collected myoelectric signals, the action signal corresponding to each playing action can be extracted, and a finger action signal library corresponding to the musical instrument played by the fingers is established, thereby completing the action recognition process matched with the myoelectric signals.

Further, since the muscle positions of each finger and the arm involved in each motion are different, in order to comprehensively collect motion signals during playing of the fingers, the embodiment of the present invention provides that the motion collection module is provided with a plurality of electromyographic sensors 20 distributed at intervals along the circumferential direction of the arm, and the plurality of electromyographic sensors 20 are used for comprehensively collecting all motion signals during playing of the musical instrument.

In addition, in order to improve the accuracy of the action signal collected by the action collection module at the position of the arm corresponding to the finger, the embodiment of the utility model further provides that a group of electromyographic sensors 20 is arranged at the position of the arm corresponding to the finger, and the accuracy of electromyographic signal collection is improved through a plurality of electromyographic signals collected by a plurality of electromyographic sensors 20 in the group of electromyographic sensors 20.

According to the embodiment of the utility model, in order to achieve the accuracy of collecting multiple muscle cells corresponding to multiple fingers on an arm, the embodiment of the utility model provides that the motion collection module is configured to include multiple groups of electromyographic sensors 20 which are distributed at intervals along the circumferential direction of the arm and correspond to the multiple fingers, and the distance between two adjacent electromyographic sensors 20 in each group of electromyographic sensors 20 corresponds to the distribution density of the muscle cells on the skin where the user wears the wrist. It should be noted that, the distance between two adjacent electromyographic sensors 20 is not strictly required at present, theoretically, the distance between two adjacent electromyographic sensors 20 is related to the number of muscle cells contained, the distance between two adjacent electromyographic sensors 20 is too close to include too few muscle cells, the electromyographic signals are weak, the distance between two adjacent electromyographic sensors 20 is too far to include too many electromyographic cells, the range is too large, and the identification of fine movements is not facilitated, as shown in fig. 5, in the embodiment of the present invention, the distance between two adjacent electromyographic sensors 20 is 12mm, and the diameter of the electromyographic sensor 20 is 6mm and the length is 3mm, so that the purposes of acquiring fine movement signals and acquiring strong electromyographic signals can be achieved.

Further, in order to improve the sensitivity of the electromyographic sensor 20, the embodiment of the utility model further provides that one side of the electromyographic sensor 20, which is attached to the arm, is set to be a cambered surface structure matched with the arm, specifically, the top end of the electromyographic sensor 20 is set to be arc-shaped gold-plated stainless steel, so that the contact effect of the electromyographic sensor 20 and the arm skin is improved, and the electric conduction effect between the electromyographic sensor 20 and the arm skin is improved.

According to the embodiment of the present invention, in order to further improve the accuracy of acquiring the motion signals of a plurality of muscle cells corresponding to a plurality of fingers on the arm, the embodiment of the present invention proposes that the motion acquisition module further comprises a vibration sensor 30, and the vibration sensor 30 acquires the vibration signals on the arm caused by playing the musical instrument with the fingers.

Specifically, the vibration sensor 30 may be an electrodynamic type, a piezoelectric type, an eddy current type, an inductive type, a capacitive type, a resistive type, or a photoelectric type, and according to the preferred embodiment of the present invention, the vibration sensor 30 is an inductive type, and by attaching the acceleration sensor to the skin, the muscle movement drives the inductance data of the acceleration sensor to change, and the vibration sensor 30 may assist the electrical sensor to collect the vibration of the arm muscle caused by playing the instrument with the finger, and more accurately determine the motion signal caused by playing the instrument with the finger according to the vibration signal of the arm muscle.

Further, the motion collection module includes a plurality of vibrations sensors 30, and a plurality of vibrations sensors 30 distribute on wearable device 100 along circumference and correspond with multiunit flesh electric sensor 20 and be located the position of a plurality of hand muscle, and a plurality of vibrations sensors 30 and multiunit flesh electric sensor 20 form a plurality of sensor arrays on wearable device 100. The vibration sensor 30 can assist the multiple groups of electric sensors in collecting vibration of multiple arm muscles caused by playing the instrument with the fingers, and can more accurately judge which part of the muscles changes most intensely and the direction of the vibration of the muscles according to multiple vibration signals of the arm muscles, so as to identify which finger or fingers are playing, and further improve the collection accuracy of action signals of multiple muscle cells corresponding to the multiple fingers on the arm.

According to the embodiment of the utility model, wearable devices 100 are worn on both arms, and the processing module 50 respectively receives a plurality of electromyographic signals detected by a plurality of groups of electromyographic sensors 20 on both wearable devices 100 and a plurality of vibration signals detected by a plurality of vibration sensors 30, and generates action signals after correcting and identifying the plurality of electromyographic signals through the plurality of vibration signals. The processing module 50 corrects and identifies the plurality of electromyographic signals through the plurality of vibration signals to generate action signals, so as to accurately judge which part of muscles change most intensely and the direction of muscle vibration, and further identify which finger or fingers play actions, thereby improving the collection accuracy of the action signals of a plurality of muscle cells corresponding to the plurality of fingers on the arm.

As shown in fig. 3, the processing module 50 runs in a main control mcu (microcontroller unit) of the processing module 50, after the circuits of the electromyographic sensor 20 and the vibration sensor 30 transmit the collected and processed signals to the mcu (microcontroller unit), the mcu (microcontroller unit) respectively transmits the signals to the terminal 200 through communication lines by recognizing actions, and the terminal 200 displays the corresponding moving fingers on app (application), so as to complete the recognition of the finger playing action. Specifically, the electromyographic signal is transmitted to the processing circuit 80 of the processing module 50 through the electrode of the electromyographic sensor 20, the vibration signal is transmitted to the processing circuit 80 of the processing module 50 through the electrode of the vibration sensor 30, the processing circuit 80 includes an INA circuit, an OPA circuit and an ADC chip, specifically, the electromyographic signal and the vibration signal are subjected to first filtering through an INA (inertial) amplification circuit, small-signal amplification is performed, second signal amplification is performed through an OPA (optimal amplification) circuit, the Analog-to-Digital Converter ADC chip converts the Analog signal into a Digital signal, and finally the Digital signal is transmitted to the mcu (microcontroller unit) of the processing module 50 through the SPI circuit.

According to an embodiment of the present invention, the wearable device 100 includes a main body 101 and a band provided on the main body 101 and wrapped around an arm, the main body 101 is provided with a first electromyographic sensor array (the first electromyographic sensor array is not separately labeled in consideration of the clarity of fig. 1), and two vibration sensors 30 are provided on both sides of the main body 101 in a circumferential direction, and the two band portions of the band located on both sides of the main body 101 are provided with a second electromyographic sensor array 21 and a vibration sensor 30.

Specifically, as shown in fig. 1 and 3, the electromyographic signals and the vibration signals of the arm muscles are collected by 8 sets of electromyographic sensors 20 distributed on the main body 101 and the left and right straps, one right leg electrode 40, and 4 HSACCs (High Speed electromyographates) distributed on the main body 101 and the left and right straps. The motion acquisition module mainly comprises two parts, one part is a circuit connected with the electromyography sensor 20, the other part is a circuit composed of 4 groups of High Speed Acceleromettes (HSACCs) 30, wherein the electromyography sensor 20 is a main identification part and used for acquiring electromyography signals of muscles, and the HSACC 30 is an auxiliary identification part and used for sensing muscle vibration caused by finger playing and correcting errors of the electromyography signals. The two parts are connected with a master control MCU (microcontroller Unit) through an SPI bus. The signal amplifier 70 and the right leg electrode 40 are both electrically connected to the electromyographic sensor 20, the right leg electrode 40 is used for improving the anti-interference capability of the bioelectrical signal amplifier 70 and outputting the electromyographic signals collected by the electromyographic sensor 20, and the electromyographic signals collected by the electromyographic sensor 20 are transmitted to the processing module 50 after being amplified by the signal amplifier 70 and stabilized by the right leg electrode 40 in sequence.

It should be noted that the right leg electrode in the embodiment of the present invention is derived from a right leg driving circuit for stabilizing a bioelectrical amplifier in an electrocardiograph, and the specific circuit of the right leg electrode in the embodiment of the present invention may refer to the right leg driving circuit in the electrocardiograph, and will not be described in detail herein.

As shown in fig. 2, 4 and 6, the voice collecting module 10 is disposed on the main body 101, and the voice collecting module 10 mainly includes two parts: the digital MIC and the audio processing DSP (digital Signal processing), the audio processing DSP (digital Signal processing) is a chip specially used for audio processing, 8Mb Flash is supported on the chip, a voice recognition algorithm can be built in, the digital MIC and the main control MCU (microcontroller Unit) communicate through an I2C/I2S bus, the digital MIC collects audio signals caused when fingers are played, and the audio processing DSP (digital Signal processing) transmits recognition results to the main control MCU (microcontroller Unit) through Signal processing and voice recognition algorithms to complete voice recognition.

With continued reference to fig. 1 to 5, according to the preferred embodiment of the present invention, in a wearable device 100 that is a stand-alone device, the wearable device 100 includes a main body 101 and a band (including a left band 102 and a right band 103) that is disposed on the main body 101 and wraps around an arm, a motion collection module and a voice collection module 10 are disposed on the main body 101 and/or the band, specifically, a plurality of groups of electromyographic sensors 20 in the motion collection module are circumferentially distributed on the main body 101 and the left and right bands, a plurality of vibration sensors 30 in the motion collection module are circumferentially distributed on the main body 101 and the left and right bands, and a side of the motion collection module that is attached to the arm is configured as an arc structure that is matched with the arm, the voice collection module 10 is disposed on the main body 101, and the voice collection module 10 is disposed on the main body 101 and is located on one side of a finger.

According to an embodiment of the present invention, the wearable device 100 includes a main body 101 and a wearing part provided on the main body 101 and wrapped around an arm, the main body 101 is provided with a first rectangular array formed by four electromyographic sensors 20 and one electromyographic sensor 10 provided in the center of the first rectangular array and two vibration sensors 30 located on both sides of the first rectangular array, at least one of the two wearing parts on both sides of the main body 101 is provided with a second rectangular array formed by six electromyographic sensors 20 and one vibration sensor 30 located on a side of the second rectangular array away from the main body 101.

Specifically, four myoelectric sensors 20 included in the first rectangular array are respectively located at four corners of the first rectangular array, six myoelectric sensors 20 included in the second rectangular array are arranged in three rows along the length direction of the wearing portion, and two myoelectric sensors 20 are distributed in each row.

The embodiment of the present invention proposes that the motion acquisition module is configured to include a plurality of sets of electromyographic sensors 20 that are distributed at intervals in the circumferential direction of the arm and correspond to the plurality of fingers, so as to achieve the accuracy of acquiring a plurality of electromyographic signals of a plurality of muscle cells corresponding to the plurality of fingers on the arm, and that the motion acquisition module is configured to further include a plurality of vibration sensors 30 that are distributed at intervals in the circumferential direction of the arm and correspond to the plurality of fingers and a plurality of tendons. Specifically, as shown in fig. 1, the plurality of vibration sensors 30 includes four vibration sensors 30 located at a1, a2, B1 and B2, taking the example that the wearable device 100 includes a main body 101, a left strap 102 and a right strap 103, a1 is located on the main body 101 at a side of the left strap 102, a2 is located on the main body 101 at a side of the right strap 103, B1 is located on the left strap 102 at a side away from the main body 101, B2 is located on the right strap 103 at a side away from the main body 101, a1 and a2 are located on the wearable device 100 at a side corresponding to the back of the hand, and B1 and B2 are located on the wearable device 100 at a side corresponding to the center of the hand, so as to achieve accuracy in acquiring a plurality of vibration signals of a plurality of muscle cells corresponding to a plurality of fingers on the arm.

As shown in fig. 6, a second aspect of the present invention provides an instrument training system, comprising: two wearable devices 100 respectively worn on two arms, the two wearable devices 100 collecting an audio signal caused by a finger playing instrument and a motion signal on the arm, the wearable device 100 being the wearable device 100 according to the first aspect of the present invention; and the terminal 200 is in communication connection with the two wearable devices 100, and the terminal 200 receives the action signals and the audio signals collected by the two wearable devices 100 and analyzes the corresponding degrees of the action signals and the audio signals and the music scores of the musical instruments.

When the musical instrument accompanying system is used, two hands respectively wear one wearable device 100, because the wearable devices 100 are tightly attached to the skin, the myoelectric signals and the vibration signals of arm muscles caused by playing the musical instrument with the fingers are acquired in a sensor sensing mode, the mode is not influenced by the surrounding environment, light and the terminal 200, the action recognition of playing the musical instrument with the fingers can be more accurately carried out, and then a child is better guided to carry out musical instrument practice. In addition, the musical instrument training system of the second aspect of the present invention has all the technical effects of the wearable device 100 of the first aspect of the present invention, and will not be described herein again in a polarity.

The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Claims

1. A wearable device worn on an arm, the wearable device comprising:

the voice acquisition module is arranged on the wearable equipment and acquires an audio signal caused by playing a musical instrument with fingers;

the action acquisition module is arranged at a position, close to the skin of a wearing part, on the wearable device and acquires action signals of the skin of the wearing part caused by playing the musical instrument with fingers;

the processing module is electrically connected with the voice acquisition module and the action acquisition module and is used for identifying the audio signal and the action signal;

and the communication module is electrically connected with the processing module and sends the audio signal and the action signal identified by the processing module to a terminal.

2. The wearable device of claim 1, wherein the motion acquisition module comprises an electromyographic sensor or an array of electromyographic sensors that acquire electromyographic signals of the skin of the wearing location caused by fingers playing the instrument.

3. The wearable device according to claim 2, wherein the motion acquisition module comprises a plurality of groups of electromyography sensors distributed at intervals along the circumferential direction of the arm and corresponding to a plurality of fingers, and the distance between two adjacent electromyography sensors in each group of electromyography sensors corresponds to the distribution density of muscle cells on the skin of the wearing part.

4. Wearable device according to claim 3, characterized in that the distance between two adjacent electromyographic sensors of each group is 12 mm.

5. The wearable device according to claim 3, wherein the motion capture module further comprises a shock sensor that captures a shock signal on the skin of the wearing site caused by fingering the instrument.

6. The wearable device according to claim 5, wherein the motion acquisition module comprises a plurality of vibration sensors, the plurality of vibration sensors are circumferentially distributed on the wearable device and correspond to the plurality of groups of electromyographic sensors and are located at positions of a plurality of hand tendons, and the plurality of vibration sensors and the plurality of groups of electromyographic sensors form a plurality of sensor arrays on the wearable device.

7. The wearable device according to claim 2, further comprising a signal amplifier and a right leg electrode connected to the electromyographic sensor, wherein the electromyographic signal collected by the electromyographic sensor is transmitted to the signal amplifier after being stabilized by the right leg electrode.

8. The wearable device according to claim 6, comprising a main body and a wearing part provided on the main body and wrapped around an arm, wherein the main body is provided with a first rectangular array formed by electromyographic sensors and one electromyographic sensor provided in the center of the first rectangular array and two of the vibration sensors located on both sides of the first rectangular array, and at least one of the two wearing parts on both sides of the main body is provided with a second rectangular array formed by electromyographic sensors and one of the vibration sensors located on a side of the second rectangular array away from the main body.

9. The wearable device according to claim 8, wherein the side of the motion capture module abutting the arm is configured as a curved surface configured to engage the arm, and/or the voice capture module is configured on the side of the body located on the finger.

10. An instrument sparring system, comprising:

two wearable devices respectively worn on two arms, the two wearable devices acquiring audio signals caused by a finger playing instrument and motion signals on the arms, the wearable devices being the wearable device according to any one of claims 1 to 9;

the terminal, the terminal with two wearable equipment communication is connected, the terminal receives two wearable equipment gathers action signal with audio signal, and the analysis action signal with audio signal with the corresponding degree of the music book of musical instrument.