CN113856213B

CN113856213B - Music interactive toy for assisting self-closing child movement rehabilitation

Info

Publication number: CN113856213B
Application number: CN202111085792.3A
Authority: CN
Inventors: 包德福; 应杰; 吴桐叶; 史钰波; 沈丹妮
Original assignee: Zhejiang Sci Tech University ZSTU
Current assignee: Zhejiang Sci Tech University ZSTU
Priority date: 2021-09-16
Filing date: 2021-09-16
Publication date: 2023-07-04
Anticipated expiration: 2041-09-16
Also published as: CN113856213A

Abstract

The invention discloses a music interactive toy for assisting in self-closing children in sports rehabilitation, which comprises a shell, wherein the shell comprises a top shell and a bottom shell which is spliced with the top shell, a placing cavity is formed between the top shell and the bottom shell, an electric device is arranged in the placing cavity, the electric device comprises a DLP projection main body, an acoustic main body, a Kinect main body and a NUC host, the acoustic main body, the Kinect main body and the DLP projection main body are electrically connected with the NUC host, the NUC host is connected with an electric plug for connecting a power supply, music interaction and limb coordination rehabilitation training are combined, information is obtained through projection, and body feeling interaction is carried out through the Kinect main body, music response is triggered, a new entertainment training mode is brought for a self-closing family, a new communication mode is provided, and the music interactive mode is more interesting and social value.

Description

Music interactive toy for assisting self-closing child movement rehabilitation

Technical Field

The invention relates to a music interactive toy, in particular to a music interactive toy for assisting self-closing child motion rehabilitation, and belongs to the field of interactive toys.

Background

The existing autism rehabilitation products are too biased to tradition, the interactive rehabilitation products produced in mass on the market are single in form, the interactive toys are low in interesting and rehabilitation fine action training combination degree, and the rehabilitation training of the autism patients at home is difficult to meet.

The invention brings a new entertainment training mode for autism families through somatosensory interaction technology and projection technology, provides a new communication mode, and provides an interactive product design with more interestingness and social value in a music interaction mode.

Disclosure of Invention

In order to solve the problems in the prior art, the invention provides the music interactive toy which has the technical characteristics of being capable of interacting music with limb coordination rehabilitation training and the like and is used for assisting the self-closing child to exercise and rehabilitation.

In order to achieve the above purpose, the present invention is realized by the following technical scheme:

the invention relates to a music interactive toy for assisting self-closing children in motion rehabilitation, which comprises a shell, wherein the shell comprises a top shell and a bottom shell which is spliced with the top shell, a placing cavity is formed between the top shell and the bottom shell, an electric device is arranged in the placing cavity and comprises a DLP projection main body, an acoustic main body, a Kinect main body and a NUC main body, the acoustic main body, the Kinect main body and the DLP projection main body are electrically connected with the NUC main body, and the NUC main body is connected with an electric plug for connecting a power supply;

the bottom shell comprises a bottom plate and an end face connected around the bottom plate, the middle part of the bottom plate is connected with two partition plates, the NUC host is installed between the two partition plates, the rear end of the bottom plate is connected with a mounting frame, the projection main body is installed in the mounting frame, the front part of the bottom plate is connected with two brackets, a first supporting plate and a second supporting plate are connected between the two brackets, the first supporting plate and the second supporting plate form a Kinect bracket 8, the first supporting plate is obliquely arranged, the Kinect main body is placed on the first supporting plate and is supported by the second supporting plate to prevent the Kinect main body from sliding downwards, and the Kinect main body comprises a depth identification lens, a camera and a laser identification lens;

the DLP projection main body comprises a DLP chip and a projection lens electrically connected with the DLP chip, the DLP chip is arranged at the top of the DLP projection main body, the projection lens is connected to the rear end of the DLP projection main body, a projection hole corresponding to the projection lens is formed in the rear end face of the bottom shell, the DLP projection main body can project visual information through the projection hole through the projection lens, a user can make corresponding triggering actions according to the visual information, the Kinect main body receives triggering action information from the outside through a depth recognition lens, a camera and a laser recognition lens in a recognition mode and transmits signals to a NUC host, and the NUC host controls a sound main body 14 to play corresponding music.

Preferably, an arc notch is recessed in the upper edge of the front end face of the bottom shell, a Kinect image transparent plate is protruded on the front end edge of the top shell 2, the Kinect image transparent plate is matched with the arc notch to be spliced, and the depth recognition lens, the camera and the laser recognition lens are all arranged towards the Kinect image transparent plate;

the first supporting plate is inclined by 10 degrees, the second supporting plate 22 is vertically connected to the first supporting plate, the Kinect supporting plate 8 is close to the Kinect image transparent plate, and the Kinect image transparent plate can enable the depth recognition lens, the camera and the laser recognition lens to recognize external human body action information.

Preferably, the top shell is a black shell formed by spraying an acrylic full-transparent material, the Kinect image transparent plate is made of the acrylic full-transparent material, and the bottom shell is a white shell formed by spraying the acrylic full-transparent material;

the left end part and the right end part of the bottom plate are respectively provided with an acoustic main body, acoustic holes are formed on the left end surface and the right end surface of the bottom shell, radiating holes are formed on the bottom plate between the partition plates and the bottom plate in the mounting frame, a projection hole is inlaid at the rear part of the bottom shell, the projection hole is covered with a cover plate made of acrylic full-transparent materials, a plurality of shell buckles are connected around the inner side wall of the bottom shell, a plurality of buckling grooves are formed in the inner side wall of the top shell, the shell buckles correspond to the buckling grooves one to one, and the projection hole is used for connecting the top shell and the bottom shell.

Preferably, the audio body comprises an Arduino uno board with a storage module, audio and receiving commands are built in the Arduino uno board, a first operation command, a second operation command and a third operation command are respectively arranged in the Kinect body, the DLP projection body and the NUC host to realize different music interaction modes, the DLP projection body projects corresponding visual information through a projection hole through a projection lens according to the different second operation commands, a user makes corresponding triggering action according to the visual information, the Kinect body recognizes and receives triggering action information from the outside through a depth recognition lens, a camera and a laser recognition lens, the triggering action information can trigger the first operation command in the Kinect body, the first operation command is transmitted to the NUC host and triggers the third operation command, the third operation command in the NUC host is transmitted to the audio body and triggers the receiving command, the audio body controls playing of corresponding music through the receiving command, and the motion track of the storage module stores the action information.

The beneficial effects are that: the music interaction and limb coordination rehabilitation training are combined, information is obtained through projection, somatosensory interaction is carried out through a Kinect main body, music response is triggered, a new entertainment training mode is brought to autism families, a new communication mode is provided, and the music interaction mode is more interesting and social value.

Drawings

FIG. 1 is a schematic view of the disassembled structure of the present invention.

Fig. 2 is a schematic view of the structure of the bottom shell of the present invention.

Fig. 3 is one of the visual information diagrams of the present invention.

Fig. 4 is a second view of the visual information of the present invention.

FIG. 5 is a third view of the visual information of the present invention.

In the figure: 1-Kinect image transmission plate; 2-top shell; 3-Kinect host; 4-depth recognition lens; 5-camera; 6-laser recognition lens; the method comprises the steps of carrying out a first treatment on the surface of the 7-a shell buckle; 8-Kinect bracket; 9-DLP chip; a 10-DLP projection body; 11-heat dissipation holes; a 12-NUC host; 13-projection aperture; 14-an acoustic main body; 16-plug; 17-sound holes; 18-bottom shell; 19-a separator; 20-mounting a frame; 21-a first supporting plate; 22-a second supporting plate; 23-bracket.

Detailed Description

The present invention will be further described with reference to the accompanying drawings, but the present invention is not limited to the following examples.

1-5, a specific embodiment of a music interactive toy for assisting self-closing child motion rehabilitation is shown, the embodiment of the music interactive toy for assisting self-closing child motion rehabilitation comprises a shell, the shell comprises a top shell 2 and a bottom shell 18 spliced with the top shell 2, a placing cavity is formed between the top shell 2 and the bottom shell 18, an electric device is arranged in the placing cavity and comprises a DLP projection main body 10, an acoustic main body 14, a Kinect main body 3 and a NUC host 12, the acoustic main body 14, the Kinect main body 3 and the NUC projection main body 10 are electrically connected with the NUC host 12, and the NUC host 12 is connected with an electric plug 16 for connecting a power supply;

the bottom shell 18 comprises a bottom plate and an end face connected around the bottom plate, the middle part of the bottom plate is connected with two baffle plates 19, the NUC host 12 is arranged between the two baffle plates 19, the rear end of the bottom plate is connected with a mounting frame 20, the projection main body 10 is arranged in the mounting frame 20, the front part of the bottom plate is connected with two brackets 23, a first supporting plate 21 and a second supporting plate 22 are connected between the two brackets 23, the first supporting plate 21 and the second supporting plate 22 form a Kinect bracket 8, the first supporting plate 21 is obliquely arranged, the Kinect main body 3 is placed on the first supporting plate 21 and is supported by the second supporting plate 22 to prevent the Kinect main body 3 from sliding downwards, and the Kinect main body 3 comprises a depth recognition lens 4, a camera 5 and a laser recognition lens 6;

the DLP projection main body 10 comprises a DLP chip 9 and a projection lens electrically connected with the DLP chip 9, the DLP chip 9 is arranged at the top of the DLP projection main body 10, the projection lens is connected at the rear end of the DLP projection main body 10, a projection hole 13 corresponding to the projection lens is formed in the rear end face of the bottom shell 18, the projection hole 13 is an output point of the DLP projection main body 10, the DLP projection main body 10 can project visual information through the projection lens through the projection hole 13, the visual information is various, the design can be carried out according to actual needs, a user can make corresponding trigger actions according to the visual information, the Kinect main body 3 can recognize the trigger action information from the outside through the depth recognition lens 4, the camera 5 and the laser recognition lens 6 and transmit signals to the NUC main body 12, the NUC main body 12 controls the sound main body 14 to play corresponding music, the depth recognition lens 4, the camera 5 and the laser recognition lens 6 are matched, and the external actions are sensitive.

The invention can realize three music interaction modes (preferably three interaction modes can be added according to actual needs):

music interaction mode one: when the target user swings the arm according to the visual information projected by the DLP projection body 10 before the Kinect body 3 to complete the corresponding trigger action, and when the depth recognition lens 4, the camera 5 and the laser recognition lens 6 in the Kinect body 3 capture the trigger action of the target user, that is, when the right hand passes through the preset starting point and the preset end point, the NUC host 12 receives and processes the trigger action information, controls the sound body 14 to play music and stores the motion track, and the motion track is cancelled and the motion track is again dynamically captured at the right hand point until the right hand point to be captured next time is moved to any starting point for refreshing, so that the new track is stored, as shown in the graphic interactive content of fig. 3, the mode sets two motion forms of the big pizza from the upper side to the lower side and the egg from the left side to the right side, sound can be started only if any one of the two motion forms is performed, the sound part is sound recorded from high to low and stored in the sound body, and the music part of any one of the two motion forms is triggered only.

Music interaction mode two: as shown in fig. 4, the front section of the music piece of the small star is selected and divided into eight sections, the opening of each section needs to use the right hand tracked by the Kinect main body 3 to perform the track motion in front of the Kinect image transparent plate 1, the track motion rule is as shown in fig. 4, the first section corresponds to a horizontal line shape, the second section corresponds to a vertical line shape, the third section corresponds to an L shape, the fourth section corresponds to an inverted V shape, the fifth section corresponds to a vertical S shape, the sixth section corresponds to a horizontal S shape, the seventh section corresponds to a horizontal o shape, the eighth section corresponds to a C shape, when the right hand point tracked by the Kinect main body 3 starts from any one starting point to any one ending point, the track corresponding to the music section and the track of the tracked right hand point is left, the track motion is cleared from the left hand point from any starting point after the audio is played, the track and music is cleared again left, and the music is played once again, and the music content is fixed.

And a music interaction mode III: as shown in fig. 5, the front section of the music piece is divided into eight sections, the first section is corresponding to an O shape, the second section is corresponding to a transverse S shape, the third section is corresponding to an inverted V shape, the fourth section is corresponding to two inverted V shapes and one O shape, the fifth section is corresponding to a transverse S shape, the sixth section is corresponding to an inverted V shape, the seventh section is corresponding to two inverted V shapes, the eighth section is corresponding to a transverse straight line shape, when the tracked right-hand point is started from any starting point to any ending point, the corresponding music section is triggered and the track of the tracked right-hand point is left, when the audio is ended to play, the track of the motion left before the tracked right-hand point is emptied from any starting point, the track and music are re-left, the next music is played every time the track is refreshed, the internal music content is fixed, and the track of the music can be stored as required.

Depth recognition lens 4: the method is responsible for identifying the positioning of depth information capturing and capturing objects in space;

camera 5: identifying and capturing image information, so that the object is positioned more accurately;

laser recognition lens 6: the infrared transmitter emits a laser to cover the visible range of the whole Kinect main body 3, and the camera group (the depth recognition lens 4, the camera 5 and the laser recognition lens 6) receives reflected light to recognize the human body and then positions the human body;

DLP projection body 10: the module can give image feedback when a user uses the product to perform interactive playing, such as selecting model Ruiger 605;

acoustic main body 14: the main body comprises an arduino uno control board and an audio module, wherein the audio module is connected with the arduino uno control board, and when the arduino uno receives an instruction from the nuc host, the corresponding audio is played by the audio module;

kinect body 3: the main body is mainly responsible for receiving and identifying human body limb information, and then transmitting the information to the NUC host 12, for example, the host model is kinect1.0, and the main body comprises a control circuit board for receiving external human body limb information and transmitting information besides the depth lens 4, the RGB camera 5 and the laser identification lens 6.

NUC host 12: the main machine is mainly used for running the main program of the product, and belongs to a controller, when the Kinect main machine 3 transmits corresponding information to the NUC main machine 12, the NUC main machine 12 sends instructions to the sound main machine 14 to transmit audio information and transmit image information through the DLP projection 10 (the image information is generated by the NUC main machine 12, and the DLP projection main machine 10 is only used as a presenting medium), for example, the NUC main machine model is intel NUC8i5BEHS.

The above components are prior art, and should be understood in a broad sense, without specific limitation, as long as the functions thereof are required to be realized.

In a preferred embodiment, an arc notch is recessed at the upper edge of the front end face of the bottom shell 18, a Kinect image transparent plate 1 is protruded at the front end edge of the top shell 2, the Kinect image transparent plate 1 is matched with the arc notch to be spliced, the depth recognition lens 4, the camera 5 and the laser recognition lens 6 are all arranged towards the Kinect image transparent plate 1, the first support plate 21 is inclined by 10 degrees, the depth recognition lens 4, the camera 5 and the laser recognition lens 6 on the Kinect main body 3 can be inclined upwards by 10 degrees, the recognition range is larger, the second support plate 22 is vertically connected on the first support plate 21, the Kinect bracket 8 is close to the Kinect image transparent plate 1, the Kinect image transparent plate 1 can enable the depth recognition lens 4, the camera 5 and the laser recognition lens 6 to recognize external human body motion information, and the structure design is reasonable, and the recognition of external human body motion information is facilitated.

In a preferred embodiment, the top case 2 is a black case formed by spraying an acrylic full transparent material, the Kinect image transparent plate 1 is formed by spraying an acrylic full transparent material, the bottom case 18 is a white case formed by spraying an acrylic full transparent material, and the case has a simple structure and is suitable for processing and manufacturing;

the left end part and the right end part of the bottom plate are respectively provided with an acoustic main body 14 (comprising conventional equipment such as a loudspeaker and the like), acoustic holes 17 are formed on the left end surface and the right end surface of the bottom shell 18, radiating holes 11 are formed on the bottom plate between the partition plates 19 and the bottom plate in the mounting frame 20, a projection hole 13 is inlaid at the rear part of the bottom shell 18, the projection hole 13 is covered with a cover plate made of acrylic full-transparent materials, a plurality of shell buckles 7 are connected around the inner side wall of the bottom shell 18, a plurality of buckling grooves are formed in the inner side wall of the top shell 2, the shell buckles 7 correspond to the buckling grooves one to one, and the projection hole is used for connecting the top shell 2 and the bottom shell 18 in the bottom shell 18, and the projection hole is simple in structure and high in practicality.

In a preferred embodiment, the audio body 14 includes an Arduino uno board with a storage module, audio and receiving commands are built in the Arduino uno board, a first operation instruction, a second operation instruction and a third operation instruction are respectively set in the Kinect body 3, the DLP projection body 10 and the NUC host 12 to implement different music interaction modes, the corresponding visual information is projected by the DLP projection body 10 through the projection lens through the projection hole 13 according to the different second operation instructions (which may be randomly transmitted or transmitted according to the remote control terminal), the user makes a corresponding triggering action according to the visual information, the Kinect body 3 recognizes that the triggering action information from the outside is received through the depth recognition lens 4, the camera 5 and the laser recognition lens 6, the triggering action information can trigger the first operation instruction in the Kinect body 3, the first operation instruction is transmitted to the NUC host 12 and triggers the third operation instruction, the third operation instruction in the NUC host 12 is transmitted to the audio body 14 and the audio body 14 is triggered and the corresponding action information is received, and the audio motion track is stored in the storage module.

Finally, it should be noted that the invention is not limited to the above embodiments, but that many variants are possible. All modifications directly derived or suggested to one skilled in the art from the present disclosure should be considered as being within the scope of the present invention.

Claims

1. The utility model provides an supplementary self-closing children motion recovered music interactive toy, includes casing, its characterized in that: the shell comprises a top shell (2) and a bottom shell (18) spliced with the top shell (2), a placing cavity is formed between the top shell (2) and the bottom shell (18), an electric device is arranged in the placing cavity, the electric device comprises a DLP projection main body (10), an acoustic main body (14), a Kinect main body (3) and a NUC host (12), the acoustic main body (14), the Kinect main body (3) and the DLP projection main body (10) are electrically connected with the NUC host (12), and the NUC host (12) is connected with an electric plug (16) for connecting a power supply;

the DLP projection main body (10) comprises a DLP chip (9) and a projection lens electrically connected with the DLP chip (9), the DLP chip (9) is arranged at the top of the DLP projection main body (10), the projection lens is connected to the rear end of the DLP projection main body (10), a projection hole (13) corresponding to the projection lens is formed in the rear end face of the bottom shell (18), the DLP projection main body (10) can project visual information through the projection hole (13) through the projection lens, a user can make corresponding triggering action according to the visual information, the Kinect main body (3) can recognize the triggering action information received from the outside through the depth recognition lens (4), the camera (5) and the laser recognition lens (6) and transmit signals to the NUC host (12), and the NUC host (12) controls the acoustic main body (14) to play corresponding music;

the bottom shell (18) comprises a bottom plate and an end face connected around the bottom plate, the middle part of the bottom plate is connected with two partition plates (19), the NUC host (12) is installed between the two partition plates (19), the rear end of the bottom plate is connected with a mounting frame (20), the projection main body (10) is installed in the mounting frame (20), the front part of the bottom plate is connected with two brackets (23), a first support plate (21) and a second support plate (22) are connected between the two brackets (23), the first support plate (21) and the second support plate (22) form a Kinect bracket (8), the first support plate (21) is obliquely arranged, the Kinect main body (3) is placed on the first support plate (21) and is supported by the second support plate (22) to prevent the Kinect main body (3) from sliding downwards, and the Kinect main body (3) comprises a depth recognition lens (4), a camera (5) and a laser recognition lens (6);

the upper edge of the front end face of the bottom shell (18) is sunken with an arc notch, the front end edge of the top shell (2) is protruded with a Kinect image transparent plate (1), the Kinect image transparent plate (1) is matched with the arc notch to be spliced, and the depth recognition lens (4), the camera (5) and the laser recognition lens (6) are arranged towards the Kinect image transparent plate (1); the left end part and the right end part of the bottom plate are respectively provided with an acoustic main body (14);

the audio main body (14) comprises an Arduino uno board with a storage module, audio and receiving commands are built in the Arduino uno board, a Kinect main body (3), a DLP projection main body (10) and a NUC host (12) are respectively provided with a plurality of first operation commands, a plurality of second operation commands and a plurality of third operation commands to realize different music interaction modes, the DLP projection main body (10) projects corresponding visual information through a projection hole (13) according to the different second operation commands, a user makes corresponding triggering actions according to the visual information, the Kinect main body (3) recognizes and receives triggering action information from the outside through a depth recognition lens (4), a camera (5) and a laser recognition lens (6), the triggering action information can trigger the first operation commands in the Kinect main body (3), the first operation commands are transmitted to the NUC host (12) and trigger the third operation commands, the third operation commands in the NUC host (12) are transmitted to the audio main body (14) and receive the triggering action commands, and the audio main body (14) stores the corresponding action commands;

the depth recognition lens (4) is responsible for recognizing the positioning of the depth information capturing object in the space; the camera (5) is used for recognizing and capturing image information, so that the object is positioned more accurately, the laser recognition lens (6) is used for emitting laser to cover the visible range of the whole Kinect main body (3), and the depth recognition lens (4), the camera (5) and the laser recognition lens (6) are used for receiving reflected light to recognize the human body and then are positioned.

2. A musical interactive toy for assisting in the rehabilitation of self-closing child exercises according to claim 1, characterized in that: the first supporting plate (21) is inclined by 10 degrees, the second supporting plate (22) is vertically connected to the first supporting plate (21), the Kinect bracket (8) is close to the Kinect image transparent plate (1), and the Kinect image transparent plate (1) can enable the depth recognition lens (4), the camera (5) and the laser recognition lens (6) to recognize external human body action information.

3. A musical interactive toy for assisting in the rehabilitation of self-closing child exercises according to claim 1, characterized in that: the top shell (2) is a black shell formed by spraying acrylic full-transparent materials, the Kinect image transparent plate (1) is made of acrylic full-transparent materials, and the bottom shell (18) is a white shell formed by spraying acrylic full-transparent materials;

sound holes (17) are formed in the left end face and the right end face of the bottom shell (18), radiating holes (11) are formed in the bottom plate between the partition plates (19) and the bottom plate in the mounting frame (20), a projection hole (13) is formed in the rear portion of the bottom shell (18), the projection hole (13) is covered with a cover plate made of acrylic full-transparent materials, a plurality of shell buckles (7) are connected to the inner side wall of the bottom shell (18) in a surrounding mode, a plurality of buckling grooves are formed in the inner side wall of the top shell (2), and the shell buckles (7) correspond to the buckling grooves one by one.