CN114089647A - Intelligent rhythm system and control method thereof - Google Patents
Intelligent rhythm system and control method thereof Download PDFInfo
- Publication number
- CN114089647A CN114089647A CN202111385229.8A CN202111385229A CN114089647A CN 114089647 A CN114089647 A CN 114089647A CN 202111385229 A CN202111385229 A CN 202111385229A CN 114089647 A CN114089647 A CN 114089647A
- Authority
- CN
- China
- Prior art keywords
- control
- rhythm
- action
- module
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000033764 rhythmic process Effects 0.000 title claims abstract description 150
- 238000000034 method Methods 0.000 title claims abstract description 26
- 230000009471 action Effects 0.000 claims abstract description 145
- 230000000875 corresponding effect Effects 0.000 claims abstract description 58
- 238000004891 communication Methods 0.000 claims abstract description 20
- 230000033001 locomotion Effects 0.000 claims description 33
- 238000012545 processing Methods 0.000 claims description 7
- 230000006870 function Effects 0.000 abstract description 5
- 230000001276 controlling effect Effects 0.000 abstract description 4
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000004590 computer program Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 10
- 238000012937 correction Methods 0.000 description 6
- 210000003414 extremity Anatomy 0.000 description 4
- 210000000689 upper leg Anatomy 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 210000001624 hip Anatomy 0.000 description 3
- 210000000544 articulatio talocruralis Anatomy 0.000 description 2
- 244000309466 calf Species 0.000 description 2
- 210000002310 elbow joint Anatomy 0.000 description 2
- 210000004394 hip joint Anatomy 0.000 description 2
- 210000001503 joint Anatomy 0.000 description 2
- 210000000629 knee joint Anatomy 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000036544 posture Effects 0.000 description 2
- 210000000323 shoulder joint Anatomy 0.000 description 2
- 210000003857 wrist joint Anatomy 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000005802 health problem Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001020 rhythmical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides an intelligent rhythm system and a control method thereof, relating to the technical field of sports equipment, wherein the rhythm equipment comprises: the control background, and the rhythm equipment and the control equipment which are in communication connection with the control background, wherein the control equipment and the rhythm equipment are arranged separately; the control equipment is used for playing the guide action; acquiring body-building action and control intention of a user; generating the completion similarity of the user according to the guide action and the body-building action; generating a control instruction of the rhythm equipment according to the control intention and the completion similarity; the rhythm equipment is used for acquiring the control instruction and executing corresponding action according to the control instruction; the control background is used for establishing a communication link with the rhythm device and the control device, and transmitting a control instruction and a guidance action stored in the control background. The invention realizes the split type rhythm equipment by applying the Internet of things technology, and can realize the functions of demonstrating and correcting actions of a user, controlling the rhythm equipment and the like.
Description
Technical Field
The invention relates to the technical field of sports equipment, in particular to an intelligent rhythm system and a control method thereof.
Background
A rhythmic device refers to a mechanical device that vibrates regularly in a manner that produces a sine wave in a vertical or horizontal direction. Rhythm equipment is widely used in fields such as medical treatment, rehabilitation and the like to solve the health problem of a user in a motion intervention mode, and the user can exercise different body parts by standing on the rhythm equipment and using different postures.
At present, the rhythm equipment has less functions, can only control speed and time simply, and lacks the body-building action guidance function urgently needed by users. Therefore, there is a need for improvements to current rhythm devices.
Disclosure of Invention
The invention provides an intelligent rhythm system and a control method thereof, which are used for solving the defect that rhythm equipment in the prior art cannot guide a user to perform body-building actions, and realizing the functions of action demonstration and action correction of the user, rhythm equipment control and the like.
The invention provides an intelligent rhythm system, comprising:
the control device comprises a control background, and a rhythm device and a control device which are in communication connection with the control background, wherein the control device and the rhythm device are arranged separately;
the control equipment is used for playing a guide action; acquiring body-building action and control intention of a user; generating the completion similarity of the user according to the guide action and the body-building action; generating a control instruction of the rhythm equipment according to the control intention and the completion similarity;
the rhythm equipment is used for acquiring the control instruction and executing corresponding action according to the control instruction;
the control background is used for establishing a communication link with the rhythm equipment and the control equipment, and transmitting the control instruction and the guide action stored in the control background.
According to the intelligent rhythm system provided by the invention, the control device comprises:
the first acquisition module is used for acquiring the guide action sent by the control background;
the playing module is used for playing the guide action;
the acquisition module is used for acquiring audio information and video information of a user;
an identification module for identifying the exercise action and the control intent of the user from the audio information and the video information;
the comparison module is used for matching and comparing the body-building action with the corresponding guide action to generate the corresponding completion similarity when the user completes the guide action;
the instruction generating module is used for generating a control instruction of the rhythm equipment according to the control intention and the completion similarity;
and the first sending module is used for sending the control instruction to the control background.
According to the intelligent rhythm system provided by the invention, the identification module comprises:
a first recognition unit for recognizing the control intention of the user occurring within a first preset range from the audio information and the video information; wherein the control intent comprises a limb action, a gesture, and speech;
the second identification unit is used for identifying the body-building action which occurs in a second preset range and occurs on the rhythm equipment by the user from the video information;
the first preset range covers the second preset range, and the rhythm device is provided with the first preset range and the second preset range corresponding to the rhythm device.
According to the intelligent rhythm system provided by the invention, the acquisition module specifically comprises:
determining first time required for completely playing the guidance action, and acquiring audio information and video information of a user within second time when the guidance action is played; wherein the second time covers the second time.
According to the intelligent rhythm system provided by the invention, the comparison module comprises:
a first determination unit for identifying a first joint point of a user from the fitness action;
the first processing unit is used for determining a first included angle between the first joint points which are mutually related;
a second determination unit for identifying a second joint point of the instructor from the instructor's actions;
a second processing unit, configured to determine a second included angle between the second joint points that are associated with each other;
the first comparison unit is used for obtaining the single similarity according to the first included angle and the second included angle of the same position and the same time point of the human body;
and the second comparison unit is used for generating the corresponding completion similarity when the user completes the guidance action according to the obtained single similarity.
According to the intelligent rhythm system provided by the invention, the control device further comprises:
the prompt module is used for generating prompt information when the completion similarity is lower than a preset value;
correspondingly, the playing module is further configured to play the prompt message.
According to the intelligent rhythm system provided by the invention, the rhythm device comprises:
the second acquisition module is used for acquiring the control instruction sent by the control background;
and the electromechanical execution module is used for executing corresponding actions according to the control command.
According to the intelligent rhythm system provided by the invention, the control background comprises:
the storage module is used for storing the guide action;
a third obtaining module, configured to obtain the control instruction sent by the first sending module;
the second sending module is used for sending the guiding action to the first obtaining module, or sending the guiding action to the first obtaining module according to the control instruction;
and the third sending module is used for sending the control instruction to the second acquiring module.
According to the intelligent rhythm system provided by the invention, the control background further comprises:
a fourth obtaining module, configured to obtain the first connection request sent by the rhythm device and the second connection request sent by the control device;
a connection module, configured to establish communication with the rhythm device according to the first connection request, and/or establish communication with the control device according to the second connection request;
correspondingly, the rhythm device further comprises:
the first request module is used for generating the first connection request and sending the first connection request to the fourth acquisition module;
the control apparatus further includes:
and the second request module is used for generating the second connection request and sending the second connection request to the fourth acquisition module.
The invention also provides a control method of the intelligent rhythm system, which comprises the following steps:
when the guiding action is played, acquiring the audio information and the video information of the user in the second time, and identifying the body-building action and the control intention of the user from the audio information and the video information;
identifying first joint points of a user from the body-building action, determining a first included angle between the first joint points which are mutually associated, identifying second joint points of an instructor from the guiding action, and determining a second included angle between the second joint points which are mutually associated;
obtaining single similarity according to the first included angle and the second included angle at the same position and the same time point of the human body, accumulating all the single similarity, and generating corresponding completion similarity when the user completes the guidance action;
and generating a control instruction of the rhythm equipment according to the control intention and the completion similarity, and executing corresponding action by the rhythm equipment according to the control instruction.
The invention also provides an electronic device, comprising a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the steps of the control method of the intelligent rhythm system.
The invention also provides a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of the method of controlling an intelligent rhythm system as described in any one of the above.
The invention also provides a computer program product comprising a computer program which, when executed by a processor, carries out the steps of the method of controlling an intelligent rhythm system as described in any one of the above.
According to the intelligent rhythm system and the control method thereof, provided by the invention, the split type rhythm equipment is realized by applying the Internet of things technology, a larger space can be provided for a user to act, meanwhile, the body building action and the control intention of the user are obtained through the control equipment which is separated from the rhythm equipment, the body building action and the corresponding guidance action are matched and identified, and the corresponding control instruction of the rhythm equipment is obtained, so that the functions of action demonstration and action correction of the user, control of the rhythm equipment and the like can be realized, and the rhythm equipment has a better application market.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of the structure of an intelligent rhythm system provided by the present invention;
FIG. 2 is a schematic structural diagram of a control device in the intelligent rhythm system provided by the present invention;
FIG. 3 is a schematic structural diagram of an identification module in the intelligent rhythm system provided by the present invention;
fig. 4 is a schematic structural diagram of a comparison module in the intelligent rhythm system provided by the present invention;
FIG. 5 is an exemplary diagram of an intelligent rhythm system computing completion similarity as provided by the present invention
Fig. 6 is a second schematic structural diagram of a control device in the intelligent rhythm system provided by the present invention;
FIG. 7 is a schematic structural diagram of a rhythm device of the intelligent rhythm system provided by the present invention;
FIG. 8 is a schematic structural diagram of a control background in the intelligent rhythm system provided by the present invention;
FIG. 9 is a schematic flow chart of a control method of the intelligent rhythm system provided by the invention;
fig. 10 is a schematic structural diagram of an electronic device provided by the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The intelligent rhythm system of the present invention is described below in conjunction with fig. 1, the rhythm system comprising:
a control background 300, and a rhythm device 100 and a control device 200 communicatively coupled to the control background 300, for which rhythm device 100 the control device 200 is separate from the rhythm device 100 and is not provided or integrated with the rhythm device 100.
In this embodiment, each musical instrument 100 has its corresponding control device 200, and multiple musical instruments 100 can be arranged in a fitness venue, it being understood that each musical instrument 100 has its corresponding control device 200, and the control devices 200 can be arranged nearby their corresponding musical instruments 100. In this embodiment, the control back office 300 is provided with one or more than one, all the above-mentioned rhythm devices 100 and control devices 200 can establish a communication link with the one or more than one control back office, and the mutually corresponding rhythm device 100 and control device 200 establish a communication link with the same control back office 300, so as to ensure that pairing between the rhythm device 100 and its opposite control device 200 is performed through the control back office, so that the control device 200 can control the corresponding rhythm device 100.
The communication connection may be connected in various ways such as 5G, 4G, WIFI, ethernet, and the like.
Wherein, the control device 200 is used for playing the guiding action; and obtaining the body-building action and the control intention of the user; generating the completion similarity of the user according to the guiding action and the body building action; and generating a control instruction of the rhythm device 100 according to the control intention and the completion similarity.
In some possible embodiments, the user's control intent includes, but is not limited to, starting the rhythm device 100 (power on), closing the rhythm device 100 (power off), playing the specified coaching action, pausing the play of the specified coaching action, replaying the coaching action (i.e., resuming the play of the coaching action), switching to the specified coaching action, and the like.
In some possible embodiments, the guiding action may be presented in a video stream manner by playing on a display screen to guide the user to perform the corresponding exercise, and the guiding action at this time may be understood as a video lesson. Under such embodiments, the control device 200 includes at least a display screen, and the display screen of the control device 200 may be positioned near but not obstructing or obstructing the user's performance of the fitness-related action, such as positioning the display screen at a height above the rhythm device 100, in view of the play presentation effect of the coaching action.
The rhythm device 100 is configured to obtain a control command, and execute corresponding actions according to the control command, where the actions include turning on, turning off, performing regular vibration, stopping the regular vibration, recovering the regular vibration, and playing a prompt message.
Optionally, when the guidance action is played, the rhythm device 100 performs a corresponding action according to the guidance action, that is, the speed configured by the video course, and starts shaking, that is, controls corresponding shaking parameters such as shaking amplitude and frequency according to the configuration information of the video course; when the playing guidance action is paused, the corresponding action of the rhythm device 100 is pause running, namely pause vibration; when the guiding action is resumed, the corresponding action of the rhythm device 100 is resumed, i.e. vibration is resumed, and the corresponding vibration parameters such as vibration amplitude and frequency are controlled according to the configuration information of the video course; when the motion of playing the tutorial stops, the corresponding motion of the rhythm device 100 is to stop running, i.e. stop shaking.
It should be noted that each bar of the video lesson can be configured with a different rhythm speed, and when the video lesson switches, the rhythm device 100 will adjust its vibration parameter accordingly.
The control back office 300 is used to establish a communication link with the rhythm devices 100 and the control device 200, through which the pairing between the rhythm device 100 and its opposite control device 200 is made, so that the control device 200 can control the corresponding rhythm device 100, the control back office 300 also being responsible for transmitting control instructions and instructional actions stored in the control back office 300.
According to the intelligent rhythm system, a split type rhythm device is realized by applying the technology of the Internet of things, a larger space can be provided for a user to do actions, meanwhile, the body-building actions and the control intentions of the user are obtained through the control device which is separated from the rhythm device 100, the body-building actions and the corresponding guide actions are matched and recognized, the corresponding control instructions of the rhythm device 100 are obtained, the actions demonstration and the action correction of the user can be realized, the rhythm device 100 is controlled, and the like, so that the rhythm device has a better application market.
The intelligent rhythm system of the present invention is described below in conjunction with fig. 2, the control device 200 comprising:
the first obtaining module 210 is configured to obtain a guidance action sent by the control background 300.
And a playing module 220 for playing the guiding action.
And the collecting module 230 is used for collecting the audio information and the video information of the user.
In some possible embodiments, the capture module 230 may capture video information of a user using a video capture device such as a camera to form a video stream of the user; the collecting module 230 may collect audio information of a user by using an audio collecting device such as a microphone to form an audio stream of the user.
The collecting module 230 may specifically include:
determining the first time required for completely playing the guidance action, and acquiring the audio information and the video information of the user in the second time when the guidance action is played. In this embodiment, the second time overlaps the second time.
The second time may exceed the first time while the audio and video information is being captured, since the user's actions after a period of time before the video session begins and after the video session ends can also be associated with the video session.
And the identification module 240 is used for identifying the body building action and the control intention of the user from the audio information and the video information.
And the comparison module 250 is configured to match and compare the body-building action with the corresponding guidance action, and generate a corresponding completion similarity when the user completes the guidance action by obtaining a difference between the body-building action of the user and the corresponding guidance action.
It can be understood that a higher value of the completion similarity indicates that the user completes the guiding action more regularly, and the fitness effect is better; the end of the month completing the similarity value indicates that the more the guiding action of the user is not in accordance with the standard or specification, and accordingly, the exercise effect may be limited, and the action demonstration and the action correction may be required, and the action demonstration and the action correction may be performed by sending a prompt message through the control device 200, or may be performed by a professional instructor (trainer).
The instruction generating module 260 is configured to generate a corresponding control instruction of the rhythm device 100 according to the control intention and the completion similarity.
The first sending module 270 is configured to send a control instruction to the control backend 300.
The intelligent rhythm system of the present invention is described below in conjunction with fig. 3, and the recognition module 240 includes:
a first identifying unit 241 for identifying a control intention of the user occurring within a first preset range from the audio information and the video information. In this embodiment, the control intention includes a body motion, a gesture, and a voice, that is, the user may control the rhythm device 100 to perform a corresponding motion in the body motion, the gesture, and the voice, and specifically may be to start the rhythm device 100 (power on), close the rhythm device 100 (power off), play a specified guidance motion, pause the play of the specified guidance motion, replay the guidance motion (i.e., resume the play of the guidance motion), switch to the specified guidance motion, and the like.
And a second identification unit 242, configured to identify, from the video information, that the user is within a second preset range and the exercise action is performed on the rhythm device.
The first preset range covers the second preset range, the musical movements 100 have the corresponding first preset range and second preset range, and when a plurality of musical movements 100 and a plurality of corresponding control devices 200 are arranged in a gymnasium, it can be understood that each musical movement 100 has the corresponding first preset range and second preset range.
In some possible embodiments, the first predetermined range is beyond a second predetermined range, which requires consideration of the exercise-related actions of the user on the musical movement apparatus, and thus the second predetermined range can be generally set as the action space range corresponding to the musical movement apparatus 100, and the first predetermined range requires consideration of the user being able to start, stop, and pause the musical movement apparatus 100 beside the musical movement apparatus 100, and thus the first predetermined range is the whole occupied space range of the musical movement apparatus 100 and the partial space range around the musical movement apparatus 100, and the partial space range around the musical movement apparatus 100 can be set according to the actual requirements.
The intelligent rhythm system of the present invention is described below with reference to fig. 4, and the comparing module 250 includes:
a first determination unit 251 for identifying a first joint point of the user from the fitness action, which in this embodiment is the position of a main joint point of the user's body, such as an ankle joint, a knee joint, a hip joint, a shoulder joint, an elbow joint, a wrist joint, etc.
A first processing unit 252 for determining a first angle between the first joint points associated with each other.
A second determining unit 253 for identifying a second joint point of the instructor from the instructor's movement, wherein the second joint point is a position of a main joint point of a human body of the instructor (trainer), such as an ankle joint, a knee joint, a hip joint, a shoulder joint, an elbow joint, a wrist joint, and the like, and the corresponding positions and the acquisition numbers of the second joint point and the first joint point can be corresponding to each other.
A second processing unit 254 for determining a second angle between the interrelated second joint points.
The first comparing unit 255 is configured to obtain the singleton similarity according to the first included angle and the second included angle at the same position and the same time point of the human body.
And a second comparing unit 256, configured to generate a corresponding completion similarity when the user completes the guidance action according to the obtained similarity of all the singles.
The comparison module 250 evaluates the similarity between the more standard motion made by the instructor in the guidance motion and the motion finished by the user with reference to the guidance motion according to the first angle and the second angle at the same position and the same time point of the human body.
The comparison module 250 may adopt an AI limb recognition technique to extract the positions of the main joint points of the human body, and then determine the postures of the body and the limbs of the user and the instructor according to the positions of the main joint points. After the limb recognition technology is applied, the accuracy of the user action can be judged, and the error action of the user can be corrected.
Referring to FIG. 5, first, a second angle may be calculated for the instructor's joints:
the included angle A between the neck and the shoulder, namely the included angle between the connecting line of the two joint points 1 and 2 and the connecting line of the two joint points 3 and 6 in figure 5;
the included angle B between the upper left arm and the shoulder, namely the included angle between the connecting line of the two joint points 3 and 4 and the connecting line of the two joint points 3 and 6 in fig. 5;
the angle C between the upper right arm and the shoulder, i.e. the angle between the connecting line of the two joint points 6 and 7 and the connecting line of the two joint points 3 and 6 in FIG. 5;
an included angle D between the lower left arm and the upper left arm, i.e. an included angle between a connecting line of two joint points 3 and 4 and a connecting line of two joint points 4 and 5 in fig. 5;
an included angle E between the right lower arm and the right upper arm, i.e. an included angle between a connecting line of two joint points 6 and 7 and a connecting line of two joint points 7 and 8 in fig. 5;
the included angle F between the lumbar vertebra and the hip, namely the included angle between the connecting line of the two joint points 2 and 9 and the connecting line of the two joint points 10 and 13 in fig. 5;
the angle G between the hip and the left thigh is the angle between the connecting line of the two joint points 10 and 13 and the connecting line of the two joint points 10 and 11 in FIG. 5;
the included angle H between the hip and the right thigh, i.e. the included angle between the connecting line of the two joint points 10 and 13 and the connecting line of the two joint points 13 and 14 in fig. 5;
an included angle I between the left thigh and the left calf, i.e. an included angle between a connecting line of two joint points 10 and 11 and a connecting line of two joint points 11 and 12 in fig. 5;
the angle between the right thigh and the right calf is i.e. the angle between the line connecting the two joint points 13 and 14 and the line connecting the two joint points 14 and 115 in fig. 5.
In fig. 5, 10 second angles (which are also equivalent to 10 first angles) are illustrated, and then the first angles of the joints of the user at the same time point (the same certain frame image or the same continuous multi-frame image) are calculated in the same manner.
Next, the difference between the second angle of each joint of the coach and the first angle of each joint of the user is calculated, and the single similarity is calculated by the following formula:
wherein S isxAt a certain angle of monomial similarity, ACxTo the instructor (coach) the degree of this angle, ASxThe degree of the angle is given to the user, i.e. student.
According to the formula, taking the included angle D as an example, when the degree of the included angle is 180 for the instructor and the degree of the included angle is 0 for the user, the single-term similarity of the included angle is 0 (representing 0% similarity); when the number of degrees of the included angle of the instructor is 180 and the number of degrees of the included angle of the user is 180, the single similarity of the included angle of the user is 1 (representing 100% similarity); when the instructor indicates that the included angle is 180 degrees and the user indicates that the included angle is 90 degrees, the single item similarity of the user's included angle is 0.5 (indicating 50% similarity).
After calculating the single similarity of all the included angles, the scores of all the included angles are counted by using the following formula to obtain the completion similarity:
wherein S istFor the completion similarity of the user, the calculation method of the 10 included angles in the above example is used as an example for explanation, in which case the full score of the completion similarity is 10, and SxThe full score is 1 score for the single similarity of a certain included angle.
The intelligent rhythm system of the present invention is described below in conjunction with fig. 6, and the control device 200 further includes:
the prompt module 280 is configured to generate a prompt message when the completion similarity is lower than a preset value, for example, the preset value may be set to 60% of the full score. In the present embodiment, the prompt information is used for action demonstration and action correction for the user.
Correspondingly, the playing module 220 is further configured to play the prompt message.
The intelligent rhythm system of the present invention is described below in conjunction with fig. 7, with rhythm device 100 including:
the second obtaining module 110 is configured to obtain a control instruction sent by the control background 300.
And the electromechanical execution module 120 is configured to execute a corresponding action according to the control instruction.
The intelligent rhythm system of the present invention is described below with reference to fig. 8, and the control background 300 includes:
a storage module 310 for storing the guidance action.
The third obtaining module 320 is configured to obtain the control instruction sent by the first sending module 270.
The second sending module 330 is configured to send the guidance action to the first obtaining module 210, or send the guidance action to the first obtaining module 210 according to the control instruction.
It should be noted that even without a control instruction, the control console 300 can transmit its stored guidance action to the control device 200.
The third sending module 340 is configured to send a control instruction to the second obtaining module 110.
The control background 300 is mainly used for processing operations such as pairing between the control device 200 and the rhythm device 100, query and transmission of guidance actions, forwarding of control instructions, and the like. It will be appreciated that the control console 300 may also be used to store corresponding motion data for the user, i.e., exercise motions.
In this embodiment, the control background 300 further includes:
the fourth obtaining module is used for obtaining the first connection request sent by the rhythm equipment and the second connection request sent by the control equipment;
the connection module is used for establishing communication with the rhythm equipment according to the first connection request and/or establishing communication with the control equipment according to the second connection request;
correspondingly, the rhythm device further comprises:
the first request module is used for generating a first connection request and sending the first connection request to the fourth acquisition module;
the control apparatus further includes:
and the second request module is used for generating a second connection request and sending the second connection request to the fourth acquisition module.
The control background 300 is in a starting state at any time and is used for receiving a first connection request of the rhythm device 100 and a second connection request of the control device 200; after the rhythm device 100 is started, according to different hardware and software configurations, the rhythm device 100 can be connected to the internet in one of the modes of 5G, 4G, WIFI, ethernet and the like, and sends a first connection request to the control background 300, and after the control background 300 responds to the first connection request of the rhythm device 100, the ID of the rhythm device 100 is inquired and recorded, and an instruction is sent to inform the rhythm device 100 to enter a state controlled by the network; after the control device 200 is started, according to different hardware and software configurations, the control device may also connect to the internet in a manner of one of 5G, 4G, WIFI, ethernet, etc., and send a second connection request to the control back-end 300, and after the control back-end 30 responds to the second connection request of the control device 200, query and record the ID of the control device 200, and send an instruction to notify the control device that the paired rhythm devices may be controlled through the network; after the control device 200, the control background 300 and the rhythm device 100 are successfully connected, the control device 200 enters a control mode, and a user can send a control instruction to the control device 100 in a mode of combining one or more modes of body movement, gestures and language, browse and select a guidance action, and control the volume, the screen brightness and the video playing in the process of playing the guidance action.
The control method of the intelligent rhythm system of the present invention is described below with reference to fig. 9, and the method includes the following steps:
s100, when the guiding action is played, collecting audio information and video information of the user in a second time, and identifying the body-building action and the control intention of the user from the audio information and the video information;
s200, identifying first joint points of a user from the body building action, determining a first included angle between the first joint points which are mutually associated, identifying second joint points of an instructor from the guiding action, and determining a second included angle between the second joint points which are mutually associated;
s300, obtaining single similarity according to a first included angle and a second included angle of the same position and the same time point of the human body, accumulating all the single similarities, and generating corresponding completion similarity when the user completes the guidance action;
s400, generating a control instruction of the rhythm device 100 according to the control intention and the completion similarity, and executing corresponding action by the rhythm device 100 according to the control instruction.
Fig. 10 illustrates a physical structure diagram of an electronic device, and as shown in fig. 10, the electronic device may include: a processor (processor)810, a communication Interface 820, a memory 830 and a communication bus 840, wherein the processor 810, the communication Interface 820 and the memory 830 communicate with each other via the communication bus 840. The processor 810 may invoke logic instructions in the memory 830 to perform a method of controlling an intelligent rhythm system, the method comprising:
s100, when the guiding action is played, collecting audio information and video information of the user in a second time, and identifying the body-building action and the control intention of the user from the audio information and the video information;
s200, identifying first joint points of a user from the body building action, determining a first included angle between the first joint points which are mutually associated, identifying second joint points of an instructor from the guiding action, and determining a second included angle between the second joint points which are mutually associated;
s300, obtaining single similarity according to a first included angle and a second included angle of the same position and the same time point of the human body, accumulating all the single similarities, and generating corresponding completion similarity when the user completes the guidance action;
s400, generating a control instruction of the rhythm device 100 according to the control intention and the completion similarity, and executing corresponding action by the rhythm device 100 according to the control instruction.
In addition, the logic instructions in the memory 830 may be implemented in software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product, the computer program product comprising a computer program, the computer program being storable on a non-transitory computer-readable storage medium, the computer program, when executed by a processor, being capable of executing the control method for executing the intelligent rhythm system provided by the above methods, the method comprising:
s100, when the guiding action is played, collecting audio information and video information of the user in a second time, and identifying the body-building action and the control intention of the user from the audio information and the video information;
s200, identifying first joint points of a user from the body building action, determining a first included angle between the first joint points which are mutually associated, identifying second joint points of an instructor from the guiding action, and determining a second included angle between the second joint points which are mutually associated;
s300, obtaining single similarity according to a first included angle and a second included angle of the same position and the same time point of the human body, accumulating all the single similarities, and generating corresponding completion similarity when the user completes the guidance action;
s400, generating a control instruction of the rhythm device 100 according to the control intention and the completion similarity, and executing corresponding action by the rhythm device 100 according to the control instruction.
In yet another aspect, the present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a control method for executing a smart rhythm system provided by the above methods, the method comprising:
s100, when the guiding action is played, collecting audio information and video information of the user in a second time, and identifying the body-building action and the control intention of the user from the audio information and the video information;
s200, identifying first joint points of a user from the body building action, determining a first included angle between the first joint points which are mutually associated, identifying second joint points of an instructor from the guiding action, and determining a second included angle between the second joint points which are mutually associated;
s300, obtaining single similarity according to a first included angle and a second included angle of the same position and the same time point of the human body, accumulating all the single similarity, and generating corresponding completion similarity when the user completes the guidance action;
s400, generating a control instruction of the rhythm device 100 according to the control intention and the completion similarity, and executing corresponding action by the rhythm device 100 according to the control instruction.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. An intelligent rhythm system, comprising:
the control device comprises a control background, and a rhythm device and a control device which are in communication connection with the control background, wherein the control device and the rhythm device are arranged separately;
the control equipment is used for playing a guide action; acquiring body-building action and control intention of a user; generating the completion similarity of the user according to the guide action and the body-building action; generating a control instruction of the rhythm equipment according to the control intention and the completion similarity;
the rhythm equipment is used for acquiring the control instruction and executing corresponding action according to the control instruction;
the control background is used for establishing a communication link with the rhythm equipment and the control equipment, and transmitting the control instruction and the guide action stored in the control background.
2. An intelligent musical movement system according to claim 1, wherein the control device comprises:
the first acquisition module is used for acquiring the guide action sent by the control background;
the playing module is used for playing the guide action;
the acquisition module is used for acquiring audio information and video information of a user;
an identification module for identifying the exercise action and the control intent of the user from the audio information and the video information;
the comparison module is used for matching and comparing the body-building action with the corresponding guide action to generate the corresponding completion similarity when the user completes the guide action;
the instruction generating module is used for generating a control instruction of the rhythm equipment according to the control intention and the completion similarity;
and the first sending module is used for sending the control instruction to the control background.
3. The intelligent rhythm system of claim 2, wherein the identification module comprises:
a first recognition unit for recognizing the control intention of the user occurring within a first preset range from the audio information and the video information; wherein the control intent comprises a limb action, a gesture, and speech;
the second identification unit is used for identifying the body-building action which occurs in a second preset range and occurs on the rhythm equipment by the user from the video information;
the first preset range covers the second preset range, and the rhythm device is provided with the first preset range and the second preset range corresponding to the rhythm device.
4. The intelligent rhythm system of claim 2, wherein the collection module specifically comprises:
determining first time required for completely playing the guidance action, and acquiring audio information and video information of a user within second time when the guidance action is played; wherein the second time covers the second time.
5. The intelligent rhythm system of claim 2, wherein the comparison module comprises:
a first determination unit for identifying a first joint point of a user from the fitness action;
the first processing unit is used for determining a first included angle between the first joint points which are mutually related;
a second determination unit for identifying a second joint point of the instructor from the instructor's actions;
the second processing unit is used for determining a second included angle between the second joint points which are mutually related;
the first comparison unit is used for obtaining the single similarity according to the first included angle and the second included angle of the same position and the same time point of the human body;
and the second comparison unit is used for generating the corresponding completion similarity when the user completes the guidance action according to the obtained single similarity.
6. The intelligent musical movement system according to claim 2, wherein the control device further comprises:
the prompt module is used for generating prompt information when the completion similarity is lower than a preset value;
correspondingly, the playing module is further configured to play the prompt message.
7. An intelligent musical movement system according to claim 2, wherein the musical movement device comprises:
the second acquisition module is used for acquiring the control instruction sent by the control background;
and the electromechanical execution module is used for executing corresponding actions according to the control command.
8. The intelligent rhythm system of claim 7, wherein the control backend comprises:
the storage module is used for storing the guide action;
a third obtaining module, configured to obtain the control instruction sent by the first sending module;
a second sending module, configured to send the guidance action to the first obtaining module, or send the guidance action to the first obtaining module according to the control instruction;
and the third sending module is used for sending the control instruction to the second acquiring module.
9. The intelligent rhythm system of claim 8, wherein the control backend further comprises:
a fourth obtaining module, configured to obtain the first connection request sent by the rhythm device and the second connection request sent by the control device;
a connection module, configured to establish communication with the rhythm device according to the first connection request, and/or establish communication with the control device according to the second connection request;
correspondingly, the rhythm device further comprises:
a first request module, configured to generate the first connection request and send the first connection request to the fourth obtaining module;
the control apparatus further includes:
and the second request module is used for generating the second connection request and sending the second connection request to the fourth acquisition module.
10. A control method based on the intelligent rhythm system of any one of claims 1-9, comprising the steps of:
when the guiding action is played, acquiring the audio information and the video information of the user in the second time, and identifying the body-building action and the control intention of the user from the audio information and the video information;
identifying first joint points of a user from the body-building action, determining a first included angle between the first joint points which are mutually associated, identifying second joint points of an instructor from the guiding action, and determining a second included angle between the second joint points which are mutually associated;
obtaining single similarity according to the first included angle and the second included angle at the same position and the same time point of the human body, accumulating all the single similarity, and generating corresponding completion similarity when the user completes the guidance action;
and generating a control instruction of the rhythm equipment according to the control intention and the completion similarity, and executing corresponding action by the rhythm equipment according to the control instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111385229.8A CN114089647A (en) | 2021-11-22 | 2021-11-22 | Intelligent rhythm system and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111385229.8A CN114089647A (en) | 2021-11-22 | 2021-11-22 | Intelligent rhythm system and control method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114089647A true CN114089647A (en) | 2022-02-25 |
Family
ID=80302651
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111385229.8A Pending CN114089647A (en) | 2021-11-22 | 2021-11-22 | Intelligent rhythm system and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114089647A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006227434A (en) * | 2005-02-18 | 2006-08-31 | Advanced Telecommunication Research Institute International | Voice guidance device, voice guidance method, and voice guidance program |
| CN101064057A (en) * | 2006-04-24 | 2007-10-31 | 李渝 | Display with timing acousto-optic prompting and guiding movement |
| CN107135371A (en) * | 2016-02-29 | 2017-09-05 | 华北中控(北京)安防电子设备有限公司 | Online electronic security service system |
| CN112422946A (en) * | 2020-11-30 | 2021-02-26 | 重庆邮电大学 | Intelligent yoga action guidance system based on 3D reconstruction |
| CN112487965A (en) * | 2020-11-30 | 2021-03-12 | 重庆邮电大学 | Intelligent fitness action guiding method based on 3D reconstruction |
| CN112734799A (en) * | 2020-12-14 | 2021-04-30 | 中国科学院长春光学精密机械与物理研究所 | Body-building posture guidance system |
| CN113515695A (en) * | 2021-05-06 | 2021-10-19 | 乐渊网络科技(上海)有限公司 | Fitness assisting method and device, electronic equipment and computer-readable storage medium |
-
2021
- 2021-11-22 CN CN202111385229.8A patent/CN114089647A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006227434A (en) * | 2005-02-18 | 2006-08-31 | Advanced Telecommunication Research Institute International | Voice guidance device, voice guidance method, and voice guidance program |
| CN101064057A (en) * | 2006-04-24 | 2007-10-31 | 李渝 | Display with timing acousto-optic prompting and guiding movement |
| CN107135371A (en) * | 2016-02-29 | 2017-09-05 | 华北中控(北京)安防电子设备有限公司 | Online electronic security service system |
| CN112422946A (en) * | 2020-11-30 | 2021-02-26 | 重庆邮电大学 | Intelligent yoga action guidance system based on 3D reconstruction |
| CN112487965A (en) * | 2020-11-30 | 2021-03-12 | 重庆邮电大学 | Intelligent fitness action guiding method based on 3D reconstruction |
| CN112734799A (en) * | 2020-12-14 | 2021-04-30 | 中国科学院长春光学精密机械与物理研究所 | Body-building posture guidance system |
| CN113515695A (en) * | 2021-05-06 | 2021-10-19 | 乐渊网络科技(上海)有限公司 | Fitness assisting method and device, electronic equipment and computer-readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11745055B2 (en) | Method and system for monitoring and feed-backing on execution of physical exercise routines | |
| US20140172460A1 (en) | System, Method, and Computer Program Product for Digitally Recorded Musculoskeletal Diagnosis and Treatment | |
| KR101936692B1 (en) | Dance training apparatus and method using automatic generation of dance key motion | |
| CN113144540A (en) | Intelligent safe fitness guidance device, system and method | |
| US11395940B2 (en) | System and method for providing guided augmented reality physical therapy in a telemedicine platform | |
| CN110428486B (en) | Virtual interaction fitness method, electronic equipment and storage medium | |
| KR102320960B1 (en) | Personalized home training behavior guidance and correction system | |
| US20220277506A1 (en) | Motion-based online interactive platform | |
| CN113409651B (en) | Live broadcast body building method, system, electronic equipment and storage medium | |
| US20230116624A1 (en) | Methods and systems for assisted fitness | |
| Osgouei et al. | An objective evaluation method for rehabilitation exergames | |
| KR102355008B1 (en) | Method of providing personal training service and recording medium thereof | |
| WO2023077660A1 (en) | Tai chi training method and system based on mixed reality, device, and storage medium | |
| EP2482935B1 (en) | System for supporting a user to do exercises | |
| US20230285806A1 (en) | Systems and methods for intelligent fitness solutions | |
| TW201919735A (en) | Moveable fitness equipment controller, information transmission and collection device combined with fitness equipment, and fitness equipment and control method | |
| JP2023168557A (en) | Program, method, and information processing device | |
| CN114089647A (en) | Intelligent rhythm system and control method thereof | |
| CN215231970U (en) | Intelligent safety body-building guiding device | |
| CN113842622B (en) | Motion teaching method, device, system, electronic equipment and storage medium | |
| WO2021178589A1 (en) | Exercise instruction and feedback systems and methods | |
| CN114241595A (en) | Data processing method and device, electronic equipment and computer storage medium | |
| JP2021191356A (en) | Correction content learning device, operation correction device and program | |
| CN114356100B (en) | Body-building action guiding method, body-building action guiding device, electronic equipment and storage medium | |
| CN110996149A (en) | Information processing method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |