WO2018214520A1 - Method and apparatus for synchronizing video data and exercise effect animation - Google Patents

Abstract

The present invention is applicable to the field of exercise monitoring, and provides a method and apparatus for synchronizing video data and exercise effect animation. The method comprises: recording a video of an exercise process of a user to obtain video data, and synchronously acquiring electromyographic data corresponding to video image frames during the recording of the video data; parsing the electromyographic data respectively corresponding to the video image frames to determine exercise muscle groups and electromyographic strengths respectively corresponding to the video image frames; playing back the video data in a terminal interface; and rendering, while playing back the video data, exercise effect animation in the terminal interface in real time according to the exercise muscle group and electromyographic strength corresponding to a video image frame that is being currently played back. The present invention ensures the synchronization precision of exercise effect animation and video data, and enables a user to intuitively learn the training effect achieved by each movement performed by the user, so that the user can scientifically and effectively improve own fitness method, and thus, the exercise effectiveness of the user is enhanced.

Description

Method and device for synchronizing video data and motion effect animation Technical field

The invention belongs to the field of motion monitoring, and in particular relates to a synchronization method and device for video data and motion effect animation.

Background technique

In recent years, myoelectric data has begun to be applied in the field of sports biomechanics. Specifically, in the process of performing exercise training by the user, the myoelectric data of a specific part of the human body can be collected, and based on the analysis result of the myoelectric data, the user is Analysis and guidance of exercise effects.

In the prior art, the user can only view the motion guidance after the end of the exercise. Therefore, even if the motion guidance point indicates that the user is not standardized in the movement process, the user can only recall his own action by memory. Mistakes, and can't know what kind of training effect each action has been achieved, so even if the motion monitoring device provides exercise guidance, it is difficult for the user to scientifically and effectively improve their fitness methods, thereby reducing The effectiveness of user exercise.

Summary of the invention

In view of this, the embodiment of the present invention provides a method and a device for synchronizing video data and motion effect animation, so as to solve the problem that the user has difficulty in scientifically and effectively improving his own fitness mode and exercising in the prior art. Low problem.

A first aspect of the embodiments of the present invention provides a method for synchronizing video data and motion effect animation, including:

Performing video recording on the motion process of the user to obtain video data, and synchronously collecting the myoelectric data corresponding to each frame of the video image when recording the video data;

Parsing respective electromyographic data corresponding to each video image frame to determine respective exercise muscle groups and myoelectric intensity corresponding to each video image frame;

Playing back the video data in a terminal interface;

While playing back the video data, reading the moving muscle group and the myoelectric intensity corresponding to the currently played video image frame, and rendering the motion effect animation in the terminal interface in real time according to the read moving muscle group and the myoelectric intensity .

A second aspect of the embodiments of the present invention provides a synchronization device for video data and motion effect animation, including:

The collecting unit is configured to perform video recording on the motion process of the user to obtain video data, and synchronously collect the myoelectric data corresponding to each frame of the video image when the video data is recorded;

The analyzing unit is configured to parse the respective electromyographic data corresponding to each video image frame to determine a moving muscle group and a myoelectric intensity corresponding to each video image frame;

a playback unit, configured to play back the video data in a terminal interface;

a display unit, configured to read the moving muscle group and the myoelectric intensity corresponding to the currently played back video image frame while playing back the video data, according to the read moving muscle group and the myoelectric intensity, in real time at the terminal The interface renders motion animation.

In the embodiment of the present invention, by performing video recording on the motion process of the user, and in the process of video playback, according to the moving muscle group and the myoelectric intensity corresponding to the video image frame, the motion effect animation is rendered in real time, and the moment is guaranteed at each moment. The displayed motion effect animation is associated with the motion motion displayed in the current time video image frame, ensuring the motion effect animation and the synchronization precision of the video data. At the same time, because the user can visualize the motion effect animation that is played synchronously based on the video image frame, intuitively understand what kind of training effect each action he has achieved, and know in real time which action he is doing is not standardized, and thus can be scientific, Effectively improve your fitness style and improve the effectiveness of your exercise.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the embodiments or the description of the prior art will be briefly described below. It is obvious that the drawings in the following description are only the present invention. For some embodiments, other drawings may be obtained from those of ordinary skill in the art in light of the inventive workability.

1 is a flowchart showing an implementation of a method for synchronizing video data and motion effect animation according to Embodiment 1 of the present invention;

2 is a specific implementation flowchart of a synchronization method S104 for video data and motion effect animation according to Embodiment 2 of the present invention;

3 is a schematic diagram of a motion effect animation provided by Embodiment 2 of the present invention;

4 is a specific implementation flowchart of a synchronization method S104 for video data and motion effect animation according to Embodiment 3 of the present invention;

FIG. 5 is a schematic diagram of a motion effect animation according to Embodiment 3 of the present invention; FIG.

6 is a flowchart of a specific implementation of a synchronization method S104 for video data and motion effect animation according to Embodiment 4 of the present invention;

FIG. 7 is a flowchart of a specific implementation of a synchronization method S104 for video data and motion effect animation according to Embodiment 5 of the present invention;

FIG. 8 is a structural block diagram of a synchronization apparatus for video data and motion effect animation according to Embodiment 6 of the present invention.

detailed description

In the following description, for purposes of illustration and description However, it will be apparent to those skilled in the art that the present invention may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the invention.

In order to explain the technical solution described in the present invention, the following description will be made by way of specific embodiments.

In various embodiments of the present invention, the execution body of the process is a terminal device, and the terminal device is a smart terminal having a display screen and a camera, such as a mobile phone, a tablet, a smart camera, a notebook computer, and a computer. The terminal device internally runs a specific application client, and the application client exchanges data with the accompanying wearable mobile device through a connection manner such as wired, wireless or Bluetooth.

In the embodiment of the present invention, the wearable exercise device may be a wearable smart fitness garment, or may be a collection of one or more collection modules that are wearable and attachable.

Wherein, when the wearable exercise device is a wearable smart fitness garment, it may be a garment or pants made of a flexible fabric, and a plurality of collection modules are embedded on the side of the flexible fabric close to the human skin. Each collection module is fixed at different points of the smart fitness garment so that after the user wears the smart fitness garment, each collection module can be attached to each muscle of the user's body. In the wearable exercise device, at least one control module is also embedded, and each of the acquisition modules is separately connected to the control module.

In particular, when the acquisition module is in communication with the control module, each acquisition module may include only an acquisition electrode having a somatosensory sensor function, or an integrated circuit having an acquisition function. The above collection electrodes include, but are not limited to, fabric electrodes, rubber electrodes, gel electrodes, and the like.

When the wearable exercise device is a set of one or more collection modules that are wearable and attachable, the user can flexibly fix each collection module to the body position point specified by the user, so that each collection module can be attached separately. The specified muscles of the user's body. At this time, each acquisition module is an integrated circuit having an acquisition function and a wireless transmission function, and the integrated circuit includes the above-mentioned acquisition electrode having a somatosensory sensor function. The myoelectric data collected by the acquisition module is transmitted to the remote control module through the wireless network, and the control module is located in the above terminal device or remote control box used in conjunction with the acquisition module.

Embodiment 1

FIG. 1 shows an implementation flow of a method for synchronizing video data and motion effect animation provided by an embodiment of the present invention, and the method flow includes steps S101 to S104. The specific implementation principles of each step are as follows:

S101: Perform video recording on the motion process of the user to obtain video data, and synchronously collect the myoelectric data corresponding to each frame of the video image when the video data is recorded.

In the embodiment of the present invention, when the terminal device receives the video recording instruction input by the user in the application client, the terminal device starts the camera and starts performing video recording. At the same time, the application client sends an acquisition signal to the control module, so that the control module controls each collection module to start collecting the electromyography data from each muscle group of the user body at a preset frequency, and causes the control module to collect the muscles of each collection module. The electrical data is returned to the terminal device in real time. At the moment when the terminal device receives each of the myoelectric data, the video image frame recorded at the time is associated with the myoelectric data. During the recording of the video data, the terminal device will continue to receive the EMG data returned by the wearable exercise device and the video images of the frames continuously recorded, so that it is possible to determine the EMG data correspondingly received in real time when the video images of each frame are acquired. .

When receiving the video recording stop command, the terminal device turns off the camera and sends a termination signal to the control module to stop the acquisition and stop transmitting the myoelectric data.

S102: Analyze the respective electromyography data corresponding to each video image frame to determine a moving muscle group and a myoelectric intensity corresponding to each video image frame.

Since the myoelectric data received by the terminal device is derived from different acquisition modules on the wearable exercise device respectively, the terminal device will correspond to the myoelectric data corresponding to one frame of the video image according to the source module identifier of the collection module carried by the myoelectric data. Divided into N way sub-data, N is the number of acquisition modules. Since the human muscle group attached to each collection module is preset in the application client, the terminal device divides the N-way sub-data corresponding to each video image frame according to the correspondence relationship between the collection module source identifier and the human muscle group. M groups. Where M is the total number of muscle groups of the human muscle group attached to the acquisition module in the wearable exercise device, and M is less than or equal to N. Specifically, for the K collection modules attached to the same human muscle group, the terminal device identifies the acquisition module source as the K-channel sub-data of the K acquisition modules as a group. M, N, and K are all positive integers.

Performing comprehensive analysis and processing on the EMG data of the M groups corresponding to the continuous multi-frame video images, and determining the human muscle group corresponding to the group of EMG data with the highest myoelectric intensity as the continuous multi-frame video image corresponding to Athletic muscle group. The number of consecutive video image frames is a preset value.

After determining the moving muscle group corresponding to the continuous multi-frame video image, each frame of the video image in the continuous multi-frame video image is also determined to correspond to the moving muscle group. The myoelectric intensity of the sports muscle group is the signal intensity value of the myoelectric data corresponding to the frame video image.

The terminal device stores the moving muscle groups and the myoelectric intensity corresponding to the respective video image frames.

S103: Play back the video data in a terminal interface.

After the video image of each frame of the user motion process is acquired by the camera of the terminal device, the terminal device generates a video data file. When the application client receives the video data file selection instruction sent by the user, or when the video data file is generated, the terminal device reads the video data file, and according to the recording order of each frame of the video image, from the first frame The video image begins, and each frame of the video image is played in turn in the display. Since the terminal device can play multiple frames of video images in one second, it is possible for the video viewer to dynamically review the various actions that the user has made during the exercise.

S104: while playing back the video data, reading the moving muscle group and the myoelectric intensity corresponding to the currently played video image frame, and rendering the motion in the terminal interface in real time according to the read moving muscle group and the myoelectric intensity. Effect animation.

At each moment of the video data playback process, a video image frame displayed at the current time is determined. According to the moving muscle group and the myoelectric intensity corresponding to each video image frame stored in the above S102, the terminal device reads the moving muscle group and the myoelectric intensity corresponding to the currently played back video image, thereby using the sports muscle group and As the animation parameter, the electromyography intensity generates a motion animation in real time and displays it in the preset play area in the display screen to play the motion effect animation corresponding to the video image frame while playing each video image frame.

In the embodiment of the present invention, by performing video recording on the motion process of the user, and in the process of video playback, according to the moving muscle group and the myoelectric intensity corresponding to the video image frame, the motion effect animation is rendered in real time, and the moment is guaranteed at each moment. The displayed motion effect animation is associated with the motion motion displayed in the current time video image frame, ensuring the motion effect animation and the synchronization precision of the video data. At the same time, because the user can visualize the motion effect animation that is played synchronously based on the video image frame, intuitively understand what kind of training effect each action he has achieved, and know in real time which action he is doing is not standardized, and thus can be scientific, Effectively improve your fitness style and improve the effectiveness of your exercise.

Embodiment 2

As an embodiment of the present invention, based on the first embodiment, as shown in FIG. 2, the foregoing S104 further includes:

S201: Determine a muscle strength level corresponding to the muscle strength according to the read exercise muscle group and the myoelectric intensity.

A comparison table of muscle strength levels is pre-set inside the terminal equipment. The muscle strength rating table contains multiple muscle strength levels, each of which corresponds to a percentage of myoelectric intensity.

After determining the electromyogram intensity of the moving muscle group and the moving muscle group respectively corresponding to each video image frame, the ratio of the myoelectric intensity to the preset maximum value of the myoelectric intensity is calculated, and the ratio is output as the motion. Percentage of myoelectric strength of muscle groups. The preset maximum value of the myoelectric intensity corresponds to the moving muscle group, that is, after determining the moving muscle group corresponding to the video image frame, the maximum value of the myoelectric amplitude corresponding to the moving muscle group is determined.

Specifically, the maximum value of the myoelectric amplitude corresponding to each of the athletic muscle groups corresponds to the personal account number used by the user in the application client. As an implementation example of the present invention, before the user performs the motion action, the application client will prompt the user to perform the motion test action with the greatest effort and collect the myoelectric test data generated by the user during the motion test. By identifying the electromyography test data, the application client calculates the maximum value of the myoelectric intensity of each of the athletic muscle groups that match the user.

According to the percentage of the myoelectric intensity of the moving muscle group corresponding to the video image frame, the terminal device reads the muscle force level relationship comparison table, and then determines which percentage of the myoelectric intensity percentage of the muscle group of the exercise muscle group belongs to, and the muscle The muscle strength level corresponding to the electric strength percentage interval is judged as the muscle strength level of the exercise muscle group.

Illustratively, Table 1 is a comparison table of muscle strength ratings of triceps, as follows:

Table 1

Muscle strength	Percentage of myoelectric strength
I	[0,20%]
II	(20%, 40%)
III	(40%, 60%)
IV	(60%, 80%)
V	(80%, 100%)

If the currently played video image frame corresponds to the triceps muscle and the percentage of myoelectric strength is 15%, the terminal device can determine from Table 1 that 15% belongs to the first percentage of the myoelectric intensity percentage, thereby The muscle strength level I corresponding to the percentage of the myoelectric intensity percentage is determined as the muscle strength level corresponding to the myoelectric strength of the triceps.

S203: Acquire a first color element corresponding to the muscle strength level.

In the embodiment of the present invention, in order to display the muscle strength level of the sports muscle group in the motion effect animation diagram, after determining the muscle strength level of the sports muscle group, the muscle strength level corresponding to the preset color element correspondence table is directly obtained. Color elements. The same muscle strength level corresponds to the same color element. If different video image frames respectively correspond to different moving muscle groups, and the muscle strength levels of the respective sports muscle groups are the same, they jointly correspond to one color element. If the muscle strength levels of the various sports muscle groups are different, the muscle strength level of each sports muscle group corresponds to one color element.

S203: Mark the moving muscle group with the first color element in a preset human muscle group distribution map.

FIG. 3 shows a distribution diagram of a human muscle group provided by an embodiment of the present invention. As shown in FIG. 3, the figure shows a human body model which is in a mirror-symmetric relationship with the actual body of the user. That is, the left part of the human body model viewed by the video observer also represents the left side of the actual body of the user. Moreover, in the human body model, different muscle groups are divided by lines, so that the user can visually see the physiological parts of the human body actually corresponding to each muscle group from the distribution map of the human muscle group.

The moving muscle group corresponding to the currently played back video image frame is confirmed from the human muscle group distribution map, and the moving muscle group is marked with the first color element corresponding to the muscle strength level of the moving muscle group. The marking method includes marking the contour of the moving muscle group with a first color element, or filling the positional region where the moving muscle group is located with the first color element.

For example, if the moving muscle group corresponding to the currently played video image frame is the left pectoralis major muscle, in FIG. 3, the region A is filled with the first color element corresponding to the muscle strength level of the left pectoralis major muscle.

In the embodiment of the present invention, the real-time rendering speed of the motion effect animation is improved by directly reading the moving muscle group and the myoelectric intensity corresponding to the pre-stored video image frame; by using different color elements in the human muscle group distribution map Marking different muscle strength levels allows the user to visually understand the actual force level of the sports muscle group, so that the actual movement can be checked according to the color change during video playback.

Embodiment 3

As an embodiment of the present invention, based on the second embodiment, as shown in FIG. 4, the foregoing S104 further includes:

S401: Acquire a reference motion muscle group corresponding to the currently played video image frame and a reference muscle strength level.

Before the video data is played back, the terminal device performs image recognition processing on all the video image frames obtained by the recording, thereby determining the start and end video image frames corresponding to each action performed by the user during the motion. All video image frames between the start and end video image frames are collectively confirmed to correspond to the same action.

For each video image frame, a corresponding action is input into the data analysis model to obtain the optimal force level of the muscle group and the muscle group to be exercised, and the muscle group is output as the reference exercise muscle group. The optimal force level is output as the reference muscle level of the reference motor muscle group.

When playing back the video data, the terminal device reads the reference motion muscle group corresponding to the currently played back video image and the reference muscle strength according to the predetermined reference motion muscle group and the reference muscle strength level corresponding to each of the predetermined video image frames. grade.

S402: Determine a second color element corresponding to the reference muscle strength level.

In the embodiment of the present invention, the color element corresponding to the reference muscle strength level is obtained from the preset color element correspondence table, and the color element is the second color element. Wherein, each color element in the color element correspondence table belongs to the same color system, and the greater the muscle strength level, the higher the brightness of the corresponding color element. Since only the unique color element correspondence table is stored in the terminal device, the first color element corresponding to the determined muscle strength level in the above S203 and the second color element corresponding to the determined reference muscle strength level in S402 are all implemented based on the same color element correspondence table. The first color element and the second color element are the same color system.

S403: Determine whether the reference exercise muscle group is the same as the exercise muscle group.

The reference moving muscle group corresponding to the currently played video image frame is compared with the moving muscle group to determine whether the moving muscle group is the same as the reference moving muscle group.

S404: When the reference moving muscle group is the same as the moving muscle group, the moving muscle group is marked by the first color element in a preset human muscle group distribution map.

If the reference sports muscle group is the same as the sports muscle group, then in the human muscle group distribution map, only the same one muscle group is corresponding, and therefore, the human body muscle is marked only by the first color element corresponding to the muscle strength level of the sports muscle group. Groups, avoiding multiple color aliasing, which makes it difficult for users to check the actual strength of the muscle group.

S405: when the reference moving muscle group is different from the moving muscle group, marking the moving muscle group with the first color element in the preset human muscle group distribution map, and the second color An element marks the reference motor muscle group and flashes the reference motor muscle group.

If the reference exercise muscle group is different from the exercise muscle group, the first muscle group representing the sports muscle group and the second muscle group indicating the reference exercise muscle group are respectively determined in the human muscle group distribution map. The first muscle group is marked with a first color element and the second muscle group is marked with a second color element. The specific marking manner is the same as that in the above embodiment, and therefore will not be described one by one. Wherein, while marking the second muscle group, the second muscle group is flashed to highlight that the second muscle group represents the reference motor muscle group.

For example, in FIG. 5, the A muscle group is marked with a first color element having a brightness of 50, and the second color element with a brightness of 20 is marked and the B-series B-group is illuminated, according to an animation display effect of the human muscle group distribution map, It can be shown that the reference exercise muscle group is the B muscle group, and the actual exercise muscle group is the A muscle group. And since the display brightness of the A muscle group is larger than the brightness of the B muscle group, it is known that the actual force of the user is too large, and the correct approach should be to force the body muscles actually corresponding to the B muscle group with a small force. .

In the embodiment of the present invention, the user can intuitively understand the actual position and standard of the actual force by displaying the reference moving muscle group in the human muscle group distribution map and marking the actual moving muscle group corresponding to the user during the exercise. What are the differences in the position of the force, and can reflect the difference in the intensity based on the different brightness colors displayed by the two human muscle groups, so that the user can scientifically adjust and improve his movement posture, and improve the motion analysis. The availability of the effect.

Embodiment 4

As an embodiment of the present invention, based on the foregoing various embodiments, as shown in FIG. 6, the foregoing S104 further includes:

S601: Read the moving muscle group and the myoelectric intensity corresponding to the currently played back video image frame while playing back the video data.

S602: Determine whether there is an abnormality in the read moving muscle group or the myoelectric strength.

In the embodiment of the present invention, the reference moving muscle group corresponding to the currently played back video image frame and the reference muscle strength level are acquired. The read reference exercise muscle group is compared with the exercise muscle group, and the read reference muscle strength level is compared with the muscle strength level to determine whether the exercise muscle group and the myoelectric strength are abnormal.

S603: If there is an abnormality in the read muscle group or the myoelectric intensity, the motion effect animation carrying the audio alarm signal is rendered in real time on the terminal interface according to the read moving muscle group and the myoelectric intensity.

When the read reference exercise muscle group is different from the exercise muscle group, it is determined that there is an abnormality in the read exercise muscle group. When the read reference muscle group is the same as the exercise muscle group and the reference muscle strength level is different from the muscle strength level, it is judged that there is an abnormality in the read myoelectric strength.

The motion effect animation is rendered in the terminal interface in real time according to the moving muscle group and the myoelectric intensity corresponding to the currently played back video image frame, and the motion effect animation carries the audio prompt information. For example, an audio prompt message such as a drip sound or a Chinese alarm is issued.

S604: If there is no abnormality in the recorded muscle group and the electromyogram strength, the motion effect animation is rendered in the terminal interface in real time according to the read moving muscle group and the myoelectric intensity.

When the reference sports muscle group is the same as the sports muscle group, and the reference muscle strength level is the same as the muscle strength level, according to the moving muscle group and the myoelectric intensity corresponding to the currently played back video image frame, the audio is not carried in the terminal interface in real time. An animation of the motion effect of the alarm signal.

In the embodiment of the present invention, when the motion effect animation is real-time rendered and displayed, the audio alarm signal is synchronously issued when the motion is not standard, so that the user can be reminded to watch the video to view the inadequacies of the action and regulate the posture of the action. Avoid users having to ignore their own motion errors because they don't pay attention to the motion effect animation.

Embodiment 5

As an embodiment of the present invention, based on the foregoing various embodiments, as shown in FIG. 7, the above S104 further includes:

S701: Read an image frame number corresponding to the currently played back video image frame.

When recording video data, the image frame number is sequentially identified for each video image frame according to the acquisition order of each video image frame. Then, when playing back to each video image frame, it can be determined according to the read image frame number that the frame video image is the video frame of the video frame.

S702: adding the image frame number to the motion effect animation displayed at the current time, and saving the motion effect animation, according to the image corresponding to the currently played back video image frame when the video data is played back again. The frame number displays the motion effect animation of the same image frame number in the terminal interface in real time.

When the motion effect animation is generated in real time, the read image frame number is added to the motion effect animation played at this time, and the motion effect animation carrying the image frame number is saved.

If the user's play progress adjustment command is received during the playback of the video data, it is assumed that the time is the abort time, and the play progress adjustment instruction is used to instruct the terminal device to play the multi-frame video image that has been played back before playing again, then the playback is performed. Before the time of suspension, for the currently played video image frame, the terminal device can directly read the motion effect animation of the same image frame number as the video image frame, and display it in real time. After the playback to the abort time, the motion effect animation is rendered in real time on the terminal interface according to the moving muscle group and the myoelectric intensity corresponding to the currently played video image frame.

When the entire video data has completed the first playback and the user's playback instruction is received again, the terminal device can read the same as the image frame number in real time according to the image frame number corresponding to the video image frame played back at each moment. The motion effects are animated and displayed simultaneously.

According to the order of the image frame numbers, the generated motion effect animations are sequentially connected to obtain a motion effect animation file corresponding to the video data.

The terminal device can separately play back the motion effect animation file when receiving the selection instruction based on the motion effect animation file.

In the embodiment of the present invention, by adding the image frame number frame of each frame of video image to its corresponding generated motion effect animation, when the frame video image of the video data is played back again, according to the corresponding video image frame Image frame number, quickly read the same motion effect animation with its image frame number and play, without having to repeatedly generate motion effect animation, while ensuring synchronous display of video data and motion effect animation, reducing the calculation pressure of the terminal device and improving The playback efficiency of the motion effect animation.

It should be understood that the size of the sequence of the steps in the above embodiments does not imply a sequence of executions, and the order of execution of the processes should be determined by its function and internal logic, and should not be construed as limiting the implementation of the embodiments of the present invention.

Embodiment 6

Corresponding to the method described in the foregoing embodiment, FIG. 8 is a structural block diagram of a synchronization device for video data and motion effect animation provided by an embodiment of the present invention, and the device can be operated in an intelligent terminal having a display screen and a camera. Such as mobile phones, tablets, laptops, smart cameras and computers, and so on. For the convenience of explanation, only the parts related to the present embodiment are shown.

Referring to Figure 8, the apparatus includes:

The collecting unit 81 is configured to perform video recording on the motion process of the user to obtain video data, and synchronously collect the myoelectric data corresponding to each frame of the video image when the video data is recorded.

The analyzing unit 82 is configured to analyze the respective electromyography data corresponding to each video image frame to determine the moving muscle group and the myoelectric intensity corresponding to the respective video image frames.

The playback unit 83 is configured to play back the video data in the terminal interface.

a display unit 84, configured to read the moving muscle group and the myoelectric intensity corresponding to the currently played back video image frame while playing back the video data, according to the read moving muscle group and the myoelectric intensity, in real time The terminal interface renders the motion effect animation.

Optionally, the display unit 84 includes:

The determining subunit is configured to determine the muscle strength level corresponding to the myoelectric intensity according to the read moving muscle group and the myoelectric intensity.

Obtaining a subunit for acquiring a first color element corresponding to the muscle strength level.

a display subunit for marking the moving muscle group with the first color element in a preset human muscle group distribution map.

Optionally, the display subunit is specifically configured to:

Obtaining a reference moving muscle group corresponding to the currently played back video image frame and a reference muscle strength level;

Determining a second color element corresponding to the reference muscle strength level;

When the reference moving muscle group is the same as the moving muscle group, the moving muscle group is marked with the first color element in a preset human muscle group distribution map;

When the reference moving muscle group is different from the moving muscle group, in the preset human muscle group distribution map, the moving muscle group is marked with the first color element, and the second color element is marked with The reference motor muscle group is flashed to display the reference motor muscle group.

Optionally, the display unit 84 includes:

a judging subunit, configured to play back the video data in the terminal interface, and read the moving muscle group and the myoelectric intensity corresponding to the currently played back video image frame while playing back the video data, and determine the reading Whether there is abnormality in the acquired muscle group or myoelectric strength.

The alarm subunit is configured to render and display an audio alarm signal carried in the terminal interface in real time according to the read moving muscle group and the myoelectric intensity if the read moving muscle group or the myoelectric intensity is abnormal. Motion effect animation.

Optionally, the device further includes:

The reading unit is configured to read an image frame number corresponding to the currently played back video image frame.

Adding a unit for adding the image frame number to the motion effect animation displayed at the current moment, and saving the motion effect animation to be based on the currently played back video image frame when the video data is played back again Corresponding image frame number, the motion effect animation with the same image frame number is displayed in the terminal interface in real time.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the division of each functional unit and module described above is exemplified. In practical applications, the above functions may be assigned to different functional units as needed. The module is completed by dividing the internal structure of the device into different functional units or modules to perform all or part of the functions described above. Each functional unit and module in the embodiment may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit, and the integrated unit may be implemented by hardware. Formal implementation can also be implemented in the form of software functional units. In addition, the specific names of the respective functional units and modules are only for the purpose of facilitating mutual differentiation, and are not intended to limit the scope of protection of the present application. For the specific working process of the unit and the module in the foregoing system, reference may be made to the corresponding process in the foregoing method embodiment, and details are not described herein again.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

In the embodiments provided by the present invention, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the system embodiment described above is merely illustrative. For example, the division of the module or unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the embodiments of the present invention may contribute to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage. The medium includes a plurality of instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the methods described in various embodiments of the embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

The embodiments described above are only for explaining the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that The technical solutions described in the examples are modified, or some of the technical features are equivalently replaced; and the modifications or substitutions do not deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in Within the scope of protection of the present invention.

Claims (10)

1. A method for synchronizing video data and motion effect animation, comprising:

   Performing video recording on the motion process of the user to obtain video data, and synchronously collecting the myoelectric data corresponding to each frame of the video image when recording the video data;

   Parsing respective electromyography data corresponding to each video image frame to determine a corresponding moving muscle group and myoelectric intensity of each video image frame;

   Playing back the video data in a terminal interface;

   While playing back the video data, reading the moving muscle group and the myoelectric intensity corresponding to the currently played video image frame, and rendering the motion effect animation in the terminal interface in real time according to the read moving muscle group and the myoelectric intensity .
2. The synchronization method according to claim 1, wherein the rendering of the motion effect animation in the terminal interface in real time according to the read moving muscle group and the myoelectric intensity comprises:

   Determining the muscle strength level corresponding to the myoelectric intensity according to the read moving muscle group and the myoelectric intensity;

   Obtaining a first color element corresponding to the muscle strength level;

   In the preset human muscle group distribution map, the moving muscle group is marked with the first color element.
3. The synchronization method according to claim 2, wherein in the preset human muscle group distribution map, marking the sports muscle group with the first color element comprises:

   Obtaining a reference moving muscle group corresponding to the currently played back video image frame and a reference muscle strength level;

   Determining a second color element corresponding to the reference muscle strength level;

   When the reference moving muscle group is the same as the moving muscle group, the moving muscle group is marked with the first color element in a preset human muscle group distribution map;

   When the reference moving muscle group is different from the moving muscle group, in the preset human muscle group distribution map, the moving muscle group is marked with the first color element, and the second color element is marked with The reference motor muscle group is flashed to display the reference motor muscle group.
4. The synchronization method according to claim 1, wherein said playing the video data simultaneously reads a moving muscle group and a myoelectric intensity corresponding to the currently played back video image frame, according to the read moving muscle Group and myoelectric intensity, real-time rendering of motion effects animation in the terminal interface, including:

   While playing back the video data, reading the moving muscle group and the myoelectric intensity corresponding to the currently played video image frame, and determining whether the read moving muscle group or the myoelectric strength is abnormal;

   If there is an abnormality in the recorded muscle group or the myoelectric intensity, the motion effect animation carrying the audio alarm signal is rendered in real time on the terminal interface according to the read moving muscle group and the myoelectric intensity.
5. The synchronization method according to any one of claims 1 to 4, further comprising:

   Reading an image frame number corresponding to the currently played back video image frame;

   Adding the image frame number to the motion effect animation displayed at the current moment, and saving the motion effect animation to be based on the image frame number corresponding to the currently played back video image frame when the video data is played back again And displaying the motion effect animation with the same image frame number in the terminal interface in real time.
6. A synchronization device for video data and motion effect animation, comprising:

   The collecting unit is configured to perform video recording on the motion process of the user to obtain video data, and synchronously collect the myoelectric data corresponding to each frame of the video image when the video data is recorded;

   The analyzing unit is configured to parse the respective electromyographic data corresponding to each video image frame to determine a moving muscle group and a myoelectric intensity corresponding to each video image frame;

   a playback unit, configured to play back the video data in a terminal interface;

   a display unit, configured to read the moving muscle group and the myoelectric intensity corresponding to the currently played back video image frame while playing back the video data, according to the read moving muscle group and the myoelectric intensity, in real time at the terminal The interface renders motion animation.
7. The synchronization device according to claim 6, wherein the display unit comprises:

   Determining a subunit for determining a muscle strength level corresponding to the myoelectric strength according to the read moving muscle group and the myoelectric intensity;

   Obtaining a subunit, configured to acquire a first color element corresponding to the muscle strength level;

   a display subunit for marking the moving muscle group with the first color element in a preset human muscle group distribution map.
8. The synchronization device according to claim 7, wherein the display subunit is specifically configured to:

   Obtaining a reference moving muscle group corresponding to the currently played back video image frame and a reference muscle strength level;

   Determining a second color element corresponding to the reference muscle strength level;

   When the reference moving muscle group is the same as the moving muscle group, the moving muscle group is marked with the first color element in a preset human muscle group distribution map;

   When the reference moving muscle group is different from the moving muscle group, in the preset human muscle group distribution map, the moving muscle group is marked with the first color element, and the second color element is marked with The reference motor muscle group is flashed to display the reference motor muscle group.
9. The synchronization device according to claim 6, wherein the display unit comprises:

   a judging subunit, configured to play back the video data in the terminal interface, and read the moving muscle group and the myoelectric intensity corresponding to the currently played back video image frame while playing back the video data, and determine the reading Whether there is abnormality in the acquired muscle group or myoelectric strength;

   The alarm subunit is configured to render and display an audio alarm signal carried in the terminal interface in real time according to the read moving muscle group and the myoelectric intensity if the read moving muscle group or the myoelectric intensity is abnormal. Motion effect animation.
10. The synchronization device according to any one of claims 6 to 9, further comprising:

    a reading unit, configured to read an image frame number corresponding to the currently played video image frame;

    Adding a unit for adding the image frame number to the motion effect animation displayed at the current moment, and saving the motion effect animation to be based on the currently played back video image frame when the video data is played back again Corresponding image frame number, the motion effect animation with the same image frame number is displayed in the terminal interface in real time.

Images