WO2023082463A1

WO2023082463A1 - Auxiliary fitness method, device and system having interaction function

Info

Publication number: WO2023082463A1
Application number: PCT/CN2022/070911
Authority: WO
Inventors: 何思然; 杨俊杰; 张璟; 张越; 杨洋; 曾晓嘉
Original assignee: 成都拟合未来科技有限公司
Priority date: 2021-11-12
Filing date: 2022-01-10
Publication date: 2023-05-19
Also published as: CN114028794A

Abstract

An auxiliary fitness method, device and system having an interaction function, relating to the field of fitness, and comprising: presetting control content and a preset action corresponding to the control content, the preset action being executed as a control instruction, and the execution result being the implementation of the control content; displaying a fitness course on the auxiliary fitness device; a user sending a control instruction on the basis of the preset action corresponding to the control content; the auxiliary fitness device acquiring image data of the user; the auxiliary fitness device acquiring user action information according to the image data; and comparing the user action information with the preset action, and executing the control instruction corresponding to the preset action. The method can enhance the interactivity and interestingness of the user during fitness, and can facilitate a control center or coach to master the condition of the user, so as to better adjust fitness courses and facilitate long-term use.

Description

Auxiliary fitness method, equipment and system with interactive function

technical field

The present disclosure relates to the field of fitness, in particular to an auxiliary fitness method, equipment and system with interactive functions.

Background technique

Fitness is a kind of sports project that improves people's body and enhances people's physique. The exercise form and practice methods of fitness need to be formulated according to the principles of human life science to achieve the purpose of promoting people's physical and mental health. Unscientific excessive exercise will cause damage to the human body. With the accelerated pace of people's work and life, more and more people realize the importance of exercise and fitness, and exercising 3-5 times a week is more beneficial to their health. The fitness programs in the gym are rich and have professional fitness coaches to guide them. The fitness effect is good. However, after a busy day’s work, if people need to go to the gym to exercise, it is too energy-intensive and time-consuming. Most people will choose to follow the TV and computer at home. Or fitness equipment such as mobile phones. With the continuous attention to fitness, smart fitness mirrors have begun to be widely used. Smart fitness mirrors display various devices built into the body and are displayed and mirrored by the front mirror. However, in the actual use process, users directly follow the smart fitness mirror. Played fitness courses for fitness, poor interactivity, unable to obtain the user's situation and feedback in a timely manner, not conducive to long-term use by users, and less interesting.

Contents of the invention

An object of the present disclosure is to provide an auxiliary fitness method and system with an interactive function, so that users can interact during the fitness process, improve the fun of the fitness process, and facilitate long-term use by the user.

This purpose is achieved using the following technical solutions, including:

The preset control content and the preset action corresponding to the control content, the preset action can be executed as a control instruction, and the execution result is the realization of the control content;

Display fitness courses on auxiliary fitness equipment;

The user issues a control command based on the preset action corresponding to the control content;

The auxiliary fitness equipment obtains the image data of the user;

The auxiliary fitness equipment obtains user action information according to the image data;

The user action information is compared with the preset action, and the control instruction corresponding to the preset action is executed.

In the present disclosure, the auxiliary fitness equipment may include a display device, a processing device, etc., and the display device may include a display and/or a mirror glass. For example, a display device may be composed of at least one display and at least one mirror glass. The reflection and transmission of light by the mirror glass may have a certain ratio. to a fitness class on the monitor. Among them, the fitness courses can be in various forms, including one or a combination of video, image, voice, text and so on. The exercise course can be at least one of pre-recorded, real-time generated, and real-time adjustment based on pre-recorded. For example, pre-recorded fitness classes can be stored in a storage device, and when retrieval is triggered, the auxiliary fitness device directly retrieves from the storage device. The storage device may be located in the fitness assisting device or in an external device other than the fitness assisting device. The fitness course can also be generated in real time, that is, the fitness coach teaches in the form of live broadcast. During the live broadcast, multiple users can watch and perform fitness training at the same time.

In order to further enhance the user's interaction in the fitness process, the user can input feedback information during the display of the fitness course, and any system can give a response based on the feedback information, so that the fitness coach or the control center can obtain the user's feedback information, In order to make timely adjustments to the fitness courses, and at the same time, the user is more interactive during the fitness process, avoiding the user's long-term fatigue and reducing interest in fitness. In the present disclosure, the feedback information is a control command, that is, the user inputs a control command, and the system responds based on the control command, and the control command can be set in various ways. In this disclosure, the control instruction is preset by the system. The fitness coach or the control center sets the control content and defines the preset action corresponding to the control content. The preset action can be executed as a control instruction, and the result of the execution is the control realization of the content. Therefore, in the present disclosure, the user issues a control command based on a preset action corresponding to the control command. When a control command is issued, the preset action corresponding to the control command can be displayed to the user, so that the user can issue a control command based on the displayed content. The display device can be divided into one or more areas or have one or more key points to display the preset action. Set actions and their corresponding control content. The user can select the control content he needs according to the displayed content, and execute the preset action corresponding to the control content. The auxiliary fitness equipment obtains the user's real-time image data, that is, captures the image or video of the user issuing the control command. Image data can be expressed in various forms, such as images or videos. The system can identify the user's actions in the image data and match the corresponding control instructions. Among them, the system can recognize the image in various ways to determine the control instruction issued by the user. For example, identify the key points of the user in the image (eg, joints of the hand, etc.), determine the type of the user's gesture (ie, determine the user's action), so as to determine the control instruction issued by the user. For another example, the control instruction issued by the user is determined according to the degree of matching between the standard image corresponding to the control instruction and the user image. Further, the user may give up the command action before the control command is completed, so as to cancel the sending of the control command. Specifically, by acquiring the action time of the control command issued by the user, comparing the action time with the preset time threshold, if the action time is greater than or equal to the time threshold, the control command corresponding to the preset action is executed, otherwise, the command action is abandoned.

In order to further improve the interaction effect, the control content of the present disclosure may include at least one of instruction-type control content, selection-type control content, question-and-answer type control content, or barrage-type control content. When the control content is an instruction control content, the control content includes one or more feedbacks or interactions for the user to give instructions, and sending a feedback or interaction to the auxiliary fitness device is the realization of the control content. When the control content is selection control content, the control content includes one or more feedbacks or interactions for the user to select, and sending a feedback or interaction to the auxiliary fitness device is the realization of the control content. When the control content is a question-and-answer control content, the control content includes several sub-control contents, and there can be multiple control contents. One control content is a question, and the sub-control content is an answer option. Each sub-control content corresponds to a sub-preset action. , in the fitness course, when the trigger instruction is recognized, the corresponding control content, sub-control content and corresponding sub-preset action will appear on the display device, and the user selects the corresponding sub-control content according to the control content, and only needs to issue the The sub-preset action corresponding to the sub-control content is enough. After sending out, the auxiliary fitness equipment will recognize the action made by the user and match the corresponding control command, and then execute the corresponding control command. When executing the corresponding control command, the user will The name information, avatar information and selected sub-control content can be displayed on the display device, and after executing the control command corresponding to the sub-preset action, the number of users who execute the same sub-control content within the same time period can also be obtained, and in the auxiliary It is displayed on the fitness equipment, so that the user can not only interact with the fitness coach when exercising, the coach or the control center can grasp the user's fitness situation, and at the same time, the user can see the fitness situation of other users, which increases the interactivity and fun of fitness.

Furthermore, when triggering command recognition, it can be pre-set for the fitness coach or the control center at different stages in the fitness course, that is, when the fitness course reaches a certain stage, the command recognition is automatically triggered, and the control content is displayed on the display device. Users answer preset questions and select answers to questions through actions. It can also be used for the control center or fitness trainer to control the trigger command recognition, including but not limited to, the control center or fitness trainer triggers the control button to ask real-time questions, or the control center or fitness trainer temporarily sets the control content and preset actions, and executes the action through the trigger button. Trigger command recognition.

When the control content is a barrage control content, the control content is the preset barrage content, and there are multiple control contents. Each control content corresponds to a preset action. When the user wants to send one or more barrages , select the corresponding control content. When selecting, you only need to issue the preset action corresponding to the control content. After sending out, the auxiliary fitness equipment will recognize the user's action and match the corresponding control command, and then execute the corresponding control command. When executing the corresponding control instruction, the user's name information, avatar information and selected control content may be displayed on the display device, and at the same time, the user's name information, avatar information and selected control content may not be displayed on the display device, The present disclosure also includes a switch for controlling whether to display the control content, and when the switch is triggered, the display of the control content is turned off. Improve the fun of fitness by sending barrage. Furthermore, when the instruction is recognized, it can be triggered when the fitness course is played, and then the user can send the control instruction at any time during the whole process of fitness, and the trigger of the instruction recognition can also be triggered by the user through the control button or a specific action. After triggering, send out the preset action corresponding to the control content.

Further, for the present disclosure, the fitness course may be in various forms, including a combination of one or more of video, image, voice, and text. The exercise course can be at least one of pre-recorded, real-time generated, and real-time adjustment based on pre-recorded. For example, pre-recorded fitness classes can be stored in a storage device, and when retrieval is triggered, the auxiliary fitness device directly retrieves from the storage device. The storage device can be located in the auxiliary fitness equipment, or in an external device other than the auxiliary fitness equipment. The fitness course can also be generated by the coach in real time. The user of the present disclosure can use multiple auxiliary fitness equipment for one or more users to exercise at the same time. When multiple users simultaneously perform the fitness course generated in real time, the Multiple users can interact through displayed controls on their respective assistive fitness devices.

The present disclosure also provides an auxiliary fitness equipment with interactive functions, including:

The preset module is used to preset the control content and the preset action corresponding to the control content. The preset action can be executed as a control instruction, and the execution result is the realization of the control content;

The display module is used for displaying fitness courses on the auxiliary fitness equipment;

The command module is used for the user to issue a control command based on the preset action corresponding to the control content;

The first acquisition module is used to assist the fitness equipment to acquire the user's image data;

The second acquisition module is used to assist the fitness equipment to acquire user action information according to the image data;

The execution module is used to execute the control instruction corresponding to the preset action according to the comparison information between the user information and the preset action, wherein the preset action can be executed as a control instruction, and the execution result is the realization of the control content.

Further, the command module is used for the user to issue a control command based on the preset action corresponding to the control command and execute:

Trigger command recognition;

The control content and the preset action corresponding to the control content are displayed on the auxiliary fitness equipment;

The preset action corresponding to the control content is issued by the user as a control instruction.

Further, the auxiliary fitness equipment acquires the user's image data as real-time image data.

Further, the execution module is configured to execute the control instruction corresponding to the preset action according to the comparison information between the user information and the preset action, and the comparison includes:

Compare the user action information with the preset action to determine whether the action information is the same as the preset action. If they are the same, obtain the action time when the user issues the control command, compare the action time with the preset time threshold, and if the action time is greater than or equal to the time threshold , then execute the control instruction corresponding to the preset action.

Further, the exercise course is one or more of pre-recorded or real-time generated or real-time adjustment based on pre-recorded.

Further, the control content may include at least one of instruction-type control content, selection-type control content, question-and-answer type control content, or barrage-type control content.

Further, after the execution module executes the control instruction corresponding to the preset action, the user information and the control content executed by the user are displayed on the auxiliary fitness equipment.

Further, when the control content is question-and-answer control content, the control content includes several sub-control content, each sub-control content corresponds to a sub-preset action, and the sub-preset action can be executed as a control instruction, and the execution result is the For the realization of the sub-control content, after the execution module executes the control instruction corresponding to the sub-preset action, it obtains the number of users who execute the same sub-control content, and displays it on the auxiliary fitness equipment.

According to another aspect of the present disclosure, there is provided an auxiliary fitness system with an interactive function for performing any of the aforementioned auxiliary fitness methods, and the auxiliary fitness system includes:

The display module is used to obtain fitness courses and display them on the auxiliary fitness equipment;

The obtaining module is used to obtain the user's image data through the auxiliary fitness equipment, and obtain the user's action information according to the image data;

The comparison module is used to judge whether the user's action information and the preset action corresponding to the preset control content are the same, and send the comparison information to the execution module;

The execution module is configured to execute the control instruction corresponding to the preset action according to the comparison information, wherein the preset action can be executed as a control instruction, and the execution result is the realization of the control content.

The display module is also used to display user information and control content executed by the user on the auxiliary fitness equipment after executing the control instruction corresponding to the preset action.

Compared with the prior art, the present disclosure has the following advantages and beneficial effects:

The present disclosure provides an auxiliary fitness method and system with interactive functions. During the exercise process of the present disclosure, the user sends out a preset action corresponding to the control content, and after sending out, the auxiliary fitness device recognizes the user's action and matches the corresponding control command, and then Execute corresponding control instructions, including but not limited to answering questions raised by the fitness coach or the control center, generating bullet screens, etc., which can not only increase the interaction and fun of the user during the fitness process, but also facilitate the control center or the coach to grasp User situation, better adjustment of fitness courses for long-term use.

Moreover, the control content of the present disclosure can be self-defined, and the flexibility is higher. At the same time, when the user selects the control content, it can be used through preset actions, and the user does not need to operate and select on the auxiliary fitness equipment, so the flexibility is higher and more flexible. It is convenient to quickly select answers to questions and send barrage during the fitness process to improve usage efficiency.

Description of drawings

The drawings described here are used to provide further understanding of the embodiments of the present disclosure, constitute a part of the application, and do not limit the embodiments of the present disclosure. In the attached picture:

Fig. 1 is a schematic flow chart of an auxiliary fitness method with interactive functions;

2 is a schematic diagram of the composition of the auxiliary fitness system with interactive functions;

Fig. 3 is a display interface diagram A of the auxiliary fitness equipment with interactive functions;

Fig. 4 is a display interface diagram B of auxiliary fitness equipment with interactive functions;

Fig. 5 is a display interface diagram C of auxiliary fitness equipment with interactive functions;

Fig. 6 is a display interface diagram D of auxiliary fitness equipment with interactive functions;

7 is a schematic diagram of the composition of auxiliary fitness equipment with interactive functions;

Fig. 8 is a schematic diagram of interaction between a user and an auxiliary fitness device with an interactive function.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the present disclosure will be further described in detail below in conjunction with the examples and accompanying drawings. As a limitation of this disclosure.

In describing the present disclosure, it is to be understood that the terms "front", "rear", "left", "right", "upper", "lower", "vertical", "horizontal", "high", The orientation or positional relationship indicated by "low", "inner", "outer", etc. are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present disclosure and simplifying the description, rather than indicating or implying the referred device or positional relationship. Elements must have certain orientations, be constructed and operate in certain orientations, and thus should not be construed as limiting the scope of the present disclosure.

It can be understood that the term "a" should be understood as "at least one" or "one or more", that is, in one embodiment, the number of an element can be one, while in another embodiment, the number of the element The quantity can be multiple, and the term "a" cannot be understood as a limitation on the quantity.

【Example 1】

The present disclosure has an auxiliary fitness method with an interactive function, preset control content and preset actions corresponding to the control content, the preset action can be executed as a control command, and the execution result is the realization of the control content;

Fitness courses are displayed on the auxiliary fitness equipment; wherein, the auxiliary fitness equipment may include a display device, a processing device, and the like. In some embodiments, the display device can display real-time fitness information of the user using the device in addition to displaying preset content for the user. For example, the display device of the auxiliary fitness equipment can display fitness courses such as videos or images for the user, and display the fitness data of the user's exercise according to the fitness courses. For example, the fitness data may include images and videos of the user's fitness actions, physiological data of the user during fitness, and the like. In some embodiments, the auxiliary fitness device may also include a voice device. In some embodiments, the audio device can play the real-time fitness information of the user using the device in addition to playing preset content for the user. For example, a voice device of an auxiliary fitness device can play a fitness course and play fitness data of a user exercising according to the fitness course. In some embodiments, the exercise data may also include audio and the like emitted by the user during exercise. A display device may include a display and/or mirror glass. For example, a display device may be composed of at least one display and at least one mirror glass. The reflection and transmission of light by the mirror glass may have a certain ratio. to a fitness class on the monitor. There are many ways to trigger the acquisition of fitness courses. In some embodiments, the auxiliary fitness system obtains the fitness course based on the course request instruction input by the user on the auxiliary fitness equipment. In some embodiments, the assisted fitness system can be triggered automatically. For example, the auxiliary fitness system can recognize the user's fitness intention and automatically trigger the acquisition of fitness courses. The fitness intention may be the willingness to exercise expressed directly or indirectly through various behaviors of the user. The fitness intention can be determined by one or more of the user's appearance, user's action, user's location, and user's expression. For example, if the infrared sensing device of the auxiliary fitness equipment senses that the user's distance from the auxiliary fitness equipment is less than a preset threshold, it is determined that the user has an exercise intention. In another example, the auxiliary fitness system determines that the user has fitness intentions based on the image of the user's appearance captured by the camera. There is no limitation on the manner of determining the fitness intention here. The fitness courses can be in various forms, including one or more combinations of video, image, voice, and text. The exercise course can be at least one of pre-recorded, real-time generated, and real-time adjustment based on pre-recorded. For example, pre-recorded fitness classes can be stored in a storage device, and when retrieval is triggered, the auxiliary fitness device directly retrieves from the storage device. The storage device can be located in the auxiliary fitness equipment, or in an external device other than the auxiliary fitness equipment.

The user issues a control command based on the preset action corresponding to the control content; when the user uses any system (not limited to the auxiliary fitness system), the user can input the control command, and any system can give a response based on the control command. In some embodiments, the preset action corresponding to the control instruction can be displayed to the user, so that the user can issue the control instruction based on the displayed content. For example, the display device of any system may be divided into one or more regions or have one or more key points to display preset actions and corresponding control contents. Users can select the control content they need according to the displayed content, and execute the preset action corresponding to the control content. At the same time, the control command can be set in various ways. In some embodiments, the control instruction may be any system preset. In some embodiments, the fitness trainer or the control center presets several control contents, and customizes the preset actions corresponding to each control content. The preset actions can be executed as control instructions, and the execution result is the realization of the control contents. For example, a fitness trainer can set the control content as a question-and-answer control content, such as whether the control content is menstruating or feeling anxious. There are two sub-control content of this control content, which are "yes" and "no". The preset sub-control content of the control center is "Yes", and the corresponding sub-preset action is to raise the left hand for 2 seconds, and the sub-preset action corresponding to the preset sub-control content of the fitness trainer or the control center is "No", and the corresponding sub-preset action is to raise the right hand for 2 seconds , when the user triggers command recognition, the control content, sub-control content and corresponding sub-preset actions appear on the display device, and the user chooses the answer according to his own situation. When he chooses "Yes", he raises his right hand for 2 seconds to assist fitness The device recognizes the actions made by the user and matches the corresponding control instructions. When the control instructions are executed, the selected sub-control content will be displayed on the display device. See sub-controls selected by other users for added fitness interactivity.

In some embodiments, the fitness coach or the control center or the user presets several control contents, and customizes the preset action corresponding to each control content. The preset action can be executed as a control instruction, and the execution result is the result of the control content accomplish. For example, the control content is barrage information, and each control content corresponds to a preset action. For example, if the barrage information is "Favorite teacher", the control content is "Favorite teacher", and the preset action of the control content is Bixin, triggers the user to trigger command recognition, the control content and the corresponding preset action appear on the display device, and the user chooses the barrage that he wants to send according to his own situation, that is, the control content. When the user wants to send "Favorite teacher" When controlling the content, Bixin 2 seconds, the auxiliary fitness equipment will recognize the actions of the user and match the corresponding control commands. When the control commands are executed, the selected control content will be displayed on the display device, and when there are multiple people When exercising in the fitness course, the user can also see the control content selected by other users. The identification of the trigger control instruction can be in various ways. In some embodiments, the assisting fitness system triggers command recognition based on the user triggering the command recognition button on the assisting fitness device. In some embodiments, the assisted fitness system can be triggered automatically. For example, when the auxiliary fitness system recognizes that the user's action is similar to the preset action of the control command, it automatically triggers command recognition. In some embodiments, the control center or the fitness trainer presets the triggering time of instruction recognition, for example, the instruction recognition can be triggered at the beginning of the fitness class, or the instruction recognition can be automatically triggered 10 minutes after the fitness class starts.

The auxiliary fitness equipment acquires the user's image data; the auxiliary fitness equipment acquires the user's action information according to the image data; in some embodiments, the camera can capture the user's real-time image data, that is, capture the image or video of the user issuing a control command. Image data can be expressed in various forms, such as images or videos. The system can identify the user's actions in the image data and match the corresponding control instructions. In some embodiments, the system can recognize the image in various ways to determine the control instruction issued by the user. For example, identify the key points of the user in the image (eg, joints of the hand, etc.), determine the type of the user's gesture (ie, determine the user's action), so as to determine the control instruction issued by the user. For another example, the control instruction issued by the user is determined according to the degree of matching between the standard image corresponding to the control instruction and the user image. In some embodiments, the user may give up the command action before the control command is completed, so as to cancel the sending of the control command. For example, it takes 2 seconds to send the control content of "My Favorite Teacher". The user can give up the command action at any time within these 2 seconds to cancel the barrage. In some embodiments, the system may remind the user in various ways whether the preset action corresponding to the control instruction has been completed. The reminder method is not limited to one or more of image, text, sound, and vibration.

[Example 2]

The following is an introduction to the auxiliary fitness method with interactive functions of the present disclosure in combination with specific examples:

As shown in Figure 3, when the user is in a live or recorded video course, a two-way data channel between the auxiliary fitness equipment and the server of the auxiliary fitness equipment will be provided. Before that, we preset the preset action and the corresponding Control content, in this live broadcast or recorded video course, the preset action is the control command of the corresponding control content, and the result of executing the preset action is the realization of the corresponding control content. As shown in Figure 3, the coach in the live broadcast or recorded video class sends out a question. In some embodiments, this question can be about the difficulty of all or part of the actions in the live broadcast or recorded video class, the difficulty of learning, the The degree of liking, the degree of fatigue up to now, the degree of liking for the coach, etc. about the live or recorded video course or the evaluation of the coach, etc., or other questions, the text directly below the coach in Figure 3 is the text of the question illustrate. At this time, for the question, there will be a preset answer option, and the answer option at this time is the control content, and sending the answer option is the realization of the control content. The two circles at the bottom of Fig. 3 and the upper and lower lines on the right side of the circle represent an example of setting the answer options, and the answer options in this embodiment are two items: the left answer option and the right answer option. The content of the two lines of text can be the text content of the answer option and the text introduction of the corresponding preset action, and the circle can be the pattern representative of the answer option or the pattern representative of the preset action. The pattern here is just a representative pattern , which can be an animated or symbolic pattern or text. When a user performs the preset action corresponding to the left answer option, it means that the user's answer to the question is the left answer option; similarly, when a user performs the preset action corresponding to the right answer option, it means The user's answer to the question is the answer option on the right. In addition, according to different actual questions, different numbers of answer options may also be set, as long as the preset actions corresponding to each answer option are different. Specifically, as shown in Figure 3, the question raised by the coach is "whether it is difficult for the user to exercise the course content". At this time, the answer option on the left is "feeling easy", and the default action is "raise the left hand"; the answer option on the right is "feeling difficult", and the default action is "raise the right hand". Then, after the camera on the fitness auxiliary device acquires the image data of the user, the fitness auxiliary device or the server of the fitness auxiliary device sends a data request (HTTP), and the fitness auxiliary device or the server of the fitness auxiliary device analyzes the user's image data, and analyzes the user's action information , and then compare the user action information with the preset action, identify which preset action the user action information corresponds to, and obtain which preset action the user did, whether it was "raise the left hand" or "raise the right hand", and then execute the analysis to find out The control command corresponding to the preset action performed by the user, if the analysis shows that the user is doing "raise the left hand", then execute and send the user's answer is "feeling relaxed", if the analysis shows that the user is doing "raise the right hand" , the execution sends the user whose answer is "feeling difficult". The content and corresponding relationship between preset actions and answer options in this embodiment can be flexibly adjusted according to application requirements, and its expression form can be text, pattern or animation, etc., and is not limited to the settings in this embodiment.

[Example 3]

As shown in Figure 4, when the user is in a live broadcast or recorded video course, a two-way data channel between the auxiliary fitness equipment and the server of the auxiliary fitness equipment will be provided. Before that, we have preset actions and corresponding actions Control content, in this live broadcast or recorded video course, the preset action is the control command of the corresponding control content, and the result of executing the preset action is the realization of the corresponding control content. As shown in Figure 4, the four-line barrage in the lower left corner of the auxiliary fitness equipment is a body barrage sent by the user, which is used to display some body barrages sent by the user of the live broadcast or video course. The larger circle frame in the lower left corner can be the user avatar of the user of the auxiliary fitness equipment, and the smaller circle in the bottom row in Figure 4 can be the user avatar who participated in the live broadcast class or the recorded video class. When the user enters the live broadcast or recorded video course, the user can send bullet chatting according to actual needs. Different bullet chatting is used as different control content, and also corresponds to different preset actions. When the user makes a preset action, then After the camera on the fitness assisting device obtains the user's image data, the fitness assisting device or the server of the fitness assisting device sends a data request (HTTP), and the fitness assisting device or the server of the fitness assisting device analyzes the user's image data, analyzes the user's action information, Then compare the user action information with the preset action, identify which preset action the user action information corresponds to, obtain which preset action the user did, and then send the barrage corresponding to the preset action. Better, here we may set a wake-up action to prevent the user from being recognized as sending a barrage when other actions similar to the preset action are performed. When the user makes a wake-up action, an interface similar to Figure 5 will appear. The progress bar in the larger circle box in the lower left corner of Figure 5 indicates that the user is waking up. The interface shown in Figure 6 provides some bullet chatting options, and the text directly below the coach in Figure 6 is the text description of the bullet chatting. There will be a preset barrage option below, and the barrage option at this time is the control content, and sending the barrage option is the realization of the control content. The four circles at the bottom of Figure 6 and the two lines of text on the right side of the circle represent the setting example of the barrage option. The barrage option in this embodiment is four items: the barrage option A on the upper left, the barrage option B on the upper right, and the Bullet chat option C and bullet chat option D in the lower right. In addition, different numbers of bullet chat options can be set, as long as the preset actions corresponding to each bullet chat option are different. Specifically, as shown in Figure 6, the barrage option A is "Like XX coach", and the default action is "Raise your left hand"; the barrage option B is "Thank you XX coach", and the default action is "Raise your right hand" ;Bullet chat option C is "the user is sweating profusely", and the default action is "raise the left leg"; the bullet chat option D is "the user feels very happy", and the default action is "raise the right leg". After the camera on the fitness assisting device obtains the user's image data, the fitness assisting device or the server of the fitness assisting device sends a data request (HTTP), and the fitness assisting device or the server of the fitness assisting device analyzes the user's image data, analyzes the user's action information, Then compare the user's action information with the preset action, identify which preset action the user's action information corresponds to, and obtain which preset action the user is doing, such as "raise the left hand", "raise the right hand", "raise the left leg " or "raise the right leg", and then execute the control command corresponding to the preset action performed by the analyzed user. If the analysis shows that the user is doing "raise the left hand", then execute and send the user's barrage is "like XX "Coach", if the analysis shows that the user is doing "raise the right hand", then execute and send the barrage to the user is "Thank you XX coach"; if the analysis shows that the user is doing "raise the left leg", then execute and send the user The bullet chat of the user is "the user is sweating profusely"; if the analysis shows that the user did "raise the right leg", then the bullet chat sent to the user is "the user feels very happy". Here, the server of the fitness auxiliary equipment handles the business logic, and broadcasts barrage messages (MQTT) to all auxiliary fitness equipment participating in the live broadcast or recording video course, and each auxiliary fitness equipment pushes the received barrage into the local queue, according to The priority and frequency specified by the business will display the barrage on the auxiliary fitness equipment. The content and corresponding relationship between preset actions and barrage options in this embodiment can be flexibly adjusted according to application requirements, and its expression form can be text, pattern or animation, etc., and is not limited to the settings in this embodiment.

【Example 4】

As shown in Figure 8, when the user is in the course interface, the interface after the live or recorded video course, or the user's personal main interface, a prompt message will appear to inform the user to give feedback or interact with the auxiliary fitness equipment. At this time, there will be a or multiple feedbacks or interactions for the user to instruct or select. Different feedbacks or interactions correspond to different preset actions. Here, different feedbacks or interactions are the control content. Sending a feedback or interaction to the auxiliary fitness equipment is the control content. accomplish. As shown in Figure 8, it is a course interface, showing a prompt to start the course by raising your hand. The user selects the feedback or interaction corresponding to the preset action of "raise hand". After the auxiliary fitness device recognizes that the user has made the preset action, it means that the user sends the preset action of "raise hand" to the auxiliary fitness device. ” and start playing the corresponding lesson. In this embodiment, different preset actions may be set for different instruction contents. The user can instruct the auxiliary fitness equipment to start the course, suspend the course, end the course, etc. by setting different preset actions. Similarly, when setting multiple feedbacks or interactions, it is only necessary to ensure that the preset actions corresponding to each feedback or interaction are different. For example, after a live or recorded class video ends, the fitness device will display opt-in prompts such as "raise your right hand" if you like the class, and "raise your left hand" if you don't like the class. If the user selects the feedback or interaction corresponding to the preset action "raise the right hand" or "raise the left hand", after the auxiliary fitness device recognizes that the user has made the preset action, it will record the user's course feedback locally, or Send course feedback for this user to the server. In addition, it should be noted that the main interface here can be about courses, training schedules, user personal achievements, badges or other similar interfaces, and the interface after the live broadcast or recorded video course here can be the user's The evaluation of the recorded video course, the degree of fatigue or self-perception of the user during the training of the live broadcast or recorded video course, etc. The preset action in this embodiment and the feedback or interactive content for users to instruct or select and their corresponding relationship can be flexibly adjusted according to the needs of the application, and its expression form can be text, pattern or animation, etc., and is not limited to this embodiment. example settings.

【Example 5】

The following is an introduction to the auxiliary fitness method with interactive functions in the present disclosure in combination with specific examples:

This method includes:

Operation 1 presets the control content and the preset action corresponding to the control content. The preset action can be executed as a control instruction, and the execution result is the realization of the control content;

1.1 Control content includes question-and-answer control content and barrage control content;

1.11 When the control content is a question-and-answer control content, the control content includes several sub-control content, each sub-control content corresponds to a sub-preset action, and the sub-preset action can be executed as a control command, and the execution result is the sub-control To realize the content, after executing the control instruction corresponding to the sub-preset action, obtain the number of users who execute the same sub-control content within the same time period, and display it on the auxiliary fitness equipment. For example, the control content is a question, the sub-control content is an option, and there are 2-4 sub-control content. Each sub-control content corresponds to a different sub-preset action. For example, sub-control content 1 corresponds to raising the left hand, and sub-control content 2 corresponds to Raise the right hand, sub-control content 3 corresponds to raising the left leg, and sub-control content 4 corresponds to raising the right leg. In this embodiment, the information of the control content and the sub-control content can be modified and replaced by the fitness trainer or the control center, and when the setting is modified, it can be before the fitness course starts or during the fitness course.

1.111 When triggering the instruction recognition of the question-and-answer control content, the fitness coach can directly trigger the instruction recognition through the coaching equipment or the control center. After triggering, the control center will send the control content, sub-control content and corresponding sub-preset actions to the display device , to assist the fitness equipment to identify the user's actions, and feed back the recognition results to the control center. The control center feeds back the user's choice and the statistical data of different user selection results in this period on the display device. At the same time, the coaching device also receives the user's selection and statistical data, that is The control center or the fitness coach triggers classroom questions and answers. The control center or the fitness coach sends the questions and answer options to the display device, and triggers command recognition to assist the fitness device to identify user actions. In this operation, the trigger command recognition can not only be used by the fitness coach or The control center triggers in real time, and it can also be preset, that is, the first control content is triggered when the fitness class is 10 minutes old, and the second control content is triggered when the fitness class is 20 minutes old.

1.12 When the control content is a barrage control content, each control content is a barrage message, each control content corresponds to a preset action, and the preset action can be executed as a control command, and the result of the execution is the control The realization of the content, after executing the control instruction corresponding to the preset action, the control content is displayed on the auxiliary fitness equipment. For example, the control content is "Let me drink slowly", and the preset action corresponding to the control content is to drink water. After the trigger command is recognized, the user initiates a drinking action, assisting the fitness equipment to recognize the user's action and feedback the recognition result to the control Center, the control center sends the control content to the display device, the coach device and the display devices of other users;

1.121 When the instruction recognition of triggering bullet chatting control content can be triggered for the user, the user can choose to close the bullet chatting or open the bullet chatting. When closing the bullet chatting, it will not receive the bullet chatting control content of other users. When the user When the barrage function is turned on, command recognition is triggered, and the fitness equipment is assisted to obtain the control content of the barrage and the corresponding preset action. When the user selects the barrage to be sent, he only needs to make the corresponding action command to assist the fitness equipment to identify The user moves, and the recognition result is fed back to the control center, and the control center sends the control content to the display device, the coaching device, and the display devices of other users.

Operation 2: Display the fitness course on the auxiliary fitness equipment; in this operation, the fitness course can be at least one of pre-recorded, real-time generated, and real-time adjustment based on pre-recorded.

Operation 3. The user issues a control command based on the preset action corresponding to the control content;

3.1 When you want to send barrage-type control content, the trigger instruction is identified as user trigger; when you want to send question-and-answer control content, the trigger instruction is identified as trigger by the control center or coach equipment, and when triggered, it can be triggered in real time. That is, triggering the command recognition button triggers the command recognition. It can also be triggered automatically.

3.2 After the trigger command is recognized, the control content and the preset action corresponding to the control content are displayed on the auxiliary fitness equipment;

3.21 When it is a question-and-answer control content, the user selects the sub-control content, that is, selects the answer option corresponding to the question, and after selection, it is enough to make the preset action corresponding to the sub-control content, that is, the user based on the preset action corresponding to the control content Actions are issued as control commands;

3.22 When it is a barrage-type control content, the user selects the barrage that he wants to send, that is, the control content, and after selection, takes the preset action corresponding to the control content, that is, the user uses the preset action corresponding to the control content as a control command issue;

Operate 4 auxiliary fitness equipment to obtain real-time image data of the user;

4.1 In this embodiment, the auxiliary fitness equipment captures the real-time image data of the user through the camera, that is, captures the image or video of the control command issued by the user.

Operation 5 assists fitness equipment to obtain user action information according to image data;

5.1 The system can identify the user's actions in the image data and match the corresponding control instructions. In this embodiment, the system can determine the type of the user's gesture (that is, determine the user's action) by identifying key points of the user in the image (eg, joints of the hand, etc.), so as to determine the control instruction issued by the user.

Operation 6 compares the user action information with a preset action, and executes a control instruction corresponding to the preset action.

6.1 Compare the user's action information with the preset action, and judge whether the action information is the same as the preset action. If they are the same, obtain the action time of the user's control command, compare the action time with the preset time threshold, and if the action time is greater than or equal to the time threshold, execute the control command corresponding to the preset action.

[Example 6]

An auxiliary fitness system with interactive functions, on the basis of Embodiment 4, as shown in Figure 2, includes: a display module for obtaining fitness courses and displaying them on the auxiliary fitness equipment; an acquisition module for obtaining the user's information through the auxiliary fitness equipment image data, and obtain the user’s action information according to the image data; the comparison module is used to judge whether the user’s action information and the preset action corresponding to the preset control content are the same, and send the comparison information to the execution module; the execution module uses The control instruction corresponding to the execution of the preset action according to the comparison information, wherein the preset action can be executed as a control instruction, and the execution result is the realization of the control content. The display module is also used to display user information and control content executed by the user on the auxiliary fitness equipment after executing the control instruction corresponding to the preset action. The control content may include at least one of instruction-type control content, selection-type control content, question-and-answer type control content, or barrage-type control content. When this system is in use, multiple users can use their respective auxiliary fitness equipment to conduct a fitness course at the same time. , it can also display the statistics of the number of people selected for each option, that is, each sub-control content, which increases interactivity.

[Example 7]

Auxiliary fitness equipment with interactive functions, as shown in Figure 7, includes:

Trigger command recognition;

The preset action corresponding to the control content is issued by the user as a control command.

[Embodiment 8]

The present disclosure provides an electronic device, including a memory, a processor, and a computer program stored in the memory and operable on the processor. When the processor executes the computer program, the interactive function is realized. The process of auxiliary fitness methods.

Wherein, the processor may be a central processing unit, or other general-purpose processors, digital signal processors, application-specific integrated circuits, off-the-shelf programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like.

The memory can be used to store the computer program and/or module, and the processor implements various functions of a novel data source security authentication device disclosed in the disclosure by running or executing the data stored in the memory. The memory may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application required by a function (such as a sound playback function, an image playback function, etc.) and the like. In addition, the memory can include high-speed random access memory, and can also include non-volatile memory, such as hard disk, internal memory, plug-in hard disk, smart memory card, secure digital card, flash memory card, at least one magnetic disk storage device, flash memory device, or other volatile solid-state memory devices.

[Example 9]

The present disclosure provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the process of an auxiliary fitness method with an interactive function is realized.

The computer storage medium in the embodiments of the present disclosure may use any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more conductors, portable computer disks, hard disks, Random Access Memory (RAM), Read Only Memory (Read Only Memory) , ROM), erasable programmable read-only memory ((Erasable Programmable ReadOnly Memory, EPROM) or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or the above any suitable combination. In this document, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

While preferred embodiments of the present disclosure have been described, additional changes and modifications can be made to these embodiments by those skilled in the art once the basic inventive concept is appreciated. Therefore, it is intended that the appended claims be construed to cover the preferred embodiment and all changes and modifications which fall within the scope of the present disclosure.

It is obvious that those skilled in the art can make various changes and modifications to the present disclosure without departing from the spirit and scope of the present disclosure. Thus, if these modifications and variations of the present disclosure fall within the scope of the claims of the present disclosure and equivalent technologies thereof, the present disclosure also intends to include these modifications and variations.

Claims

Assisted fitness methods with interactive features, including:

The preset control content and the preset action corresponding to the control content, the preset action can be executed as a control instruction, and the execution result is the realization of the control content;

Display fitness courses on auxiliary fitness equipment;

The user issues a control command based on the preset action corresponding to the control content;

The auxiliary fitness equipment obtains the image data of the user;

The auxiliary fitness equipment obtains user action information according to the image data;

The user action information is compared with the preset action, and the control instruction corresponding to the preset action is executed.
The auxiliary fitness method with interactive functions according to claim 1, wherein the user issues a control command based on a preset action corresponding to the control command, including:

Trigger command identification;

The control content and the preset action corresponding to the control content are displayed on the auxiliary fitness equipment;

The preset action corresponding to the control content is issued by the user as a control instruction.
The auxiliary fitness method with interactive functions according to claim 1, wherein the image data acquired by the auxiliary fitness equipment is real-time image data.
The auxiliary fitness method with interactive functions according to claim 1, wherein comparing the user action information with the preset action, and triggering the control instruction corresponding to the preset action includes:

Compare the user action information with the preset action to determine whether the action information is the same as the preset action. If they are the same, obtain the action time when the user issues the control command, compare the action time with the preset time threshold, and if the action time is greater than or equal to the time threshold , then execute the control command corresponding to the preset action.
The auxiliary fitness method with interactive functions according to claim 1, wherein the fitness course is one or more of pre-recorded or real-time generated or based on pre-recorded real-time adjustment.
The auxiliary fitness method with interactive functions according to claim 1, wherein the control content includes at least one of instruction control content, selection control content, question and answer control content or barrage control content.
The auxiliary fitness method with interactive functions according to claim 1, wherein after the control instruction corresponding to the preset action is executed, user information and the control content executed by the user are displayed on the auxiliary fitness equipment.
The auxiliary fitness method with interactive functions according to claim 6, wherein when the control content is question-and-answer control content, the control content includes several sub-control content, each sub-control content corresponds to a sub-preset action, and the sub-preset Assume that the action can be executed as a control command, and the execution result is the realization of the sub-control content. After executing the control command corresponding to the sub-preset action, obtain the number of users who execute the same sub-control content, and display it on the auxiliary fitness equipment.
Assistive fitness equipment with interactive features, including:

The preset module is used to preset the control content and the preset action corresponding to the control content. The preset action can be executed as a control instruction, and the execution result is the realization of the control content;

The display module is used for displaying fitness courses on the auxiliary fitness equipment;

The command module is used for the user to issue a control command based on the preset action corresponding to the control content;

The first acquisition module is used to assist the fitness equipment to acquire the user's image data;

The second acquisition module is used to assist the fitness equipment to acquire user action information according to the image data;

The execution module is used to execute the control instruction corresponding to the preset action according to the comparison information between the user information and the preset action, wherein the preset action can be executed as a control instruction, and the execution result is the realization of the control content.
The auxiliary fitness equipment with interactive functions according to claim 9, wherein the command module is used for the user to issue a control command based on the preset action corresponding to the control command to execute:

Trigger command identification;

The control content and the preset action corresponding to the control content are displayed on the auxiliary fitness equipment;

The preset action corresponding to the control content is issued by the user as a control instruction.
The auxiliary fitness equipment with interactive function according to claim 9, wherein the image data acquired by the auxiliary fitness equipment is real-time image data.
The auxiliary fitness equipment with interactive functions according to claim 9, wherein the execution module is configured to execute the control instruction corresponding to the preset action according to the comparison information between the user information and the preset action, and the comparison includes:

Compare the user action information with the preset action to determine whether the action information is the same as the preset action. If they are the same, obtain the action time when the user issues the control command, compare the action time with the preset time threshold, and if the action time is greater than or equal to the time threshold , then execute the control command corresponding to the preset action.
The auxiliary fitness equipment with interactive functions according to claim 9, wherein the fitness course is one or more of pre-recorded or real-time generated or real-time adjustment based on pre-recorded.
The auxiliary fitness equipment with interactive functions according to claim 9, wherein the control content includes at least one of instruction control content, selection control content, question and answer control content or barrage control content.
The auxiliary fitness equipment with interactive function according to claim 9, wherein after the executing module executes the control instruction corresponding to the preset action, user information and the control content executed by the user are displayed on the auxiliary fitness equipment.
The auxiliary fitness equipment with interactive functions according to claim 14, wherein when the control content is question-and-answer control content, the control content includes several sub-control content, each sub-control content corresponds to a sub-preset action, and the sub-preset Assume that the action can be executed as a control command, and the result of the execution is the realization of the sub-control content. After the execution module executes the control command corresponding to the sub-preset action, it obtains the number of users who execute the same sub-control content, and displays it on the auxiliary fitness equipment .
The auxiliary fitness system with interactive functions implements the auxiliary fitness method described in any one of claims 1-8, and the auxiliary fitness system includes:

The display module is used to obtain fitness courses and display them on the auxiliary fitness equipment;

The obtaining module is used to obtain the user's image data through the auxiliary fitness equipment, and obtain the user's action information according to the image data;

The comparison module is used to judge whether the user's action information and the preset action corresponding to the preset control content are the same, and send the comparison information to the execution module;

The execution module is configured to execute the control instruction corresponding to the preset action according to the comparison information, wherein the preset action can be executed as a control instruction, and the execution result is the realization of the control content.
The auxiliary fitness system with interactive functions according to claim 17, wherein the display module is further configured to display user information and control content executed by the user on the auxiliary fitness equipment after executing the control instruction corresponding to the preset action.
The auxiliary fitness system with interactive functions according to claim 17, wherein the control content includes at least one of instruction-type control content, selection-type control content, question-and-answer type control content or barrage-type control content.