KR20210129571A - Lecturer device for providing exercise lecture and user customized exercise mission - Google Patents

Abstract

The present invention relates to an exercise lecture providing system providing an exercise lecture video by streaming. The present invention includes: a lecturer device filming and generating the exercise lecture video, transmitting the exercise lecture video via a network, and setting an exercise mission to be given to students watching the exercise lecture video; at least one student device receiving the streaming of the exercise lecture video, displaying the video on a display screen, filming a student executing the exercise mission for motion recognition, generating exercise mission execution result data on the student, and transmitting the data to an exercise lecture management server; and the exercise lecture management server receiving and tallying the exercise mission execution result data of the students and transmitting the tally result to the lecturer and student devices. According to the present invention, it is possible to arouse students' interest and improve their satisfaction.

Description

Instructor device that provides exercise lectures and customized exercise missions {LECTURER DEVICE FOR PROVIDING EXERCISE LECTURE AND USER CUSTOMIZED EXERCISE MISSION}

The present invention relates to an instructor device capable of providing an exercise lecture video and a user-customized exercise mission.

Recently, as interest in health has increased, various health exercises such as fitness, yoga, and Pilates are spreading. Of course, some people are ready to take the time and money to take care of their health. However, the reality is that it is not easy for most people to find a place that helps them manage their health by taking extra time to exercise.

In particular, since most of these exercises are performed while registering at a gym or sports center and being guided by an instructor, it is difficult for people who are usually rushed for time to take classes, and there was a difficulty in that it takes an excessive amount of money to visit the gym and receive personal training. .

Accordingly, in recent years, broadcasting or programs that help individuals to exercise at the office or at home have been developed and distributed. Students who watch these broadcasts can follow the exercises while watching live broadcasts provided by expert instructors. And, when the instructor sets the exercise mission and provides it to the students, it is possible to induce the students to follow the exercise mission.

However, in the past, it was not possible to provide a differentiated mission for each student, so there was a limit to increasing the satisfaction of various students. In addition, in the past, when several characters other than the instructor appear in the lecture video, it is difficult to conduct an exercise lecture effectively because an exercise assistant to imitate is not automatically designated or continuous tracking is not provided, so it is difficult to provide an exercise mission easily. there was

Matters described in this background section are prepared to enhance understanding of the background of the invention, and may include matters that are not already known to those of ordinary skill in the art to which this technology belongs.

The present invention sets various types of exercise missions while streaming an exercise lecture video and provides various types of exercise missions to the students who watch the exercise lecture video, thereby inducing the interest of the students and improving the satisfaction of the students. It is intended to propose a system for providing exercise lectures and a method for providing exercise lectures using the same.

In addition, the present invention recognizes the motions of the students performing the exercise mission, analyzes the results of the exercise mission performance of the students, and provides them to the instructor and students, so that the instructor can conduct an exercise lecture more fun and induce competition among the students. Therefore, it is intended to propose a system for providing exercise lectures that can increase the exercise effect and a method for providing exercise lectures using the same.

In addition, the present invention continuously tracks the character designated as the exercise assistant among the characters appearing in the video of the exercise lecture and recognizes the motion of the exercise assistant to generate various types of exercise missions, thereby providing an instructor while streaming the image of the exercise lecture. proposes an exercise lecture providing system that can effectively provide various types of exercise missions and a method of providing exercise lectures using the same.

An exercise lecture providing system according to an embodiment of the present invention is an exercise lecture providing system that provides an exercise lecture video by streaming, generating an image of the exercise lecture and transmitting it through a network, and to students who watch the exercise lecture video Instructor device that sets the exercise mission to be given, the image of the exercise lecture is streamed in real time and displayed on the display screen, and the motion is recognized by photographing the student performing the exercise mission according to the exercise mission definition data, and the student's exercise mission is performed At least one student device that generates and transmits the result data to the exercise lecture management server, and receives and aggregates the exercise mission performance result data of the students, and collects the result data of the trainees' exercise mission performance data to the instructor device and the student devices Includes an exercise lecture management server that transmits to.

The instructor device sets a first type exercise mission for repeatedly performing an exercise movement shared in advance with the student devices as the exercise mission, but the exercise type (eg, squat, lunge, shoulder press, etc.) and You can set the exercise mission basic data consisting of the exercise mission execution time (eg, 5 minutes, 10 minutes, 15 minutes, etc.).

The exercise mission definition data is, based on the exercise mission basic data, the height, weight, gender, blood pressure, pulse, body temperature, recent exercise mission performance history, possessed disease, pain level for each body part, current ranking, current body The number of repetitions per one set of the exercise movement, the total number of sets of the movement movement, the appropriate range of motion for each joint in the movement movement, or sets and At least one of the rest time lengths between sets may be set differently according to a user's needs.

The instructor device, but sets the second type of exercise mission to follow the motion of the exercise assistant appearing in the image of the exercise lecture in real time as the exercise mission, the start time of following the exercise assistant for the second type of exercise mission and You can set the end time for following the exercise assistant.

The instructor device or the exercise lecture management server recognizes the motion of the exercise assistant in the image of the exercise lecture from the start time of following the exercise assistant, generates the exercise assistant motion data and transmits it to the student device, and according to the exercise assistant After the following end time, by recognizing the motion of the exercise assistant in the image of the exercise lecture, it is possible to stop generating and transmitting the movement assistant motion data to the device of the student.

The instructor device or the exercise lecture management server calculates the two-dimensional coordinate value or three-dimensional coordinate value data of the joints of the exercise assistant from the motion of the exercise assistant in the image of the exercise lecture, and the calculated joint coordinate value data and time information It is possible to create an exercise assistant motion data that includes.

The instructor device or the exercise lecture management server recognizes the motion of the exercise assistant in the image of the exercise lecture at a time between the start time of following the exercise assistant and the end time of following the exercise assistant, but every predetermined time interval (eg, every 0.1 second, 0.2 second, or 0.5 second time interval) Whenever a motion recognition execution command is input through an input device, the motion of the exercise assistant is recognized, or whenever a preset motion recognition execution voice is recognized in the exercise lecture image (eg, "one", "two Whenever a specific voice such as ", "three", "four", "up", "beginning", "end", "one" , "two", "three", "four" is recognized) motion can be recognized.

The instructor device or the exercise lecture management server, when a plurality of characters are recognized in the image of the exercise lecture, assigns an identification number to each character, and continuously performs a character tracking task that matches the identification number and the character It is possible to continuously display a bounding box, a body outline, or an identification number value for each character in the image of the exercise lecture displayed on the screen of the instructor device.

The instructor device or the exercise lecture management server automatically designates the character as an exercise assistant when only one character continuously appears in the image of the exercise lecture, and several characters are continuously displayed in the image of the exercise lecture. When appearing, a character identification number value is input through a wired/wireless input device connected to the instructor device, a click input on the inner space of the character's bounding box figure, or a click on the inner space of the character's body outline You can designate, de-designate, or change an exercise assistant among the characters of

When the instructor device or the exercise lecture management server generates the exercise lecture image by selecting one image source from among a plurality of image sources instead of the image of the exercise lecture being composed of one image source, the plurality of images By performing a tracking operation so that the identification number value for each character is kept constant for the sources, it is possible to maintain the identification number value for each character constant even if the selected image source is changed.

The instructor device or the student device matches the joint coordinate value data of the exercise assistant to the image of the exercise assistant in the image of the exercise lecture and displays a plurality of pieces designated by the instructor through a wired/wireless input device connected to the instructor device. At least one of angle, length, and ratio information between joints may be displayed.

The student device generates the exercise mission performance result data of the student, but whether the recent exercise mission is performed, the recent exercise posture accuracy, the recent exercise timing accuracy, the recent exercise speed accuracy, the accumulated value of the number of exercise missions performed, the exercise posture accuracy accumulated value , an exercise timing accuracy accumulation value, an exercise speed accuracy accumulation value, an exercise mission performance accumulation value, or an exercise mission performance overall grade may be generated.

The exercise lecture management server, as an aggregate result of the exercise mission performance data of the students, at least one of whether each trainee has achieved an exercise mission, an exercise mission performance grade, an exercise mission performance grade, or the ranking information of the students, the instructor device and to the student devices.

The exercise lecture management server transmits the results of the exercise mission performance data of the trainees to the instructor device and the student devices, but does not transmit the same data to all receiving target devices, and presets a list of interest in the receiving device. At least one of information on students, information on students corresponding to a ranking value similar to the ranking value of the receiving device, or information on students corresponding to a ranking range requesting an inquiry from the receiving device may be transmitted.

In a method for providing an exercise lecture according to an embodiment of the present invention, an instructor device or an exercise lecture management server streams an exercise lecture video in a method of providing an exercise lecture through a network, and provides an exercise mission to a student who watches the exercise lecture. providing, collecting exercise mission performance result data of trainees performing the exercise mission, generating exercise mission achievement information or ranking information of trainees by aggregating the trainee's exercise mission performance result data, and the and transmitting the exercise mission achievement information or ranking information of the trainees to the trainee device.

The exercise mission includes a first type exercise mission for repeatedly performing an exercise movement shared in advance between the instructor and the students, and when the instructor sets the exercise operation type and the exercise mission execution time value of the first type exercise mission , personal information of students (e.g., height, weight, sex, blood pressure, pulse, body temperature, disease, current level of pain for each body part, current fitness level for each body part, or current overall body grade), exercise At least one of the target number of repetitions per set of the exercise movement, the total number of sets of the exercise movement, the appropriate range of motion for each joint in the exercise movement, or the length of rest time between sets and sets according to history, ranking, or grade is determined by the user. It may be set differently for customization.

The exercise mission includes a second type of exercise mission that follows the motion of the exercise assistant in real time, and the step of providing the exercise mission to students watching the exercise lecture includes setting the start time of the second type of exercise mission. Step, recognizing the two-dimensional coordinate value or three-dimensional coordinate value data of the joints of the exercise assistant in the image of the exercise lecture, generating the movement assistant motion data including the joint coordinate value data and time information of the exercise assistant It may include transmitting to a device, and setting an end time of the second type of exercise mission.

The step of recognizing the two-dimensional coordinate value or three-dimensional coordinate value data of the joints is performed every predetermined time interval (for example, every 0.1 second, 0.2 second, or 0.5 second time interval), or to the instructor device Each time a command to execute recognition is given through a wired/wireless input device such as a connected wired mouse or wireless keyboard, touch screen, touch pad, or wireless presenter, or whenever the instructor or teaching assistant speaks a preset word by voice ( For example, "one", "two", "three", "four", "up", "beginning", "end", "one" , "two", "three", "four" whenever it is recognized).

The step of providing an exercise mission to the students watching the exercise lecture includes: when a plurality of characters are recognized in the image of the exercise lecture, an identification number is assigned to each character; and an exercise assistant among the plurality of characters It may include the step of designating an exercise assistant marking number to the designated character.

The step of providing an exercise mission to a student watching the exercise lecture includes receiving a plurality of joints designated from the instructor device, receiving at least one of angle, length, or ratio information between the joints, and in the image of the exercise lecture Matching the joint coordinate value data of the exercise assistant and displaying it on the screen, the instructor device may include displaying at least one of angle, length, and ratio information between specific joints designated in advance.

A computer-readable recording medium in which an exercise lecture providing program is recorded generates an image of an exercise lecture and transmits it through a network, and a first type exercise mission that repeats a preset exercise operation or a system that follows the movement of an exercise assistant in real time Set up two types of exercise missions, but learn the information (e.g., height, weight, gender, blood pressure, pulse, body temperature, recent exercise mission history, possessed diseases, pain level for each body part, current ranking, current Depending on the degree of training for each body part, or the current overall body grade) At least one of the lengths of time is set differently for the first type of exercise mission to generate exercise mission definition data, or by recognizing the motion of the exercise assistant in real time to generate the exercise mission definition data for the second type of exercise mission. .

According to the present invention, an instructor can set various types of exercise missions while streaming an exercise lecture video online, and the set exercise mission can be customized based on the student's information and data to the students who watch the exercise lecture video. It provides an environment that can induce students' interest and improve their satisfaction by being adjusted and provided.

In addition, the present invention recognizes the motion of the students performing the exercise mission, analyzes the performance result of the exercise mission, and provides it to the instructor and the students, thereby inducing competition among the students and creating an environment that can increase the fun and exercise effect. to provide.

In addition, by comparing the exercise mission definition data of the exercise mission with the exercise mission performance result data of the students, it is judged whether the exercise mission has been achieved, and based on the judgment result, the exercise performance and ranking information for each student are generated and provided to the instructor and students. By doing so, it provides an environment that can make exercise lectures more fun and induce competition among students.

In addition, when the present invention provides an exercise mission for repeatedly performing an exercise movement shared in advance between an instructor and a student, the number of repetitions of the exercise movement is set differently for each student's personal information, recent exercise history, ranking, or grade By doing so, it provides differentiated exercise missions for each student and provides an environment that can improve students' satisfaction.

In addition, the present invention establishes an exercise mission that follows the motion of the exercise assistant, recognizes the two-dimensional or three-dimensional coordinate values of the body joints of the exercise assistant from the motion of the exercise assistant, and generates movement mission definition data, so that the instructor can provide various It provides an environment in which exercise lectures can be conducted in a more fun way by making exercise missions composed of various types of body movements easily.

In addition, in the present invention, when a plurality of characters are recognized in the exercise lecture image, an identification number is given to each character, and the identification number and the character are matched to display on the instructor's exercise lecture video, and the instructor is an exercise assistant. By designating or changing the , it provides an environment in which exercise lectures can be conducted more effectively.

In addition, the present invention tracks the character designated as the exercise assistant and generates an exercise mission by recognizing the movement of the exercise assistant, so that even if the camera angle for recording the exercise assistant is suddenly changed, the students do not experience confusion. It provides an environment that can provide

1 is a diagram schematically illustrating a system for providing an exercise lecture for providing an image of an exercise lecture in real-time streaming according to an embodiment of the present invention.
2 is a block diagram showing a schematic configuration of an exercise lecture management server according to an embodiment of the present invention.
3 is a block diagram showing a schematic configuration of an instructor device according to an embodiment of the present invention.
4 is a block diagram illustrating a schematic configuration of a student device according to an embodiment of the present invention.
5 is a flowchart schematically illustrating a process of streaming an exercise lecture video in an exercise lecture providing system according to an embodiment of the present invention, comparing and analyzing exercise mission definition data and exercise mission performance result data to provide instructors and students. .
6 is a flowchart schematically illustrating a process of providing different conditions of an exercise mission for each trainee according to an embodiment of the present invention.
Figure 7 is tracking the identification information of the characters in the image of the exercise lecture according to an embodiment of the present invention, and tracking by assigning an exercise assistant marking number to the character designated as an exercise assistant, and recognizes the movement of the exercise assistant to exercise It is a flowchart briefly illustrating the process of generating mission definition data.
8 is a diagram illustrating an example of shooting an exercise lecture image in which a plurality of characters appear with a plurality of cameras according to an embodiment of the present invention.
9 is a diagram illustrating an example of selecting an exercise lecture image from among images captured by a plurality of cameras according to an embodiment of the present invention.
10 is a diagram illustrating an example of selecting an exercise lecture image while providing an exercise mission according to an embodiment of the present invention.
11 is a process in which an exercise mission is set and provided to the students according to the first embodiment of the present invention, the motion of the trainee performing the exercise mission is recognized, and exercise results and ranking information are generated and provided to the instructor and the students. This is a simplified flowchart.
12 is a second embodiment of the present invention, in accordance with the second embodiment of the present invention, the exercise mission basic data is generated in the instructor device, the exercise mission definition data is generated in the student device, and the exercise lecture management server generates a grade of the exercise mission performance result, and the instructor and the instructor This is a flow chart that briefly shows the process of sharing to students.
13 is a third embodiment of the present invention by recognizing the motion of the exercise assistant for the exercise lecture image stored in the exercise lecture management server according to the third embodiment of the present invention, generating and providing exercise mission definition data, and collecting the exercise mission performance result data of the trainees. This is a flow chart that outlines the process of sharing with instructors and students.

Hereinafter, preferred embodiments of the present invention will be described in detail based on the accompanying drawings.

Prior to this, the configurations shown in the embodiments and drawings described in this specification are only the most preferred embodiment of the present invention and do not represent all the technical spirit of the present invention, so they can be substituted at the time of the present application It should be understood that various equivalents and modifications may be made.

Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily implement them. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Since the size and thickness of each component shown in the drawings are arbitrarily indicated for convenience of description, the present invention is not necessarily limited to the bar shown in the drawings, and the thickness is enlarged to clearly express various parts and regions.

Throughout the specification, when a part "includes" a certain element, it means that other elements may be further included, rather than excluding other elements, unless otherwise stated. In addition, terms such as “…unit”, “…group”, and “module” described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware or software or a combination of hardware and software. have.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the embodiment belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

In addition, in the description of the embodiment, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the embodiment, the detailed description thereof will be omitted.

Now, a system for providing exercise lectures and a method for providing exercise lectures using the same according to an embodiment of the present invention will be described in detail with reference to FIGS. 1 to 13 .

1 is a diagram schematically illustrating a system for providing an exercise lecture for providing an image of an exercise lecture in real-time streaming according to an embodiment of the present invention. At this time, the exercise lecture providing system 10 shows only a schematic configuration necessary for description according to an embodiment of the present invention, but is not limited to this configuration.

Referring to FIG. 1 , a system for providing an exercise lecture 10 according to an embodiment of the present invention includes a system for providing an image of an exercise lecture as streaming through a network. Here, the exercise lecture of the present invention includes a broadcast in which an instructor or an exercise assistant directly demonstrates and broadcasts. For example, the exercise lecture may include health, fitness exercise, weight training, stretching, aerobics, GX, dance, martial arts demonstration, yoga, and Pilates.

The exercise lecture providing system 10 according to an embodiment of the present invention includes an exercise lecture management server 100 , an instructor device 200 , and a plurality of student devices 300-1 to 300-1 according to an embodiment of the present invention. 300-n).

The exercise lecture providing system 10 may provide an image of an exercise lecture of the instructor device 200 to a plurality of student devices 300-1 to 300-n in real-time streaming. In addition, the exercise lecture providing system 10 stores the image of the exercise lecture in the exercise lecture management server 100, and streams the image of the exercise lecture stored in the server to a plurality of student devices 300-1 to 300-n. may provide.

Here, the instructor device 200 and the student device 300 are a broad concept including a wired terminal or a wireless terminal, and include a personal computer (PC), an Internet protocol television (IP), and a notebook-sized personal computer. ), PDA (Personal Digital Assistant), smart pad, smart phone, IMT2000 (International Mobile Telecommunication 2000) phone, GSM (Global System for Mobile Communication) phone, GPRS (General Packet Radio Service) phone, WCDMA (Wideband Code Division Multiple Access) phone ) phone, a Universal Mobile Telecommunication Service (UMTS) phone, a Mobile Broadband System (MBS) phone, and the like. In addition, the instructor device 200 and the student device 300 may provide a function of transmitting and receiving data for voice and video with the exercise lecture management server 100 .

Meanwhile, the network is a high-speed backbone network of a large-scale communication network capable of long-distance voice and data services, and may be a next-generation wired or wireless network for providing the Internet or high-speed multimedia services. Here, when the network is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an example of the asynchronous mobile communication network, there may be a wideband code division multiple access (WCDMA) type communication network. Meanwhile, although the WCDMA network is taken as an example, it may be a 3G LTE network, a 4G network, other next-generation communication networks such as 5G, and other IP-based IP networks.

First, the instructor device 200 may generate an image of an exercise lecture and transmit it through a network. In addition, the instructor device 200 may set various types of exercise missions during an exercise lecture, and provide the set exercise mission to the student device 300 viewing an exercise lecture video. Here, the exercise mission includes an exercise movement that students can follow with their body while watching an exercise lecture video.

Then, the student device 300 receives the video of the exercise lecture in real time and displays it on the display screen. In addition, the student device 300 may photograph a student performing the exercise mission, recognize the student's motion, and generate data on the student's exercise mission performance result. In addition, the student device 300 may transmit one or more of the student's captured image, the student's motion recognition data, or the exercise mission performance data to the exercise lecture management server 100 .

In addition, the exercise lecture management server 100 may receive an exercise lecture image from the instructor device 200 and provide the received exercise lecture image to a plurality of student devices 300-1 to 300-n in real-time streaming. .

Then, the exercise lecture management server 100 may receive the exercise mission performance result data of the trainee and determine whether the exercise mission is achieved. In this case, the exercise lecture management server 100 may determine whether the specific exercise mission is achieved by comparing the exercise mission definition data of the specific exercise mission with the exercise mission performance result data of the students performing the specific exercise mission.

Here, the exercise mission definition data may include an exercise motion or image of a specific exercise mission, skeleton data of an exercise assistant, and the like. In addition, the exercise mission performance data may include images of trainees following the specific exercise mission or skeleton data of the trainees.

In addition, the exercise lecture management server 100 may generate ranking information by accumulating exercise scores for each student, and transmit the exercise results and ranking information to the instructor device 200 and the student device 300 .

Therefore, the exercise lecture providing system 10 according to an embodiment of the present invention sets and provides various types of exercise missions to students while streaming the exercise lecture video online, and performs the exercise mission while watching the exercise lecture video. By recognizing the motions of the students performing the exercise, and by analyzing the performance results of the exercise missions and providing them to the instructors and students, it provides an environment that can induce students' interest and improve their satisfaction.

2 is a block diagram showing a schematic configuration of an exercise lecture management server according to an embodiment of the present invention. At this time, the exercise lecture management server 100 shows only a schematic configuration necessary for description according to an embodiment of the present invention, but is not limited to this configuration.

Referring to FIG. 2 , the exercise lecture management server 100 according to an embodiment of the present invention includes a control module 110 , a transmission/reception module 120 , an exercise mission management module 130 , an analysis module 140 , and an image control module. a module 150 , and a database 160 .

The control module 110 controls the video of the exercise lecture generated by the instructor device 200 to be streamed in real time through the network. Then, the control module 110 controls the instructor device 200 to set the exercise mission and provide it to the plurality of student devices 300-1 to 300-n.

In addition, the control module 110 receives the trainee's exercise mission performance result data from the plurality of student devices (300-1 to 300-n), the exercise mission definition data of the exercise mission and the trainee's exercise mission performance result data can be compared to control the operation of each part to determine whether the exercise mission has been achieved for each student.

Then, the control module 110 generates ranking information by accumulating exercise scores for each student, and transmits the exercise results and the ranking information to the instructor device 200 and the plurality of student devices 300-1 to 300-n. can be controlled to do so.

The transmission/reception module 120 receives an exercise lecture image, an exercise mission, and exercise mission definition data from the instructor device 200 , and from the student device 300 , the trainee's exercise image, the trainee's motion recognition data, and the trainee's exercise It is possible to receive mission performance result data and the like. In addition, the transmission/reception module 120 may transmit the aggregated athletic performance and ranking information for each student to the instructor device 200 and the plurality of student devices 300-1 to 300-n.

Here, the exercise lecture management server 100 transmits whether the students have achieved the exercise mission and the ranking information to the instructor device 200 and the student devices 300, but does not transmit the same data to all reception target devices. may not be

For example, the exercise lecture management server 100 is the information of the students preset in the list of interest in the receiving target device, the information of the students corresponding to the ranking value similar to the ranking value of the receiving target device, or inquiry from the receiving device It is possible to transmit the information of the students corresponding to the ranking range requesting, or to transmit only the minimum data by combining one or more of them.

In addition, the exercise lecture management server 100 is the result of the exercise mission performance data of the students, at least among the achievement of each student's exercise mission, exercise mission performance grade, exercise mission performance grade, or the ranking information of the students. One may be transmitted to the instructor device 200 and the student devices 300 .

In addition, the transmission/reception module 120 includes a data reception unit 122 and a data transmission unit 124 according to an embodiment of the present invention.

In addition, the data receiving unit 122 receives an exercise lecture image, an exercise mission, and exercise mission definition data from the instructor device 200 . In addition, the data receiving unit 122 may receive the trainee's exercise image, the trainee's motion recognition data, and the trainee's exercise mission performance result data from the trainee device 300 .

In addition, the data transmitter 124 may transmit an image of an exercise lecture and exercise mission to the student device 300 , and transmit the exercise image of the trainee and the result data of the trainee's exercise mission to the instructor device 200 . In addition, the data transmission unit 124 compares and analyzes the exercise mission definition data of the exercise mission and the exercise mission performance result data of the students, and transmits the exercise results and ranking information aggregated for each student to the instructor device 200 and a plurality of student devices 300- 1 to 300-n).

The exercise mission management module 130 manages the exercise mission and exercise mission definition data set in the instructor device 200 , and manages to provide the exercise mission and the exercise mission definition data to the student device 300 . In this case, the exercise mission management module 130 may directly set the exercise mission and provide it to the student device 300 .

In addition, the exercise mission management module 130 includes an exercise mission setting unit 132 and an exercise mission definition data generating unit 134 according to an embodiment of the present invention.

The exercise mission setting unit 132 may set as the exercise mission a first type exercise mission for repeatedly performing exercise motions shared in advance between the instructor and the students. Then, the exercise mission definition data generation unit 134 may generate the exercise mission definition data by analyzing the movement motion of the first type of exercise mission.

Then, the exercise mission setting unit 132 sets the exercise start time and the exercise execution time for one repetition of the first type exercise mission to be the same regardless of the students. However, the exercise mission setting unit 132 may set the number of repetitions of the exercise operation differently for each student's ranking or grade.

The exercise mission setting unit 132 may generate exercise mission basic data including a type of exercise operation and a value of the exercise mission execution time.

And, the exercise mission setting unit 132 is based on the exercise mission basic data, the height, weight, gender, blood pressure, pulse, body temperature, recent exercise mission performance history, possessed disease, current pain level for each body part, current The number of repetitions per set of the exercise, the total number of sets of the exercise, and the appropriate range of motion for each joint in the exercise according to at least one or more of the ranking, the current training level for each body part, or the current overall body grade. , or at least one of a set and a length of rest time between sets may generate exercise mission definition data in which at least one is set differently according to a user's preference.

In addition, the exercise mission setting unit 132 may set a second type of exercise mission that follows the movement of the exercise assistant in real time as the exercise mission. In addition, the exercise mission definition data generation unit 134 may generate the exercise mission definition data by recognizing the motion of the exercise assistant. In addition, the exercise mission definition data generation unit 134 may recognize the skeleton data from the captured image of the exercise assistant, and analyze the recognized skeleton data to generate the exercise mission definition data.

For example, the exercise mission definition data generation unit 134 recognizes the skeleton data at predetermined time intervals in the captured image of the exercise assistant, or recognizes the input signal input by the instructor or the voice signal of the exercise assistant. The skeleton data can be recognized.

In addition, the movement mission definition data generation unit 134 calculates the two-dimensional coordinate value or three-dimensional coordinate value data of the joints of the exercise assistant from the motion of the exercise assistant in the image of the exercise lecture, and the calculated joint coordinate value data and Exercise assistant motion data including time information can be generated.

In addition, the exercise mission definition data generation unit 134 may generate the exercise mission definition data based on the exercise assistant motion data.

And, when the exercise lecture management server 100 receives the starting time value for following the exercise assistant for the second type of exercise mission from the instructor device 200, the instructor device 200 or the exercise lecture management server ( 100) may recognize the motion of the exercise assistant in the image of the exercise lecture from the time of starting to follow the exercise assistant, generate the exercise assistant motion data, and transmit it to the student device 300 .

In addition, the instructor device 200 may transmit a value of the exercise assistant follow-up end time to the exercise lecture management server 100 or the student device 300 . Then, the instructor device 200 or the exercise lecture management server 100 recognizes the motion of the exercise assistant in the image of the exercise lecture after the exercise assistant follow end time value and generates the exercise assistant motion data, and the Transmission to the student device 300 may be stopped.

And, the instructor device 200 or the exercise lecture management server 100 is the movement of the exercise assistant in the image of the exercise lecture in a time between the start time of the exercise assistant following the exercise assistant and the end time of the exercise assistant. can recognize

At this time, the instructor device 200 or the exercise lecture management server 100 recognizes the motion of the exercise assistant at every preset time interval (for example, every 0.1 second, 0.2 second, or 0.5 second time interval) or , Whenever a motion recognition execution command is input through a wired or wireless input device such as a wired mouse or wireless keyboard, a touch screen, a touch pad, or a wireless presenter connected to the instructor device 200, the motion of the exercise assistant is recognized, or Whenever a preset motion recognition execution voice is recognized in the exercise lecture video (eg, "one", "two", "three", "four", "up", "start", "end", " Whenever a specific voice such as "one", "two", "three", or "four" is recognized), the motion of the exercise assistant can be recognized.

In addition, the analysis module 140 may determine whether the exercise mission is achieved by analyzing the exercise mission performance result data, the captured image, or the trainee's motion recognition data for performing the exercise mission. In addition, the analysis module 140 may generate ranking information by tallying exercise scores for each student.

In addition, the exercise mission management module 130 includes a data comparison unit 142 , an exercise performance analysis unit 144 , and a ranking information generation unit 146 according to an embodiment of the present invention.

The data comparison unit 142 may determine whether the specific exercise mission is achieved by comparing the exercise mission definition data of the specific exercise mission with the exercise mission performance result data of the students performing the specific exercise mission.

In addition, the exercise performance analysis unit 144 may aggregate the scores of the students based on whether or not the repeatedly performed exercise mission has been achieved. In addition, the ranking information generating unit 146 may generate ranking information of students taking an exercise lecture based on the students' scores.

In addition, the image control module 150 may control to assign an identification number to the character of the exercise lecture image, match the identification number with the character, and display the same on the exercise lecture image. In addition, the image control module 150 can be controlled to give an exercise assistant marking number to a character designated as an exercise assistant, and track the character to which the exercise assistant marking number is assigned.

In addition, when a plurality of characters are recognized in the image of the exercise lecture, the image control module 150 may assign an identification number to each character. And, the image control module 150 continuously performs a character tracking task that matches the identification number and the character, and a bounding box for each character in the exercise lecture image displayed on the screen of the instructor device 200, The body outline or the identification number value can be continuously displayed.

In addition, the image control module 150 includes an identification number setting unit 152 , a tracking unit 154 , and a data matching unit 156 according to an embodiment of the present invention.

When a plurality of characters are recognized in the image of the exercise lecture, the identification number setting unit 152 assigns an identification number to each character, matches the identification number with the character, and can be controlled to be displayed on the image of the exercise lecture. have.

In addition, the tracking unit 154 provides an exercise mission that follows the motion of the exercise assistant in real time, so that the identification number assigned to each character appearing in the image of the exercise lecture is continuously maintained and constant. You can control operations such as adding, saving, and de-assigning grant information.

In addition, the data matching unit 156 may match the image data and the skeleton data to display them on the display screen, and display angle and length information between specific joints on the display screen. For example, the data matching unit 156 may control the image of an exercise lecture generated by the instructor device 200 to match the skeleton data of the instructor or exercise assistant, and display it on the image of the exercise lecture.

In addition, the data matching unit 156 matches the student image captured by the student device 300 with the skeleton data and motion recognition data of the student following the exercise mission, and at this time, the matched data is controlled to be displayed on the student image. may be

In addition, the database 160 may store an image of an exercise lecture received from the instructor device 200 , exercise mission, exercise mission definition data, motion recognition data of an exercise assistant, and skeleton data. In addition, the database 160 may store student images captured by the plurality of student devices 300-1 to 300-n, motion recognition data of the students, and exercise mission performance result data of the students.

In addition, the database 160 may store the student's personal information, exercise history, and student's grades and ranking information, and the present invention provides an environment in which various types of exercise missions can be customized for students.

3 is a block diagram showing a schematic configuration of an instructor device according to an embodiment of the present invention. In this case, the instructor device 200 shows only a schematic configuration necessary for description according to an embodiment of the present invention, but is not limited to this configuration.

Referring to FIG. 3 , the instructor device 200 according to an embodiment of the present invention includes a control module 210 , a communication module 220 , a photographing module 230 , a mission setting module 240 , and a motion recognition module 250 . ), an input module 260 , an image selection module 270 , and a display module 280 .

The control module 210 generates an exercise lecture image and transmits it through a network, and controls the operation of each unit to set an exercise mission and provide it to students who view the exercise lecture image.

In addition, the communication module 220 may transmit an image of an exercise lecture through a network and transmit/receive various data related to the exercise lecture with the exercise lecture management server 100 and the student device 300 .

Then, the photographing module 230 creates an image of an exercise lecture by photographing the instructor and the exercise assistant. Then, the photographing module 230 may photograph the exercise assistant to generate the exercise mission and the exercise mission definition data.

In addition, the mission setting module 240 may set various types of exercise missions while the image of the exercise lecture is streaming, and may generate exercise mission definition data for each exercise mission.

In addition, the mission setting module 240 may generate the exercise mission definition data by setting a first type of exercise mission for repeatedly performing an exercise motion shared in advance with the trainee as the exercise mission. At this time, the mission setting module 240 sets the exercise start time and the exercise execution time at the time of one repetition of the first type exercise mission to be the same regardless of the student, but repeats the exercise operation by the rank or grade of the trainee. The number of times can be set differently.

In addition, the instructor device 200 sets a first type exercise mission for repeatedly performing an exercise movement shared in advance with student devices as the exercise mission, and an exercise mission consisting of an exercise operation type and an exercise mission execution time value. Basic data may be transmitted to the exercise lecture management server 100 or the student device 300 .

And, the exercise lecture management server 100 or the student device 300 receiving the exercise mission basic data based on the exercise mission basic data height, weight, gender, blood pressure, pulse, body temperature, recent exercise mission The number of repetitions per set of the exercise movement, the number of repetitions per set of the exercise movement, according to at least one or more of performance history, disease possessed, current pain level for each body part, current ranking, current training level for each body part, or current overall body grade At least one of the total number of sets, the appropriate range of motion for each joint in the exercise motion, or the length of a rest period between sets and sets can be customized and differently set by the user may be generated.

Then, while the instructor is conducting an exercise lecture, the instructor device 200 provides an exercise mission to the students through the input module 260 such as a keyboard, mouse, touch screen, touch pad, wireless presenter, microphone, or voice recognition artificial intelligence speaker. can be given In this case, the exercise mission may include a first type exercise mission for repeatedly performing a shared exercise method, or a second type exercise mission for imitating the movement of an exercise assistant.

Here, in the case of the first type of exercise mission that repeats the exercise method that has already been shared, the instructor device 200 determines the type of exercise, the start time, and the exercise time (eg, to perform the mission for several minutes from the start time or at what time). How many minutes to perform a mission, etc.) can be set. However, the target number of workouts for each student may be automatically set differently for each student by reflecting the level of each student.

And, according to the present invention, the student's grades are counted, it is determined whether the target has been achieved, the target is below the target, and whether the target is exceeded, and each list is transmitted to the instructor device 200 , through which the instructor achieves the target or exceeds the target Provide an environment where people can be praised.

In addition, the mission setting module 240 may set a second type of exercise mission that follows the motion of the exercise assistant in real time as the exercise mission, and may generate the exercise mission definition data by recognizing the motion of the exercise assistant.

The instructor device 200 may transmit a value of an exercise assistant follow-up start time for the second type of exercise mission to the exercise lecture management server 100 .

And, the instructor device 200 or the exercise lecture management server 100 recognizes the motion of the exercise assistant in the image of the exercise lecture from the start time of the exercise assistant follow, and generates the exercise assistant motion data to the student device It can be transmitted to (300).

In addition, the instructor device 200 may transmit a value of the exercise assistant follow-up end time to the exercise lecture management server 100 or the student device 300 .

Then, the instructor device 200 or the exercise lecture management server 100 recognizes the motion of the exercise assistant in the image of the exercise lecture after the exercise assistant follow end time value and generates the exercise assistant motion data, and the Transmission to the student device 300 may be stopped.

And, the instructor device 200 or the exercise lecture management server 100 is the movement of the exercise assistant in the image of the exercise lecture in a time between the start time of the exercise assistant following the exercise assistant and the end time of the exercise assistant. can recognize

At this time, the instructor device 200 or the exercise lecture management server 100 recognizes the motion of the exercise assistant at every preset time interval (for example, every 0.1 second, 0.2 second, or 0.5 second time interval) or , Whenever a motion recognition execution command is input through a wired or wireless input device such as a wired mouse or wireless keyboard, a touch screen, a touch pad, or a wireless presenter connected to the instructor device 200, the motion of the exercise assistant is recognized, or Whenever a preset motion recognition execution voice is recognized in the exercise lecture video (eg, "one", "two", "three", "four", "up", "start", "end", " Whenever a specific voice such as "one", "two", "three", or "four" is recognized), the motion of the exercise assistant can be recognized.

And, the motion recognition module 250 may recognize the motion of the instructor or exercise assistant in the image of the exercise lecture, and generate the skeleton data. In addition, the mission setting module 240 may analyze the skeleton data recognized by the motion recognition module 250 to generate the movement mission definition data.

In addition, the motion recognition module 250 calculates the two-dimensional coordinate value or three-dimensional coordinate value data of the joints of the exercise assistant from the motion of the exercise assistant in the image of the exercise lecture, and includes the calculated joint coordinate value data and time information exercise assistant motion data can be generated. And, the motion recognition module 250 may generate the exercise mission definition data based on the exercise assistant motion data.

And, the motion recognition module 250 may recognize the skeleton data at intervals of a predetermined time in the captured image of the exercise assistant. In addition, the motion recognition module 250 recognizes an input signal or a voice signal input through the input module 260 such as a keyboard, mouse, touch screen, touch pad, wireless presenter, microphone, or voice recognition artificial intelligence speaker, and the Skeletal data can also be recognized.

For example, in the case of the second type of exercise mission that follows the exercise movement of the exercise assistant, when the instructor device 200 sets the start time, the image of the exercise lecture from the start time for a certain period of time (for example, 0.1 seconds) ) or whenever the instructor presses a button on the wired or wireless input device or speaks one, two, three, or four by voice, skeletal data is derived through the Pose Estimation deep learning engine and exercise is provided to the students. Transmits the skeletal data of the teaching assistant.

In this case, the instructor device 200 may recognize the skeleton data only from the start time of the exercise mission to the end time of the exercise mission, rather than recognizing the skeleton data for the entire exercise lecture image. Here, the process of recognizing the skeleton data of the exercise assistant with respect to the image of the exercise lecture may be performed in the instructor device 200 or may be performed in the exercise lecture management server 100 that has received the image of the exercise lecture.

And, when the instructor device 200 sets the end of the second type of exercise mission, skeletal data derivation through the pose estimation deep learning engine for the exercise lecture image is stopped. Then, the exercise lecture management server 100 calculates the cumulative similarity scores for the exercise missions followed by the students, determines the ranking of the students, and displays them on the screens of the instructors and students.

In addition, the image selection module 270 may select an image of an exercise lecture to be streamed from among images captured by a plurality of cameras. And, when a plurality of characters are recognized in the image of the exercise lecture, the image selection module 270 assigns an identification number to each character, matches the identification number with the character, and can be controlled to be displayed on the image of the exercise lecture. have.

In addition, when a plurality of characters are recognized in the image of the exercise lecture, the image selection module 270 assigns an identification number to each character, and continuously performs a character tracking operation that matches the identification number with the character, , it is possible to continuously display a bounding box, a body outline, or an identification number value for each character in the exercise lecture image displayed on the screen of the instructor device 200 .

At this time, the instructor device 200 may designate or change an exercise assistant to at least one of the plurality of characters through an input signal received from a keyboard, mouse, touch screen, touch pad, wireless presenter, etc. An exercise assistant marking number can be assigned to a character designated as an exercise assistant.

For example, the instructor device 200 or the exercise lecture management server 100 may automatically designate the character as an exercise assistant when only one character continuously appears in the image of the exercise lecture.

In addition, the instructor device 200 or the exercise lecture management server 100 receives the character identification number value through a wired/wireless input device connected to the instructor device 200 when several characters continuously appear in the image of the exercise lecture. Manually designating 0 or 1 exercise assistant among several characters by receiving input, clicking on the inner space of the character's bounding box figure, or receiving the click on the inner space of the character's body outline, The designation can be canceled or changed. Here, the instructor device 200 or the exercise lecture management server 100 selects one image source from among a plurality of image sources, rather than the image of the exercise lecture being composed of one image source. When generating the image of the exercise lecture, the character tracking operation is continuously performed for a plurality of image sources so that the bounding box, body outline, or identification number value for each character is kept constant even if the selected image source is changed can be controlled

Also, the display module 280 may output images captured by a plurality of cameras and an image of an exercise lecture provided to the student device 300 on the display screen. In addition, the display module 280 may match the image data and the skeleton data and display it on the display screen, or may display angle and length information between specific joints.

In addition, the instructor device 200 or the student device 300 may match the joint coordinate value data of the exercise assistant to the image of the exercise assistant in the image of the exercise lecture and display it on the screen. In addition, at least one of angle, length, and ratio information between two or three joints designated by the instructor through a wired/wireless input device connected to the instructor device 200 may be displayed.

For example, in the case of the second type of exercise mission following an exercise assistant, several characters, ie, an exercise assistant, a guest, and a commentator, may appear in the image of the exercise lecture. Among them, the person who sets the standard for the students to follow the exercise mission may be the exercise assistant.

Therefore, the present invention assigns an identification number (eg, A0, A1, A2, A3..) to each character through a multi-person tracking deep learning engine for an exercise lecture image, and this is the instructor device (200) can be displayed on the screen.

In addition, the instructor device 200 may designate or change who is an exercise assistant among several characters with input signals received from a keyboard, mouse, touch screen, touch pad, wireless presenter, and the like. Here, when only one character appears in the instructor video, that one person may be automatically designated as an exercise assistant.

In addition, if there are a plurality of cameras that record the video of the exercise lecture, the instructor device 200 receives the images taken from the plurality of cameras, and the identification number of the characters through the multi-person tracking deep learning engine. may be given. In this case, the instructor device 200 may select which image from among the images of several cameras to be transmitted as an image of an exercise lecture, and stream the selected image of the exercise lecture.

Therefore, the present invention sets various types of exercise missions while streaming the exercise lecture video, and provides the set exercise mission to the students who watch the exercise lecture video, thereby inducing students' interest and improving satisfaction. provides

4 is a block diagram illustrating a schematic configuration of a student device according to an embodiment of the present invention. In this case, the student device 300 only shows a schematic configuration necessary for explanation according to an embodiment of the present invention, but is not limited to this configuration.

Referring to FIG. 4 , a student device 300 according to an embodiment of the present invention includes a communication unit 310 , a photographing unit 320 , a motion recognition unit 330 , a display unit 340 , and a control unit 350 . include

In addition, the communication unit 310 may transmit the student image captured by the photographing unit 220 and the student's exercise mission performance data to the exercise lecture management server 100 .

Then, the photographing unit 320 photographs the students performing the exercise mission. Then, the motion recognition unit 330 analyzes the student image captured by the photographing unit 320 to recognize the motion of the student performing the exercise mission, and use this to generate the student's exercise mission performance data. .

In addition, the display unit 340 may display an image of an exercise lecture streamed from the instructor device 200 on the display screen. Also, the display unit 340 may display the student image captured by the photographing unit 320 on the display screen. In this case, the display unit 340 may display the exercise mission on the display screen, and may display information on the angle or length between the joints of the trainee on the display screen.

Then, the control unit 350 receives the streaming video of the exercise lecture in real time and controls it to be displayed on the display screen. In addition, the control unit 350 controls to capture a student performing the exercise mission or recognize the motion of the student to generate exercise mission performance result data, and control to transmit various data to the exercise lecture management server 100 . have.

In addition, the student device 300 generates the exercise mission performance result data of the student, but whether the recent exercise mission is performed, the recent exercise posture accuracy, the recent exercise timing accuracy, the recent exercise speed accuracy, the accumulated value of the number of exercise missions performed, the exercise posture Data including at least one of an accuracy accumulation value, an exercise timing accuracy accumulation value, an exercise speed accuracy accumulation value, an exercise mission performance accumulation value, or an exercise mission performance overall grade may be generated.

Through this, the present invention recognizes the motion of the students performing the exercise mission, analyzes the performance result of the exercise mission, and provides it to the instructor and the students, thereby inducing competition among the students and increasing the fun and exercise effect. provides

5 is a flowchart schematically illustrating a process of streaming an exercise lecture video in an exercise lecture providing system according to an embodiment of the present invention, comparing and analyzing exercise mission definition data and exercise mission performance result data to provide instructors and students. . In this case, the following flowchart will be described using the same reference numerals in connection with the configurations of FIGS. 1 to 4 .

Referring to FIG. 5 , the exercise lecture providing system 10 according to an embodiment of the present invention streams the image of the exercise lecture produced by the instructor device 200 in real time through a network ( S102 ).

In addition, the instructor device 200 may set various types of exercise missions during an exercise lecture, and may generate exercise mission definition data for the set exercise mission (S104). Here, the exercise mission definition data may include an exercise motion or image of a specific exercise mission, skeletal data of an exercise assistant, and the like.

Then, the student device 300 receives the video of the exercise lecture streamed in real time and displays it on the display screen, and recognizes the motion of the trainee performing the exercise mission to generate the exercise mission performance data of the trainee (S106). Here, the exercise mission performance data may include an image of a trainee following the specific exercise mission, or skeleton data of the trainee.

Then, the exercise lecture management server 100 receives the exercise mission performance result data of the trainee, and compares and analyzes the exercise mission definition data of the exercise mission and the trainee exercise mission performance result data to determine whether the exercise mission is achieved. It can be done (S108).

In addition, the exercise lecture management server 100 may generate ranking information by aggregating the exercise performance for each student based on the analysis result (S110). The exercise lecture management server 100 may generate the exercise mission achievement information or ranking information of the trainees by aggregating the exercise mission performance result data of the trainees.

In addition, the exercise lecture management server 100 may transmit and share the exercise performance and the ranking information to the instructor device 200 and the student device 300 ( S112 ). The exercise lecture management server 100 may transmit the exercise mission achievement information or ranking information of the trainees to the instructor device 200 or the trainee device 300 .

Therefore, the present invention compares the exercise mission definition data of the exercise mission with the exercise mission performance result data of the students to determine whether the exercise mission is achieved, and generates exercise scores and ranking information for each trainee and provides them to instructors and students By doing so, it provides an environment in which exercise lectures can be conducted more interestingly.

6 is a flowchart schematically illustrating a process of providing different conditions of an exercise mission for each trainee according to an embodiment of the present invention. In this case, the following flowchart will be described using the same reference numerals in connection with the configurations of FIGS. 1 to 4 .

Referring to FIG. 6 , the exercise lecture providing system 10 according to an embodiment of the present invention may capture an image of an exercise lecture from the instructor device 200 and stream it in real time through a network ( S202 ).

And, the exercise lecture providing system 10 according to an embodiment of the present invention analyzes student information, grades, ranking, etc., and at this time, using the analysis result, various types that the students watching the exercise lecture video can follow You can set the exercise mission of (S204, S206). Here, the exercise mission may include a first type of exercise mission for repeatedly performing an exercise movement shared in advance between the instructor and the students.

For example, in the exercise mission, when the instructor sets the exercise action type and exercise mission execution time value of the first type exercise mission, personal information (eg, the student's height, weight, gender, blood pressure, Pulse, body temperature, disease, current pain level for each body part, current training level for each body part, or current overall body grade), exercise history, ranking or grade At least one of the total number of sets of , an appropriate range of motion for each joint in the exercise motion, or a length of rest time between sets and sets may be set differently according to the user's needs.

And, the exercise lecture providing system 10 according to an embodiment of the present invention may set the conditions of the exercise mission for each student based on the analysis result of the students (S208). For example, the exercise lecture providing system 10 sets the exercise start time of the exercise mission and the exercise execution time at one repetition to be the same, but sets the number of repetitions of the exercise operation differently for each student's ranking or grade. can

In addition, the exercise lecture providing system 10 according to an embodiment of the present invention may provide a set exercise mission to each student device 300 to induce exercise in the students watching the exercise broadcast (S210).

Therefore, the present invention provides a differentiated exercise mission for each student by setting the number of repetitions of the exercise to be different for each student's ranking or grade when providing an exercise mission for repeatedly performing an exercise movement shared in advance with a student. and provide an environment that can improve student satisfaction.

Figure 7 is tracking the identification information of the characters in the image of the exercise lecture according to an embodiment of the present invention, tracking by assigning a marking number to the exercise assistant for the character designated as the exercise assistant, and recognizing the motion of the exercise assistant It is a flowchart briefly illustrating the process of generating mission definition data. In this case, the following flowchart will be described using the same reference numerals in connection with the configuration of FIGS. 1 to 5 .

Referring to FIG. 7 , the exercise lecture providing system 10 according to an embodiment of the present invention captures and streams an exercise lecture video in the instructor device 200 ( S302 ).

And, when a plurality of characters appear in the image of the exercise lecture, the instructor device 200 may designate an exercise assistant to any one of the plurality of characters (S304). Here, when the character is one instructor, the instructor may be automatically set as an exercise assistant.

8 is a view showing an example of shooting an image of an exercise lecture in which a plurality of characters appear with a plurality of cameras according to an embodiment of the present invention, and FIG. It is a view showing an example of selecting an image of an exercise lecture from among the captured images, and FIG. 10 is a diagram illustrating an example of selecting an image of an exercise lecture while providing an exercise mission according to an embodiment of the present invention.

Referring to Figure 8, the exercise lecture providing system 10 according to an embodiment of the present invention using a plurality of cameras (230a, 230b, 230c) a plurality of characters (P1, P2, P3) appearing exercise You can record lecture videos.

Also, referring to FIG. 9 , the exercise lecture providing system 10 according to an embodiment of the present invention may assign identification numbers A1 to A3 to a plurality of characters P1 , P2 , and P3 . At this time, the display module 280 of the instructor device 200 includes a first image 280a captured by the first camera 230a, a second image 280b captured by the second camera 230b, and a third camera. The third image 280c photographed at 230c may be simultaneously displayed.

In addition, the instructor device 200 may select the first exercise lecture image 280d to be streamed through the network from among the images 280a, 280b, and 280c. For example, the instructor device 200 may select the first image 280a captured by the first camera 230a as the image 280d of the first exercise lecture as shown in FIG. 9 .

Referring to Figure 10, the exercise lecture providing system 10 according to an embodiment of the present invention is an identification number for each character so that the identification number of the character to which a specific identification number (A2) designated as an exercise assistant is kept constant. tracking information. Here, the instructor device 200 selects the second exercise lecture image 280e to be streamed through the network from among the images 280a, 280b, and 280c while providing the exercise mission to the students, and transmits the selected image to the network. You can stream through For example, the instructor device 200 may display the second image 280b captured by the second camera 230b in which the character to which the specific identification number A2 is assigned is most visible, the image of the second exercise lecture. You can select (280e) and stream it over the network.

In addition, the instructor device 200 may set various types of exercise missions that students who watch an exercise lecture video can follow ( S306 ). Here, the exercise mission may include a second type of exercise mission that follows the movement of the exercise assistant in real time.

Then, the instructor device 200 recognizes the motion of the character assigned a specific identification number (A2) designated as an exercise assistant. And, the instructor device 200 may recognize the skeleton data of the exercise assistant by analyzing the captured image and motion of the exercise assistant (S308, S310).

Then, the instructor device 200 may analyze the skeleton data of the exercise assistant to generate the exercise mission definition data, and transmit the generated exercise mission definition data to the exercise lecture management server 100 (S312).

Then, the present invention may include the step of providing the second type of exercise mission to the students who watch the exercise lecture. In this case, the step of providing the second type of exercise mission is a step of setting the start time of the second type of exercise mission, recognizing the two-dimensional coordinate value or three-dimensional coordinate value data of the joints of the exercise assistant in the image of the exercise lecture The method may further include generating and transmitting the movement assistant motion data including the joint coordinate value data and time information of the movement assistant to the student device, and setting the end time of the second type of movement mission. .

Therefore, the present invention sets the exercise mission to imitate the movement of the exercise assistant, recognizes the movement of the exercise assistant in real time to generate the exercise mission definition data, and the exercise mission definition data generated so that students can follow the exercise assistant. by providing students with various types of exercise missions and providing an environment where instructors can conduct exercise lectures in a more fun way.

11 is a process in which an exercise mission is set and provided to students according to the first embodiment of the present invention, the motion of the trainee performing the exercise mission is recognized, and exercise results and ranking information are generated and provided to instructors and students. This is a simplified flowchart. In this case, the following flowchart will be described using the same reference numerals in connection with the configurations of FIGS. 1 to 4 .

Referring to FIG. 11 , the exercise lecture providing system 10 according to the first embodiment of the present invention takes an image of an exercise lecture in the instructor device 200 and streams the image of the exercise lecture in real time through a network (S402) .

Then, the plurality of student devices 300-1 to 300-n receive an image of an exercise lecture streamed in real time, and output the received image of the exercise lecture on the display screen (S404).

In addition, the instructor device 200 may set various types of exercise missions that students who watch an exercise lecture video can follow ( S406 ).

Then, the instructor device 200 may designate an exercise assistant, recognize the motion of the exercise assistant, and generate exercise mission definition data (S408, S410).

In addition, the instructor device 200 may provide an exercise mission to the plurality of student devices 300-1 to 300-n and transmit the exercise mission definition data to the exercise lecture management server 100 (S412, S414).

And, when a student watching an exercise lecture image performs an exercise mission, the plurality of student devices 300-1 to 300-n may capture an image of the student and recognize the student's motion (S416).

In addition, the plurality of student devices 300-1 to 300-n may analyze the student's image and motion recognition data to generate the student's exercise mission performance result data (S420).

Also, the exercise lecture management server 100 may receive exercise mission performance result data from the plurality of student devices 300-1 to 300-n (S422).

And, the exercise lecture management server 100 compares and analyzes the exercise mission definition data of a specific exercise mission and the specific exercise mission performance result data of the students performing the specific exercise mission to determine whether the mission of the specific exercise mission has been accomplished. (S424).

In addition, the exercise lecture management server 100 may aggregate exercise scores for each student, generate ranking information, and provide it to the instructor device 200 and the student device 300 ( S426 to S430 ).

Therefore, the present invention provides exercise missions to students by setting various types of exercise missions while streaming an exercise lecture video, and analyzes and analyzes the results of exercise missions by recognizing the motions of students performing exercise missions. By processing the results and providing them to instructors and students, it provides an environment that not only induces students' interest and improves satisfaction, but also induces competition among students and increases fun and exercise effects.

12 is a second embodiment of the present invention that generates exercise mission basic data in the instructor device, generates exercise mission definition data in the student device, and the exercise lecture management server generates a grade of the exercise mission performance result with the instructor This is a flow chart that briefly shows the process of sharing to students. In this case, the following flowchart will be described using the same reference numerals in connection with the configurations of FIGS. 1 to 4 .

Referring to FIG. 12 , the exercise lecture providing system 10 according to the second embodiment of the present invention captures an image of an exercise lecture in the instructor device 200 and transmits the captured exercise lecture image to the student device 300 through a network. to (S502 and S504).

Here, the exercise lecture providing system 10 provides the image of the exercise lecture to the student device 300 in real-time streaming, or after the exercise lecture management server 100 stores the exercise lecture image in the DB, the student device 300 ) may provide an exercise lecture image stored in the DB to the student device 300 at the request.

Then, the plurality of student devices 300-1 to 300-n receive the streamed exercise lecture image, and output the received exercise lecture image on the display screen (S506).

In addition, the instructor device 200 may set various types of exercise missions that students watching an exercise lecture video can follow, and may generate exercise mission basic data consisting of an exercise operation type and an exercise mission execution time value ( S508 and S510).

In addition, the plurality of student devices 300-1 to 300-n may receive the basic exercise mission data and generate exercise mission definition data based on the received basic exercise mission data (S512 and S514).

Here, the exercise mission definition data includes the student's height, weight, gender, blood pressure, pulse, body temperature, recent exercise mission performance history, possessed diseases, current pain level for each body part, current ranking, current training level for each body part, or current At least one of the target number of repetitions per set of the exercise motion, the total number of sets of the motion motion, the appropriate range of motion for each joint in the motion motion, or the length of rest time between sets and sets according to at least one or more of the overall body grades. One may be set differently according to user customization.

In addition, the plurality of student devices (300-1 to 300-n) generate exercise mission performance result data of students performing an exercise mission, and provide the generated exercise mission performance result data to the exercise lecture management server 100. It can be done (S516 and S518).

In this case, the plurality of student devices 300 - 1 to 300 - n may provide the exercise mission definition data generated by the respective student devices to the exercise lecture management server 100 .

And, the exercise lecture management server 100 may aggregate the grades for the exercise mission performance results of the trainees, and selectively share the exercise mission performance grades to the instructor device 200 and the trainee device 300 (S520). and S522).

13 is a third embodiment of the present invention, by recognizing the motion of the exercise assistant with respect to the exercise lecture image stored in the exercise lecture management server according to the third embodiment of the present invention, generating and providing exercise mission definition data, and collecting the exercise mission performance result data of trainees This is a flow chart that outlines the process of sharing with instructors and students. In this case, the following flowchart will be described using the same reference numerals in connection with the configurations of FIGS. 1 to 4 .

Referring to FIG. 13 , the exercise lecture providing system 10 according to the third embodiment of the present invention captures and records an image of an exercise lecture in the instructor device 200 , and uses the recorded exercise lecture image on the exercise lecture management server 100 . ) is provided (S602).

Then, the instructor device 200 may set the second type of exercise mission, and may set a value of a start time for following the exercise assistant and a value of an end time for following the exercise assistant for the second type of exercise mission (S604).

Then, the exercise lecture management server 100 stores the image of the exercise lecture provided by the instructor device 200 in the DB (S606). Thereafter, the exercise lecture management server 100 may provide the image of the exercise lecture stored in the DB to the student device 300 according to the request of the student device 300 .

In addition, the exercise lecture management server 100 recognizes the exercise assistant motion in the image of the exercise lecture, and generates the exercise mission definition data (S608 and S610).

Here, the exercise lecture management server 100 calculates the two-dimensional coordinate value or three-dimensional coordinate value data of the joints of the exercise assistant from the motion of the exercise assistant, and the movement assistant motion including the calculated joint coordinate value data and time information data can be generated.

Then, the exercise lecture management server 100 may provide the exercise mission definition data together with the exercise lecture image stored in the DB to the student device 300 (S612).

Then, the plurality of student devices 300-1 to 300-n receive the image of the exercise lecture and output the received image of the exercise lecture on the display screen (S614).

In addition, the student device 300 recognizes the motion of the student performing the exercise assistant following mission, generates the exercise mission performance result data about how accurately the student followed the timing, and the generated exercise mission performance data is provided to the exercise lecture management server 100 (S616 and S618).

Then, the exercise lecture management server 100 aggregates the exercise mission performance data of the trainees, and makes a list of trainees whose accuracy of following the exercise assistant among the trainees is a certain value or more to the instructor device 200 and the trainee device 300 . share (S620 and S622).

As described above, in the exercise lecture providing system and the exercise lecture providing method using the same according to an embodiment of the present invention, various types of exercise missions are set while streaming the exercise lecture video online, and the set exercise mission is used to view the exercise lecture video. It provides an environment that can induce students' interest and improve their satisfaction by providing them with user-customized information.

In addition, the present invention recognizes the motion of the students performing the exercise mission, analyzes the performance result of the exercise mission, and provides it to the instructor and the students, thereby inducing competition among the students and creating an environment that can increase the fun and exercise effect. to provide.

In addition, by comparing the exercise mission definition data of the exercise mission with the exercise mission performance result data of the students, it is judged whether the exercise mission has been achieved, and based on the judgment result, the exercise performance and ranking information for each student are generated and provided to the instructor and students. By doing so, it provides an environment that can make exercise lectures more fun and induce competition among students.

In addition, when the present invention provides an exercise mission for repeatedly performing an exercise movement shared in advance between an instructor and a student, by setting the number of repetitions of the exercise movement differently for each student's ranking or grade, a differentiated exercise mission for each student and provide an environment that can improve student satisfaction.

In addition, the present invention sets an exercise mission that imitates the movement of the exercise assistant, recognizes the movement of the exercise assistant in real time and generates exercise mission definition data, so that the instructor can create various types of exercise missions to make exercise more fun. provide an environment where

In addition, in the present invention, when a plurality of characters are recognized in the exercise lecture image, an identification number is assigned to each character, and the identification number and the character are matched to display in the exercise lecture video, as well as the instructor designates an exercise assistant It provides an environment in which exercise lectures can be conducted more effectively by changing or

In addition, the present invention recognizes the motion of the exercise assistant while tracking by giving an exercise assistant marking number to a character designated as an exercise assistant among the characters in the image of the exercise lecture, and the camera angle suddenly changes during the exercise lecture. Even if it is changed, the exercise assistant is not unintentionally changed to another character or de-designated, providing students with a stable environment to follow the exercise assistant mission.

The embodiments of the present invention described above are not implemented only through the described apparatus and method, and may be implemented through a program for realizing a function corresponding to the configuration of the embodiment of the present invention or a recording medium in which the program is recorded. Such a recording medium may be executed not only in the server but also in the student terminal.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improved forms of the present invention are also provided by those skilled in the art using the basic concept of the present invention as defined in the following claims. is within the scope of the right.

Claims (1)

A recording module that creates an exercise lecture video by recording an instructor,
By recognizing the motion of the instructor to generate skeleton data, and recognizing the skeleton data at predetermined time intervals in the photographed image of the instructor, or by recognizing the input signal input through the input module or the instructor's voice signal, the Motion recognition module that recognizes skeleton data,
A mission setting module for setting an exercise mission while the image of the exercise lecture is streaming, setting an exercise mission that follows the instructor's motion in real time, and generating exercise mission definition data of the exercise mission based on the skeleton data, and
The image of the exercise lecture is transmitted to the student device through the network, and the skeleton data or the exercise mission definition data derived according to the input signal of the input module or the voice signal at regular time intervals or by the student device or the exercise lecture management server communication module to transmit
Instructor device that provides exercise lectures and user-customized exercise missions, including.

Images